tag:blogger.com,1999:blog-9238405.post1835585678169065935..comments2015-07-29T10:26:03.227-07:00Comments on Agile Testing: Lessons learned from deploying a production database in EC2Grig Gheorghiuhttp://www.blogger.com/profile/17863511617654196370noreply@blogger.comBlogger9125tag:blogger.com,1999:blog-9238405.post-58173917255141770412011-05-05T13:47:36.414-07:002011-05-05T13:47:36.414-07:00@DaniKrom -- glad the post was useful to you. To a...@DaniKrom -- glad the post was useful to you. To answer some of your questions:<br /><br />1) I haven&#39;t used Rightscale. I try to use OpenSource/portable solutions whenever possible. I can deploy Chef in any infrastructure, be it cloud or data center. Same w/ Puppet.<br /><br />2) We&#39;re probably going to move our DB servers back in the data center, on high performance hardware. I don&#39;t think there&#39;s any ideal solution currently in &#39;the cloud&#39; in terms of I/O -- with maybe the exception of Joyent, which I haven&#39;t looked at deeply yet.<br /><br />3) Don&#39;t take my word regarding the striped EBS solution. I think it&#39;s highly dependent on your data access patterns, so I strongly advise you to run some benchmarks, ideally with production-grade data, and at the DB layer, not only at the disk I/O layer.Grig Gheorghiuhttp://www.blogger.com/profile/17863511617654196370noreply@blogger.comtag:blogger.com,1999:blog-9238405.post-12630945326802437052011-05-05T13:41:51.475-07:002011-05-05T13:41:51.475-07:00Excellent post!
We have a similar setup on AWS, an...Excellent post!<br />We have a similar setup on AWS, and are also on the verge of engaging Percona. Your post answered a handful of my best-practices questions.<br /><br />You mentioned you use Chef. Do you have any opinions on Rightscale&#39;s service?<br />We&#39;ve (very happily) been using Rightscale from the beginning, as they provide a lot of &quot;canned&quot; features like server logging, alerting, and the equivalent of Chef for putting servers together, among many other things.<br />They support AWS and Rackspace.<br /><br />Also you seem to indicate that you&#39;re moving away from using EBS completely. The question is to what? Are other cloud provider&#39;s equivalent network disks any more reliable? Besides the recent EBS outage did you regularly have EBS problems?<br />Based on your blog, my thought is to use 2-4 EBS volumes with RAID mirroring to gain reliability. You mentioned that in practice, you found that striping EBS volumes doesn&#39;t buy you performance, which is a bit surprising to hear -- you saved me the trouble of testing out this &quot;common wisdom&quot; that I&#39;ve read as best-practices in other blogs.DaniKromhttp://www.blogger.com/profile/16043004818130232080noreply@blogger.comtag:blogger.com,1999:blog-9238405.post-63360840025251437052011-05-05T01:03:01.201-07:002011-05-05T01:03:01.201-07:00Nice and detailed recovery on EC2 outage.Nice and detailed recovery on EC2 outage.Rodneyhttp://www.capsunlock.netnoreply@blogger.comtag:blogger.com,1999:blog-9238405.post-45322956628972486882011-05-02T06:02:09.899-07:002011-05-02T06:02:09.899-07:00Nice writeup.Nice writeup.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-9238405.post-57177289927378108462011-04-29T07:43:27.280-07:002011-04-29T07:43:27.280-07:00Great post! Thanks for sharing so many great detai...Great post! Thanks for sharing so many great details about your approach and what has worked for you.Brandon Craig Rhodeshttp://www.blogger.com/profile/04530745611634767785noreply@blogger.comtag:blogger.com,1999:blog-9238405.post-52410154852087672522011-04-27T23:28:52.837-07:002011-04-27T23:28:52.837-07:00Bine ca ai mai putuu trece din experienta ta pe b...Bine ca ai mai putuu trece din experienta ta pe blog , cred ca este utila pentru toti,Gheorghe Gheorghiuhttp://www.blogger.com/profile/14367388481676297817noreply@blogger.comtag:blogger.com,1999:blog-9238405.post-23795701189808848092011-04-27T14:03:58.988-07:002011-04-27T14:03:58.988-07:00Chris -- mysqldump was a known quantity at the tim...Chris -- mysqldump was a known quantity at the time when we devised our backup-to-disk strategy. I want to look into xtrabackup too when it comes to incrementals.Grig Gheorghiuhttp://www.blogger.com/profile/17863511617654196370noreply@blogger.comtag:blogger.com,1999:blog-9238405.post-24307837748984291612011-04-27T13:50:16.612-07:002011-04-27T13:50:16.612-07:00Nice detail on a real world operations outage. The...Nice detail on a real world operations outage. There comes a time when you need to remove the abstraction layer to gain performance. Thanks for sharing.Edwinhttp://edwin.ionoreply@blogger.comtag:blogger.com,1999:blog-9238405.post-63132470028216362692011-04-27T13:50:07.829-07:002011-04-27T13:50:07.829-07:00What is the reason for using mysqldump instead of ...What is the reason for using mysqldump instead of xtrabackup on those short time frame/incremental backups you are doing? It would seem that xtrabackup would probably be a bit friendlier for that?Chrishttp://www.blogger.com/profile/05264308689747583781noreply@blogger.com