4 years at Engine Yard, what a long strange trip it's been.

Posted by ezmobius Fri, 13 Aug 2010 08:27:00 GMT

So by now most folks who know me know that I have resigned from the startup I co-founded, namely Engine Yard Inc. It’s a long strange story that has lead up to this point and a lot of it I cannot speak of but I am going to give a short history of a 4 year startup that took $38million in VC money over 3 rounds and my view from the cockpit and trenches both.

Back in February of 2006 Ruby on Rails was still in it’s infancy and things were still changing very fast with regards to deployment especially. It was obvious that Rails was going to be a smashing success and I had actually launched one of the first commercial Rails applications in late 2004 when I worked at the Yakima Herald-Republic newspaper in Yakima WA. They had a website already written in PHP that got about 250k uniques/day, so not a small amount of traffic but it was no twitter or anything like that. Still back then almost no one knew how to efficiently deploy Rails apps and scale them without them falling over. And the landscape was going through major changes, CGI, webrick, Fast-CGI, mod_ruby, mongrel etc. With a plethora of front end static file web servers to put these things behind.

I was the only technical person at the whole newspaper and I was tasked with rewriting their entire website, intranet and classified and obituary entry system. THey had a small data center in the newspaper building and they bought me two Apple X-Serves and said “here you go, your Rails application must take the 250k uniques on day one without faltering or we will roll back to the php app and you will be in hot water buddy”

So I had to become the deployment expert in the Rails community, if you search the ruby on rails mailing lists from 2004-2007 you will find literally thousands of my posts helping folks figure out how to deploy and keep their apps running. I was approached by Dave Thomas of the Pragmatic Programmers and asked if I’d like to write a book on Rails Deployment. “Hell yeah I’d like to write that book I said”. Little did I know how much work that was going to be with all the changes Rails deployment was about to go through. But it gave me a name in the community as the “Rails Deployment Expert”. And I did finally finish the book “Deploying Rails Applications” 2 years later with the help of two other authors. But I rewrote most of the book a few times as things changed so often.

Anyway back to February of 2006, Tom Mornini and Lance Walley called me up out of the blue(I did not know either of these guys before this call) and told me about an idea they had to build a “Rackspace for Rails”. They asked if I was interested and said they found me through my thousands of posts on the rails mailing list and my Pragmatic beta book and figured I was the obvious expert to help them build their vision. So I agreed to become the 3rd founder with them and we started the planning stages of what was to become Engine Yard Inc.

The first Railsconf was in June of 2006 and we had a teaser website up and I was giving a talk on Rails Deployment at the conference. I announced the then vaporware Engine Yard as my “One more thing” at the end of my speech and linked to our site where we took emails.

We rounded up about $120k by begging, borrowing and stealing(not really) from friends and family. I must admit that Tom and Lance raised most of this first money here while I was busy writing the first code for Engine Yard. We raised this seed money in August of 2006 and that was when I quit my full time job and took the plunge. We all flew down to Sacramento where we had rented our first rack at Herakles data and bought our first 6 Super-micro servers and first Co-Raid JBOD disk array.

I still remember building the servers and racking them while at the same time fast talking folks on the phone trying to sell early accounts on our not yet running first cluster.

Now you need to know that this was way back before everything was “Cloud” Amazon had not yet come out with EC2 or any hints of it. But we knew what we needed to make our vision happen so we ended up building a cloud before the word cloud meant what it means today. We went with Xen and commodity pizza boxes and hand rolled automation written in ruby and python.

At this point Tom and I had realized we were out of our league with the low level linux, Xen, networking and basic ponytail type of stuff. This is when we took on our 4th founder Jayson Vantyl. He was the guy answering all our Xen and coraid questions on the mailing lists just like I had been the guy answering the rails deployment stuff. So we first hired him as a contractor and flew him out to help build our first cluster. We quickly realized we needed this guy as the 4th founder and made him an offer and he joined the company as the 4th and final founder in September I believe of 2006.

So we were able to cobble together our first cluster and get it working well enough to take some trusting early customers. I personally hand deployed the first 80 or so customers. I mean I literally took their app code and worked with them to learn about their app, and personally wrote the caspistrano deployment scripts for each of these customers myself. I was the only support staff on call 24/7 for the first year as far as application support went and Jayson was the only cluster support guy for the first 6 months or so as well.

I quickly built up a collection of best practices and a set of automation tools that let me do this easier and easier for each new customer. Slowly building out our Engine Yard automation toolkit.

I was also responsible for putting together the “Rails Stack” we used. Jayson chose Gentoo linux because that was what he was most familiar with and it was the distro we could hand optimize to get the best speed and flexibility out of. But I built the entire stack that ran after a blank VM was online with networking, storage and all that jazz.

I chose Nginx, Mongrel, Mysql, Memcached, Monit, Sphinx and a handful of other open source items that we made custom builds of highly tuned for ruby and running Rails apps as fast as possible. Many of you will remember me sharing my nginx and other configs on this blog and I am sure that my nginx.con for running rails apps with mongrel clusters is probably one of the most widely used nginx.conf files in existence ;)

Fast forward a year or so and we hired a few folks to help me. We were having massive success. Hardly any other hosting companies knew how to host, scale and keep rails apps online. We specialized in rails apps only and we also did the full white glove service. Anything you needed you could file a ticket for and we would bend over backwards to help you get it done.

We helped many folks get through slashdottings and digg and techcrunch ‘attacks’ by temporarily giving them more ram or cpu or bigger databases and then scaling them back down after the onslaught was over. We were one of the first hosting companies to be truly ‘cloud like’ IMHO. EC@ came out in 2007 and looking back if it had come out before we built our own cloud I would have chosen to use them as a substrate instead of building our own cloud. But also looking back I think rolling our own gave us a unique perspective on the whole thing as we have seen the cloud stack all the way from the blank cages to the PaaS we currently run on top of Amazon.

But in late 2008 I was between projects and we had taken our series B VC round which included Benchmark, NEA and Amazon as investors. So I decided to go off into a cave for a month or two and see if I could decouple our ‘stack’ from our hardware and make it run on top of EC2. It took me about 6 weeks to have a working prototype of what is now called AppCloud. I’d like to shout out here to Adam Holoway from Opscode here for training me on how to use Chef. I hired him for 3 days to come down and help me convert my Engine Yard automation system that was mostly based on capistrano to chef and a central gui to manage it. He helped me jump start the whole thing and Engine Yard owes him and Opscode a debt of gratitude. We were the first company to use chef commercially, heck we even used chef in production for pay before opscode did! So big ups Adam.

This was all done in october and november of 2008. Then I showed it to the rest of the company and we started to build a team around me to help productize the prototype spike and thus was born AppCloud.

We launched it in late January 2009 as Engine Yard Solo as it started out only managing single machines at a time with the app servers, database servers and cache servers all running on one box. The only way to scale was to move to a bigger EC2 instance. But we launched and pretty fast too!

We started taking customers rapidly and taking customer feedback to rapidly iterate the system. By the end of the summer of 2009 we launched Engine Yard Flex(horrible names here, bear with me) which was the same system but supported full clusters on EC2 with load balanced self healing application tiers, Database tiers with read only slaves and utility servers so anything that didn’t fit into the other two boxes like nosql databases or search engines etc.

Then we took on even more customers and rapidly iterated on this until it was pretty nice and solid. The team has been doing this ever since and now there are way over 1000 customers on AppCloud(we removed the solo and flex names and just called it AppCloud). Many features have been added and the current incarnation of AppCloud is the vision I had in my head when we first started Engine Yard way back in 2006. We just were victims of our own success and could not deploy customers fast enough to get free time to build the automated system that AppCloud is today.

And we started moving people out of our own data center and off our own cloud onto AppCloud as it got more and more featureful. As far as I see it there is zero value in racking and stacking servers anymore. The money is going to be in management platforms for other peoples IaaS clouds like EC2 and others that are popping up all over the place.

But I believe the true future of cloud computing for developers is to not think about servers at all. It is now time to focus on the Application and new levels of abstraction that allow folks to use the computing resources in easier and easier ways.

So here it is the summer of 2010, I’ve been working my ass off at Engine Yard for 4 years now pouring every ounce of blood sweat and tears that I could muster to make it the best it could be.

February of this year my wife Regan and I had a beautiful baby boy named Ryland and that changed the game entirely. Now is the time for me to focus on spending as much time with my son and family as I can and I can no longer commit to 100 hour weeks at Engine Yard. I also wanted to move to Portland where my folks live so my son can grow up near his grandparents and my wife and I can have trustworthy babysitters so we can have a social live of our own(even if it’s just a little bit;)

After 4 years at Engine Yard I was so close to being fully vested on my stock that I decided to resign and leave the company in the competent hands and team that has been built up there over the years. I wish all of you the very best and will be watching closely to make sure you make me a ton of money someday when you sell the company like you promised me you would ;)

So here we are at the beginning of a new era. What comes next for me? Something truly awesome and even more challenging then Engine Yard, but that will allow me to work from home in Portland. I cannot yet reveal where I am going to work next but I can promise it will be another game changing project and I am chomping at the bit to get started.

I will make another post when I am allowed to reveal my new job and what I will be working on, but for now I just wanted to write down a short history of “Engine Yard, the Good Times”. Don’t get me wrong it has definitely not all been roses and taking lots of VC money is a hard thing to do and keep the balance of your vision of a company. But I believe I did the best I could for Engine Yard, I gave them many great inventions and lots of good code and I practically hired most of the devs, ops and support folks there just by knowing them from online or at conferences or by working with them on open source projects or talking with them on irc. That is the new way to build companies, College degrees don’t matter much IMHO anymore, for developers anyway. It’s more how you interact with the open source community and what you release yourself. Your github account has become your new resume and what you say on Twitter and in various IRC channels are more likely to get you the best jobs then any recruiters ever will.

I just want to say a fond farewell to Engine Yard and all my people there. I wish you all the best of luck and I know you will be a success with all the smart folks that work there.

It was just time for a new challenge for me, time to move on and time to focus a bit more on family then on startup life 24/7.

Farewell fond memories and friends at the Yard, I will miss each and everyone of you. Oh the stories I could tell if only I could. But I feel that telling this positive story of the history of EY is the classy way to go out and I wish Engine Yard all the best in the world.

Tags , , , ,  | 64 comments

Comments

  1. Dr Nic said about 2 hours later:
    That's a wonderful story of 4 years well spent! Bravo!
  2. Kieran Masterton said about 2 hours later:
    An amazing story and an incredible achievement.
  3. Sam Aaron said about 2 hours later:
    An incredible story. Thanks for sharing it with us. I do hope that you really enjoy your time with your new family.
  4. Steve Odom said about 2 hours later:
    I don't know any of the other EY founders, but EY seemed to be the perfect reflection or embodiment of *you* - from the ridiculous customer service, the incredible support for open source projects, and its deep influence on best-practice rails deployment. They are going to miss you. I look forward to what you're going to do next. Best of luck, bro.
  5. Roger said about 3 hours later:
    Think you mean Adam Jacob at Opscode.
  6. Jan Wikholm said about 3 hours later:
    Thanks for this post Ezra! I was just saying on IRC that I recall the time when all nginx docs were in Russian and your conf was the only piece in English - massive props for that! Best of luck! // unfo-
  7. hernan43 said about 3 hours later:
    I left a job so that my wife and I could raise our children near their grandparents as well. Totally worth it. I didn't have most of my grandparents when I was a kid and it has been really great getting to see my daughter with them. I think we (and you) made the right decision.
  8. Jamie van Dyke said about 3 hours later:
    Hey mate, it was a pleasure working with you at Engine Yard and I hope you get as much time with your family as you want. I'll bump into you at a conference sometime or when I get over to Portland to catch up with some old friends. Say hi to Regan for me and I'll speak to you soon!
  9. Amy Hoy said about 3 hours later:
    Hearty congrats! On choosing, and what you've accomplished so far. I know whatever you do next will kick ass. It's been amazing to watch Engine Yard from afar, ever since Workshop for Good. I know I never said it, but I've always been impressed by what you've achieved and proud to be able to say I knew you when. ;)
  10. pablete said about 3 hours later:
    Nice! Congrats man. Wish you well in the new road you have to walk. You have always been one of my heros ;) (I think I still have nginx.conf borrowed from an old post of yours hanging in one of my servers)
  11. Kevin Smith said about 3 hours later:
    Best of luck on your new gig and I hope you get all the time you want with your family! It was a pleasure working with you at EY (ah, the good ol' days of Vertebra :-)
  12. Rev. Rog - Roger.Baker(a)rogerbaker.net said about 3 hours later:
    Don't forget, Ryland 1.0 is your legacy, all the rest is just fun & shelter. The product that will survive (if you do your best work) is Ryland. Imagine what a great kid you'd have if you spend 100 hours a week on him. ;-) Have fun, be smart, enjoy! best wishes -Rev. Rog
  13. Julio Javier Cicchelli said about 4 hours later:
    Great insight on one of the most successful companies mounted around Ruby and Rails. I particularly have to thank you for releasing Merb! That framework was the first step to my Ruby life without Rails. ;) Now go and enjoy your family, you deserve it man! Rock On!
  14. Celso said about 4 hours later:
    Hi Ezra, really nice story. I really enjoyed the last part where you mention that the money will be in application management instead of IaaS (more AppEngine, less EC2?) as I share your opinion. I'm hoping that your next project is on this space, it could use a nice boost.
  15. Senthil Nayagam said about 4 hours later:
    I have couple of parallels with your history. we started RailsFactory in 2006, we through nthid (client) were one of engine yard's early customers. I remember your mails for our code and deployment process, you were friendly. You have made significant contribution to ruby and rails community at various levels a) Merb -> Rails 3 b) VC funding for Rails based business c) supporting alternate ruby implementation Rubinious , Jruby etc looking forward for your future announcements
  16. Alex said about 4 hours later:
    Great story, and I wish you the best of luck with your family and your future endeavors. Excited to hear what you do next!
  17. Falk said about 5 hours later:
    Very interesting post - thanks for sharing this! Wise decision to place your family at #1, keeping it all balanced. Only well balanced developers produce well balanced code! ;)
  18. Alexander Ainslie (@AAinslie) said about 5 hours later:
    A really wild guess: @Banksimple next?!
  19. chetan.muneshwar@gmail.com said about 5 hours later:
    Hello Ezra, When it come to interacts with Ey we always find Ezra to answer and resolution ,all the best for Your Game changing plan we waiting for it.
  20. Roland said about 5 hours later:
    Very interesting and impressive Story! Best of luck to yo., I am sure we'll see more great things from you. :-)
  21. Justin Pease said about 5 hours later:
    Thanks for everything. Your articles, your code, and even a job. Can't wait to see what you do next!
  22. Salman said about 6 hours later:
    Great writeup on your experiences. It's nice that you are putting your family first and at the same time found a way to work from home. Looking forward to what you have up your sleeves :)
  23. Bumi said about 6 hours later:
    A really great story and great insights in one of the most important company in the Rails world. ;) I was one of those learning a lot of your posts and config files. Thanks so much and all the best for your next project(s)!!
  24. Mike Champion said about 6 hours later:
    Hey Ezra, great story. I remember hearing you speak at the 1st RailsConf announce EY, and being excited because deploying Rails was so painful at that time. And as a current EY Cloud customer you've really helped move the whole Rails community forward. Thanks for all the hard work!
  25. Mark Carey said about 7 hours later:
    I think it's awesome that you are making these decisions for your family. Your contribution to the various communities you participated in is well appreciated. In fact a huge part of my affinity for EY was because of your presence and demeanor in the community. I'm sure you will be missed.
  26. James Edward Gray II said about 7 hours later:
    I'm glad to hear you had a good ride. I look forward to more game changers from you. I know you're not done yet!
  27. Zack said about 7 hours later:
    As an early Rails dev back in the day I know how much you helped countless devs the community on mailing lists and your blog posts to deploy early apps. So give yourself a huge pat on the back and take some time to enjoy your son. I'm sure excited to hear about your next project in the tech world... Again, thanks for all your contributions!
  28. Justin Chen said about 7 hours later:
    Hey Ezra, congrats on the all the success, your new son and your transition to the next big thing! I still remember back in early 2007 when you pitched us the web GUI vision over the phone and then manually migrated us over to EY. Good times. Glad we stuck around long enough to see it come to fruition with AppCloud.
  29. Shai said about 7 hours later:
    Thank you for everything you've done at Engine Yard! You've been the face, and you'll be deeply missed.
  30. Martin Emde said about 7 hours later:
    I'm glad I got a chance to work with you, even if it was only a small amount over the last year. Your son will appreciate the time you took to be with him. Best of luck to you!
  31. David Schmidt said about 8 hours later:
    I completely understand how children and family completely change the picture, and I bet you now understand better some of the choices I've made in my carreer, like my choice to avoid relocation. Best of luck in your new endeavors and I'll buy the beers next time I'm visiting my folks in Portland.
  32. David Parker said about 8 hours later:
    Congrats Ezra! Sounds like you had a fabulous learning experience. Best of luck in your future plans and family.
  33. Lance Walley said about 9 hours later:
    I'm printing this and going to read it over breakfast :-)... All of us founders should have kept a daily or weekly journal, because if I had to compile a history now, it would be tough!
  34. Justin Palmer said about 9 hours later:
    We'll have to arrange a play date when you make it to Portland. My son was born January of this year. I still remember the first real job I had working with Rails was with you. Little did I know that you'd help found a company that would really help my company get off the ground in its early days. Things might have worked out differently for us without your generosity. Thanks! I'm looking forward to see what you're working on.
  35. Mark Turner said about 11 hours later:
    Being a new father myself I completely understand the motivation you had to leave. You built a fantastic company and have contributed a ton to our community. Enjoy the R&R and I can't wait to see whats next for you. Thanks Ezra!
  36. Doug Hall said about 11 hours later:
    I remember the early days...ah, what fun! I am reliably informed that we were your first European customer - spoke to Tom about the trans-Atlantic conference call we had back then...BOOM, Moneyspyder was a customer...still is too! Love the product, the service, the tech and the story. Sir, you will truly rock in your next venture - best of luck and have fun.
  37. Bala said about 12 hours later:
    Great. Which irc's do you normally visit?
  38. Jayson Vantuyl said about 13 hours later:
    It was a pleasure, man. Keep fighting the good fight, and I know you'll kick ass wherever you go.
  39. Jayson Vantuyl said about 13 hours later:
    It was a pleasure, man. Keep fighting the good fight, and I know you'll kick ass wherever you go.
  40. Adam Michaels said about 13 hours later:
    Best of luck to you Ezra. It was great to be part of the EY story, if only for a little bit. Take it easy my friend.
  41. RobertF said about 13 hours later:
    As a Rub-noob, this must have been a fascinating experience. What a classy way to go out, too. I was expecting a a lot of dirt. Thanks for the book, too. I'll be reading it before I deploy my first Rails app later this year.
  42. Katari said about 14 hours later:
    Awesome story. Best of luck with your move. Moving closer to the grandparents is something we are contemplating as well.
  43. Richard Henry said about 17 hours later:
    Thanks for sharing this! Inspirational. What an amazing accomplishment -- your hard work couldn't have paid off any better.
  44. Brie McMahon said about 20 hours later:
    Thanks for all of your hard work. Thanks to Reagan for her sacrifice. I was so lucky to be part of early EY on the park. I miss those days. It was fun. Congratulations on the opportunities to come!
  45. Jonathan Marcus said about 20 hours later:
    Great post. Thanks for sharing!
  46. Luke Melia said about 21 hours later:
    Thanks for clearing the path and paving the road Ezra. All the best to you and your family.
  47. yes566 said about 21 hours later:
    Great post. Thanks for sharing! All the best :)
  48. Simon Russell said about 24 hours later:
    Good luck with everything, I just wanted to say thanks for your help getting everything working at Moneyspyder back at the start of 2007. We couldn't have started the business as easily without the help of yourself and EngineYard.
  49. foz said 1 day later:
    I was in the room at RailsConf when you gave that first presentation on scaling Rails. Mongrel? What's that? :) Thanks for all the great code. Good luck with your next amazing endeavor!
  50. Jaime Iniesta said 1 day later:
    It's amazing how a little baby can change your life and get you focused on the important details. Thanks for all you've built, and luck on your next adventure. :)
  51. Rudolf Olah said 1 day later:
    Could you tell us more about the hours you worked there? It's hard to imagine someone doing 100 hours of work per week.
  52. Damon Clinkscales said 1 day later:
    Congrats on what you've built and best wishes to what's next. Thanks for all you've given the Rails community. Enjoy Portland!
  53. Greg Herlein said 1 day later:
    Welcome to the world of balancing wife, job and *kids*. Not easy, but well worth it. While I'm not a Rails guy, I've followed your work these past years and been amazed at your success... which only happens from hard work and grit. Congrats on building something of value. Best of luck in your next venture.
  54. Mark Essel said 3 days later:
    Classy move Ezra. Say howdy to my friend Tyler Gillies in Portland. We're working on an app now that has a nice sized market. Curious what happens to the equity that was reserved for you based on vesting? Does it go to VCs, cofounders, or employees or an even mix? Best of luck with your refocusing on family and working from home. Inspiring tale :)
  55. John Athayde said 3 days later:
    Congrats! Good luck in your next endeavor! Looking forward to when you announce it!
  56. Lance Carlson said 3 days later:
    Best wishes to you and your son!
  57. Henning Koch said 3 days later:
    Thanks for sharing Ezra.
  58. Karl Statton said 4 days later:
    Well, it surely was nice to read this. I almost feel sorry to see you leave a company made with your bare hands. Incredible job. Incredible. Best wishes to your family, and to your professional plans. Meanwhile... what about giving some (more) love to your little wonderful and awesome Merb ? :-) :engineers_in_love_with_Merb << me
  59. Mike Bailey said 5 days later:
    One of the things I respect most is that you've always been happy to share your inventions and discoveries. Few hosting companies are willing to share their secret sauce.
  60. Steve Sanderson said 8 days later:
    Congratulations - eager to see what's next for you & have fun with your kid & family.
  61. Taylor said 13 days later:
    That's a pretty inspirational article. Thanks for your thoughts.
  62. Bala Paranj said 18 days later:
    This is shocking news. Better things are ahead! Good luck.
  63. Paul Hepworth said 33 days later:
    Thanks for all that you do, Ezra. Please tell me you are confounding a new venture with _why. ;) Best of luck and thanks for your inspiration!
  64. motorradbrillen.org said 40 days later:
    many thanks from your infos

(leave url/email »)

   Preview comment