Posts Tagged 'Scale'

Big data is only getting bigger. Late last year, SoftLayer teamed up with 10Gen to launch a high-performance MongoDB solution, and since then, many of our customers have been clamoring for us to support other big data platforms in the same way. By automating the provisioning process of a complex big data environment on bare metal infrastructure, we made life a lot easier for developers who demanded performance and on-demand scalability for their big data applications, and it's clear that our simple formula produced amazing results. As Marc mentioned when he started breaking down big data database models, document-oriented databases like MongoDB are phenomenal for certain use-cases, and in other situations, a key-value store might be a better fit. With that in mind, we called up our friends at Basho and started building a high-performance architecture specifically for Riak ... And I'm excited to announce that we're launching it today!

Riak is an open source, distributed database platform based on the principles enumerated in the DynamoDB paper. It uses a simple key/value model for object storage, and it was architected for high availability, fault tolerance, operational simplicity and scalability. A Riak cluster is composed of multiple nodes that are all connected, all communicating and sharing data automatically. If one node were to fail, the other nodes would automatically share the data that the failed node was storing and processing until the node is back up and running or a new node is added. See the diagram below for a simple illustration of how adding a node to a cluster works within Riak.

We will support both the open source and the Enterprise versions of Riak. The open source version is a great place to start. It has all of the database functionality of Riak Enterprise, but it is limited to a single cluster. The Enterprise version supports replication between clusters across data centers, giving you lots of architectural options. You can use replication to build highly available, live-live failover applications. You can also use it to distribute your application's data across regions, giving you a global platform that you can update anywhere in the world and know that those modifications will be available anywhere else. Riak Enterprise customers also receive 24×7 coverage, both from SoftLayer and Basho. This includes SoftLayer's one-hour guaranteed response for Severity 1 hardware issues and unlimited support available via our secure web portal, email and phone.

The business use-case for this flexibility is that if you need to scale up or down, nodes can be easily added or taken down as your requirements change. You can opt for a single-data center environment with a few nodes or you can broaden your architecture to a multi-data center deployment with a 40-node cluster. While these capabilities are inherent in Riak, they can be complicated to build and configure, so we spent countless hours working with Basho to streamline Riak deployment on the SoftLayer platform. The fruit of that labor can be found in our Riak Solution Designer:

The server configurations and packages in the Riak Solution Designer have been selected to deliver the performance, availability and stability that our customers expect from their bare metal and virtual cloud infrastructure at SoftLayer. With a few quick clicks, you can order a fully configured Riak environment, and it'll be provisioned and online for you in two to four hours. And everything you order is on a month-to-month contract.

Thanks to the hard work done by the SoftLayer development group and Basho's team, we're proud to be the first in the marketplace to offer a turn-key Riak solution on bare metal infrastructure. You don't need to sacrifice performance and agility for simplicity.

Chris Gardner (of The Pursuit of Happyness fame) said, "Find something that you love. Something that gets you so excited you can't wait to get out of bed in the morning. Forget about money. Be happy." Now I can't honestly tell you I'm able to "forget about money" or that I'm much of a morning person, but I'm quick to tell people that I love what I do. If you click through a few of the "Culture" posts on this blog, you'll read that I'm not alone. This week, I realized how many non-work interests SoftLayer plays a role in.

Beyond my closet-full of black and red shirts (many of which are visible in Tech Partner Spotlight video interviews on YouTube), even when I'm out of the office I find myself "checking on customers' servers" quite a bit ... I use quotes in there because that the justification I give myself for spending time (that I'd probably spend anyway) on platforms that leverage SoftLayer's infrastructure.

Because SoftLayer operates with an "Innovate or Die" mentality, we tend to attract customers that innovate in their own businesses. Whether that trend is intentional or not, it makes sense: Why would a fast-moving platform or application with massive growth and scaling needs be hosted with a provider taking "enterprise" time to provision a solution that ends up being "enterprise" only in name? "Enterprise Class" is not the same as "Internet Scale," and that distinction is pretty significant when a business might have one visitor on Monday and a million visitors on Tuesday. Platforms and applications that grow like that usually operate with a high level of what I like to call "awesomeness," so when they choose SoftLayer as a hosting provider, I feel like I need to investigate their awesomeness personally ... And that's how I've become a die-hard user of many of SoftLayer's customers.

One of my favorite customers to "check on" is Tumblr. If you aren't familiar with Tumblr, I recommend that you go to their site right now and immerse yourself in their community. I actually remember the day Tumblr signed on as a customer; I was genuinely excited that they'd be hosting on our platform. Even if that excitement was because I could justify having my Tumblr dashboard open in the background at work. I don't think anyone could have expected the platform to grow so phenomenally in a few years, but Tumblr's numbers are pretty staggering these days: 16.7 billion (yes, with a "B") monthly pageviews of 55.7 million blogs with 23.1 billion posts. I wasn't one of the first accounts on Tumblr, but I tell myself I have some kind of Tumblr cred ... And I use my "limited-edition" black background and Japanese dashboard logo to prove it:

Another SoftLayer customer who's gotten a lot of press over the past month or two is OMGPOP. OMGPOP scaled "Draw Something" to tens of millions of users on SoftLayer's infrastructure (which you probably know), but what you probably didn't know is that as "Draw Something" started growing in the market, it was also spreading virally in our office. You'd be amazed at how many SLayers caught the bug. Here's one of Steve Kinman's works of art from a recent game:

While Tumblr and OMGPOP manage to snag a good amount of my free time, my most recent obsession has been playing NomNom Combo from Eastside Game Studios. I had a chance to meet a few of the guys from Eastside Games at GDC this year, and George Karidis told me that I should download NomNom Combo to check it out before I went to the launch party we sponsored for them in San Francisco. As it turns out, he created a monster ... By the time the party rolled around, I had to tear myself away from strategizing the best way to move up the game's all-time "Top Score" leader board. Two months later, I can say that all of my efforts have been validated:

I guess if I had to make a long story short, if you have an addictive app or game that you want to move to the SoftLayer platform, it would be brilliant move from a growth and scaling perspective. One request I'd have is that you warn me, though. I want to have time to bury my head in the sand so I don't get hooked on more SoftLayer-powered goodness ... I'm running out of "free time."

SoftLayer's goal is to provide unparalleled value to the customers who entrust their business-critical computing to us — whether via dedicated hosting, managed hosting, cloud computing or a hybrid environment of all three. We provide the best platform on the market, delivering convenience, ease of use, compelling return on investment (ROI), significant competitive advantage, and consistency in a world where the only real constant seems to be change.

That value proposition is one of the biggest driving forces behind our partnership with RightScale. We're cloud computing soul mates.

RightScale understands the power of automation, and as a result, they've created a cloud management platform that they like to say delivers "abstraction with complete customization." RightScale customers can easily deploy and manage applications across public, private and hybrid cloud environments, unencumbered by the underlying details. They are free to run efficient, scalable, highly available applications with visibility into and control over their computing resources available in one place.

As you know, SoftLayer is fueled by automation as well, and it's one of our primary differentiators. We're able to deliver a phenomenal customer experience because every aspect of our platform is fully and seamlessly automated to accelerate provisioning, mitigate human error and provide customers with access and features that our competitors can only dream of. Our customers get simple and total control over an ever-expanding number of back-end services and functions through our easy-to-use Customer Portal and via an open, robust API.

The compatibility between SoftLayer and RightScale is probably pretty clear already, but if you needed another point to ponder, you can ruminate on the fact that we both share expertise and focus across a number of vertical markets. The official announcement of the SoftLayer and RightScale partnership will be particularly noteworthy and interesting in the Internet-based business and online gaming market segments.

It didn't take long to find an amazing customer success story that demonstrated the value of the new SoftLayer-RightScale partnership. Broken Bulb Game Studios — the developer of social games such as My Town, Braaains, Ninja Warz and Miscrits — is already harnessing the combined feature sets made possible by our partnership with RightScale to simplify its deployment process and scale to meet its customers' expectations as its games find audiences and growing favor on Facebook. Don't take our word for it, though ... Check out the Broken Bulb quote in today's press release announcing the partnership.

Broken Bulb and other developers of social games recognize the importance of getting concepts to market at breakneck speed. They also understand the critical importance of intelligently managing IT resources throughout a game's life cycle. What they want is fully automated control over computing resources so that they can be allocated dynamically and profitably in immediate response to market signals, and they're not alone.

Game developers of all sorts — and companies in a growing number of vertical markets — will need and want the same fundamental computing-infrastructure agility.

Our partnership with RightScale is only beginning. You're going to see some crazy innovation happening now that our cloud computing mad scientists are all working together.

SoftLayer is in the business of helping businesses scale. You need 1,000 cloud computing instances? We'll make sure our system can get them online in 10 minutes. You need to spin up some beefy dedicated servers loaded with dual 8-core Intel Xeon E5-2670 processors and high-capacity SSDs for a new application's I/O-intensive database? We'll get it online anywhere in the world in under four hours. Everywhere you look, you'll see examples of how we help our customers scale, but what you don't hear much about is how our operations team scales our infrastructure to ensure we can accommodate all of our customers' growth.

When we launch a new data center, there's usually a lot of fanfare. When AMS01 and SNG01 came online, we talked about the thousands of servers that are online and ready. We meet huge demand for servers on a daily basis, and that presents us with a challenge: What happens when the inventory of available servers starts dwindling?

Truck Day.

Truck Day not limited to a single day of the year (or even a single day in a given month) ... It's what we call any date our operations team sets for delivery and installation of new hardware. We communicate to all of our teams about the next Truck Day in each location so SLayers from every department can join the operations team in unboxing and preparing servers/racks for installation. The operations team gets more hands to speed up the unloading process, and every employee has an opportunity to get first-hand experience in how our data centers operate.

If you want a refresher course about what happens on a Truck Day, you can reference Sam Fleitman's "Truck Day Operations" blog, and if you want a peek into what it looks like, you can watch Truck Day at SR02.DAL05. I don't mean to make this post all about Truck Day, but Truck Day is instrumental in demonstrating the way SoftLayer scales our own infrastructure.

Let's say we install 1,000 servers to officially launch a new pod. Because each pod has slots for 5,000 servers, we have space/capacity for 3,000-4,000 more servers in the server room, so as soon as more server hardware becomes available, we'll order it and start preparing for our next Truck Day to supplement the pod's inventory. You'd be surprised how quickly 1,000 servers can be ordered, and because it's not very easy to overnight a pallet of servers, we have to take into account lead time and shipping speeds ... To accommodate our customers' growth, we have to stay one step ahead in our own growth.

This morning in a meeting, I saw a pretty phenomenal bullet that got me thinking about this topic:

Truck Day — 4/3 (All Sites): 2,673 Servers

In nine different data center facilities around the world, more than 2,500 servers were delivered, unboxed, racked and brought online. Last week. In one day.

Now I know the operations team wasn't looking for any kind of recognition ... They were just reporting that everything went as planned. Given the fact that an accomplishment like that is "just another day at SoftLayer" for those guys, they definitely deserve recognition for the amazing work they do. We host some of the most popular platforms, games and applications on the Internet, and the DC-Ops team plays a huge role in scaling SoftLayer so our customers can scale themselves.

Last week, I spent a few days at GDC in San Francisco, getting a glimpse into the latest games hitting the market. Game developers are a unique bunch, and that uniqueness goes beyond the unbelievable volume of NOS Energy Drinks they consume ... They like to test and push the IT envelope, making games more diverse, interactive and social.

The new crop of games showcased at GDC is more resource-intensive — it's almost like watching an IT arms race; they're upping the ante for all online gaming companies. The appetite from the public remains relentless, and the pay-off can be huge. Consider that gaming industry research firm DFC Intelligence predicts that worldwide market revenue generated solely from online games is set to reach $26.4 billion in 2015, more than double the $11.9 achieved in 2009.

That's where SoftLayer comes in. We understand the high stakes in the gaming world and have tailored our IaaS offerings for an optimal end-user experience that stretches from initial release to everyday play. Take a look at what game developer OMGPOP (a SoftLayer customer) achieved with Draw Something: Almost overnight it became the #1 application in Apple's App Store, tallying more than 26 million downloads in just a few weeks. To put the volume of gameplay into perspective, the game itself is generating more than 30 hours of drawings per second. That's what what we refer to as "Internet Scale." When YouTube hit one hour of video uploads per second, they came up with a pretty impressive presentation to talk about that scale ... and that's only one hour per second.

Gamers require a high-performance, always on, graphically attractive and quick-responding experience. If they don't get that experience, they move on to the next game that can give it to them. With our core strengths of automation and extensive network reach, game developers come to us to easily enable that experience, and in return, they get a platform where they can develop, test, deploy and yes, play their latest games. True "Internet Scale" with easy consumptive billing ... Get in and out quickly, and use only what you need.

Some of the most interesting and innovative use cases of how customers take advantage of our platform come from the gaming industry. Because we make it easy to rapidly provision resources (deploy dedicated servers in less than two hours and cloud servers in as few as five minutes) in an automated way (our API), many developers have started incorporating cloud-like functions into their games and applications that add dedicated resources to their infrastructure on-demand as you'd only expect to see in a virtual environment. Now that Flex Images are available, we're expecting to see a lot more of that.

As I was speaking with a few customers on the show floor, I was amazed to hear how passionate they were about what one called the "secret ingredient" at SoftLayer: Our network. He talked about his trials and tribulations in delivering global reach and performance before he transitioned his infrastructure to SoftLayer, and hearing what our high-bandwidth and low-latency architecture has meant for his games was an affirmation for all of the work we've put into creating (and continuing to build) the network.

The rapid pace of innovation and change that keeps the gaming industry going is almost electric ... When you walk into a room filled with game developers, their energy is contagious. We ended GDC with an opportunity to do just that. We were proud to sponsor a launch party for our friends at East Side Game Studios as the celebrated the release of two new games — Zombinis and Ruby Skies. Since their NomNom Combo puzzle game is one of the most addicting games on my iPhone, it was a no-brainer to hook up with them at GDC. If you want a peek into the party, check out our GDC photo album on Facebook.

To give you an idea of how much the gaming culture permeates the SoftLayer offices, I need only point out a graffiti mural on one of the walls in our HQ office in Dallas. Because we sometimes get nostalgic for the days of misspent youth in video arcades playing Pac Man, Donkey Kong and Super Mario, we incorporated those iconic games in a piece of artwork in our office:

If you are an aspiring game developer, we'd like to hear from you and help enable the next Internet gaming sensation ... Having a good amount of experience with our existing customer base should assure you that we know what we're talking about. For now, though, it's my turn to go "Draw Something."

This is a guest blog from Spot Influence. Spot Influence provides businesses with detailed information on who's influential in the world of social media and what those influencers actually care about. This data, accessed via an API, enables companies to react faster with more information and, more importantly, to be proactive and execute a strategic social media plan.

Discover the People Who Drive Your Business

If you're involved in marketing, you understand the importance of monitoring your business's community online. You also probably know that engaging with the "Influencers" who speak to your intended audience can be critical to understanding their needs and spreading your brand's message. But existing tools are limited in their ability to find these individuals. They don't allow you to sift through the noise and discover the people who are already impacting your business online.

Spot Influence is a data service that provides granular, actionable information to businesses about their online audience and the people who are influencing them. With this data, business can discover the key influencers they need to be paying attention to and gain valuable insight regarding their existing customers: their online profiles, where they publish and engage with content, and what they care about.

Solving this problem at scale is incredibly challenging. We deal with vast amounts of unstructured data, processing tens of millions of URLs and creating terabytes of data every day. That's why we're excited to be a SoftLayer customer and a part of the Technology Partners Marketplace. SoftLayer enables us to cost-effectively scale our machines to meet customer needs.

If you're interested in learning more about Spot Influence, please check out the following links and sign up for the Beta on our website!

This guest blog series highlights companies in SoftLayer's Technology Partners Marketplace. These Partners have built their businesses on the SoftLayer Platform, and we're excited for them to tell their stories. New Partners will be added to the Marketplace each month, so stay tuned for many more come.

A month ago, Summer talked about how SoftLayer defies the laws of physics by being in several different places at the same time. With a worldwide network and data center footprint, that's always going to be the case, but when we have several events going on in a given week, we're even more dispersed. As Summer mentioned in her Server Challenge blog this morning, she traveled east to New York City for ad:tech with a few SLayers, and I joined a team that headed west for Cloud Expo West in Santa Clara, California.

We set up shop on the expo floor and had the opportunity to meet with interesting and interested attendees between session. In addition to our exhibit hall presence, SoftLayer had three SLayers featured in presentations, and the response to each was phenomenal.

Our first presenter was none other than SoftLayer CTO Duke Skarda. His presentation, "Not Your Grandpa's Cloud," was about dedicated servers and whether cloud computing may be surpassing that "grandpa" of the hosting industry. Joined by RightScale CEO Michael Crandell, Duke also announced our SoftLayer's new relationship with RightScale. If you didn't have a chance to join us, we have a treat for you ... You can download Duke's presentation from Sys-con!

Five minutes after Duke left the stage, SoftLayer Director of Product Innovation Marc Jones spoke to Cloud Expo attendees about "Building at Internet Scale in a Hosted Environment." His focus was how businesses could enable technologies, design and architecture of Internet scale solutions in a hosted environment. He shared trends from SoftLayer customers and partners, explained what SoftLayer believes Internet-scale is from a technology perspective, and the products and services in the market that create a scalable solution.

On Day 3, SoftLayer Director of Corporate Analytics Francisco Romero presented a question to attendees: "How Smart is it to Build Your Own Cloud?" With concerns around security, hardware, software and flexibility, is a business better off going with a hosted solution over building its own cloud infrastructure. Spoiler alert: He showed how the hosted environment was head-and-shoulders over the in-house environment in most cases.

All in all, Cloud Expo West was an exemplary tradeshow for SoftLayer ... Three fantastic speakers in two days driving traffic to our booth where we could share how SoftLayer has built our cloud and how our approach is part of a bigger effort to drive innovation in the world of hosting.

As Summer mentioned in her post, we want to see your smiling faces at our booths and in our presentations in the future, so bookmark the SoftLayer Event Calendar and start planning your trips to meet us in 2012!

The Northeastern part of the United States saw two natural disasters within the span of five days of each other. The first was in the Washington, D.C. area: A 5.8 earthquake on August 23, 2011. On August 28, Hurricane Irene made her way up the east coast, leaving nearly 5.5 million people without power. We do everything we can to prepare our facilities for natural disasters (generator power backup, staffing, redundant bandwidth links and providers, etc.), and given the recent events, now might be a good time to start thinking about how your servers respond when something out of the ordinary happens ... Let's look at two relatively easy ways you can set your business up to scale and recover.

The first option you may consider would be to set up a multi-tiered environment by deploying multiple servers in various geographical locations. Your servers in each location could be accessed via load balancing or round robin DNS. In this kind of high-availability environment, your servers could handle the incoming requests more quickly with the load being split amongst the multiple data centers. The failover would be just a few seconds should you lose connectivity to one of the locations.

The second option to consider would be the private image repository for our CloudLayer Computing. This options allows you to save a private image template in different data centers, each ready for quick deployment without having to install and configure the same operating system and applications. Should you need additional resources or lose connectivity to your instance in one facility, you can deploy the saved image in another facility. The failover time would be only in the provisioning process of the Computer Instance ... which doesn't take too long.

Scalability makes sense no matter what situation you may be facing – from natural disaster to hitting the front page of Reddit. If you have any questions about these scalability options, "Click to Chat" on our site or give us a call and a sales rep can help you get prepared. Your infrastructure may have come through these recent events unscathed, but don't let that lull you into a false sense of security. The "It's better to be safe than sorry" cliche is a cliche for a reason: It's worth saying often.

Last week, Netflix made headlines when the company announced that it was moving most of its operations to Amazon Web Services' Elastic Compute Cloud. The news was greeted with enthusiasm and was seen as further justification of the public cloud. Rightly so: the fact that Netflix generates up to 20% of US traffic during peak times, and that this traffic is moving to the public cloud would seem justification to me. This is a great piece of advertising for the cloud (much better than Microsoft's "to the cloud" campaign), and by proxy a great piece of advertising for SoftLayer.

So why did Netflix make the move? Economics - plain and simple. It is less expensive to move to the cloud than it is to continue supporting everything via internal Netflix DCs. In a cloud model, peak traffic loads dictate Netflix's economics - they pay for peaks, but only when they occur. When traffic drops off, Netflix enjoys the resultant cost savings, plus they relieve themselves of a considerable management burden. The argument is straightforward.

All of this has brought me back to consideration of the "private" cloud (which is arguably not the cloud at all, but I digress) and the value that it offers. The industry definition of a private cloud is a cloud implementation that is internal to (still owned and operated by) a single enterprise. SoftLayer defines a private cloud a little differently: SoftLayer remains the IAAS provider, but we ensure that a customer is on a single node (i.e. server). This conversation will stick with the industry definition.

So, what are the impacts of the private cloud across an enterprise?

In theory, a private cloud would give individual departments or discrete project teams the ability to better manage cost. As with a public cloud, a project team would be able to take advantage of the cost savings that come with paying only for what they use. However, this means that change is necessary in corporate accounting functions given that systems now need to be managed based on a "pay as you go model" versus a cost center model. This means a fundamental change in IT philosophy, as they now need to bill departments working on a variable use model - all of a sudden they have to think more like a business unit with a P&L to manage.

The cloud provides the ability to quickly spin up and scale. In the SoftLayer world, this translates to availability in anywhere from 2-4 hours. This should mean an increase in operational efficiency across departments using the cloud. Projects can start and end quickly without concern for lengthy implementation or teardown windows. That said I am not sure this increase in efficiency is meaningful when balanced against an IT department that must build and support a cloud infrastructure that has to account for the operation across the entire enterprise. The impact is potentially great at a micro level, but wanes when you consider the larger picture.

From a planning point of view, IT must now consider what a variable use model means in practical terms. Different departments will experience different peaks and valleys based on different workloads. In all likelihood, these peaks will not align on the calendar, nor will they be consistent month over month. In addition, my assumption is that deployment of a cloud will engender unanticipated usage patterns given the supposed cost and operational flexibility that the cloud delivers within the enterprise. The challenge will be to balance these needs against the delivery of a service that will adhere to QoS promises and associated internal service level agreements. ( And I think they will have to exist. If IT moves beyond a cost center, and internal organizations are trying to budget based upon forecasted compute use, it only makes sense that IT will be held up against external providers. Indeed, I would expect some rogue departments to go off the reservation to external providers based on cost considerations alone.)

My guess is that the IT response to planning will be predictable - over-engineer the private cloud to make sure that it is bullet proof. This might work, but it will be expensive and will paradoxically lead to underutilization of what is an over planned resource - something the cloud is supposed to mitigate. This approach is also likely to lead to IT bloat as capable internal resources are likely to be thin, driving a round of hiring to ensure expertise is on hand to manage the cloud.

In addition, I would assume that some applications will continue to be supported (for a variety of reasons - security, I/O challenges), thus adding more cost to the equation.

The arguments against the private cloud are numerous and ought to give the enterprise pause for thought. Regardless, I am willing to bet that private cloud implementations will accelerate in the enterprise. Many companies are supported by IT organizations that are strong and well entrenched within the corporate culture. Part of the fight will be based around losing budget, headcount and perceived power if the decision is made to go to an external IAAS provider. All of the usual rubrics will be used: security, quality of service, performance and on the list goes. In essence, these are the same arguments that have been made in the past when a decision to outsource anything has come to the fore. Does it make sense to outsource everything? The answer is a resounding no, but the argument for looking to the public cloud, or SoftLayer's private cloud is strong.

As an amateur filmmaker, I strive to get my footage seen by as many people as possible. Shameless plug time - http://vimeo.com/14159857 . Most of the time, it is only 1 or 2 people per week but when a guy sells $50,000 for $200 people want to watch! Have you clicked the link yet?. My normal traffic is usually handled by a virtual machine without issues. But what happens when you instantly become popular?

This happened to me this weekend. A newer video I posted last week became popular. It went from 85 plays on Friday, to 5,007 on Saturday, to 22,136 on Sunday. On Monday, I had an all time high of 62,397 plays on Monday. The average steamed video file size was 53MB. Some were bigger (actually viewing it in Full HD mode), and some were smaller (mobile versions that were streamed). Over these 4 days, 4.75TB of my video was transferred across the internet, with 70% of this done on Monday.

How do you survive such a burst in popularity? Good backend design, and having a provider which can scale quickly to offset these issues. Here at SoftLayer, we can spin up your custom cloud instance templates in just a few minutes to help relieve that sudden increase in traffic. Still not enough? How about using our CDN to move your content files closer to the end user? At SoftLayer, the sky is the limit on the possibilities of how we can help you survive instantly becoming popular.