Scalability Tag

Articles, tagged with Scalability, providing techniques, guidance, and best practices for how to build web applications that scale to significant traffic volumes.


Lee Atchison to Present at Cloud EXPO NY 2018

Aug 21, 2018

Join me in New York on Nov 13 for the 10th annual Cloud Expo at the Javits Center where I will be giving my talk “Dynamic Infrastructure and The Cloud 
Adventures in Keeping Your Application Running…at Scale”. This will be my second appearance and third presentation at this conference. To register for the conference and my presentation, please click here.


Key Takeaways from Continuous Discussions Podcast: The DevOps Toolchain

Aug 13, 2018

On July 17th, I was fortunate enough to take part in a podcast jointly sponsored by Electric Cloud and DZone titled “Continuous Discussions: The DevOps Toolchain”. The podcast was a panel discussion with a variety of DevOps experts from around the industry. I was fortunate enough to be included on this panel.


Continuous Discussions (#c9d9) Podcast, Episode 89: The DevOps Toolchain

Jul 30, 2018

Episode 89: The DevOps Toolchain

Tools must be able to integrate with each other and provide insight into the entire process. Check out the latest Continuous Discussions podcast for insights like this. Lee Atchison was part of the panel of DevOps experts being interviewed during this podcast.


The Four Pitfalls of Cloud Migration

Jul 23, 2018

Migrating to the cloud is easy, right? What could possibly go wrong? There are at least four things I can think of. Often, when we begin a cloud migration, we come in with lofty expectations. As the migration progresses, however, we often find that moving to the cloud isn’t necessarily as easy as we would like it to be - or as easy as we were led to believe it would be. Sometimes, the cloud doesn’t meet our expectations. Promises we’ve been given may not hold true. Promises we’ve made to our stakeholders can turn out to be impossible to keep. Migrating to the cloud is not necessarily the slam dunk we expected it to be.


Preparing to Adopt the Cloud: A 10-Step Cloud Migration Checklist

Jun 25, 2018

Having been involved in cloud computing for more than a decade, I’ve heard from many IT executives working to move key enterprise applications to the public cloud. In several cases, their teams have struggled or had only limited success in their cloud migrations. But they never gave up and they used the lessons they learned to improve their results in subsequent attempts.


DevOps Reading List: Top 30 Best DevOps Books You Should Read In 2018

Apr 3, 2018

The #1 book on their list is “Architecting for Scale” book by Lee Atchison. As the article says:

"The first one on our DevOps reading list is Architecting for Scale. It is an excellent book to understand real-world paradigms for scaling and managing critical applications. This book covers 5 different elements: availability, risk management, services and microservices, scaling applications and cloud services. This book can be called a practical guide as well, it shows how to prevent an application from becoming slow, inconsistent, or downright unavailable as it grows. Also, in this book the word “Scaling” is explained very well as it is not just about handling more users; it’s also about managing risk and ensuring availability."


The Dynamic Cloud: Availability And Scalability For Your Biggest Days

Feb 4, 2018

Does this story sound familiar? It’s the day of the big game. You invite a bunch of your friends over to watch on your brand-new 75-inch Ultra-HD Super Deluxe TV. You’ve got the beer. You’ve got your snacks laid out. Everything’s ready to go. The game is about to start. When, all of a sudden, the power goes out, the lights flicker off, and the TV goes dark. For you and your friends, it’s game over.


Join Me On World Cloud Evangelism Tour

Sep 26, 2017

During the months of October and November, I will be undertaking a four week, ten city, six country, worldwide Cloud Roadshow. During this trip I will be visiting key customers and speaking at various events across the globe. I’ll be visiting Australia, New Zealand, England, Netherlands, Germany, and Switzerland.


Don’t Write Off the AWS S3 Outage as a Fat-Finger Folly

Mar 8, 2017

Major bug? Human error? Neither. The AWS S3 outage last week was more like a minor bug in an otherwise solid availability plan executed by AWS. Read my article at The New Stack..


Minimum viable product considered harmful without architecture

Feb 23, 2017

Agile development and DevOps processes are in vogue now. It seems that most well-run development organizations either have these processes ingrained in their culture, or are trying to build them into their culture.


Building Right-Sized Application Services: The Goldilocks Calculation

Dec 21, 2016

In the world of applications, services are standalone components that, when connected and working together, create an application that performs some business purpose. But services come in a wide variety of sizes, from tiny, super-specialized microservices up to services big and complete enough to form their own monolithic applications.


Goldilocks, serverless and DevOps: Five predictions for IT in 2017

Dec 14, 2016

Technological innovation drives every business, industry and sector - mostly positively, but not always. 2016 was no exception – from the first long-haul driverless cargo delivery to automated retail locations to the stiffening competition among ‘smart assistants’ we’re seeing big technological leaps at a breakneck pace.


Why I Wrote the Book on ‘Architecting for Scale’

Jul 25, 2016

As applications grow, two things begin to happen: they become significantly more complicated (and hence brittle), and they handle significantly larger traffic volume (which more novel and complex mechanisms manage). This can lead to a death spiral for an application, with users experiencing brownouts, blackouts, and other quality-of-service and availability problems. “But your customers don’t care. They just want to use your application to do the job they expect it to do. If your application is down, slow, or inconsistent, customers will simply abandon it and seek out competitors that can handle their business. That’s how my new book, Architecting for Scale: High Availability for Your Growing Applications, begins.


theCUBE Interview at AWS Summit, Santa Clara

Jul 15, 2016

I had the rewarding opportunity of being a guest on theCUBE on Silicon Angle TV at the AWS Summit in Santa Clara, CA.


O'Reilly Video Interview in Santa Clara, CA

Jul 12, 2016

I was interviewed recently by O’Reilly Media about my book Architecting for Scale. This interview was recorded during the O’Reilly Velocity conference in Santa Clara, CA, on June 23, 2016.


Scalable Architecture with Lee Atchison

Jul 9, 2016

Software Engineering Daily Podcast. Listen to Jeff Meyerson talk to Lee Atchison about Lee’s new book, “Architecting for Scale”, by O’Reilly Media.


Using Hybrid Clouds: Adding Data Center Capacity - Part 4

May 3, 2016

As enterprises increasingly move to the cloud, they are discovering a wide variety of routes to get there. In a recent series of blog posts, I’ve addressed

  • Using the hybrid cloud to add data centers and capacity
  • Using the hybrid cloud to add cloud capabilities
  • Using the hybrid cloud for app migration
In fact, many companies undertake multiple, simultaneous cloud migrations, each one using a different approach—or combination of approaches—and affecting different applications and different business units with particular needs and goals. Not surprisingly, that multifaceted combination has important implications for monitoring and managing the performance of all those applications.  


Using Hybrid Clouds: Adding Data Center Capacity - Part 3

Apr 27, 2016

For many companies, the goal isn’t to share their applications across both their own data center and the public cloud. Rather, they want to move some of their applications lock, stock, and barrel to the cloud. If some of the company’s apps live in the cloud while others remain in the on-premise data center, then intentionally or not, these companies also have hybrid clouds.


Using Hybrid Clouds: Adding Data Center Capacity - Part 2

Apr 21, 2016

As hybrid clouds become more and more common in enterprise IT settings, a number of different use cases and journeys are beginning to become apparent. In part 1 of this series on how enterprise IT is using the hybrid cloud, we looked at how the hybrid cloud can be a faster and more economical way to add new data center or server capacity—or even an entire new or better data center.


Using Hybrid Clouds: Adding Data Center Capacity - Part 1

Apr 21, 2016

The term “hybrid cloud” has found its way into common usage among IT operations folk, but not everyone agrees on exactly what it means. Basically, a hybrid cloud refers to any situation in which you have an application running partially in your company’s data center, and partially in one or more public clouds, such as AWS, Microsoft Azure, or Google Cloud Platform.


Cloudy with a Chance of Scaling: Keeping Your Highly Scaled Application Highly Available Using the Cloud

Mar 30, 2016

As our applications grow, keeping them operational can be challenging. High growth means more data, more computation, and more opportunities for problems. The cloud offers us the ability to improve our scalability, while maintaining and improving our availability. During this talk, we’ll show you the “keep two mistakes high” principal and use the cloud to prevent availability issues, keeping our applications healthy and growing, yet keeping costs inline.


Distributing the Cloud - AWS Architecture - Part 3

Mar 4, 2016

We all know the value of distributing an application across multiple data centers. The same philosophy applies to the cloud. As we put our applications into the cloud we need to watch where in the cloud they are located. How geographically and network topologically distributed our applications are is just as important as with normal data centers. While Amazon AWS won’t tell you specifically where your application is running, they do give you enough information to make diversification decisions. Interpreting and understanding this information, and using it to your advantage, requires an understanding of how AWS is architected. In part 1 of this article, we talked about the AWS Architecture of regions and availability zones. In part 2, we went into more detail about how availability zones are structured, and how we can utilize this information. In this final part, we discuss the availability zone to data center mapping, why it is important, and how to use all this information to make sure you have the highest diversification as possible for your application.


Distributing the Cloud - AWS Architecture - Part 2

Mar 3, 2016

We all know the value of distributing an application across multiple data centers. The same philosophy applies to the cloud. As we put our applications into the cloud we need to watch where in the cloud they are located. How geographically and network topologically distributed our applications are is just as important as with normal data centers. While Amazon AWS won’t tell you specifically where your application is running, they do give you enough information to make diversification decisions. Interpreting and understanding this information, and using it to your advantage, requires an understanding of how AWS is architected. In part 1 of this article, we talked about the AWS Architecture of regions and availability zones. In part 2, we will go into more detail about how availability zones are structured, and how we can utilize this information.


Distributing the Cloud - AWS Architecture - Part 1

Mar 3, 2016

We all know the value of distributing an application across multiple data centers. The same philosophy applies to the cloud. As we put our applications into the cloud we need to watch where in the cloud they are located. How geographically and network topologically distributed our applications are is just as important as with normal data centers. However, the cloud makes knowing where your application is located harder. The cloud also makes it harder to proactively make your application more distributed. Some cloud providers don’t even expose enough information to let you know where, geographically, your application is running. Luckily, larger providers like AWS are better. No, AWS won't tell you specifically where, geographically, your application is running, since they do not disclose their actual data center locations (I worked at AWS, and I have no idea, specifically, where the data centers are located). While they won’t tell you specifically where your application is running, they do give you enough information to make diversification decisions. Interpreting and understanding this information, and using it to your advantage, requires an understanding of how AWS is architected.


Architecting for Scale - Updated Early Release Available

Jan 28, 2016

An updated copy of my book, Architecting for Scale, published by O’Reilly Media, is available for download. This is the second version under the early release program. The full book is scheduled to be released in May.


Scaling with Availability

Jan 14, 2016

One of the most important topics in architecting for scalable systems is availability. While there are some companies and some services where a certain amount of downtime is reasonable and expected, most businesses cannot have any downtime at all without it impacting their customer’s satisfaction, and ultimately their company’s bottom line. How do you keep your customers happily using your service and keep your company’s revenue coming in? You keep your service operational as much as possible. There is a direct and meaningful correlation between system availability, and customer satisfaction.


Welcome!

Dec 29, 2015

Scaling web applications isn’t easy. As web applications grow, two things begin to happen. First, they become significantly more complicated and hence brittle. Second, they handle significantly larger traffic volume requiring more novel and complicated mechanisms to handle this traffic. This can lead to a death spiral for an application that can lead to brownouts, blackouts, and other quality of service and availability problems. My purpose for this blog is to provide techniques, guidance, and best practices for how to build web applications that scale to significant traffic volumes.



Lee Atchison