Consistency, Availability, and Geo-Replicated Storage

For the past few years, we’ve been working on problems related to geo-replicated storage. We want to store data “in the cloud,” but that data should reside within multiple datacenters, not just in a single one.  When data is geographically replicated in such a fashion:

  • Users can experience lower latency by accessing a datacenter near to them, rather than one halfway around the world.
  • Network or system failures at a single datacenter doesn’t make the service unavailable  (even for data stored at that site).

This is common practice today.  Google runs multiple datacenters around the world, and Amazon Web Services offers multiple “Availability Zones” that are supposed to fail independently.

When data is replicated between locations, an important question arises about the consistency model such a system exposes.  Wyatt Lloyd has been tackling this question in his recent COPS and Eiger systems.  The  problem space this work explores — between giving up on any consistency guarantees one can reason about and just going with “eventual” consistency on one extreme, and giving up on availability guarantees to gain strong consistency and real transactions on the other — is going to be an increasingly important one.

Normally, folks think that the CAP Theorem tells us these two choices are fundamental.  But the key point is that CAP doesn’t tell us that eventual consistency is required, just that (as Partitions can happen) one can’t have both Availability and Strong Consistency (or more formally, linearizability).  It doesn’t tell us anything about consistency models that are weaker than linearizability yet stronger than “eventual.”  And that’s where COPS and Eiger come in.

One of our collaborators at CMU, Dave Andersen, recently wrote-up a more accessible discussion of these systems, and the causally-consistent data model they expose.   With the explosion of new data storage systems, particularly of the NoSQL variety, it’s important for folks to realize that there’s a (powerful and practical) choice between these two extremes.

Caring about Causality – now in Cassandra

Over the past few years, we’ve spent a bunch of time thinking about and designing scalable systems that provide causally-consistent wide-area replication.  (Here, “we” means the team of Wyatt Lloyd, Michael Freedman, Michael Kaminsky, and myself;  but if you know academia, you wouldn’t be surprised that about 90% of the project was accomplished by Wyatt, who’s a graduating Ph.D. student at the time of this writing.)  I’m posting this because we’ve finally entered the realm of the practical, with the release of both the paper (to appear at NSDI’13) and code for our new implementation of causally-consistent replication (we call it Eiger) within the popular Cassandra key-value store.

Read Dave’s full post here.

  • http://profile.yahoo.com/M4WOJNB5Y67Z3JCDCJOPZUYQR4 Julia

    Thanks for sharing this information with us.

    Boiler Replacement
     

  • CorneliusMary

    Yes it is right that many times when data is replicated between locations question arises about the consistency model, but many things are still not cleared.
    http://www.coomberlaw.com

  • Jenkins Watson

    I think you are right there are several topics or problem that needs to be resolved fast to make the customer and clients . cloud hosting companies tries to make everything according to the clients needs.
    http://www.cloudpeople.com.au/cloud-computing/

  • mayank5790

    I was told that it may involve compromising with the security of my data too. Is it so?

    http://madgraphs.com/cloud-cloud-computing-infographic/

  • http://www.incion.com/ professional web design

    It’s really important adapting our design to all screen sizes. And we recommend not to use Flash for being more responsive.

  • San Zen

    This is of concern with small to mid businesses as they settle in to a new way of data storage.

    https://www.hartmannsoftware.com/Blog/Articles_from_Software_Fans/Is-Cloud-Computing-Safe-for-Your-Business

  • VKSEKAR

    Thanks for sharing
    this great Post dude

    SEO Company Bangalore

  • http://maliati.ir/ shayan taghavi

    read that and get an good idea.

    computer network supportه

  • http://www.bestnindia.com/Mangalore/Restaurants Restaurants in Mangalore

    Thanks for sharing man, this is very helpful to everyone.

  • http://www.incion.com/ web design company los angeles

    Very informative and useful. Keep posting.

  • http://www.online-phd-uk.co.uk/ OnlinePhDUK

    interesting research and good for future data issues

  • http://www.99th.co.in/ Anuj Kumar

    This is Very useful information shared here. I am
    really thankful for this. 99th.co.in

  • http://www.placidway.com/ PlacidWay

    excellent platform for implementing the architecture patterns

  • ritu varma

    interesting research post thank very much.nnFinding Fanny

  • http://www.makemyassignments.com MakeMyAssignments

    Indeed an amazing post. Thanks a lot for sharing.nnAssignment Help

  • javadth
  • http://www.music3nter.com Esmaeil

    i dont understand

    Geo-Replicated Storage

    can you explane ?

    دانلود آهنگ
    ابزار وبلاگ
    تبادل لينک

    be kind

  • http://websyt.ir Meysam Masoori

    good work
    sarafiparsi

  • Chefsdabba

    Your blog has been very informative and the way you have presented is very impressive. The efforts made by you are noteworthy. Thanks a lot for this post, please keep posting as it is useful for all the readers like me.
    Lunch Tiffin Service Navi Mumbai

  • https://managementpaper.com Crissa Cook

    As one of those people who still does not understand how the “cloud system” works, after this reading this blog I understood how it can be helpful to the average bloke without any knowledge of computer-stuff. Although I found myself a little lost when the writer delved into the depths of cloud understanding with all the technological stuff. But overall I found this helpful in developing some basic idea about “geo-replicated storage”.

  • http://www.chennaiwebdevelopment.in/ Chennai Web Development

    That’s a good job! Keep up the work..
    http://www.chennaiwebdevelopment.in/

  • reza22teh

    سایت مدل مانتو جدیدترین و شیکترین مدل مانتو مجلسی سال 2016 95 از سایت مدل 24 – بهترین سایت مدل مانتو زیباترین مدلهای مانتو دخترانه و زنانه مجلسی اسپرت – به همه عزیزان توصیه میکنم حتما از این سایت دیدن کنید من خودم دیدن کردم کلی خوشم اومد چون زیباترین مدلهای مانتو رو داره سایتش هر روز بروز میشه و مطالب با کیفیت قرار میده من سایت مدل 24 رو خیلی خیلی دوست دارم مطمئنم که اگه شما هم بهش سر بزنید ازش خوشتون میاد منکه عاشقش شدم و نمیدونم دیگه چی بگم البته غیر از مدل مانتوهای شیک و جدید مجلسی، لباس مجلسی کوتاه و بلند دخترانه و زنانه هم قرار میده خداییش من خودم کلی با مطالبش حال کردم چون مدلهای جدید و شیکی از مدل لباس و مانتو قرار میده عکسهای خیلی خیلی قشنگی قرار میده منکه از طرفداراش هستم حتما شما هم با یک بار سر زدن به سایت عاشقش میشید.

  • reza22teh

    با خرید بک لینک در نتایج گوگل اول باشید هزینه کردن برای سئو هزینه نیست سرمایه هست با خرید بک لینک قوی کلمات خود را در اولین نتایج جستجو ببینید.

  • hypergymco

    Thank you for posting such a great article!
    http://hypergymco.com/ خرید تردمیل
    http://treadmills-co.com/ تردمیل