SREcon19 Asia/Pacific - Building Centralized Caching Infrastructure at Scale

James Won, LinkedIn

Caching is integral to any large-scale web operation. LinkedIn formed a dedicated caching team in 2017 and since then we have built out automation and infrastructure to support over 7 million queries/second across more than one-hundred clusters.

In this talk, I will be speaking through:

Why this team needed to exist
What we wanted to improve (e.g. tighter integration with existing deployment infrastructure)
How we integrated a third-party product into our deployment system
Things we wish we did differently after implementing our initial automation/tooling
Implementing seamless upgrades (compare it to how things were in the past)
Transitioning from running in root to non-root
Tooling we created to provision stores quickly
Where we want to take caching at LinkedIn
Things to consider about if your team provides a datastore as a service