SREcon19 Americas has ended
Back To Schedule
Wednesday, March 27 • 12:20pm - 12:50pm
Madaari: Ordering for the Monkeys

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Lineage Driven Fault Injection (LDFI) is a state of the art technique in chaos engineering experiment selection. As SRE's we would like to perform chaos experiments that reveal the bugs that the customers are most likely to hit first. In this talk, we present new improvements to LDFI that orders the experiment suggestions.

In the first the half of the talk we will show introduce LDFI as a technique that can be widely used within an enterprise. We also highlight how ordering is general purpose technique that we can use to encode the peculiarities of a heterogeneous microservices architecture. LDFI can work in an enterprise by harnessing the observability infrastructure to model the redundancy of the system.

Next, we present experiments conducted within eBay using ordered LDFI and some preliminary results. We show examples of services where we discovered bugs, and how carefully controlling the order of experiments allowed LDFI to avoid running unnecessary experiments.
We will discuss open problems and future direction of LDFI.

Key takeaways :
  1. Understand how LDFI can be integrated in the enterprise by harnessing the observability infrastructure
  2. Limitations of LDFI w.r.t unordered solutions and why ordering matters for chaos experiments
  3. Preliminary results of prioritized LDFI and a future direction for the community

No prior knowledge of LDFI is required.

avatar for Ashutosh Raina

Ashutosh Raina

SRE, eBay
Ashutosh is a member of the Site Reliability team at eBay focussed on bringing LDFI to the enterprise. He works at the intersection of academia and industry, trying his best to fuse them together. Previously, Ashutosh was a graduate student at UCSC working at Disorderly Labs making... Read More →
avatar for Ramprasad Ellupuru

Ramprasad Ellupuru

Ramprasad is a member of the Site Reliability team at eBay working on making checkout highly reliable and available. He is an experienced developer and a new practitioner of chaos engineering at eBay.

Wednesday March 27, 2019 12:20pm - 12:50pm EDT
Grand Ballroom ABC