SREcon19 Americas has ended
Wednesday, March 27 • 2:55pm - 3:25pm
Designing Resilient Data Pipelines

Sign up or log in to save this to your schedule and see who's attending!

There are a number of questions that plague any operator of a complex data pipeline. How do I quickly recover from failures in my pipeline? How do I know that the data I generate is accurate? How do I minimize the risk associated with updating my pipeline? Designing your data pipeline with resiliency and observability in mind will help to answer these questions. In this talk, I will present several strategies that my team has adopted for reducing operational complexity, risk associated with updates, and concerns about accuracy of data pipelines.

avatar for Andrew Bolin

Andrew Bolin

Two Sigma Investments, LP
Andrew Bolin is a Reliability Engineer at Two Sigma Investments where he is responsible for the design and operation of data pipelines critical to the firm's research environment. Before his current role, Andrew worked on the team responsible for the development of Two Sigma's open... Read More →

Wednesday March 27, 2019 2:55pm - 3:25pm
Grand Ballroom D

Attendees (75)