#big-data

How we automate building and maintaining data lineage at Slack

For two years we’ve been running Airflow 1.8, and it was time for us to catch up. Here’s how we did it without impacting 700B daily records.

For a company like Slack that strives to be as data-driven as possible, understanding how our users use our product is essential. The Data Engineer…