July 2, 2024 11 min read @Slack Engineering Unlocking Efficiency and Performance: Navigating the Spark 3 and EMR 6 Upgrade Journey at Slack Slack Data Engineering recently underwent data workload migration from AWS EMR 5 (Spark 2/Hive 2 processing…
August 16, 2021 10 min read @Samuel Bock Data Lineage at Slack Reinventing how the world does work inevitably creates a lot of data. Each year, Slack’s scale has increased and…
June 17, 2020 9 min read @Ashwin Shankar Reliably Upgrading Apache Airflow at Slack’s Scale Apache Airflow is a tool for describing, executing, and monitoring workflows. At Slack, we use Airflow to…
June 29, 2020 10 min read @Ronnie Chen@Diana Pojar Data Wrangling at Slack For a company like Slack that strives to be as data-driven as possible, understanding how our users use our…