July 2, 2024 11 min read @Slack Engineering Unlocking Efficiency and Performance: Navigating the Spark 3 and EMR 6 Upgrade Journey at Slack Slack Data Engineering recently underwent data workload migration from AWS EMR 5 (Spark 2/Hive 2 processing…
April 27, 2022 14 min read @Laura Nolan Slack’s Incident on 2-22-22 By Laura Nolan, with contributions from Glen D. Sanford, Jamie Scheinblum, and Chris Sullivan. Assessing…
June 17, 2020 9 min read @Ashwin Shankar Reliably Upgrading Apache Airflow at Slack’s Scale Apache Airflow is a tool for describing, executing, and monitoring workflows. At Slack, we use Airflow to…