← All jobs
Data Engineer, ML Platform
Databricks
Seattle, WAHybridFull-timeMid-level3+ years$155,000 - $198,000
Our ML platform team builds the data infrastructure every model at Databricks depends on. You'll spend most of your time in Spark and Airflow, with a direct line to the model quality metrics your pipelines feed.
Requirements
- 3+ years building batch and streaming data pipelines
- Strong SQL and experience with Spark at scale
- Familiarity with Airflow or a comparable orchestrator
Responsibilities
- Own the feature pipelines feeding our internal recommendation models
- Reduce pipeline latency and cost across the ML platform
- Build monitoring so pipeline failures are caught before they page someone
Skills
- Python
- Spark
- Airflow
- AWS
- PostgreSQL
- dbt