Lead Data Engineer - Python, SQL
6+ years
Full-time (40h)
Software Development
Full Remote
Python
SQL
Azure
Requirements
Must-haves
- 6+ years of data engineering experience
- Python and SQL experience
- Expertise in large scale data processing pipelines and enabling technologies such as Azure Data Factory, Databricks, and Spark
- Expertise in at least one major cloud platform — ideally Azure
- Experience with operationally active data ingestion and automation
- Experience with Docker and other container technologies
- Experience with container orchestration technologies such as Kubernetes
- Experience with Machine Learning training and serving pipelines
- Knowledge of software development and associated technologies
- Problem solving abilities, both individually and with a team
- Strong communication skills in both spoken and written English
Nice-to-haves
- Experience in CPG or Retail industry
What you will work on
- Define, build, and integrate data processing pipelines
- Design and develop solutions aligned with the architectural vision
- Take ownership of tasks and components to ensure timely and quality delivery
- Align data systems with business goals
- Mentor fellow team members