InsiteAI: Lead Data Engineer - Python, SQL - Python, SQL, Azure - market

+ years
Full Remote
Python
SQL
Azure

Requirements

Must-haves

- 6+ years of data engineering experience - Python and SQL experience - Expertise in large scale data processing pipelines and enabling technologies such as Azure Data Factory, Databricks, and Spark - Expertise in at least one major cloud platform — ideally Azure - Experience with operationally active data ingestion and automation - Experience with Docker and other container technologies - Experience with container orchestration technologies such as Kubernetes - Experience with Machine Learning training and serving pipelines - Knowledge of software development and associated technologies - Problem solving abilities, both individually and with a team - Strong communication skills in both spoken and written English

Nice-to-haves

- Experience in CPG or Retail industry

What you will work on

- Define, build, and integrate data processing pipelines - Design and develop solutions aligned with the architectural vision - Take ownership of tasks and components to ensure timely and quality delivery - Align data systems with business goals - Mentor fellow team members