Airflow SME

• 6 month contract

• Based in London

• Remote / Hybrid role

• Inside IR35

The role

• Provide technical leadership on data engineering (acquisition, transformation, distribution), across multiple projects and squads

• Guide, nurture, and coach a team of data engineers, architects and database administrators working in an agile, fast-paced environment

• Drive adoption and evolution of frameworks and products based on best-in-class data management technologies, such as ETL/ELT tools, open-source frameworks, workflow management tools, etc.

• Provide suggestions and recommendation on how to improve the overall data engineering architecture towards a scalable, cost effective ecosystem

Your expertise:

• Excellent understanding of enterprise data warehousing principles of ETL/ELT and the tools/technologies used to implement them

• Proven experience with Apache Airflow, including designing and maintaining complex workflows.

• Strong knowledge of Python programming.

• Experience with SQL and relational databases.

• Familiarity with cloud platforms (e.g., AWS) and their data services.

• Experience with version control systems such as Git.

• Strong problem-solving skills and attention to detail.

• Excellent communication and collaboration skills.

• Be an expert in handling ECS, Fargate, EC2, EKS infrastructure hosting Airflow.

• DBT including handling Infrastructure related upgrades and optimising DBT code (desirable).

Carbon60, Lorien & SRG - The Impellam Group STEM Portfolio are acting as an Employment Business in relation to this vacancy.