Data Engineer

Trust In SODA

Role Description

Posted on: 
Sep 12, 2024

Start date: ASAP

Duration: 12 Months

Location: Hybrid Working in London office

Rate: £700-£768 per day inside IR35

Summary

The International Engineering team is responsible for building and running the UK and Canadian apps. As a Data Engineer, you will own engineering efforts to provide partner teams within the organisation with data sources that build our AI/ML user experience and help run our client robustly and at scale.

Responsibilities:

• Build and maintain scalable data pipelines for BigQuery using Cloud Composer and Airflow;

• Provide observability and monitoring using Monte Carlo and Looker as well as operational tools such as NewRelic and Splunk, driving reliability, data quality, data quality and robustness;

• Build critical data quality checks to ensure that the data we process and provide to partner teams meets security and compliance requirements;

• Participate in code and technical design reviews;

• Scope and plan work together with product engineering, data science and the business; support other teams for all tasks related to data tracking, collection, ingestion, quality monitoring and alerting.

Skills:

• Python

• Airflow

• SQL

• BigQuery

• Data Warehousing

Apply Now
> Start 3-Day Free Trial

Roles Published Yesterday
To see roles published in the last 48 hours, sign-up to 3-day free trial of Role Scout.