

Data Engineer
This role is open for contract and Permanent.
the role is open for various locations in London, Birmingham, Manchester and Newcastle upon Tyne, UK
Required skills
Experience as a Data Engineer, working with Big Data, ETL, and cloud-based solutions.
Strong expertise in Azure Databricks, and Apache Spark (PySpark, Scala, or SQL).
Familiar with Azure Data Services (Azure Data Factory, Azure Data Lake, Azure Synapse, Azure etc).
Proficiency in SQL, Python, and/or Scala for data processing and pipeline development.
Experience with Terraform for infrastructure as code (IaC)
Experience with Delta Lake for data versioning, optimization, and transactions.
Understanding of streaming technologies (e.g., Kafka, Event Hubs, Azure Stream Analytics).
Familiarity with CI/CD pipelines for data engineering using Terraform, Git, and Azure DevOps.
Strong problem-solving skills and the ability to optimize Spark jobs for performance.
Knowledge of Gen AI in the Software Development Lifecycle