Azure Data Engineer

Greenrich is looking for fill the following role. Interested candidates, please send cv's to resourcing@greenrichit.com

Role :
• Azure Data Engineer
• Client :
• Public Sector services
• Duration :
• Initially 12 months
• Location : London (NW1) / Hybrid (mostly 2 days onsite)

Day Rate : £350

IR35 Determination : Outside (TBC)

IlR, PSW, British Citizen and Dependent are eligible.
• Skills and Experience
•
• Essential
• :
• Proven experience as a Data Engineer, working on large-scale data integration and analytics projects.
• Strong expertise with Azure Cloud Services, including Azure Data Factory (ADF), Azure Synapse Analytics, and Azure Blob Storage.
• Hands-on experience with Snowflake for data warehousing, modeling, and performance optimization.
• Proficiency in Python for data engineering, automation, and ETL development.
• Solid understanding of SQL for querying and managing relational databases.
• Familiarity with data lake architectures, data pipelines, and schema design principles.
• Experience with data governance, security, and compliance frameworks.
• Desirable
• :
• Experience with IoT data processing and working on smart city or similar projects.
• Knowledge of real-time data streaming technologies like Azure Event Hub or Apache Kafka.
• Proficiency in visualization tools like Power BI or Tableau.
• Understanding of geospatial data processing and analytics.
• Key Responsibilities
• • Design, develop, and optimize scalable ETL/ELT pipelines using Azure Data Factory (ADF) and Azure Synapse Analytics.
• Build and maintain robust data integration workflows to connect various sources, ensuring high data quality and performance.
• Implement and manage Snowflake-based data warehousing solutions for advanced analytics and reporting.
• Collaborate with cross-functional teams to support the development of data-driven smart city applications.
• Write efficient, reusable, and scalable Python scripts for data processing, transformation, and automation tasks.
• Develop and enforce data governance standards, ensuring data security and compliance.
• Monitor, troubleshoot, and optimize data pipelines and workflows to ensure reliability and efficiency.
• Work with large, complex datasets to deliver insights that support smart city initiatives, such as IoT data, public transport, and environmental analytics.
• Qualifications
• • Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
• Azure certifications (e.g., Azure Data Engineer Associate) are a strong plus.