Azure Data Engineer
• Looking for a talented and experienced consultant (C2C/1099 contract). No recruitment agencies please. Must be US Permanent Resident or US Citizen
• As an Azure Data Engineer, you will play a crucial role in the design, development, and implementation of scalable and secure data solutions on the Microsoft Azure platform. You will be responsible for managing and optimizing data pipelines, integrating data from multiple sources, and ensuring data quality across various platforms. This position requires a solid understanding of Azure data services and strong hands-on experience in data engineering practices.
Location
Remote but NYC area preferred and Eastern Time Zone required
Key responsibilities include but are not limited to:
Design, build and implement Azure-based data solutions including data lakehouses and data pipelines.
Develop and maintain ETL processes using Azure Databricks, Azure Fabric, Azure Data Factory, and other Azure technologies.
Create and optimize SQL-based queries, stored procedures, and other database functions.
Integrate and transform data from disparate sources into unified data models for analytical purposes.
Ensure data consistency, quality, and governance throughout the data lifecycle.
Experience with data lakehouse architecture and managing data storage, access, and analytics.
Collaborate with stakeholders to translate business requirements into scalable and performant data solutions.
Monitor, troubleshoot and resolve performance bottlenecks and issues related to data pipelines, processing, and integrations.
Required Skills & Qualifications:
5+ years of experience in data engineering with a focus on Azure cloud technologies.
Expertise in Microsoft Azure data services, including Azure Data Factory, Azure Fabric, Azure SQL Database, and Azure Databricks.
Strong knowledge of data integration, transformation, and orchestration techniques.
Expertise in Spark SQL, T-SQL, Python, PySpark and other data engineering languages.
Strong experience with CI/CD pipelines, automation, and data pipeline orchestration.
Ability to design and implement solutions that adhere to data governance and security standards.
Excellent problem-solving, analytical, and debugging skills.
Strong communication and collaboration skills, with the ability to work effectively in a fast-paced team environment.
Excellent communication and problem-solving skills.
Preferred Skills & Qualifications:
Microsoft Azure certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect Expert, Databricks Data Engineer Professional).
Experience with machine learning models or AI integrations is a plus.
Knowledge of DevOps practices and CI/CD pipelines is an advantage.
Job Types: Full-time, Contract
Pay: $110.00 per hour
Expected hours: 40 per week
Compensation Package:
1099 contract
Schedule:
Monday to Friday
Work Location: Remote
• Looking for a talented and experienced consultant (C2C/1099 contract). No recruitment agencies please. Must be US Permanent Resident or US Citizen
• As an Azure Data Engineer, you will play a crucial role in the design, development, and implementation of scalable and secure data solutions on the Microsoft Azure platform. You will be responsible for managing and optimizing data pipelines, integrating data from multiple sources, and ensuring data quality across various platforms. This position requires a solid understanding of Azure data services and strong hands-on experience in data engineering practices.
Location
Remote but NYC area preferred and Eastern Time Zone required
Key responsibilities include but are not limited to:
Design, build and implement Azure-based data solutions including data lakehouses and data pipelines.
Develop and maintain ETL processes using Azure Databricks, Azure Fabric, Azure Data Factory, and other Azure technologies.
Create and optimize SQL-based queries, stored procedures, and other database functions.
Integrate and transform data from disparate sources into unified data models for analytical purposes.
Ensure data consistency, quality, and governance throughout the data lifecycle.
Experience with data lakehouse architecture and managing data storage, access, and analytics.
Collaborate with stakeholders to translate business requirements into scalable and performant data solutions.
Monitor, troubleshoot and resolve performance bottlenecks and issues related to data pipelines, processing, and integrations.
Required Skills & Qualifications:
5+ years of experience in data engineering with a focus on Azure cloud technologies.
Expertise in Microsoft Azure data services, including Azure Data Factory, Azure Fabric, Azure SQL Database, and Azure Databricks.
Strong knowledge of data integration, transformation, and orchestration techniques.
Expertise in Spark SQL, T-SQL, Python, PySpark and other data engineering languages.
Strong experience with CI/CD pipelines, automation, and data pipeline orchestration.
Ability to design and implement solutions that adhere to data governance and security standards.
Excellent problem-solving, analytical, and debugging skills.
Strong communication and collaboration skills, with the ability to work effectively in a fast-paced team environment.
Excellent communication and problem-solving skills.
Preferred Skills & Qualifications:
Microsoft Azure certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect Expert, Databricks Data Engineer Professional).
Experience with machine learning models or AI integrations is a plus.
Knowledge of DevOps practices and CI/CD pipelines is an advantage.
Job Types: Full-time, Contract
Pay: $110.00 per hour
Expected hours: 40 per week
Compensation Package:
1099 contract
Schedule:
Monday to Friday
Work Location: Remote
