Senior Microsoft Azure Data Engineer
SUMMARY
The potential candidate will be responsible for designing, implementing, and optimizing data solutions on the Azure platform. This role requires deep expertise in Azure data services, strong data engineering skills, and the ability to lead and mentor junior team members to deliver robust and scalable data solutions.
ESSENTIAL DUTIES AND RESPONSIBILITIES
Data Architecture Design: Design scalable and efficient data. architectures on the Azure platform to meet business requirements. Develop data models, schema designs, and data integration strategies.
Azure Data Services Implementation: Implement and manage Azure data services such as Azure SQL Database, Azure Synapse Analytics, Azure Data Lake Storage, Azure Data Factory, and Databricks, and Azure Cosmos DB.
Data Integration and ETL: Design and implement data integration solutions using Azure Data Factory, Azure Databricks, and other ETL tools. Develop data pipelines for batch and real-time data processing.
Data Warehousing: Design and implement data warehousing solutions using Azure Synapse Analytics. Optimize data warehouse performance and scalability.
Data Lake Storage and Big Data Processing: Implement data lake solutions using Azure Data Lake Storage and Azure Databricks. Develop data processing pipelines for big data analytics and machine learning.
Data Governance and Security: Implement data governance policies and security controls to ensure data privacy and compliance with regulatory requirements. Configure Azure security features such as Azure Entra, Azure Key Vault, and CyberArk.
Data Quality and Master Data Management: Implement data quality checks and master data management solutions to ensure data accuracy and consistency across the organization.
Monitoring and Performance Tuning: Set up monitoring and logging solutions using Azure Monitor, Azure Log Analytics, Microsoft Defender, Splunk, and other monitoring tools. Optimize data solution performance and scalability.
Automation and DevOps: Automate data solution deployment, management, and monitoring tasks using Azure Automation, PowerShell, GitHub, and Infrastructure as Code (IaC) tools. Implement CI/CD pipelines for data solutions using Azure DevOps and Azure Functions.
Documentation and Knowledge Sharing: Document data solution designs, configurations, and best practices. Provide training and knowledge-sharing sessions to internal teams to enhance Azure data engineering expertise.
REQUIREMENTS
Bachelor's degree in Computer Science, Engineering, or related field (Masters degree preferred).
Azure certifications, such as Azure Data Engineer Associate or related certifications.
Proven experience in designing, implementing, and optimizing data solutions on the Azure platform.
Deep understanding of Azure data services and architecture patterns.
Strong experience with SQL, T-SQL, and data modeling
Proficiency in programming languages such as Python, Scala, or .NET for data engineering tasks.
Experience with big data technologies such as Apache Spark, Hadoop, or Kafka.
Strong knowledge of data governance, data security, and compliance requirements.
Excellent communication, leadership, and mentoring skills.
Ability to work independently and as part of a team in a fast-paced environment.
MINIMUM REQUIREMENTS
US Citizen - REQUIRED
Bachelor’s Degree
Microsoft Azure Expertise
5+ years of total experience
SECURITY CLEARANCE
Must be able to obtain a PUBLIC TRUST LEVEL 4
PREFERRED REQUIREMENTS
Experience with Microsoft Azure Cloud
Familiarity with data visualization tools such as Power BI or Tableau.
Knowledge of machine learning and data science concepts.
Experience with Agile methodologies and DevOps practices.
Previous experience in a similar role as a Senior Data Engineer or Azure Data Engineer.
PRE-EMPLOYMENT SCREENING REQUIREMENTSMust pass a pre-employment background check.
Job Types: Full-time, Contract
Pay: $166,000.00 - $187,000.00 per year
Compensation Package:
Yearly pay
Schedule:
Day shift
Application Question(s):
Do you have experience with big data technologies such as Apache Spark, Hadoop, or Kafka?
License/Certification:
Data Bricks or Azure certification (Preferred)
Work Location: Remote
SUMMARY
The potential candidate will be responsible for designing, implementing, and optimizing data solutions on the Azure platform. This role requires deep expertise in Azure data services, strong data engineering skills, and the ability to lead and mentor junior team members to deliver robust and scalable data solutions.
ESSENTIAL DUTIES AND RESPONSIBILITIES
Data Architecture Design: Design scalable and efficient data. architectures on the Azure platform to meet business requirements. Develop data models, schema designs, and data integration strategies.
Azure Data Services Implementation: Implement and manage Azure data services such as Azure SQL Database, Azure Synapse Analytics, Azure Data Lake Storage, Azure Data Factory, and Databricks, and Azure Cosmos DB.
Data Integration and ETL: Design and implement data integration solutions using Azure Data Factory, Azure Databricks, and other ETL tools. Develop data pipelines for batch and real-time data processing.
Data Warehousing: Design and implement data warehousing solutions using Azure Synapse Analytics. Optimize data warehouse performance and scalability.
Data Lake Storage and Big Data Processing: Implement data lake solutions using Azure Data Lake Storage and Azure Databricks. Develop data processing pipelines for big data analytics and machine learning.
Data Governance and Security: Implement data governance policies and security controls to ensure data privacy and compliance with regulatory requirements. Configure Azure security features such as Azure Entra, Azure Key Vault, and CyberArk.
Data Quality and Master Data Management: Implement data quality checks and master data management solutions to ensure data accuracy and consistency across the organization.
Monitoring and Performance Tuning: Set up monitoring and logging solutions using Azure Monitor, Azure Log Analytics, Microsoft Defender, Splunk, and other monitoring tools. Optimize data solution performance and scalability.
Automation and DevOps: Automate data solution deployment, management, and monitoring tasks using Azure Automation, PowerShell, GitHub, and Infrastructure as Code (IaC) tools. Implement CI/CD pipelines for data solutions using Azure DevOps and Azure Functions.
Documentation and Knowledge Sharing: Document data solution designs, configurations, and best practices. Provide training and knowledge-sharing sessions to internal teams to enhance Azure data engineering expertise.
REQUIREMENTS
Bachelor's degree in Computer Science, Engineering, or related field (Masters degree preferred).
Azure certifications, such as Azure Data Engineer Associate or related certifications.
Proven experience in designing, implementing, and optimizing data solutions on the Azure platform.
Deep understanding of Azure data services and architecture patterns.
Strong experience with SQL, T-SQL, and data modeling
Proficiency in programming languages such as Python, Scala, or .NET for data engineering tasks.
Experience with big data technologies such as Apache Spark, Hadoop, or Kafka.
Strong knowledge of data governance, data security, and compliance requirements.
Excellent communication, leadership, and mentoring skills.
Ability to work independently and as part of a team in a fast-paced environment.
MINIMUM REQUIREMENTS
US Citizen - REQUIRED
Bachelor’s Degree
Microsoft Azure Expertise
5+ years of total experience
SECURITY CLEARANCE
Must be able to obtain a PUBLIC TRUST LEVEL 4
PREFERRED REQUIREMENTS
Experience with Microsoft Azure Cloud
Familiarity with data visualization tools such as Power BI or Tableau.
Knowledge of machine learning and data science concepts.
Experience with Agile methodologies and DevOps practices.
Previous experience in a similar role as a Senior Data Engineer or Azure Data Engineer.
PRE-EMPLOYMENT SCREENING REQUIREMENTSMust pass a pre-employment background check.
Job Types: Full-time, Contract
Pay: $166,000.00 - $187,000.00 per year
Compensation Package:
Yearly pay
Schedule:
Day shift
Application Question(s):
Do you have experience with big data technologies such as Apache Spark, Hadoop, or Kafka?
License/Certification:
Data Bricks or Azure certification (Preferred)
Work Location: Remote
