Data Engineer
Role: Azure Databricks (CGEMJP00282610)
Duration: 12 Months Contract
Location: Grand Rapids, MI (Day-1 onsite role only)
Required experience-
Must have good Knowledge on Architecture Design and should be able to provide solutions on any New Requirement.
Evaluates architectural options and defines overall architecture of enterprise Data Lake and MicroServices
Defines functional and non-functional requirements including performance monitoring, alerting and code management and ensuring alignment with technology best practices and SLAs in the Azure environment (infrastructure and platform)
Hands on Experience both as administration of Azure and Databricks
Providing subject matter expertise and technical consulting support on either vendor or internal applications and interfaces including Azure - Data Factory, Log Analytics, Databricks, Synapse, Power BI, ADLS Gen2, Polybase and Machine Learning/AI.
Driving engagement with ITS Security and Infrastructure teams to ensure secure development and deployment of solutions.
Conducting industry research, facilitates new product and vendor evaluations, and assists in vendor selection.
Previous experience in Data Governance and Managing Azure platforms
Experience building and designing data and analytics on enterprise solutions such as Azure - Data Factory, Log Analytics, Databricks, Synapse, Power BI, ADLS Gen2, Polybase and Machine Learning/AI.
In-depth understanding of computer, storage, including backup, monitoring and DR environment requirements
Experience designing data pipelines, ingestion, storage, prep-train, model and serve using above technologies, Automating Azure Workloads, Data quality, Governance/standards, Security and legal compliance in the Azure architecture
knowledge and experience on Python or Scala or PowerShell and API architecture in Azure
Experience with multiple, diverse technical configurations, technologies, and processing environments.
Good to have knowledge on Azure DevOps and Google Cloud.
Job Type: Contract
Expected hours: 65 – 75 per week
Schedule:
8 hour shift
Day shift
Experience:
Azure: 6 years (Required)
Databricks: 6 years (Required)
Microservices: 4 years (Required)
Data governance: 3 years (Required)
Azure architecture: 4 years (Required)
Work Location: In person