Sr. Azure Data Engineer

Role: Sr. Azure Data Engineer

Work location: 100% Remote - San Francisco

Duration: Long Term Contract

Visa Restriction: US Citizens/GC

Skills Need:

Strong in SQL, Azure and Pyspark , Databricks or Synapse is essential. Go to have MS Fabric experience.

Job Description:
• We are seeking a highly experienced Senior Azure Data Engineer with over 12 years of expertise in data warehousing.
• The ideal candidate will have extensive experience with the Azure platform, developing Azure Data Factory (ADF) pipelines, and working with PySpark.
• Knowledge of Databricks or Synapse is essential. Go to have MS Fabric experience.

Responsibilities

Design and Build Data Pipelines: Develop and manage modern data pipelines and data streams using Azure Data Factory.

Database Management: Develop and maintain databases, data systems, and processing systems.

Data Transformation: Transform complex raw data into actionable business insights using PySpark.

Technical Support: Collaborate with stakeholders and teams to assist with data-related technical issues.

Data Architecture: Ensure data architecture supports business requirements and scalability.

Process Improvements: Identify, design, and implement process improvements, such as automating manual processes and optimizing data delivery.

Big Data Solutions: Utilize Databricks or Synapse for big data processing and analytics.

Skills and Qualifications

Data Management and Storage: Proficiency with Azure SQL Database, Azure Data Lake Storage, Azure Cosmos DB, Azure Blob Storage, etc.

Data Integration and ETL: Extensive experience with Azure Data Factory for data integration and ETL processes.

Big Data and Analytics: Knowledge of big data technologies like Azure Databricks and Synapse.

Programming Languages: Proficiency in SQL, Python, and PySpark.

Analytical Skills: Strong analytical and problem-solving skills.

Communication: Excellent communication and teamwork skills.