Data Engineer - TX
Experis IT ManpowerGroup has partnered with a leading Financial services company for a Data Engineer role to assist their team. This is an Onsite role.
Industry: Financial services company
Title: Data Engineer
Location: Irving, TX
Duration: 6+ months.
Pay: $57/hr (W2)
Job Description
We seek a skilled Data Engineer with expertise in ETL/ELT, data pipeline architecture, and cloud-based data solutions. The ideal candidate will have strong experience in SQL, Python/Spark, and various data pipelining tools. This role involves designing and optimizing data pipelines for reporting and operational analytics, working with cloud-based platforms, and integrating structured and unstructured data from multiple sources
Key Responsibilities
• Design, develop, and optimize ETL/ELT data pipelines for operational and analytical applications.
• Work with SQL, Python, and Spark to process large datasets efficiently.
• Architect and implement data pipelines using open-source and cloud-based tools.
• Manage and optimize Delta Lake for both operational and analytical data stores.
• Translate and modernize legacy ETL code from tools like SSIS, Ab Initio, and SAS into cloud-native solutions.
• Ensure data quality, integrity, and security while working with large-scale datasets.
• Collaborate with business and technical teams to develop reporting and downstream applications.
• Leverage cloud platforms (preferably GCP) to build scalable data solutions.
• Troubleshoot and optimize data pipelines to ensure high performance and reliability.
• Stay updated with the latest big data technologies and cloud advancements.
Required Qualifications
• Strong proficiency in SQL, Python, and Spark.
• Experience with ETL/ELT processes and data pipeline orchestration tools.
• Hands-on experience with cloud platforms (GCP preferred, AWS/Azure a plus).
• Solid understanding of data warehouse concepts, Delta Lake, and reporting solutions.
• Experience with legacy ETL tools like SSIS, Ab Initio, and SAS is a plus.
• Strong problem-solving skills, critical thinking, and the ability to adapt to changes.
• Experience working with large-scale datasets in a distributed computing environment.
• Familiarity with CI/CD for data pipelines and best practices in data security & compliance.
Preferred Qualifications
• Experience with BigQuery, Dataflow, Dataproc, and Pub/Sub on Google Cloud Platform (GCP).
• Knowledge of modern data lake architectures and real-time data streaming.
• Experience with Apache Airflow, dbt, or other workflow orchestration tools.
Experis IT ManpowerGroup has partnered with a leading Financial services company for a Data Engineer role to assist their team. This is an Onsite role.
Industry: Financial services company
Title: Data Engineer
Location: Irving, TX
Duration: 6+ months.
Pay: $57/hr (W2)
Job Description
We seek a skilled Data Engineer with expertise in ETL/ELT, data pipeline architecture, and cloud-based data solutions. The ideal candidate will have strong experience in SQL, Python/Spark, and various data pipelining tools. This role involves designing and optimizing data pipelines for reporting and operational analytics, working with cloud-based platforms, and integrating structured and unstructured data from multiple sources
Key Responsibilities
• Design, develop, and optimize ETL/ELT data pipelines for operational and analytical applications.
• Work with SQL, Python, and Spark to process large datasets efficiently.
• Architect and implement data pipelines using open-source and cloud-based tools.
• Manage and optimize Delta Lake for both operational and analytical data stores.
• Translate and modernize legacy ETL code from tools like SSIS, Ab Initio, and SAS into cloud-native solutions.
• Ensure data quality, integrity, and security while working with large-scale datasets.
• Collaborate with business and technical teams to develop reporting and downstream applications.
• Leverage cloud platforms (preferably GCP) to build scalable data solutions.
• Troubleshoot and optimize data pipelines to ensure high performance and reliability.
• Stay updated with the latest big data technologies and cloud advancements.
Required Qualifications
• Strong proficiency in SQL, Python, and Spark.
• Experience with ETL/ELT processes and data pipeline orchestration tools.
• Hands-on experience with cloud platforms (GCP preferred, AWS/Azure a plus).
• Solid understanding of data warehouse concepts, Delta Lake, and reporting solutions.
• Experience with legacy ETL tools like SSIS, Ab Initio, and SAS is a plus.
• Strong problem-solving skills, critical thinking, and the ability to adapt to changes.
• Experience working with large-scale datasets in a distributed computing environment.
• Familiarity with CI/CD for data pipelines and best practices in data security & compliance.
Preferred Qualifications
• Experience with BigQuery, Dataflow, Dataproc, and Pub/Sub on Google Cloud Platform (GCP).
• Knowledge of modern data lake architectures and real-time data streaming.
• Experience with Apache Airflow, dbt, or other workflow orchestration tools.
