ETL Developer with AWS

Dice is the leading career destination for tech experts at every stage of their careers. Our client, Pinnacle Software Solutions, is seeking the following. Apply via Dice today!

Position: ETL Developer with AWS

Location: Houston, TX

Job Description:

We are looking for an experienced ETL Developer with AWS expertise to join our team in Houston. This is a contract position expected to last until the end of the year. The ideal candidate will have extensive experience in building and maintaining ETL pipelines with large datasets using AWS services.

Key Responsibilities:
• Design, develop, and maintain scalable and efficient ETL pipelines with large datasets using AWS services such as AWS Glue, EMR, Kinesis, Kafka, and CloudWatch.
• Develop robust solutions with Python, leveraging Spark/PySpark and APIs to manipulate and process data.
• Write complex SQL queries, optimize performance, and work with AWS Redshift and other relational databases (MS SQL Server, PostgreSQL).
• Work proficiently with AWS Services including Lambda, EventBridge, Step Functions, SNS, SQS, and S3.
• Utilize knowledge of machine learning, deep learning AMIs, and natural language processing (NLP) techniques to develop and implement models and algorithms.
• Design and implement machine learning models and algorithms to solve complex business and data challenges.
• Familiarity with IAM Roles and Policies for managing access and security.

Required Skills:
• AWS Glue, EMR, Kinesis, Kafka, CloudWatch (ETL pipeline development)
• Python development with strong proficiency in Spark/PySpark
• SQL (Writing queries and performance tuning with AWS Redshift, MS SQL Server, Postgres)
• Expertise in AWS Services: Lambda, EventBridge, Step Functions, SNS, SQS, S3
• Machine Learning and NLP techniques
• Experience with IAM Roles/Policies management in AWS

Preferred Skills:
• Familiarity with infrastructure as code tools such as CloudFormation
• Experience in CI/CD pipelines and working in agile methodologies