AWS Data Engineer
Ampstek
Role Description
Role Title: AWS Data Engineer
Hybrid with 2 day in the office/week
Contract duration: 6+ months
Location: Northampton
Industry: Banking
AWS Lead Data Engineer with a minimum 7-8 years of experience in AWS services relevant to data engineering. Target Data ware house would be on Redshift/ Snowflake so the ideal candidate should also have working knowledge of the same.
Key Skills required:
AWS
Big data
Spark
• Must have: Hands-on experience in AWS services – S3, Glue, EC2, Data Lake formation, Lambda, Step function, Cloud formation, SNS, SQS, Event Bridge, Athena, Dynamo DB, IAM, Redshift, Kinesis stream, Kinesis firehose, EKS and Confluent Kafka.
Coding Languages – Python, Spark, PySpark and SQL.
• Should have: Snowflake and DBT (Data Build Tool) for managing transformations in the data pipeline
Areas of responsibility:
Coding
Design
Deployment
Detailed Job Description:
Data Engineering Lead will be proficient in AWS services relevant to data engineering such as S3, Glue, EMR, Athena, Lake formation and Lambda etc. with hands-on experience with Snowflake, Redshift based cloud data warehousing solutions.
• Should be familiar with DBT (Data Build Tool) for managing transformations in the data pipeline
• Should possess strong programming skills in technologies like Python, Scala, Spark, PySpark or Ab Initio for building data pipelines and ETL processes
• Should have experience with data pipeline orchestration tools like Apache Airflow, Cron
• Should have understanding of data modelling Principles and best practices
• Prior experience of leading Data Engineering Team
• Agile Practitioner; Strong Stakeholder Management