Data Engineer
W2 Only role.
Data Engineer (Must have Databricks)
Need Mid level (3-5Yrs)
Location : North Quincy MA – Hybrid Onsite
Key Skill: Strong Databricks, AWS, Apache Spark, SQL, Scala/Python, Hadoop
Skill Sets Required
• Good decision-making and problem solving skills
• Solid understanding of Databricks fundamentals/architecture and have hands on experience in setting up Databricks cluster, working in Databricks modules (Data Engineering and SQL warehouse).
• Solid Knowledge on medallion architecture, DLT and unity catalog within Databricks.
• Experience in migrating data from on-prem Hadoop to Databricks/AWS
• Understanding of core AWS services, uses, and AWS architecture best practices
• Hands-on experience in different domains, like database architecture, business intelligence, machine learning, advanced analytics, big data, etc.
• Solid knowledge on Airflow
• Solid knowledge on CI/CD pipeline in AWS technologies
• Application migration of RDBMS, java/python applications, model code, Opensearch etc.
• Solid programming background on scala and/or python with Spark
• Experience with Docker and Kubernetes is a plus
W2 Only role.
Data Engineer (Must have Databricks)
Need Mid level (3-5Yrs)
Location : North Quincy MA – Hybrid Onsite
Key Skill: Strong Databricks, AWS, Apache Spark, SQL, Scala/Python, Hadoop
Skill Sets Required
• Good decision-making and problem solving skills
• Solid understanding of Databricks fundamentals/architecture and have hands on experience in setting up Databricks cluster, working in Databricks modules (Data Engineering and SQL warehouse).
• Solid Knowledge on medallion architecture, DLT and unity catalog within Databricks.
• Experience in migrating data from on-prem Hadoop to Databricks/AWS
• Understanding of core AWS services, uses, and AWS architecture best practices
• Hands-on experience in different domains, like database architecture, business intelligence, machine learning, advanced analytics, big data, etc.
• Solid knowledge on Airflow
• Solid knowledge on CI/CD pipeline in AWS technologies
• Application migration of RDBMS, java/python applications, model code, Opensearch etc.
• Solid programming background on scala and/or python with Spark
• Experience with Docker and Kubernetes is a plus
