Remote Lead Data Engineer - Contract
This is a 100% Remote position based anywhere in the US and will pay a rate of approximately $60/hr on W2. The project will be an initial 3-month duration with the possibility of extension.
The Lead Data Engineer role develops and maintains robust and scalable integrations and data pipelines that connect our core systems and drive critical automation for online K 12 learning and school management. This Lead Data Engineer will be part of a collaborative remote team working closely with other engineers, analysts, architects, and business stakeholders to develop reliable and modular data flows and integrations on an agile cycle that automates core business needs at scale and empowers online education for students across the United States.
Key Responsibilities:
• Develop modular data integrations following an event-based architecture, partnering with data analysts and architects to understand and meet development requirements for each use case
• Partner with other engineers and technical leads for collaboration, support, and alignment throughout design/development and to solve development blockers if they arise
• Develop robust unit testing on developed code and drive integration, end-to-end, and performance testing to ensure each data integration is reliable, scalable, and meets business needs before deployment
• Drive developed integrations through a CI/CD process to validate, test, and deploy reliable solutions for production use
• Communicate and demo developed data integration solutions and progress with stakeholders in bi-weekly sprint reviews to drive transparency and collaboration between teams
• Maintain deployed data integrations, monitoring for any issues and resolving them as they arise.
Skills Required:
• Three (3) years of relevant professional experience working with, building, and/or managing AWS cloud services including AWS Lambda , Step Functions , DMS , Kinesis , S3 , RDS , Glue , EC2 , CloudWatch , CloudFormation , or equivalent Azure/GCP services
• Proficiency in Python development.
• Proficiency in using SQL and APIs to automate interactions with various data stores and systems
• Familiarity with pub/sub-event-based architecture and ETL data pipeline patterns
• Demonstrated experience with software development best practices, including developing robust unit, integration, functional, and performance test
• Demonstrated experience following enterprise-grade DevOps practices, including release management, CI/CD pipelines
• Demonstrated success in working with a highly collaborative and agile remote development team
• Excellent verbal and written communication skills
• Proficiency in the Microsoft Office Suite (Excel, Word, PowerPoint, SharePoint)
• Ability to clear required background check
Preferred Qualifications:
• Experience working in industries with rigorous technical environments such as insurance, retail, CPG, high-tech.
• Experience developing pub/sub-event-based architectures, data streaming, data integration, and batch data pipelines
• Experience working with various data storage types including relational databases, object storage, graph databases, data warehouses
• Experience with Snowflake or equivalent data warehousing and services
• AWS or Azure cloud certifications
• Experience in education and/or educational technology industries
