Advanced Data Engineer 100% Remote
Advanced Data Engineer (100% Remote)
Primary Location: 100% Remote
V-Soft Consulting is currently hiring for a Advanced Data Engineer (100% Remote) for our premier client.
Education And Experience »
• 4+ years in professional data development.
• 4+ years with SQL and NoSQL technologies.
• 3+ years building and maintaining data pipelines and workflows.
• 5+ years developing with Java.
• 2+ years developing with Python.
• 3+ years developing Kafka solutions.
• 2+ years feature engineering for ML pipelines.
Preferred Qualifications
• Knowledge of Structured Streaming (e.g., Spark, Kafka, EventHub).
• Experience with GitHub SaaS/GitHub Actions.
• Familiarity with Databricks, PySpark, and Spark development.
Technical Skills
Knowledge, Skills and Abilities »
• Expertise with GCP services: BigQuery, Vertex AI Platform, Cloud Storage, AutoMLOps, and Dataflow.
• Proficiency in CI/CD processes and version control tools (e.g., Git).
• Strong understanding of ETL, Data Warehousing concepts, and Agile (Scrum) principles.
Soft Skills
• Excellent communication and agile thinking.
• Ability to understand and present options effectively.
• Positive, accomplishment-driven attitude with the ability to adapt to various situations.
What You’ll Do
Job Responsibilities:
• Technical Leadership: Provide clear technical guidance across ongoing projects, fostering collaboration to solve complex data engineering challenges.
• Data Pipeline Development: Design, build, and maintain scalable and efficient data pipelines for ingestion, transformation, and integration using tools like Kafka, Databricks, and other technologies.
• Digital Innovation: Modernize and extend core data assets across SQL, NoSQL, cloud, and real-time streaming platforms.
• Feature Engineering: Develop and manage feature engineering pipelines for machine learning workflows, utilizing tools such as Vertex AI, BigQuery ML, and custom Python libraries.
• Automated Testing: Implement automated testing frameworks to ensure data quality, reliability, and compliance with organizational standards.
• Workflow Optimization: Optimize data workflows for performance, cost efficiency, and scalability across large datasets and complex environments.
• Team Mentorship: Mentor team members in data principles, patterns, and practices to elevate team capabilities and encourage best practices.
• Documentation and Communication: Draft and review architectural diagrams, interface specifications, and other technical documentation to ensure clear communication of solutions.
• Strategic Guidance: Present opportunities with cost/benefit analyses to leadership, guiding architectural decisions for scalable and efficient data solutions.
Interested?
Qualified candidates should send their resumes to sbandi@vsoftconsulting.com
V-Soft Consulting Group is recognized among the top 100 fastest growing staffing companies in North America, V-Soft Consulting Group is headquartered in Louisville, KY with strategic locations in India, Canada and the U.S. V-Soft is known as an agile, innovative technology services company holding several awards and distinctions and has a wide variety of partnerships across diverse technology stacks.
As a valued V-Soft Consultant, you’re eligible for full benefits (Medical, Dental, Vision), a 401(k) plan, competitive compensation and more. V-Soft is partnered with numerous Fortune 500 companies, exceptionally positioned to advance your career growth.
V-Soft Consulting provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
For more information or to view all our open jobs, please visit www.vsoftconsulting.com or call (844) 425-8425.
