Data Engineer

Big Data Engineer

Irving, TX ( Hybrid – 3 Days a Week )

Contract Type: W2 / Self Corporation

Long Term

Exp: 8-10 yrs

Big Data Engineer Responsibilities:
• Meeting with managers to determine the company’s Big Data needs.
• Developing Hadoop systems.
• Loading disparate data sets and conducting pre-processing services using Hive
• Finalizing the scope of the system and delivering Big Data solutions.
• Managing the communications between the internal system and the survey vendor.
• Collaborating with the software research and development teams.
• Building cloud platforms for the development of company applications.
• Maintaining production systems.
• Training staff on data resource management.

Big Data Engineer Requirements:
• Bachelor’s degree in computer engineering or computer science.
• Previous experience as a big data engineer.
• In-depth knowledge of Hadoop Legacy, Spark, Python, and similar frameworks.
• Knowledge of NoSQL and RDBMS databases including Redis and MongoDB.

Good in DevOps CI/CD, Scheduling, and automations.

Excellent project management skills.
• Good communication skills.
• Ability to solve complex networking, data, and software issues.

Education:

Bachelor’s degree/University degree or equivalent