(Data Engineer) - Recent Exp with Pig and Hive Is Mandatory
strong experience with Pig and Oozie in current assignments
Responsibilities:
• Design technical solutions for given requirement/features and lead the implementation
• Lead and coordinate engineers activities; Be responsible for their delivery and meeting goals
• Review their work for quality and provide mentoring, coaching
• Plan, prioritize the work for the team in an agile fashion and execute them based on sprint schedule.
A lot About You:
• BS/MS in Computer Science or Data Engineering/Machine Learning with strong understanding of the fundamentals including Data Structures, Algorithms, OS and Networking
• 8+ years experience in software development with Java
• 3+ years experience in owning, designing components of large scale system
• 3+ Experience in leading small teams of engineers
• Demonstrated problem solving skills and taking initiatives
Specialized Skill (Mandatory):
• 5+ years of extensive experience in Hadoop technologies for batch processing
o Oozie
o Pig
o Hive
o Spark
o HBase
• 3+ years of experience
o Real time/ Streaming solutions like Apache Storm, Flink etc
Queuing solutions like Kafka
• Solid understanding of big data fundamentals like High Availability, Distributed file systems like HDFS, Distributed compute framework like Map/Reduce
