Big Data Engineer / Hadoop Developer (Application Programmer V)-CLT
Our client, a financial services client, is seeking a Big Data Engineer/Hadoop Developer to join their team in Charlotte, NC (3 days onsite/2 days remote)
Big Data Engineer / Hadoop Developer focused on data processing, transformation, and optimization using the Hadoop ecosystem. It involves:
• Hadoop & Spark Development: Expertise in HIVE, HDFS, Spark (PySpark 2.4+), and Impala, ensuring efficient data storage, processing, and querying.
• Big Data Schema Design: Experience with Bigtable and HBase for structured storage solutions.
• ETL & Data Processing: Developing, debugging, and maintaining PySpark jobs and optimizing performance in distributed environments.
• SQL & Data Analysis: Strong SQL and Impala skills to work with large datasets, including optimized view design.
• Automation & Scheduling: Working with Autosys and Unix shell scripting for job scheduling and workflow automation.
• API Development & Integration: Implementing and working with REST APIs to support data movement and transformation.
• Agile & Cross-Team Collaboration: Following Agile methodologies and collaborating with internal and external technical teams.
• Preferred Skills: Experience with Scala, Java, Python, Hive 3.0 (CDP), and UI/UX development is a plus.
This role is ideal for someone experienced in big data architecture, distributed computing, and performance optimization for large-scale enterprise applications.
Key contributor to development initiatives that require Hadoop technical expertise across numerous components
• Effectively partner with internal and external technical resources to define and design solutions to meet Business needs
• Design, develop, enhance, debug, support, maintain and test software applications that support Business units
• Provide innovative solutions to problems and drive the design/development of components
• Effectively conveys message in both written and verbal development discussions
• Expertise and demonstrated experience in Hadoop ecosystem components: HIVE, HDFS, SPARK
• Strong grasp and experience in PySpark (2.4 or higher) development
• Skilled in Bigtable design, with HBASE experience preferred
• Strong knowledge of Impala, including demonstrated experience in optimized view design
• Knowledge and implementation experience with RESTer API
• Strong SQL knowledge and data analysis skills
• Familiarity and experience with Autosys scheduler
• Experience in Unix shell scripting
• Strong working experience in Agile methodology
• Working experience with Autosys or other Schedular tools
• Scala experience is preferred, but not required
• Familiarity with Python or Java programing language strongly preferred
• Familiarity and working experience with HIVE 3.0 (CDP platform) preferred
• UI/UX development experience strongly preferred
• Banking domain experience (especially in compliance and risk)
If this is a role that interests you and you’d like to learn more, click apply now and a recruiter will be in touch with you to discuss this great opportunity. We look forward to speaking with you!
About ManpowerGroup, Parent Company of:Manpower, Experis, Talent Solutions, and Jefferson Wells
ManpowerGroup® (NYSE: MAN), the leading global workforce solutions company, helps organizations transform in a fast-changing world of work by sourcing, assessing, developing, and managing the talent that enables them to win. We develop innovative solutions for hundreds of thousands of organizations every year, providing them with skilled talent while finding meaningful, sustainable employment for millions of people across a wide range of industries and skills. Our expert family of brands – Manpower, Experis, Talent Solutions, and Jefferson Wells – creates substantial value for candidates and clients across more than 75 countries and territories and has done so for over 70 years. We are recognized consistently for our diversity - as a best place to work for Women, Inclusion, Equality and Disability and in 2022 ManpowerGroup was named one of the World's Most Ethical Companies for the 13th year - all confirming our position as the brand of choice for in-demand talent.
Our client, a financial services client, is seeking a Big Data Engineer/Hadoop Developer to join their team in Charlotte, NC (3 days onsite/2 days remote)
Big Data Engineer / Hadoop Developer focused on data processing, transformation, and optimization using the Hadoop ecosystem. It involves:
• Hadoop & Spark Development: Expertise in HIVE, HDFS, Spark (PySpark 2.4+), and Impala, ensuring efficient data storage, processing, and querying.
• Big Data Schema Design: Experience with Bigtable and HBase for structured storage solutions.
• ETL & Data Processing: Developing, debugging, and maintaining PySpark jobs and optimizing performance in distributed environments.
• SQL & Data Analysis: Strong SQL and Impala skills to work with large datasets, including optimized view design.
• Automation & Scheduling: Working with Autosys and Unix shell scripting for job scheduling and workflow automation.
• API Development & Integration: Implementing and working with REST APIs to support data movement and transformation.
• Agile & Cross-Team Collaboration: Following Agile methodologies and collaborating with internal and external technical teams.
• Preferred Skills: Experience with Scala, Java, Python, Hive 3.0 (CDP), and UI/UX development is a plus.
This role is ideal for someone experienced in big data architecture, distributed computing, and performance optimization for large-scale enterprise applications.
Key contributor to development initiatives that require Hadoop technical expertise across numerous components
• Effectively partner with internal and external technical resources to define and design solutions to meet Business needs
• Design, develop, enhance, debug, support, maintain and test software applications that support Business units
• Provide innovative solutions to problems and drive the design/development of components
• Effectively conveys message in both written and verbal development discussions
• Expertise and demonstrated experience in Hadoop ecosystem components: HIVE, HDFS, SPARK
• Strong grasp and experience in PySpark (2.4 or higher) development
• Skilled in Bigtable design, with HBASE experience preferred
• Strong knowledge of Impala, including demonstrated experience in optimized view design
• Knowledge and implementation experience with RESTer API
• Strong SQL knowledge and data analysis skills
• Familiarity and experience with Autosys scheduler
• Experience in Unix shell scripting
• Strong working experience in Agile methodology
• Working experience with Autosys or other Schedular tools
• Scala experience is preferred, but not required
• Familiarity with Python or Java programing language strongly preferred
• Familiarity and working experience with HIVE 3.0 (CDP platform) preferred
• UI/UX development experience strongly preferred
• Banking domain experience (especially in compliance and risk)
If this is a role that interests you and you’d like to learn more, click apply now and a recruiter will be in touch with you to discuss this great opportunity. We look forward to speaking with you!
About ManpowerGroup, Parent Company of:Manpower, Experis, Talent Solutions, and Jefferson Wells
ManpowerGroup® (NYSE: MAN), the leading global workforce solutions company, helps organizations transform in a fast-changing world of work by sourcing, assessing, developing, and managing the talent that enables them to win. We develop innovative solutions for hundreds of thousands of organizations every year, providing them with skilled talent while finding meaningful, sustainable employment for millions of people across a wide range of industries and skills. Our expert family of brands – Manpower, Experis, Talent Solutions, and Jefferson Wells – creates substantial value for candidates and clients across more than 75 countries and territories and has done so for over 70 years. We are recognized consistently for our diversity - as a best place to work for Women, Inclusion, Equality and Disability and in 2022 ManpowerGroup was named one of the World's Most Ethical Companies for the 13th year - all confirming our position as the brand of choice for in-demand talent.
