PySpark Engineer

Job Overview

A team of Data Scientists is looking for a skilled Python and pySpark developer who will support the team in development and deploying high quality data analysis projects and webapps.

Responsibilities

Propose, contribute to, and maintain a Python library of common functions that would help the team to develop webapps and run pySpark and SQL queries efficiently

Define the deployment procedure and deploy the team's applications to production environment

Suggest and POC optimal app architectures

Troubleshoot apps in production

provide first-line user support

Performance optimization of Spark and SQL transformations

The candidate should be able to work autonomously but effectively sharing the results with a small team

Qualifications And Skills

Advanced degree in Computer Science, Mathematics, or a related field

10+ years of programming experience

Strong Python development experience related to big data processing or big data analysis

Strong SQL, or pySpark, or Spark experience

Good understanding or experience with the distributed data processing

Nice To Haves

Experience with development of code recipes in Dataiku

Webapps development

Data visualization

Data Analysis skills

Experience with the Financial industry data processing, ideally with the equity and option markets transactions

If this is a role that interests you and you’d like to learn more, click apply now and a recruiter will be in touch with you to discuss this great opportunity. We look forward to speaking with you!

About ManpowerGroup, Parent Company of:Manpower, Experis, Talent Solutions, and Jefferson Wells

ManpowerGroup® (NYSE: MAN), the leading global workforce solutions company, helps organizations transform in a fast-changing world of work by sourcing, assessing, developing, and managing the talent that enables them to win. We develop innovative solutions for hundreds of thousands of organizations every year, providing them with skilled talent while finding meaningful, sustainable employment for millions of people across a wide range of industries and skills. Our expert family of brands – Manpower, Experis, Talent Solutions, and Jefferson Wells – creates substantial value for candidates and clients across more than 75 countries and territories and has done so for over 70 years. We are recognized consistently for our diversity - as a best place to work for Women, Inclusion, Equality and Disability and in 2022 ManpowerGroup was named one of the World's Most Ethical Companies for the 13th year - all confirming our position as the brand of choice for in-demand talent.