

Senior Big Data Engineer
Senior Big Data Engineer with strong technical skills and experience working with and supporting multiple engineering teams.
•
• Must be able to go for onsite interview in NJ
•
• Need only local candidates
•
• Requirements:
• Must have heavy Databricks exp
• Experience in building Big Data/ML/AI applications and optimizing data pipelines, architectures and data sets.
• 5+ years of technical experience with big data technologies. They should also have experience using the following software/tools:
• Experience with big data tools: Apache Spark, Databricks, Parquet/Delta, PySpark, SparkSQL, Spark Streaming, Kafka/Kinesis, S3, Glue
• Experience with Databricks using Unity Catalog and MLFlow is a big plus
• Experience with any relational/noSQL databases or any MPP databases like Snowflake and Redshift.
• Experience with data pipeline and workflow management tools: Step Functions, Airflow
• Experience with AWS cloud services: EC2, EMR, RDS, Redshift, IAM, Security Group, VPC etc.
• Experience developing in Python and Notebooks/IDE
• Experience with Automation: Jenkins CI/CD, Terraform, CDK, Boto3
•
• Must be able to go for onsite interview in NJ
•
• Need only local candidates
•
•