Big Data Engineer (PySpark & Scala)

Role Summary

We are seeking a highly skilled Big Data Engineer with strong experience in PySpark and Scala to design, build, and optimizelarge-scale data processing systems.

The associate will work on distributed data platforms, enabling real-time and batch analytics solutions across enterprise data ecosystems.

The role involves building scalable data pipelines, data lakes, and streaming solutions leveraging modern big data technologies.

This role requires a combinationof:

Strong PySpark + Scala coding

Deep big data architecture knowledge

Hands-on experience with streaming + cloud data engineering

Required Skills

Core Technologies

Strong hands-on experience in:

PySpark & Apache Spark

Scala programming

Expertise in:

Spark SQL, Data Frames, RDDs

Distributed data processing frameworks