This position focuses on designing, building, and maintaining batch and real-time data pipelines.
Responsibilities include:
- Enhancing and maintaining existing data ingestion, transformation, and extraction pipelines.
- Collaborating with product owners to gather detailed requirements.
- Building new and optimized data pipelines to meet end-user requirements.
- Ensuring data pipelines meet non-functional requirements such as security and scalability.
- Performing data profiling, analysis, and transformation.
- Coordinating with other teams for planning, design, and release management.
