Data Engineer

Responsibilities

• Design and maintain batch and real-time data pipelines.
• Develop ETL/ELT processes and data ingestion frameworks.
• Work with teams to gather data requirements and technical specifications.
• Monitor, troubleshoot, and optimize pipeline performance.
• Automate data ingestion, transformation, and validation.
• Implement CI/CD pipelines and infrastructure automation.
• Ensure data security and compliance standards.
• Support project planning, estimation, and delivery.

Skills Required

• 10+ years of Data Engineering experience.
• Strong skills in Python, SQL, Spark, and SSIS.
• Experience with Databricks, Snowflake, BigQuery, and Data Lake.
• Strong knowledge of ETL pipelines, Data Warehousing, Star Schema, and Dimensional Modelling.
• Experience with distributed systems and large-scale datasets.
• Good analytical, communication, and problem-solving skills.