Data Engineer (ETL)

Key Responsibilities:

. Design, develop, and maintain ETL jobs using the Talend ETL tool set.

. Build and optimize ETL processes for extracting and transforming data from diverse sources including Hive, PostgreSQL, and SQL Server.

. Design and develop database tables with appropriate constraints based on business requirements.

. Collaborate with team members to understand source system structures, data retrieval methods, and organizational tools.

. Support the development of data transformation logic using ETL tools and scripting languages such as SQL and Python.

. Perform data cleaning, validation, and transformation to align with target schema and quality standards.

. Contribute to data quality improvement initiatives.

. Participate in troubleshooting activities to ensure data integrity and process efficiency.

Required Skills & Experience:

. Strong hands-on experience with Talend, Python, and Spark.

. Solid knowledge and working experience with Data Lake and Hadoop ecosystem (Hive, Impala, HDFS).

. Proven experience in designing, developing, and optimizing Talend Big Data jobs leveraging the Spark engine.

. Good understanding of Spark Catalyst Optimizer and Spark executor parameters for query optimization.

. Strong foundation in data warehousing and data modeling techniques.

. Familiarity with industry-standard visualization and analytics tools.

. Strong interpersonal skills, proactive attitude, and ability to work effectively in a team environment.