BIg Data Developer -Contract

ABOUT THE COMPANY

Zenith Infotech (S) Pte Ltd. was started in 1997, primarily with the vision of offering state-of-the-art IT Professionals and solutions to various organizations and thereby helping them increase their productivity and competitiveness. From deployment of one person to formation of whole IT teams, Zenith Infotech has helped clients with their staff augmentation needs. Zenith offers opportunity to be engaged in long term projects with large IT savvy companies, Consulting organizations, System Integrators, Government, and MNCs.

EA 20S0237

Industry
62011 - Development of software and applications (except games and cybersecurity)

Job Scope:

. Using the Talend ETL toolset, to create new and maintain existing ETL jobs.

. Design and implement ETLfor extracting and transforming data from diverse sources, such as: Hive, PostgreSQL, and SQL Server databases.

. Design and develop database tables necessary along with the necessary constraints as per the requirement.

. Collaborate with Team members to understand source system structures and data retrieval methods/techniques, and tools within the organization.

. Support the development of data transformation logic using ETL tools or scripting languages like SQL, Python, etc.

. Clean, validate, and transform data to confirm target schema and quality standards.

. Work with the Team to execute data quality improvement plans.

. Participate in troubleshooting activities to maintain data integrity and process efficiency.

Required skills
. Experience with Talend, Python and Spark
. Should have good knowledge and working experience in Datalake and Hadoop (Hive, Impala, HDFS).
. Hands-on experience in designing, developing, and optimizing Talend Big Data jobs leveraging the Spark engine
. Good understanding of Spark Catalyst Optimizer and spark executer parameters to optimize the Spark queries
. Strong experience in data-warehousing and data-modeling techniques
. Knowledge of industry-wide visualization and analytics tools
. Good interpersonal skills and positive attitude