Data Engineer
Data Engineer
Beyondsoft Corp- Posted 31 minutes ago
- Be among the first 10 applicants
Job Description
What you'll be doing
- Develop, maintain and optimise data pipelines using Python, PySpark and SQL across Cloudera, Snowflake and Databricks platforms.
- Perform data extraction, cleansing, transformation and loading (ETL) using Informatica and other data integration tools.
- Support batch data processing and enterprise data integration to ensure data accuracy, quality and consistency.
- Monitor, troubleshoot and resolve data pipeline failures, performance bottlenecks and data discrepancies.
- Collaborate with Senior Data Engineers and reporting teams to deliver reliable datasets for business analytics and reporting.
Requirements
- Bachelor's degree in Computer Science, IT, Data Engineering or related disciplines.
- Minimum 3 years of experience in Data Engineering, ETL Development or Data Integration.
- Strong hands-on skills in Python, PySpark and SQL.
- Practical experience with Informatica and ETL/ELT development.
- Experience with at least one of the following platforms: Cloudera, Snowflake or Databricks.
- Good understanding of data pipelines, batch processing, data transformation and data quality management.
- Strong analytical, troubleshooting and problem-solving skills.

