Search by job, company or skills

Data Engineer

Data Engineer

Beyondsoft Corp
3-5 Years
Not Disclosed
  • Posted 31 minutes ago
  • Be among the first 10 applicants

Job Description

What you'll be doing

  1. Develop, maintain and optimise data pipelines using Python, PySpark and SQL across Cloudera, Snowflake and Databricks platforms.
  2. Perform data extraction, cleansing, transformation and loading (ETL) using Informatica and other data integration tools.
  3. Support batch data processing and enterprise data integration to ensure data accuracy, quality and consistency.
  4. Monitor, troubleshoot and resolve data pipeline failures, performance bottlenecks and data discrepancies.
  5. Collaborate with Senior Data Engineers and reporting teams to deliver reliable datasets for business analytics and reporting.

Requirements

  • Bachelor's degree in Computer Science, IT, Data Engineering or related disciplines.
  • Minimum 3 years of experience in Data Engineering, ETL Development or Data Integration.
  • Strong hands-on skills in Python, PySpark and SQL.
  • Practical experience with Informatica and ETL/ELT development.
  • Experience with at least one of the following platforms: Cloudera, Snowflake or Databricks.
  • Good understanding of data pipelines, batch processing, data transformation and data quality management.
  • Strong analytical, troubleshooting and problem-solving skills.

More Info

Job Type:
Industry:
Employment Type:

Key Skills

About Company

Similar Jobs

5-10 yrs
Singapore
Skills:
Data Lineage, Data Modelling, Metadata Management, Shell Scripting, Release Management, Git, Python, Data Quality Frameworks, Apache Iceberg, SCD Type 1 2 3 implementations, CI CD Pipelines, Hadoop Ecosystem Cloudera, SQL Advanced, Teradata, Spark PySpark, Trino, Automated Deployment Tools, ETL ELT Design, Data Reconciliation Techniques
4-7 yrs
SGD 7,000 - 8,000 per month
Singapore, Cross Street
Skills:
Data Quality, Data Governance, Data Cleaning, Data Modeling, Data Integration, Python, Sql, pipeline development, Data Processing, AI applications
2-5 yrs
SGD 4,500 - 6,500 per month
Singapore
Skills:
Java, Apache Flink, Scala, Apache Spark, Automated Testing, Sql, Apache Airflow, Git, Docker, Apache Kafka, Kubernetes, S3-compatible object storage, CI/CD
5-8 yrs
SGD 8,000 - 12,000 per month
Singapore
Skills:
snowflake , Pyspark, Cloudera, Databricks, Python
2-4 yrs
Singapore
Skills:
Java, Apache Flink, Scala, Apache Spark, Automated Testing, Sql, Apache Airflow, Git, Docker, Apache Kafka, Kubernetes, stream-processing, S3-compatible object storage, Data Mapping, CI CD, Transformation, scheduled workflows, Validation