Junior Data Engineer

Responsibilities

• Develop and maintain batch and streaming data pipelines.
• Perform data mapping, transformation and validation.
• Support scheduled data workflows and pipeline monitoring.
• Assist in deploying and maintaining data workloads in containerised environments.
• Troubleshoot data pipeline issues and support defect resolution.
• Work with the team to maintain data quality and support CI/CD processes.
  
  

Qualifications

• Minimum 2 years of experience in data engineering or backend development.
• Familiarity with Agile development methodologies.
• Working knowledge of SQL and Java or Scala.
• Basic experience with Apache Spark, Apache Flink or Apache Kafka.
• Familiarity with Kubernetes, Docker and S3-compatible object storage.
• Experience with data mapping, transformation, validation and scheduled workflows.
• Familiarity with the SAFe framework.
• Exposure to MinIO or equivalent S3-compatible storage solutions.
• Familiarity with relational databases, Git, CI/CD and automated testing.
• Exposure to Apache Airflow or equivalent workflow orchestration tools.
• Knowledge of batch and stream-processing technologies.
  
  

Other Information


Beyondsoft Consulting (Singapore) Pte. Ltd is committed to being an equal opportunity employer and provides equal employment opportunities to all employees and applicants. We strive to cultivate a workplace that celebrates diversity and inclusion, where individuals of all backgrounds—regardless of nationality, ethnicity, religion, age, gender identity, sexual orientation, or any other distinguishing trait—can succeed and thrive. We prohibit discrimination and harassment of any type with regard to race, color, religion, age, national origin, disability status, genetics, sexual orientation, gender identity, or expression. This policy applies to all terms and conditions of employment, including recruiting, hiring, and the entire employee lifecycle. We are focused on creating an environment where everyone can reach their full potential.

Employment offers from Beyondsoft Consulting (Singapore) Pte. Ltd. are contingent upon the successful completion of any required pre-employment processes, in line with applicable laws and regulations. Beyondsoft Consulting (Singapore) Pte. Ltd. does not ask for any recruitment fees, nor does it request any unauthorized payments from candidates as part of the hiring process.