22. Data Engineer (Junior) - KT
dci consultants private limited- Posted an hour ago
- Be among the first 10 applicants
Job Description
Mandatory Requirements
. 2-4 years of data engineering or backend development experience
. Familiarity with Agile delivery
. Working knowledge of SQL and Java or Scala
. Basic experience developing batch or streaming pipelines using Apache Spark, Apache Flink or Apache Kafka
. Familiarity with containerised deployment, Kubernetes and S3-compatible object storage
. Experience implementing mappings, transformations, validation checks and scheduled workflows, and supporting pipeline monitoring and defect resolution under guidance
Preferred Requirements
. Familiarity with the SAFe framework . Familiarity with Apache Kafka, Apache Spark, Apache Flink or comparable processing technologies, and MinIO or equivalent S3-compatible object storage
. Familiarity with relational databases, Git, CI/CD, Docker and automated testing
Equivalent Technologies
. Apache Spark or equivalent data-processing frameworks Apache Airflow or equivalent workflow-orchestration tools other S3-compatible object-storage platforms
..We regret to inform that only shortlisted candidates will be notified. Personal data collected will be used for recruitment purposes..
More Info
Key Skills
S3-compatible object storage
CI/CD
