Search by job, company or skills

GCP Data Engineer

GCP Data Engineer

Tata Consultancy Services
6-10 Years
Not Disclosed
Early Applicant
  • Posted 11 days ago
  • Be among the first 20 applicants

Job Description

Job description

Job Description

Role: Google Data Engineer

Experience: 6-10 Years

Location: Chennai, Bengaluru, Hyderabad, Pune, Kochi, Kolkata, NCR, Delhi

Virtual Interview: 10th Oct

Required Technical Skill Set:

SQL + GCP (BigQuery, Pub/Sub, Dataflow, Composer DAGs, Airflow)

Key Requirements:

  • Experience in BigQuery, Pub/Sub, Dataflow, Composer DAGs, and Airflow.
  • Strong SQL knowledge with the ability to translate complex business scenarios into efficient queries.
  • Experience in data modeling and data mapping.
  • Hands-on experience with Google Cloud SDK and API scripting.
  • Strong programming experience in Python.
  • Experience working in Agile processes and DevOps methodologies.
  • Retail domain experience will be an added advantage.

Responsibilities:

  • Create and maintain optimal data pipeline architecture, replicating existing processes.
  • Analyze, explore, and select appropriate tools for data migration and transformation.
  • Assemble large, complex datasets that meet functional and non-functional business requirements.
  • Ensure data security through masking and encryption techniques.
  • Work with data and analytics experts to improve data system functionality.
  • Identify, design, and implement process improvements by automating manual processes, optimizing data delivery, and redesigning infrastructure for greater scalability.

Note: Please apply only if your experience and skill set align with the requirements mentioned above.

We are not looking for immediate joiners. We are specifically seeking candidates who have a 90-day notice period.

More Info

Job Type:
Industry:
Employment Type:

Key Skills

API scripting

DAGs

GCP BigQuery

Google Cloud SDK

Similar Jobs

5-8 yrs
Bengaluru, India
Skills:
Pyspark, Sql, ELT, Data Modeling, BigQuery, Etl, Dataproc, Python, Git, CI CD tools, Cloud Composer, Cloud Dataflow, Pub Sub, GCP data services, performance optimization, GCS, partitioning
7-9 yrs
Bengaluru, India
Skills:
Sql, BigQuery, Dataproc, Python, Gcp, DataFlow, PUB SUB
6-8 yrs
Bengaluru, India
Skills:
Sql, Rest Apis, BigQuery, Python, Gcp, GCS, Cloud Run, Airflow, Eventarc, Cloud Composer, DataForm, Pub Sub, Cloud Functions
8-12 yrs
Bengaluru, India
Skills:
Github, Cloud Storage, Docker, Python, AWS, Java, BigQuery, Hadoop, Scala, Sql, Jenkins, Gcp, Spark, Apache Kafka, Apache Beam, DataFlow, Azure, Kubernetes, Go, Flink, Pub Sub, Cloud Composer, GCP Data Products, Spinnaker
7-9 yrs
Bengaluru, India
Skills:
BigQuery, Sql, Cloud Storage, Gcp, DataFlow, Cloud Monitoring, Pub Sub