GCP Data Engineer
Job Description
Unnesting of JSON files in Google BigQuery
Google Cloud Run (using container services, python)
Hands on experience in GCP services like composer, cloud function, cloud run
Experience in developing CI/CD pipelines.
Experience in DBT scripts, docker files and knowledge on datavault is a plus.
Strong technical knowledge and hands on experience of python or java
Role: Data Engineer
Industry Type: IT Services & Consulting
Department: Data Science & Analytics
Employment Type: Full Time, Permanent
Role Category: Data Science & Machine Learning
Education
UG: Any Graduate
PG: Any Postgraduate
More Info
Job Type:
Industry:
Function:
Employment Type:
About Company
Skills:
Hadoop, Pyspark, Kafka, Sql, Nosql, Hive, Linux, Sqoop, Spark, Log Monitoring, Apache Beam, Python, GCP data services, data fusion, CI-CD pipelines, Google Cloud Storage
Skills:
BigQuery, Gcp, Spark, Apache Beam, Dataproc, DataFlow, Python, Sql, ELT, Etl, Cloud Data Engineering
Skills:
Pyspark, Google Cloud Platform, Dataproc, Cloud Storage, Terraform, Python, Git, Shell Scripting, Api Development, Tekton, Airflow, DataFusion, DataPlex, Confluent Kafka, Cloud SQL, Data Flow, Agile Framework, Data Transfer Utilities, Redis Memory
Skills:
Sql, Dataproc, Python, Gcp, Pyspark, Kafka, Airflow, Cloud Run, Cloud Function, Big Query, Pubsub, Data Flow
Skills:
Pyspark, Terraform, Postgres, Api, Dataproc, Python, Kafka, Google Cloud Platform, Airflow, Cloud SQL, data fusion, AIRFLOW, Pub Sub, Data Flow, Tekton