
Search by job, company or skills

Job Description:
i. Min 5 years exp as Data Engineer
ii. Prefeered who have exp on open source Data Engineering instead of
AWS, Azure and GCP
iii. Must have exp on data visualisation
Apache Spark + Airflow + Kafka + Hive + Hadoop + Linux
Job ID: 148729177
Skills:
and query tuning., and optimize Snowflake-based data warehouse solutions., • Develop and maintain modular DBT models (staging, and marts)., and Git-based workflows., and architecture teams to deliver reliable data solutions., Security & Performance Optimization ? DBT (Data Build Tool) ? Advanced SQL ? Data Modeling & Data Warehouse Architecture ? ETL / ELT Development ? Snowpipe, Streams & Tasks ? Git & CI/CD ? Unix/Linux Shell Scripting ? Control-M, Streams, Clustering, Autosys, Optimize Snowflake performance using Snowpipe, Tasks, Design, Develop, Intermediate, Build scalable ETL/ELT pipelines, Implement CI/CD pipelines, Analytics, Business, enterprise data models, including Star Schema, Snowflake Schema, and Fact/Dimension modeling, Snowflake Architecture, Airflow, or similar orchestration tools
Skills:
Java, Spark Streaming, Scala, Kafka, Python, Sql, Doris, Clickhouse, Starrocks, Flink
Skills:
data engineering , Python, Sql, Pyspark, AWS, Aws Rds, S3, Apache Airflow, Kafka, Etl, ELT, Data Modeling, Data Lake, Docker, Cloud Infrastructure, Nosql, Data Quality, Scalability, dbt, Debezium, CDC Frameworks, Data Pipelines, Real-Time Processing, Batch Processing, Apache Iceberg, Delta Lake, ClickHouse, Workflow Orchestration, Relational Databases, ERP Data Integration, Construction Data, Manufacturing Data, Logistics Data, Pipeline Monitoring, Troubleshooting, Performance Optimization
Skills:
data engineering , Azure Data Lake, Kafka, Postgresql, FastAPI, Apache Kafka, PostgreSQL, Python, Angular, Typescript, Rest API Development, API security, Azure Synapse, Azure Storage, Sql, Database Design, Devops, Kubernetes, Authentication, Identity Management, solution architecture, Web Application Development, TimescaleDB, asynchronous processing, data pipeline development, real-time data streaming, Batch Processing, cloud data platforms, CI/CD pipelines, container orchestration, microservices architecture, observability, Microsoft Entra ID, consumer groups, Problem Solving
Skills:
Data Analytics, Etl Development, Kafka, Informatica, Microsoft Ssis, Gcp, Data Warehousing, Talend, Azure, AWS, Agile SDLC, Advanced Analytics solutions, Big Data platforms, cloud-based data platforms, NiFi, Business Intelligence
We don’t charge any money for job offers