workflow management , Pyspark, Apache Spark, Data Warehousing, Google Cloud, Sql, Automated Testing, Data Modelling, Azure, Python, AWS, Validation, Data quality practices, Copilots, AI-enabled data engineering practices, Data orchestration, AI agents, Modern data architecture, Observability, Monitoring

S3, Pyspark, Apache Spark, Redshift, Sql, Lambda, Kms, Cloudwatch, Kinesis, Terraform, Iam, Databricks, Python, AWS, Step Functions, MSK, EventBridge, Lake Formation, Glue, Delta Lake

data warehouses , Java, Machine Learning, Apis, Scala, Sql, ELT, Python, Etl, data integration frameworks, data observability, CI CD, data lakes, DataOps, automated data quality checks, LLM technologies, streaming integrations

Apache Flink, Google Cloud Platform, Data Modelling, Data Warehousing, Database Management Systems, Sql, Spark, Apache Kafka, Databricks, batch and streaming workflows, Airflow, dbt, ETL pipelines

Performance Tuning, Apis, Mq, Data Warehouse Concepts, Sql, Dimensional Modeling, ELT, Sdlc, Databricks, Azure, Python, Etl, Integration methods, Data Mapping, Job cluster management, pipeline development

Technical Documentation, Unix, Orchestration, Data Integration, Shell scripting, Python, Testing, Logging, Exception Handling, Configuration management, Sql, Linux, Etl, Code reviews, Batch Processing, Merge requests, Engineering standards, Branching strategies, Modular design, Cloud platforms, Data pipeline architecture, CI-CD tooling, Command-line tools, CI/CD pipelines, Mentoring

data engineering , Data Modelling, Hadoop, Hive, Gcp, Spark, Big Data Technologies, Data Architecture, Azure, Etl, AWS, Data Pipelines

Unix, Git, Linux, Shell Scripting, Python, Data Integration, Sql, Etl, Data Quality Monitoring, CI CD Pipelines, Data Pipeline Architecture

software engineering practices , Unix, System Migration, Sql, Git, Linux, Data Integration, Shell scripting, Gitlab, Python, Testing, Etl, Logging, Workflow orchestration tools, Code reviews, Documentation, Cloud platforms, CI/CD pipelines, Large-scale data processing, Error handling, Data pipeline development, Modernisation

Data Architecture, Hadoop, Big Data Technologies, Etl, AWS, Hive, Azure, Gcp, Data Modelling, Spark, Data Pipelines