

Search by job, company or skills
Key Skills:
▪ Lead a team of data engineers in managing day-to-day BAU operations, production support, incident management, and platform stability.
▪ Strong AWS knowledge in terms of designing new architecture and providing optimized solutions for existing ones. (S3, Glue, DMS, MWAA, AMS, IAM).
▪ In-depth knowledge with respect to Snowflake and its architecture.
▪ Prefer prior Experience in BAU environment.
▪ Good knowledge on Airflow and MWAA.
▪ Hands-on experience in SQL/Python/Pyspark.
▪ Expertise in optimizing techniques in cloud environments.
▪ Should have the vision on data strategy and able to deliver the same.
▪ Should be able to lead the design and implementation of data management processes, including data sourcing, integration, and transformation.
▪ Able to manage and lead a team of data professionals, providing guidance, mentoring and foster a collaborative and innovative team culture focused on continuous improvement.
▪ To evaluate and recommend data-related technologies, tools, and platforms.
▪ Collaborate with IT teams to ensure seamless integration of data solutions.
▪ Should have experience in Implementing and enforcing data security protocols and ensure compliance with relevant regulations.
Required Qualifications:
▪ At least 8+ years of Data Engineer Experience
▪ Bachelor qualification in a computer science or STEM (science, technology, engineering, or mathematics) related field.
▪ At least 5+ years of recent hands-on professional experience (actively coding) working as a Lead handling support & production issue.
▪ 2+ experience with large scale datasets, data lake and data warehouse technologies such as AWS Redshift, Google BigQuery, Snowflake. Snowflake is highly preferred.
Job ID: 151766449
Skills:
Aws Lambda, S3, Aws Services, Pyspark, AWS Glue, Jenkins, Cloudwatch, Terraform, Iam, Gitlab, Python, AWS Step Functions, GitHub Actions, data lakes
Skills:
Java, Hadoop, Scala, Spark, Kafka, HBase, Python, Sql, Druid, Clickhouse, Flink
Skills:
Data Lineage, Metadata Management, Oracle Sql Server, Data Modelling, Data Management, PostgreSQL, Sql, Data Integration, ELT, Data Quality, DB2, Data Architecture, Data Profiling, Data Governance, Etl, Data Lakes, Relational Databases, Lakehouse Architectures, Source-to-Target Mapping, Physical Data Modelling, Enterprise Data Architecture, Data Analysis
Skills:
data engineering , snowflake , Java, Unix Scripting, Emr, Autosys, Cloud Technologies, Devops, Jenkins, React, Ec2, MLops, Ansible, Python, Full Stack Engineering, Airflow, ETL Processes, Microservices Development, Data Management Principles
Skills:
Devops, Pyspark, Apache Spark, Databricks, Python, Azure DevOps, Microsoft Azure Cloud