Senior AWS Data Engineer

Role: Senior AWS Data Engineer

Location: Pan India

Experience: 7+ yrs

Immediate Joiners Only

SENIOR DATA ENGINEER

OVERVIEW OF ROLE

• Handle client communication to design and deliver large scale Data Transformation.

• Build and support large-scale batch and real-time data pipelines with data processing frameworks like AWS managed services.

• Help drive optimization, testing and tooling to improve data quality and our ability to use data to make product decisions.

• Work in multi-functional agile teams to continuously experiment, iterate and deliver on new product and infrastructure objectives.

• Contribute to and optimize the existing data infrastructure

• Support for the integration of API calls to gather third-party vendor data.

REQUIRED QUALIFICATIONS

• 7 + years of experience building ETL pipeline to handle large datasets

• 3 + years of experience with AWS: S3, Glue, Aurora, Databricks and other services

• 2+ years of experience in data modeling and database design

• 3 + years of experience with data modeling and/or migrating data from legacy systems

• Must have strong SQL skills. Proficient in at least one of programming languages: Python, Scala, Go or Java.

PREFERRED QUALIFICATIONS

• Data engineer with API development experience

• Experience with Redis or any in-memory database

• Relevant AWS Certifications in cloud computing, data engineering, and/or solutions architecture.

• Previous developing and debugging experience in a large team

• Detail-oriented with an ability to effectively multi-task in a deadline-driven atmosphere.

• 3 + years of experience writing and maintaining infrastructure code.

• 5 + years of experience using any automation tools and CI/CD pipelines

• Nice to have experience in Lambda functions, IAM, Step functions, CloudWatch

we need someone with strong hands-on PySpark and Apache Spark experience who can independently support job validation and guide the client team on effective validation techniques