R
AWS Data Engineer
Search Jobs
Search by job, company or skills
Search by job, company or skills
Key Responsibilities
. Design, develop, and maintain scalable data pipelines using PySparkon AWS.
. Build and orchestrate ETL/ELT workflows using AWS Glueand AWS Step Functions.
. Develop serverless applications and automation using AWSLambda.
. Write clean, efficient, and maintainable Python/PySpark codefollowing engineering best practices.
. Provision and manage cloud infrastructure using Terraform(Infrastructure as Code).
. Implement and maintain CI/CD pipelines to automate codedeployment, testing, and infrastructure changes.
. Monitor, troubleshoot, and optimize data pipelines forperformance, reliability, and cost efficiency.
. Collaborate with business stakeholders to deliver datasolutions.
. Follow DevOps, security, and coding standards throughout theengagement.
Required Skills
. Strong hands-on experience with PySpark and Python fordata engineering.
. Experience developing ETL pipelines using AWS Glue.
. Proficiency with AWS Step Functions for workfloworchestration.
. Experience building serverless solutions using AWS Lambda.
. Hands-on experience with Terraform for Infrastructure asCode (IaC).
. Experience implementing CI/CD pipelines using tools suchas GitLab, GitHub Actions, Jenkins, or similar.
. Good understanding of AWS services, data lakes, IAM, S3,CloudWatch, and monitoring.
Job ID: 151802411
Skills:
S3, Aws Lambda, Aws Services, Pyspark, AWS Glue, Jenkins, Cloudwatch, Terraform, Iam, Gitlab, Python, AWS Step Functions, Monitoring, CI CD, data lakes, GitHub Actions
Skills:
data engineering , Data Engineer, AWS, Databricks, Pyspark, Lambda, Amazon Web Services, Apache Spark, Spark SQL, Sql, Data Modeling, Etl, ELT, Big Data, Aws S3, Amazon S3, AWS Glue, Aws Lambda, Amazon Redshift, AWS IAM, Data Warehousing, Data Lake, Data Integration, Data Transformation, Data Migration, Cloud Migration, Git, Devops, Python, Aws Cloud, Data Architecture, Data Analytics, Data Governance, Data Quality, Agile, Sdlc, AWS Data Engineer, Data Pipelines, Scalable Data Pipelines, Delta Lake, Lakehouse Architecture, Amazon Athena, Cloud Data Engineering, Data Lakehouse, Data Processing, Workflow Orchestration, Batch Processing, Real-Time Data Processing, Performance Optimization, CI/CD, AWS Certified Data Engineer, AWS Certified Solutions Architect, Databricks Certified Data Engineer, Data Platform, Data Optimization, Stakeholder Management
Skills:
S3, Oracle Sql, Data Architecture, ELT, Ec2, Kinesis, Python, Java, Aws Services, Emr, Redshift, Sql, Devops, Hive, Spark, Plsql, Kubernetes, Etl, Modeling, Airflow, Warehousing, R, machine learning deployment, microservices deployment, data crawling, streaming solutions, CI CD pipelines, warehouse construction, lake formation, Athena, container orchestration
Skills:
snowflake , Data Engineer, AWS, AWS glue, Aws Redshift, Data Lake, Data Warehouse, Airflow
Skills:
snowflake , Aws Lambda, Amazon Kinesis, Pyspark, AWS Glue, Sql, ELT, Apache Airflow, Data Integration, Iam, Data Transformation, Data Modelling, Amazon Rds, Python, Etl, AWS, AWS Step Functions, AWS DMS, Data quality management, Data ingestion frameworks, AWS MWAA
