Responsibilities:
Leadership & Strategy
- Lead a team of data engineers in designing and implementing cloud-native data solutions.
- Define and drive the data engineering roadmap aligned with business goals.
- Collaborate with cross-functional teams including Data Science, Analytics, DevOps, and Product.
Architecture & Development
- Architect and implement scalable, secure, and cost-effective data pipelines and platforms.
- Design and optimize data lake, data warehouse, and real-time streaming architectures.
- Ensure high availability, performance, and reliability of data systems.
Cloud & Tools
- Leverage cloud platforms (AWS, Azure). for data storage, processing, and orchestration.
- Utilize tools such as Snowflake, Data Bricks, AWS Glue, Iceberg, Apache Spark, Airflow, Kafka, dbt, and Terraform.
- Implement CI/CD pipelines and infrastructure-as-code for data workflows.
Governance & Quality
- Establish data governance, security, and compliance standards.
- Monitor data quality and implement automated validation and alerting mechanisms.
Mentorship & Growth
- Mentor junior engineers and foster a culture of continuous learning and innovation.
- Conduct code reviews, technical workshops, and performance evaluations.
Requirements:
- Bachelor's or Master's degree in Computer Science, Engineering, or related field.
- 7+ years of experience in data engineering, with 2+ years in a leadership role.
- Proven expertise in cloud platforms (AWS, Azure).
- Strong programming skills in Python, Scala, or Java.
- Experience with big data technologies (Spark, Hadoop), ETL tools, and SQL.
- Familiarity with data modeling, warehousing, and real-time data processing.
- Excellent communication, leadership, and project management skills.