Description
Summary
We are seeking a Senior Data Engineer with a distinguished background in Google Cloud Platform (GCP) to spearhead the evolution of our enterprise data ecosystem. With 5–8 years of professional experience, the successful candidate will operate as a technical authority, designing and deploying sophisticated data architectures that bridge the gap between complex raw data and strategic business intelligence. This role demands a mastery of distributed computing, advanced Python development, and expert-level SQL optimization to ensure the integrity, scalability, and cost-efficiency of our global data assets.
Core Responsibilities
- Architectural Strategy & System Design
Enterprise Framework Design: Conceptualize and implement end-to-end data architectures utilizing GCP's Modern Data Stack (BigQuery, Dataflow, Dataform).
Scalable Data Modeling: Lead the development of high-performance data models (Star, Snowflake, Data Vault) optimized for multi-petabyte scale and high-concurrency analytics.
Hybrid & Multi-Cloud Strategy: Provide technical leadership on data integration strategies spanning GCP, on-premise systems, and third-party SaaS environments.
- Advanced Engineering & Pipeline Automation
Distributed Processing: Engineer highly resilient, low-latency streaming and batch pipelines using Apache Beam (Dataflow) and Cloud Composer (Airflow).
Software Engineering Excellence: Develop reusable Python libraries and frameworks to standardize data ingestion, logging, and error-handling across the engineering team.
Infrastructure as Code (IaC): Drive operational maturity by managing cloud resources exclusively through Terraform, ensuring robust versioning and environment parity.
- Data Governance, Security & Performance
System Optimization: Conduct deep-dive performance tuning of BigQuery environments, implementing partitioning, clustering, and slot management to optimize ROI.
Security & Compliance: Architect data security protocols including VPC Service Controls, IAM Least Privilege, and data masking/encryption to meet global compliance standards (GDPR, SOC2).
Observability: Establish comprehensive monitoring and alerting frameworks for data health, ensuring high availability and meeting stringent Service Level Objectives (SLOs).
- Technical Leadership & Collaboration
Strategic Mentorship: Serve as a mentor to mid-level and junior engineers, conducting rigorous code reviews and promoting best practices in DataOps.
Stakeholder Alignment: Act as a primary technical liaison between Data Science, Business Intelligence, and Executive leadership to translate business goals into technical roadmaps.
