Overview
Build and maintain scalable data pipelines and platforms to support data-driven applications and analytics.
Key Responsibilities
- Design, develop and deploy data tables, views and marts in data warehouses, operational data store, data lake and data virtualization.
- Perform data extraction, cleaning, transformation, and flow.
- Design, build, launch and maintain efficient and reliable large-scale batch and real-time data pipelines with data processing frameworks.
- Integrate and collate data silos in a manner which is both scalable and compliant
- Collaborate with Product Manager, Data Architect, Business Analysts, Frontend Developers, Designers and Data Analyst to build scalable data-driven products.
- Be responsible for developing backend APIs & working on databases to support the applications.
- Work in an Agile Environment that practices Continuous Integration and Delivery.
- Work closely with fellow developers through pair programming and code review process.
Key Requirements
- Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field
- Minimum 4 years of experience in data engineering, data platform development, or related roles
- Strong experience in data engineering and pipeline development
- Proficiency in databases, SQL, and data processing frameworks
- Experience with cloud data platforms
- Familiarity with Agile and CI/CD practices
- Familiar with GIS platforms: ArcGIS Server, PostGIS
- Able to use spatial Python libraries: GeoPandas, Shapely
- Build scalable geospatial data pipelines for ingestion, transformation, storage, and quality checks from multiple government sources.
- Implements data cataloging, metadata, lineage, and security optimizes storage and performance for GIS analytics (e.g., PostGIS, data lakes).
- Provides reliable data services and contracts to support downstream GIS analytics and front-end visualizations, collaborating closely with GIS and frontend teams.
- Data management: applies validation, cleansing, reprojection, metadata, and data lineage of geospatial data
