Data Engineer

Data Architecture & Pipeline Development

• Design and implement data models for social service integration (Client360, Household360)
• Build ETL processes for legacy system migration and real-time agency data synchronization
• Develop and maintain batch and real-time data pipelines for cross-agency data flow
• Implement data quality validation frameworks and monitoring systems

Integration Development & API Management

• Design and develop APIs for system integrations (OneCV, CaseConnect, ComLink+)
• Implement interfaces with government services
• Create and maintain documentation for all integration points and APIs
• Ensure API performance, security, and scalability

Data Security & Compliance

• Implement data protection measures including field-level encryption and access controls
• Ensure compliance with IM8 standards and government security requirements
• Maintain audit trails and data masking for sensitive information
• Monitor and enforce data classification policies

Performance Optimization & Monitoring

• Optimize query performance and batch processing efficiency
• Monitor and tune real-time data synchronization
• Implement performance monitoring dashboards
• Maintain system reliability and uptime metrics

Cross-Team Collaboration

• Work with business analysts, solution architects, and frontend developers
• Participate in Agile ceremonies and sprint planning
• Conduct code reviews and pair programming sessions
• Provide technical guidance on data integration matters

Quality Assurance & Documentation

• Develop and maintain comprehensive technical documentation
• Implement automated testing for data transformations and integrations
• Ensure data accuracy and validation across systems
• Create and maintain troubleshooting guides and procedures