Data Engineer

Job Responsibilities:

• Deliver end-to-end data pipeline solutions on cloud infrastructure leveraging the latest technologies and the best industry practices
• Use domain modelling techniques to allow us to build best in class business products.
• Structure software so that it is easy to understand, test and evolve.
• Build solutions that avoid single points of failure, using scalable architectural patterns.
• Develop secure code so that customers are protected from malicious actors.
• Promptly investigate and fix issues and ensure they do not resurface in the future.
• Make sure releases happen with zero downtime for end-users.
• Keep an eye on performance, making sure we use the right approach to identify and solve problems.
• Ensure systems are reliable and easy to operate.
• Keep us up to date by continuously updating technologies and patterns.
• Support the products built through their entire lifecycle, including in production and during incident management

Job Requirements:

• Recent hands-on professional experience as a data engineer
• Experience in coding in a recent version of the Python programming language
• Experience in designing and implementing effective tests (unit, component, integration, end-to-end, performance, etc.)
• Experience with cloud technologies and distributed systems
• Experience with data transformation frameworks and data pipeline orchestration tools
• Experience with managing large volumes of data and optimizing data processing
• Understanding of event-base architecture, data streaming and messaging frameworks
• Coach other team members on coding practices, design principles, and implementation patterns that lead to high-quality maintainable solutions.
• Manage stakeholders and effectively prioritize work across multiple work streams.
• Experience with data governance frameworks
• Understanding of incremental data processing and versioning