This role is required to design and build high volume backend data processing systems for Razer's Artificial Intelligence (AI) gaming products. The ideal candidate is responsible for developing and implementing data pipelines, data storage systems, and backend application software, while working closely with frontend engineers, data scientists, and machine learning engineers to enable Gen AI capabilities.
Essential Duties and Responsibilities
- Design and implement data systems that enable the organization to store, process, and analyze large volumes of data. This involves developing data pipelines, designing scalable data processing systems in support of Gen AI capabilities.
- Manage data lakes, knowledge bases, and application databases. This involves creating and managing table schemas, views, materialized views, including tokenization techniques for Gen AI.
- Develop and templatize data pipelines that enable high volume extract, transform, and load operations from various sources - particularly API-based or web-based data ingestion.
- Design, develop, and maintain highly performant, scalable, and robust backend systems and server-side logic - including maintenance and optimization of backend infrastructure for changing product requirements.
- Collaborate with data scientists and machine learning engineers to understand the data needs of various stakeholders across the organization and integrate appropriate solutions.
Requirements
- Ability to work in fast paced, high pressure, agile environment.
- Ability and willingness to learn and apply new technologies
- Strong in programming languages such as Python, SQL.
- Experience in developing and deploying applications running on cloud infrastructure such as AWS, Azure or Google Cloud Platform using Infrastructure as code tools such as Terraform, containerization tools like Dockers, container orchestration platforms like Kubernetes
- Experience in system design and building scalable, high concurrency user applications
- Familiarity with a wide variety and genres of video games, and the gaming industry in general.
- Excellent with various data processing techniques (streaming, batch, event-based), managing and optimizing data storage (Data Lake, Vector Data Stores and Database, SQL, and NoSQL) is essential.
- Excellent problem-solving and analytical skills, with an understanding of Gen AI technologies and their applications
- Experience using orchestration tools like Airflow or Prefect is preferred
- Excellent written and verbal communication skills for coordinating across teams.
- Experience and Interest to keep up with the advancement in the Data Engineering Field
- Has a Bachelor's or Master's degree in computer science or similar discipline.
