We are seeking a
Data Engineer. You build reliable batch and real-time pipelines that turn messy data into trusted datasets for products and analytics. You partner with engineers and analysts to integrate data across platforms while keeping performance, security and scalability in mind.
Responsibilities
- Design and deliver data tables, views and marts across data warehouse, data lake and operational data stores
- Build and maintain batch and real-time data pipelines using modern data processing frameworks
- Develop ETL and ELT workflows including extraction, cleansing, transformation and orchestration
- Integrate data from multiple systems in a scalable, compliant way
- Build and maintain Back-end APIs and database services that support applications
- Collaborate with project and product teams to deliver data-driven features end to end
- Improve quality through automated testing, code reviews and pair programming
- Contribute in Agile teams practicing continuous integration and continuous delivery
Requirements
- Proven experience building production-grade data pipelines and data integrations (ETL or ELT)
- Hands-on expertise in SQL for transformation, validation and performance tuning
- Hands-on experience with Python for data processing and automation
- Experience with cloud platforms such as Amazon Web Services (AWS), Microsoft Azure or Google Cloud Platform (GCP)
- Strong background in data modeling and storage patterns including data warehouse, data lake and data mart
- Knowledge of big data tools such as Apache Spark, Apache Kafka or Hadoop
- Familiarity with REST APIs and web protocols
- Understanding of data governance, access control and security best practices
Nice to have
- Experience with Apache Airflow and relational database integrations
- Experience with Snowflake, Databricks or similar platforms
- Experience with web scraping tools such as Selenium or BeautifulSoup
We offer
- By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023.
- Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters
- You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices
- We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey
- At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us
Life at EPAM
- EPAM is a leading global provider of digital platform engineering and development services. EPAM has been expanding in Singapore since 2013 and delivering the best solutions to our customers. As a recognized leader, EPAM Singapore achieved Great Place to Work® Certification in 2023 and is committed to providing our team with inspiring careers.
- You will have the opportunity to work with fellow talented technologists and accelerate your career by participating in our numerous upskilling, training, and certification programs. That is why EPAM Singapore was awarded Gold for Best In-House Certification Programmes in the Employee Experience Awards 2023 and Silver in the SkillsFuture Employers Awards 2022 for our efforts in championing employees skills development and building a lifelong learning culture at the workplace. You can also look forward to developing holistically with the multiracial festivals and various wellness and cultural activities organized by our passionate colleagues here.
