Senior Data Engineer
encora technologies pte. ltd.- Posted 12 hours ago
- Be among the first 10 applicants
Job Description
Responsibilities:
. Implement and operationalize enterprise Lakehouse platforms, data products, and data marketplace capabilities.
. Develop scalable batch, streaming, CDC, and API-based data ingestion pipelines.
. Develop scalable multimodal data ingestion pipelines including content extraction from various file formats, regex for specific field extraction, content extraction from embedded images, frame extraction from video files, transcript extraction from audio files, etc
. Build, test, and maintain foundation and business data products with agreed data contracts, SLAs, and data quality controls.
. Implement open table formats such as Iceberg, Hudi, and Delta Lake.
. Support RAG, vector search, GenAI and agentic data pipelines.
. Perform performance tuning, optimization, production support, and root cause analysis.
. Create technical documentation, deployment guides, and operational runbooks.
. Ensure compliance with engineering standards, DevSecOps controls, and software delivery practices.
Requirements:
EDUCATION
. Bachelor's degree in Computer Science, Engineering or related discipline
PREFERRED CERTIFICATIONS
. Databricks Certified Data Engineer
. Azure Data Engineer Associate
. AWS Data Analytics Specialty
. Google Professional Data Engineer
. Snow Pro Certification
. DAMA CDMP
Requirements
. Strong engineering and automation mindset.
. Excellent troubleshooting and performance optimization skills.
. Ability to work across distributed teams and multiple projects.
. Strong communication and stakeholder management skills.
. Experience in Agile delivery and enterprise-scale platforms.
Commitment to quality, operational excellence and continuous improvement
More Info
Key Skills
Snow Software
Azure Data Explorer
Data Contracts
Open Table



