Data Engineer (Databricks/AI)

Keyrus is an international consulting firm, specializing in the integration of data intelligence and Digital solutions. With over 3,500 employees spread across 25 countries, Keyrus continues to deliver on such projects to a wide range of clients from various industries including but not limited to Banking/Finance, Healthcare/pharmaceuticals, FMCG, Oil & Gas, and more.

As part of Keyrus solution delivery, we are also in a position to recruit and place technical consultants to complement on existing client projects with their expertise. As such, we seek innovative and agile people to support ambitious and forthcoming technological challenges.

We're seeking a Data Engineering Consultant with expertise in Databricks and Generative AI to build scalable data pipelines and integrate LLMs into enterprise workflows. This role combines modern data engineering with AI innovation to support advanced analytics and GenAI solutions.

Responsibilities:

• Build and optimize ETL/ELT pipelines using Databricks and Apache Spark.
• Design and manage Delta Lake architectures and medallion data models.
• Develop and deploy GenAI workflows, including LLM integration, embeddings, and vector databases.
• Collaborate with data scientists to support prompt engineering and RAG pipelines.
• Ensure best practices in data quality, governance, and CI/CD.
• Document data architecture, pipelines, and lineage.

Requirements:

• 4+ years in Data Engineering with strong Databricks and Spark experience.
• Proficient in Python, SQL, and cloud platforms (Azure, AWS, or GCP).
• Experience with LLMs, LangChain, vector DBs, and embedding models.
• Solid understanding of data modeling, pipeline orchestration, and AI integration.
• Familiarity with tools like Hugging Face, OpenAI, or Azure OpenAI.