
Search by job, company or skills
We are looking for an experienced Data Engineer with strong expertise in Quantexa, Spark/Scala, Hadoop, Elasticsearch, and OpenShift to design and build scalable data pipelines and analytics solutions. You will work with cross-functional teams to deliver high-performance big data and search platforms. Experience in Compliance/AML is a plus.
Key Responsibilities
Design, develop, and optimize Spark/Scala data pipelines for large-scale structured and unstructured data
Build and integrate Elasticsearch for efficient indexing and search
Implement data transformations, aggregations, and enrichment for analytics and ML use cases
Deploy and manage data solutions on OpenShift/Kubernetes using containerization
Optimize performance, monitor pipelines, and troubleshoot data quality and processing issues
Collaborate with DevOps to enable CI/CD and reliable deployments
Requirements
Bachelor's/Master's in Computer Science or related field
Quantexa certified Data Engineer/Data Architect with hands-on experience
Strong experience with Spark, Scala, Hadoop ecosystem, and Elasticsearch
Experience with OpenShift/Kubernetes, Docker, and CI/CD tools
Knowledge of DevOps practices and monitoring tools (Grafana, Prometheus, Splunk - plus)
Strong problem-solving, communication, and teamwork skills
Cloud platform experience (AWS/Azure/GCP) is a plus
Job ID: 141124733