PySpark Lead
OX Consultancy Pte. Ltd.- Posted 7 hours ago
- Be among the first 10 applicants
Job Description
Required Technical Skills -
PySpark 3.5.x
- Python
- Apache Spark internals and distributed systems architecture
- Delta Lake , Iceberg , Parquet - Query Engines Spark SQL , Trino , Hive Metastore
-Linux , vi commands
- Workflow orchestration (Airflow)
- S3 Compatible Object Store ( like Minio )
- Containerized deployment environments (Kubernetes)
- Git , Azure ADO
- Vscode AI
- Github Copilot
- AI Assisted Debugging , Code Optimization
- Prompt Engineering for software development and Experience building productivity workflow using LLMS
Preferred / Nice-to-Have
- Trade surveillance domain experience
- Financial services data engineering experience
- Time-series analytics
- Market data processing
More Info
About Company
OX Consultancy is an IT recruitment firm and we offer a range of services that cover permanent, contract and flexible on demand recruitment. Our team have enormous experience enabling the right solution for your needs. Whether your business need is to transform talent acquisition, hire permanent staff, or plug in the gaps around your workforce, we can adapt our services to meet your business needs.
