Act as the chief data engineer for the company, with the following responsibilities:
- Develop and implement techniques and analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualization software.
- Apply data mining, data modelling, natural language processing, and machine learning to extract and analyze information from large structured and unstructured datasets.
- Visualize, interpret, and report data findings and may create dynamic data reports as well
- Engineer end-to-end data pipelines using Python, SQL, and Apache Airflow to automate data ingestion, transformation, and integration from multiple third-party applications like Numerix (OVAM and OneView)
- Standardize raw financial datasets into structured, analysis-ready formats, enabling seamless reporting and analytics across operations, trading, and risk teams.
- Design and deploy databases for large-scale market and trading data, ensuring efficient storage, retrieval, and management of big data workloads.
- Develop and deploy APIs using Python to manage and serve big data efficiently, supporting internal applications and analytics workflows.
- Host and maintain production-grade webservers, databases, and applications, ensuring smooth, reliable, and scalable operations.
- Create dynamic dashboards using Streamlit, Apache Superset, and Power BI to visualize and interpret live PnL and price movements, improving transparency and decision making for management.
- Implement machine learning classifiers to research and evaluate trading strategies, supporting alpha generation for strategies.
- Create automated reporting systems for daily/weekly performance and compliance reporting, reducing manual effort and errors.
- Build real-time notification scripts that push alerts on significant market movements, enhancing risk management and responsiveness.
- Collaborate with cross-functional teams (trading, risk, operations) to deliver tailored automation and analytics solutions aligned with business needs.
