Main Responsibilities
- Lead technical study into a proposed solution, while involving expertise from infrastructure big data experts, business analyst requirements.
- Document proposed design and develop the solution.
- Implicitly ensure all CI-CD artefacts are part of the solution.
- Perform code review while fostering knowledge and coaching best practices to team members.
- Interact and provide reporting to project managers.
- Monitor technical risk and escalate appropriately to management.
- Research, design, and develop software.
- Analyse user needs and develop software solutions.
- Update software, enhance existing software capabilities, and develop and direct software testing and validation procedures.
- Work with other engineers to integrate hardware and/or software systems.
The position requires autonomy and reliability in performing duties with initiatives and leadership when it comes to all non-functional deliverables such as testing tools, mocking objects, production monitoring concerns, quality control including performance and load testing.
Qualifications And Profile
Mandatory
- At least 8 years in Software development.
- At least 5 years in Java/J2EE development.
- Hands-on Data ingest and data processing technology like Spark streaming and Spark.
- Hands-on Messaging systems like Kafka, Flume or ActiveMQ, MQSeries or RabbitMQ.
- Hands-on knowledge on Hadoop (preferably Hortonworks distribution) - HDFS, HBase, Hive, ORC/Parquet.
- Build tool - Maven/sbt/ant, UML, Restful web services, Jenkins/Team City, Source management SVN/GIT, TDD using Junit, Jira/QC.
Good to Have
- Solution design using proven patterns, awareness of anti-patterns, performance tuning, especially in streaming.
- Knowledge of tools like Phoenix, ElasticSearch, Sqoop, StreamSets are good to have.
- Basic understanding of finance and investment banking.
