Job responsibilities
- Lead technical study into a propose solution, while involving expertise from infrastructure big data expert, business analyst requirement
- Document proposed design and develop the solution
- Implicitly ensure all CI-CD artefacts are part of the solution
- Perform code review while fostering knowledge and coaching best practices to team members
- Interact and provide reporting to project managers
- Monitor technical risk and escalate appropriately to management
- Research, design, and develop software.
- Analyse user needs and develop software solutions
- Update software, enhances existing software capabilities, and develops and direct software testing and validation procedures.
- Work with other engineers to integrate hardware and/or software systems
The position requires autonomy and reliability in performing duties with initiatives and leadership when it comes to all non-functional deliverables such as testing tools, mocking objects, production monitoring concerns, quality control including performance and load testing.
Requirements
Mandatory
- At least 8 years in Software development
- At least 5 years in Java/J2EE development
- Hands on Data ingest and data processing technology like Spark streaming and Spark
- Hands on Messaging systems like Kafka, Flume or ActiveMQ, MQSeries or RabbitMQ
- Hands on knowledge on Hadoop (preferably Hortonworks distribution) - HDFS, HBase, Hive, ORC/Parquet.
- Build tool - Maven/sbt/ant, UML, Restful web services, Jenkins/Team City, Source management - SVN/GIT, TDD using Junit, Jira/QC.
Good to Have
- Solution design using proven patterns, awareness of anti-patterns, performance tuning, especially in streaming
- Knowledge of tools like Phoenix, ElasticSearch, Sqoop, StreamSets are good to have.
- Basic understanding of finance and investment banking
