Search by job, company or skills

4-7 Years
SGD 8,500 - 8,800 per month
Early Applicant
  • Posted 25 days ago
  • Be among the first 10 applicants

Job Description

Job Description:

-Design, develop and deploy data tables, views and marts in data warehouses,operational data store, data lake and data virtualization.

-Perform data extraction, cleaning, transformation, and flow. Web scraping maybe also a part of the work scope in data extraction.

-Design, build, launch and maintain efficient and reliable large-scale batch andreal-time data pipelines with data processing frameworks.

-Integrate and collate data silos in a manner which is both scalable andcompliant.

-Collaborate with Project Manager, Data Architect, Business Analysts, FrontendDevelopers, Designers and Data Analyst to build scalable data driven products.

- Beresponsible for developing backend APIs & working on databases to supportthe applications.

- Workin an Agile Environment that practices Continuous Integration and Delivery.

- Workclosely with fellow developers through pair programming and code reviewprocess.

The teamis expected to perform Data Warehousing tasks, mainly in AWS GCC, and manageAPIs

Qualifications

-Proficient in general data cleaning and transformation (e.g. SQL, pandas, R,etc) to ensure data accuracy and consistency.

-Proficient in building ETL pipeline (e.g. SQL Server Integration Services

-(SSIS), AWS Database Migration Services (DMS), Python, AWS Lambda, ECSContainer task, Eventbridge, AWS Glue, Spring).

-Proficient in database design and various databases (e.g. SQL, PostgreSQL, AWSS3, Athena, MongoDB, postgres/gis, MySQL, SQLite, voltdb, Cassandra, etc).

-Experience in cloud technologies such as GPC, GCC (i.e. AWS, Azure, GoogleCloud).

-Experience and passion for data engineering in a big data environment usingCloud platforms such as GPC, GCC (i.e. AWS, Azure, Google Cloud).

-Experience with building production-grade data pipelines, ETL/ELT dataintegration.

-Knowledge about system design, data structure and algorithms.

-Familiar with data modelling, data access, and data storage infrastructure likeData Mart, Data Lake, Data Virtualisation and Data Warehouse for efficientstorage and retrieval.

-Familiar with rest api and web requests/protocols in general.

-Familiar with big data frameworks and tools (eg. Hadoop, Spark, Kafka, RabbitMQ).

-Familiar with W3C Document Object Model and customized web scraping (e.g.BeautifulSoup, CasperJS, PhantomJS, Selenium, Nodejs, etc).

-Familiar with data governance policies, access control and security bestpractices.

-Comfortable in at least one scripting language (eg. SQL, Python).

-Comfortable in both windows and Linux development environments.

-Interest in being the bridge between engineering and analytics

More Info

Job Type:
Industry:
Employment Type:

Job ID: 151132499

Similar Jobs

Orchard Road, Singapore

Skills:

Aws LambdaAmazon S3ScalaAmazon KinesisAWS GlueData GovernanceSqlMetadata ManagementAmazon RedshiftPythonAmazon EventBridgeAWS Step FunctionsAWS Lake FormationAWS AppFlowData cataloguing

Singapore

Skills:

QuicksightS3Power BiAmazon RedshiftAWS GlueTableauPythonSql

Singapore

Skills:

Etl ToolsPythondata integration processes

Singapore

Skills:

Aws LambdaAmazon S3ScalaAmazon KinesisAWS GlueSqlAmazon RedshiftPythonAmazon EventBridgeAWS Step FunctionsAWS Lake FormationAWS AppFlow

Singapore

Skills:

data engineering Data EngineerAWSDatabricksPysparkLambdaAmazon Web ServicesApache SparkSpark SQLSqlData ModelingEtlELTBig DataAws S3Amazon S3AWS GlueAws LambdaAmazon RedshiftAWS IAMData WarehousingData LakeData IntegrationData TransformationData MigrationCloud MigrationGitDevopsPythonAws CloudData ArchitectureData AnalyticsData GovernanceData QualityAgileSdlcAWS Data EngineerData PipelinesScalable Data PipelinesDelta LakeLakehouse ArchitectureAmazon AthenaCloud Data EngineeringData LakehouseData ProcessingWorkflow OrchestrationBatch ProcessingReal-Time Data ProcessingPerformance OptimizationCI/CDAWS Certified Data EngineerAWS Certified Solutions ArchitectDatabricks Certified Data EngineerData PlatformData OptimizationStakeholder Management

Beware of Scammers

We don’t charge money for job offers