Cloudera and Database Administrator

Cloudera and Database Administrator

About the Role

The Cloudera and Database Administrator (DBA) is responsible for the installation, configuration, administration, monitoring, and performance tuning of Cloudera, Oracle and Microsoft SQL Server databases running on Windows and Linux platforms. The role ensures high availability, security, and recoverability of enterprise databases using advanced technologies such as Hadoop, Hive, Oracle Data Guard, Oracle GoldenGate, SQL Server AlwaysOn Availability Groups, and Failover Cluster Instances.

Cloudera competencies are a must.

You will work closely with application teams, infrastructure engineers, and security specialists to design and maintain resilient, optimized, and secure database environments that support critical business applications.

Responsibilities

Database Administration

• Install, configure, and upgrade Oracle (12c/19c/21c) on Windows and Linux servers.
• Install, configure, and maintain Microsoft SQL Server (2016/2019/2022) on Windows platforms.
• Manage database storage structures, users, roles, and access privileges.
• Perform routine database maintenance, patching, and performance tuning.
• Implement and maintain backup and recovery strategies using RMAN (Oracle) and SQL Server native tools.

Big Data Platform Administration

• Install, configure, and manage Cloudera Data Platform (CDP) Private Cloud and Public Cloud environments.
• Deploy and administer Hadoop ecosystem components including HDFS, YARN, Hive, Impala, HBase, Spark, Kafka, and NiFi.
• Manage cluster resources, capacity planning, and workload distribution across compute and storage nodes.
• Configure and maintain Cloudera Manager for centralized cluster monitoring, management, and configuration.
• Implement data ingestion pipelines and ETL workflows using Cloudera ecosystem tools.
• Manage HDFS storage quotas, replication factors, and data lifecycle policies.
• Administer and optimize Hive metastore, partitioning strategies, and query performance.
• Configure and manage Apache Ranger for centralized security administration, fine-grained access control, and data masking policies.

High Availability & Replication

• Configure, administer, and monitor Oracle Data Guard for disaster recovery and standby database management.
• Implement and support Oracle GoldenGate for real-time data replication and synchronization across heterogeneous environments.
• Configure and maintain SQL Server AlwaysOn Availability Groups for high availability and read-scale solutions.
• Manage SQL Server Failover Cluster Instances (FCI), including cluster setup, node management, and failover testing.
• Configure HDFS high availability (HA) with NameNode and ResourceManager failover capabilities.
• Implement HBase region server load balancing and replication for distributed NoSQL workloads.

Performance & Optimization

• Analyze and tune SQL queries, indexes, and database performance parameters.
• Troubleshoot slow-running queries and application performance issues.
• Use AWR, ADDM (Oracle) and Query Store, Extended Events (MSSQL) for performance diagnostics.
• Optimize Hive and Impala queries, partition pruning, and execution plans.
• Monitor and tune YARN resource allocation, container sizing, and job scheduling policies.
• Analyze Spark application performance and optimize memory, parallelism, and shuffle operations.
• Conduct cluster performance assessments and implement recommendations for workload optimization

Security & Compliance

• Enforce database security policies, encryption, and audit mechanisms.
• Ensure compliance with data governance and industry standards (e.g., MAS TRM, ISO 27001).
• Apply regular patches and perform vulnerability remediation activities.
• Configure Apache Ranger policies for role-based access control (RBAC) across Hadoop services.
• Enable data encryption at rest (HDFS TDE) and in transit (TLS/SSL) for Cloudera components.
• Manage Apache Sentry (legacy) or Ranger integration with LDAP/Active Directory for centralized user management.
• Implement data lineage and audit logging using Cloudera Navigator or Atlas.

Monitoring & Automation

• Set up proactive database monitoring and alerting using tools such as Oracle Enterprise Manager, SQL Server Management Studio, and third-party monitoring platforms.
• Develop scripts for automation of maintenance, monitoring, and reporting tasks (using Shell, PowerShell, or Python).
• Configure Cloudera Manager alerts, health checks, and diagnostic bundles for proactive cluster monitoring.
• Implement log aggregation and analysis using Cloudera tools or external platforms (ELK, Splunk).
• Automate cluster provisioning, configuration management, and routine maintenance tasks using Ansible, Chef, or custom scripts.
• Develop monitoring dashboards for cluster health, resource utilization, and service-level metrics.

Disaster Recovery & Documentation

• Conduct periodic DR drills and validate failover/failback processes.
• Maintain comprehensive documentation for database architecture, configurations, and operational procedures.
• Participate in 24x7 on-call rotation and incident response.
• Implement BDR (Backup and Disaster Recovery) strategies for HDFS using distcp, snapshots, and replication policies.
• Design and test disaster recovery procedures for Cloudera clusters including metadata backup and recovery.
• Document cluster topology, network configurations, service dependencies, and runbooks for incident management.

Required skills and qualifications

. Degree/Diploma in Computer Science, Computing, Electrical Engineering, IT or equivalent.

. Singapore citizen (Mandatory as will be involved in production environment)

. Good knowledge in one or more of the following platforms and technologies:

a. Database (e.g. MS SQL and Oracle)

b. Big Data (e.g. Hadoop, NoSQL, Hive, Sqoop, Cloudera)

c. Database Activity Monitoring (e.g. Imperva, Guardium, Data Sunrise)

Good knowledge of Windows platform and Linux platform such as Red Hat and Oracle Linux.

At least one (1) year experience in installing, configuring or administrating Relational databases, Big data platforms or Database Activity Monitoring tools.

• Strong experience with Oracle Data Guard and Oracle GoldenGate.
• Hands-on experience with SQL Server AlwaysOn Availability Groups and Failover Cluster Instances.
• Proven experience in both Windows and Linux environments.

Technical Skills:

• Oracle Database 12c/19c/21c (RAC, ASM, RMAN, OEM).
• MS SQL Server 2016/2019/2022 (SSMS, SSIS, SSRS, AlwaysOn, FCI).
• Scripting: Shell, PowerShell, Python (for automation).
• Backup tools (NetBackup, CommVault, or equivalent).
• Strong understanding of networking, storage, and OS fundamentals for database performance optimization.

Preferred skills and qualifications

. Oracle and/or MS SQL certifications

. Windows and/or Linux certifications

. ITIL Foundation

Soft Skills

• Strong analytical and troubleshooting skills.
• Excellent communication and documentation ability.
• Team-oriented, with experience working in multi-vendor and cross-platform environments.
• Ability to prioritize and manage multiple tasks under pressure.