Search by job, company or skills

Senior Data Engineer

  • Posted 2 months ago
  • Over 50 applicants have applied

Job Description

Position Overview: As a Data Connector Developer, your role is crucial in building and maintaining efficient data integration solutions that connect various data sources and systems within an organization. You will be responsible for designing, developing, and implementing data connectors to enable seamless data flow and integration across different platforms, databases, APIs, and third-party applications. Your expertise in data connectivity and integration will contribute to the organization's overall data strategy and help ensure the availability and accuracy of data for various business functions.

Years of Experience: 2 to 4 years

Key Responsibilities:

  • This involves understanding the data models, APIs, and protocols of various data sources and developing connectors that can extract, transform, and load data effectively.
  • Define data mappings, transformations, and business rules to ensure consistency and accuracy of integrated data.
  • Identify opportunities to optimize data integration processes, reduce latency, and enhance data quality.
  • Conduct rigorous testing of data connectors and integration processes to identify and resolve any issues or bugs. Ensure data integrity, reliability, and consistency by performing regular data validation and reconciliation tasks.
  • Create and maintain technical documentation, including specifications, user guides, and best practices for data integration and connector development.
  • Share knowledge and provide training to other team members or stakeholders to promote self-service data integration capabilities.
  • Provide technical support and troubleshooting assistance to resolve integration-related issues.
  • Adhere to data governance policies, standards, and regulatory requirements while handling sensitive and confidential data. Implement necessary security measures to protect data during integration and transit.

Qualifications and Skills:

  • Bachelor's degree in computer science, Information Systems, or a related field (or equivalent experience).
  • Strong programming skills in languages such as Python/Java, and SQL.
  • Proven experience in developing microservices-based applications using languages like Java, Python, or Node.js.
  • Strong understanding of microservices architecture, design patterns, and best practices.
  • Familiarity with data modelling concepts and experience working with diverse data formats (e.g., JSON, XML, CSV, relational databases).
  • Solid understanding of integration patterns, protocols, and APIs (e.g., REST, SOAP, GraphQL).
  • Experience with version control systems (e.g., Git) and continuous integration/continuous deployment (CI/CD) practices.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration skills to work effectively with cross-functional teams and stakeholders.
  • Familiarity with data governance principles, data security, and compliance standards is a plus.

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 111573807

Similar Jobs

Bengaluru, India

Skills:

DatabricksSqlPythonPysparkCI CDData Pipelines

Bengaluru, India

Skills:

snowflake SqlPythonGen AIdata engineering design patternsMicrosoft DevOpsMatillionStreamsets

Bengaluru, India

Skills:

snowflake PythonSqlEtlELTAWS GlueOpenflowSnowpipeAzure DevOpsdbtfivetran

Bengaluru

Skills:

snowflake PythonSparkSqldbt

Bengaluru, India

Skills:

PysparkDimensional ModelingSnowpipeJiraSqlGitGcpConfluenceStreamsAzurePythonAzure DevOpsEtlAWScdcTasksVirtual WarehousesMedallion ArchitectureSAP HANA to Snowflake migrationSnowflake ArchitecturedbtELT DevelopmentSCD Type 1

Beware of Scammers

We don’t charge money for job offers