Tamcherry Technologies logo

Senior Data Engineer

Tamcherry Technologies

8 - 12 years

Kochi

Posted:2 days ago

Job Description

Role Overview

Data Engineer

Key Responsibilities

  • Design, develop, and maintain

    ETL/ELT data pipelines

    and data products in distributed, multi-cloud, and multi-region environments.
  • Select appropriate technologies and data engineering patterns based on business and technical requirements.
  • Drive

    data investigations

    and resolve complex technical, procedural, and operational issues.
  • Analyze complex business requirements and translate them into scalable and efficient data solutions.
  • Follow disciplined software development methodologies and engineering best practices.
  • Build solutions that are

    scalable, flexible, efficient, reliable, and supportable

    .
  • Implement data pipelines with appropriate

    monitoring, logging, security, and operational controls

    .
  • Collaborate with engineering, architecture, product, and business teams to deliver high-quality data solutions.

Required Skills & Experience

Data Engineering

  • Strong understanding of

    data engineering patterns

    and the ability to determine the appropriate pattern based on use cases.
  • Good understanding of

    ETL/ELT concepts, data pipelines, and orchestration frameworks

    .
  • Experience working with large-scale distributed data processing environments.

Data Architecture

  • Understanding of modern

    data architecture principles and frameworks

    , including:
    • Data Mesh
    • Data Fabric
    • Distributed Data Architecture
  • Ability to design scalable and resilient data solutions.

Big Data & Cloud Technologies

  • Proficiency in big data technologies and cloud-based data platforms.
  • Hands-on experience with

    AWS data services

    , preferably:
    • Amazon EMR
    • AWS Glue
    • Data Lake
  • Experience working with large datasets and distributed processing frameworks.

Programming

  • Strong programming skills in Python, Java, or Scala.

  • Strong understanding of

    Object-Oriented Programming (OOP)

    concepts and development practices.

Data Warehousing & Databases

  • Strong knowledge of

    data warehousing concepts and solutions

    .
  • Experience with

    Snowflake and/or Amazon data warehousing technologies

    .
  • Expertise in both

    relational and NoSQL databases

    .
  • Strong understanding of database design and optimization.

Data Modelling

  • Experience designing efficient data models for:
    • OLAP systems

    • OLTP systems

  • Understanding of dimensional modelling and data modelling best practices.

Streaming & Orchestration

  • Knowledge of

    streaming data technologies

    and real-time data processing.
  • Familiarity with

    data pipeline orchestration tools

    .

DevOps & Engineering Practices

  • Hands-on experience with

    Git/version control systems

    .
  • Understanding of

    Docker/containerization

    .
  • Knowledge of

    Kubernetes/container orchestration platforms

    .

Data Security

  • Understanding of data security principles, including:
    • Data encryption
    • Access control
    • Data privacy
    • Regulatory and compliance requirements

Monitoring & Logging

  • Experience setting up and managing

    monitoring and logging

    for data pipelines.
  • Familiarity with tools and practices for monitoring pipeline performance, failures, data quality, and operational health.

Preferred Candidate Profile

  • Strong analytical and problem-solving skills.
  • Ability to investigate and resolve complex data and production issues.
  • Good understanding of scalable and distributed data architectures.
  • Ability to work independently as well as collaboratively in a cross-functional environment.
  • Strong communication skills with the ability to translate business requirements into technical solutions.

Skills Required

SCALA Data Python AWS Java Senior Data Engineering Pyspark

Learn the skills this job asks for

See your skill gap for Data Engineer →

Free courses, interview questions and practice for each skill.

Work Mode

Work from Office

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Tamcherry Technologies logo
Tamcherry Technologies

RecommendedJobs for You

Recruito logo

India

Jobaaj Com logo

Noida

YouGov logo
HP logo
Ecolab logo

Bengaluru

Hiringhood logo

Hyderabad

IntraEdge logo

Pune

NationsBenefits logo

Senior Data Engineer

NationsBenefits

Hyderabad

P

Hyderabad