Expert Data Engineer

2 - 6 years

3 - 7 Lacs

Posted:2 weeks ago| Platform: Foundit logo

Apply

Skills Required

Work Mode

On-site

Job Type

Full Time

Job Description

About the Role

Expert Data Engineer

Responsibilities

  • Build, deploy, and maintain mission-critical analytics solutions for processing large-scale data.
  • Develop components for data ingestion, real-time streaming, batch processing, and ETL across various storage platforms.
  • Own parts of the engineering infrastructure; improve platform quality, performance, and maintainability.
  • Collaborate with other engineers to share knowledge and continuously learn new technologies.
  • Ensure solutions meet requirements for functionality, scalability, reliability, and availability.
  • Support end-to-end solutions, performing development, QA, and DevOps roles as needed.
  • Partner with business analysts and data scientists to understand and support use cases.
  • Participate in unit activities, conferences, and promote best practices.
  • Contribute to sales efforts, customer meetings, and digital services engagement.

Requirement

Technical Experience

  • 5+ years of experience coding in

    SQL

    ,

    Java

    ,

    Python

    , or

    Scala

    , with solid computer science fundamentals.
  • 3+ years of experience leading production deployments of large-scale backend data systems.
  • 2+ years of hands-on experience with tools like

    Hadoop

    ,

    MapReduce

    ,

    Pig

    ,

    Hive

    ,

    Impala

    ,

    Spark

    ,

    Kafka

    ,

    Storm

    , and databases like

    HBase

    ,

    Cassandra

    .
  • 3+ years working with cloud data platforms:

    AWS

    ,

    Azure

    , or

    GCP

    .

Data Engineering Expertise

  • Strong knowledge of

    Data Governance

    , including data quality, security, and compliance standards.
  • Deep understanding of

    Data Warehousing

    design, optimization, and implementation.
  • Experience with

    SQL

    and

    MPP

    databases (e.g.,

    Vertica

    ,

    Netezza

    ,

    Greenplum

    ).
  • Familiarity with

    data quality testing

    , automation, and visualization tools.
  • Experience in

    BI report and dashboard

    design (e.g.,

    Power BI

    ,

    Tableau

    ).

Engineering Practices

  • Experience with Agile methodologies (e.g.,

    SCRUM

    ).
  • Strong grasp of the

    software development lifecycle

    , including coding standards, version control, code reviews, CI/CD, and operations.
  • Proven ability to lead development teams: managing backlogs, peer review processes, and maintaining development standards.

Education

  • Bachelor's degree in

    Computer Science

    or

    Engineering

    from a top-tier university;

    Master's preferred

    .

Desirable Skills

  • Experience in

    data science

    or

    machine learning

    projects.
  • Proficiency in

    backend development

    and

    deployment

    .
  • Knowledge of

    CI/CD pipelines

    and related tools.
  • Understanding of

    enterprise-level data analytics

    .
  • Experience with platforms like

    Databricks

    ,

    Snowflake

    .
  • Familiarity with

    Kubernetes

    and

    container orchestration

    .

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Ciklum logo
Ciklum

IT Services and IT Consulting

London England

RecommendedJobs for You

chennai, tamil nadu, india

chennai, tamil nadu, india

nashik, maharashtra, india