Senior Data Engineer – AWS | Databricks (Freelance 8hr/Day)

5 years

0 Lacs

Posted:1 week ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Contractual

Job Description

NRM Analytix


Primary Responsibilities


  • Design, develop, and maintain

    data lakes

    and

    ETL pipelines

    on AWS using

    Databricks

    and modern frameworks.
  • Integrate and transform large-scale data from multiple sources into a centralized data lake.
  • Implement and manage

    Delta Lake architectures

    using

    Databricks Delta

    or

    Apache Hudi

    .
  • Build end-to-end data workflows using

    PySpark

    ,

    Databricks Notebooks

    , and

    Python

    .
  • Design and develop

    data warehouses

    and

    data marts

    using

    Snowflake

    ,

    Redshift

    , or similar technologies.
  • Optimize data storage, query performance, and cost efficiency across AWS and Databricks.
  • Develop and maintain

    CI/CD pipelines

    for Databricks jobs and Python data processes.
  • Collaborate with cross-functional teams to deliver high-performance, reusable data assets.
  • Participate in architectural decision-making and performance troubleshooting for Spark/ETL pipelines.
  • Work closely with business and technical stakeholders through the full SDLC.


Required Experience


  • 5+ years in

    Data Lake design and development

    on

    AWS Cloud

    .
  • 3+ years with AWS data services such as

    S3

    ,

    Glue

    ,

    Lake Formation

    ,

    EMR

    ,

    Kinesis

    ,

    RDS

    ,

    DMS

    , and

    Redshift

    .
  • 3+ years building

    Data Warehouses

    on

    Snowflake

    ,

    Redshift

    ,

    HANA

    ,

    Teradata

    , or

    Exasol

    .
  • 3+ years of

    Databricks

    hands-on experience with

    PySpark

    and

    Spark

    .
  • 3+ years implementing

    Delta Lakes

    (Databricks Delta or Apache Hudi).
  • Strong in

    Python

    (automation, API integration, data processing).
  • Familiar with

    Databricks Jobs

    ,

    Workflows

    , and

    Cluster Management

    .
  • Experience working in

    Agile

    environments.


Preferred Skills


  • Experience with

    Databricks Unity Catalog

    ,

    Delta Live Tables (DLT)

    , and

    MLflow

    .
  • AWS or Databricks certifications (e.g., AWS Data Analytics Specialty, Databricks Certified Data Engineer Professional).
  • Knowledge of

    data security

    ,

    access control

    , and

    cloud compliance

    .
  • Excellent analytical, communication, and problem-solving skills.


Why Join Us


  • Work with cutting-edge

    cloud and data technologies

    .
  • Be part of a

    fast-growing, innovation-driven data engineering team

    .
  • Contribute to enterprise-scale

    data analytics and integration

    projects.


contact@nrmanalytix.com

+91 86678 44087


Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You