Jobs
Interviews
Decision Minds logo

Senior Data Engineer- Databricks

0 - 8 years

0 Lacs

Karnataka

Posted:1 month ago| Platform: Indeed logo

Apply

Skills Required

data databricks technology analytics ai ml automation oracle hadoop aws pyspark etl support migration analyze sql logic indexing optimization reconciliation integrity devops pipeline integration architecture engineering query tuning git governance security compliance communication documentation unity pentaho virtualization azure hive sqoop jenkins github orchestration airflow jira confluence certifications

Work Mode

Remote

Job Type

Full Time

Job Description

Job Information

    Date Opened

    06/13/2025

    Industry

    Technology

    Job Type

    Full-time

    Work Experience

    6

    City

    Remote

    State/Province

    Karnataka

    Country

    India

    Zip/Postal Code

    560066

Job Description

Decision Minds is a leader in Data Cloud, Big Data, Cloud Analytics, AI/ML, and Multi-Cloud deployments. We are a team of passionate thought leaders and industry experts who strive for excellence and clarity in creating innovative solutions and products. Our goal is to revolutionize Data Analytics, Artificial Intelligence, Cloud Computing, and Robotic Process Automation, and make a positive impact on people's lives.


Know more about us at www.decisionminds.com | LinkedIn


Location: Bangalore/ Chennai/ Hyderabad (preferred)


Job Title: Senior Data Engineer - Databricks
Skills: Databricks, Oracle, Hadoop, AWS Cloud, PySpark, Data Warehousing, ETL/ELT, Cloud Migration
Education: B.E/B.Tech/Master’s

Key Responsibilities:

  • Develop and maintain scalable data pipelines in Databricks to support the migration of data from Oracle-based Data Warehouse (DWH) and Operational Data Store (ODS) systems.

  • Analyze and understand existing Oracle schemas, stored procedures, and data transformation logic.

  • Translate PL/SQL logic into PySpark/Databricks SQL.

  • Develop and maintain Delta Lake-based datasets with appropriate partitioning, indexing, and optimization strategies.

  • Perform data validation and reconciliation post-migration, including row count, data integrity, and accuracy checks.

  • Build reusable and modular data ingestion and transformation frameworks using Databricks Notebooks, Jobs, and Workflows.

  • Collaborate with DevOps teams for CI/CD pipeline integration and efficient deployment.

  • Optimize performance of existing pipelines and queries in Databricks.

  • Document architecture, transformation logic, and data lineage clearly for operational transparency.


Mandatory Skills & Experience:

  • 6 to 8 years of experience in data engineering, with strong experience in DWH/ODS environments.

  • Minimum 3+ years hands-on experience in Databricks (including PySpark, SQL, Delta Lake, Workflows).

  • Strong understanding of Lakehouse architecture, cloud data platforms, and big data processing.

  • Proven experience in migrating data warehouse and ETL workloads from Oracle to cloud platforms.

  • Experience with PL/SQL, query tuning, and reverse engineering legacy systems.

  • Experience with CI/CD pipelines, version control (e.g., Git), and automated testing.

  • Familiarity with data governance, security policies, and compliance in cloud environments.

  • Strong communication and documentation skills.


Preferred Skills (Advantage):

  • Experience in cloud migration projects (AWS/Azure).
  • Knowledge of Delta Lake, Unity Catalog, and Databricks workflows.
  • Exposure to Pentaho and/or TIBCO Data Virtualization/Integration tools will be an added advantage.

  • AWS/Azure/Databricks certifications


Tools & Technologies:

  • Databricks, Oracle, Hadoop (HDFS, Hive, Sqoop), AWS (S3, RDS)
  • PySpark, SQL, Python

  • CI/CD (Jenkins, GitHub Actions), Orchestration (Airflow, Control-M)
  • JIRA, Confluence, Git (GitHub/Bitbucket)

Cloud Certifications (Preferred):

  • Databricks Certified Data Engineer
  • AWS Certified Solutions Architect/Developer

More Jobs at Decision Minds

Imm Joiner Tech/ Semi-Tech Support (International Voice) @ Hyderabad

Hyderabad

3 - 5 yrs
|

INR 5 - 14 Lacs

Imm Joiner! Sr. Business Analyst(SQL, Data Modeling) @ Chennai

Bengaluru

9 - 10 yrs
|

INR 15 - 18 Lacs

Imm Joiner! Lead Data Engg (Azure DB, DF, DL) B'LORE, HYD, CHE

Bengaluru

9 - 14 yrs
|

INR 30 - 37 Lacs

Imm Joiner! Sr. Automation Test Engg(Java, Selenium)@India

Kolkata, Hyderabad, Pune, Chennai, Bengaluru, Delhi / NCR, Mumbai (All Areas)

5.0 - 9.0 yrs
|

INR 10 - 16 Lacs

Imm Joiner International Voice B2B Tech @ Hyderabad

Hyderabad

3.0 - 5.0 yrs
|

INR 5 - 14 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Google Play App Store
coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Decision Minds logo
Decision Minds

Data Analytics / Software

Analytics City

RecommendedJobs for You

Decision Minds logo

Senior Data Engineer- Databricks

Decision Minds

Karnataka