Jobs

Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Home

Jobs

Companies

Resume

Home
>
Jobs in Hyderabad
>
Innova AM Tech
>
Senior Azure Databricks Engineer - Python/Scala (5-6 yrs)

Senior Azure Databricks Engineer - Python/Scala (5-6 yrs)

Innova AM Tech

5 - 6 years

8 - 13 Lacs

Hyderabad

Posted:3 weeks ago| Platform:

Apply

Skills Required

sql spark azure databricks python data engineering scala data warehousing azure data factory azure devops docker sql azure devops ssrs paas data lake ssas azure synapse microsoft azure power bi elt sql server azure blob storage blob iaas ssis aws

Work Mode

Work from Office

Job Type

Full Time

Job Description

About the Role - We are seeking a highly skilled and experienced Senior Azure Databricks Engineer to join our dynamic data engineering team. - As a Senior Azure Databricks Engineer, you will play a critical role in designing, developing, and implementing data solutions on the Azure Databricks platform. - You will be responsible for building and maintaining high-performance data pipelines, transforming raw data into valuable insights, and ensuring data quality and reliability. Key Responsibilities - Design, develop, and implement data pipelines and ETL/ELT processes using Azure Databricks. - Develop and optimize Spark applications using Scala or Python for data ingestion, transformation, and analysis. - Leverage Delta Lake for data versioning, ACID transactions, and data sharing. - Utilize Delta Live Tables for building robust and reliable data pipelines. - Design and implement data models for data warehousing and data lakes. - Optimize data structures and schemas for performance and query efficiency. - Ensure data quality and integrity throughout the data lifecycle. - Integrate Azure Databricks with other Azure services (e.g., Azure Data Factory, Azure Synapse Analytics, Azure Blob Storage). - Leverage cloud-based data services to enhance data processing and analysis capabilities. Performance Optimization & Troubleshooting - Monitor and analyze data pipeline performance. - Identify and troubleshoot performance bottlenecks. - Optimize data processing jobs for speed and efficiency. - Collaborate effectively with data engineers, data scientists, data analysts, and other stakeholders. - Communicate technical information clearly and concisely. - Participate in code reviews and contribute to the improvement of development processes. Qualifications Essential - 5+ years of experience in data engineering, with at least 2 years of hands-on experience with Azure Databricks. - Strong proficiency in Python and SQL. - Expertise in Apache Spark and its core concepts (RDDs, DataFrames, Datasets). - In-depth knowledge of Delta Lake and its features (e.g., ACID transactions, time travel). - Experience with data warehousing concepts and ETL/ELT processes. - Strong analytical and problem-solving skills. - Excellent communication and interpersonal skills. - Bachelor's degree in Computer Science, Computer Engineering, or a related field.

More Jobs at Innova AM Tech

Power BI Professional

Bengaluru

5 - 7 yrs

INR 30 - 32 Lacs

AEM Developer / Support Engineer

Noida, Gurugram, Bengaluru

2 - 6 yrs

INR 12 - 16 Lacs

Java Backend Developer

Mumbai, Bengaluru

5 - 10 yrs

INR 40 - 45 Lacs

Senior Associate Salesforce ( Marketing Cloud )

Pune, Bengaluru, Delhi / NCR

2 - 5 yrs

INR 10 - 13 Lacs

Python Developer - Flask/Django (5-8 yrs)

Bengaluru

5.0 - 8.0 yrs

INR 6 - 10 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Sql Interview Now

My Connections Innova AM Tech

Download Chrome Extension (See your connection in the Innova AM Tech )

Download Now

Innova AM Tech

82 Jobs

Login to

Please Verify Your Phone or Email

Confirm Action

Search

Profile

Bookmarks

Senior Azure Databricks Engineer - Python/Scala (5-6 yrs)

Experience & Salary

Skills Required

Work Mode

Job Type

Job Description

More Jobs at Innova AM Tech

Mock Interview

Download Chrome Extension (See your connection in the Innova AM Tech )

RecommendedJobs for You

Senior Azure Databricks Engineer - Python/Scala (5-6 yrs)

Senior Azure Databricks Engineer - Python/Scala (5-6 yrs)

Data Engineer

Senior Data Engineer

Senior / Lead Data Engineer

Data Engineer AI

Urgent Requirement For Data Archival @ MNC

Snowflake Engineer with IICS

Senior Data Engineer

Junior AI/ML Engineer

Login to

Please Verify Your Phone or Email

Confirm Action

Contact Us

Search

Profile

Bookmarks

Personal Settings

Senior Azure Databricks Engineer - Python/Scala (5-6 yrs)

Experience & Salary

Skills Required

Work Mode

Job Type

Job Description

More Jobs at Innova AM Tech