Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Home
>
Jobs in bengaluru
>
IBM
>
Data Engineer-Data Platforms-Azure

Data Engineer-Data Platforms-Azure

IBM

9 - 14 years

14 - 18 Lacs

bengaluru

Posted:2 days ago| Platform:

Apply

Skills Required

data engineer data streaming python data pipelines performance tuning data platforms data processing ai databricks power bi llm data engineering cloud technologies sql data storage dbt data transformation programming azure

Work Mode

Work from Office

Job Type

Full Time

Job Description

Establish and implement best practices for DBT workflows, ensuring efficiency, reliability, and maintainability.

Collaborate with data analysts, engineers, and business teams to align data transformations with business needs.

Monitor and troubleshoot data pipelines to ensure accuracy and performance.

Work with Azure-based cloud technologies to support data storage, transformation, and processing

Required education

Bachelor''s Degree

Preferred education

Master''s Degree

Required technical and professional expertise

9+ Yrs total experience in IT/Data Engineering projects & 5+ years of relevant experience.

Strong coding skills in - Python, SQL, ADF, Databricks (PySpark, Delta live table, Live/structural data streaming, Unity Catalog, Performance Tuning of DLT pipelines with high volume of data processing , Cost Optimization of Databricks when DLT runs in live streaming on Photon, Serverless, non serverless)Azure Functions, Logic Apps

The DE role are expected to have AI, Gen AI to be efficient and innovation in developement.

Using Gen AI in developing automated data pipelines for faster delivery , Can a data engineer use agents or LLM to build data pipelines

The candidate should be responsible, take ownership, self driven, dedication to achieve timeline.

Should have great problem solving and analytical/reasoning capability, technical skill with good mindset and behavior is important good hands-on programming / scripting lnowledge in Python,

Very strong skilled resources only with good communication-knowledge in Power BI

Strong MS SQL, Azure Databricks experience

Implement and manage data models in DBT, data transformation and alignment with business requirements.

Ingest raw, unstructured data into structured datasets to cloud object store.

Utilize DBT to convert raw, unstructured data into structured datasets, enabling efficient analysis and reporting.

Write and optimize SQL queries within DBT to enhance data transformation processes and improve overall performance

Preferred technical and professional experience

Establish best DBT processes to improve performance, scalability, and reliability.

Design, develop, and maintain scalable data models and transformations using DBT in conjunction with Databricks

Proven interpersonal skills while contributing to team effort by accomplishing related results as required

More Jobs at IBM

Package Consultant-SAP HR Comp & Payroll

bengaluru

3.0 - 7.0 yrs

INR 5 - 9 Lacs

Package Consultant-SAP HANA SCM SD

pune

5.0 - 10.0 yrs

INR 8 - 13 Lacs

Package Specialist-SAP SCM MM

ahmedabad

5.0 - 8.0 yrs

INR 4 - 8 Lacs

Package Specialist-SAP EIM

bengaluru

2.0 - 6.0 yrs

INR 5 - 9 Lacs

Package Consultant-Oracle SCM Cloud

bengaluru

8.0 - 12.0 yrs

INR 9 - 13 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Data Engineer Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

IBM

Information Technology

Armonk

Login to

Please Verify Your Phone or Email

Confirm Action

Data Engineer-Data Platforms-Azure