Databricks Developer

4 years

Bengaluru

Posted:1 week ago

Job Description

Role description


Who we are:

At UST, we help the world’s best organizations grow and succeed through transformation. Bringing together the right talent, tools, and ideas, we work with our client to co-create lasting change. Together, with over 30,000 employees in 30+ countries, we build for boundless impact—touching billions of lives in the process. Visit us at .

Job Description

  • Minimum 6+ years in Data Engineering, with at least 4 years of hands-on experience in Databricks and Azure ecosystem.
  • End-to-End Data Pipeline Delivery – Proven track record of building and owning ETL/ELT pipelines, data models, and platform components at enterprise scale across complex business domains.
  • Expert SQL Skills – Advanced proficiency in complex joins, window functions, CTEs, query optimization, and performance tuning across large datasets.
  • Strong PySpark & Python – Hands-on experience building distributed data processing pipelines, transformations, and automation scripts using PySpark and Python.
  • Databricks Expertise – Deep working knowledge of Delta Lake, Unity Catalog, Workflows, medallion architecture (bronze-silver-gold), notebook development, and lakehouse best practices.
  • Clean Code & Engineering Discipline – Writes modular, well-documented, and testable code. Follows coding standards, maintains version control hygiene, and builds reusable components that other developers can extend.
  • Problem Solving & Debugging – Strong ability to diagnose and resolve complex data pipeline failures, distributed system issues, and production incidents under pressure.
  • Performance Tuning – Demonstrated expertise in optimizing Spark jobs, SQL queries, and storage layers for cost efficiency, throughput, and reliability.
  • Developer Ownership Mindset – Takes end-to-end responsibility from development through unit testing, deployment validation, and production support — not just writing code and handing off.
  • Adaptability – Comfortable navigating evolving technology stacks, shifting priorities, and cross-functional collaboration in a dynamic, fast-paced Agile environment.
  • Team Player – Collaborative engineer who actively contributes to code reviews, architecture discussions, knowledge sharing, and mentoring within a globally distributed team.
  • AI Exposure – Familiarity with AI/ML concepts such as model training pipelines, feature engineering, RAG architectures, or tools like Azure OpenAI and LangChain.
  • Experience working with supply chain data domains such as procurement, logistics, inventory, or demand planning is a strong plus. Understanding of SAP or ERP data structures in a supply chain context is an added advantage.
  • Full Project Lifecycle & Cross-Team Collaboration – Has worked through the complete project lifecycle — from requirements gathering to production deployment. Experienced in collaborating with API and UI/UX teams, and understands how data flows end-to-end across upstream sources, backend services, APIs, and front-end applications.

What we believe:

We’re proud to embrace the same values that have shaped UST since the beginning. Since day one, we’ve been building enduring relationships and a culture of integrity. And today, it's those same values that are inspiring us to encourage innovation from everyone, to champion diversity and inclusion and to place people at the centre of everything we do.

Humility:

We will listen, learn, be empathetic and help selflessly in our interactions with everyone.

Humanity:

Through business, we will better the lives of those less fortunate than ourselves.

Integrity:

We honour our commitments and act with responsibility in all our relationships.

Equal Employment Opportunity Statement

UST is an Equal Opportunity Employer. We believe that no one should be discriminated against because of their differences, such as age, disability, ethnicity, gender, gender identity and expression, religion, or sexual orientation.

All employment decisions shall be made without regard to age, race, creed, colour, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law.


UST reserves the right to periodically redefine your roles and responsibilities based on the requirements of the organization and/or your performance.

  • To support and promote the values of UST.
  • Comply with all Company policies and procedures


Skills


Agile, Data Modeling, Databricks, Debugging


About UST

UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world’s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients’ organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact—touching billions of lives in the process.

Skills Required

Data Engineering Azure Data Pipeline ETL SQL Query Optimization Performance Tuning Pyspark Python Data Processing Automation Version Control

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
UST logo
UST

IT Services and IT Consulting

Aliso Viejo CA

RecommendedJobs for You

Kumaran Systems logo

Databricks Developer

Kumaran Systems

Hyderabad

Pradha Solutions Pvt Ltd logo

Databricks Developer

Pradha Solutions Pvt Ltd

Bengaluru

H

Mumbai

Kumaran Systems logo

Databricks Developer

Kumaran Systems

Hyderabad