Lead Data Engineer

6 - 8 years

Bengaluru

Posted:1 week ago

Apply

Job Description

Role Description

Who we are:

At UST, we help the world’s best organizations grow and succeed through transformation. Bringing together the right talent, tools, and ideas, we work with our client to co-create lasting change. Together, with over 30,000 employees in 30+ countries, we build for boundless impact—touching billions of lives in the process. Visit us at . Job Code 15124 Locations Bengaluru Minimum Experience 6 Maximum Experience 8 Mandatory Skills Snowflake,SQL,Python,PySpark,dbt,ETL/ELT,data modeling,Git Skill to Evaluate Snowflake,SQL,Python,PySpark,dbt,ETL/ELT,data modeling,Git Experience 6 to 8 Years Location Bengaluru Job Description Required qualifications
  • Bachelor's or master's degree in computer science, engineering, mathematics or a related discipline, or equivalent practical experience.
  • Substantial professional experience designing and operating enterprise data pipelines and data warehouses in production.
  • Advanced SQL skills and strong hands-on experience with Python and/or PySpark for data processing and automation.
  • Deep experience with Snowflake, including performance optimization, security, workload management and scalable data modeling.
  • Experience building ETL/ELT solutions with dbt, Informatica PowerCenter or comparable transformation and integration tools.
  • Hands-on experience implementing CI/CD pipelines for data engineering workloads using Git-based workflows and automated testing/deployment tools.
  • Experience building automated data quality systems with measurable rules, ing, lineage and issue-resolution workflows.
  • Strong grounding in data profiling, cleansing, standardization, reconciliation and production data validation.
  • Ability to gather ambiguous requirements, make sound design decisions and communicate effectively with technical and non-technical partners. Preferred qualifications
  • Snowflake SnowPro Core or comparable cloud data certification.
  • Experience with REST API, event and/or streaming data, and high-volume security or operational datasets.
  • Familiarity with data observability and quality frameworks such as dbt tests, Great Expectations, Soda or Deequ.
  • Experience delivering data solutions in regulated, security-sensitive, healthcare, telecommunications or audit-oriented environments.
  • Demonstrated technical leadership, mentoring or delivery coordination across a small engineering team. Education Qualificaiton B Tech/ M Tech Job Title Senior Data Engineer (Senior Individual Contributor / Technical Lead) Roles & Responsibilities
  • Design and deliver scalable pipelines. Build batch and near-real-time ETL/ELT pipelines using SQL, Python and PySpark, with Snowflake as a primary cloud data platform.
  • Engineer reliable data models. Create dimensional, normalized and analytical models that support efficient querying, traceability and reuse across enterprise reporting and analytics.
  • Own data quality by design. Implement automated profiling, schema checks, reconciliation, completeness, freshness, uniqueness and business-rule validation; publish quality results and route failures for action.
  • Build CI/CD for data products. Create and maintain automated build, test and deployment pipelines for SQL, dbt, orchestration code and infrastructure configuration, including version control, peer review, environment promotion and safe rollback.
  • Strengthen observability and operations. Monitor pipeline health, lineage, cost, performance and service-level objectives; troubleshoot incidents, perform root-cause analysis and eliminate recurring manual support.
  • Integrate diverse sources. Ingest and standardize data from databases, APIs, files and event sources, applying secure access patterns and appropriate handling for sensitive information.
  • Modernize legacy workflows. Migrate or refactor Informatica PowerCenter and other legacy ETL processes into maintainable cloud-native patterns using tools such as dbt and modern orchestration platforms.
  • Partner from requirement to adoption. Translate stakeholder needs into technical designs, validate production outcomes and communicate tradeoffs, risks and delivery progress clearly.
  • Lead through engineering practice. Set coding and testing standards, review designs and pull requests, mentor engineers and coordinate delivery across cross-functional teams.

What We Believe

We’re proud to embrace the same values that have shaped UST since the beginning. Since day one, we’ve been building enduring relationships and a culture of integrity. And today, it's those same values that are inspiring us to encourage innovation from everyone, to champion diversity and inclusion and to place people at the centre of everything we do.

Humility

We will listen, learn, be empathetic and help selflessly in our interactions with everyone.

Humanity

Through business, we will better the lives of those less fortunate than ourselves.

Integrity

We honour our commitments and act with responsibility in all our relationships.

Equal Employment Opportunity Statement

UST is an Equal Opportunity Employer. We believe that no one should be discriminated against because of their differences, such as age, disability, ethnicity, gender, gender identity and expression, religion, or sexual orientation.
All employment decisions shall be made without regard to age, race, creed, colour, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law.
UST reserves the right to periodically redefine your roles and responsibilities based on the requirements of the organization and/or your performance.
  • To support and promote the values of UST.
  • Comply with all Company policies and procedures

Skills

SQL, Python, Snowflake, PySpark

Skills Required

SQL Python Pyspark ETL Data Modeling GIT Computer Science Data Processing Automation Performance Optimization Informatica Powercenter Ci/cd Pipelines

Learn the skills this job asks for

See your skill gap for Data Engineer →

Free courses, interview questions and practice for each skill.

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
UST logo
UST

IT Services and IT Consulting

Aliso Viejo CA

RecommendedJobs for You

Qentelli logo

Hyderabad

Arup logo

Hyderabad

Navikenz India logo

Lead Data Engineer

Navikenz India

Noida, Bengaluru

MTI Integration Solutions Private Limited logo

Lead Data Engineer

MTI Integration Solutions Private Limited

Hyderabad

Eucloid Data Solutions logo

Lead Data Engineer

Eucloid Data Solutions

Chennai

Milestone Technologies logo

Lead Data Engineer

Milestone Technologies

Hyderabad

Epiroc logo

Bengaluru

Nashik, Maharashtra, India