Lead II - Data Engineering

7 - 10 years

Hyderabad

Posted:1 day ago

Apply

Job Description

Role description


Who we are:

At UST, we help the world’s best organizations grow and succeed through transformation. Bringing together the right talent, tools, and ideas, we work with our client to co-create lasting change. Together, with over 30,000 employees in 30+ countries, we build for boundless impact—touching billions of lives in the process. Visit us at UST.com.
Summary:

we have a opening for big data developer

Roles and Responsibilities:
  • 7-10 years of professional experience in data engineering.
  • Minimum 4 years building and operating production data pipelines on AWS.
  • Strong programming ability in Python or Scala, with production-quality code standards.
  • Expert-level SQL, including window functions, CTEs, and query plan analysis.
  • Deep, hands-on Apache Spark experience — not just usage, but performance tuning and debugging.
  • Demonstrated ability to diagnose Spark data skew, shuffle bottlenecks, and memory issues.
  • Production experience across the AWS data stack: EMR, S3, Athena, Redshift, and Lambda.
  • Streaming data experience with Amazon Kinesis or Apache Kafka.
  • Workflow orchestration with Apache Airflow (MWAA) or an equivalent scheduler.
  • Solid data modelling fundamentals, including dimensional modelling and slowly changing dimensions.
  • Working knowledge of data lake table formats such as Apache Iceberg, Hudi, or Delta Lake.
  • Experience operating what you build — CloudWatch, structured logging, ing, and on-call participation.
  • Familiarity with version control and collaborative development workflows using Git.
  • Ability to work directly with non-technical stakeholders and communicate trade-offs clearly.

What we believe:

We’re proud to embrace the same values that have shaped UST since the beginning. Since day one, we’ve been building enduring relationships and a culture of integrity. And today, it's those same values that are inspiring us to encourage innovation from everyone, to champion diversity and inclusion and to place people at the centre of everything we do.

Humility:

We will listen, learn, be empathetic and help selflessly in our interactions with everyone.

Humanity:

Through business, we will better the lives of those less fortunate than ourselves.

Integrity:

We honour our commitments and act with responsibility in all our relationships.

Equal Employment Opportunity Statement

UST is an Equal Opportunity Employer. We believe that no one should be discriminated against because of their differences, such as age, disability, ethnicity, gender, gender identity and expression, religion, or sexual orientation.

All employment decisions shall be made without regard to age, race, creed, colour, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law.

UST reserves the right to periodically redefine your roles and responsibilities based on the requirements of the organization and/or your performance.

  • To support and promote the values of UST.
  • Comply with all Company policies and procedures

Skills


AWS, AWS Lambda, Amazon Athena, Amazon CloudWatch, Amazon Kinesis, Amazon Redshift, Amazon S3, Apache Airflow, Apache Hudi, Amazon EMR


About UST

UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world’s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients’ organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact—touching billions of lives in the process.

Skills Required

Data Engineering BIG Data AWS Python SQL Apache Spark Performance Tuning Debugging Spark Apache Kafka Data Modelling

Learn the skills this job asks for

Free courses, interview questions and practice for each skill.

Mock Interview

Practice Video Interview with JobPe AI

Start Big Data Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
UST logo
UST

IT Services and IT Consulting

Aliso Viejo CA

RecommendedJobs for You