Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Jobs

Interviews

Home
>
Jobs in thiruvananthapuram
>
UST
>
Lead II - Data Engineering

Lead II - Data Engineering

UST

8 - 12 years

0 Lacs

thiruvananthapuram kerala

Posted:21 hours ago| Platform: Shine logo

Apply

Skills Required

sql pyspark azure databricks elt

Work Mode

On-site

Job Type

Full Time

Job Description

As a Senior Data Engineer, you will be responsible for designing and building robust, scalable data pipelines with deep expertise in PySpark, SQL, and cloud data platforms such as Azure Databricks, with exposure to AWS or GCP environments. You will collaborate with data architects, analysts, and business stakeholders to deliver high-quality data solutions that drive insights and business value. Your key responsibilities will include designing, building, and optimizing scalable ETL/ELT pipelines using PySpark and SQL, developing data workflows on Azure Databricks, integrating across cloud platforms (AWS or GCP), implementing and maintaining data models using Kimball/star schema or similar dimensional modeling approaches, ensuring data quality, consistency, and performance across large datasets, and contributing to data architecture and platform decisions in a cloud-native environment. You must have 8+ years of experience in Data Engineering or a related field, strong hands-on experience with PySpark for data transformation and processing, advanced SQL skills for querying and managing large-scale datasets, proven experience with Azure Databricks for big data development, familiarity with cloud platforms like AWS and/or GCP, solid understanding of dimensional data modeling using Kimball/star schema, and experience building and maintaining ETL/ELT data pipelines in production environments. Nice-to-have skills include experience with orchestration tools (e.g., Apache Airflow, Azure Data Factory), exposure to data governance, cataloging, and lineage tools, familiarity with Delta Lake and Lakehouse architectures, proficiency in Python beyond PySpark (e.g., for utilities, API integration), and a background in business domains such as finance, e-commerce, or retail analytics. If you are looking to utilize your skills in PySpark, SQL, Azure Databricks, and ELT in a challenging and rewarding environment, this role is perfect for you.,

More Jobs at UST

Architect II - Technical SAP ABAP

Bengaluru

12 - 15 yrs

INR 0 - 0 Lacs

Lead I - SAP FICO with PS (Project Systems) and RAR

Bengaluru

5 - 7 yrs

INR 0 - 0 Lacs

Lead II - SAP ABAP

Bengaluru

7 - 9 yrs

INR 0 - 0 Lacs

Procurement

Bengaluru, Karnataka

Experience: Not specified

Salary: Not disclosed

Manual & Python Automation

Bengaluru, Karnataka

Experience: Not specified

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

UST

IT Services and IT Consulting

Aliso Viejo CA

Login to

Please Verify Your Phone or Email

Confirm Action

Search

Profile

Upskill and Grow with AI

Lead II - Data Engineering