Jobs

Interviews
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Home

Jobs

Home
>
Jobs in Trivandrum
>
UST
>
Azure with Azure Data Factory & Pyspark - Lead

Azure with Azure Data Factory & Pyspark - Lead

UST

5 - 7 years

0 Lacs

Trivandrum

Posted:2 months ago| Platform:

Apply

Skills Required

azure databricks python azure data lake data processing microsoft azure pyspark data warehousing power bi azure data factory data engineering business intelligence azure cloud sql server sql plsql analytics pipeline tableau sql azure data modeling etl ssis informatica

Work Mode

Work from Office

Job Type

Full Time

Job Description

Data Pipeline Development: Design, implement, and optimize end-to-end data pipelines on Azure, focusing on scalability and performance. Develop and maintain ETL workflows for seamless data processing. Azure Cloud Expertise. Utilize Azure services such as Azure Data Factory, Azure SQL Database, and Azure Databricks for effective data engineering. Implement and manage data storage solutions on Azure. Data Transformation with PySpark Leverage PySpark for advanced data transformations, ensuring high-quality and well-structured output. Implement data cleansing, enrichment, and validation processes using PySpark. Performance Optimization Optimize data pipelines, queries, and PySpark jobs to enhance overall performance and scalability. Identify and address performance bottlenecks within data processing workflows. Proven experience as a Data Engineer, emphasizing expertise in Azure. Proficiency in Azure Data Factory and other relevant Azure services. Expertise in PySpark for data processing and analytics is a must. Experience with data modeling, ETL processes, and data warehousing. Required Skills Azure,Azure Data Factory,Pyspark

More Jobs at UST

UCC Engineer (Collab)

Trivandrum

5 - 7 yrs

INR 0 - 0 Lacs

Specialist I - Cloud Infrastructure Services - Network Engineer

Trivandrum

12 - 18 yrs

INR 0 - 0 Lacs

Application Packaging - SCCM, Release management

Trivandrum

8 - 12 yrs

INR 0 - 0 Lacs

Lead I - Cloud Infrastructure Services

Trivandrum

5 - 7 yrs

INR 0 - 0 Lacs

SQL Database Engineering

Trivandrum

12 - 15 yrs

INR 0 - 0 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Azure Databricks Interview Now

My Connections UST

Download Chrome Extension (See your connection in the UST )

Download Now

UST

www.ust.com

IT Services and IT Consulting

Aliso Viejo CA

10001 Employees

1845 Jobs

Key People

Kris Canekeratne

Co-Founder & CEO
Sandeep Reddy

President
Baskar Subramanian

Co-Founder & Chief Strategy Officer
Lynn C. Mclean

Chief Financial Officer

Login to

Please Verify Your Phone or Email

Confirm Action

Search

Profile

Upskill and Grow with AI

Azure with Azure Data Factory & Pyspark - Lead