Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Home
>
Jobs in thiruvananthapuram
>
UST
>
Associate Data Architect II

Associate Data Architect II

UST

12 - 15 years

5 Lacs

thiruvananthapuram

Posted:1 week ago| Platform:

Apply

Skills Required

pyspark azure data factory data pipeline data architecture azure devops sql cloud git data modeling gcp spark design data ingestion hadoop programming azure databricks python azure data lake data processing microsoft azure data engineering data bricks data quality agile aws

Work Mode

Work from Office

Job Type

Full Time

Job Description

Key Accountabilities / Responsibilities:

Provide technical direction and leadership to data engineers on data platform initiatives - ensuring adherence to best practices in data modelling, End to End pipeline design, and code quality.
Review and optimize
PySpark
,
SQL
, and
Databricks
code for performance, scalability, and maintainability.
Offer engineering support and mentorship to data engineering teams within delivery squads, guiding them in building robust, reusable, and secure data solutions.
Collaborate with architects to define data ingestion, transformation, and storage strategies leveraging Azure services such as
Azure Data Factory
, Azure Databricks, Azure Data Lakes
Drive automation and
CI/CD
practices in data pipelines using tools such as
Git, Azure DevOps
, and DBT (good to have).
Ensure optimal data quality and lineage by implementing proper testing, validation, and monitoring mechanisms within data pipelines.
Stay current with evolving data technologies, tools, and best practices, continuously improving standards, frameworks, and engineering methodologies.
Troubleshoot complex data issues, analyse system performance, and provide solutions to development and service challenges.
Coach, mentor, and support team members through knowledge sharing sessions, technical reviews.

Required Skills & Experience:

background of large-scale distributed data processing systems (or experience in equal measure).

Proficient in designing scalable and efficient data models

Practical experience implementing and managing Unity Catalog for centralized governance of data assets across Databricks workspaces, including access control, lineage tracking, and auditing.

- Demonstrated ability to optimize data pipelines and queries using techniques such as partitioning, caching, indexing, and adaptive execution strategies to improve performance and reduce costs.

- Programming in Pyspark (Must), SQL(Must), Python (Good to have).

- Experience with Databricks (Mandatory) and DBT (Good to have) is required

- Implemented cloud data technologies on either Azure (Must) other optional GCP, Azure or AWS.

- Knowledge around shortening development lead time and improving data development lifecycle

- Worked in an Agile delivery framework.

Required Skills

Pyspark, SQL, Azure Databricks, AWS

More Jobs at UST

Architect II - Technical SAP ABAP

Bengaluru

12 - 15 yrs

INR 0 - 0 Lacs

Lead I - SAP FICO with PS (Project Systems) and RAR

Bengaluru

5 - 7 yrs

INR 0 - 0 Lacs

Lead II - SAP ABAP

Bengaluru

7 - 9 yrs

INR 0 - 0 Lacs

Procurement

Bengaluru, Karnataka

Experience: Not specified

Salary: Not disclosed

Manual & Python Automation

Bengaluru, Karnataka

Experience: Not specified

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.