Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Jobs

Interviews

Home
>
Jobs in Chennai
>
Virtusa
>
ETL Databricks with AWS (PySpark/SQL)

ETL Databricks with AWS (PySpark/SQL)

Virtusa

0 years

0 Lacs

Chennai Tamil Nadu India

Posted:3 weeks ago| Platform:

Apply

Skills Required

etl databricks aws pyspark sql code data spark checks logging pipeline orchestration schedule collaborative development engineering certification optimization scripting python storage devops git terraform debugging troubleshooting tuning

Work Mode

On-site

Job Type

Full Time

Job Description

Develop and maintain a metadata driven generic ETL framework for automating ETL codeDesign, build, and optimize ETL/ELT pipelines using Databricks (PySpark/SQL) on AWS .Ingest data from a variety of structured and unstructured sources (APIs, RDBMS, flat files, streaming).Develop and maintain robust data pipelines for batch and streaming data using Delta Lake and Spark Structured Streaming.Implement data quality checks, validations, and logging mechanisms.Optimize pipeline performance, cost, and reliability.Collaborate with data analysts, BI, and business teams to deliver fit for purpose datasets.Support data modeling efforts (star, snowflake schemas) de norm tables approach and assist with data warehousing initiatives.Work with orchestration tools Databricks Workflows to schedule and monitor pipelines.Follow best practices for version control, CI/CD, and collaborative development

Skills

Hands-on experience in ETL/Data Engineering roles.Strong expertise in Databricks (PySpark, SQL, Delta Lake), Databricks Data Engineer Certification preferredExperience with Spark optimization, partitioning, caching, and handling large-scale datasets.Proficiency in SQL and scripting in Python or Scala.Solid understanding of data lakehouse/medallion architectures and modern data platforms.Experience working with cloud storage systems like AWS S3Familiarity with DevOps practices Git, CI/CD, Terraform, etc.Strong debugging, troubleshooting, and performance-tuning skills.

More Jobs at Virtusa

Servicenow QA

Bengaluru, Karnataka

3 - 3 yrs

Salary: Not disclosed

React T3

Bengaluru, Karnataka

Experience: Not specified

Salary: Not disclosed

Java-Pankaj

Bengaluru, Karnataka

Experience: Not specified

Salary: Not disclosed

C ++

Bengaluru, Karnataka

Experience: Not specified

Salary: Not disclosed

Java Architect (ATC)

Bengaluru, Karnataka

Experience: Not specified

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

Virtusa

Information Technology and Services

Southborough

Login to

Please Verify Your Phone or Email

Confirm Action

Search

Profile

Upskill and Grow with AI

ETL Databricks with AWS (PySpark/SQL)