Home
Jobs
Virtusa logo

Data Engineer- Python Pyspark

7 years

0 Lacs

Pune Maharashtra India

Posted:3 weeks ago| Platform: Linkedin logo

Apply

Skills Required

data python pyspark support integration processing scripting sql etl informatica aws redshift airflow architecture kafka mulesoft api healthcare agile communication teamwork design test querying reporting development maintenance checks monitoring

Work Mode

On-site

Job Type

Full Time

Job Description

Senior Data Engineer Position Summary The Sr Data Engineer is responsible for building and maintaining data pipelines ensuring the smooth operation of data systems, and optimizing workflows to meet business requirements This role will support data integration and processing for various applications Minimum Qualifications 7 Years overall IT experience with minimum 4 years of work experience in below tech skills Tech Skills Proficient in Python scripting and PySpark for data processing tasks Strong SQL capabilities with hands on experience managing big data using ETL tools like Informatica Experience with the AWS cloud platform and its data services including S3 Redshift Lambda EMR Airflow Postgres SNS and EventBridge Skilled in BASH Shell scripting Understanding of data lakehouse architecture particularly with Iceberg format is a plus Preferred Experience With Kafka And Mulesoft API Understanding of healthcare data systems is a plus Experience in Agile methodologies Strong analytical and problem solving skills Effective communication and teamwork abilities Responsibilities Develop and maintain data pipelines and ETL processes to manage large scale datasets Collaborate to design test data architectures to align with business needs Implement and optimize data models for efficient querying and reporting Assist in the development and maintenance of data quality checks and monitoring processes Support the creation of data solutions that enable analytical capabilities Contribute to aligning data architecture with overall organizational solutions Show more Show less

More Jobs at Virtusa

Servicenow QA

Bengaluru, Karnataka

3 - 3 yrs
|

Salary: Not disclosed

React T3

Bengaluru, Karnataka

Experience: Not specified

|

Salary: Not disclosed

Java-Pankaj

Bengaluru, Karnataka

Experience: Not specified

|

Salary: Not disclosed

C ++

Bengaluru, Karnataka

Experience: Not specified

|

Salary: Not disclosed

Java Architect (ATC)

Bengaluru, Karnataka

Experience: Not specified

|

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Data Interview Now

My Connections Virtusa

Download Chrome Extension (See your connection in the Virtusa )

chrome image
Download Now
Virtusa
Virtusa
www.virtusa.com

Information Technology and Services

Southborough

20,000+ Employees

3452 Jobs

    Key People

  • Kris Canekeratne

    Chairman and CEO

  • Sanjay Singh

    President and COO

RecommendedJobs for You

Virtusa logo

Data Engineer- Python Pyspark

Virtusa

Pune, Maharashtra, India

Virtusa logo

Data Engineer- Python Pyspark

Virtusa

Pune, Maharashtra, India