Data Engineer

Virtusa

2 - 5 years

4 - 8 Lacs

bengaluru

Posted:2 days ago| Platform:

Apply

Skills Required

data engineer python github api development restful api gateway scala ai sql spring boot data quality lambda java automation redshift spark grafana data governance devsecops prometheus aws etl data lake

Work Mode

Work from Office

Job Type

Full Time

Job Description

Transform and process source data into data products and enable egression to other platforms Develop efficient Data Lake frameworks using Scala, PySpark, or Python, with robust data quality and security controls
Create reusable libraries and config driven pipelines for enterprise wide ingestion and integration Ensure compliance with data governance and security standards using tools like AWS DataZone, Lake Formation, AWS Glue and MWAA
Communicate effectively with internal stakeholders and contribute to team knowledge sharing Experience with CI/CD tools such as GitHub, GitHub Actions, ArgoCD, and automated deployment pipelines
Experience with observability tools like Cloudwatch, Prometheus, or Grafana Exposure to AI/ML technologies, with the ability to integrate or leverage AI models to enhance data processing, automation, or system intelligence
Experience using DevSecOps methodologies and best practice to automate deployments and testing Demonstrable in Python, SQL, Spark, and Scala for distributed data processing
Demonstrable experience with AWS Glue, Lambda, Redshift, Athena, Kinesis, and EMR Exposure to AWS Marketplace, API Gateway, and data monetisation strategies
Performance tuning of ETL jobs and query optimisation for cost efficiency Design and develop next generation data platforms and pipeline solutions
Build and maintain backend services and integrations using Java Spring Boot, ensuring performance, scalability, and security
Collaborate with engineering peers to co create and contribute to shared practices and frameworks
Apply modern coding standards to deliver high quality, reliable solutions that address core business needs and reduce risk
Strong experience in Java, Spring Boot, and RESTful API development

More Jobs at Virtusa

Servicenow QA

Bengaluru, Karnataka

3 - 3 yrs

Salary: Not disclosed

React T3

Bengaluru, Karnataka

Experience: Not specified

Salary: Not disclosed

Java-Pankaj

Bengaluru, Karnataka

Experience: Not specified

Salary: Not disclosed

C ++

Bengaluru, Karnataka

Experience: Not specified

Salary: Not disclosed

Java Architect (ATC)

Bengaluru, Karnataka

Experience: Not specified

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Data Engineer Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.