DataOps Engineer-Pune

Role & responsibilities

Data Engineering & Pipeline Management

• Design, manage, monitor, and maintain data pipelines and ETL processes using PySpark, Azure DataBricks, SQL Server Studio and Azure Data Factory.
• Ensure data flows are reliable, scalable, and optimized for performance.
• Validate data processes through automated testing and monitoring.

Continuous Integration, Deployment & Reliability

• Perform deployments using CI/CD pipelines in Azure DevOps, aligned with team practices.
• Ensure continuous availability, reliability, and scalability of connected systems.
• Support performance, uptime, disaster recovery, and capacity growth.

Operational Support & Collaboration

• Serve as Level 3 support for digital applications, collaborating with Level 2 users to resolve escalated incidents.
• Apply high-level technical mitigation and provide initial technical findings, helping to identify product gaps and improvements.
• Work closely with cross-functional, international teams to deliver innovative solutions.
• Actively participate in the global DevOps community.

Preferred candidate profile

• Bachelors degree in Computer Engineering or other technical engineering fields related to coding is valued.
• 5+ years of experience in data engineering or software development, with a focus on cloud-based data solutions.
• Strong hands-on experience with PySpark, Azure DataBricks, SQL Server Studio and Azure Data Factory.
• Deep understanding of ETL pipelines and data processing workflows.
• Experience with large, complex, and highly scalable systems.
• Expertise in automated testing and monitoring of data pipelines.
• Strong analytical and problem-solving skills.
• Effective communication skills for working with developers, product owners, testers, and designers.
• Experience with DevOps tools (Azure DevOps preferred).
• Nice to have experience in .NET development.
• Experience with version control systems (GIT).
• Experience with CI/CD pipelines is a plus.
• Experience with Agile methodology is a plus.
• Fluent in English.

Work Location Address

Parkar Consulting & Labs, 5th Floor, C wing, Manikchand Ikon, Bund Garden, B S Dhole Patil Path, Wadia College, Sangamvadi, District Pune, Maharashtra-411001