Software Engineer/Developer - Databricks

Cognizant

7 - 12 years

14 - 20 Lacs

chennai

Posted:1 month ago| Platform:

Apply

Skills Required

kafka spark azure devops yaml python azure cloud cosmos

Work Mode

Work from Office

Job Type

Full Time

Job Description

Key Responsibilities:

Develop, test, and maintain high-quality, scalable data processing pipelines using Databricks and PySpark
Design and implement efficient ETL processes for large-scale data integration and transformation
Write optimized SQL queries for data analysis and reporting
Develop Python / PySpark scripts for data manipulation, automation, and machine learning tasks
Work with Azure cloud services, particularly Azure Databricks and CosmosDB
Collaborate with data scientists and analysts to implement and optimize data models
Participate in code reviews and contribute to best practices and coding standards
Implement and maintain CI/CD pipelines using Azure DevOps
Troubleshoot and resolve data processing and performance issues
Stay current with the latest developments in big data technologies and cloud computing

Required Qualifications:

Bachelors degree in computer science, Engineering, or a related field
8+ years of experience in software development, with a focus on data engineering
Strong proficiency in Python programming
Experience with Apache Spark and PySpark
Solid understanding of SQL and experience with large-scale data processing
Familiarity with Databricks and its ecosystem
Experience with Azure cloud services, particularly Azure Databricks
Knowledge of NoSQL databases, specifically CosmosDB
Understanding of CI/CD principles and experience with Azure DevOps
Excellent problem-solving skills and attention to detail
Strong communication skills and ability to work in a team environment

More Jobs at Cognizant

Workday: Walk-in drive 10th May Pune with CTS(Full time)

Pune, Mumbai (All Areas)

3 - 8 yrs

INR 7 - 17 Lacs

Java Full Stack Developer

Chennai

5 - 10 yrs

INR 10 - 20 Lacs

Walkin For Freshers @hyderabad

Hyderabad

Experience: Not specified

INR 0 - 2 Lacs

React JS Developer

Hyderabad

2 - 7 yrs

INR 9 - 14 Lacs

Java Developer

Bengaluru

5 - 10 yrs

INR 15 - 30 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Azure DevOps Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.