Azure Databricks

Tata Consultancy Services

6 - 8 years

0 Lacs

kolkata west bengal india

Posted:4 days ago| Platform:

Apply

Skills Required

azure databricks design data apache etl analytics security compliance resolve processing pipeline python pyspark devops agile development

Work Mode

On-site

Job Type

Full Time

Job Description

Azure Databricks

Experience: 6 to 8 Years

Locations: Chennai / Kochi / Hyderabad / Bangalore / Kolkata

Key Responsibilities

Design and develop
data pipelines
using
Azure Databricks
and
Apache Spark
.
Implement
ETL processes
for large-scale data ingestion and transformation.
Optimize data workflows for performance and scalability.
Integrate Databricks with
Azure services
such as
Data Lake, Synapse, Event Hub, and Azure Functions
.
Collaborate with data scientists and analysts to enable advanced analytics and machine learning.
Ensure data security and compliance with organizational standards.
Troubleshoot and resolve issues related to data processing and pipeline failures.

Required Skills

Strong experience with
Azure Databricks
and
Apache Spark
.
Proficiency in
Python, PySpark, and SQL
.
Hands-on experience with
Azure Data Lake, Azure Synapse Analytics, and Azure Storage
.
Knowledge of
data modeling, data warehousing, and performance tuning
.
Familiarity with
CI/CD pipelines
and
DevOps practices
.
Experience in
Agile development methodologies
.

More Jobs at Tata Consultancy Services

Tcs Hiring For GRC , Pan India

Pune, Bengaluru, Mumbai (All Areas)

7 - 12 yrs

INR 9 - 19 Lacs

Java / Spring boot with API Developer

Pune

5 - 10 yrs

INR 9 - 19 Lacs

SAP PP and QM Consultant

Pune

4 - 9 yrs

INR 8 - 18 Lacs

SAP BTP Consultant

Pune

4 - 9 yrs

INR 9 - 19 Lacs

Customer Service Associate

Pune

1 - 6 yrs

INR 1 - 5 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.