Azure Databricks, Data Factory and SQL

6 - 13 years

0 Lacs

Posted:1 week ago| Platform: Shine logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

You will be responsible for designing, building, and deploying data pipelines and workflows using Databricks. Additionally, you will develop and optimize Apache Spark applications for data processing and analytics. You will integrate Databricks with various data sources and platforms, implement data quality checks and monitoring processes, and manage/configure the Databricks environment including clusters and notebooks. Troubleshooting and resolving issues related to Databricks performance and functionality will also be part of your role. Furthermore, collaborating with data scientists and analysts to implement machine learning models and staying up-to-date with the latest Databricks features and best practices are key responsibilities. Qualifications for this role include a strong proficiency in Python or Scala programming languages, experience with Apache Spark and big data processing frameworks, knowledge of cloud platforms like AWS, Azure, or GCP, familiarity with data warehousing and ETL processes, understanding of machine learning concepts and algorithms, and strong problem-solving and analytical skills. Depending on the specific role, additional skills may be required such as experience with Databricks Delta Lake or MLflow, knowledge of infrastructure as code (IaC) tools like Terraform, familiarity with CI/CD pipelines for data and machine learning workflows, and experience with containerization technologies like Docker.,

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Cognizant logo
Cognizant

IT Services and IT Consulting

Teaneck New Jersey

RecommendedJobs for You