Databricks - Lead

Iris Solutions

4 - 8 years

6 - 10 Lacs

noida

Posted:1 week ago| Platform:

Apply

Skills Required

health insurance data analysis orchestration analytical machine learning data quality dms analytics reporting tools python

Work Mode

Work from Office

Job Type

Full Time

Job Description

Key Responsibilities

Architect and Develop Data Pipelines: Design and implement data pipelines that can handle the 4Vs of data (Volume, Variety, Velocity, Veracity) from diverse sources.
Implement CDC: Utilize Change Data Capture (CDC) to efficiently and reliably synchronize data between source and target systems.
Build a Medallion Architecture: Design and implement a data platform following the Medallion Architecture (Raw, Refined, Insights) to ensure data quality, manage transformations, and support analytical needs.
Orchestrate and Manage Workflows: Develop and manage data orchestration processes to automate data ingestion, transformation, and delivery.
Data Strategy Business Value: Articulate how data solutions create tangible business value, and collaborate with stakeholders to define data-driven strategies.
Technical Proficiency: Develop and maintain data solutions using Python and PySpark.
Modern Data Formats: Work with open data formats such as Parquet and Iceberg.
Resilient Architecture: Implement resilient architecture patterns to ensure high availability and fault tolerance of data systems.
Reporting Analytics: Integrate with various reporting tools to provide business insights. (will be a plus)

Soft Skills

Communication Collaboration: Excellent communication skills with the ability to articulate technical concepts and business value to both technical and non-technical audiences.
Personal Attributes: Curious and inquisitive mindset with a passion for continuous learning and problem-solving.

Mandatory Competencies

Data Science and Machine Learning - Data Science and Machine Learning - Databricks

DMS - Data Analysis Skills

Big Data - Big Data - Pyspark

Development Tools and Management - Development Tools and Management - CI/CD

Data Science and Machine Learning - Data Science and Machine Learning - Python

Beh - Communication and collaboration

Mock Interview

Practice Video Interview with JobPe AI

Start Machine Learning Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.