Senior Data Engineer

Careernet

5 - 8 years

12 - 22 Lacs

hyderabad

Posted:-1 days ago| Platform:

Apply

Skills Required

delta lake azure databricks spark apache spark python azure snowflake kafka ci/cd qlik

Work Mode

Hybrid

Job Type

Full Time

Job Description

Key Skills:

Roles & Responsibilities:

Design, develop, and maintain scalable data pipelines using Azure Databricks and Spark.
Implement data processing solutions with Delta Lakes and manage multiple file formats.
Collaborate with cross-functional teams to ensure data quality and integrity.
Utilize CI/CD practices for efficient deployment and management of data solutions.
Work with Snowflake and Qlik for data visualization and reporting.
Leverage Kafka or similar streaming technologies for real-time data processing.
Ensure compliance with data governance and security standards in Azure.

Experience Requirement:

5 - 8 years of experience developing and optimizing Spark jobs in Azure Databricks.
Proficient in building scalable ETL pipelines and working with Delta Lake for versioned data management.
Experienced in implementing CI/CD pipelines and managing deployments in cloud-based environments.
Knowledgeable in real-time data streaming using Kafka or similar platforms.
Experience with Snowflake integration and reporting via Qlik or other BI tools.

Education:

More Jobs at Careernet

Devops Engineer

Pune

6 - 11 yrs

INR 10 - 20 Lacs

Servicenow Developer

Chennai, Bengaluru, Hyderabad

4 - 6 yrs

INR 10 - 18 Lacs

RDS Engineer

Bengaluru

6 - 9 yrs

INR 8 - 18 Lacs

Senior ML Software Engineer

Bengaluru

7 - 11 yrs

INR 30 - 40 Lacs

ICC System Architect

Bengaluru

12 - 17 yrs

INR 22 - 37 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.