Data Engineer SQL

3 - 12 years

0 Lacs

Pune All india

Posted:1 day ago| Platform: Shine logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

As an experienced and talented Data Engineer specializing in Databricks, you will join our growing data engineering team on a full-time employment basis. Your role will involve designing and maintaining scalable data pipelines using Databricks and Apache Spark, optimizing ETL/ELT processes for structured and unstructured data, and implementing Lakehouse architecture for efficient data storage, processing, and analytics. You will also be responsible for managing Databricks Workflows, Jobs API, and AWS/Azure/GCP data services, ensuring data governance, security policies, and access controls. Key Responsibilities: - Design and maintain scalable data pipelines with Databricks and Apache Spark - Develop and optimize ETL/ELT processes for structured and unstructured data - Implement Lakehouse architecture for efficient data storage, processing, and analytics - Manage Databricks Workflows, Jobs API, and AWS/Azure/GCP data services - Ensure data governance with Unity Catalog, security policies, and access controls Qualifications Required: - 3+ years of experience in Big Data technologies like Apache Spark and Databricks - Strong proficiency in Python or Scala - Experience with cloud platforms such as AWS, Azure, and GCP - Knowledge of data warehousing, ETL processes, and SQL - Familiarity with CI/CD pipelines, GitHub, and containerization (Docker, Kubernetes) In addition to the challenging role, we offer a competitive salary and benefits package, a culture focused on talent development with quarterly promotion cycles, and company-sponsored higher education and certifications. Our employee engagement initiatives include project parties, flexible work hours, Long Service awards, and annual health check-ups. Insurance coverage is provided for group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents. Our client is committed to fostering diversity and inclusion in the workplace, welcoming applications from all qualified individuals, regardless of disabilities, gender, or gender preference. Hybrid work options and flexible hours are available to accommodate various needs and preferences. Our office is equipped with accessible facilities, including adjustable workstations, ergonomic chairs, and assistive technologies to support employees with physical disabilities. If you have specific requirements due to disabilities, please inform us during the application process or at any time during your employment. Join us in collaborative innovation, where diversity and work-life wellbeing are at the core. As an experienced and talented Data Engineer specializing in Databricks, you will join our growing data engineering team on a full-time employment basis. Your role will involve designing and maintaining scalable data pipelines using Databricks and Apache Spark, optimizing ETL/ELT processes for structured and unstructured data, and implementing Lakehouse architecture for efficient data storage, processing, and analytics. You will also be responsible for managing Databricks Workflows, Jobs API, and AWS/Azure/GCP data services, ensuring data governance, security policies, and access controls. Key Responsibilities: - Design and maintain scalable data pipelines with Databricks and Apache Spark - Develop and optimize ETL/ELT processes for structured and unstructured data - Implement Lakehouse architecture for efficient data storage, processing, and analytics - Manage Databricks Workflows, Jobs API, and AWS/Azure/GCP data services - Ensure data governance with Unity Catalog, security policies, and access controls Qualifications Required: - 3+ years of experience in Big Data technologies like Apache Spark and Databricks - Strong proficiency in Python or Scala - Experience with cloud platforms such as AWS, Azure, and GCP - Knowledge of data warehousing, ETL processes, and SQL - Familiarity with CI/CD pipelines, GitHub, and containerization (Docker, Kubernetes) In addition to the challenging role, we offer a competitive salary and benefits package, a culture focused on talent development with quarterly promotion cycles, and company-sponsored higher education and certifications. Our employee engagement initiatives include project parties, flexible work hours, Long Service awards, and annual health check-ups. Insurance coverage is provided for group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents. Our client is committed to fostering diversity and inclusion in the workplace, welcoming applications from all qualified individuals, regardless of disabilities, gender, or gender preference. Hybrid work options and flexible hours are available to accommodate various needs and preferences. Our office is equipped with accessible facilities, including adjustable workstations, ergonomic chairs, and assistive technologies to support employees with physical disabilities. If you have specific requirements due to disabilities, please inform

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now
coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You