Databricks Data Engineer

Company Description

zRanga is a specialized staffing and talent solutions provider helping enterprises scale quickly with high-quality technology and business professionals.

We deliver fast, reliable, and cost-effective staffing services—from individual experts to full project teams—tailored to each client’s unique needs. Our customer-centric approach has enabled us to support Fortune 100 organizations as well as growing SMEs across multiple industries.

At zRanga, we take pride in providing personalized staffing solutions that drive growth, increase operational efficiency, and set our clients up for long-term success.

Role Description

This full-time on-site role, located in Hyderabad, India, is for a Databricks Data Engineer. The primary responsibilities include building and maintaining efficient and scalable data pipelines, implementing Extract Transform Load (ETL) processes, designing and optimizing data models, and managing datasets within a data warehouse. Additionally, the role involves leveraging data analytics to provide actionable insights for informed business decisions while collaborating closely with cross-functional teams to meet strategic goals.

Key responsibilities

• Data pipeline development:

   Design, build, and maintain scalable ETL/ELT pipelines for both batch and streaming data.

• Data architecture and modeling:

   Design and implement data solutions like data lakes, lakehouses, and data warehouses using Databricks Delta Lake and other components.

• Performance optimization:

   Optimize Databricks clusters, Spark jobs, and data processing workflows to ensure efficiency and performance.

• Data quality and governance:

   Ensure data integrity, quality, and security through robust data governance, cleaning, and compliance measures.

• Collaboration:

   Work with data scientists, analysts, and business stakeholders to understand requirements and deliver high-quality data solutions.

• Integration:

   Integrate data from various sources, such as APIs, SQL databases, and streaming platforms, into the Databricks environment.

• Programming:

   Write and optimize code in languages like Python or Scala and SQL for data transformation and automation. 

Required skills

• Proficiency in Databricks and Apache Spark.
• Strong programming skills in Python and SQL.
• Experience with ETL/ELT frameworks and data modeling.
• Familiarity with Azure cloud platforms.
• Knowledge of data governance and security practices.
• Experience with data pipeline development (batch and streaming).