Data Engineer with Azure Databricks

4 - 6 years

0 Lacs

bengaluru karnataka

Posted:1 day ago| Platform: Indeed logo

Apply

Skills Required

data azure databricks pyspark python processing etl storage retrieval integrity governance engineering spark programming scala sql relational integration communication collaboration apache

Work Mode

On-site

Job Type

Full Time

Job Description

Bengaluru, Karnataka, India
Job Type
Full Time
About the Role
Mandatory Skills
Data Warehousing, Azure Data Engineer, Azure Data Lake, Data Bricks, Pyspark, Python Skill to Evaluate Data Warehousing, Azure Data Engineer, Azure Data Lake, Data Bricks, Pyspark, Python Experience 4 to 6 Years Roles & Responsibilities
  • Develop and implement scalable data processing solutions using Azure Databricks, including ETL processes that efficiently handle large data volumes.
  • Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs and objectives.
  • Optimize data storage and retrieval processes to enhance performance and reduce latency.
  • Ensure data quality and integrity by implementing best practices for data governance and validation.
  • Stay updated with the latest trends and technologies in data engineering, and evaluate their applicability to the organization's needs.

Proficiency in Databricks and experience with Spark for big data processing.
  • Solid programming skills in Python or Scala for developing data pipelines.
  • Knowledge of SQL and experience with relational databases and data warehousing concepts.
- Familiarity with cloud platforms - Azure, particularly in relation to data storage and processing.
  • Understanding of data modeling, ETL processes, and data integration methodologies.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration abilities to work effectively in a team-oriented environment.

Skill Area Tools & Technologies Data Engineering Databricks, Apache Spark, Delta Lake Programming Python, SQL, PySpark Cloud Platforms Azure Education Qualificaiton B Tech
Requirements
Mandatory Skills
Data Warehousing, Azure Data Engineer, Azure Data Lake, Data Bricks, Pyspark, Python

Skill to Evaluate
Data Warehousing, Azure Data Engineer, Azure Data Lake, Data Bricks, Pyspark, Python

Experience
4 to 6 Years
Roles & Responsibilities
  • Develop and implement scalable data processing solutions using Azure Databricks, including ETL processes that efficiently handle large data volumes.
  • Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs and objectives.
  • Optimize data storage and retrieval processes to enhance performance and reduce latency.
  • Ensure data quality and integrity by implementing best practices for data governance and validation.
  • Stay updated with the latest trends and technologies in data engineering, and evaluate their applicability to the organization's needs.

Proficiency in Databricks and experience with Spark for big data processing.
  • Solid programming skills in Python or Scala for developing data pipelines.
  • Knowledge of SQL and experience with relational databases and data warehousing concepts.
- Familiarity with cloud platforms - Azure, particularly in relation to data storage and processing.
  • Understanding of data modeling, ETL processes, and data integration methodologies.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration abilities to work effectively in a team-oriented environment.

Skill Area Tools & Technologies
Data Engineering Databricks, Apache Spark, Delta Lake
Programming Python, SQL, PySpark
Cloud Platforms Azure

Education Qualificaiton
B Tech
About the Company

More Jobs at Cigres Technologies

Blackline System Administrator

bengaluru, karnataka

7.0 - 7.0 yrs
|

Salary: Not disclosed

Scrum Master

bengaluru, karnataka

8.0 - 8.0 yrs
|

Salary: Not disclosed

Service Desk Analyst

bengaluru

Experience: Not specified

|

INR 1 - 6 Lacs

Salesforce Data Analyst

bengaluru

Experience: Not specified

|

INR 2 - 6 Lacs

QA Engineer

bengaluru

3.0 - 5.0 yrs
|

INR 5 - 8 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Google Play App Store
coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Cigres Technologies

RecommendedJobs for You

Data Engineer with Azure Databricks

Cigres Technologies

bengaluru, karnataka