Data Bricks with Python/Pyspark Professional

Krazy Mantra HR Solutions Pvt. Ltd

8 - 13 years

3 - 7 Lacs

bengaluru

Posted:3 days ago| Platform:

Apply

Skills Required

pyspark azure data factory spark python azure data lake hive scala data warehousing sql java sql azure ssrs hadoop big data etl arm msbi azure databricks ssas microsoft azure power bi sql server nosql data bricks data quality kafka sqoop ssis aws

Work Mode

Work from Office

Job Type

Full Time

Job Description

We are looking for a skilled Data Engineer with expertise in Python/Pyspark to join our team at Krazy Mantra HR Solutions Pvt. Ltd, located in Bangalore. The ideal candidate will have 8+ years of experience in a Data Engineer role and be available to join immediately.

Roles and Responsibility

Design and develop data pipelines using Azure Data Factory, Stream Analytics, and Databricks.
Collaborate with cross-functional teams to integrate data from various sources into a unified platform.
Develop and maintain large-scale data warehouses using Azure Data Lake Storage and NoSQL databases.
Implement serverless architecture using Azure Functions and ARM Templates.
Optimize data processing workflows using big data tools such as Hadoop, Spark, and Kafka.
Ensure data quality and integrity by implementing robust testing and validation frameworks.

Job Requirements

Strong proficiency in Python/Pyspark programming languages.
Experience with cloud-based technologies such as Azure, including Azure Data Factory, Azure Data Lake Storage, and Databricks.
Knowledge of big data tools such as Hadoop, Spark, and Kafka.
Familiarity with SQL and NoSQL databases.
Understanding of scripting languages and experience with stream analytics.
Excellent problem-solving skills and attention to detail.
Education: BE, B.Tech, ME, M.Tech.
Contact: .

Additional Info

The company offers a dynamic work environment and opportunities for professional growth and development.

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

Krazy Mantra HR Solutions Pvt. Ltd

Human Resources

Rajkot

Login to

Please Verify Your Phone or Email

Confirm Action

Data Bricks with Python/Pyspark Professional