Jobs

Interviews
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Home

Jobs

Home
>
Jobs in Bengaluru
>
Apptad
>
SQL PySpark

SQL PySpark

Apptad

3 - 8 years

3 - 6 Lacs

Bengaluru

Posted:4 hours ago| Platform:

Apply

Skills Required

azure data lake scala sql data bricks data modeling azure databricks data processing azure synapse power bi pyspark microsoft azure azure data factory adls gen2 pipeline spark data ingestion data warehousing concepts etl process

Work Mode

Work from Office

Job Type

Full Time

Job Description

We are looking for a skilled SQL PySpark professional with 3 to 8 years of experience to join our team. The ideal candidate will have expertise in developing data pipelines and transforming data using Databricks, Synapse notebooks, and Azure Data Factory.
Roles and Responsibility

Collaborate with technical architects and cloud solutions teams to design data pipelines, marts, and reporting solutions.

Code, test, and optimize Databricks jobs for efficient data processing and report generation.

Set up scalable data pipelines integrating with various data sources and cloud platforms using Databricks.

Ensure best practices are followed in terms of code quality, data security, and scalability.

Participate in code and design reviews to maintain high development standards.

Optimize data querying layers to enhance performance and support analytical requirements.

Leverage Databricks to set up scalable data pipelines that integrate with a variety of data sources and cloud platforms.

Collaborate with data scientists and analysts to support machine learning workflows and analytic needs.

Stay updated with the latest developments in Databricks and associated technologies to drive innovation.

Job

Proficiency in PySpark or Scala and SQL for data processing tasks.

Hands-on experience with Azure Databricks, Delta Lake, Delta Live tables, Auto Loader, and Databricks SQL.

Expertise with Azure Data Lake Storage (ADLS) Gen2 for optimized data storage and retrieval.

Strong knowledge of data modeling, ETL processes, and data warehousing concepts.

Experience with Power BI for dashboarding and reporting is a plus.

Familiarity with Azure Synapse for analytics and integration tasks is desirable.

Knowledge of Spark Streaming for real-time data stream processing is an advantage.

MLOps knowledge for integrating machine learning into production workflows is beneficial.

Familiarity with Azure Resource Manager (ARM) templates for infrastructure as code (IaC) practices is preferred.

Demonstrated expertise of 4-5 years in developing data ingestion and transformation pipelines using Databricks, Synapse notebooks, and Azure Data Factory.

Solid understanding and hands-on experience with Delta tables, Delta Lake, and Azure Data Lake Storage Gen2.

Experience in efficiently using Auto Loader and Delta Live tables for seamless data ingestion and transformation.

Proficiency in building and optimizing query layers using Databricks SQL.

Demonstrated experience integrating Databricks with Azure Synapse, ADLS Gen2, and Power BI for end-to-end analytics solutions.

Prior experience in developing, optimizing, and deploying Power BI reports.

Familiarity with modern CI/CD practices, especially in the context of Databricks and cloud-native solutions.

More Jobs at Apptad

MDM Developer with CDI & CAI

Noida

4 - 9 yrs

INR 20 - 35 Lacs

React Full stack developer

Gurugram

7 - 10 yrs

INR 15 - 25 Lacs

Aws Data Engineer ( Pyspark+ Python+ SQL)_ Bangalore

Pune, Bangalore Rural, Bengaluru

7 - 12 yrs

INR 20 - 22 Lacs

Java Back End Developer + AI For Apptad Technology _ PAN India

Bengaluru, Delhi / NCR, Mumbai (All Areas)

5 - 10 yrs

INR 15 - 25 Lacs

CDP Architect For Apptad Technology _Remote

Bengaluru

12 - 19 yrs

INR 30 - 45 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Azure Data Lake Interview Now

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

Apptad

IT Services and IT Consulting

Alpharetta Georgia

1001-5000 Employees

456 Jobs

Key People

John Doe

CEO
Jane Smith

CTO

Login to

Please Verify Your Phone or Email

Confirm Action

Search

Profile

Upskill and Grow with AI

SQL PySpark