Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Home
>
Jobs in india
>
K&K Talents - India
>
Big Data Engineer

Big Data Engineer

K&K Talents - India

8 years

0 Lacs

india

Posted:3 hours ago| Platform:

Apply

Skills Required

data recruiting scala azure processing design support analytics databricks adf spark etl integration pyspark storage sql nosql kafka reliability devops jenkins ml query security compliance agile code documentation apache tuning nifi talend sqoop airflow git linux powershell mongodb learning certifications

Work Mode

On-site

Job Type

Full Time

Job Description

K&K Talents

Title: Big Data Engineer (Scala & Spark)

Location: PAN India (Hybrid)

Employment Type: Permanent

Notice Period: 15 Days

Required Experience: 8 Years and above

Role

Senior Data Engineer

Responsibilities

Design and build
scalable, high-performance data pipelines
using Azure Databricks, ADF, and Spark.
Develop and optimize
Spark (Scala/PySpark) jobs
for large-volume data processing and transformation.
Manage and integrate data from diverse sources including
ADLS, Blob Storage, SQL databases, NoSQL stores, and streaming platforms
.
Implement and support
real-time data streaming
using Kafka, Spark Streaming, or Flink.
Create and maintain
ETL workflows
, ensuring data quality, reliability, and consistency.
Work with
Azure Synapse Analytics, Snowflake, or BigQuery
for warehousing and analytics solutions.
Build and maintain
CI/CD pipelines
using Azure DevOps/Jenkins for automated deployments.
Collaborate with data architects, analysts, and data scientists to enable analytics, ML workflows, and business insights.
Optimize query performance, storage, cost, and compute usage across pipelines and cloud environments.
Ensure
data governance
, security, lineage, and compliance best practices are followed.
Participate in Agile processes, code reviews, documentation, and production support.

Skills & Experience

7–12 years of hands-on experience as a
Data Engineer
or
Big Data Engineer
.
Strong hands-on experience with
Azure cloud
, including:
Azure Databricks
Azure Data Factory (ADF)
Azure Data Lake Storage (ADLS/Gen2)
Azure Synapse/SQL
Expert-level proficiency in
Apache Spark
, Spark SQL, PySpark, or Scala.
Experience with
Kafka, Spark Streaming, or Flink
for streaming pipelines.
Strong SQL skills with experience in
performance tuning and query optimization
.
Hands-on experience with
ETL tools
(ADF, NiFi, Talend, Sqoop, Airflow, etc.).
Good understanding of
data modeling
, warehouse concepts, and distributed systems.
Proficiency with
Git, Azure DevOps, Jenkins
, or similar CI/CD tools.
Strong background in
Linux/Unix
, Bash/PowerShell scripting.
Experience with
Snowflake, BigQuery, or other cloud DWH
solutions is a plus.
Familiarity with
NoSQL
technologies (MongoDB, HBase, Cassandra, Cosmos DB).

Preferred Qualifications

Experience in
on-premise to cloud migration
projects.
Exposure to
machine learning feature pipelines
or MLOps workflows.
Knowledge of
data governance
, security practices, and metadata/catalog tools.
Certifications in
Azure Data Engineer
or related cloud technologies.

More Jobs at K&K Talents - India

SAP CPI Consultant

India

Experience: Not specified

Salary: Not disclosed

SAP Security Analyst

India

7.0 - 7.0 yrs

Salary: Not disclosed

Lead SAP OpenText ECM Consultnat

India

12.0 - 12.0 yrs

Salary: Not disclosed

SAP SuccessFactor EC Design Lead

India

12.0 - 12.0 yrs

Salary: Not disclosed

SAP Open Text – VIM

India

14.0 - 14.0 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.