C

Senior Data Engineer

cEpoch

5 years

5 - 17 Lacs

Hyderabad

Posted:4 days ago

Apply

Job Description

We are looking for an experienced Data migration Engineer / Senior Data Engineer with strong hands-on expertise in SSIS, PySpark, SQL, Databricks, and ETL development. The ideal candidate should have experience in data migration, data pipeline development, performance optimization, and modernizing legacy ETL processes.

Hands-on SSIS experience is mandatory. Candidates should also have practical experience working with Databricks and PySpark to build, maintain, and optimize scalable data engineering solutions.

Key Responsibilities

  • Design, develop, and maintain robust ETL/ELT pipelines using SSIS, PySpark, SQL, and Databricks.
  • Develop and optimize data processing workflows using Databricks Workflows and Delta Live Tables (DLT).
  • Perform SSIS migration and modernization of existing ETL processes to modern data platforms.
  • Write and optimize Spark SQL queries for large-scale data processing.
  • Develop and maintain data integration solutions, including legacy ColdFusion ETL processes where applicable.
  • Implement data transformation, validation, reconciliation, and quality checks.
  • Troubleshoot performance bottlenecks and optimize data pipelines, SQL queries, and Spark jobs.
  • Schedule and orchestrate data pipelines using Airflow and Databricks Workflows.
  • Implement CI/CD practices for data engineering workflows and deployments.
  • Collaborate with business analysts, architects, QA teams, and other stakeholders to deliver reliable data solutions.

Mandatory Skills

  • 5+ years of overall experience in data engineering, ETL development, or related roles.
  • Strong hands-on experience with SSIS (SQL Server Integration Services) – mandatory.
  • Strong proficiency in SQL and query optimization.
  • Hands-on experience with PySpark and Apache Spark.
  • Practical experience with Databricks and data pipeline development.
  • Experience in ETL development, data migration, and performance tuning.

Pay: ₹510,000.00 - ₹1,700,000.00 per year

Benefits:

  • Paid time off

Application Question(s):

  • 2. How many years of hands-on experience do you have with SSIS (SQL Server Integration Services)?
  • Do you have hands-on experience developing and maintaining SSIS packages?
  • How many years of hands-on experience do you have with PySpark?
  • Have you worked on SSIS migration or modernization of legacy ETL pipelines?
  • Are you immediate joiner ?
  • What is your ctc and expected ctc ?

Work Location: In person

Skills Required

Data Migration Ssis Pyspark SQL ETL Development Data Pipeline Performance Optimization ETL Data Engineering Data Processing Spark SQL Queries

Learn the skills this job asks for

See your skill gap for Data Engineer →

Free courses, interview questions and practice for each skill.

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
C
cEpoch

RecommendedJobs for You

Hiringhood logo

Hyderabad

bebo Technologies logo

Senior Data Engineer

bebo Technologies

Chandigarh

Cognite logo

Bengaluru

360 Technology logo

Senior Data Engineer

360 Technology

Bengaluru

R

Bengaluru

Commvault logo

Bengaluru

Unisys logo

Hyderabad