Jobs
Interviews
Cynosure Corporate Solutions logo

Lead Data Engineer

8 - 13 years

9 - 19 Lacs

chennai

Posted:9 hours ago| Platform: Naukri logo

Apply

Skills Required

data lake data bricks python pyspark aws sql

Work Mode

Work from Office

Job Type

Full Time

Job Description

Responsibilities

  • Participate in the customers system design meetings and collect the functional/technical equirements.
  • Build up data pipelines for consumption by the Data Science team.
  • Experience with ETL process and tools.
  • Clear understanding and experience with Python and PySpark or Spark and SCALA, with HIVE, irflow, Impala, and Hadoop and RDBMS architecture.
  • Experience in writing Python programs and SQL queries.
  • Experience in SQL Query tuning.
  • Experienced in Shell Scripting (Unix/Linux).
  • Build and maintain data pipelines in Spark/PySpark with SQL and Python or SCALA.
  • Knowledge of Cloud (Azure/AWS/GCP, etc..) technologies.
  • Good to have knowledge of Kubernetes, CI/CD concepts, Apache Kafka.
  • Suggest and implement best practices in data integration.
  • Guide the QA team in defining system integration tests as needed.
  • Split the planned deliverables into tasks and assign them to the team.
  • Needs to Maintain/Deploy the ETL code and follow the Agile methodology.
  • Needs to work on optimization wherever applicable.
  • Good oral, written and presentation skills.

Requirements:

  • Degree in Computer Science, IT, or a similar field; a Masters is a plus.
  • Hands-on experience with Python and PySpark.
  • Hands-on experience with Spark and SCALA.
  • Great numerical and analytical skills.
  • Working knowledge of cloud platforms such as MS Azure, AWS, etc.
  • Technical expertise in data models, data mining, and segmentation techniques.

More Jobs at Cynosure Corporate Solutions

Business Development Executive

Chennai

Experience: Not specified

|

INR 2 - 2 Lacs

Production Engineer

Chennai

1 - 6 yrs
|

INR 1 - 2 Lacs

Development Engineer

Chennai

1 - 4 yrs
|

INR 1 - 2 Lacs

Quality Engineer

Chennai

Experience: Not specified

|

INR 1 - 2 Lacs

Senior Java Developer

Chennai

7 - 10 yrs
|

INR 25 - 30 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Google Play App Store
coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Cynosure Corporate Solutions logo
Cynosure Corporate Solutions

Consulting

Anytown

RecommendedJobs for You

Kadel Labs logo

Lead Data Engineer

Kadel Labs

udaipur

Thermo Fisher Scientific India logo

Lead Data Engineer

Thermo Fisher Scientific India

hyderabad

Cynosure Corporate Solutions logo

Lead Data Engineer

Cynosure Corporate Solutions

chennai

Cynosure Corporate Solutions logo

Lead Data Engineer

Cynosure Corporate Solutions

chennai

Cynosure Corporate Solutions logo

Lead Data Engineer

Cynosure Corporate Solutions

chennai

Cynosure Corporate Solutions logo

Lead Data Engineer

Cynosure Corporate Solutions

chennai

Ecolab Global Services logo

Lead Data Engineer

Ecolab Global Services

bengaluru

Lead Data Engineer

Coders Brain

bengaluru, karnataka, india

Maruti Techlabs logo

Lead Data Engineer

Maruti Techlabs

ahmedabad, gujarat, india

Lead Data Engineer

Dentsu

thane, maharashtra