Lead Data Engineer

5.0 - 10.0 years

6 - 11 Lacs

Bengaluru

Posted:1 day ago| Platform: Naukri logo

Apply Now

Skills Required

python version control kafka cloud formation aws agile jvm cloud services api gateway eks data engineering docker sql java lambda expressions aws cloud devops real time pcr sns terraform software engineering aws agile methodology interface design

Work Mode

Work from Office

Job Type

Full Time

Job Description

Req ID: 306669 We are currently seeking a Lead Data Engineer to join our team in Bangalore, Karntaka (IN-KA), India (IN). Position Overview We are seeking a highly skilled and experienced Lead Data/Product Engineer to join our dynamic team. The ideal candidate will have a strong background in streaming services and AWS cloud technology, leading teams and directing engineering workloads. This is an opportunity to work on the core systems supporting multiple secondary teams, so a history in software engineering and interface design would be an advantage. Key Responsibilities Lead and direct a small team of engineers engaged in - Engineering reuseable assets for the later build of data products - Building foundational integrations with Kafka, Confluent Cloud and AWS - Integrating with a large number of upstream and downstream technologies - Providing best in class documentation for downstream teams to develop, test and run data products built using our tools - Testing our tooling, and providing a framework for downstream teams to test their utilisation of our products - Helping to deliver CI, CD and IaC for both our own tooling, and as templates for downstream teams Required Skills and Qualifications - Bachelor's degree in Computer Science, Engineering, or related field - 5+ years of experience in data engineering - 3+ years of experience with real time (or near real time) streaming systems - 2+ years of experience leading a team of data engineers - A willingness to independently learn a high number of new technologies and to lead a team in learning new technologies - Experience in AWS cloud services, particularly Lambda, SNS, S3, and EKS, API Gateway - Strong experience with Python - Strong experience in Kafka - Excellent understanding of data streaming architectures and best practices - Strong problem-solving skills and ability to think critically - Excellent communication skills to convey complex technical concepts both directly and through documentation - Strong use of version control and proven ability to govern a team in the best practice use of version control - Strong understanding of Agile and proven ability to govern a team in the best practice use of Agile methodologies Preferred Skills and Qualifications - An understanding of cloud networking patterns and practises - Experience with working on a library or other long term product - Knowledge of the Flink ecosystem - Experience with terraform - Experience with CI pipelines - Ability to code in a JVM language - Understanding of GDPR and the correct handling of PII - Knowledge of technical interface design - Basic use of Docker

Mock Interview

Boost Confidence & Sharpen Skills

Start Python Interview Now
NTT DATA, Inc.
NTT DATA, Inc.

IT Services and IT Consulting

Tokyo Plano +

10001 Employees

1441 Jobs

    Key People

  • Denise S. Kinsley

    CEO
  • Ryuhei Sakamoto

    President and CEO of NTT DATA Corporation

RecommendedJobs for You

Bangalore Urban, Karnataka, India

Hyderabad, Telangana, India