Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Home
>
Jobs in bengaluru
>
Innoitus
>
Lead Data Engineer

Lead Data Engineer

Innoitus

5 - 10 years

10 - 14 Lacs

bengaluru

Posted:15 hours ago| Platform:

Apply

Skills Required

computer science cloud computing payroll tdd mysql agile scrum unit testing sql python

Work Mode

Work from Office

Job Type

Full Time

Job Description

What you will be doing:

Function as part of an Agile engineering team in the role of Lead Data Engineer, responsible for orchestrating and upholding the highest levels of Engineering and Enterprise Data Warehouse concepts and practices throughout the Software Development Life Cycle, collaborating closely with development, operations, and architecture teams.

Define delivery phases and perform project, task, and individual management duties for the team, setting activities, sub-activities, and milestones, while ensuring that development and delivery standards are rigorously enforced.

Manage and enhance Continuous Integration, Delivery, and Deployment processes, teams, and users to ensure high-quality and efficient delivery.

Collaborate closely with Engineering Managers and Business Analysts to produce accurate delivery estimates and oversee the transition from analysis through design to delivery.

Design and implement scalable data solutions using AWS services.

Design and implement data models for warehouse solutions.

Create and maintain Infrastructure as Code using CloudFormation.

Implement comprehensive unit testing strategies.

Work closely with cross-functional teams to gather requirements.

Mentor junior engineers on AWS best practices and data engineering concepts.

Participate in code reviews and technical discussions.

Document technical solutions and maintain knowledge base.

Deploy and troubleshoot solutions as needed, adhering to best practices throughout the development lifecycle to identify and resolve issues prior to deployment.

Plan, design, and develop cloud-based applications, analytical services, and platforms.

Ensure adherence to company security guidelines and requirements.

What We Are Looking For

An enthusiastic team member who fosters collaborative relationships, advocates for technical excellence, and adapts to evolving requirements within a dynamic team environment.

Demonstrates excellent communication and organizational skills, with a proactive approach to meeting deadlines and achieving project goals.

Proven experience as a Lead Data Engineer with expertise in Python and Spark.

Experience in CI/CD pipelines using GitHub and GitHub Actions to streamline development workflows.

Develop and maintain ETL pipelines using AWS Glue, Lambda, and EventBridge.

Manage data storage solutions across S3 and Redshift.

Implement security best practices using AWS IAM.

Experience with cloud computing services, particularly AWS ECS, RDS, EFS, S3, and Lambda, to build scalable and resilient applications.

Experience with database management including SQL (e.g., MySQL) and NoSQL (e.g., MongoDB), ensuring efficient data storage and retrieval.

Ensure code quality through SonarCloud integration.

Create and maintain Infrastructure as Code using CloudFormation.

In-depth knowledge of Test Driven Development (TDD) for data pipelines and Python.

Excellent container orchestration skills using Docker for efficient application deployment and management.

Strong understanding of Agile methodologies and practices (Kanban, XP, Scrum).

Excellent problem-solving and troubleshooting skills.

Process-oriented with strong documentation skills.

Bachelors degree in Computer Science or a related field, or equivalent work experience.

More Jobs at Innoitus

Business Development Manager

Bengaluru

5.0 - 10.0 yrs

INR 5 - 15 Lacs

Accountant

mumbai

5.0 - 10.0 yrs

Salary: Not disclosed

Relationship Manager

bengaluru

6.0 - 11.0 yrs

INR 8 - 13 Lacs

Tele Collection Professional

bengaluru

6.0 - 11.0 yrs

INR 8 - 13 Lacs

City Head / Team Leader

jodhpur

5.0 - 10.0 yrs

INR 7 - 12 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.