Data Engineering Manager - Python & AI (7 to 12 yrs)

Data Engineering Manager Python & AI

Experience:

Location:

Mode of Engagement:

No of Positions:

Educational Qualification:

Industry:

Notice Period:

What We Are Looking For:

• 712 years of experience in managing

  end-to-end data engineering and delivery projects

  , including

  Python-based data scraping, ETL, and dashboarding

  .
• Proven experience in

  leading teams

  ,

  setting up complex data engineering projects

  , and establishing

  data pipelines

  integrating scraping, processing, and analytics.
• Hands-on proficiency in

  Python, SQL, ETL frameworks

  , and

  web scraping

  , with working knowledge of

  AI tools and automation frameworks

  like

  LangChain, LlamaIndex, or AutoGen

  .
• Experience with

  AWS, GitHub, CI/CD, Jira, ClickUp

  , and

  DevOps tools

  for delivery tracking, workflow automation, and performance optimization.

Responsibilities:

• Lead and manage multiple

  data engineering and AI-enabled delivery projects

  , ensuring scalability, performance, and high-quality outcomes.
• Architect and implement

  data pipelines and scraping systems

  using Python, Pandas, BeautifulSoup, or Scrapy, integrating

  AI-based automation

  where applicable.
• Collaborate with cross-functional teams Data Engineers, Python Developers, and Analysts to

  design, build, and optimize

  large-scale data systems and dashboards.
• Drive

  automation and AI adoption

  across projects to improve efficiency in

  scraping, transformation, and reporting workflows

  .
• Work closely with clients across

  IT, FinTech, E-commerce, and Healthcare

  domains to understand technical needs, plan delivery schedules, and ensure data integrity.
• Establish and monitor

  data quality, governance, and compliance

  standards throughout project execution.
• Mentor and guide team members on

  Python best practices, AI frameworks, and data engineering design patterns

  .
• Manage project timelines, status reporting, and delivery metrics using

  Jira, ClickUp, and CI/CD pipelines

  .

Qualifications:

• Bachelor's or master's degree in engineering, Computer Science, or related field.
• Strong hands-on expertise in

  Python, SQL, ETL, Advanced Excel, Power BI, and web scraping frameworks

  .
• Exposure to

  AI and automation frameworks

  (LangChain, LlamaIndex, AutoGen) preferred.
• Working knowledge of

  AWS

  ,

  GitHub

  ,

  DevOps (Docker, Kubernetes)

  , and

  workflow automation tools

  .
• Proven experience managing

  cross-functional data delivery teams

  and handling

  international client communication

  .
• Excellent analytical, leadership, and problem-solving skills.
• Project Management certifications (

  PMP, Agile, or Scrum Master

  ) are an added advantage.