Technical Lead

5 - 10 years

7 - 12 Lacs

Posted:6 days ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

Internet Brands is seeking a Lead Data Engineer to drive the development and optimization of data pipelines that power our AI-driven Legal content platforms. This role sits within the Content Ingestion function of the AI team, which enables scalable and intelligent ingestion, normalization, and enrichment of legal data across multiple brands and data sources.
As the Lead Data Engineer, you ll architect, build, and maintain robust data pipelines and systems that support our AI models, fueling Legal content understanding, recommendation systems, and generative AI workflows. You ll collaborate closely with Data Scientists, AI Engineers, and Product Managers to ensure that high-quality, structured, and compliant data powers every stage of our Legal AI ecosystem.

Key Responsibilities

  • Lead the design and development of scalable data ingestion and processing frameworks for structured, semi-structured, and unstructured Legal data (e.g., case law, firm profiles, practice area articles, contracts).
  • Oversee the end-to-end content ingestion lifecycle, from source identification and ETL pipeline design to normalization, metadata tagging, and delivery into AI data lakes.
  • Collaborate cross-functionally with AI Research, ML Ops, and Legal Product teams to support downstream model training, data labeling, and retrieval-augmented generation (RAG) pipelines.
  • Implement data quality and observability frameworks to ensure accuracy, completeness, and freshness of ingested content.
  • Evaluate and integrate third-party APIs, crawlers, and ingestion tools for large-scale legal content aggregation and compliance.
  • Partner with Legal and Compliance teams to ensure data governance and security standards are met, particularly for sensitive or proprietary data.
  • Continuously optimize pipeline performance, cost efficiency, and scalability across cloud environments (e.g., AWS, GCP, or Azure).

Qualifications Required:

  • Bachelor s or Master s degree in Computer Science, Data Engineering, or a related technical field.
  • 5+ years of experience in data engineering.
  • Deep expertise with Python, SQL, and modern ETL frameworks (e.g., Airflow, dbt, Dagster, Luigi).
  • Strong experience building and maintaining data pipelines.
  • Experience with unstructured data ingestion and processing, including text, media, PDFs, and web content.
  • Proficiency in data modeling, data quality frameworks, and metadata management.
  • Familiarity with ML/AI workflows, such as dataset preparation for LLMs or model fine-tuning.

Preferred:

  • Experience in the Legal, Compliance, or Professional Services domain.
  • 2+ years in a lead or senior data engineering role
  • Familiarity with vector databases (e.g., Pgvector, Pinecone, Weaviate, FAISS) and LLM data preparation (tokenization, chunking, RAG).
  • Knowledge of NLP pipelines (e.g., spaCy, Hugging Face Transformers) or document understanding frameworks.
  • Hands-on experience with data cataloging and lineage tools (e.g., DataHub, Amundsen).
  • Demonstrated leadership in establishing data engineering best practices, CI/CD for data, and team mentoring.

Why Join Internet Brands

  • Be part of an AI-first transformation driving innovation across one of the largest Legal information networks.
  • Collaborate with cross-functional AI experts in ML, NLP, and content intelligence.
  • Work in a culture that values autonomy, experimentation, and technical excellence.

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Webmd Guru logo
Webmd Guru

Healthcare Information

Healthtown

RecommendedJobs for You

bengaluru, delhi / ncr, thiruvananthapuram

mumbai, maharashtra, india