Web Scraping Engineer

3 years

0 Lacs

Posted:1 day ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Job title: Web Scraping Engineer

Location: Gurgaon


About the Role

Web Scraping Engineer


The ideal candidate will design and implement robust scrapers to collect, clean, and normalize product data (pricing, availability, reviews, images, etc.) that power our analytics and competitive pricing systems.


What you'll do


  • Develop and maintain scalable scraping pipelines to extract structured data from complex, dynamic e-commerce sites (Amazon, etc.).
  • Design and manage distributed scraping infrastructure (e.g., rotating proxies, request throttling).
  • Handle dynamic rendering, anti-bot measures, and API integrations where applicable.
  • Implement data quality validation, normalization, and deduplication routines
  • Optimize performance and reliability of scrapers with scheduling, retry logic, and monitoring
  • Collaborate with data engineers and product teams to define data needs and integration workflows.
  • Maintain compliance with relevant site terms of service, data usage policies, and legal constraints.


What you'll need


  • 3+ years of professional experience in

    web scraping

    ,

    data extraction

    , or

    automation.

  • Strong Python skills with libraries such as

    Scrapy

    ,

    BeautifulSoup

    ,

    Requests

    , or

    aiohttp.

  • Experience with

    proxy management

    and

    anti-bot evasion

    (e.g., rotating IPs, user agents, cookies, CAPTCHA handling).
  • Solid understanding of

    HTML

    ,

    JavaScript

    , and

    network protocols (HTTP, REST)

    .
  • Familiarity with

    GCP or AWS

    for deploying scalable scraping systems.
  • Experience storing and processing data using

    MySQL

    ,

    Elasticsearch

    , or

    S3.

  • Experience scraping

    Amazon’s product pages (ASINs, listings, offers)

    and/or using

    Amazon Product Advertising API

    is

    strongly preferred

    .
  • Experience with

    distributed scraping frameworks

    (e.g., Scrapyd, Airflow, Celery).
  • Knowledge of

    data pipelines

    or

    ETL

    design.
  • Experience with

    competitive pricing

    ,

    catalog mapping

    , or

    e-commerce analytics.

  • Familiarity with

    Docker

    and CI/CD tools.


Who will excel?


  • We’re looking for people with high standards who understand that hard work matters.
  • You need to be relentlessly resourceful and operate with a deep bias for action.
  • We need people with the courage to be fiercely original.
  • noon is not for everyone; readiness to adapt, pivot, and learn is essential.


If the above values resonate with you, then noon might be the place for you!

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You

gurugram, haryana, india