Web Scrapping - Python

Location: Gurgaon

About Nitro Commerce

Nitro Commerce is a Series A AdTech startup redefining how India’s fastest-growing D2C brands acquire and retain customers in a privacy-first, cookieless world. Founded in 2023 by the team behind Wigzo (acquired by Shiprocket), Nitro is building India’s first Revenue-as-a-Service stack with:

● NitroX → Cookieless measurement & first-party identity resolution.

● Nitro Ads → Commerce media & performance marketing, powered by NitroX data.

With 2,200+ D2C brands already onboarded and 200+ brands actively running campaigns on Nitro Ads, we’re rapidly emerging as the go-to partner for commerce media in India.

What You’ll Do — Key Responsibilities

● Develop and maintain web scraping pipelines to collect data from a variety of sources (e.g. e-commerce sites, competitor sites, public data sources, marketplaces, product catalogs, etc.).

● Extract structured data (product details, pricing, reviews, metadata, inventory status, competitor pricing, category hierarchies, etc.) and store in internal databases for analysis/use.

● Respectfully handle unstructured data — include cleaning, normalization, deduplication, and transformation into usable formats (JSON, CSV, relational DB, etc.).

● Ensure scraping infrastructure is robust: handles rate-limiting, bot-detection, CAPTCHAs; follow best practices to avoid IP-blocking, implement proxy rotation, delay strategies, etc.

● Monitor data quality and pipeline health: validate data correctness, completeness, consistency; alert/resolve errors.

● Work closely with Analytics, Product, and Engineering teams to feed scraped data into marketing intelligence, competitor benchmarking, trend analysis, pricing optimization, and custom dashboards.

● Document scraping processes, data schemas, pipelines, and update logs for reproducibility and auditability.

● Stay updated on legal/ethical guidelines for web scraping, data privacy, compliance — ensure all data collection adheres to relevant laws and company policies.

What We’re Looking For — Candidate Profile

● Proven experience in web scraping / data extraction / web crawling / data engineering.

● Strong programming skills — ideally in languages like Python (with libraries such as BeautifulSoup, Scrapy, Selenium), or similar tools.

● Familiarity with HTTP, web protocols, parsing HTML/JSON/XML, handling JavaScript heavy sites, headless browsers, proxies, CAPTCHAs, etc.

● Experience designing and maintaining reliable, scalable scraping pipelines (scheduling, logging, error handling, retries, proxy management).

● Ability to clean, process, and transform raw data into structured, usable datasets.

● Basic knowledge of databases (SQL / NoSQL), data storage formats, data modelling.

● Attention to detail, ability to spot and correct data quality issues.

● Understanding of ethical & legal implications of data scraping, compliance with data protection laws.

● Good communication skills — able to collaborate with cross-functional teams (engineering, product, analytics, ops).

● Self-motivated, proactive, comfortable working in a fast-paced startup environment.

Preferred / Good-to-Have

● Prior experience working for e-commerce/MarTech/data-driven startups.

● Familiarity with pricing-monitoring, competitor-analysis, e-commerce product taxonomy.

● Experience with cloud infrastructure, CI/CD, containerization (Docker), scheduling (cron, airflow), scalable data pipelines.

● Basic scripting/automation for ETL, data ingestion, scheduled jobs.

What You’ll Get — What Nitro Offers

● Opportunity to build data infrastructure for a fast-growing AI-driven commerce-tech startup.

● Work with cross-functional teams to power marketing automation, personalization, competitor intelligence, and growth tools.

● Exposure to real-world e-commerce data — product catalogs, competitor pricing, market trends — helping brands scale intelligently.

● Startup culture: flexibility, ownership, fast decision-making, potential to grow responsibilities quickly.

● Competitive compensation and growth opportunities (as per role, experience).