Web Scraper Developer – Beauty E-commerce (Nykaa, Tira, Purplle)

Location: Remote / Flexible
Job Type: Contract / Freelance / Full-time (open for discussion)

About the Role

We are looking for an experienced Web Scraper Developer to build and maintain robust scrapers for leading Indian beauty platforms (Nykaa, Tira Beauty, and Purplle). The scrapers should be designed for scalability, stealth, and resilience, ensuring smooth operation even when websites update their structures.

You will be responsible for architecting, coding, and optimizing scrapers that can handle large volumes of product data quickly and efficiently, with minimal downtime and easy maintainability.

Responsibilities

• Design and implement scrapers for Nykaa, Tira Beauty, and Purplle to extract product listings, prices, descriptions, ingredients, and availability.
• Ensure scrapers are modular and resilient to DOM/classname changes (easy fixes with minimum effort).
• Implement anti-bot evasion techniques (stealth browsing, rotating proxies, headless browsing, rate limiting, retries).
• Enable multi-worker/concurrent scraping for faster data collection.
• Optimize for speed and low resource usage.
• Create simple configurations or scripts to quickly update/fix selectors when sites change layouts.
• Implement logging, error handling, and monitoring for scraper reliability.
• Deliver clean, well-documented code with clear setup instructions.

Requirements

• Strong hands-on experience with Python (Scrapy, Playwright, Selenium, BeautifulSoup, Requests) or Node.js (Puppeteer, Playwright, Axios, Cheerio).
• Familiarity with stealth scraping techniques: proxy rotation, headless browsing, human-like request simulation.
• Experience in building scalable scraping systems with multiple workers/threads.
• Knowledge of data storage pipelines (MySQL, PostgreSQL, MongoDB, or even CSV/JSON).
• Ability to build scrapers that are resilient to frequent site changes.
• Good debugging and problem-solving skills.

Nice to Have

• Experience with cloud deployment (AWS, GCP, Azure, or VPS environments).
• Prior work on e-commerce scraping.
• Understanding of product data normalization (brands, categories, pricing).

What We Offer

• Flexible working hours (remote).
• Competitive compensation (hourly/project-based or retainer).
• Long-term opportunity to manage and scale scraping pipelines for multiple platforms.

Job Types: Part-time, Internship, Contractual / Temporary, Freelance
Contract length: 24 months

Pay: ₹10,000.00 - ₹20,000.00 per month

Expected hours: 20 per week

Experience:

• Web Scraping: 2 years (Required)