Python Automation Engineer

Web Scraping Developer

Key Responsibilities

• Design, develop, and maintain scalable scrapers/crawlers for e-commerce websites.
  
• Extract structured data such as product listings, pricing, descriptions, reviews, and rankings.
  
• Handle dynamic content, cookies, pagination, AJAX, and anti-bot challenges efficiently.
  
• Ensure data accuracy, integrity, and scalability of scraping pipelines.
  
• Optimize scraping speed and manage proxies, request throttling, and retries.
  
• Collaborate with cross-functional teams to integrate extracted data into downstream systems.
  
• Document processes, maintain code quality, and ensure reusability and scalability.
  

Required Skills & Technologies

• Strong proficiency in

  Python

  .
• Hands-on experience with

  Scrapy, Selenium, Playwright, Beautiful Soup (bs4)

  .
• Expertise in handling JavaScript-heavy websites, AJAX requests, CAPTCHAs, and anti-bot systems.
  
• Experience with API-based data extraction.
  
• Strong understanding of e-commerce data structures (product catalogs, pricing, reviews, rankings).
  
• Excellent debugging and optimization skills for scrapers/crawlers.
  

Qualifications

• Minimum

  2 years of professional experience

  in Python with a strong focus on web scraping.
• At least

  one end-to-end project

  involving building scrapers/crawlers for e-commerce or quick-commerce platforms.
• Bachelors degree in Computer Science, Engineering, or related field (preferred, not mandatory).
  

Nice to Have

• Experience with

  proxy management, headless browsers, and captcha-solving techniques

  .
• Knowledge of cloud platforms (AWS, GCP, Azure) for deploying scalable scrapers.
  
• Familiarity with databases such as

  MySQL, MongoDB, PostgreSQL

  for storing extracted data.