Web Scraping Specialist

Job Title:

Experience:

Location:

Employment Type:

About the Role:

Web Scraping Specialist

Key Responsibilities:

·        Develop, optimize, and maintain web-scraping spiders using Python and Scrapy.

·        Write clean, scalable, and modular Python code for scraping workflows.

·        Analyze website structures and implement effective scraping strategies using HTML, XPath, and CSS selectors.

·        Extract, clean, transform, and structure data for internal use.

·        Implement proxy rotation, captcha handling, and anti-bot bypass techniques.

·        Monitor scraping jobs, debug issues, and ensure timely data delivery.

·        Collaborate with internal teams to understand data needs and deliver accurate datasets.

Required Skills & Qualifications:

• 1–4 years of experience in web scraping.
• Strong hands-on experience with

  Scrapy

  .
• Proficient in Python programming and data formats (JSON, XML, CSV).
• Good understanding of HTML, CSS selectors, XPath, and HTTP protocols.
• Experience with Selenium/Playwright for dynamic websites.
• Experience with APIs, databases (SQL/NoSQL), and automation workflows.
• Familiarity with Git and basic Linux commands.

Nice to Have:

• Knowledge of Azure/AWS, Docker, or cloud deployment of scraping jobs.
• Experience managing scraping at scale using schedulers or pipelines.