Web Scraping Engineer

As a Web Scraping Engineer at noon, your primary responsibility will be to design and implement robust scrapers to collect, clean, and normalize product data from e-commerce platforms. You will play a crucial role in building, maintaining, and scaling data extraction systems to support our analytics and competitive pricing systems. Key Responsibilities: - Develop and maintain scalable scraping pipelines to extract structured data from complex, dynamic e-commerce sites. - Design and manage distributed scraping infrastructure, including rotating proxies and request throttling. - Handle dynamic rendering, anti-bot measures, and API integrations when necessary. - Implement data quality validation, normalization, and deduplication routines. - Optimize performance and reliability of scrapers with scheduling, retry logic, and monitoring. - Collaborate with data engineers and product teams to define data needs and integration workflows. - Ensure compliance with relevant site terms of service, data usage policies, and legal constraints. Qualifications Required: - 3+ years of professional experience in web scraping, data extraction, or automation. - Strong Python skills with libraries such as Scrapy, BeautifulSoup, Requests, or aiohttp. - Experience with proxy management and anti-bot evasion techniques. - Solid understanding of HTML, JavaScript, and network protocols like HTTP and REST. - Familiarity with GCP or AWS for deploying scalable scraping systems. - Experience with storing and processing data using MySQL, Elasticsearch, or S3. - Knowledge of distributed scraping frameworks like Scrapyd, Airflow, or Celery. - Experience with data pipelines or ETL design. - Familiarity with competitive pricing, catalog mapping, or e-commerce analytics. - Knowledge of Docker and CI/CD tools. If you resonate with our values of high standards, hard work, resourcefulness, and a bias for action, noon might be the perfect place for you. Adaptability, willingness to pivot, and a continuous learning mindset are key attributes for success in our team.,