TruFides AI

Role We are seeking a Python Web Scraping Intern to help build reliable, scalable scrapers that power our internal data pipelines. This role is ideal for someone who enjoys solving real-world scraping challenges—dynamic pages, anti-bot detections, proxy rotations, and more. Success in this role means you can independently build scrapers using Python + Playwright, implement stealth techniques, manage proxy systems, and deliver clean, structured data consistently. You will work closely with the engineering team and directly influence data flows across the organization. This role fits into our broader mission by strengthening the data ingestion layer that supports core AI and automation products. Responsibilities Develop high-quality web scrapers using Python and Playwright for dynamic and complex websites Implement proxy rotation, session management, headless/stealth techniques , and anti-bot mitigation strategies Design scraping workflows that are reliable, fault-tolerant, and easy to maintain Inspect network calls, handle authentication flows, detect content load triggers, and manage asynchronous scraping behavior Clean, transform, and structure scraped data for downstream ML/AI systems Collaborate with the engineering team to improve scraping reliability and performance Document scraper behavior, edge cases, and troubleshooting steps Qualifications Strong programming skills in Python Hands-on experience with Playwright (or Selenium with willingness to switch) Understanding of HTML/CSS selectors, DOM traversal, dynamic rendering, and browser automation Familiarity with proxy usage, rotation mechanisms, session spoofing, stealth browser techniques , and bypassing common anti-scraping measures Ability to debug selectors, timeouts, synchronization issues, and race conditions Comfortable working with Git and command-line tools Strong problem-solving mindset and attention to detail (Nice to have) Experience with async Python, Scrapy, or API integrations Additional Details Paid internship opportunity Duration: 2–6 months (flexible) Location: Remote or Bengaluru Strong potential for a PPO based on performance