1 Anti-Blocking Techniques Jobs

Setup a job Alert
JobPe aggregates results for easy application access, but you actually apply on the job portal directly.

OSI Digital logo
Data Engineer OSI Digital

3.0 - 5.0 years

0 Lacs

hyderabad, telangana, india

On-site

We are looking for a skilled Web Crawling Engineer with strong expertise in Python and hands-on experience building scalable crawlers and scrapers. The ideal candidate should have deep knowledge of crawling frameworks, anti-blocking techniques, and proxy management, along with experience solving challenges like captchas and rate-limiting. Key Responsibilities Design, develop, and maintain scalable and efficient web crawlers for data extraction. Work with Scrapy, Requests, and other Python libraries to implement crawling solutions. Handle anti-scraping measures, including IP blocks, rate limits, and captchas. Implement and manage proxy rotation and session management strategies. Ensure high-q...

Posted 1 day ago

AI Match Score
Apply
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Google Play App Store

Featured Companies

View All Companies