Posted:2 hours ago|
Platform:
Work from Office
Full Time
We are seeking an experienced Web Scraping Engineer with deep expertise in Scrapy to develop, maintain, and optimize web crawlers. The ideal candidate will have a strong background in extracting, processing, and managing large-scale web data efficiently.
Responsibilities :
- Write and maintain web scraping scripts using Python Optimize custom web scraping tools and workflows.- Familiarity with Python and web scraping frameworks (Scrapy, Selenium, BeautifulSoup, Requests, Playwright).- Troubleshoot and resolve scraping challenges, including CAPTCHAs, rate limiting, and IP blocking.- Experience with proxy management (Rotating IPs, VPNs, Residential proxies, etc.)- Handle dynamic content using headless browsers and solve CAPTCHAs & IP bans.- Collaborate with senior developers to improve code quality and efficiency.Skills Required :
- Python and scraping libraries such as Scrapy and BeautifulSoup- Experience with proxy management, CAPTCHA bypass techniques, and anti-bot evasion.
- Ability to optimize crawlers for performance and minimize website detection risks.
- Strong background in databases and data storage systems .- Prior Experience of scraping large-scale E-Commerce websites would be plus.- Willingness to learn and take feedback constructively.- Excellent communication and leadership abilities.
Volody Product
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Instantly access job listings, apply easily, and track applications.
Practice Python coding challenges to boost your skills
Start Practicing Python Now
2.0 - 5.0 Lacs P.A.
hyderabad, pune, bengaluru
27.5 - 30.0 Lacs P.A.
27.5 - 30.0 Lacs P.A.
9.0 - 14.0 Lacs P.A.
2.0 - 5.0 Lacs P.A.
3.0 - 8.0 Lacs P.A.
3.0 - 4.0 Lacs P.A.
3.0 - 4.0 Lacs P.A.
4.0 - 9.0 Lacs P.A.
noida
4.0 - 9.0 Lacs P.A.
