Jobs
Interviews

1 Spidermon Jobs

Setup a job Alert
JobPe aggregates results for easy application access, but you actually apply on the job portal directly.

3.0 - 8.0 years

5 - 15 Lacs

Pune

Work from Office

Interested candidates may share their profiles at gauri.shedge@ambitsoftware.com Below is the Job Description for your reference: Roles & Responsibilities: Design, develop and maintain Scrapy web crawlers. Leverage the platform and open-source projects to perform distributed information extraction, retrieval, and data processing. Identify and resolve performance and scalability issues with distributed crawling at scale. Help identify, debug and fix problems with open source projects, including Scrapy. Requirements: 3+ years of software development experience in Python. Solid Python knowledge. Familiarity with Linux/UNIX, HTTP, HTML, JavaScript, and Networking. Good communication skills in written and spoken English. Availability to work full time. Bonus points for: Scrapy experience is a big plus. Familiarity with techniques and tools for crawling, extracting, and processing data (e.g., Scrapy, NLTK, pandas, scikit-learn, mapreduce, NoSQL, etc). Proficient English. Tech Stack Elements: Python / Javascript, Scrapy, AI Spider Templates, Page Objects, Spidermon, API(+ Extraction) and Scrapy Cloud. HTML/CSS, HTTP and web protocols, Javascript and Dynamic content. Data cleaning and processing, data storage, workflow automation. IP rotation and proxies, user-agent rotation, captcha handling, rate limiting / throttling, device fingerprinting obfuscation.

Posted 1 month ago

Apply
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Featured Companies