Job
Description
As a Python Developer and Web Scraping Specialist at our company, you will be responsible for designing and implementing efficient, scalable web crawlers to extract structured data from various websites and online platforms. You should have at least 1 year of experience in Python programming and hands-on knowledge of web scraping tools and techniques. Key Responsibilities: - Design, build, and maintain web scraping scripts and crawlers using Python. - Utilize tools such as BeautifulSoup, Selenium, and Scrapy to extract data from dynamic and static websites. - Clean, structure, and store extracted data in usable formats (e.g., CSV, JSON, databases). - Handle data parsing, anti-scraping measures, and ensure scraping compliance with website policies. - Monitor and troubleshoot scraping tasks for performance and reliability. - Collaborate with team members to understand data requirements and deliver accurate, timely results. - Optimize scraping scripts for speed, reliability, and error handling. - Maintain documentation of scraping processes and codebase. Required Skills: - Solid programming skills in Core Python and data manipulation. - Strong experience in Web Scraping using BeautifulSoup, Selenium, and Scrapy. - Familiarity with HTTP protocols, request headers, cookies, and browser automation. - Understanding of HTML, CSS, and XPath for parsing and navigating web content. - Ability to handle and solve CAPTCHA and anti-bot mechanisms. - Experience with data formats like JSON, XML, and CSV. - Knowledge of version control tools like Git. Preferred Qualifications: - Bachelors degree in Computer Science, IT, or a related field. - Experience with task schedulers (e.g., CRON, Celery) for automated scraping. - Knowledge of storing data in SQL or NoSQL databases. - Familiarity with proxy management and user-agent rotation. Education: - Bachelor's degree is required. Experience: - Python: 1 year - BeautifulSoup or Scrapy: 1 year - Selenium: 1 year (Preferred) Location: - Jaipur, Rajasthan Note: This job is full-time and requires you to reliably commute or plan to relocate to Jaipur, Rajasthan before starting work. As a Python Developer and Web Scraping Specialist at our company, you will be responsible for designing and implementing efficient, scalable web crawlers to extract structured data from various websites and online platforms. You should have at least 1 year of experience in Python programming and hands-on knowledge of web scraping tools and techniques. Key Responsibilities: - Design, build, and maintain web scraping scripts and crawlers using Python. - Utilize tools such as BeautifulSoup, Selenium, and Scrapy to extract data from dynamic and static websites. - Clean, structure, and store extracted data in usable formats (e.g., CSV, JSON, databases). - Handle data parsing, anti-scraping measures, and ensure scraping compliance with website policies. - Monitor and troubleshoot scraping tasks for performance and reliability. - Collaborate with team members to understand data requirements and deliver accurate, timely results. - Optimize scraping scripts for speed, reliability, and error handling. - Maintain documentation of scraping processes and codebase. Required Skills: - Solid programming skills in Core Python and data manipulation. - Strong experience in Web Scraping using BeautifulSoup, Selenium, and Scrapy. - Familiarity with HTTP protocols, request headers, cookies, and browser automation. - Understanding of HTML, CSS, and XPath for parsing and navigating web content. - Ability to handle and solve CAPTCHA and anti-bot mechanisms. - Experience with data formats like JSON, XML, and CSV. - Knowledge of version control tools like Git. Preferred Qualifications: - Bachelors degree in Computer Science, IT, or a related field. - Experience with task schedulers (e.g., CRON, Celery) for automated scraping. - Knowledge of storing data in SQL or NoSQL databases. - Familiarity with proxy management and user-agent rotation. Education: - Bachelor's degree is required. Experience: - Python: 1 year - BeautifulSoup or Scrapy: 1 year - Selenium: 1 year (Preferred) Location: - Jaipur, Rajasthan Note: This job is full-time and requires you to reliably commute or plan to relocate to Jaipur, Rajasthan before starting work.
