Job
Description
Job Summary: We are looking for a skilled Python Developer with strong expertise in web scraping and data extraction. You will be responsible for designing and maintaining scalable scraping systems, handling large volumes of data, and ensuring data accuracy and integrity from various online sources. Responsibilities: Develop and maintain Python scripts for scraping structured and unstructured data from websites and APIs. Build robust, scalable, and efficient scraping solutions using libraries such as BeautifulSoup, Scrapy, Selenium, or Playwright. Monitor and optimize scraping performance and manage data pipelines. Handle website structure changes, anti-bot protections, and CAPTCHA bypassing when necessary. Store, clean, and normalize scraped data using databases (e.g., PostgreSQL, MongoDB) or cloud solutions. Collaborate with data analysts, engineers, and product managers to define data needs and deliver insights. Ensure compliance with legal and ethical standards of data collection. Required Skills: · Strong proficiency in Python, especially in web scraping. · Solid understanding of HTML, CSS, JavaScript, HTTP protocols, and browser behavior. · Familiarity with RESTful APIs, JSON, and XML. · Experience working with databases (SQL or NoSQL). · Basic knowledge of cloud platforms (AWS, GCP, or Azure) and containerization (Docker) is a plus. Preferred Qualifications: · Bachelor's degree in Computer Science, Information Technology, or related field. · Experience handling large-scale scraping projects. · Background in using version control systems (e.g., Git). · Understanding of data privacy laws (e.g., GDPR, CCPA). Job Type: Full-time Pay: ₹25,000.00 - ₹30,000.00 per month Benefits: Health insurance Leave encashment Paid sick time Paid time off Provident Fund Schedule: Day shift Experience: Data visualization: 1 year (Required) Work Location: In person
