Associate Software Developer

Role & responsibilities

• Develop and maintain web scraping scripts using Python.
• Extract relevant data from websites based on business and project requirements.
• Work with libraries such as BeautifulSoup, Requests, Selenium, and Scrapy.
• Analyze website structures, HTML, CSS selectors, and XPath to identify relevant data elements.
• Handle pagination, cookies, sessions, headers, and basic API requests.
• Identify and resolve scraping errors, data inconsistencies, and website changes.
• Perform data validation and quality checks to ensure accuracy and completeness.
• Maintain existing scripts and troubleshoot issues in scheduled scraping jobs.
• Coordinate with team leads and QA teams to meet project requirements and delivery deadlines.
• Document scripts, issues, and process updates.

Preferred candidate profile

• Basic to intermediate knowledge of Python programming.
• Understanding of HTML, CSS, XPath, and web page structures.
• Hands-on experience with BeautifulSoup and Requests.
• Basic knowledge of Selenium or Scrapy.
• Understanding of JSON, APIs, HTTP requests, and response codes.
• Familiarity with SQL and databases is an advantage.
• Basic knowledge of Git or version control is preferred.
• Good analytical, debugging, and problem-solving skills.
• Willingness to learn new tools, technologies, and website-specific scraping techniques.