Python Automation & Web Scraping Engineer (2 to 4 yrs)

Python Automation & Web Scraping Engineer (WFH)

Experience:

Location:

Mode of Engagement:

No of Positions:

Educational Qualifications:

Industry:

Notice Period:

What We Are Looking For:

• Strong hands-on experience in

  Python

  for automation and mid-scale web scraping projects.
• Experience with

  Selenium, BeautifulSoup, Requests

  , and automation-driven scraping workflows.
• Good understanding of

  HTML, CSS, DOM structures

  , and dynamic/JavaScript-rendered websites.
• Experience in backend/API development using

  Flask or Django

  .
• Ability to handle

  cookies, sessions, authentication flows, headers

  , and basic anti-bot mechanisms.
• Strong skills in debugging, error handling, data cleaning, and optimization of scraping pipelines.

Key Responsibilities:

• Develop, maintain, and optimize

  Python-based scraping scripts and automation pipelines

  .
• Extract data from both static and dynamic websites, including sites requiring browser automation.
• Manage

  pagination, login/authentication

  , and session-based scraping workflows.
• Build and maintain

  REST APIs

  using Flask/Django to integrate data and automation services.
• Implement data pipelines for cleaning, transforming, and storing outputs (CSV, Excel, JSON, DB).
• Work with

  MySQL, PostgreSQL, MongoDB, Redis

  for structured and unstructured data storage.
• Use

  Docker

  for containerizing automation modules and assist in basic cloud deployments.
• Troubleshoot failures, implement retry/recovery logic, and ensure high accuracy of extracted data.
• Maintain documentation, logging, and monitoring for all scraping and automation tasks.

Qualifications:

• Solid programming experience in

  Python

  .
• Hands-on experience with

  Selenium, BeautifulSoup, Requests

  (Playwright/Scrapy optional but good to have).
• Understanding of

  HTTP, APIs, headers, cookies, sessions

  , and basic browser automation concepts.
• Experience with backend frameworks like

  Flask or Django

  .
• Familiarity with

  Docker

  and Git-based workflows.
• Knowledge of relational and non-relational databases (MySQL/PostgreSQL/MongoDB/Redis).
• Strong debugging, optimization, and troubleshooting abilities.