Automation Engineer

About the Role:

building web scrapers

Responsibilities:

• Build and maintain robust web scraping solutions across various websites and platforms.
• Develop and optimize Selenium-based automation scripts for high reliability and speed.
• Leverage AI models and frameworks to design autonomous agents for workflow and task automation.
• Ensure scalability, error handling, and long-term maintainability of scraping and automation systems.
• Collaborate closely with internal teams to understand evolving data extraction and automation needs.
• Stay current with industry best practices in scraping defenses, AI agents, and Python advancements.

Requirements:

• 3+ years of hands-on experience building production-grade web scrapers.
• Strong proficiency in

  Python

  and libraries like

  Selenium

  ,

  BeautifulSoup

  ,

  Scrapy

  , etc.
• Experience designing or implementing

  AI-based automation agents

  (using frameworks like LangChain, OpenAI, or similar).
• Deep understanding of headless browser operations, CAPTCHAs, proxies, and evasion techniques.
• Solid debugging, testing, and optimization skills.
• Comfort working in a fast-paced, self-directed environment.

Bonus Points:

• Experience with browser automation frameworks beyond Selenium (e.g., Playwright).
• Familiarity with cloud-based scraping infrastructure (e.g., AWS Lambda, Dockerized scraping).
• Knowledge of reinforcement learning or AI autonomy systems.