Senior Python Developer - Web Scraping & Automation

You are sought after for the role of Senior Python Developer with expertise in web scraping and automation. Your responsibilities will include designing, developing, and optimizing large-scale scraping solutions using Scrapy and collaborating with various teams to ensure timely delivery. - Design, develop, and maintain scalable web scraping frameworks using Scrapy. - Utilize additional libraries/tools like BeautifulSoup, Selenium, Playwright, Requests, etc. - Implement robust error handling, data parsing, and storage mechanisms. - Build and optimize asynchronous scraping workflows, handling multithreading/multiprocessing. - Research and adopt new scraping technologies to enhance performance and scalability. To qualify for this role, you should have: - 2 years of Python development experience with expertise in Scrapy. - Proficiency in automation libraries like Playwright or Selenium. - Experience with REST APIs, asynchronous programming, and concurrency. - Familiarity with databases (SQL/NoSQL) and cloud-based data pipelines. - Strong problem-solving skills and ability to work within Agile environments. Preferred Qualifications: - Knowledge of DevOps tools such as Docker, GitHub Actions, or CI/CD pipelines. The company offers a competitive salary, a 5-day work week, a flexible and collaborative work environment, and ample opportunities for career growth and skill development.,