Senior Python Developer

As a Senior Python Developer specializing in web scraping and automation, your role will involve designing, developing, and optimizing large-scale scraping solutions using Scrapy. You will collaborate with product managers, QA, and DevOps teams to ensure timely delivery and research and adopt new scraping technologies to improve performance and efficiency. Key Responsibilities: - Design, develop, and maintain scalable web scraping frameworks using Scrapy (mandatory). - Utilize additional libraries/tools such as BeautifulSoup, Selenium, Playwright, Requests, etc. - Implement robust error handling, data parsing, and data storage mechanisms (JSON, CSV, SQL/NoSQL databases). - Build and optimize asynchronous scraping workflows and handle multithreading/multiprocessing. - Collaborate with cross-functional teams to ensure timely delivery. - Research and adopt new scraping technologies for improved performance. Qualifications Required: - 2 years of experience in Python development with expertise in Scrapy. - Proficiency in automation libraries such as Playwright or Selenium. - Experience with REST APIs, asynchronous programming, and concurrency. - Familiarity with databases (SQL/NoSQL) and cloud-based data pipelines. - Strong problem-solving skills and ability to meet deadlines in an Agile environment. In addition to the job requirements, the company offers competitive salary, a 5-day work week, flexible and collaborative work environment, and ample opportunities for career growth and skill development.,