616 Scrapy Jobs - Page 2

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and shape the future of hybrid agents—where human expertise and AI-driven automation work together seamlessly to deliver exceptional results for real clients. In this role, you'll work alongside Tendem Agent that handle repetitive and time-consuming tasks, while you provide the critical thinking, domain expertise, and quality control needed to produce accurate, reliable, and actionab...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and shape the future of hybrid agents—where human expertise and AI-driven automation work together seamlessly to deliver exceptional results for real clients. In this role, you'll work alongside Tendem Agent that handle repetitive and time-consuming tasks, while you provide the critical thinking, domain expertise, and quality control needed to produce accurate, reliable, and actionab...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and shape the future of hybrid agents—where human expertise and AI-driven automation work together seamlessly to deliver exceptional results for real clients. In this role, you'll work alongside Tendem Agent that handle repetitive and time-consuming tasks, while you provide the critical thinking, domain expertise, and quality control needed to produce accurate, reliable, and actionab...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and shape the future of hybrid agents—where human expertise and AI-driven automation work together seamlessly to deliver exceptional results for real clients. In this role, you'll work alongside Tendem Agent that handle repetitive and time-consuming tasks, while you provide the critical thinking, domain expertise, and quality control needed to produce accurate, reliable, and actionab...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and shape the future of hybrid agents—where human expertise and AI-driven automation work together seamlessly to deliver exceptional results for real clients. In this role, you'll work alongside Tendem Agent that handle repetitive and time-consuming tasks, while you provide the critical thinking, domain expertise, and quality control needed to produce accurate, reliable, and actionab...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and shape the future of hybrid agents—where human expertise and AI-driven automation work together seamlessly to deliver exceptional results for real clients. In this role, you'll work alongside Tendem Agent that handle repetitive and time-consuming tasks, while you provide the critical thinking, domain expertise, and quality control needed to produce accurate, reliable, and actionab...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and shape the future of hybrid agents—where human expertise and AI-driven automation work together seamlessly to deliver exceptional results for real clients. In this role, you'll work alongside Tendem Agent that handle repetitive and time-consuming tasks, while you provide the critical thinking, domain expertise, and quality control needed to produce accurate, reliable, and actionab...

Web Scraping Expert Experience: 2–5 Years Location: Remote (Work from Home) Mode of Engagement: Full-time No of Positions: 8 Educational Qualification: Bachelor’s degree in Computer Science, IT, or related field Industry: IT / Software Services / Data & AI Notice Period: Immediate Joiners Preferred What We Are Looking For Strong hands-on experience handling dynamic, JavaScript-heavy websites using Selenium, Playwright, or Puppeteer. Expertise in managing cookies, sessions, and local storage to maintain state and bypass authentication/anti-bot systems. Ability to solve CAPTCHAs programmatically using third-party or AI-based solutions. Proven experience in proxy rotation, IP management, and fi...

We are seeking exceptional and resourceful Data Engineers to join our product development teams. In this role, you will design and build automated web-scraping systems, data pipelines, and large-scale data extraction workflows that support business-critical insights. Key Responsibilities Develop and maintain web robots/spiders to extract data from various online sources (HTML, PDFs, text, Excel, etc.). Reverse-engineer websites, analyze technologies, and create automated data extraction workflows. Build parsing and transformation systems to convert raw data into structured formats. Design monitoring systems to ensure data quality, availability, and integrity. Handle changes in website struct...

We are looking for a skilled Senior Quality Assurance Automation Engineer with 5 to 10 years of experience in QA Automation Engineering, SDET, or Software Engineering. The ideal candidate should have strong coding skills in Python or Go and experience building automation frameworks for microservices and asynchronous pipelines. This position is located in Bengaluru, India. Roles and Responsibility Define and manage the quality and automation strategy across core engineering services. Build automation frameworks for distributed microservices and asynchronous data pipelines. Develop integration, regression, and performance test suites. Implement synthetic tests and chaos experiments to identify...

Build the Data Engine Behind a Global Food-Tech Platform MenuWise is not a typical SaaS company. Were rebuilding a 20-year-old platform from the ground up and creating one of the largest, cleanest, most structured culinary datasets in the world powering everything from menu costing and nutrition to AI ingredient intelligence used by professional chefs across Australia & New Zealand. To do this, we need a Python engineer who gets excited by the words: scraping at scale messy real-world data clever algorithms high-quality pipelines clean, elegant backend architecture If thats you, this is a career-defining role. What You Will Own (These Are Not Small Problems) You wont be writing CRUD APIs. Yo...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and shape the future of hybrid agents—where human expertise and AI-driven automation work together seamlessly to deliver exceptional results for real clients. In this role, you'll work alongside Tendem Agent that handle repetitive and time-consuming tasks, while you provide the critical thinking, domain expertise, and quality control needed to produce accurate, reliable, and actionab...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and shape the future of hybrid agents—where human expertise and AI-driven automation work together seamlessly to deliver exceptional results for real clients. In this role, you'll work alongside Tendem Agent that handle repetitive and time-consuming tasks, while you provide the critical thinking, domain expertise, and quality control needed to produce accurate, reliable, and actionab...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and shape the future of hybrid agents—where human expertise and AI-driven automation work together seamlessly to deliver exceptional results for real clients. In this role, you'll work alongside Tendem Agent that handle repetitive and time-consuming tasks, while you provide the critical thinking, domain expertise, and quality control needed to produce accurate, reliable, and actionab...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and shape the future of hybrid agents—where human expertise and AI-driven automation work together seamlessly to deliver exceptional results for real clients. In this role, you'll work alongside Tendem Agent that handle repetitive and time-consuming tasks, while you provide the critical thinking, domain expertise, and quality control needed to produce accurate, reliable, and actionab...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and shape the future of hybrid agents—where human expertise and AI-driven automation work together seamlessly to deliver exceptional results for real clients. In this role, you'll work alongside Tendem Agent that handle repetitive and time-consuming tasks, while you provide the critical thinking, domain expertise, and quality control needed to produce accurate, reliable, and actionab...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and shape the future of hybrid agents—where human expertise and AI-driven automation work together seamlessly to deliver exceptional results for real clients. In this role, you'll work alongside Tendem Agent that handle repetitive and time-consuming tasks, while you provide the critical thinking, domain expertise, and quality control needed to produce accurate, reliable, and actionab...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and shape the future of hybrid agents—where human expertise and AI-driven automation work together seamlessly to deliver exceptional results for real clients. In this role, you'll work alongside Tendem Agent that handle repetitive and time-consuming tasks, while you provide the critical thinking, domain expertise, and quality control needed to produce accurate, reliable, and actionab...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and shape the future of hybrid agents—where human expertise and AI-driven automation work together seamlessly to deliver exceptional results for real clients. In this role, you'll work alongside Tendem Agent that handle repetitive and time-consuming tasks, while you provide the critical thinking, domain expertise, and quality control needed to produce accurate, reliable, and actionab...

Data Extraction Analyst Experience: 2–5 Years Location: Remote (Work from Home) Mode of Engagement: Full-time No of Positions: 8 Educational Qualification: Bachelor’s degree in Computer Science, IT, or related field Industry: IT / Software Services / Data & AI Notice Period: Immediate Joiners Preferred What We Are Looking For Strong hands-on experience handling dynamic, JavaScript-heavy websites using Selenium, Playwright, or Puppeteer. Expertise in managing cookies, sessions, and local storage to maintain state and bypass authentication/anti-bot systems. Ability to solve CAPTCHAs programmatically using third-party or AI-based solutions. Proven experience in proxy rotation, IP management, an...

You will be responsible for developing future-ready technology solutions for the transportation and logistics industry, focusing on adaptive and innovative solutions to thrive in rapidly transforming supply chains. Key Responsibilities: - Proficiency in Python and Django rest framework - Hands-on experience with MySQL, including schema design, query optimization, and performance tuning - Experience in web scraping using Python tools like BeautifulSoup, Scrapy, or Selenium - Docker experience for containerizing applications and managing environments - Front-end development skills with JavaScript, HTML, and basic CSS - Experience building and consuming RESTful APIs - Knowledge of version contr...

As a Python Web Scraper at HiLabs, you will be a key player in designing and building scalable and reliable web scraping solutions using Python/PySpark. Your responsibilities will include developing enterprise-grade scraping services, working with large volumes of structured and unstructured data, implementing robust data validation and monitoring processes, and optimizing data workflows for performance and scalability. You will also collaborate with data scientists, analysts, and engineers to integrate data from disparate sources and ensure smooth data flow between systems. **Key Responsibilities:** - Design and build scalable, reliable web scraping solutions using Python/PySpark. - Develop...

You have the opportunity to join a dynamic team as a Backend Developer with a focus on utilizing your expertise in Node.js, Go, and Python. Your role will involve working on high-scale consumer internet projects, requiring a minimum of 6 years of experience in backend development. Additionally, you will be utilizing machine learning frameworks like TensorFlow or PyTorch, along with developing web crawlers and scrapers using tools such as Scrapy. Your strong understanding of cloud infrastructure, DevOps practices, and CI/CD pipelines will be essential in this role. Moreover, your familiarity with large-scale data processing and storage will be an asset to the team. **Key Responsibilities:** -...

We are seeking a Web Crawling Engineer who will be responsible for building and maintaining web crawlers, extracting valuable insights from the web, and ensuring data quality. The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms. About Forage AI : Forage AI is a pioneering AI-powered data extraction and automation company that transforms complex, unstructured web and document data into clean, structured intelligence. Our platform combines web crawling, NLP, LLMs, and agentic AI to deliver highly accurate firmographic and enterprise insights across numerous domains. Trusted by ...

Role Overview: You will design, build, and operate software for data collection and processing at scale. The role is hands‑on, with emphasis on clean design, reliability, and performance. About Forage AI: ForageAI builds next‑generation systems for data collection and processing — large‑scale web crawling , document parsing , data pipelines, and automation. We work primarily in Python , leverage cloud‑native designs (mainly AWS , with exposure to GCP/Azure ), and increasingly apply GenAI and AI agents across our stack. Every developer owns their module and collaborates closely with peers in a high‑ownership, high‑trust environment. Location: Remote (Work from Home) Key Responsibilities: · De...