602 Scrapy Jobs

Company Description INNOFarms.AI is a global AI SaaS and Robotics company dedicated to transforming AgriFood enterprises and enabling climate-resilient future food systems. Leveraging advanced AI, Robotics, and IoT technologies, the company builds intelligent digital operational frameworks aimed at making agriculture smarter, efficient, and more profitable. Role Overview We are seeking a motivated AI Engineer Intern to join our growing team. This role offers hands-on experience in building AI/ML pipelines, working with computer vision systems, and developing cloud-based solutions. You'll work directly with our engineering team on real projects that impact our product. Key Responsibilities Ma...

As an AI/ML Data Analyst at our company, your role will involve developing and deploying machine learning models, optimizing data pipelines, and driving AI-driven innovation. You will need expertise in machine learning, artificial intelligence, automation, and data engineering, along with hands-on experience in Node JS, Python, SQL, and data scraping. Your strong analytical mindset and problem-solving abilities will be crucial in working with large datasets to drive impactful business solutions. **Key Responsibilities:** - Develop and deploy machine learning models for predictive analytics and automation. - Build and optimize data pipelines using SQL, Python to process large datasets efficie...

Web Scraping Specialist with extensive experience in large-scale data extraction, automation, and API development. I help businesses extract, process, and structure data from websites, e-commerce platforms, and online portals to power their data-driven decisions. Web Scraping Services I Offer: Custom Web Scraping Solutions – Extract data from any website, including dynamic and JavaScript-heavy sites E-commerce Data Extraction – Product details, prices, reviews, inventory tracking from multiple retailers Large-Scale Data Automation – Handle thousands to millions of URLs with multi-threaded scraping systems Anti-Bot Bypass & CAPTCHA Handling – Sophisticated techniques to work with protected we...

As a Web Scraping Specialist, your role involves collecting, cleaning, and organizing data from various websites and online sources. You will be responsible for developing and maintaining web scraping scripts using Python libraries such as BeautifulSoup, Scrapy, and Requests. Additionally, you will extract and process data from websites, APIs, and dynamic content, storing structured data in databases such as SQL or NoSQL. Your expertise in troubleshooting and optimizing scraping scripts for accuracy and efficiency will be crucial, ensuring compliance with website policies and data usage guidelines. Key Responsibilities: - Develop and maintain web scraping scripts using Python (BeautifulSoup,...

Linux System Administrator (Junior/Mid Level) About Us. PST.AG is a growing medium-sized business with headquarters in the historical city of Weimar, Germany. With continuous coordination with legal authorities from around the world (e.g. customs authorities, export control authorities). PST.AG is the leading provider of customs/global trade data, helping companies from a diverse range of industries. You are exceptionally talented, bright, and driven people. Razor-sharp eyes for detail push them through their workdays and keep them determined to meet high standards. Does this sound like you? Then you might want to consider a career as our next team member. We are looking for a motivated IT A...

Job Title: Workflow Automation and Data Scraper Engineer Aonxi is building the Neural Revenue OS for local service businesses across America. Every day we turn unstructured conversations into intelligence that drives qualified meetings and sales on automation. Now we’re hiring an engineer who thinks in workflows, builds like a hacker, and automates like a systems architect. If you live inside n8n, Clay, Browserless, Puppeteer, Playwright, Python scripts, webhooks, and enrichment APIs - this is your role. What you will build Hyper automated outbound engines Mass-scale data scrapers for BBB, Yelp, state registries and public directories Automated enrichment pipelines using Apollo, Clay, Clearb...

About Rivan Solutions Rivan Solutions is a web scraping and web designing company. We are based in Hyderabad but we serve the entire world. About the work from home job/internship Selected intern's day-to-day responsibilities include: 1. Scraping websites using Python and BeautifulSoup/Scrapy or Selenium 2. Delivering the web scraping script within 6 to 7 hours. 3. Working with Python and Beautiful Soup to scrape and automate the websites 4. Storing data into SQL and NoSQL 5. Being regular to meetings and delivering on time Preferred Passouts on or before 2025 are preferred. Skill(s) required JSON, Python, SQL Who can apply Only those candidates can apply who: 1. are available for the work f...

eGrove Systems is looking for Senior Python Developer to join its team of experts. Exp :5+Yrs Location : Chennai /Madurai NP :Immediate to 30Days Interested candidates can send your resume to annie@egrovesys.com Roles & Responsibilities :- Hands-on software development skills, deep technical expertise across the entire software delivery process. Forward-thinking skilled individual. Structured, organized, and a good communicator. Write reusable, Testable, and Efficient code. Required Skills: - 5+ years of Strong experience in Python & 2 years in Django Web framework. Experience or Knowledge in implementing various Design Patterns. Good Understanding of MVC framework & Object-Oriented Programm...

Technical Skills (Mandatory) Strong hands-on experience with TypeScript Backend development using Node.js Web scraping using Puppeteer / Playwright / Selenium Strong understanding of HTML, CSS, DOM, and JavaScript execution Experience with HTTP requests, REST APIs, Cookies, Headers, Sessions Data handling with JSON, CSV, and databases (MongoDB / MySQL / PostgreSQL) Experience with Git / Version Control Kriti Madan | Recruitment Lead People Staffing Solutions kriti.madan@peoplestaffing.in | 9354235524

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and shape the future of hybrid agents—where human expertise and AI-driven automation work together seamlessly to deliver exceptional results for real clients. In this role, you'll work alongside Tendem Agent that handle repetitive and time-consuming tasks, while you provide the critical thinking, domain expertise, and quality control needed to produce accurate, reliable, and actionab...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and shape the future of hybrid agents—where human expertise and AI-driven automation work together seamlessly to deliver exceptional results for real clients. In this role, you'll work alongside Tendem Agent that handle repetitive and time-consuming tasks, while you provide the critical thinking, domain expertise, and quality control needed to produce accurate, reliable, and actionab...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and shape the future of hybrid agents—where human expertise and AI-driven automation work together seamlessly to deliver exceptional results for real clients. In this role, you'll work alongside Tendem Agent that handle repetitive and time-consuming tasks, while you provide the critical thinking, domain expertise, and quality control needed to produce accurate, reliable, and actionab...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and shape the future of hybrid agents—where human expertise and AI-driven automation work together seamlessly to deliver exceptional results for real clients. In this role, you'll work alongside Tendem Agent that handle repetitive and time-consuming tasks, while you provide the critical thinking, domain expertise, and quality control needed to produce accurate, reliable, and actionab...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and shape the future of hybrid agents—where human expertise and AI-driven automation work together seamlessly to deliver exceptional results for real clients. In this role, you'll work alongside Tendem Agent that handle repetitive and time-consuming tasks, while you provide the critical thinking, domain expertise, and quality control needed to produce accurate, reliable, and actionab...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and shape the future of hybrid agents—where human expertise and AI-driven automation work together seamlessly to deliver exceptional results for real clients. In this role, you'll work alongside Tendem Agent that handle repetitive and time-consuming tasks, while you provide the critical thinking, domain expertise, and quality control needed to produce accurate, reliable, and actionab...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and shape the future of hybrid agents—where human expertise and AI-driven automation work together seamlessly to deliver exceptional results for real clients. In this role, you'll work alongside Tendem Agent that handle repetitive and time-consuming tasks, while you provide the critical thinking, domain expertise, and quality control needed to produce accurate, reliable, and actionab...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and shape the future of hybrid agents—where human expertise and AI-driven automation work together seamlessly to deliver exceptional results for real clients. In this role, you'll work alongside Tendem Agent that handle repetitive and time-consuming tasks, while you provide the critical thinking, domain expertise, and quality control needed to produce accurate, reliable, and actionab...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and shape the future of hybrid agents—where human expertise and AI-driven automation work together seamlessly to deliver exceptional results for real clients. In this role, you'll work alongside Tendem Agent that handle repetitive and time-consuming tasks, while you provide the critical thinking, domain expertise, and quality control needed to produce accurate, reliable, and actionab...

Web Scraping Expert Experience: 2–5 Years Location: Remote (Work from Home) Mode of Engagement: Full-time No of Positions: 8 Educational Qualification: Bachelor’s degree in Computer Science, IT, or related field Industry: IT / Software Services / Data & AI Notice Period: Immediate Joiners Preferred What We Are Looking For Strong hands-on experience handling dynamic, JavaScript-heavy websites using Selenium, Playwright, or Puppeteer. Expertise in managing cookies, sessions, and local storage to maintain state and bypass authentication/anti-bot systems. Ability to solve CAPTCHAs programmatically using third-party or AI-based solutions. Proven experience in proxy rotation, IP management, and fi...

We are seeking exceptional and resourceful Data Engineers to join our product development teams. In this role, you will design and build automated web-scraping systems, data pipelines, and large-scale data extraction workflows that support business-critical insights. Key Responsibilities Develop and maintain web robots/spiders to extract data from various online sources (HTML, PDFs, text, Excel, etc.). Reverse-engineer websites, analyze technologies, and create automated data extraction workflows. Build parsing and transformation systems to convert raw data into structured formats. Design monitoring systems to ensure data quality, availability, and integrity. Handle changes in website struct...

We are looking for a skilled Senior Quality Assurance Automation Engineer with 5 to 10 years of experience in QA Automation Engineering, SDET, or Software Engineering. The ideal candidate should have strong coding skills in Python or Go and experience building automation frameworks for microservices and asynchronous pipelines. This position is located in Bengaluru, India. Roles and Responsibility Define and manage the quality and automation strategy across core engineering services. Build automation frameworks for distributed microservices and asynchronous data pipelines. Develop integration, regression, and performance test suites. Implement synthetic tests and chaos experiments to identify...

Build the Data Engine Behind a Global Food-Tech Platform MenuWise is not a typical SaaS company. Were rebuilding a 20-year-old platform from the ground up and creating one of the largest, cleanest, most structured culinary datasets in the world powering everything from menu costing and nutrition to AI ingredient intelligence used by professional chefs across Australia & New Zealand. To do this, we need a Python engineer who gets excited by the words: scraping at scale messy real-world data clever algorithms high-quality pipelines clean, elegant backend architecture If thats you, this is a career-defining role. What You Will Own (These Are Not Small Problems) You wont be writing CRUD APIs. Yo...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and shape the future of hybrid agents—where human expertise and AI-driven automation work together seamlessly to deliver exceptional results for real clients. In this role, you'll work alongside Tendem Agent that handle repetitive and time-consuming tasks, while you provide the critical thinking, domain expertise, and quality control needed to produce accurate, reliable, and actionab...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and shape the future of hybrid agents—where human expertise and AI-driven automation work together seamlessly to deliver exceptional results for real clients. In this role, you'll work alongside Tendem Agent that handle repetitive and time-consuming tasks, while you provide the critical thinking, domain expertise, and quality control needed to produce accurate, reliable, and actionab...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and shape the future of hybrid agents—where human expertise and AI-driven automation work together seamlessly to deliver exceptional results for real clients. In this role, you'll work alongside Tendem Agent that handle repetitive and time-consuming tasks, while you provide the critical thinking, domain expertise, and quality control needed to produce accurate, reliable, and actionab...