448 Scrapy Jobs - Page 3

Position: Lead Python Developer Location: Ahmedabad Position Summary We are seeking a skilled and experienced Backend Developer with strong expertise in TypeScript, Python, and web scraping. You will be responsible for designing, developing, and maintaining scalable backend services and APIs that power our data-driven products. Your role will involve collaborating with cross- functional teams, optimizing system performance, ensuring data integrity, and contributing to the design of efficient and secure architectures. Job Responsibility ● Design, develop, and maintain backend systems and services using Python and TypeScript. ● Develop and maintain web scraping solutions to extract, process, a...

Data Pipeline Engineer– Web Services, WebCrawling, ETL, NLP(spaCy/LLM), AWS Experience Level: 5-8 years of relevant experience in data engineering. About Forage AI: Forage AI is a pioneering AI-powered data extraction and automation company that transforms complex, unstructured web and document data into clean, structured intelligence. Our platform combines web crawling, NLP, LLMs, and agentic AI to deliver highly accurate firmographic and enterprise insights across numerous domains. Trusted by global clients in finance, real estate, and healthcare, Forage AI enables businesses to automate workflows, reduce manual rework, and access high-quality data at scale. About the Role: We are seeking ...

We are looking for an enthusiastic and proactive Python Developer with core Python expertise and hands-on experience in Generative AI (GenAI) to join our development team. Experience Required: 2-3 Years Mode of Work: On-Site Only (Mohali, Punjab) Mode of Interview : Face to Face( On-Site) Contact for Queries: +91-9872993778 (Mon–Fri, 11 AM – 6 PM) Note: This number will be unavailable on weekends and public holidays. Key Responsibilities: Backend Development: Assist in the development of clean, efficient, and scalable Python applications to meet business needs. Generative AI Experience: Working knowledge and experience in building applications using GenAI technologies is mandatory. API Integ...

Job Title: Senior Python Developer – Web Scraping & Automation Company: Actowiz Solutions Location: Ahmedabad Job Type: Full-time Working Days: 5 Days a Week About Us Actowiz Solutions is a leading provider of data extraction, web scraping, and automation solutions. We empower businesses with actionable insights by delivering clean, structured, and scalable data through cutting-edge technology. Join our fast-growing team and lead projects that shape the future of data intelligence. Role Overview We are seeking an experienced Senior Python Developer with proven expertise in Scrapy (must-have) and strong skills in web scraping and automation. The ideal candidate will design, develop, and optim...

We are seeking an experienced Web Scraping Engineer with deep expertise in Scrapy to develop, maintain, and optimize web crawlers. The ideal candidate will have a strong background in extracting, processing, and managing large-scale web data efficiently. Responsibilities : - Write and maintain web scraping scripts using Python Optimize custom web scraping tools and workflows. - Familiarity with Python and web scraping frameworks (Scrapy, Selenium, BeautifulSoup, Requests, Playwright). - Troubleshoot and resolve scraping challenges, including CAPTCHAs, rate limiting, and IP blocking. - Experience with proxy management (Rotating IPs, VPNs, Residential proxies, etc.) - Handle dynamic content us...

We are seeking a highly skilled and passionate Python Developer to join our team. The ideal candidate should have strong expertise in backend development using Django, DRF, or FastAPI, along with extensive experience in advanced web scraping and hands-on knowledge in AI/LLM model training . Key Responsibilities: Develop and maintain RESTful APIs using Django, DRF, or FastAPI . Perform very advanced web scraping using tools like BeautifulSoup, Scrapy, and Selenium . Example platforms : Amazon, LinkedIn, Twitter, job portals, e-commerce sites, and real estate listings. Example content : Product data, job listings, user reviews, pricing data, dynamic JS-rendered content, etc. Implement and mana...

As an experienced AI Data Analyst with 7+ years of professional experience, including leadership in tech projects, you will be responsible for working on cutting-edge AI solutions at a company located in Mahape, Navi Mumbai with a Hybrid Work from Office setup. Your expertise in Python, Machine Learning, AI APIs, and Large Language Models (LLMs) will be essential for this role. **Key Responsibilities:** - Perform data exploration, profiling, and cleaning across large datasets. - Design, implement, and evaluate machine learning and AI models for business problems. - Leverage LLM APIs, foundation models, and vector databases to power AI-driven analysis. - Build end-to-end ML workflows from dat...

Overview Stats Perform is the market leader in sports tech. We provide the most trusted sports data to some of the world's biggest organizations, across sports, media, and broadcasting. Through the latest AI technologies and machine learning, we combine decades' worth of data with the latest in-game happenings. We then offer coaches, teams, professional bodies, and media channels around the world, access to the very best data, content, and insights. In turn, improving how sports fans interact with their favorite sports teams and competitions. How do they use it? Media outlets add a little magic to their coverage with our stats and graphics packages. Sportsbooks can offer better predictions a...

Overview Stats Perform is the market leader in sports tech. We provide the most trusted sports data to some of the world's biggest organizations, across sports, media, and broadcasting. Through the latest AI technologies and machine learning, we combine decades' worth of data with the latest in-game happenings. We then offer coaches, teams, professional bodies, and media channels around the world, access to the very best data, content, and insights. In turn, improving how sports fans interact with their favorite sports teams and competitions. How do they use it? Media outlets add a little magic to their coverage with our stats and graphics packages. Sportsbooks can offer better predictions a...

Overview Stats Perform is the market leader in sports tech. We provide the most trusted sports data to some of the world's biggest organizations, across sports, media, and broadcasting. Through the latest AI technologies and machine learning, we combine decades' worth of data with the latest in-game happenings. We then offer coaches, teams, professional bodies, and media channels around the world, access to the very best data, content, and insights. In turn, improving how sports fans interact with their favorite sports teams and competitions. How do they use it? Media outlets add a little magic to their coverage with our stats and graphics packages. Sportsbooks can offer better predictions a...

Overview Stats Perform is the market leader in sports tech. We provide the most trusted sports data to some of the world's biggest organizations, across sports, media, and broadcasting. Through the latest AI technologies and machine learning, we combine decades' worth of data with the latest in-game happenings. We then offer coaches, teams, professional bodies, and media channels around the world, access to the very best data, content, and insights. In turn, improving how sports fans interact with their favorite sports teams and competitions. How do they use it? Media outlets add a little magic to their coverage with our stats and graphics packages. Sportsbooks can offer better predictions a...

Data Pipeline Engineer– Web Services, WebCrawling, ETL, NLP(spaCy/LLM), AWS Experience Level: 5-8 years of relevant experience in data engineering. About Forage AI: Forage AI is a pioneering AI-powered data extraction and automation company that transforms complex, unstructured web and document data into clean, structured intelligence. Our platform combines web crawling, NLP, LLMs, and agentic AI to deliver highly accurate firmographic and enterprise insights across numerous domains. Trusted by global clients in finance, real estate, and healthcare, Forage AI enables businesses to automate workflows, reduce manual rework, and access high-quality data at scale. About the Role: We are seeking ...

You will be joining Dnviva, an innovative SaaS company specializing in data automation, real-time analytics, and brand intelligence. As a part of our expanding team, we are looking for skilled developers who can contribute to our fast-growing platform. **Role Overview:** - Design and develop scalable backend features for our SaaS platform. - Implement secure APIs using GraphQL & REST. - Optimize data processing workflows and database performance. - Deploy & manage cloud infrastructure with AWS/Kubernetes. - Develop and maintain large-scale web scraping systems. **Key Responsibilities:** - 3+ years of experience in backend development, DevOps, or web scraping. - Strong knowledge of API develo...

PLEASE READ CAREFULLY: IN ORDER TO BE CONSIDERED FOR THIS ROLE, YOU MUST SUBMIT AN APPLICATION HERE: https://onboard.daply.ai/developers Daply is hiring a Python Developer with deep experience in data scraping. You will architect reliable crawlers, pipelines, and services that turn messy web data into clean, usable datasets for analytics and AI features. What you will do Build distributed crawlers and parsers with strong error handling Use headless browsers and smart rotation to bypass common defenses Create ETL flows that validate, dedupe, and enrich data before loading Expose datasets through APIs and internal tools Instrument jobs, add alerts, and drive continuous performance gains Must h...

Company Description Stylumia, founded in 2015, aims to revolutionize retail strategy and decision-making through advanced intelligence, significantly reducing wastage from unsold products. Utilizing predictive and prescriptive analytics, Stylumia enables brands to anticipate market trends and stay ahead. With features like demand science, real-time consumer intelligence, and an Gen AI-native approach, our solutions drive revenue and profit growth by transforming businesses for brands and retailers globally including the Fortune 100. Ready to illuminate your future? Partner with us today. Role Description This is a internship role with full-time role for a Data Engineer specializing in Web Da...

About Us BYLD Group is committed to making a difference to people and their organizations through its decades of excellence in business solutions, diverse corporate exposure, and skilled workforce. Our clients across various industries believe us in managing, developing, and aligning their corporate needs with their organizational goals and objectives. Founded in the year 1998, BYLD is the largest group in the South Asian region, offering technology-enabled HR and business productivity solutions. We have served 5,00,000+ individuals, worked with more than 50% of the Fortune 500 and over 60% of the Business World top 1000 companies. Please read about us – www.byldgroup.com Designation - Pytho...

Were Hiring: Python Developers Web Scraping, Crawling & Automation Experts (40 Openings | 3 - 12 Yrs Experience | Multiple Levels & Roles) Location: Mumbai / Pune / Chandigarh / Bengaluru / Gurugram / Noida / New Delhi (WFO, Hybrid, or Remote Based on Role Industry: Fortune 500 Client Projects (Staffing via Hatchtra Innotech Pvt. Ltd.) Employment Type: Full-Time | Contract (C2H) Notice Period: Immediate Joiners / Max 30 Days About Us: Hatchtra Innotech Pvt. Ltd. is a leading staffing partner for Fortune 500 clients and high-growth enterprises. We specialize in placing top-tier tech professionals on high-impact, scalable digital projects. From digital intelligence, product monitoring, site ma...

JOB DESCRIPTION Role : Data Engineer Job location : Chennai About Us At I, Saras, we develop AI applications for students, teachers and professionals. Why you should apply for I, Saras? Work in emerging tech like AI, ML and NLP. Funded by Startup India Scheme for being an innovative startup. Incubated at IIM Lucknow. Role Overview Build and maintain data infrastructure for AI-powered educational applications, enabling seamless data flow and intelligent features for students and teachers. Key Responsibilities Technical Documentation Understand business requirements from product docs (PRD and FSD) Translate them into Technical Specification Documents (TSD) Create comprehensive data architectur...

Job Description: Python Developer (Django, Automation & Web Scraping) Location: Gurgaon, Haryana (On-Site Role) Experience: 2–5 years Employment Type: Full-time About Trailytics Trailytics is a fast-growing MarTech company working with global clients to transform how retail and eCommerce businesses leverage data. We specialize in Retail Media, Digital Shelf, and Data-driven Automation solutions across marketplaces like Amazon, Flipkart, Blinkit, Instacart, and Walmart Connect. Our mission is to empower brands and agencies with intelligent campaign management, performance optimization, and technology-driven efficiency. We are looking for a Python Developer with strong expertise in Django-base...

As a Web Scraping Specialist, your role involves collecting, cleaning, and organizing data from various websites and online sources. Your strong programming skills and prior experience in building automated data extraction solutions will be highly valuable in this part-time position. Key Responsibilities: - Develop and maintain web scraping scripts using Python libraries such as BeautifulSoup, Scrapy, and Requests. - Extract and process data from websites, APIs, and dynamic content. - Store structured data in databases, including SQL or NoSQL. - Troubleshoot and optimize scraping scripts to ensure accuracy and efficiency. - Ensure compliance with website policies and data usage guidelines. R...

We are looking for a 2 to 3 years experienced Python Developer to join our team. As a part of our Technology/Solutions leadership team, you will be directly working with Product Engineering team in Designing the crawling algorithm from social media. Skills: Python, Web crawling, Web scraping, Beautiful Soup, Snowflake, Scrapy Develop customised tools to automate critical business functions and meet project objectives, requirements and company goals Interact with manager as necessary to analyse project objectives and capability requirements Use skills in python and selenium to design and deploy automated tools Understand client databases and manage data and databases for internal reporting pu...

Company Introduction - Information Security & Data Analytics Series A funded company. Working in cutting edge technologies - Using AI for predictive intelligence and Facial Biometrics. Among Top 5 Cyber excellence companies globally (Holger Schulze awards) Bronze award for best startup of the year (Indian Express IT awards), only cyber Security Company in top 3. More than 100+ clients in India. Job Description:- Job Title: Python Developer Key Requirements:- Mine data from structured and unstructured data sources. Extract data (text, images, and videos) from multiple documents in different formats. Extract information and intelligence from data. Extract data based on regular expressions. Col...

3+ years of work experience as a Python Developer. Sound understanding and knowledge of Python and its ecosystem libraries like pandas and numpy. Also be able to write modular code and understand the python packaging system. Experience on web crawling, scraping (Scrapy,BeautifulSoup, Selenium) and web application development using Django/Flask Framework. Experience on Data-Science; exposure to Theanos, Tensorflow, Pytorch (preferable) Exposure to data mining, Pyspark (preferable) Skills:- Python, Django, SQL and Flask

We are looking for an enthusiastic and proactive Python Developer with core Python expertise and hands-on experience in Generative AI (GenAI) to join our development team. Experience Required: 2-3 Years Mode of Work: On-Site Only (Mohali, Punjab) Mode of Interview : Face to Face( On-Site) Contact for Queries: +91-9872993778 (Mon–Fri, 11 AM – 6 PM) Note: This number will be unavailable on weekends and public holidays. Key Responsibilities: Backend Development: Assist in the development of clean, efficient, and scalable Python applications to meet business needs. Generative AI Experience: Working knowledge and experience in building applications using GenAI technologies is mandatory. API Integ...

Full Stack Developer (3–5 Years Experience) 📍 Location: on site 🌐 Company: BS Eduworld (bseduworld.com) About Us BS Eduworld is a leading global education consultancy, empowering students and professionals to achieve their academic and career goals. With a growing digital footprint, we are expanding our technology team to build powerful in-house solutions that drive efficiency, scalability, and growth. Role Overview We are seeking an experienced Full Stack Developer with 3–5 years of proven expertise to join our dynamic team. The ideal candidate will be responsible for developing and maintaining our custom CMS, CRM for conversion tracking and centralized data management, and web scraping too...