448 Scrapy Jobs - Page 10

Data Scraping, MongoDB, Solr / ElasticSearch We are seeking a skilled Python Developer with strong experience in web/data scraping and working knowledge of MongoDB, Solr, and/or ElasticSearch. You will be responsible for developing, maintaining, and optimizing scalable scraping scripts to collect structured and unstructured data, efficiently manage it in MongoDB, and index it for search and retrieval using Solr or ElasticSearch. Design and develop robust web scraping solutions using Python (e.g., Scrapy, BeautifulSoup, Selenium, etc.). Extract and process large volumes of data from websites, APIs, and other digital sources. Ensure scraping mechanisms are efficient, resilient to site changes,...

Job Overview We are seeking six highly motivated and detail-oriented professionals to join our Data & Insights team. As a Data Processor / Scraper / Collector, you will play a pivotal role in gathering, cleaning, and organizing entertainment-related data from various sources. Your work will directly support strategic decision-making across content development, marketing, and audience engagement. Industry: Entertainment/ Hospitality Experience Required: Minimum 3 years Key Responsibilities Collect and process structured and unstructured data from websites, APIs, and internal databases Scrape entertainment-related data (e.g., movie listings, showtimes, ratings, social media trends) using autom...

Roles and Responsibilities: Convert broad vision and concepts into a structured data science roadmap, and guide a team to successfully execute on it. Handling end-to-end client AI & analytics programs in a fluid environment. Your role will be a combination of hands-on contribution, technical team management, and client interaction. Proven ability to discover solutions hidden in large datasets and to drive business results with their data-based insights Contribute to internal product development initiatives related to data science. Drive excellent project management required to deliver complex projects, including effort/time estimation. Be proactive, with full ownership of the engagement. Bui...

Role & responsibilities As a Data Engineer focused on web crawling and platform data acquisition, you will design,develop, and maintain large-scale web scraping pipelines to extract valuable platform data. Youwill be responsible for implementing scalable and resilient data extraction solutions, ensuringseamless data retrieval while working with proxy management, anti-bot bypass techniques, anddata parsing. Optimizing scraping workflows for performance, reliability, and efficiency will be akey part of your role. Additionally, you will ensure that all extracted data maintains high qualityand integrity. Preferred candidate profile We are seeking candidates with: Strong experience in Python and ...

Job Type: Full-Time Experience Level: 1–3 years preferred (open to strong freshers with demonstrable skills) About the Role: We are seeking a Database Executive with strong skills in web scraping, data extraction, and data organization to support our data acquisition efforts. This role involves identifying data sources , automating data collection , and organizing data into structured formats that support business insights, lead generation, or content operations. You will work closely with internal teams (marketing, sales, analytics, etc.) to build robust datasets from public and semi-structured online sources, ensuring accuracy, relevance, and compliance with data practices. Key Responsibil...

About Zaobuild : "Zapbuild builds future-ready technology solutions for the transportation and logistics industry. We are deeply invested in helping the Transportation & Logistics industry and its players move forward with adaptive and innovative solutions, in order to thrive in rapidly transforming supply chains". Job Requirement: 1. Proficiency in Python and Django rest framework. 2. Hands-on experience with MySQL , including schema design, query optimization, and performance tuning. 3. Experience in web scraping using Python tools like BeautifulSoup, Scrapy, or Selenium. 4. Docker experience for containerizing applications and managing environments. 5. Front-end development skills with Ja...

Responsibilities: * Design, develop & maintain web scrapers using Python & Scrapy * Ensure data accuracy & compliance with website terms * Collaborate with cross-functional teams on project requirements Work from home

About Zaobuild : "Zapbuild builds future-ready technology solutions for the transportation and logistics industry. We are deeply invested in helping the Transportation & Logistics industry and its players move forward with adaptive and innovative solutions, in order to thrive in rapidly transforming supply chains". Job Requirement: 1. Proficiency in Python and Django rest framework. 2. Hands-on experience with MySQL , including schema design, query optimization, and performance tuning. 3. Experience in web scraping using Python tools like BeautifulSoup, Scrapy, or Selenium. 4. Docker experience for containerizing applications and managing environments. 5. Front-end development skills with Ja...

Senior Data Analyst – E-commerce & Quick-Commerce Location: Gurugram, Haryana, India Experience: 3–5 years Employment Type: Full-time Industry: E-commerce / Quick-Commerce Department: Data & Analytics About the Role We’re looking for a skilled Senior Data Analyst with solid experience in e-commerce and quick-commerce domains. The role demands expertise in data collection, analysis, visualization, and communication, with a strong emphasis on web scraping for competitive intelligence and operational insights. Key Responsibilities Analyse large-scale datasets to extract business-critical insights on customer behaviour, sales trends, and operational performance. Create and maintain interactive d...

Job Description Company Description Assent is the leading solution for supply chain sustainability tailored for the world’s top-tier, sustainability-driven manufacturers. Hidden risks riddle supply chains, many of which werent built with sustainability in mind. Thats where we step in. With insights from experts, Assent is the tool manufacturers trust for comprehensive sustainability. We are proud to announce that Assent has crossed the US$100M ARR milestone, granting us Centaur Status. This accomplishment, reached just 8 years following our Series A, makes us the first and only Certified B Corporation in North Americas SaaS sustainability industry to celebrate this milestone. Our journey fro...

Company Description Assent is the leading solution for supply chain sustainability tailored for the world’s top-tier, sustainability-driven manufacturers. Hidden risks riddle supply chains, many of which weren't built with sustainability in mind. That's where we step in. With insights from experts, Assent is the tool manufacturers trust for comprehensive sustainability. We are proud to announce that Assent has crossed the US$100M ARR milestone, granting us Centaur Status. This accomplishment, reached just 8 years following our Series A, makes us the first and only Certified B Corporation in North America's SaaS sustainability industry to celebrate this milestone. Our journey from $5 million ...

Testing and debugging applications. Developing back-end components. Integrating user-facing elements using server-side logic. Assessing and prioritizing client feature requests. Integrating data storage solutions. Required Candidate profile Knowledge of Python and related frameworks including Django and Flask. A deep understanding and multi-process architecture and the threading limitations of Python. Perks and benefits Flexible hours. Remote work options.

Python Web Scraper (Data Extraction | Automation | APIs) We’re looking for a Python Web Scraper to help us collect, clean, and manage data from various websites and online platforms. If you’re skilled in building scalable scrapers, handling APIs, and automating data workflows, this role is for you! You’ll work on real-world projects where data powers decision-making. Responsibilities: Build and maintain web scrapers using Python (BeautifulSoup, Scrapy, Selenium, etc.) Extract, clean, and structure large datasets from multiple sources. Work with APIs, JSON, and automation scripts. Troubleshoot scraping challenges (CAPTCHAs, dynamic content, rate limits). Collaborate with the team to deliver d...

Job Title: Web Scraper & Lead Generation Specialist Location: Remote Job Type: Part Time About the Role We are seeking a highly skilled Web Scraper & Lead Generation Specialist with proven experience in extracting, validating, and organizing data for sales and business development. The ideal candidate will have hands-on experience in generating qualified leads within Solar Industries, Call Center, BPO, Customer Support as a Service (CSaaS), Business Process Services (BPS), and B2B Data & Analytics companies (e.g., Snowflake, Databricks, GCP/AWS Analytics partners, Tableau, Power BI, and other analytics consulting firms). Key Responsibilities Develop and maintain automated web scraping script...

Job Title : Lead Data Scraping Engineer Location : Ahmedabad/WFO Experience Level : Senior (4+ years) Employment Type : Full-time Job Summary: We are seeking a highly skilled and experienced Lead Data Scraping Engineer to join our team. The ideal candidate will have a minimum of 4 years of hands-on experience in IT scraping, with at least 2 years leading a team of 5+ developers. This role requires deep technical knowledge in advanced scraping techniques, reverse engineering, automation, and leadership skills to drive the team towards success. Key Responsibilities: • Design and develop scalable data scraping solutions using tools like Scrapy and Python libraries. • Lead and mentor a team of 5...

Job Title: Web Scraping Specialist (Python) Company : Actowiz Solutions Location: Ahmedabad Job Type: Full-time Working Days: 5 Days a Week. About Us Actowiz Solutions is a leading provider of data extraction, web scraping, and automation solutions. We empower businesses with actionable insights by delivering clean, structured, and scalable data through cutting-edge technology. Join our fast-growing team and lead projects that shape the future of data intelligence. Role Overview We are looking for a highly skilled Python Developer with expertise in web scraping, automation tools, and related frameworks. Key Responsibilities • Design, develop, and maintain scalable web scraping scripts and fr...

Job Description:- 1. Develop and maintain web scraping scripts using Python libraries such as BeautifulSoup, Scrapy, or Selenium. 2. Design and implement machine learning algorithms and models to analyse data and extract insights. 3. Create and manage databases using PostgreSQL to efficiently store and query large datasets. 4. Develop automation scripts and tools using Selenium for web application testing and data extraction. 5. Collaborate with cross-functional teams including data scientists, software engineers, and business analysts to deliver high-quality solutions. 6. Stay updated with the latest trends and technologies in web scraping, machine learning, and automation. Job Type: Full-t...

Job Description:- 1. Develop and maintain web scraping scripts using Python libraries such as BeautifulSoup, Scrapy, or Selenium. 2. Design and implement machine learning algorithms and models to analyze data and extract insights. 3. Create and manage databases using PostgreSQL for storing and querying large datasets efficiently. 4. Develop automation scripts and tools using Selenium for web application testing and data extraction. 5. Collaborate with cross-functional teams including data scientists, software engineers, and business analysts to deliver high-quality solutions. 6. Stay updated with the latest trends and technologies in web scraping, machine learning, and automation. Job Locati...

Job Description: Python Developer (with Node.js, React & AI/ML Exposure) About the Role We are looking for a versatile Python Developer with experience in Node.js, React, and AI/ML to join our growing tech team. The role involves designing and developing scalable applications, implementing web scraping solutions, and contributing to AI/ML-driven projects. Key Responsibilities Design, develop, and maintain backend systems using Python (Flask/Django/FastAPI). Build and optimize RESTful APIs and microservices . Work with Node.js for backend services and React.js for front-end integration. Implement web scraping solutions to extract, process, and analyze large-scale data. Collaborate on AI/ML mo...

Male applicants are preferred We are looking for an enthusiastic and proactive Python Developer to join our development team. Experience Required: 2-3 Years Mode of Work: On-Site Only (Mohali, Punjab) Mode of Interview : Face to Face( On-Site) Contact for Queries: +91-9872993778 (Mon–Fri, 11 AM – 6 PM) Note: This number will be unavailable on weekends and public holidays. Key Responsibilities: Backend Development: Assist in the development of clean, efficient, and scalable Python applications to meet business needs. API Integration: Support the creation, management, and optimization of RESTful APIs to connect backend and frontend components. Collaboration: Work closely with frontend develope...

Location - Goregaon West (Mumbai Candidates only apply) Working Days - 6 Immediate Joiner Preferred Python Developer – Data Scraping, MongoDB, Solr / ElasticSearch We are seeking a skilled Python Developer with strong experience in web/data scraping and working knowledge of MongoDB, Solr, and/or ElasticSearch. You will be responsible for developing, maintaining, and optimizing scalable scraping scripts to collect structured and unstructured data, efficiently manage it in MongoDB, and index it for search and retrieval using Solr or ElasticSearch. Key Responsibilities: •Design and develop robust web scraping solutions using Python (e.g., Scrapy, BeautifulSoup, Selenium, etc.). •Extract and pro...

Male applicants are preferred We are looking for an enthusiastic and proactive Python Developer to join our development team. Experience Required: 2-3 Years Mode of Work: On-Site Only (Mohali, Punjab) Mode of Interview : Face to Face( On-Site) Contact for Queries: +91-9872993778 (Mon–Fri, 11 AM – 6 PM) Note: This number will be unavailable on weekends and public holidays. Key Responsibilities: Backend Development: Assist in the development of clean, efficient, and scalable Python applications to meet business needs. API Integration: Support the creation, management, and optimization of RESTful APIs to connect backend and frontend components. Collaboration: Work closely with frontend develope...

We are seeking a Python Lead Developer with a proven track record in building robust, scalable applications and leading high-performing development teams. This role requires strong expertise in Python programming, web scraping, and application development, with a focus on delivering efficient, high-quality solutions. Key ResponsibilitiesLeadership and Team Collaboration - Lead and mentor a team of Python developers, fostering best practices, conducting code reviews, and providing technical guidance. - Break down complex tasks into manageable modules, setting clear expectations and timelines for the team. - Collaborate with cross-functional teams, including front-end and back-end developers, ...

We're looking for an entrepreneurial, passionate, and driven Data Engineer to join Startup Gala Intelligence backed by Navneet Tech Venture. As we're building our technology platform from scratch, you'll have the unique opportunity to shape our technology vision, architecture, and engineering culture right from the ground up. You’ll directly contribute to foundational development and establish best practices, while eventually building and contributing to our engineering team. This role is ideal for someone eager to own the entire tech stack, who thrives on early-stage challenges, and loves building innovative, scalable solutions from day zero. What You’ll Do Web Scraping & Crawling: Build an...

Designation : Python Developer & Web Crawling Experience : 3 to 5 Years Location : Gurgaon, Haryana Entity : Global Checks Pvt ltd Role & Responsibilities Collaborate with cross-functional teams to define, design, and implement new features. Ensure the performance, quality, and responsiveness of web crawling systems. Identify and correct bottlenecks and fix bugs in web crawling processes. Help maintain code quality, organization, and automation. Stay up-to-date with the latest industry trends and technologies. Skills 3+ years of experience in Web Scraping or Crawling through Scrapy, Selenium or other frameworks and related libraries (like beautifulsoup, puppeteer). Should be expert on latest...