448 Scrapy Jobs - Page 8

You will be part of Xwiz Analytics, a company specializing in providing innovative data-driven solutions focusing on e-commerce, social media, and market analytics. As a Python Developer with expertise in web scraping, you will play a crucial role in developing robust data extraction pipelines. Your responsibilities will include creating and optimizing scalable web scraping solutions, building scraping scripts using Python libraries like Scrapy, BeautifulSoup, Selenium, and Playwright, managing scraping bots with advanced automation capabilities, and handling anti-scraping mechanisms effectively. Moreover, you will be responsible for ensuring data accuracy and quality through data validation...

We are seeking a highly skilled and passionate Python Developer to join our team. The ideal candidate should have strong expertise in backend development using Django, DRF, or FastAPI, along with extensive experience in advanced web scraping and hands-on knowledge in AI/LLM model training . Key Responsibilities: Develop and maintain RESTful APIs using Django, DRF, or FastAPI . Perform very advanced web scraping using tools like BeautifulSoup, Scrapy, and Selenium . Example platforms : Amazon, LinkedIn, Twitter, job portals, e-commerce sites, and real estate listings. Example content : Product data, job listings, user reviews, pricing data, dynamic JS-rendered content, etc. Implement and mana...

Male applicants are preferred We are looking for an enthusiastic and proactive Python Developer with core Python expertise and hands-on experience in Generative AI (GenAI) to join our development team. Experience Required: 2-3 Years Mode of Work: On-Site Only (Mohali, Punjab) Mode of Interview : Face to Face( On-Site) Contact for Queries: +91-9872993778 (Mon–Fri, 11 AM – 6 PM) Note: This number will be unavailable on weekends and public holidays. Key Responsibilities: Backend Development: Assist in the development of clean, efficient, and scalable Python applications to meet business needs. Generative AI Experience: Working knowledge and experience in building applications using GenAI techno...

Job Overview We are seeking a detail-oriented Data Entry Specialist with strong skills in online research, data cross-checking, and updating records from multiple online sources. The ideal candidate should be proficient in web scraping , Excel (including advanced formulas/macros) , and able to work quickly and accurately. Good command of spoken and written English is essential for effective communication and task execution. Key Responsibilities Collect, verify, and update data from multiple online platforms. Cross-check and validate information to ensure data accuracy. Use scraping tools or custom scripts to extract data efficiently. Maintain and organize large datasets in Excel, applying fo...

Position: Data Mining Analyst This is a Delhi-based position and work from office only! Work Location: Sector 23 Dwarka, Delhi We are seeking a skilled Data Mining Analyst with expertise in automating data extraction processes from web platforms. The ideal candidate will be experienced in Python, Selenium, Pandas, SQL, and APIs, with the ability to design and implement efficient and scalable data scraping systems. If you have a passion for working with data and a solid understanding of web technologies, we want to hear from you! Key Responsibilities: Design, develop, and maintain robust web scraping solutions to extract structured and unstructured data from various websites and APIs. Use too...

You will be responsible for building, improving, and extending NLP capabilities. Your tasks will include selecting proper annotated datasets for supervised learning techniques, using effective text representation techniques to develop useful features, identifying and utilizing correct algorithms for specific NLP projects, developing NLP projects as per prescribed requirements, training developed NLP models, and evaluating their effectiveness. Additionally, you will conduct statistical analyses of models, adjust models where necessary, and extend machine learning frameworks and libraries for NLP projects. The ideal candidate should have 2-4 years of experience in Analytics and Machine Learnin...

As a Senior Lead, you will be involved in Python-based automation initiatives encompassing AI/ML model testing and Framework development. Your responsibilities will include designing Frameworks, developing Proof of Concepts, Accelerators, and executing tasks effectively and independently. You will also be designing and implementing automation for Data, Web, and Mobile applications, as well as participating in Demos, Planning, and collaborating with various teams including business consultants, data scientists, engineers, and application developers. Desired Skills and Experience: - Strong knowledge and experience in Python Programming Language. - Basic understanding of AI/ML and Data science ...

Responsibilities: * Design, develop & maintain web scrapers using Scrapy framework. * Optimize crawl speed & handle anti-scraping measures. * Ensure data accuracy & compliance with privacy policies. Work from home

Male applicants are preferred We are looking for an enthusiastic and proactive Python Developer with core Python expertise and hands-on experience in Generative AI (GenAI) to join our development team. Experience Required: 2-3 Years Mode of Work: On-Site Only (Mohali, Punjab) Mode of Interview : Face to Face( On-Site) Contact for Queries: +91-9872993778 (Mon–Fri, 11 AM – 6 PM) Note: This number will be unavailable on weekends and public holidays. Key Responsibilities: Backend Development: Assist in the development of clean, efficient, and scalable Python applications to meet business needs. Generative AI Experience: Working knowledge and experience in building applications using GenAI techno...

Job Title: Senior Python Developer – Web Scraping & Automation Company : Actowiz Solutions Location: Ahmedabad Job Type : Full-time Working Days : 5 Days a Week About Us Actowiz Solutions is a leading provider of data extraction, web scraping, and automation solutions. We empower businesses with actionable insights by delivering clean, structured, and scalable data through cutting-edge technology. Join our fast-growing team and lead projects that shape the future of data intelligence. Role Overview We are seeking an experienced Senior Python Developer with proven expertise in Scrapy (must-have) and strong skills in web scraping and automation. The ideal candidate will design, develop, and op...

Job Title : Lead Data Scraping Engineer Location: Ahmedabad/WFO Experience Level: Senior (4+ years) Employment Type : Full-time Job Summary: We are seeking a highly skilled and experienced Lead Data Scraping Engineer to join our team. The ideal candidate will have a minimum of 4 years of hands-on experience in IT scraping, with at least 2 years leading a team of 5+ developers. This role requires deep technical knowledge in advanced scraping techniques, reverse engineering, automation, and leadership skills to drive the team towards success. Key Responsibilities: • Design and develop scalable data scraping solutions using tools like Scrapy and Python libraries. • Lead and mentor a team of 5+ ...

Position: Data Mining Analyst This is a Delhi-based position and work from office only! Work Location: Sector 23 Dwarka, Delhi We are seeking a skilled Data Mining Analyst with expertise in automating data extraction processes from web platforms. The ideal candidate will be experienced in Python, Selenium, Pandas, SQL, and APIs, with the ability to design and implement efficient and scalable data scraping systems. If you have a passion for working with data and a solid understanding of web technologies, we want to hear from you! Key Responsibilities: Design, develop, and maintain robust web scraping solutions to extract structured and unstructured data from various websites and APIs. Use too...

Python Developer is responsible for building, debugging, and implementing application projects using the Python programming language and developing program specifications and coded modules according to specifications and client standards. Responsibilities Advanced Python Programming: Extensive experience in Python, with a deep understanding of Python principles, design patterns, and best practices. Proficiency in developing scalable and efficient Python code, with a focus on automation, data processing, and backend services. Demonstrated ability with automation libraries like PyAutoGUI for GUI automation tasks, enabling the automation of mouse and keyboard actions. Experience with Selenium f...

Job description: We’re looking for a hands-on Data Engineer to manage and scale our data scraping pipelines across 60+ websites. The job involves handling OCR-processed PDFs, ensuring data quality, and building robust, self-healing workflows that fuel AI-driven insights. You’ll Work On: Managing and optimizing Airflow scraping DAGs Implementing validation checks, retry logic & error alerts Cleaning and normalizing OCR text (Tesseract / AWS Textract) Handling deduplication, formatting, and missing data Maintaining MySQL/PostgreSQL data integrity Collaborating with ML engineers on downstream pipelines What You Bring: 2–5 years of hands-on experience in Python data engineering Experience with A...

Job description Python +Web Scrapping Developer · Work experience as a Python Developer · Expertise in at least one popular Python framework (like Django, Flask or Pyramid) · Familiarity with front-end technologies (like JavaScript and HTML5) · Strong experience using Web Services and API's in python. · Hands on experience on web scrapping, Beautiful Soup, Snowflake, Scrapy, ZMQ/Kafka · Implementation of security and data protection. · Integration of data storage solutions. · Performance tuning, improvement, balancing, usability, automation. · Work collaboratively with the design team to understand end user requirements to provide technical solutions and for the implementation of new softwar...

Job description: We’re looking for a hands-on Data Engineer to manage and scale our data scraping pipelines across 60+ websites. The job involves handling OCR-processed PDFs, ensuring data quality, and building robust, self-healing workflows that fuel AI-driven insights. You’ll Work On: Managing and optimizing Airflow scraping DAGs Implementing validation checks, retry logic & error alerts Cleaning and normalizing OCR text (Tesseract / AWS Textract) Handling deduplication, formatting, and missing data Maintaining MySQL/PostgreSQL data integrity Collaborating with ML engineers on downstream pipelines What You Bring: 2–5 years of hands-on experience in Python data engineering Experience with A...

Techversant is currently looking for an experienced Python Team Lead to join our team. As a Python Team Lead, you will be responsible for overseeing the development team, driving best practices, and ensuring the successful delivery of high-quality software solutions. We are seeking an individual with over 6 years of experience in Python development, who possesses excellent leadership skills, and has a strong passion for mentoring and guiding team members. Key Responsibilities: - Create technical designs to support various client requirements - Evaluate project requirements and prepare estimates - Write code that passes unit tests and thrives in an agile and test-driven development environmen...

We are seeking an experienced Web Scraping Engineer with deep expertise in Scrapy to develop, maintain, and optimize web crawlers. The ideal candidate will have a strong background in extracting, processing, and managing large-scale web data efficiently. Responsibilities : - Write and maintain web scraping scripts using Python Optimize custom web scraping tools and workflows. - Familiarity with Python and web scraping frameworks (Scrapy, Selenium, BeautifulSoup, Requests, Playwright). - Troubleshoot and resolve scraping challenges, including CAPTCHAs, rate limiting, and IP blocking. - Experience with proxy management (Rotating IPs, VPNs, Residential proxies, etc.) - Handle dynamic content us...

Position: Lead Python Developer Experience: 4+ Years Location: Ahmedabad (Onsite) Employment Type: Full-Time Salary: As per industry standards Position Summary: We are seeking a skilled and experienced Backend Developer with strong expertise in TypeScript, Python, and web scraping. You will be responsible for designing, developing, and maintaining scalable backend services and APIs that power our data-driven products. Your role will involve collaborating with cross-functional teams, optimizing system performance, ensuring data integrity, and contributing to the design of efficient and secure architectures. Job Responsibility: ● Design, develop, and maintain backend systems and services using...

Location: Remote / Flexible Job Type: Contract / Freelance / Full-time (open for discussion) About the Role We are looking for an experienced Web Scraper Developer to build and maintain robust scrapers for leading Indian beauty platforms (Nykaa, Tira Beauty, and Purplle). The scrapers should be designed for scalability, stealth, and resilience , ensuring smooth operation even when websites update their structures. You will be responsible for architecting, coding, and optimizing scrapers that can handle large volumes of product data quickly and efficiently , with minimal downtime and easy maintainability. Responsibilities Design and implement scrapers for Nykaa, Tira Beauty, and Purplle to ex...

Male applicants are preferred We are looking for an enthusiastic and proactive Python Developer with core Python expertise and hands-on experience in Generative AI (GenAI) to join our development team. Experience Required: 2-3 Years Mode of Work: On-Site Only (Mohali, Punjab) Mode of Interview : Face to Face( On-Site) Contact for Queries: +91-9872993778 (Mon–Fri, 11 AM – 6 PM) Note: This number will be unavailable on weekends and public holidays. Key Responsibilities: Backend Development: Assist in the development of clean, efficient, and scalable Python applications to meet business needs. Generative AI Experience: Working knowledge and experience in building applications using GenAI techno...

You will be part of a dedicated team at Zapbuild, specializing in building cutting-edge technology solutions for the transportation and logistics industry. Our primary goal is to support and propel the Transportation & Logistics sector by providing adaptive and innovative solutions that enable players to thrive in the face of rapidly evolving supply chains. Your responsibilities will revolve around various aspects such as achieving sustainability objectives, harnessing new technologies for streamlined logistics operations, and minimizing supply chain expenses. As your technology partner, our commitment remains unwavering - we are dedicated to keeping you at the forefront of the industry with...

As a Web Scraper at our Pune office, you will undertake the full-time responsibility of extracting, transforming, and loading data from various websites and online sources. Your primary role will involve developing robust web scraping scripts using Python and relevant libraries to ensure data quality and accuracy for our B2B marketing and sales solutions. Additionally, you will collaborate with internal teams to support data-driven decision-making. Your key responsibilities will include designing, developing, and maintaining efficient web scraping scripts, performing data extraction, transformation, and loading processes, implementing data quality assurance measures, collaborating with inter...

Full Stack Developer (MERN + Python) Urgent Hiring - Immediate Joiners Preferred Location: Fully Remote, Onsite after 3 months(if suitable for company and candidate) Type: Full-time Compensation: ₹4 to ₹10 LPA (fixed, in-hand) We're looking to fill this position this week itself. So if you're currently available or can start within a few days, you’ll be given preference. About Iced Automations Iced Automations LLC is a fast-moving automation company that helps cold email agencies streamline and scale their operations. We build systems on top of Smartlead, Instantly, n8n, Clay, Slack, and other platforms to help our clients save time and grow faster. We’ve worked with over 100 agencies and ar...

Responsibilities: * Develop web applications using Python & Scrapy * Collaborate with cross-functional teams on project requirements * Optimize scraped data for performance & accuracy Work from home Annual bonus