448 Scrapy Jobs - Page 4

Job Title : Web Scraping Specialist Location : B-8, First Floor, Noida Sector-2, U.P Employment Type : Part-Time About the Role: We are looking for a part-time Web Scraping Specialist to help us collect, clean, and organize data from various websites and online sources. This role is ideal for someone with strong programming skills and prior experience in building automated data extraction solutions. Key Responsibilities: 1. Develop and maintain web scraping scripts using Python (BeautifulSoup, Scrapy, Requests). 2. Extract and process data from websites, APIs, and dynamic content. 3.Store structured data in databases (SQL/NoSQL). 4. Troubleshoot and optimize scraping scripts for accuracy and...

Build and maintain scalable data pipelines, optimize LLM-based AI workflows, perform web/social media scraping, ensure data quality, integrate APIs, mentor junior engineers, conduct code reviews, contribute to architecture and technical decisions.

Software Engineer - Content Parsing The Opportunity We're looking for a talented and detail-oriented Software Engineer - Content Parsing to join our dynamic team. In this role, you'll be crucial in extracting, categorizing, and structuring vast amounts of content from various web sources. You'll leverage your expertise in Python and related parsing technologies to build robust, scalable, and highly accurate parsing solutions. This position requires a strong focus on data quality, comprehensive testing, and the ability to implement effective alerting and notification systems. Responsibilities : Design, develop, and maintain robust and scalable HTML parsing solutions to extract diverse web con...

Python/JavaScript Developer – Web Scraping - 4 to 7 years Experience: 4 to 7 Years Location: Remote Mode of Engagement: Full-time No of Positions: 3 Educational Qualifications: Bachelor's degree in Computer Science, Information Technology Industry: IT / Software Development Notice Period: Immediate Joiners Preferred What We Are Looking For: Strong expertise in web scraping with hands-on experience in large-scale data collection systems. Proficient in Python, including Scrapy, Requests, Playwright, and Selenium. Skilled in JavaScript for web scraping and automation tasks. Capable of designing, building, and maintaining robust and scalable scrapers for a variety of websites. Experience with AI...

Job Description – Junior Legal Associate (Intellectual Property Rights & LegalTech) Company: URE Legal Advocates Position: Junior Legal Associate – Intellectual Property Rights (IPR) Location: Noida (Client Engagements) Qualification: LLB Graduate (with IPR specialization) or LLM in IPR Why Join Us? At URE Legal Advocates, we are building the next-generation Intellectual Property Rights (IPR) software and legal solutions, blending law with technology. This Role Gives You Exposure To IP filing & prosecution (Trademark, Copyright, Patent, Industrial Design, GI). Tech-enabled IP management platforms. Legal automation tools for portfolio management, IP compliance dashboards, and AI-based IP sear...

You are Spherex's ideal candidate for the Artificial Intelligence (AI) Machine Learning (ML) Engineer position based in Navi Mumbai, India. Your main role will involve developing, enhancing, and expanding the current platform of products catering to the Media and Entertainment industry. Your key responsibilities will include creating machine learning models and retraining systems to optimize performance. **Key Responsibilities:** - Develop machine learning models and retrain systems to improve platform performance. **Qualifications Required:** - Possess a degree in computer science or software development. - Proficiency in Hands-on .Net, Azure, Project management, Team and Client management....

Key Responsibilities1 Design, develop, and maintain robust Python scripts for data processing, cleaning, and transformation Work extensively with Pandas for complex data manipulation and reporting Automate Excel workflows using OpenPyXL and win32com libraries Build and optimize web scraping solutions using Selenium (and other scraping tools if required) Maintain and scale existing Python-based applications and automation pipeline Troubleshoot, debug, and optimize performance of data workflows and scraping processes Ensure data accuracy, reliability, and process scalability Collaborate with stakeholders to understand business requirements and deliver automated solutions Take ownership of exis...

Job Title: Senior Python Developer – Web Scraping & Automation Company: Actowiz Solutions Location: Ahmedabad Job Type: Full-time Working Days: 5 Days a Week About Us Actowiz Solutions is a leading provider of data extraction, web scraping, and automation solutions. We empower businesses with actionable insights by delivering clean, structured, and scalable data through cutting-edge technology. Join our fast growing team and lead projects that shape the future of data intelligence. Role Overview We are seeking an experienced Senior Python Developer with proven expertise in Scrapy (must-have) and strong skills in web scraping and automation. The ideal candidate will design, develop, and optim...

Job Title : Sr Python Developer – Web Scraping & Automation Company: Actowiz Solutions Location: Ahmedabad Job Type: Full-time About Us Actowiz Solutions is a leading provider of data extraction, web scraping, and automation solutions. We empower businesses with actionable insights by delivering clean, structured, and scalable data through cutting-edge technology. Role Overview We are looking for a highly skilled Python Developer with expertise in web scraping, automation tools, and related frameworks. Key Responsibilities Design, develop, and maintain scalable web scraping scripts and frameworks. Lead a team of Python developers in project planning, task allocation, and code reviews. Work w...

As a Python Web Scraper at HiLabs in Bengaluru, Karnataka, you will play a crucial role in designing and building scalable web scraping solutions using Python/PySpark. Your responsibilities will include developing enterprise-grade scraping services, working with structured and unstructured data, implementing data validation processes, and collaborating with cross-functional teams to ensure smooth data flow between systems. Your technical expertise in Python, web scraping tools and libraries, PySpark, cloud-based platforms, and databases will be essential for optimizing data workflows and ensuring data accuracy, consistency, and availability. **Responsibilities:** - Design and build scalable,...

We are looking for an enthusiastic and proactive Python Developer with core Python expertise and hands-on experience in Generative AI (GenAI) to join our development team. Experience Required: 2-3 Years Mode of Work: On-Site Only (Mohali, Punjab) Mode of Interview : Face to Face( On-Site) Contact for Queries: +91-9872993778 (Mon–Fri, 11 AM – 6 PM) Note: This number will be unavailable on weekends and public holidays. Key Responsibilities: Backend Development: Assist in the development of clean, efficient, and scalable Python applications to meet business needs. Generative AI Experience: Working knowledge and experience in building applications using GenAI technologies is mandatory. API Integ...

As a backend developer at our company, you will be responsible for developing robust and efficient backend systems using Node.js, Go, and Python. You should have a solid background in computer science, engineering, or a related field with at least 6 years of experience in a high-scale consumer internet startup. Your role will involve working with machine learning frameworks like TensorFlow or PyTorch and developing web crawlers and scrapers using tools such as Scrapy. Additionally, you should have a strong understanding of cloud infrastructure, DevOps practices, and CI/CD pipelines. Experience in handling large-scale data processing and storage will be beneficial for this role. Qualification...

We are looking for an enthusiastic and proactive Python Developer with core Python expertise and hands-on experience in Generative AI (GenAI) to join our development team. Experience Required: 2-3 Years Mode of Work: On-Site Only (Mohali, Punjab) Mode of Interview : Face to Face( On-Site) Contact for Queries: +91-9872993778 (Mon–Fri, 11 AM – 6 PM) Note: This number will be unavailable on weekends and public holidays. Key Responsibilities: Backend Development: Assist in the development of clean, efficient, and scalable Python applications to meet business needs. Generative AI Experience: Working knowledge and experience in building applications using GenAI technologies is mandatory. API Integ...

Job Requirements: ● 4+ years of professional experience in backend development with TypeScript and Python. ● Strong understanding of TypeScript-based server-side frameworks (e.g., Node.js, NestJS, Express) and Python frameworks (e.g., FastAPI, Django, Flask). ● Experience with tools and libraries for web scraping (e.g., Scrapy, BeautifulSoup, Selenium, Puppeteer) ● Hands-on experience with Temporal for creating and orchestrating workflows ● Proven hands-on experience in web scraping, including crawling, data extraction, deduplication, and handling dynamic websites. ● Proficient in implementing proxy solutions and handling bot-detection challenges (e.g., Cloudflare). ● Experience working with...

Overview We're looking for a data-obsessed explorer who can build and maintain pipelines that collect, clean, and enhance large volumes of data, then apply AI tools to keep it accurate, useful, and ready for analysis. This is initially a project-based role with the possibility of evolving into a full-time contract based on performance and business needs. Key Responsibilities Data Acquisition & Scraping Design, develop, and maintain scalable web-scraping systems and APIs to collect structured and unstructured data from diverse sources. Ensure compliance with data privacy laws (GDPR, CCPA) and site-specific terms of service. Data Enrichment & Transformation Implement pipelines to clean, normal...

Looking for someone who thrives in a full-stack Python + QA + Database + AI environment and is excited to grow technically. If you’re a passionate Python engineer with 3–5 years of hands-on experience. You’ve built web services, supported QA/automation workflows, and worked confidently across SQL/NoSQL databases. Ideally, you’ve also experimented with AI/ML tooling or frameworks, so this opportunity is for you. Responsibilities Develop, test, and maintain Python-based backend services using Django, FastAPI, or Flask Execute efficient web scraping tasks using BeautifulSoup or Scrapy Automate browser workflows using Selenium Write scalable database queries and schema designs for SQL (PostgreSQ...

ABOUT THE PYTHON DATA ENGINEER ROLE: We are looking for a skilled Python Data Engineer to join our team and work on building high-performance applications and scalable data solutions. In this role, you will be responsible for designing, developing, and maintaining robust Python-based applications, optimizing data pipelines, and integrating various APIs and databases. This is more than just a coding role—it requires strategic thinking, creativity, and a passion for data-driven decision-making to drive results and innovation. KEY RESPONSIBILITIES: Develop, test, and maintain efficient Python applications. Design, develop, and maintain ETL pipelines for efficient data extraction, transformation...

Position: Python Developer Location: Remote (India) Salary: 80-90k pm Experience: 4+ years Job Description: We’re looking for a Python Developer with solid hands-on experience in job and web data scraping, AI-enabled data processing, and building scalable ETL pipelines. You’ll design, implement, and operate scraping and enrichment systems that feed recruitment and analytics products. Familiarity with Aspen/Webspidermount and Kadoa is a plus. QA-minded engineers who care about data accuracy and observability will thrive in this role. Key Responsibilities: Design, develop, and maintain AI-powered web and job-scraping pipelines. Extract structured and unstructured data from job boards, company ...

RPAMumbai Posted On 26 Sep 2025 End Date 25 Nov 2025 Required Experience 4 - 5 Years Basic Section No. Of Openings 1 Designation Senior RPA Engineer Closing Date 25 Nov 2025 Organisational MainBU Full Stack Automation Engineering Sub BU RPA Country India Region India 2 State Maharashtra City Mumbai Working Location Mumbai Client Location NA Skills Skill PYTHON Highest Education No data available CERTIFICATION No data available Working Language No data available JOB DESCRIPTION Key Responsibilities 1. Design, develop, and maintain robust Python scripts for data processing, cleaning, and transformation. 2. Work extensively with Pandas for complex data manipulation and reporting. 3. Automate Ex...

About the role: We are seeking a highly motivated and detail-oriented AI Data Collection Expert to join our innovative AI/ML team. You will be instrumental in the end-to-end process of gathering, annotating, and curating high-quality datasets that serve as the foundation for our cutting-edge AI and machine learning models. This role requires a meticulous eye for detail, a proactive approach to problem-solving, and a commitment to data integrity and quality. Key responsibilities: Data sourcing and acquisition: Collaborate with AI/ML researchers and data scientists to understand data requirements and execute comprehensive data acquisition strategies. Dataset curation and management: Gather, cu...

Location: Remote Duration: 2-6 months Type: Unpaid Internship About Collegepur Collegepur is an innovative platform dedicated to providing students with comprehensive information about colleges, career opportunities, and educational resources. We are building a dynamic team of talented individuals passionate about data-driven decision-making. Job Summary We are seeking a highly motivated Data Science Intern to join our team. This role involves working on data collection, web scraping, analysis, visualization, and machine learning to derive meaningful insights that enhance our platform’s functionality and user experience. Responsibilities: ● Web Scraping: Collect and extract data from website...

Job Title: Sr Python Developer – Web Scraping & Automation Company: Actowiz Solutions Location: Ahmedabad Job Type: Full-time About Us Actowiz Solutions is a leading provider of data extraction, web scraping, and automation solutions. We empower businesses with actionable insights by delivering clean, structured, and scalable data through cutting-edge technology. Role Overview We are looking for a highly skilled Python Developer with expertise in web scraping, automation tools, and related frameworks. Key Responsibilities Design, develop, and maintain scalable web scraping scripts and frameworks. Lead a team of Python developers in project planning, task allocation, and code reviews. Work wi...

Position: Data Mining Analyst Please Note: Only Candidates with 2-3 years of experience should apply. This is a Delhi-based position and work from office only! Work Location: Sector 23 Dwarka, Delhi We are seeking a skilled Data Mining Analyst with expertise in automating data extraction processes from web platforms. The ideal candidate will be experienced in Python, Selenium, Pandas, SQL, and APIs, with the ability to design and implement efficient and scalable data scraping systems. If you have a passion for working with data and a solid understanding of web technologies, we want to hear from you! Key Responsibilities: Design, develop, and maintain robust web scraping solutions to extract ...

Note - Looking for Full Stack Developer with Language Skill set mainly focusing on Laravel, React JS, who has worked for 3+ years on the same. Job Location: Mumbai Basic KRA’s  Participating in the design and creation of scalable software  Writing clean, functional code on the front- and back-end  Testing and fixing bugs or other coding issues Job brief We are looking for a full stack developer to produce scalable software solutions. You’ll be part of a cross-functional team that’s responsible for the full software development life cycle, from conception to deployment. As a full stack developer, you should be comfortable around both front-end and back-end coding languages, development fra...

1) Bypass Captcha v2 2) web scraping using python programming library Scrapy, Selenium, beautiful soup and splash. 3) Data mining from given URL. 4) Lead generation emails, phone number, images ,address scraping. 5) I can add selenium and splash for JS rendering. 6) Data extraction from website and save that in any format. 7) Web scraping, data extration , python, web crawling, python automation, data scraping, selenium automation , data mining , api devlopment, rest api 8) Proxies and user agent rotation to prevent IP blockage. 9) Data save in any format (database,json,google sheet,csv,excel,GoogleSheet). 10) Web Scraping language python. 11) e-commerce site scraping with variations. 12) Se...