448 Scrapy Jobs - Page 6

About the Role: We're a fast-paced AI startup revolutionizing machine learning through high-quality data. We're hiring a Web Data Engineer Intern for a 3-6 month remote/part-time role (10-20 hours/week). You'll build and optimize web scraping tools, APIs, and data pipelines to fuel our AI engine with diverse, high-quality datasets. This is a hands-on opportunity to create innovative data solutions, hone your coding skills, and contribute to cutting-edge AI projects. What You'll Do: Develop Data Tools: Design and implement web scrapers, crawlers, and automation scripts (Python preferred) to collect data from websites, APIs, and public datasets (e.g., social media, news, open repositories). Op...

We are looking for a skilled Web Crawling Engineer with strong expertise in Python and hands-on experience building scalable crawlers and scrapers. The ideal candidate should have deep knowledge of crawling frameworks, anti-blocking techniques, and proxy management, along with experience solving challenges like captchas and rate-limiting. Key Responsibilities Design, develop, and maintain scalable and efficient web crawlers for data extraction. Work with Scrapy, Requests, and other Python libraries to implement crawling solutions. Handle anti-scraping measures, including IP blocks, rate limits, and captchas. Implement and manage proxy rotation and session management strategies. Ensure high-q...

Full-Stack Web Scraping Engineer (Python & JavaScript - 4 to 8 Years) Experience: 3+ Years Location: Remote Mode of Engagement: Full-time No of Positions: 3 Educational Qualifications: Bachelor's degree in Computer Science, Information Technology Industry: IT / Software Development Notice Period: Immediate Joiners Preferred What We Are Looking For: Strong expertise in web scraping with hands-on experience in large-scale data collection systems. Proficient in Python, including Scrapy, Requests, Playwright, and Selenium. Skilled in JavaScript for web scraping and automation tasks. Capable of designing, building, and maintaining robust and scalable scrapers for a variety of websites. Experience...

Python/JavaScript Developer – Web Scraping & AI/ML (3 to 6 years) Experience: 3+ Years Location: Remote Mode of Engagement: Full-time No of Positions: 3 Educational Qualifications: Bachelor's degree in Computer Science, Information Technology Industry: IT / Software Development Notice Period: Immediate Joiners Preferred What We Are Looking For: Strong expertise in web scraping with hands-on experience in large-scale data collection systems. Proficient in Python, including Scrapy, Requests, Playwright, and Selenium. Skilled in JavaScript for web scraping and automation tasks. Capable of designing, building, and maintaining robust and scalable scrapers for a variety of websites. Experience wit...

Web Scraping with Python & JavaScript (3 to 6 years) Experience: 3+ Years Location: Remote Mode of Engagement: Full-time No of Positions: 3 Educational Qualifications: Bachelor's degree in Computer Science, Information Technology Industry: IT / Software Development Notice Period: Immediate Joiners Preferred What We Are Looking For: Strong expertise in web scraping with hands-on experience in large-scale data collection systems. Proficient in Python, including Scrapy, Requests, Playwright, and Selenium. Skilled in JavaScript for web scraping and automation tasks. Capable of designing, building, and maintaining robust and scalable scrapers for a variety of websites. Experience with AI-driven t...

Position: Data Mining Analyst Please Note: Only Candidates with 2-3 years of experience should apply. This is a Delhi-based position and work from office only! Work Location: Sector 23 Dwarka, Delhi We are seeking a skilled Data Mining Analyst with expertise in automating data extraction processes from web platforms. The ideal candidate will be experienced in Python, Selenium, Pandas, SQL, and APIs, with the ability to design and implement efficient and scalable data scraping systems. If you have a passion for working with data and a solid understanding of web technologies, we want to hear from you! Key Responsibilities: Design, develop, and maintain robust web scraping solutions to extract ...

Job Summary We are seeking a highly skilled and experienced Senior Data Scraping Engineer to design, develop, and orchestrate robust web scraping frameworks. The ideal candidate will have 8-10 years of experience in ethical web scraping, including navigating login-protected websites, solving CAPTCHAs, and managing proxies or third-party services. You will be responsible for building scalable, efficient, and compliant scraping pipelines using industry-standard programming languages and tools, ensuring data integrity and adherence to legal and ethical guidelines. Key Responsibilities Framework Development: Design and implement end-to-end web scraping frameworks to extract structured data from ...

We are looking for an enthusiastic and proactive Python Developer with core Python expertise and hands-on experience in Generative AI (GenAI) to join our development team. Experience Required: 2-3 Years Mode of Work: On-Site Only (Mohali, Punjab) Mode of Interview : Face to Face( On-Site) Contact for Queries: +91-9872993778 (Mon–Fri, 11 AM – 6 PM) Note: This number will be unavailable on weekends and public holidays. Key Responsibilities: Backend Development: Assist in the development of clean, efficient, and scalable Python applications to meet business needs. Generative AI Experience: Working knowledge and experience in building applications using GenAI technologies is mandatory. API Integ...

Position: Lead Generation Specialist Location: Remote - Frequent Visit to Delhi Employment Type: Full-time About Us We are specializing in delivering tailored technology and workforce solutions. We are looking for an experienced Lead Generation Specialist who can drive our client acquisition efforts, with strong expertise in web scraping, bulk email campaigns, and staffing industry lead generation processes. Key Responsibilities: Generate qualified leads for IT consulting and staffing services through multiple channels. Perform web scraping to identify prospects, contacts, and market opportunities. Build, manage, and optimize bulk email campaigns , ensuring deliverability and compliance. Set...

We are looking for an enthusiastic and proactive Python Developer with core Python expertise and hands-on experience in Generative AI (GenAI) to join our development team. Experience Required: 2-3 Years Mode of Work: On-Site Only (Mohali, Punjab) Mode of Interview : Face to Face( On-Site) Contact for Queries: +91-9872993778 (Mon–Fri, 11 AM – 6 PM) Note: This number will be unavailable on weekends and public holidays. Key Responsibilities: Backend Development: Assist in the development of clean, efficient, and scalable Python applications to meet business needs. Generative AI Experience: Working knowledge and experience in building applications using GenAI technologies is mandatory. API Integ...

Role Overview: You will be part of Stylumia, a Deep Tech company focused on solving fundamental retail challenges in the fashion and lifestyle industry. With your strong programming skills in Python and Node.js, you will develop and maintain web scraping scripts to extract data from various sources. Your responsibilities will include collaborating with the data team, optimizing scraping processes, conducting data quality assessments, troubleshooting issues, and implementing data storage solutions using SQL databases, Git, Redis, and Elasticsearch. Key Responsibilities: - Develop and maintain web scraping scripts to extract data from a variety of sources. - Collaborate with the data team to u...

Responsibilities • Develop Quick Process Automations (QPAs) using one of the following platforms - VBA, MS Office pack, Java, SQL, Python. • Create appropriate project documentation and train operations team on how to use the developed tool. • Follow standard team coding structure and maintenance of already developed solutions. • Proactive to identify workarounds, fix bugs, implement changes and come up with out of the box solutions • Manage project delivery throughout entire lifecycle: analyze, plan, design, build, test, deploy, maintain • Self-driven, being able to work independently and take the project to completion with minimum supervision • Self-learner, self-starter, reach out to coll...

Sigmoid enables business transformation using data and analytics, leveraging real-time insights to make accurate and fast business decisions, by building modern data architectures using cloud and open source. Some of the world’s largest data producers engage with Sigmoid to solve complex business problems. Sigmoid brings deep expertise in data engineering, predictive analytics, artificial intelligence, and DataOps. Sigmoid has been recognized as one of the fastest growing technology companies in North America, 2021, by Financial Times, Inc. 5000, and Deloitte Technology Fast 500. Offices: New York | Dallas | San Francisco | Lima | Bengaluru This role is for our Bengaluru office. Why Join Sig...

We are seeking highly motivated and results-driven Business Development Executives to join our sales team. The successful candidate will be responsible for supporting overall sales operations, strengthening client relationships, and contributing to revenue growth. A core aspect of this role will be lead generation and data acquisition from digital platforms to build and maintain a qualified sales pipeline. Key Responsibilities Lead Generation: Identify, qualify, and generate prospective leads through online tools, platforms, and databases (e.g., LinkedIn, industry events, company websites, and email sources). Client facing capabilities to include ability to pitch new business and ideas to po...

Python programming,data science methodologies AI systems or chatbot development Deep learning, transformer, GAN’s , VAE’s and LLM processing, prompt engineering TensorFlow, PyTorch, spaCy send cv - sairamglobal.hr@gmail.com Required Candidate profile Education 15 years full time regular study required Notice period - 0 to 45 days Location- Bangalore, Hyderabad, Chennai Good Communication skills required

Key Responsibilities: Develop and maintain automated web scraping scripts using Python libraries such as Beautiful Soup, Scrapy, and Selenium. Optimize scraping pipelines for performance, scalability, and resource efficiency. Handle dynamic websites, CAPTCHA-solving, and implement IP rotation techniques for uninterrupted scraping. Process and clean raw data, ensuring accuracy and integrity in extracted datasets. Collaborate with cross-functional teams to understand data requirements and deliver actionable insights. Leverage APIs when web scraping is not feasible, managing authentication and request optimization. Document processes, pipelines, and troubleshooting steps for maintainable and re...

We are seeking an experienced Web Scraping Engineer with deep expertise in Scrapy to develop, maintain, and optimize web crawlers. The ideal candidate will have a strong background in extracting, processing, and managing large-scale web data efficiently. Responsibilities : - Write and maintain web scraping scripts using Python Optimize custom web scraping tools and workflows. - Familiarity with Python and web scraping frameworks (Scrapy, Selenium, BeautifulSoup, Requests, Playwright). - Troubleshoot and resolve scraping challenges, including CAPTCHAs, rate limiting, and IP blocking. - Experience with proxy management (Rotating IPs, VPNs, Residential proxies, etc.) - Handle dynamic content us...

Position: Lead Developer Experience: 4+ Years Location: Ahmedabad (Onsite) Employment Type: Full-Time Salary: As per industry standards Must Have Skills:- TypeScript, JavaScript, Web Scrapping & Python Position Summary: We are seeking a skilled and experienced Backend Developer with strong expertise in TypeScript, Python, and web scraping. You will be responsible for designing, developing, and maintaining scalable backend services and APIs that power our data-driven products. Your role will involve collaborating with cross-functional teams, optimizing system performance, ensuring data integrity, and contributing to the design of efficient and secure architectures. Job Responsibility: ● Desig...

We are hiring a Python Developer (0.52 yrs) for web scraping. Responsibilities: build & optimize scrapers, handle dynamic sites, proxies & CAPTCHAs, ensure data accuracy. Skills: Python, Scrapy, BeautifulSoup, Selenium, regex, debugging. Provident fund Health insurance

Position: Data Mining Analyst Please Note: Only Candidates with 2-3 years of experience should apply. This is a Delhi-based position and work from office only! Work Location: Sector 23 Dwarka, Delhi We are seeking a skilled Data Mining Analyst with expertise in automating data extraction processes from web platforms. The ideal candidate will be experienced in Python, Selenium, Pandas, SQL, and APIs, with the ability to design and implement efficient and scalable data scraping systems. If you have a passion for working with data and a solid understanding of web technologies, we want to hear from you! Key Responsibilities: Design, develop, and maintain robust web scraping solutions to extract ...

Role Overview: As a Tech Lead specializing in Python & Web Data Solutions, you will play a crucial role in leading a team of developers to design, develop, and implement scalable data scraping solutions. Your expertise in advanced scraping techniques, reverse engineering, and automation will be vital in driving the team towards success. Key Responsibilities: - Design and develop scalable data scraping solutions using tools like Scrapy and Python libraries. - Lead and mentor a team of 5+ developers, managing project timelines and deliverables. - Implement advanced blocking and captcha-solving techniques to bypass scraping restrictions. - Conduct source code reverse engineering and automate we...

As a Data Extraction Engineer at Relu Consultancy, your role will involve designing, implementing, and maintaining robust data scraping solutions using Python (Selenium) to drive forward cutting-edge projects. You will have the opportunity to enjoy a work schedule tailored to your needs. Key Responsibilities: - Work on web scraping or data extraction through Selenium/Scrapy or other frameworks and related libraries. - Utilize working knowledge in various DBSs, message queues & web Restful APIs. - Design, build, and maintain high-performance, reusable, and reliable Python code. - Ensure the best possible performance, quality, and responsiveness of the application. - Identify and correct bottl...

As an entrepreneurial, passionate, and driven Data Engineer at Startup Gala Intelligence backed by Navneet Tech Venture, you will play a crucial role in shaping the technology vision, architecture, and engineering culture of the company right from the beginning. Your contributions will be foundational in developing best practices and establishing the engineering team. **Key Responsibilities:** - **Web Scraping & Crawling:** Build and maintain automated scrapers to extract structured and unstructured data from websites, APIs, and public datasets. - **Scalable Scraping Systems:** Develop multi-threaded, distributed crawlers capable of handling high-volume data collection without interruptions....

As a Node.js Engineer at DataWeave, you will be responsible for designing and developing web scraping and automation projects using Node.js and Python. Your role will involve optimizing processes for performance and scalability, troubleshooting and debugging issues, and collaborating with team members to enhance overall architecture and performance. Stay updated with new technologies and advancements in web scraping and automation to ensure the projects are cutting-edge. **Key Responsibilities:** - Design and develop web scraping and automation projects using Node.js and Python - Optimize processes for performance and scalability - Troubleshoot and debug issues - Collaborate with team member...

Responsibilities: * Design, develop & maintain web scrapers using Scrapy & Python * Collaborate with cross-functional teams on project requirements * Ensure data accuracy & compliance with industry standards Work from home