448 Scrapy Jobs - Page 15

Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm. In this role, you will collaborate with individuals across various company departments to shape and innovate new products and features for our platform, enhancing existing ones. You will have a large degree of independence and trust, but you won't be isolated; the support of the Engineering team leads, the Product team leads, and every other technology team member is behind you. This is an opportunity to join a team-first meritocracy and help grow an entrepreneurial group inside Alternative Path. You will be asked to contribute, given ownership, and will be expected to mak...

About A highly motivated and passionate individual who has experience in executing end to end application deliveries; bringing them to production with high quality. Passionate about building flexible and scalable solutions with an eye for details and can weigh pros and cons to find the best possible solutions. As a Python Backend Developer, you should be comfortable around Python development frameworks & library usages. R&r Design and Develop Major software components, systems, and features for Next. Gen Rule Engine & Risk Platform for the Digital Lending Responsibilities also include Guiding Junior members, Creating Interfaces, Integration with other applications & Databases, and debugging ...

About The Company Hypersonix.ai is disrupting the e-commerce space with AI, ML, and advanced decision-making capabilities to drive real-time business insights. Built from the ground up using modern technologies, Hypersonix simplifies data consumption for customers across various industry verticals. We are seeking a well-rounded, hands-on product leader to help manage key capabilities and features in our platform. Position Overview We are seeking a highly skilled Web Scraping Architect to join our team. The successful candidate will be responsible for designing, implementing, and maintaining web scraping processes to gather data from various online sources efficiently and accurately. As a Web...

Job description KrawlNet Technologies provides services to advertiser & publisher to run the affiliate programs effectively. KrawlNet aggregates products from various retailers that can readily and effectively allow publishers & analytics to grow their business. An integral part of offerings is web-scale crawl and extraction. Our objective is to solve the business problems faced in the industry and provide associated services of cleansing, normalizing the web content. Responsibility: As a software developer, in this full-time permanent role, you will be responsible for Ensuring an uninterrupted flow of data from the various sources by crawling the web Extracting & managing large volumes of s...

eGrove Systems is looking for Django Developer to join its team of experts. Skill : Django Developer Exp : 4+Yrs NP : Immediate to 15Days Location : Chennai/Madurai Interested candidates can send your resume to annie@egrovesys.com Required Skills: - · 3+ years of Strong experience in Python & 2 years in Django Web framework. · Experience or Knowledge in implementing various Design Patterns. · Good Understanding of MVC framework & Object-Oriented Programming. · Experience in PGSQL / MySQL and MongoDB. · Good knowledge in different frameworks, packages & libraries Django/Flask, Django ORM, Unit Test, NumPy, Pandas, Scrapy etc., · Experience developing in a Linux environment, GIT & Agile method...

Job Summary: We’re looking for a passionate and driven Machine Learning Engineer with 1 year of hands-on experience working with Large Language Models (LLMs), Natural Language Processing (NLP), Python, and web scraping. The ideal candidate should have practical exposure to real-world NLP tasks and be comfortable fine-tuning models and building end-to-end pipelines. ✅ Key Responsibilities: Work on fine-tuning and integrating LLMs for various use cases. Build and maintain NLP pipelines for text classification, summarization, or Q&A systems. Perform web scraping to gather structured and unstructured data using Python libraries like BeautifulSoup, Scrapy, or Selenium. Collaborate with the team t...

Bloom AI is a modern intelligence firm that accelerates decision-making through AI-driven synthesized intelligence. We empower enterprises to unlock the value of data with human-like synthesis and decision intelligence at scale. Our proprietary tools and solutions are trusted by investment managers, insurance, private equity, and Fortune 1000 companies for more informed, efficient, and productive business practices. Bloom AI is in Raleigh (U.S.) and New Delhi (India). Responsibilities: Design, develop, and maintain scalable Python-based applications with a focus on data scraping, data ingestion, and API integration. Build and manage web scrapers that are robust, fault-tolerant, and adaptable...

About Sellmark Sellmark is committed to creating brands that foster memories and traditions by producing industry-leading outdoor lifestyle products. We promote a healthy outdoor lifestyle and drive innovation through positive leadership, strong ethics, and unwavering dedication. Our team-oriented culture encourages self-growth, mutual respect, and a passion for excellence—both at work and beyond. We seek individuals who bring passion to everything they do, instill confidence, trust, and respect, and inspire success while building strong relationships. If you're looking for a dynamic, professional, and supportive team, we’d love to have you join us. Job Summary We are seeking a hands-on Web ...

About Us: Upscrape is a fast-growing data automation and web scraping company building advanced scraping systems, custom data pipelines, and API-driven solutions for enterprise clients. We work on complex real-world challenges that require precision, scale, and expertise. As we continue to grow, we are looking to bring on an experienced developer to join our core technical team. Position Overview: We are hiring a full-time Python developer with strong experience in web scraping, browser automation, and backend API development. The ideal candidate has previously built production-level scraping systems, understands anti-bot protections, and can independently manage end-to-end data extraction w...

Responsibilities: * Design, develop, test and maintain scalable Python applications using Scrapy, Selenium and Requests. * Implement anti-bot systems and data pipeline solutions with Airflow and Kafka. Share CV on recruitment@fortitudecareer.com Flexi working Work from home

Job Title: Data Engineer Location: Chennai, India Experience: 5+ years Work Mode: Full-time (9am-6:30pm), In-office (Monday to Friday) Department: Asign Data Sciences About Us At Asign, we are revolutionizing the art sector with our innovative digital solutions. We are a passionate and dynamic startup dedicated to enhancing the art experience through technology. Join us in creating cutting-edge products that empower artists and art enthusiasts worldwide. Role Overview We are looking for an experienced Data Engineer with a strong grasp of ELT architecture and experience to help us build and maintain robust data pipelines. This is a hands-on role for someone passionate about structured data, a...

Note: Please don't apply if you do not have at least 5 years of Scrapy experience Location: KOLKATA ------------ We are seeking a highly experienced Web Scraping Expert (Python) specialising in Scrapy-based web scraping and large-scale data extraction. This role is focused on building and optimizing web crawlers, handling anti-scraping measures, and ensuring efficient data pipelines for structured data collection. The ideal candidate will have 6+ years of hands-on experience developing Scrapy-based scraping solutions, implementing advanced evasion techniques, and managing high-volume web data extraction. You will collaborate with a cross-functional team to design, implement, and optimize sca...

Job Title: Data Analyst (with Data Visualization & Web Scraping Skills) Location: Hyderabad Experience Required: 1-2 Years Employment Type: Full-time J ob Summary: We are seeking a highly motivated and detail-oriented Data Analyst with strong expertise in data visualization, data analysis, and web scraping . The ideal candidate will be responsible for collecting, processing, and analyzing large sets of data from multiple sources and presenting them in meaningful formats to support business decisions. K ey Responsibilities: Perform end-to-end data analysis and reporting using structured and unstructured data. Build insightful and interactive dashboards and reports using tools like Power BI, T...

Interested candidates may share their profiles at gauri.shedge@ambitsoftware.com Below is the Job Description for your reference: Roles & Responsibilities: Design, develop and maintain Scrapy web crawlers. Leverage the platform and open-source projects to perform distributed information extraction, retrieval, and data processing. Identify and resolve performance and scalability issues with distributed crawling at scale. Help identify, debug and fix problems with open source projects, including Scrapy. Requirements: 3+ years of software development experience in Python. Solid Python knowledge. Familiarity with Linux/UNIX, HTTP, HTML, JavaScript, and Networking. Good communication skills in wr...

Designation- Python Developer & Web Crawling Experience- 3+ Years Location- Gurgaon, Haryana ABOUT US: Founded in 1998, BYLD is the largest group in the South Asian region, offering technology-enabled HR and business productivity solutions. We have served 5,00,000+ individuals, worked with more than 50% of the Fortune 500 and over 60% of the Business World top 1000 companies. Please read about us www.byldgroup.com Role & Responsibilities: Collaborate with cross-functional teams to define, design, and implement new features. Ensure the performance, quality, and responsiveness of web crawling systems. Identify and correct bottlenecks and fix bugs in web crawling processes. Help maintain code q...

We are seeking a highly skilled Scraping Expert to join our data team and drive automated extraction of tender information from various Indian portals, including the Government e-Marketplace (GeM). The ideal candidate will leverage advanced scraping techniques, Optical Character Recognition (OCR), and data validation methods to collect, process, and deliver high-quality tender datasets for our stakeholders. Key Responsibilities Develop and maintain robust web-scraping pipelines to extract tender information from GeM, state/central portals, and private aggregators. Integrate OCR tools to accurately extract text from scanned PDFs and tender-related images. Parse, normalize, and structure scrap...

Job Description: This position is for a senior software engineer who is passionate about solving challenging business problems and has - ✓ Strong experience in developing ETL pipeline using SQL, T-SQL, stored procedures, SQL server, performance tuning of queries and stored procedures. ✓ Experience in troubleshooting and resolving database integrity issues, performance issues, deadlock issues, connectivity issues, etc. ✓ Hands-on and strong knowledge of data frames and pandas in Python. Reading data from excel, CSV, SQL, and JSON and writing to SQL and JSON. Sql ✓ Excellent communication skills and client-facing experience. Strong experience in DDL and DML commands, UNIONS, JOINS, Subqueries,...

Job Summary We are seeking a highly skilled and experienced Senior Data Scraping Engineer to design, develop, and orchestrate robust web scraping frameworks. The ideal candidate will have 8-10 years of experience in ethical web scraping, including navigating login-protected websites, solving CAPTCHAs, and managing proxies or third-party services. You will be responsible for building scalable, efficient, and compliant scraping pipelines using industry-standard programming languages and tools, ensuring data integrity and adherence to legal and ethical guidelines. Key Responsibilities Framework Development: Design and implement end-to-end web scraping frameworks to extract structured data from ...

eGrove Systems Pvt Ltd is looking for Senior Python Developer to join its team of experts. Skill: - Senior Python Developer Exp: 4+Yrs NP: Immediate to 15days Location: Chennai/Madurai Interested candidates can send your resume to annie@egrovesys.com Skills Requirement: - Hands-on software development skills, deep technical expertise across the entire software delivery process. Forward-thinking skilled individual. Structured, organized, and a good communicator. Write reusable, Testable, and Efficient code. Required Skills: - 3+ years of Strong experience in Python & 2 years in Django Web framework. Experience or Knowledge in implementing various Design Patterns. Good Understanding of MVC fra...

We are seeking an experienced and motivated Data Scraper / Lead Generator to join our fast-growing team in Mumbai. The ideal candidate will have a strong background in generating leads through web scraping and online research, specifically targeting the Europe, UK, USA and other international markets.. Key Responsibilities:. Conduct in-depth online research to identify potential leads in targeted geographies. Use advanced web scraping tools and techniques to extract accurate contact and business data from various sources.. Validate and verify collected data to ensure quality and relevance.. Maintain and manage a structured database of leads for outreach and tracking.. Collaborate closely wit...

Client : Our client is a leading Software as a Service (SaaS) company that specializes in the transformation of data in the US healthcare industry through cutting-edge Artificial Intelligence (AI) solutions. Requirements : Our client is looking for Python Web Scraper, who should continually strive to advance engineering excellence and technology innovation. The mission is to power the next generation of digital products and services through innovation, collaboration, and transparency. You will be a technology leader and doer who enjoys working in a dynamic, fast-paced environment. Responsibilities : - Design and build scalable, reliable web scraping solutions using Python/PySpark. - Develop ...

Job Title: MERN stack Developer Location: Mohali, India (On-site) Experience Required: Minimum 3 Years Job Summary: We are seeking a highly skilled Software Engineer with hands-on experience in the MERN stack (MongoDB, Express.js, React.js, Node.js) and strong scripting and automation capabilities using Python. The ideal candidate should be comfortable working on server deployments (VPS), automation tasks, and have a solid understanding of cloud services and DevOps tools. Key Responsibilities: Develop and maintain scalable web applications using the MERN stack. Write and maintain scripts for automation tasks using Python and relevant frameworks. Manage server deployments on VPS environments,...

Job Description : Should have 4+ years hands-on experience in algorithms and implementation of analytics solutions in predictive analytics, text analytics and image analytics Should have handson experience in leading a team of data scientists, works closely with client’s technical team to plan, develop and execute on client requirements providing technical expertise and project leadership. Leads efforts to foster innovative ideas for developing high impact solutions. Evaluates and leads broad range of forward looking analytics initiatives, track emerging data science trends, and knowledge sharing Engaging key stakeholders to source, mine and validate data and findings and to confirm business...

Hi, With reference to your profile on job portal we would like to share an opportunity with you for one of our Gurgaon Based client for Gurgaon location. Please find below the details regarding same: Location: Remote/WFH Experience: 6-10 Years Title: Manager-Data Engineer (Web Scraping) Notice Period: Only Immediate Joiner - 30 Days Max Job Responsibilities Technical Skills Required: Proficiency in Python and SQL/Database skills is required. Must have strong expertise in using Pandas library (Python). Experience with web technologies (HTML/JS, APIs, etc.) is essential. Should have a good understanding of tools such as Scrapy, BeautifulSoup, and Selenium. Responsible for reviewing and approvi...

Be a part of India’s largest and most admired news network! Network18 is India's most diversified Media Company in the fast growing Media market. The Company has a strong Heritage and we possess a strong presence in Magazines, Television and Internet domains. Our brands like CNBC, Forbes and Moneycontrol are market leaders in their respective segments. The Company has over 7,000 employees across all major cities in India and has been consistently managed to stay ahead of the growth curve of the industry. Network 18 brings together employees from varied backgrounds under one roof united by the hunger to create immersive content and ideas. We take pride in our people, who we believe are the ke...