445 Scrapy Jobs

What’s important to us: Techversant is seeking a Senior Python Developer who can strike the right balance between innovation and delivering practical, client-focused solutions. The ideal candidate will be eager to learn, collaborate effectively within a team, and adapt to the languages, tools, and applications used in our environment. Key Responsibilities: Minimum 4 years of experience as a Python Developer. Proven expertise in the Flask framework. Strong hands-on experience in developing, testing, and maintaining production grade Python applications. Ability to design and implement technical solutions based on client requirements. In-depth understanding of software development methodologies...

What’s important to us: Techversant is seeking a Team Lead- Python who can strike the right balance between innovation and delivering practical, client-focused solutions. The ideal candidate will be eager to learn, collaborate effectively within a team, and adapt to the languages, tools, and applications used in our environment. Job Description Python Team Lead with more than 7+ years of experience. Expert in Django, Flask,FastAPI. You are expected to create technical designs that support varying client requirements. Should be capable of evaluating project requirements and preparing estimates. More than two years of extensive and production level grade coding experience in python. Knowledge ...

Position: Data Engineer Experience: 6 Months to 3 Years Location: Remote Joining: Immediate Joiners Preferred About the Role: We are looking for a skilled Data Engineer with strong Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization. The ideal candidate should be capable of building data pipelines, performing web scraping, and generating actionable insights through dashboards and reports. Key Responsibilities: Develop, test, and maintain efficient Python scripts for data collection and transformation. Design and implement web scraping solutions to extract structured and unstructured data from diverse sources. Perform data cleaning, ...

Data Engineer Experience: 5 to 9 Years Location: Remote (Work from Home) / Bangalore / India Mode of Engagement: Full-time No. of Positions: 2 Educational Qualification: B.E / B.Tech / M.Tech / MCA / Computer Science / IT Industry: IT / Data / AI / LegalTech / Enterprise Solutions Notice Period: Immediate What We Are Looking For: 5–9 years of strong experience in Python-based data engineering and end-to-end data pipeline development . Hands-on expertise in data extraction, transformation, and automation using Python, SQL, and cloud-based tools. Proven ability in building scalable APIs, microservices, and ETL workflows with Docker/Kubernetes. Working knowledge of AWS , PostgreSQL/MySQL , and ...

Position: Data Mining Analyst Please Note: Only Candidates with 2-3 years of experience should apply. This is a Delhi-based position and work from office only! Work Location: Sector 23 Dwarka, Delhi We are seeking a skilled Data Mining Analyst with expertise in automating data extraction processes from web platforms. The ideal candidate will be experienced in Python, Selenium, Pandas, SQL, and APIs, with the ability to design and implement efficient and scalable data scraping systems. If you have a passion for working with data and a solid understanding of web technologies, we want to hear from you! Key Responsibilities: Design, develop, and maintain robust web scraping solutions to extract ...

The Team: The Automotive Insights - Supply Chain and Technology and IMR department at S&P Global is dedicated to delivering critical intelligence and comprehensive analysis of the automotive industry's supply chain and technology. Our team provides actionable insights and data-driven solutions that empower clients to navigate the complexities of the automotive ecosystem, from manufacturing and logistics to technological innovations and market dynamics. We collaborate closely with industry stakeholders to ensure our research supports strategic decision-making and drives growth within the automotive sector. Join us to be at the forefront of transforming the automotive landscape with cutting-ed...

Data Systems Engineering Manager – Python Experience: 7 to 12 Years Location: Remote (Work from Home) / Bangalore / India Mode of Engagement: Full-time No of Positions: 2 Educational Qualification: B.E / B.Tech / M.Tech / MCA / Computer Science / IT Industry: IT / Data / AI / LegalTech / Enterprise Solutions Notice Period: Immediate What We Are Looking For: 7–12 years of experience in managing end-to-end data systems , including data collection, API-driven data delivery, and AI model integrations . Proven expertise in Python-based data engineering , data scraping , and pipeline orchestration for large-scale analytics and automation projects. Strong background in building scalable APIs , micr...

Sigmoid enables business transformation using data and analytics, leveraging real-time insights to make accurate and fast business decisions, by building modern data architectures using cloud and open source. Some of the world’s largest data producers engage with Sigmoid to solve complex business problems. Sigmoid brings deep expertise in data engineering, predictive analytics, artificial intelligence, and DataOps. Sigmoid has been recognized as one of the fastest growing technology companies in North America, 2021, by Financial Times, Inc. 5000, and Deloitte Technology Fast 500. Offices: New York | Dallas | San Francisco | Lima | Bengaluru This role is for our Bengaluru office. Why Join Sig...

About Bloom AI Bloom AI is a modern intelligence firm that accelerates decision-making through AI-driven synthesized intelligence. We empower enterprises to unlock the value of data with human-like synthesis and decision intelligence at scale. Our proprietary tools and solutions are trusted by investment managers, insurance, private equity, and Fortune 1000 companies for more informed, efficient, and productive business practices. Bloom AI is in Raleigh (U.S.) and New Delhi (India). Join Our Team Our team is looking for a Python developer intern to help scale our data infrastructure. The candidate should have a a passion for AI and building intelligent solutions that drive real business impa...

Overview JOB DESCRIPTION Stats Perform is the market leader in sports tech. We provide the most trusted sports data to some of the world's biggest organizations, across sports, media, and broadcasting. Through the latest AI technologies and machine learning, we combine decades' worth of data with the latest in-game happenings. We then offer coaches, teams, professional bodies, and media channels around the world, access to the very best data, content, and insights. In turn, improving how sports fans interact with their favorite sports teams and competitions. How do they use it? Media outlets add a little magic to their coverage with our stats and graphics packages. Sportsbooks can offer bett...

We are looking for an enthusiastic and proactive Python Developer with core Python expertise and hands-on experience in Generative AI (GenAI) to join our development team. Experience Required: 2-3 Years Mode of Work: On-Site Only (Mohali, Punjab) Mode of Interview : Face to Face( On-Site) Contact for Queries: +91-9872993778 (Mon–Fri, 11 AM – 6 PM) Note: This number will be unavailable on weekends and public holidays. Key Responsibilities: Backend Development: Assist in the development of clean, efficient, and scalable Python applications to meet business needs. Generative AI Experience: Working knowledge and experience in building applications using GenAI technologies is mandatory. API Integ...

Senior Engineer - VBA Python: Elevate Your Impact Through Innovation & Learning Evalueserve is a global leader in delivering innovative and sustainable solutions to a diverse range of clients, including over 30% of Fortune 500 companies. With a presence in more than 45 countries across five continents, we excel in leveraging state-of-the-art technology, artificial intelligence, and unparalleled subject matter expertise to elevate our clients' business impact and strategic decision-making. Our team of over 4, 500 talented professionals operates in countries such as India, China, Chile, Romania, the US, and Canada. Our global network also extends to emerging markets like Colombia, the Middle E...

Position: Data Mining Analyst Please Note: Only Candidates with 2-3 years of experience should apply. This is a Delhi-based position and work from office only! Work Location: Sector 23 Dwarka, Delhi We are seeking a skilled Data Mining Analyst with expertise in automating data extraction processes from web platforms. The ideal candidate will be experienced in Python, Selenium, Pandas, SQL, and APIs, with the ability to design and implement efficient and scalable data scraping systems. If you have a passion for working with data and a solid understanding of web technologies, we want to hear from you! Key Responsibilities: Design, develop, and maintain robust web scraping solutions to extract ...

Head – Data Acquisition & Intelligence (Best for a strategic + technical leadership role) Job Description We are seeking a visionary and data-centric leader to head our Data Acquisition & Intelligence function. The candidate will be responsible for identifying, collecting, validating, and maintaining structured information of SMEs across India using AI, automation tools, and advanced data sourcing strategies. Key Responsibilities Design and lead large-scale data acquisition programs targeting SME PAN India (7.0Cr+ records) having all legal compliance as Indian Govt. Build and manage data collection systems leveraging AI, web scraping, APIs, and third-party data sources. Develop and oversee d...

As an experienced professional with over 7+ years of experience in Noida, your role will involve the following key responsibilities: - Reviewing and understanding business requirements to ensure timely completion of development tasks with minimal defects - Collaborating with a software development team to implement best practices and enhance the performance of Data applications for meeting client needs - Engaging with various teams and customers to translate their business challenges into innovative solutions - Conducting research on new Big Data technologies to align them with the business and technology strategy - Operating within a rapid and agile development process to accelerate speed t...

We are looking for an enthusiastic and proactive Python Developer with core Python expertise and hands-on experience in Generative AI (GenAI) to join our development team. Experience Required: 2-3 Years Mode of Work: On-Site Only (Mohali, Punjab) Mode of Interview : Face to Face( On-Site) Contact for Queries: +91-9872993778 (Mon–Fri, 11 AM – 6 PM) Note: This number will be unavailable on weekends and public holidays. Key Responsibilities: Backend Development: Assist in the development of clean, efficient, and scalable Python applications to meet business needs. Generative AI Experience: Working knowledge and experience in building applications using GenAI technologies is mandatory. API Integ...

We are looking for an enthusiastic and proactive Python Developer with core Python expertise and hands-on experience in Generative AI (GenAI) to join our development team. Experience Required: 2-3 Years Mode of Work: On-Site Only (Mohali, Punjab) Mode of Interview : Face to Face( On-Site) Contact for Queries: +91-9872993778 (Mon–Fri, 11 AM – 6 PM) Note: This number will be unavailable on weekends and public holidays. Key Responsibilities: Backend Development: Assist in the development of clean, efficient, and scalable Python applications to meet business needs. Generative AI Experience: Working knowledge and experience in building applications using GenAI technologies is mandatory. API Integ...

We are looking for an enthusiastic and proactive Python Developer with core Python expertise and hands-on experience in Generative AI (GenAI) to join our development team. Experience Required: 2-3 Years Mode of Work: On-Site Only (Mohali, Punjab) Mode of Interview : Face to Face( On-Site) Contact for Queries: +91-9872993778 (Mon–Fri, 11 AM – 6 PM) Note: This number will be unavailable on weekends and public holidays. Key Responsibilities: Backend Development: Assist in the development of clean, efficient, and scalable Python applications to meet business needs. Generative AI Experience: Working knowledge and experience in building applications using GenAI technologies is mandatory. API Integ...

Python Developer (Web Scraping) Location: Remote/Hybrid (India) Type: Full-time Experience: 2–6 years (open to strong juniors with solid projects) About the Role We’re looking for a Python developer who lives and breathes web scraping—someone who can design reliable, scalable crawlers, extract clean data from messy sites, and ship pipelines that run in production every day. What You’ll Do Build and maintain high-quality scrapers using Python (Scrapy/Playwright/Requests + lxml/BS4). Handle anti-bot defenses: rotating proxies, headless browsers, session management, retries, backoff, fingerprinting hygiene. Parse complex HTML/JSON/XML; normalize and validate data; design resilient selectors. Or...

Position: Data Mining Analyst Please Note: Only Candidates with 2-3 years of experience should apply. This is a Delhi-based position and work from office only! Work Location: Sector 23 Dwarka, Delhi We are seeking a skilled Data Mining Analyst with expertise in automating data extraction processes from web platforms. The ideal candidate will be experienced in Python, Selenium, Pandas, SQL, and APIs, with the ability to design and implement efficient and scalable data scraping systems. If you have a passion for working with data and a solid understanding of web technologies, we want to hear from you! Key Responsibilities: Design, develop, and maintain robust web scraping solutions to extract ...

As a Senior Python Developer at Actowiz Solutions, you will play a crucial role in designing, developing, and optimizing large-scale web scraping solutions using Scrapy and other tools. Your responsibilities will include: - Designing, developing, and maintaining scalable web scraping frameworks primarily using Scrapy. - Working with additional libraries/tools like Beautiful Soup, Selenium, Playwright, and Requests. - Implementing robust error handling, data parsing, and data storage mechanisms using JSON, CSV, SQL/NoSQL databases. - Building and optimizing asynchronous scraping workflows, handling multithreading/multiprocessing efficiently. - Collaborating with product managers, QA, and DevO...

Role & responsibilities As a Data Engineer focused on web crawling and platform data acquisition, you will design, develop, and maintain large-scale web scraping pipelines to extract valuable platform data. You will be responsible for implementing scalable and resilient data extraction solutions, ensuring seamless data retrieval while working with proxy management, anti-bot bypass techniques, and data parsing. Optimizing scraping workflows for performance, reliability, and efficiency will be a key part of your role. Additionally, you will ensure that all extracted data maintains high quality and integrity. Preferred candidate profile We are seeking candidates with: Strong experience in Pytho...

Collect, cleanse, and validate data from multiple sources Design ETL processes and pipelines Build data acquisition systems Use APIs and web scraping tools for automated data collection Develop Python-based APIs to support data lakes Work from home

Experience required: 2–4 years of professional software engineering experience. Budget for the role - Max Up to Rs. 15 LPA 100% remote Opportunity Role Overview: You will design, build, and operate software for data collection and processing at scale. The role is hands‑on, with emphasis on clean design, reliability, and performance. Key Responsibilities: · Develop and maintain Python applications for crawling, parsing, enrichment, and processing of large datasets. · Build and operate data workflows (ETL/ELT), including validation, monitoring, and error‑handling. · Work with SQL and NoSQL (plus vector databases/data lakes) for modeling, storage, and retrieval. · Contribute to system design us...

Role & responsibilities Application Development: Design and build web-scale applications using Python (Django/Flask/FastAPI) and modern frontend frameworks (React / Angular / Vue). API Development: Develop and integrate RESTful and GraphQLAPIs. Implement responsive, intuitive, and interactive user interfaces. Build scalable and secure backend systems with optimized database queries and caching strategies. Create and manage relational (PostgreSQL/MySQL) and NoSQL (MongoDB/Redis) databases. Deploy applications on AWS / Azure / GCP, including containerization (Docker, Kubernetes). Write clean, reusable, and maintainable code following industry best practices. Ensure system performance, security...