448 Scrapy Jobs - Page 9

Job Title: AI Developer-Intelligent Web Automation Location: Noida Employment Type: Full Time/Contract Experience: 0-3 Years in AI+ Automation Position Overview: We are looking for an experienced AI/ML Developer with strong expertise in web automation to design and build an intelligent system that can interact with websites, perform smart actions (clicking, downloading, form filling, navigation), and extract data automatically. The role involves combining AI techniques with web crawling/automation tools to create a scalable and efficient solution. Key Responsibilities Design and develop an AI-powered web automation system capable of interacting with websites intelligently. Implement web craw...

Male applicants are preferred We are looking for an enthusiastic and proactive Python Developer with core Python expertise and hands-on experience in Generative AI (GenAI) to join our development team. Experience Required: 2-3 Years Mode of Work: On-Site Only (Mohali, Punjab) Mode of Interview : Face to Face( On-Site) Contact for Queries: +91-9872993778 (Mon–Fri, 11 AM – 6 PM) Note: This number will be unavailable on weekends and public holidays. Key Responsibilities: Backend Development: Assist in the development of clean, efficient, and scalable Python applications to meet business needs. Generative AI Experience: Working knowledge and experience in building applications using GenAI techno...

Role & responsibilities Technical Skills: Proficiency in Python and libraries like BeautifulSoup, Scrapy, and Selenium. • Experience with regular expressions (Regex) for data parsing. • Strong knowledge of HTTP protocols, cookies, headers, and user-agent rotation. • Familiarity with databases (SQL and NoSQL) for storing scraped data. Hands-on experience with data manipulation libraries such as pandas and NumPy. Experience working with APIs and managing third-party integrations. Familiarity with version control systems like Git. Bonus Skills: • Knowledge of containerization tools like Docker. Preferred candidate profile Develop and maintain automated web scraping scripts using Python librarie...

We are seeking a highly motivated and results-driven Sales and Revenue Manager to join our sales team. The successful candidate will be responsible for supporting overall sales operations, strengthening client relationships, and contributing to revenue growth. A core aspect of this role will be lead generation and data acquisition from digital platforms to build and maintain a qualified sales pipeline. Key Responsibilities Lead Generation: Identify, qualify, and generate prospective leads through online tools, platforms, and databases (e.g., LinkedIn, industry events, company websites, and email sources). Client facing capabilities to include ability to pitch new business and ideas to potent...

As a skilled professional with over 7 years of experience, you will be responsible for reviewing and understanding business requirements to ensure timely completion of development tasks with rigorous testing to minimize defects. Collaborating with a software development team is crucial to implement best practices and enhance the performance of Data applications, meeting client needs effectively. In this role, you will collaborate with various teams within the company and engage with customers to comprehend, translate, define, and design innovative solutions for their business challenges. Your tasks will also involve researching new Big Data technologies to evaluate their maturity and alignme...

About Us: At Zapbuild, we specialize in developing advanced technology solutions tailored for the transportation and logistics sector. Our primary goal is to support the industry and its stakeholders in embracing adaptive and innovative solutions to navigate the ever-evolving supply chains effectively. Whether your objectives revolve around achieving sustainability targets, adopting cutting-edge technologies for streamlined logistics, or reducing operational costs within the supply chain, we are committed to keeping you at the forefront with forward-looking solutions. Our focus as your technology partner is to ensure that you are fully prepared to tackle upcoming challenges, embrace advancem...

Male applicants are preferred We are looking for an enthusiastic and proactive Python Developer with core Python expertise and hands-on experience in Generative AI (GenAI) to join our development team. Experience Required: 2-3 Years Mode of Work: On-Site Only (Mohali, Punjab) Mode of Interview : Face to Face( On-Site) Contact for Queries: +91-9872993778 (Mon–Fri, 11 AM – 6 PM) Note: This number will be unavailable on weekends and public holidays. Key Responsibilities: Backend Development: Assist in the development of clean, efficient, and scalable Python applications to meet business needs. Generative AI Experience: Working knowledge and experience in building applications using GenAI techno...

QDesk DSS is a dynamic and growing Data Management and Offshore Staffing service provider based in Lucknow. We are seeking a talented and motivated Full Stack Developer - Android to join our team and contribute to the development of web applications and automation tools for internal company usage. Key Responsibilities: Full Stack Development: Design, develop, and maintain robust web applications using Python. Develop and maintain Android applications using Kotlin/Java. Implement and maintain scalable backend services using Node.js, Python, or Java. Work with databases like MongoDB, Firebase, MySQL, or PostgreSQL for data storage and management. Collaborate with cross-functional teams to defi...

TransForm Solutions is a trailblazer in the business process management and IT-enabled services industry, known for delivering top-notch solutions that drive business efficiency and growth. With a focus on innovation and excellence, we empower businesses to transform their operations and achieve their full potential. As we continue to expand, we're currently seeking a dynamic Senior Web Data Scraping Engineer to join our team and help us harness the power of data. Your primary mission will involve developing cutting-edge solutions by designing, developing, and maintaining robust web scraping solutions that extract large datasets from various websites to fuel our data-driven initiatives. You ...

As a Python Developer/Web Scraping Specialist at our company in Jaipur, you will be a crucial member of our technology team. With a minimum of 1 year of experience in Python programming and a deep understanding of web scraping tools and techniques, you will play a vital role in designing and implementing efficient web crawlers to extract structured data from various websites and online platforms. Your responsibilities will include designing, building, and maintaining web scraping scripts and crawlers using Python. You will utilize tools such as BeautifulSoup, Selenium, and Scrapy to extract data from both dynamic and static websites. Furthermore, you will be responsible for cleaning, structu...

Male applicants are preferred We are looking for an enthusiastic and proactive Python Developer with core Python expertise and hands-on experience in Generative AI (GenAI) to join our development team. Experience Required: 2-3 Years Mode of Work: On-Site Only (Mohali, Punjab) Mode of Interview : Face to Face( On-Site) Contact for Queries: +91-9872993778 (Mon–Fri, 11 AM – 6 PM) Note: This number will be unavailable on weekends and public holidays. Key Responsibilities: Backend Development: Assist in the development of clean, efficient, and scalable Python applications to meet business needs. Generative AI Experience: Working knowledge and experience in building applications using GenAI techno...

You will be responsible for conducting in-depth online research to identify potential leads in specific geographies, utilizing advanced web scraping tools and techniques to extract accurate contact and business data from various sources. It will be your duty to validate and verify the collected data to ensure its quality and relevance. Additionally, you will maintain and manage a structured database of leads for outreach and tracking purposes. Collaboration with the sales and marketing teams to provide a consistent flow of high-quality leads is a key aspect of this role. Staying informed about industry trends, tools, and best practices in data scraping and lead generation is essential. To ex...

Freelance Python Developer (Web Scraping Specialist) Job Title: Freelance Python Developer – Web Scraping Location Preference: Pondicherry / Cuddalore / Villupuram (Remote also considered) Experience Required: Minimum 1 Year in Python development. Pay: ₹150 – ₹200 per hour Responsibilities: Develop and maintain Python-based web scraping solutions. Work with libraries and tools like Playwright, Scrapy, BeautifulSoup, Selenium. Extract, clean, and structure large volumes of data from websites. Debug and optimize scraping scripts for performance and accuracy. Deliver projects on time in a freelancing environment. Requirements: Minimum 1 year of experience in Python development. Strong hands-on ...

Job description: We’re looking for a hands-on Data Engineer to manage and scale our data scraping pipelines across 60+ websites. The job involves handling OCR-processed PDFs, ensuring data quality, and building robust, self-healing workflows that fuel AI-driven insights. You’ll Work On: Managing and optimizing Airflow scraping DAGs Implementing validation checks, retry logic & error alerts Cleaning and normalizing OCR text (Tesseract / AWS Textract) Handling deduplication, formatting, and missing data Maintaining MySQL/PostgreSQL data integrity Collaborating with ML engineers on downstream pipelines What You Bring: 2–5 years of hands-on experience in Python data engineering Experience with A...

Job description: We’re looking for a hands-on Data Engineer to manage and scale our data scraping pipelines across 60+ websites. The job involves handling OCR-processed PDFs, ensuring data quality, and building robust, self-healing workflows that fuel AI-driven insights. You’ll Work On: Managing and optimizing Airflow scraping DAGs Implementing validation checks, retry logic & error alerts Cleaning and normalizing OCR text (Tesseract / AWS Textract) Handling deduplication, formatting, and missing data Maintaining MySQL/PostgreSQL data integrity Collaborating with ML engineers on downstream pipelines What You Bring: 2–5 years of hands-on experience in Python data engineering Experience with A...

As a professional responsible for handling end-to-end client AI & analytics programs in a dynamic environment, your role will encompass a diverse range of tasks including hands-on contribution, technical team management, and client interaction. You should possess an M-Tech/PhD from a reputable Institute, preferably in a quantitative subject, along with over 18 years of practical experience in applied Machine Learning, AI, and analytics. Proficiency in scientific programming using scripting languages like Python, R, SQL, NoSQL, and Spark, coupled with expertise in ML tools and Cloud Technology (AWS, Azure, GCP), is essential. Familiarity with Python libraries such as numpy, pandas, sci-kit-le...

As an AI/ML Data Analyst at our company, you will have the opportunity to develop and deploy machine learning models, optimize data pipelines, and drive AI-driven innovation. Your expertise in machine learning, artificial intelligence, automation, and data engineering will be crucial for this role. You will work with structured and unstructured data, utilizing Node JS, Python, SQL, and data scraping techniques to extract and preprocess data efficiently. Your responsibilities will include developing and deploying machine learning models for predictive analytics and automation, building and optimizing data pipelines using SQL and Python, and implementing data scraping techniques to extract dat...

Job Overview We are seeking six highly motivated and detail-oriented professionals to join our Data & Insights team. As a Data Processor / Scraper / Collector, you will play a pivotal role in gathering, cleaning, and organizing entertainment-related data from various sources. Your work will directly support strategic decision-making across content development, marketing, and audience engagement. Industry: Entertainment/ Hospitality Experience Required: Minimum 3 years Key Responsibilities Collect and process structured and unstructured data from websites, APIs, and internal databases Scrape entertainment-related data (e.g., movie listings, showtimes, ratings, social media trends) using autom...

Job Title: Python Developer (Hybrid Intelligence) Location: Remote (Work From Home) Job Type: Full Time Compensation Range: 5-8 LPA Working: 5.5 days (Saturday half day) Website: https://algo-one.com About the role We’re not just hiring developers — we’re hiring pioneers. The Hybrid Intelligence Developer role is for those who believe that the best code is written when human creativity meets AI speed . You’ll be building full-stack applications at lightning pace, using AI coding assistants as your co-pilot while you focus on solving problems, designing systems, and shipping features that matter. If you’re the kind of person who experiments with prompts, optimizes workflows with AI, and belie...

As a Python Developer & Web Crawling professional at Global Checks Pvt Ltd, you will collaborate with cross-functional teams to define, design, and implement new features. Your role will involve ensuring the performance, quality, and responsiveness of web crawling systems. You will be responsible for identifying and correcting bottlenecks, fixing bugs in web crawling processes, and helping maintain code quality, organization, and automation. It is essential to stay up-to-date with the latest industry trends and technologies. With 3+ years of experience in Web Scraping or Crawling through frameworks like Scrapy, Selenium, or other related libraries, you should be an expert in the latest versi...

As a Lead Data Scraping Engineer, you will be a vital part of our team in Ahmedabad/WFO, bringing your senior-level expertise with over 4 years in the IT scraping industry. Your role will involve not only hands-on data scraping using tools like Scrapy and Python libraries but also leading and mentoring a team of 5+ developers to deliver successful projects within set timelines. Your primary responsibilities will include designing and implementing scalable data scraping solutions, managing project timelines, and ensuring the team's success through effective leadership. You will be expected to utilize advanced scraping techniques, reverse engineering, and automation to overcome scraping restri...

You will be responsible for developing cutting-edge solutions by designing, developing, and maintaining robust web scraping solutions to extract large datasets from various websites, supporting our data-driven initiatives. Your role involves mastering Python programming to implement and optimize sophisticated scraping scripts and tools. You will be leveraging industry-leading tools such as BeautifulSoup, Scrapy, Selenium, and other scraping frameworks to efficiently collect and process data. Additionally, you will innovate with AI technologies like ChatGPT prompt skills to automate and enhance data extraction processes, pushing the boundaries of what is possible. Your duties will also includ...

Senior Engineer - VBA Python: Elevate Your Impact Through Innovation & Learning Evalueserve is a global leader in delivering innovative and sustainable solutions to a diverse range of clients, including over 30% of Fortune 500 companies. With a presence in more than 45 countries across five continents, we excel in leveraging state-of-the-art technology, artificial intelligence, and unparalleled subject matter expertise to elevate our clients' business impact and strategic decision-making. Our team of over 4, 500 talented professionals operates in countries such as India, China, Chile, Romania, the US, and Canada. Our global network also extends to emerging markets like Colombia, the Middle E...

Job Title: Python Developer Experience: 2 - 4 years Mode: 3 month contract + ext. Location: Gurgaon Job Summary: We are looking for a Python Specialist with the hands-on knowledge for developing automation tools with an analytical mindset. Responsibilities Develop Quick Process Automations (QPAs) using one of the following platforms - VBA, MS Office pack, Java, SQL, Python. Create appropriate project documentation and train operations team on how to use the developed tool. Follow standard team coding structure and maintenance of already developed solutions. Proactive to identify workarounds, fix bugs, implement changes and come up with out of the box solutions Manage project delivery through...

Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm. In this role, you will collaborate with individuals across various company departments to shape and innovate new products and features for our platform, enhancing existing ones. You will have a large degree of independence and trust, but you won't be isolated; the support of the Engineering team leads, the Product team leads, and every other technology team member is behind you. This is an opportunity to join a team-first meritocracy and help grow an entrepreneurial group inside Alternative Path. You will be asked to contribute, given ownership, and will be expected to mak...