448 Scrapy Jobs - Page 7

🚀 We’re Hiring: Lead Data Engineer (SQL Server, DevOps, Python & AI) 📍 Fully Remote | Full-time We are seeking an experienced Lead Data Engineer to design, develop, and optimize scalable data platforms while driving AI-powered innovation. This role combines hands-on technical expertise with leadership responsibilities, mentoring a team of data engineers and collaborating with cross-functional teams to shape the future of data-driven IT asset management. 🔑 What You’ll Do Design and optimize SQL Server architectures with performance tuning & high availability Build and manage ETL pipelines and scalable data workflows Implement DevOps practices for database CI/CD workflows Lead Python-based dat...

As a Data Extraction Engineer at Relu Consultancy, you will play a crucial role in designing, implementing, and maintaining robust data scraping solutions using Python (Selenium). Your expertise will drive forward cutting-edge projects, offering you the opportunity to work on initiatives tailored to your preferences. Responsibilities: - Work on web scraping or data extraction using Selenium/Scrapy or other related frameworks and libraries. - Utilize working knowledge in various DBSs, message queues, and web Restful APIs. - Design, build, and maintain high-performance, reusable, and reliable Python code. - Ensure optimal performance, quality, and responsiveness of applications. - Identify and...

Please see further details and apply here: https://apply.workable.com/polonord-adeste-srl/j/41BC0C3F26/ About Us: We are an e-commerce company dedicated to driving sales on our product listings on Amazon. As we continue to grow, we are looking for a talented Python Developer to join our team. If you have a knack for Data Integration & Automation, we’d love to hear from you! Our line of product is mainly in the health category. About the Role: We are seeking a skilled Python Developer to join our team and take ownership of building data pipelines and automation workflows. The ideal candidate will be responsible for connecting multiple data sources (APIs, web scraping, Google Sheets, Amazon Se...

Job Title: Web Scraping Specialist Experience: 3 - 6 Years Location: Remote (Work from Home) About the job We are seeking a highly skilled Web Scraping Specialist to join our team. The successful candidate will be responsible for designing, implementing, and maintaining web scraping processes to gather data from various online sources efficiently and accurately. As a Web Scraping Specialist, you will play a crucial role in collecting data for competitor analysis, and other business intelligence purposes. Responsibilities: Scalability/Performance: Lead and provide expertise in scraping at scale e-commerce marketplaces. Data Source Identification: Identify relevant websites and online sources ...

Job Title: Lead Data Scientist Location: Noida Employment Type: Full-time Responsibilities: Lead and manage a team of data scientists, providing guidance, mentorship, and technical expertise Collaborate with stakeholders to understand business objectives and develop data science strategies aligned with those objectives Design, develop, and implement advanced machine learning and statistical models to solve complex business problems. Conduct exploratory data analysis, data cleansing, and feature engineering to prepare datasets for analysis. Good in fine-tuning, and optimization of LLMs like Open AI, Gemini AI, Copilot, and open-source models like LLAMA, DeepSeek, and BERT Hands-on experience ...

Job Title: Principal Data Scientist Location: Noida Employment Type: Full-time Responsibilities: Convert broad vision and concepts into a structured data science roadmap and guide a team to successfully execute on it Collaborate with AI Product managers, UI/UX, stakeholders, etc. to design, develop, and deploy AI/LLM models Good in fine-tuning, and optimization of LLMs like Open AI, Gemini AI, Copilot, and open-source models like LLAMA, DeepSeek, and BERT Hands-on experience in Prompt Engineering and RAG for real-world applications Develop Conversational AI, ChatBots, VoiceBots using modern NLP frameworks like SpaCy, Rasa, LangChain, Hugging Face Use vector databases like Pinecone, Vertex AI...

Job Title: Tech Lead - Python & Web Data Solutions Location : Ahmedabad / WFO Experience Level : Senior (4+ years) Employment Type : Full-time Job Summary We are seeking a highly skilled and experienced Lead Data Scraping Engineer to join our team. The ideal candidate will have a minimum of 4 years of hands-on experience in IT scraping, with at least 2 years leading a team of 5+ developers. This role requires deep technical knowledge in advanced scraping techniques, reverse engineering, automation, and leadership skills to drive the team towards success. Key Responsibilities Design and develop scalable data scraping solutions using tools like Scrapy and Python libraries. Lead and mentor a te...

We're looking for an entrepreneurial, passionate, and driven Data Engineer to join Startup Gala Intelligence backed by Navneet Tech Venture. As we're building our technology platform from scratch, you'll have the unique opportunity to shape our technology vision, architecture, and engineering culture right from the ground up. You’ll directly contribute to foundational development and establish best practices, while eventually building and contributing to our engineering team. This role is ideal for someone eager to own the entire tech stack, who thrives on early-stage challenges, and loves building innovative, scalable solutions from day zero. What You’ll Do Web Scraping & Crawling: Build an...

Relu Consultancy is seeking a Data Extraction Engineer with expertise in Python (Selenium). In this role, you will design, implement, and maintain robust data scraping solutions that drive our projects forward. This is your chance to contribute to cutting-edge initiatives while enjoying a work schedule tailored to your needs. Job Title: Data Extraction Engineer Location: Bhopal, MP Job Type: Full-Time CTC: 5LPA Responsibility: 1. Work on web scraping or data extraction through Selenium/Scrapy or other frameworks and related libraries. 2. Working knowledge in various DBSs, message queues & web Restful APIs. 3. Design, build, and maintain high-performance, reusable, and reliable Python code. 4...

Be a part of India’s largest and most admired news network! Network18 is India's most diversified Media Company in the fast growing Media market. The Company has a strong Heritage and we possess a strong presence in Magazines, Television and Internet domains. Our brands like CNBC, Forbes and Moneycontrol are market leaders in their respective segments. The Company has over 7,000 employees across all major cities in India and has been consistently managed to stay ahead of the growth curve of the industry. Network 18 brings together employees from varied backgrounds under one roof united by the hunger to create immersive content and ideas. We take pride in our people, who we believe are the ke...

Position: Data Mining Analyst Please Note: Only Candidates with 2-3 years of experience should apply. This is a Delhi-based position and work from office only! Work Location: Sector 23 Dwarka, Delhi We are seeking a skilled Data Mining Analyst with expertise in automating data extraction processes from web platforms. The ideal candidate will be experienced in Python, Selenium, Pandas, SQL, and APIs, with the ability to design and implement efficient and scalable data scraping systems. If you have a passion for working with data and a solid understanding of web technologies, we want to hear from you! Key Responsibilities: Design, develop, and maintain robust web scraping solutions to extract ...

As a Senior Python Developer specializing in web scraping and automation at Actowiz Solutions in Ahmedabad, you will be a key member of our dynamic team. Actowiz Solutions is a prominent provider of data extraction, web scraping, and automation solutions, enabling businesses to leverage clean, structured, and scalable data for informed decision-making. By utilizing cutting-edge technology, we strive to deliver actionable insights that drive the future of data intelligence. Your primary responsibility will be to design, develop, and optimize large-scale web scraping solutions using Scrapy, a mandatory requirement for this role. You will work with a variety of additional libraries and tools su...

You will be responsible for designing, developing, and maintaining web scraping scripts using Python. Your expertise will be essential in utilizing web scraping libraries like Beautiful Soup, Scrapy, Selenium, and other tools to extract data from various websites. It will be crucial to write reusable, testable, and efficient code to extract both structured and unstructured data effectively. Additionally, you will play a key role in developing and maintaining software documentation for the web scraping scripts you create. Collaboration with software developers, data scientists, and other stakeholders will be necessary to strategize, design, develop, and launch new web scraping projects. Troub...

About DataWeave: Digital Commerce capabilities play a crucial role in attracting today's shoppers. The global eCommerce landscape has seen rapid growth, particularly due to the pandemic, offering consumers various options to research, compare, and purchase products. In this scenario, actionable data-driven insights have become essential for eCommerce expansion and are pivotal in optimizing investments. DataWeave emerges as a leading provider of advanced sales optimization solutions for Digital Commerce businesses, consumer brands, delivery intermediaries, and marketplaces. Through our machine learning-enabled SaaS platform, we cater to over 400 global brands and retailers, offering streamlin...

You are a Data Analyst with 1-2 years of experience, skilled in data visualization, data analysis, and web scraping. Your primary role involves collecting, processing, and analyzing large datasets from various sources to provide meaningful insights for business decisions. Your responsibilities include end-to-end data analysis and reporting, creating interactive dashboards using tools like Power BI and Tableau, and conducting data scraping using Python tools such as BeautifulSoup and Selenium. You will also be responsible for data cleaning, transformation, and validation using Excel, SQL, or Python libraries like pandas and numpy. Collaboration with cross-functional teams to understand data r...

About the Role: Grade Level (for internal use): 08 Job Title: Associate Data Engineer The Team: The Automotive Insights - Supply Chain and Technology and IMR department at S&P Global is dedicated to delivering critical intelligence and comprehensive analysis of the automotive industry's supply chain and technology. Our team provides actionable insights and data-driven solutions that empower clients to navigate the complexities of the automotive ecosystem, from manufacturing and logistics to technological innovations and market dynamics. We collaborate closely with industry stakeholders to ensure our research supports strategic decision-making and drives growth within the automotive sector. J...

We are looking for an enthusiastic and proactive Python Developer with core Python expertise and hands-on experience in Generative AI (GenAI) to join our development team. Experience Required: 2-3 Years Mode of Work: On-Site Only (Mohali, Punjab) Mode of Interview : Face to Face( On-Site) Contact for Queries: +91-9872993778 (Mon–Fri, 11 AM – 6 PM) Note: This number will be unavailable on weekends and public holidays. Key Responsibilities: Backend Development: Assist in the development of clean, efficient, and scalable Python applications to meet business needs. Generative AI Experience: Working knowledge and experience in building applications using GenAI technologies is mandatory. API Integ...

Senior Python Developer — Web Scraping (1.5 years industry experience) Location: Ahemdabad ( Work from Office ) Employment type: Full-time Company: Actowiz Solutions Role overview We are looking for a pragmatic, hands-on Senior Python Developer with ~1.5 years of direct experience in the web-scraping industry . You’ll design, build and maintain high-quality, reliable data extraction systems (scrapers, crawlers, parsers) and the API layers that serve that data to downstream services. The ideal candidate is comfortable working across the full stack of a scraping product — headless browsers, HTTP clients, extraction pipelines, storage, and REST APIs — and can write production-ready code, tests,...

We are looking for an enthusiastic and proactive Python Developer with core Python expertise and hands-on experience in Generative AI (GenAI) to join our development team. Experience Required: 2-3 Years Mode of Work: On-Site Only (Mohali, Punjab) Mode of Interview : Face to Face( On-Site) Contact for Queries: +91-9872993778 (Mon–Fri, 11 AM – 6 PM) Note: This number will be unavailable on weekends and public holidays. Key Responsibilities: Backend Development: Assist in the development of clean, efficient, and scalable Python applications to meet business needs. Generative AI Experience: Working knowledge and experience in building applications using GenAI technologies is mandatory. API Integ...

We are looking for an experienced Python Developer with expertise in web scraping and OCR to design and optimize data extraction solutions. The role involves building scalable scripts, integrating OCR workflows, and ensuring clean, structured data for downstream use. Key Responsibilities: Develop and maintain Python scripts for web scraping from structured and unstructured sources. Implement OCR solutions to extract text/data from scanned images, PDFs, and other documents. Optimize data extraction workflows for performance and accuracy. Collaborate with teams to integrate scraped/OCR data into applications or databases. Key Skills: Strong proficiency in Python Hands-on experience with web sc...

Position: Data Mining Analyst This is a Delhi-based position and work from office only! Work Location: Sector 23 Dwarka, Delhi We are seeking a skilled Data Mining Analyst with expertise in automating data extraction processes from web platforms. The ideal candidate will be experienced in Python, Selenium, Pandas, SQL, and APIs, with the ability to design and implement efficient and scalable data scraping systems. If you have a passion for working with data and a solid understanding of web technologies, we want to hear from you! Key Responsibilities: Design, develop, and maintain robust web scraping solutions to extract structured and unstructured data from various websites and APIs. Use too...

Position: Data Analyst Experience: 2+ Years Location: Remote Joining: Immediate Joiners Preferred About the Role: We are looking for a skilled Data Analyst with strong Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization. The ideal candidate should be capable of building data pipelines, performing web scraping, and generating actionable insights through dashboards and reports. Key Responsibilities: Develop, test, and maintain efficient Python scripts for data collection and transformation. Design and implement web scraping solutions to extract structured and unstructured data from diverse sources. Perform data cleaning, preprocessing...

Location: Remote (Maharashtra) Experience: 2–5 Years Salary: ₹6 to ₹10 LPA Type: Full-Time About the Role We are seeking a talented and passionate AI/ML Developer to join our team in building a next-generation LLM-based intelligent chatbot system . This role encompasses backend system design, LLM integration, API development, and the creation of a scalable AI-first chatbot architecture. You’ll also contribute to scraping relevant training data, deploying fine-tuned LLMs, and building real-time conversational systems on top of modern cloud AI services. Key Responsibilities Design, develop, and maintain a scalable backend architecture for an LLM-based chatbot. Build, document, and optimize RES...

Experience range - 10+ years Type of job - Full time, In office Location - Bengaluru Roles and Responsibilities: Convert broad vision and concepts into a structured data science roadmap, and guide a team to successfully execute on it. Handling end-to-end client AI & analytics programs in a fluid environment. Your role will be a combination of hands-on contribution, technical team management, and client interaction. Proven ability to discover solutions hidden in large datasets and to drive business results with their data-based insights Contribute to internal product development initiatives related to data science. Drive excellent project management required to deliver complex projects, inclu...

Technical Skills Proven experience working with Python and its core concepts Knowledge of and working experience with the Scrapy framework Understanding of web frameworks like Flask and Django Version Control Knowledge of probability and statistics Familiarity with ORM techniques Database integration Soft Skills Analytical thinking and problem-solving Good communication and orientation Designing and time management skills Ability to adapt and meet deadlines