448 Scrapy Jobs - Page 5

1) Bypass Captcha v2 2) web scraping using python programming library Scrapy, Selenium, beautiful soup and splash. 3) Data mining from given URL. 4) Lead generation emails, phone number, images ,address scraping. 5) I can add selenium and splash for JS rendering. 6) Data extraction from website and save that in any format. 7) Web scraping, data extration , python, web crawling, python automation, data scraping, selenium automation , data mining , api devlopment, rest api 8) Proxies and user agent rotation to prevent IP blockage. 9) Data save in any format (database,json,google sheet,csv,excel,GoogleSheet). 10) Web Scraping language python. 11) e-commerce site scraping with variations. 12) Se...

About the Role We’re hiring a hands-on Data Analyst to turn business questions into reliable datasets, clear visuals, and automated workflows. You’ll build and maintain Power BI dashboards, shape data models, and orchestrate pipelines using Microsoft Fabric. You’ll also own Make.com automation for API-based data acquisition and notifications, perform web scraping (ethically and compliantly), and write Python to automate, cleanse, and enrich data. The ideal candidate is equal parts analyst and problem-solver, comfortable moving from stakeholder requirements to production-grade dashboards and automations. What You’ll Do Business Intelligence & Visualization Build, iterate, and maintain Power B...

About the Role: We are looking for a hands-on Data Engineer to join our team and take full ownership of scraping pipelines and data quality. You'll be working on data from 60+ websites involving PDFs, processed via OCR and stored in MySQL/PostgreSQL. You’ll build robust, self-healing pipelines and fix common data issues (missing fields, duplication, formatting errors). Responsibilities: Own and optimize Airflow scraping DAGs for 60+ sites Implement validation checks, retry logic, and error alerts Build pre-processing routines to clean OCR'd text Create data normalization and deduplication workflows Maintain data integrity across MySQL and PostgreSQL Collaborate with ML team for downstream AI...

Role: BDM Location: Kokapet, Hyderabad Budget: 12LPA-18LPA Job Type: Fulltime Notice period: Immediate Joiners required Criteria: US Global strong exp in generating leads in business development AI related tools knowledge Exp in Zoho CRM/Sales who has good content knowledge to develop website/blog/LinkedIn posts Excellent comm skills who can handle US Customers Below is the JD as requested. Job Description We're looking for a marketing + bizdev powerhouse who can own and execute AI-led growth at scale. This role isn't just sales — it's about using the latest AI tools to automate outreach, generate leads, close deals, and build predictable revenue pipelines for our AI training, advisory, and ...

Python/JavaScript Developer – Web Scraping & AI/ML (3 to 6 years) Experience: 3+ Years Location: Remote Mode of Engagement: Full-time No of Positions: 3 Educational Qualifications: Bachelor's degree in Computer Science, Information Technology Industry: IT / Software Development Notice Period: Immediate Joiners Preferred What We Are Looking For: Strong expertise in web scraping with hands-on experience in large-scale data collection systems. Proficient in Python, including Scrapy, Requests, Playwright, and Selenium. Skilled in JavaScript for web scraping and automation tasks. Capable of designing, building, and maintaining robust and scalable scrapers for a variety of websites. Experience wit...

Decision Analytics EXL (NASDAQ:EXLS) is a leading operations management and analytics company that helps businesses enhance growth and profitability in the face of relentless competition and continuous disruption. Using our proprietary, award-winning Business EXLerator Framework™, which integrates analytics, automation, benchmarking, BPO, consulting, industry best practices and technology platforms, we look deeper to help companies improve global operations, enhance data-driven insights, increase customer satisfaction, and manage risk and compliance. EXL serves the insurance, healthcare, banking and financial services, utilities, travel, transportation and logistics industries. Headquartered...

We are seeking highly motivated and results-driven Business Development Executives to join our sales team. The successful candidate will be responsible for supporting overall sales operations, strengthening client relationships, and contributing to revenue growth. A core aspect of this role will be lead generation and data acquisition from digital platforms to build and maintain a qualified sales pipeline. Key Responsibilities Lead Generation: Identify, qualify, and generate prospective leads through online tools, platforms, and databases (e.g., LinkedIn, industry events, company websites, and email sources). Client facing capabilities to include ability to pitch new business and ideas to po...

As an AI and Data Crawling Programmer with 12 years of hands-on experience in building data-driven solutions, your role will involve designing efficient crawlers, developing scalable web crawlers, and contributing to AI model development. Your practical exposure to AI/ML concepts, data crawling, and web scraping will be essential in collecting, cleaning, and preprocessing large datasets to support AI/ML pipelines. Additionally, your prior experience in website development or data integration will be advantageous in this role. Key Responsibilities: - Design, develop, and maintain scalable web crawlers and scraping tools. - Collect, clean, and preprocess large datasets to support AI/ML pipelin...

Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm. In this role, you will collaborate with individuals across various company departments to shape and innovate new products and features for our platform, enhancing existing ones. You will have a large degree of independence and trust, but you won't be isolated; the support of the Engineering team leads, the Product team leads, and every other technology team member is behind you. This is an opportunity to join a team-first meritocracy and help grow an entrepreneurial group inside Alternative Path. You will be asked to contribute, given ownership, and will be expected to mak...

About Zapbuild : "Zapbuild builds future-ready technology solutions for the transportation and logistics industry. We are deeply invested in helping the Transportation & Logistics industry and its players move forward with adaptive and innovative solutions, in order to thrive in rapidly transforming supply chains". Job Requirement: 1. Proficiency in Python and Django rest framework. 2. Hands-on experience with MySQL , including schema design, query optimization, and performance tuning. 3. Experience in web scraping using Python tools like BeautifulSoup, Scrapy, or Selenium. 4. Docker experience for containerizing applications and managing environments. 5. Front-end development skills with Ja...

We are looking for a highly motivated Python Developer Intern who is enthusiastic about coding, automation, and AI technologies. The intern will collaborate with our development team to build, test, and deploy scalable solutions, gaining hands-on experience in real-world projects. Stipend : Rs.10,000 per month Duration of internship - Six months (Full time) Eligibility - Currently pursuing last year or recently completed a degree in Btech, Computer Science, Engineering, Data Science, or related fields. Key Responsibilities: Develop and maintain Python Programs/Apps for automation and data scraping. Assist in designing and implementing AI models and algorithms. Work collaboratively with the t...

Position: Data Mining Analyst Please Note: Only Candidates with 2-3 years of experience should apply. This is a Delhi-based position and work from office only! Work Location: Sector 23 Dwarka, Delhi We are seeking a skilled Data Mining Analyst with expertise in automating data extraction processes from web platforms. The ideal candidate will be experienced in Python, Selenium, Pandas, SQL, and APIs, with the ability to design and implement efficient and scalable data scraping systems. If you have a passion for working with data and a solid understanding of web technologies, we want to hear from you! Key Responsibilities: Design, develop, and maintain robust web scraping solutions to extract ...

We're looking for an entrepreneurial, passionate, and driven Data Scrapper to join Startup Gala Intelligence backed by Navneet Tech Venture situated in Ahmedabad . As we're building our technology platform from scratch, you'll have the unique opportunity to shape our technology vision, architecture, and engineering culture right from the ground up. You’ll directly contribute to foundational development and establish best practices, while eventually building and contributing to our engineering team. This role is ideal for someone eager to own the entire tech stack, who thrives on early-stage challenges, and loves building innovative, scalable solutions from day zero. What You’ll Do Data Scrap...

About the role: We are seeking a highly motivated and detail-oriented AI Data Collection Expert to join our innovative AI/ML team. You will be instrumental in the end-to-end process of gathering, annotating, and curating high-quality datasets that serve as the foundation for our cutting-edge AI and machine learning models. This role requires a meticulous eye for detail, a proactive approach to problem-solving, and a commitment to data integrity and quality. Key responsibilities: Data sourcing and acquisition: Collaborate with AI/ML researchers and data scientists to understand data requirements and execute comprehensive data acquisition strategies. Dataset curation and management: Gather, cu...

About Zapbuild : "Zapbuild builds future-ready technology solutions for the transportation and logistics industry. We are deeply invested in helping the Transportation & Logistics industry and its players move forward with adaptive and innovative solutions, in order to thrive in rapidly transforming supply chains". Job Requirement: 1. Proficiency in Python and Django rest framework. 2. Hands-on experience with MySQL , including schema design, query optimization, and performance tuning. 3. Experience in web scraping using Python tools like BeautifulSoup, Scrapy, or Selenium. 4. Docker experience for containerizing applications and managing environments. 5. Front-end development skills with Ja...

Baner, Pune, Maharashtra, India Department Delivery Unit 2 Job posted on Sep 22, 2025 Employee Type Permanent Experience range (Years) 6 years - 12 years Position : Associate Tech Specialist / Tech Specilaist Experience: 6 to 9 Years Location : Pune (Hybrid) Job Summary The Senior Software Developer is responsible for designing and delivering complex, scalable software systems, leading technical initiatives, and mentoring junior developers. This role plays a key part in driving high-impact projects and ensuring the delivery of robust, maintainable solutions. In addition to core development duties, the role works closely with the business to identify opportunities for automation and web scrap...

Role Overview: - Your primary responsibility as a skilled Web Scraping Data Analyst will involve collecting, cleaning, and analyzing data from various online sources using Python-based scraping frameworks. - You will design, develop, and maintain robust web scraping scripts utilizing tools such as Python, BeautifulSoup, Scrapy, Selenium, and more. - Implementing IP rotation, proxy management, and anti-bot evasion techniques to ensure efficient data collection will be part of your tasks. - Collaborate with data analysts and data engineers to integrate web-sourced data into internal databases and reporting systems. - Conduct exploratory data analysis (EDA) to derive valuable insights from the ...

AI-Powered Web Scraping • Develop, maintain, and optimize automated web scraping pipelines using AI/ML techniques to handle dynamic and JavaScript-heavy websites. • Apply anti-bot bypass strategies and proxy rotation for uninterrupted data collection. • Integrate NLP and computer vision models to extract data from unstructured content such as PDFs, images, and chat logs. LLM Deployment & Use Case Customization • Fine-tune, deploy, and maintain LLMs for domain-specific applications including summarization, classification, and data transformation. • Implement retrieval-augmented generation (RAG) pipelines for highperformance, production-grade AI solutions. Data Extraction & Processing • Design...

Overview We're looking for a data-obsessed explorer who can build and maintain pipelines that collect, clean, and enhance large volumes of data, then apply AI tools to keep it accurate, useful, and ready for analysis. This is initially a project-based role with the possibility of evolving into a full-time contract based on performance and business needs. Key Responsibilities Data Acquisition & Scraping Design, develop, and maintain scalable web-scraping systems and APIs to collect structured and unstructured data from diverse sources. Ensure compliance with data privacy laws (GDPR, CCPA) and site-specific terms of service. Data Enrichment & Transformation Implement pipelines to clean, normal...

We are looking for a skilled and motivated AI and Data Crawling Programmer with 12 years of hands-on experience in building data-driven solutions. The ideal candidate will have practical exposure to AI/ML concepts, data crawling, and web scraping, with the ability to design efficient crawlers and contribute to AI model development. Prior experience in website development or data integration will be a strong advantage. Key Responsibilities Design, develop, and maintain scalable web crawlers and scraping tools. Collect, clean, and preprocess large datasets to support AI/ML pipelines. Work with data scientists and engineers to integrate crawled data into AI models. Research and implement techni...

Role Overview: You are sought after for your expertise in a full-stack Python environment, including QA, Database, and AI. Your passion for Python engineering with hands-on experience is evident, having built web services, supported QA/automation workflows, and proficiently worked with SQL/NoSQL databases. This role offers the opportunity to further grow technically, especially if you have dabbled in AI/ML tooling or frameworks. Key Responsibilities: - Develop, test, and maintain Python-based backend services using Django, FastAPI, or Flask - Execute efficient web scraping tasks using BeautifulSoup or Scrapy - Automate browser workflows using Selenium - Write scalable database queries and sc...

Job Description: Data Research Specialist – B2B Leads Location: Bangalore, India About the Role: We are seeking a highly skilled Data Research Specialist who can leverage advanced AI, data science, and automation to identify, enrich, and deliver high-quality B2B leads. This role is integral to enhancing our sales pipeline by providing actionable intelligence, predictive insights, and accurate datasets for our business development and marketing teams. Key Responsibilities: - Lead Identification & Enrichment: Research and build high-quality B2B lead databases using AI/ML-based tools, web scraping frameworks, and third-party APIs. Enrich and validate prospect data (e.g., firmographics, technogr...

We are seeking highly motivated and results-driven Business Development Executives to join our sales team. The successful candidate will be responsible for supporting overall sales operations, strengthening client relationships, and contributing to revenue growth. A core aspect of this role will be lead generation and data acquisition from digital platforms to build and maintain a qualified sales pipeline. Key Responsibilities Lead Generation: Identify, qualify, and generate prospective leads through online tools, platforms, and databases (e.g., LinkedIn, industry events, company websites, and email sources). Client facing capabilities to include ability to pitch new business and ideas to po...

Job Summary The Software Engineer role at Granicus is for developers growing their technical and software development skills developing products in a SaaS based environment. They take on challenging technical tasks and consistently make significant contributions to all areas of the Granicus product suite. Software Engineers are proficient in multiple different technologies and gain on-the-job experience applying their knowledge and experience in improving the design and quality of our products. They understand the deployment process and support our applications in all environments. As they gain expertise, they share their knowledge with the broader engineering team. #India What Your Impact W...

Looking for someone who thrives in a full-stack Python + QA + Database + AI environment and is excited to grow technically. If you’re a passionate Python engineer with 3–5 years of hands-on experience. You’ve built web services, supported QA/automation workflows, and worked confidently across SQL/NoSQL databases. Ideally, you’ve also experimented with AI/ML tooling or frameworks, so this opportunity is for you. Responsibilities Develop, test, and maintain Python-based backend services using Django, FastAPI, or Flask Execute efficient web scraping tasks using BeautifulSoup or Scrapy Automate browser workflows using Selenium Write scalable database queries and schema designs for SQL (PostgreSQ...