619 Scrapy Jobs - Page 3

You have the opportunity to join a dynamic team as a Backend Developer with a focus on utilizing your expertise in Node.js, Go, and Python. Your role will involve working on high-scale consumer internet projects, requiring a minimum of 6 years of experience in backend development. Additionally, you will be utilizing machine learning frameworks like TensorFlow or PyTorch, along with developing web crawlers and scrapers using tools such as Scrapy. Your strong understanding of cloud infrastructure, DevOps practices, and CI/CD pipelines will be essential in this role. Moreover, your familiarity with large-scale data processing and storage will be an asset to the team. **Key Responsibilities:** -...

We are seeking a Web Crawling Engineer who will be responsible for building and maintaining web crawlers, extracting valuable insights from the web, and ensuring data quality. The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms. About Forage AI : Forage AI is a pioneering AI-powered data extraction and automation company that transforms complex, unstructured web and document data into clean, structured intelligence. Our platform combines web crawling, NLP, LLMs, and agentic AI to deliver highly accurate firmographic and enterprise insights across numerous domains. Trusted by ...

Role Overview: You will design, build, and operate software for data collection and processing at scale. The role is hands‑on, with emphasis on clean design, reliability, and performance. About Forage AI: ForageAI builds next‑generation systems for data collection and processing — large‑scale web crawling , document parsing , data pipelines, and automation. We work primarily in Python , leverage cloud‑native designs (mainly AWS , with exposure to GCP/Azure ), and increasingly apply GenAI and AI agents across our stack. Every developer owns their module and collaborates closely with peers in a high‑ownership, high‑trust environment. Location: Remote (Work from Home) Key Responsibilities: · De...

Role Overview: As a skilled Web Scraping Data Analyst, your primary responsibility will involve collecting, cleaning, and analyzing data from various online sources. You will leverage your expertise in Python-based scraping frameworks to design, develop, and maintain robust web scraping scripts using tools such as Python, BeautifulSoup, Scrapy, Selenium, and more. Additionally, you will be tasked with implementing IP rotation, proxy management, and anti-bot evasion techniques to ensure efficient data collection. Your role will be instrumental in constructing data pipelines that drive our analytics and business intelligence initiatives. Key Responsibilities: - Collect, clean, and analyze data...

Summary To enhance user profiling and risk assessment, we are building web crawlers to collect relevant user data from third-party sources, forums, and the dark web. We are seeking a Senior Web Crawler & Data Extraction Engineer to design and implement these data collection solutions. Job Responsibilities Design, develop, and maintain web crawlers and scrapers to extract data from open web sources, forums, marketplaces, and the dark web. Implement data extraction pipelines that aggregate, clean, and structure data for fraud detection and risk profiling. Use Tor, VPNs, and other anonymization techniques to safely crawl the dark web while avoiding detection. Develop real-time monitoring soluti...

Responsibilities Write clean, efficient, and reusable Python code Develop, test, and maintain backend applications using Python frameworks (Django/Flask/FastAPI) Design and manage scalable database structures and APIs Integrate front-end elements with server-side logic Debug and troubleshoot issues to improve performance and reliability Collaborate with cross-functional teams (UI/UX, QA, DevOps) Work with version control systems like Git for code reviews and collaborative development Implement security protocols, authentication, and authorization Create automation scripts and tools as required Qualifications & Skills Strong foundation in Python programming Experience with Django , Flask , or...

At Hire Central , we specialize in connecting talented professionals with leading companies across the globe. We take a thoughtful, people-first approach to recruiting, ensuring that every candidate feels supported and every company finds the right match. With clients from the US, UK, NZ, and beyond, we’re proud to help ambitious individuals discover opportunities where they can thrive and grow. Job Overview We are hiring a remote Off-Market Property Research & Data Specialist to help identify high-potential off-market development sites through Python automation, GIS analysis, and real estate research. This individual will play a key role in compiling property databases and optimizing resear...

You are a skilled and motivated AI and Data Crawling Programmer with 12 years of hands-on experience in building data-driven solutions. You have practical exposure to AI/ML concepts, data crawling, and web scraping, with the ability to design efficient crawlers and contribute to AI model development. Your prior experience in website development or data integration gives you a strong advantage. - Design, develop, and maintain scalable web crawlers and scraping tools. - Collect, clean, and preprocess large datasets to support AI/ML pipelines. - Work with data scientists and engineers to integrate crawled data into AI models. - Research and implement techniques to improve data accuracy, efficie...

Experience : 3.00 + years Salary : Confidential (based on experience) Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full time Permanent Position (*Note: This is a requirement for one of Uplers' client - Revq.in) What do you need for this opportunity? Must have skills required: Python, Django, Flask, MySQL, PostgreSQL Revq.in is Looking for: The Opportunity As a Team Lead, you will architect, develop, and scale high-impact solutions, leading projects from concept to deployment. This is a high-ownership role for someone ready to lead a technical team and prepare to step into an engineering manager capacity within a 2-4 year horizon. What You'll Do Lead devel...

Experience : 3.00 + years Salary : Confidential (based on experience) Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full time Permanent Position (*Note: This is a requirement for one of Uplers' client - Revq.in) What do you need for this opportunity? Must have skills required: Python, Django, Flask, MySQL, PostgreSQL Revq.in is Looking for: The Opportunity As a Team Lead, you will architect, develop, and scale high-impact solutions, leading projects from concept to deployment. This is a high-ownership role for someone ready to lead a technical team and prepare to step into an engineering manager capacity within a 2-4 year horizon. What You'll Do Lead devel...

Experience : 3.00 + years Salary : Confidential (based on experience) Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full time Permanent Position (*Note: This is a requirement for one of Uplers' client - Revq.in) What do you need for this opportunity? Must have skills required: Python, Django, Flask, MySQL, PostgreSQL Revq.in is Looking for: The Opportunity As a Team Lead, you will architect, develop, and scale high-impact solutions, leading projects from concept to deployment. This is a high-ownership role for someone ready to lead a technical team and prepare to step into an engineering manager capacity within a 2-4 year horizon. What You'll Do Lead devel...

Experience : 3.00 + years Salary : Confidential (based on experience) Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full time Permanent Position (*Note: This is a requirement for one of Uplers' client - Revq.in) What do you need for this opportunity? Must have skills required: Python, Django, Flask, MySQL, PostgreSQL Revq.in is Looking for: The Opportunity As a Team Lead, you will architect, develop, and scale high-impact solutions, leading projects from concept to deployment. This is a high-ownership role for someone ready to lead a technical team and prepare to step into an engineering manager capacity within a 2-4 year horizon. What You'll Do Lead devel...

Experience : 3.00 + years Salary : Confidential (based on experience) Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full time Permanent Position (*Note: This is a requirement for one of Uplers' client - Revq.in) What do you need for this opportunity? Must have skills required: Python, Django, Flask, MySQL, PostgreSQL Revq.in is Looking for: The Opportunity As a Team Lead, you will architect, develop, and scale high-impact solutions, leading projects from concept to deployment. This is a high-ownership role for someone ready to lead a technical team and prepare to step into an engineering manager capacity within a 2-4 year horizon. What You'll Do Lead devel...

Experience : 3.00 + years Salary : Confidential (based on experience) Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full time Permanent Position (*Note: This is a requirement for one of Uplers' client - Revq.in) What do you need for this opportunity? Must have skills required: Python, Django, Flask, MySQL, PostgreSQL Revq.in is Looking for: The Opportunity As a Team Lead, you will architect, develop, and scale high-impact solutions, leading projects from concept to deployment. This is a high-ownership role for someone ready to lead a technical team and prepare to step into an engineering manager capacity within a 2-4 year horizon. What You'll Do Lead devel...

Experience : 3.00 + years Salary : Confidential (based on experience) Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full time Permanent Position (*Note: This is a requirement for one of Uplers' client - Revq.in) What do you need for this opportunity? Must have skills required: Python, Django, Flask, MySQL, PostgreSQL Revq.in is Looking for: The Opportunity As a Team Lead, you will architect, develop, and scale high-impact solutions, leading projects from concept to deployment. This is a high-ownership role for someone ready to lead a technical team and prepare to step into an engineering manager capacity within a 2-4 year horizon. What You'll Do Lead devel...

Experience : 3.00 + years Salary : Confidential (based on experience) Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full time Permanent Position (*Note: This is a requirement for one of Uplers' client - Revq.in) What do you need for this opportunity? Must have skills required: Python, Django, Flask, MySQL, PostgreSQL Revq.in is Looking for: The Opportunity As a Team Lead, you will architect, develop, and scale high-impact solutions, leading projects from concept to deployment. This is a high-ownership role for someone ready to lead a technical team and prepare to step into an engineering manager capacity within a 2-4 year horizon. What You'll Do Lead devel...

Experience : 3.00 + years Salary : Confidential (based on experience) Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full time Permanent Position (*Note: This is a requirement for one of Uplers' client - Revq.in) What do you need for this opportunity? Must have skills required: Python, Django, Flask, MySQL, PostgreSQL Revq.in is Looking for: The Opportunity As a Team Lead, you will architect, develop, and scale high-impact solutions, leading projects from concept to deployment. This is a high-ownership role for someone ready to lead a technical team and prepare to step into an engineering manager capacity within a 2-4 year horizon. What You'll Do Lead devel...

Experience : 3.00 + years Salary : Confidential (based on experience) Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full time Permanent Position (*Note: This is a requirement for one of Uplers' client - Revq.in) What do you need for this opportunity? Must have skills required: Python, Django, Flask, MySQL, PostgreSQL Revq.in is Looking for: The Opportunity As a Team Lead, you will architect, develop, and scale high-impact solutions, leading projects from concept to deployment. This is a high-ownership role for someone ready to lead a technical team and prepare to step into an engineering manager capacity within a 2-4 year horizon. What You'll Do Lead devel...

Experience : 3.00 + years Salary : Confidential (based on experience) Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full time Permanent Position (*Note: This is a requirement for one of Uplers' client - Revq.in) What do you need for this opportunity? Must have skills required: Python, Django, Flask, MySQL, PostgreSQL Revq.in is Looking for: The Opportunity As a Team Lead, you will architect, develop, and scale high-impact solutions, leading projects from concept to deployment. This is a high-ownership role for someone ready to lead a technical team and prepare to step into an engineering manager capacity within a 2-4 year horizon. What You'll Do Lead devel...

Experience : 3.00 + years Salary : Confidential (based on experience) Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full time Permanent Position (*Note: This is a requirement for one of Uplers' client - Revq.in) What do you need for this opportunity? Must have skills required: Python, Django, Flask, MySQL, PostgreSQL Revq.in is Looking for: The Opportunity As a Team Lead, you will architect, develop, and scale high-impact solutions, leading projects from concept to deployment. This is a high-ownership role for someone ready to lead a technical team and prepare to step into an engineering manager capacity within a 2-4 year horizon. What You'll Do Lead devel...

Experience : 3.00 + years Salary : Confidential (based on experience) Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full time Permanent Position (*Note: This is a requirement for one of Uplers' client - Revq.in) What do you need for this opportunity? Must have skills required: Python, Django, Flask, MySQL, PostgreSQL Revq.in is Looking for: The Opportunity As a Team Lead, you will architect, develop, and scale high-impact solutions, leading projects from concept to deployment. This is a high-ownership role for someone ready to lead a technical team and prepare to step into an engineering manager capacity within a 2-4 year horizon. What You'll Do Lead devel...

Experience : 3.00 + years Salary : Confidential (based on experience) Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full time Permanent Position (*Note: This is a requirement for one of Uplers' client - Revq.in) What do you need for this opportunity? Must have skills required: Python, Django, Flask, MySQL, PostgreSQL Revq.in is Looking for: The Opportunity As a Team Lead, you will architect, develop, and scale high-impact solutions, leading projects from concept to deployment. This is a high-ownership role for someone ready to lead a technical team and prepare to step into an engineering manager capacity within a 2-4 year horizon. What You'll Do Lead devel...

Experience : 3.00 + years Salary : Confidential (based on experience) Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full time Permanent Position (*Note: This is a requirement for one of Uplers' client - Revq.in) What do you need for this opportunity? Must have skills required: Python, Django, Flask, MySQL, PostgreSQL Revq.in is Looking for: The Opportunity As a Team Lead, you will architect, develop, and scale high-impact solutions, leading projects from concept to deployment. This is a high-ownership role for someone ready to lead a technical team and prepare to step into an engineering manager capacity within a 2-4 year horizon. What You'll Do Lead devel...

Experience : 3.00 + years Salary : Confidential (based on experience) Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full time Permanent Position (*Note: This is a requirement for one of Uplers' client - Revq.in) What do you need for this opportunity? Must have skills required: Python, Django, Flask, MySQL, PostgreSQL Revq.in is Looking for: The Opportunity As a Team Lead, you will architect, develop, and scale high-impact solutions, leading projects from concept to deployment. This is a high-ownership role for someone ready to lead a technical team and prepare to step into an engineering manager capacity within a 2-4 year horizon. What You'll Do Lead devel...

Experience : 3.00 + years Salary : Confidential (based on experience) Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full time Permanent Position (*Note: This is a requirement for one of Uplers' client - Revq.in) What do you need for this opportunity? Must have skills required: Python, Django, Flask, MySQL, PostgreSQL Revq.in is Looking for: The Opportunity As a Team Lead, you will architect, develop, and scale high-impact solutions, leading projects from concept to deployment. This is a high-ownership role for someone ready to lead a technical team and prepare to step into an engineering manager capacity within a 2-4 year horizon. What You'll Do Lead devel...