293 Web Scraping Jobs - Page 3

As a Python Developer at a rapidly growing company, your role involves: - Excellent knowledge of Python language - Designing, implementing & documenting the backend APIs for the platform - Interacting with Business Users to understand key project requirements and documenting them well - Solving complex performance problems and architectural challenges - Configuring and maintaining software/system deployment scripts - Developing integrations with third-party web-based applications - Producing and maintaining technical product documentation To excel in this role, you should possess the following qualifications: - Bachelor's/Master's degree in Engineering, Computer Science (or equivalent experi...

As a Production Management professional at our company in Coimbatore, Tamil Nadu, India, you will play a crucial role in overseeing project planning, communication, documentation, quality assurance, and collaboration within the team. Your responsibilities will involve assisting project managers in developing project plans, maintaining schedules, facilitating communication between teams, clients, and stakeholders, and ensuring project deliverables meet high-quality standards. - Help project managers in developing comprehensive project plans, setting deadlines, and defining key milestones. - Maintain project schedules, ensure deadlines are met, and tasks are completed on time. - Allocate resou...

As an ESG Specialist at LSEG, your role involves providing subject matter expertise, skills, and knowledge to maintain existing databases and test future databases, tools, and systems. You will drive automation and simplification to enhance efficiency and quality in ESG Operations. The ESG Specialist team at LSEG leverages expertise in building and maintaining content on databases, testing future databases, and driving automation and simplification for efficiency and quality within ESG Operations. **Key Responsibilities:** - Develop and deploy machine learning and deep learning models for complex problem-solving. - Conduct statistical analysis to identify trends, patterns, and insights. - Ap...

As a Fare and Market Analyst at Skywings, your role will involve conducting competitive pricing analysis for flights, travel packages, and supplementary travel services. You will be responsible for monitoring fare fluctuations in international markets to identify pricing trends, gaps, and emerging opportunities. Additionally, you will benchmark the company's fares and offerings against key competitors to determine market positioning and value proposition. Collaboration with pricing, marketing, and product teams will be essential to refine pricing strategies and plan campaigns effectively. Utilizing Global Distribution Systems, web scraping tools, and third-party data sources, you will gather...

Role Overview: As a Python Developer at Zapbuild, you will be responsible for developing and maintaining web applications using Python and Django rest framework. Your role will involve working on MySQL databases, web scraping, containerizing applications with Docker, and front-end development using JavaScript, HTML, and CSS. You will also be involved in building and consuming RESTful APIs and version control using Git. This position requires 2 to 5 years of experience. Key Responsibilities: - Proficient in Python and Django rest framework. - Hands-on experience with MySQL, including schema design, query optimization, and performance tuning. - Experience in web scraping using Python tools lik...

We are seeking an experienced Web Scraping Engineer with deep expertise in Scrapy to develop, maintain, and optimize web crawlers. The ideal candidate will have a strong background in extracting, processing, and managing large-scale web data efficiently. Responsibilities : - Write and maintain web scraping scripts using Python Optimize custom web scraping tools and workflows. - Familiarity with Python and web scraping frameworks (Scrapy, Selenium, BeautifulSoup, Requests, Playwright). - Troubleshoot and resolve scraping challenges, including CAPTCHAs, rate limiting, and IP blocking. - Experience with proxy management (Rotating IPs, VPNs, Residential proxies, etc.) - Handle dynamic content us...

As a Junior Data Engineer, your role involves developing, maintaining, and optimizing data pipelines to ensure seamless extraction, transformation, and loading (ETL) of data. You will also be responsible for building and maintaining web crawlers and scraping solutions to gather structured and unstructured data from various online sources. Collaboration with the Data Science and Analytics teams to ensure data collected meets the required standards for analysis is crucial. Working with relational and non-relational databases to store and retrieve large datasets will be part of your daily tasks. Monitoring data quality processes, ensuring data integrity, and assisting in performance tuning and ...

As a Tech Analyst at Benori, your role will involve working with the sales and delivery teams on various activities related to the integration of AI/Gen AI, data extraction, management, and automation. Key Responsibilities: - Design, test, and refine prompt structures to elicit optimal responses from AI models, ensuring high accuracy and relevance for specific use cases. - Develop and implement RAG pipelines that combine prompt engineering with retrieval systems, enabling models to draw on relevant contextual information from external databases or knowledge bases. - Leverage existing APIs provided by different tools and services to connect applications, exchange data, and automate processes ...

As an ideal candidate for the role, you will be responsible for the following: Role Overview: You will be developing Python and C# scripts to extract and process data from PDF documents, perform data transformation and analysis using pandas, and automate web processes using Selenium. Additionally, you will handle complex PDFs with OCR tools and LLM models, design RPA solutions with UiPath Studio, and conduct quality assurance testing on bots and scripts. Troubleshooting data extraction issues, writing unit and integration tests, and performing API integration and web scraping are also key parts of your responsibilities. Furthermore, you will work with front-end technologies like HTML, CSS, a...

Role Overview: As a Web Scraper, your main responsibility is to apply your expertise to extract data from various online sources. You will be tasked with developing reliable web scrapers and parsers for different websites. Your role involves extracting structured/unstructured data and storing it in SQL/NoSQL data stores. Additionally, you will collaborate closely with Project/Business/Research teams to provide the scraped data for analysis. It will be your duty to maintain the scraping projects that are delivered to production and to create frameworks for automating and ensuring a continuous flow of data from multiple sources. You should be able to work independently with minimal supervision...

As a BI Architect in Gen AI, your role involves architecting a scalable and performant BI platform that serves as a single source of truth for key business metrics across functions such as Sales, Marketing, Supply Chain, and Finance. You will be advising the BI Lead by aligning architecture decisions with long-term strategy and business priorities. Additionally, you will design a GenAI-powered natural language interface on top of BI dashboards to enable business users to query KPIs, trends, and anomalies conversationally. Your responsibilities also include selecting and implementing appropriate architectures like RAG using vector stores and Knowledge Graphs to support intelligent, context-aw...

Build and maintain scalable data pipelines, optimize LLM-based AI workflows, perform web/social media scraping, ensure data quality, integrate APIs, mentor junior engineers, conduct code reviews, contribute to architecture and technical decisions.

Role Overview: As a Lead software/Python Web Developer at Hypersonix.ai, you will be responsible for managing the interchange of data between the server and the users. Your primary focus will be on developing all server-side logic to ensure high performance and responsiveness to requests from the front-end. Additionally, you will integrate front-end elements into the application and require a basic understanding of front-end technologies. Key Responsibilities: - Writing reusable, testable, and efficient code. - Designing and implementing low-latency, high-availability, and performant applications. - Integrating user-facing elements developed by front-end developers with server-side logic. - ...

You are an experienced Senior Network Security Automation Tester with 5+ years of Industry experience and hands-on experience in End-to-End Solution testing in Security SDWAN area. Your key responsibilities include: - Strong understanding of network security concepts, protocols, and technologies. - QA Experience with VPN technologies (e.g., IKev2, IKev1, IPSec, SSL/TLS etc). - QA Experience with SD-WAN technologies and solutions. - Hands-on experience with network devices, L2/L3 protocols, and traffic generation tools (Ixia, Spirent). - Knowledge of next-generation network security standards (e.g., Post-Quantum Cryptography) and best practices. - Proficient in Python and standard libraries. ...

Key Responsibilities1 Design, develop, and maintain robust Python scripts for data processing, cleaning, and transformation Work extensively with Pandas for complex data manipulation and reporting Automate Excel workflows using OpenPyXL and win32com libraries Build and optimize web scraping solutions using Selenium (and other scraping tools if required) Maintain and scale existing Python-based applications and automation pipeline Troubleshoot, debug, and optimize performance of data workflows and scraping processes Ensure data accuracy, reliability, and process scalability Collaborate with stakeholders to understand business requirements and deliver automated solutions Take ownership of exis...

Role Overview: As the Data Analytics and Insights Manager at Piramal Pharma Solutions, you will play a crucial role in driving data-driven decision-making using advanced analytics, artificial intelligence (AI), and machine learning techniques. Your primary focus will be on utilizing technology to automate data extraction, generate actionable insights, and provide predictive analytics to support business growth. You will be responsible for automating data integration from diverse sources, identifying key trends through data mining, and delivering strategic insights to optimize marketing and sales strategies. Key Responsibilities: - Utilize advanced data extraction techniques, automation tools...

As a strategy leader in Tracxn's Data Operations & Strategy team, your role involves owning the strategy, KPIs, and automation roadmap for a large-scale data organization. You will drive operational excellence, AI-led innovation, and team leadership. **Key Responsibilities** - Define and execute a long-term strategy for Tracxns Data department. - Translate business goals into operational priorities, KPIs, and success metrics. - Identify and implement new data acquisition models, automation tools, and AI/ML solutions. - Lead large-scale SaaS-style data pipelines involving APIs, web scraping, AI/LLMs, and human curation. - Improve accuracy, turnaround time, and scalability of data operations. ...

As a developer at our company, your role involves the complete development, testing, and deployment of applications and systems. You will be responsible for the following key tasks: - Experience in Python with Flask framework - Proficiency in Python for web scraping and MongoDB for backend operations - Ability to utilize MongoDB-based REST API effectively - Hands-on experience in developing large-scale applications - Proficient in using JIRA for product requirements and Bitbucket for source control - Capable of translating Figma UI design screens into UI specifications - Knowledge of Azure Cosmos DB - Strong understanding and respect for Intellectual Property rights To be successful in this ...

You are a highly skilled and experienced Senior Node.js Developer with expertise in web scraping and web automation using tools like Chrome DevTools Protocol (CDP). Your solid understanding of web automation techniques, along with strong proficiency in Node.js and TypeScript, will be essential for designing and implementing robust web automation solutions to ensure efficiency and scalability. - Develop and maintain web scraping and automation scripts using Puppeteer, CDP, or other web automation tools. - Design and build scalable, high-performance systems for web data extraction and automation. - Collaborate with cross-functional teams to gather requirements and implement solutions. - Ensure...

We are hiring Backend Python Developer, with a strong focus on web development and automation along with web crawling/scraping, Selenium, RESTful APIs/FastAPI, Docker, Kubernetes, MS SQL Server and MongoDB exp. Years of experience - 5 to 8 Location - Hyderabad Interested candidates pleas drop your resumes to praveenkumard@ritefit.ai

Role Overview: As an automation engineer, your focus will be on designing and implementing intelligent automation solutions using Python, GenAI models, and RPA techniques. You will be responsible for developing scalable automation frameworks, performing data extraction/parsing from multiple sources, and integrating systems to support business workflows. Key Responsibilities: - Automation Development: Build and maintain RPA solutions for tasks such as web scraping (traditional and AI-driven), PDF parsing, and OCR-based data extraction. - GenAI Integration: Implement intelligent data parsing pipelines using LLMs (OpenAI, Google Gemini, Grok, etc.) and prompt engineering. - Application Developm...

Job Summary: We are seeking an accomplished and highly experienced Senior Data Analyst / Tech Lead with over 5 years of proven expertise in analytics and technology leadership, also preferably within the E-commerce domain. This role requires a strategic thinker who can manage and lead the entire technology and analytics function, while driving innovation, efficiency, and business impact. The ideal candidate will possess deep knowledge of Power BI, Python, SQL, Power Apps, and advanced Excel, along with strong leadership, client-handling, and project management skills. Key Responsibilities: creation of dynamics data scrappers, webcrawleds, auto bots, automation of process and data analytics. ...

Russell Investments is actively hiring for Artificial Intelligence, Analyst for Mumbai, Goregaon (E) location. Interested applicants please apply through below mentioned link: https://russell.wd5.myworkdayjobs.com/russellinvestments/job/Mumbai/Analyst--AI_R-03416 Job Description This role is responsible for supporting and growing the AI strategy, platform and deliverables at Russell Investments. We are looking for a curious and analytical individual who will research, develop, implement, and maintain processes to meet the needs of our AI strategy and deliver on business objectives. This is an excellent opportunity to take advantage of emerging trends and technologies and make a real-world di...

Job Title: Python Developer Data Extraction & Automation Role Type: Hybrid Location: Bengaluru (Bangalore) Experience: 3+ years Shift Timings: 6am to 3pm and 2pm to 11pm About the Role We are looking for a Python Developer with strong programming fundamentals to build and maintain automated tools for large-scale data extraction. You will design scrapers, work with APIs, transform raw data into usable formats, and ensure high reliability of our data pipelines. Your work will directly enable data-driven decisions by delivering accurate, clean, and consistent data at scale. Key Responsibilities Design, develop, and maintain automated data extraction and web scraping tools using Python. Extract ...

As an AI Engineer at GenAI & Applied ML, you will have the opportunity to work with cutting-edge AI technologies, particularly in Generative AI, Large Language Models (LLMs), and applied machine learning. Your role will involve designing, building, and deploying AI solutions using platforms like OpenAI, Hugging Face, and Cohere, specifically for applications in document intelligence, automation, and Q&A systems. You will collaborate with product and engineering teams to integrate AI features into scalable platforms, utilizing tools like Lang Chain, Flask, and AWS/GCP to deploy models effectively. - Integrate RAG (Retrieval-Augmented Generation), prompt engineering, and zero/few-shot learning...