Web Scraping Specialist YipitData (Alternative)

4.0 - 8.0 years

0 Lacs

hyderabad, telangana

On-site

YipitData is a leading market research and analytics firm in the disruptive economy that has recently secured up to $475M from The Carlyle Group, valuing over $1B. For three consecutive years, YipitData has been recognized as one of Inc's Best Workplaces, fostering a people-centric culture centered around mastery, ownership, and transparency. As a fast-growing technology company with offices in various locations worldwide, including NYC, Austin, Miami, and others, we offer exciting opportunities for individuals looking to make a significant impact. As a Web Scraping Specialist at YipitData, you will be part of the Data Solutions team, reporting directly to the Data Solutions Engineering Manager. Your role will involve designing, refactoring, and maintaining web scrapers crucial for generating key reports across the organization. By ensuring the efficiency, reliability, and scalability of our data ingestion processes, you will directly support multiple business units and products. Key Responsibilities: - Refactor and maintain web scrapers to enhance reliability, maintainability, and efficiency. - Implement advanced scraping techniques using fingerprinting methods to evade detection and blocking. - Collaborate with cross-functional teams to gather requirements, align on targets, and ensure data quality. - Monitor, troubleshoot, and optimize scraper performance to address failures and bottlenecks. - Drive continuous improvement by proposing new methodologies and technologies to enhance scraping capabilities. To succeed in this role, effective communication skills in English, a minimum of 4 years of experience with web scraping frameworks, and a strong understanding of HTTP, RESTful APIs, and HTML parsing are essential. Additionally, expertise in advanced fingerprinting and evasion strategies, managing cookies, headers, and proxies, as well as troubleshooting skills for optimizing scraper performance, are required. This is a fully-remote position based in India with flexible working hours from 11am to 8pm IST. At YipitData, we offer a competitive compensation package, comprehensive benefits, and a supportive work environment focused on personal growth and skill mastery. Your impact and contributions are what drive your growth at YipitData, where learning, self-improvement, and skill development are encouraged and valued.,

Posted 3 days ago

Apply

Web Crawling Specialist YipitData (Alternative)

4.0 - 8.0 years

0 Lacs

ahmedabad, gujarat

On-site

YipitData is the leading market research and analytics firm for the disruptive economy, having recently raised up to $475M from The Carlyle Group at a valuation over $1B. For three years and counting, YipitData has been recognized as one of Inc's Best Workplaces. As a fast-growing technology company with offices in various locations including NYC, Austin, Miami, and more, we cultivate a people-centric culture focused on mastery, ownership, and transparency. As a Web Crawling Specialist [Official, Internal Title: Data Solutions Engineer] at YipitData, you will play a pivotal role in designing, refactoring, and maintaining web scrapers that power critical reports across the organization. Reporting directly to the Data Solutions Engineering Manager, your contributions will ensure that data ingestion processes are resilient, efficient, and scalable, directly supporting multiple business units and products. In this role, you will be responsible for overhauling existing scraping scripts to improve reliability, maintainability, and efficiency. You will implement best coding practices to ensure quality and sustainability. Additionally, you will utilize sophisticated fingerprinting methods to avoid detection and blocking, handle dynamic content, navigate complex DOM structures, and manage session/cookie lifecycles effectively. Collaborating with cross-functional teams, you will work closely with analysts and stakeholders to gather requirements, align on targets, and ensure data quality. You will provide support to internal users of web scraping tooling by offering troubleshooting, documentation, and best practices to ensure efficient data usage for critical reporting. Your responsibilities will also include developing monitoring solutions, alerting frameworks to identify and address failures, evaluating scraper performance, diagnosing bottlenecks, and scaling issues. You will propose new tooling, methodologies, and technologies to enhance scraping capabilities and processes, staying up to date with industry trends and evolving bot-detection tactics. This fully-remote opportunity based in India offers standard work hours from 11am to 8pm IST with flexibility. Effective communication in English, 4+ years of experience with web scraping frameworks, a strong understanding of HTTP, RESTful APIs, HTML parsing, browser rendering, and TLS/SSL mechanics, expertise in advanced fingerprinting and evasion strategies, and troubleshooting skills are key to succeeding in this role. At YipitData, we offer a comprehensive compensation package, including benefits, perks, and a competitive salary. We prioritize your personal life with offerings such as vacation time, parental leave, team events, and learning reimbursement. Your growth at YipitData is determined by the impact you make, fostering an environment focused on ownership, respect, and trust.,

Posted 4 days ago

Apply

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.