Ahmedabad
INR 7.5 - 17.5 Lacs P.A.
Work from Office
Full Time
What we are looking for The ideal candidate will possess hands-on expertise in designing and deploying advanced web scraping solutions, leveraging Node.js and other technologies. A significant focus will be on overcoming bot detection challenges, building scalable and resilient scraping systems, and ensuring the efficiency and scalability of data acquisition pipelines. This is a highly technical, hands-on role ideal for someone passionate about solving complex scraping and infrastructure challenges. Things you will be doing Advanced Web Scraping: Develop and maintain high-performance scraping systems using Node.js, Python, or other relevant technologies. Handle JavaScript-heavy and asynchronous content using tools like Puppeteer, Playwright, or custom solutions in Node.js. Implement advanced bot detection bypass techniques, including: CAPTCHA solving using automation, AI/ML, or third-party services. Advanced proxy management and IP rotation strategies. User-agent, cookie, and header spoofing. Build robust error-handling mechanisms to adapt to changes in website structures or anti-scraping measures. Bot Detection and Anti-Scraping Expertise: Analyze and reverse-engineer advanced bot detection systems and anti-scraping mechanisms, including rate-limiting, behavioral analysis, and fingerprinting. Design and implement techniques to bypass WAFs (Web Application Firewalls) and server-side protections using Node.js libraries and tools. Monitor, log, and analyze bot detection patterns to ensure system adaptability. Create innovative solutions to blend scraping traffic with legitimate user behavior. Infrastructure and Networking: Architect and maintain scalable infrastructure using containerization tools like Docker and orchestration platforms such as Kubernetes. Leverage cloud platforms (AWS, GCP, Azure) for distributed scraping and data acquisition. Utilize Node.js and related tools to optimize network configurations for high-throughput scraping, including proxy and load balancer configurations. Automate deployment and scaling of scraping systems using CI/CD pipelines. Performance and Optimization: Ensure optimal performance of scraping systems by reducing latency and optimizing resource utilization. Develop robust monitoring and logging systems to track and troubleshoot issues in real time. Optimize pipelines for scalability, fault tolerance, and high availability. Compliance and Security: Ensure adherence to legal, ethical, and regulatory standards (e.g., GDPR, CCPA) for all scraping activities. Safeguard data acquisition systems from detection, blocking, and external threats. Respect website terms of service while implementing efficient scraping solutions. Skills you need in order to succeed in this role Technical Skills: 3+ years of hands-on experience in web scraping or data engineering. Expertise in Node.js for building and optimizing scraping systems. Deep expertise in handling advanced bot detection systems and anti-scraping mechanisms. Strong knowledge of programming languages such as Python and JavaScript. Advanced understanding of networking concepts, including HTTP/HTTPS protocols, WebSockets, DNS, and API integrations. Experience with containerization tools (Docker) and orchestration platforms (Kubernetes). Proficiency in cloud platforms (AWS, GCP, Azure) for scalable data acquisition pipelines. Familiarity with tools like Puppeteer, Playwright, Scrapy, or Selenium. Problem-Solving Expertise: Proven ability to reverse-engineer anti-bot measures such as CAPTCHA, IP blocks, and fingerprinting. Strong debugging and optimization skills for network and scraping pipelines.
Ahmedabad
INR 7.5 - 12.0 Lacs P.A.
Work from Office
Full Time
Who are we? At MeasureOne , we are redefining consumer-permissioned data exchange. We empower businesses to access trusted consumer data- like insurance, employment, education, and income while- prioritizing privacy, consent, and reliability. Our developer-first API platform transforms how companies verify information and build customer trust. What are we looking for We are hiring a functional tester who codes someone who deeply understands the product, relentlessly questions its behavior, and automates everything that matters. You lead with curiosity, think like a user, but execute like an engineer. This isnt a manual QA job. This is a role for someone who: Sees a user flow and thinks, How do I script this intelligently? Sees a bug and asks, Why did this escape the pipeline, and how do I write a test that prevents it forever? You care about quality because you care about the product. What will you own Design and implement automation-first functional tests that cover real-world, user-driven scenarios Write robust, maintainable scripts across UI, APIs, and workflows no manual test repetition Own end-to-end test coverage for product features from discovery to release Collaborate with product and engineering teams to define and test user outcomes, not just inputs/outputs Continuously improve testing strategy, coverage, and CI/CD integration Diagnose product behaviors, investigate issues, and ensure high signal from automated failures What you need to succeed Must-Haves: 5+ years in QA or testing roles with vigorous functional testing and automation experience. Hands-on scripting skills in Python, JavaScript, or Java. Strong experience with API testing, tools like Postman, REST-assured, or similar. Proven ability to break systems through exploratory testing and turn that insight into automated protection. Writes test code like production code: modular, maintainable, and DRY. Experience abstracting fixtures, test data, and assertions for reuse across test cases. Understands and translates API contracts (Swagger/OpenAPI) into reliable automation. Experience owning quality gates in CI/CD workflows (GitHub Actions, Jenkins, etc.). Clear, concise communicator both in reporting bugs and collaborating across teams. Deep understanding of Agile environments and product-centric development. Nice-to-Have: Experience working in early-stage product environments or startups. Familiarity with security, performance, or accessibility testing. Why Join MeasureOne Be part of a fast-growing, mission-driven company shaping the future of consumer data. Work alongside a collaborative and quality-focused team.
My Connections Measureone Solution Pvt Ltd
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.