Data Acquisition Engineer ( Web Scraping and Web Crawling)

3 - 8 years

6 - 15 Lacs

Posted:2 weeks ago| Platform: Naukri logo

Apply

Work Mode

Remote

Job Type

Full Time

Job Description

Role & responsibilities

As a Data Engineer focused on web crawling and platform data acquisition, you will design,

develop, and maintain large-scale web scraping pipelines to extract valuable platform data. You

will be responsible for implementing scalable and resilient data extraction solutions, ensuring

seamless data retrieval while working with proxy management, anti-bot bypass techniques, and

data parsing. Optimizing scraping workflows for performance, reliability, and efficiency will be a

key part of your role. Additionally, you will ensure that all extracted data maintains high quality

and integrity.

Preferred candidate profile

We are seeking candidates with:

  • Strong experience in Python and web scraping frameworks such as Scrapy, Selenium,

Playwright, or BeautifulSoup.

  • Knowledge of distributed web crawling architectures and job scheduling.
  • Familiarity with headless browsers, CAPTCHA-solving techniques, and proxy

management to handle dynamic web challenges.

  • Experience with data storage solutions, including SQL, and cloud storage.
  • Understanding of big data technologies like Spark and Kafka (a plus).
  • Strong debugging skills to adapt to website structure changes and blockers.
  • A proactive, problem-solving mindset and ability to work effectively in a team-driven

environment.

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Maventech Inida logo
Maventech Inida

Information Technology

Lucknow

RecommendedJobs for You