Home
Jobs
Companies
Resume
Maventech Inida logo

Lead Data/ Web Scrapping Engineer

7 - 12 years

12 - 22 Lacs

Bengaluru

Posted:1 week ago| Platform: Naukri logo

Apply

Skills Required

Scrapy Web Crawling Selenium Beautiful Soup Playwright

Work Mode

Remote

Job Type

Full Time

Job Description

Role & responsibilities As a Data Engineer focused on web crawling and platform data acquisition, you will design, develop, and maintain large-scale web scraping pipelines to extract valuable platform data. You will be responsible for implementing scalable and resilient data extraction solutions, ensuring seamless data retrieval while working with proxy management, anti-bot bypass techniques, and data parsing. Optimizing scraping workflows for performance, reliability, and efficiency will be a key part of your role. Additionally, you will ensure that all extracted data maintains high quality and integrity. Preferred candidate profile We are seeking candidates with: Strong experience in Python and web scraping frameworks such as Scrapy, Selenium, Playwright, or BeautifulSoup. Knowledge of distributed web crawling architectures and job scheduling. Familiarity with headless browsers, CAPTCHA-solving techniques, and proxy management to handle dynamic web challenges. Experience with data storage solutions, including SQL, and cloud storage. Understanding of big data technologies like Spark and Kafka (a plus). Strong debugging skills to adapt to website structure changes and blockers. A proactive, problem-solving mindset and ability to work effectively in a team-driven environment.

More Jobs at Maventech Inida

Big Data Engineer, Bangalore/Hyderabad (Remote)

Hyderabad

3 - 6 yrs
|

INR 15 - 25 Lacs

Technical support manager , Enterprise SAAS or B2B Analytics

Bengaluru

10 - 18 yrs
|

INR 12 - 20 Lacs

Big Data Engineer Lead

Bengaluru

7.0 - 10.0 yrs
|

INR 12 - 22 Lacs

Lead Data/ Web scrapping Engineer

Bengaluru

7.0 - 11.0 yrs
|

INR 12 - 19 Lacs

Lead Data/ Web Scrapping Engineer

Bengaluru

7.0 - 12.0 yrs
|

INR 12 - 22 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Scrapy Interview Now

My Connections Maventech Inida

Download Chrome Extension (See your connection in the Maventech Inida )

chrome image
Download Now
Maventech Inida
Maventech Inida
maventech.in

Information Technology

Lucknow

50-100 Employees

5 Jobs

    Key People

  • Amit Kumar

    CEO

  • Priya Singh

    CTO

RecommendedJobs for You

Maventech Inida logo

Lead Data/ Web Scrapping Engineer

Maventech Inida

Bengaluru

Merck Sharp & Dohme (MSD) logo

Intern - Pharmaceutical Forecasting

Merck Sharp & Dohme (MSD)

Pune

The Edge Partnership logo

Associate - Data Management

The Edge Partnership

Mumbai, Pune, Bengaluru

The Edge Partnership logo

Associate Data Management

The Edge Partnership

Mumbai, Pune, Bengaluru

Naukri E Hire Campaign logo

Technical Analyst

Naukri E Hire Campaign

Noida, Hyderabad, Pune

Momentum Financial Services Group logo

Operations Data Analyst

Momentum Financial Services Group

Hyderabad

HCLTech logo

Llmops

HCLTech

Noida, Hyderabad, Bengaluru

ti Steps logo

Junior Data Scientist

ti Steps

Hyderabad, Chennai, Bengaluru

ti Steps logo

Junior Data Analyst

ti Steps

Hyderabad, Chennai, Bengaluru

KGK Group logo

Data Analyst

KGK Group

Surat