Software Engineer Data

LevelShift

2 - 5 years

2 - 6 Lacs

chennai

Posted:1 week ago| Platform:

Apply

Skills Required

web scraping tool css rest api development python sql html

Work Mode

Work from Office

Job Type

Full Time

Job Description

Job Title:

Job Summary

web data extraction and API development

Key Responsibilities

Develop and maintain
web scraping scripts
using Python (Requests, BeautifulSoup, Selenium, Scrapy, etc.).
Automate extraction processes and ensure
reliable and repeatable data collection
.
Handle anti-scraping mechanisms (CAPTCHAs, rotating proxies, session management).
Clean, transform, and load the extracted data into internal databases.
Design and build
REST APIs
to access processed data from the database.
Optimize scraping workflows for performance, reliability, and error handling.
Maintain proper documentation for scraping logic, API endpoints, and workflows.
Monitor scraping tasks, troubleshoot failures, and ensure data freshness.
Collaborate with product and data teams to understand data requirements.

Required Skills

Strong proficiency in
Python
.
Experience with
web scraping tools/libraries
(Requests, BeautifulSoup, Selenium, Scrapy).
Understanding of
HTML, DOM structure, XPaths, CSS selectors
.
Experience with
REST API development
(FastAPI / Flask / Django).
Solid knowledge of
SQL
and relational databases (MySQL/Postgres).
Familiarity with handling proxies, headers, cookies, rate limits, etc.
Experience with Git and basic CI/CD workflows is a plus.

Good to Have

Understanding of ETL concepts or data engineering workflows.
Exposure to Airflow or other orchestrators.
Basic understanding of data pipelines or ML pipelines.

More Jobs at LevelShift

Data Scientist

chennai, tamil nadu

5.0 - 5.0 yrs

Salary: Not disclosed

Data Scientist

chennai

5.0 - 5.0 yrs

INR 2 - 7 Lacs

Technical Project Manager - .Net

chennai

10.0 - 17.0 yrs

INR 15 - 30 Lacs

Data Engineer-Microsoft Fabric

chennai

3.0 - 8.0 yrs

INR 8 - 15 Lacs

Data Scientist

chennai

5.0 - 8.0 yrs

INR 16 - 27 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.