We are seeking exceptional and resourceful Data Engineers to join our product development teams. In this role, you will design and build automated web-scraping systems, data pipelines, and large-scale data extraction workflows that support business-critical insights.

Key Responsibilities

Develop and maintain web robots/spiders to extract data from various online sources (HTML, PDFs, text, Excel, etc.).
Reverse-engineer websites, analyze technologies, and create automated data extraction workflows.
Build parsing and transformation systems to convert raw data into structured formats.
Design monitoring systems to ensure data quality, availability, and integrity.
Handle changes in website structure and maintain clean, accurate data downloads.
Develop scalable, high-performing data pipelines and store extracted data in recommended databases.
Provide operational support to ensure zero data loss and high uptime.

Required Qualifications

2 - 4 years of hands-on experience in website data extraction, scraping, and automation.
Strong SQL skills with experience in relational databases and ETL operations.
Proficiency in Python for data processing.
Expertise in scraping frameworks/tools:
Requests, UrlLib2, Selenium, BeautifulSoup, Scrapy
.
Solid understanding of HTTP, HTML, CSS, XML, JSON, JavaScript.
Experience using Chrome debugging tools for reverse engineering.
Strong problem-solving, analytical, and debugging skills.
Degree in BCA/MCA/BS/MS with strong fundamentals in data structures and algorithms.

Preferred Candidates

restart their careers after a break

More Jobs at D E Shaw

Lead - Tech (Platform Engineering) - Linux

hyderabad

5.0 - 10.0 yrs

INR 8 - 10 Lacs

Engineering Manager - Windows (DESIS)

hyderabad

8.0 - 13.0 yrs

INR 5 - 7 Lacs

Principal Manager - Security

hyderabad

7.0 - 12.0 yrs

INR 8 - 9 Lacs

Software Developer - DESIM

hyderabad

2.0 - 7.0 yrs

INR 5 - 6 Lacs

Senior Member - Data Engineer

hyderabad

2.0 - 5.0 yrs

INR 5 - 7 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start JavaScript Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.