Posted:4 days ago|
Platform:
On-site
Full Time
About the Role: We are looking for a hands-on Data Engineer to join our team and take full ownership of scraping pipelines and data quality. You'll be working on data from 60+ websites involving PDFs, processed via OCR and stored in MySQL/PostgreSQL. You’ll build robust, self-healing pipelines and fix common data issues (missing fields, duplication, formatting errors). Responsibilities: Own and optimize Airflow scraping DAGs for 60+ sites Implement validation checks, retry logic, and error alerts Build pre-processing routines to clean OCR'd text Create data normalization and deduplication workflows Maintain data integrity across MySQL and PostgreSQL Collaborate with ML team for downstream AI use cases Requirements: 2–5 years of experience in Python-based data engineering Experience with Airflow, Pandas, OCR (Tesseract or AWS Textract) Solid SQL and schema design skills (MySQL/PostgreSQL) Familiarity with CSV processing and data pipelines Bonus: Experience with scraping using Scrapy or Selenium Location: Delhi (in-office only) Salary Range : 50-80k/Month Show more Show less
ISITCA PRIVATE LIMITED
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
My Connections ISITCA PRIVATE LIMITED
Kolkata, Mumbai, New Delhi, Hyderabad, Pune, Chennai, Bengaluru
10.0 - 11.0 Lacs P.A.
9.0 - 13.0 Lacs P.A.
0.6 - 1.75 Lacs P.A.
Hyderabad, Ahmedabad
7.0 - 9.0 Lacs P.A.
Hyderabad, Chennai, Bengaluru
7.0 - 11.0 Lacs P.A.
Chennai, Tamil Nadu, India
Salary: Not disclosed
Bengaluru
15.0 - 25.0 Lacs P.A.
4.0 - 12.0 Lacs P.A.
Hyderābād
4.375 - 9.5 Lacs P.A.
Mumbai
Experience: Not specified
3.45 - 7.0 Lacs P.A.