Senior Member, Data Engineering – Front Office Tech

What You Will Do Day-to-day

As a member of the Data Engineering team, you will be responsible forvarious aspects of data extraction, such as understanding the datarequirements of the business group, reverse-engineering the website,its technology, and the data retrieval process, re-engineering bydeveloping web robots to automate the extraction of the data, andbuilding monitoring systems to ensure the integrity and quality of theextracted data. You will also be responsible for managing the changesto the website's dynamics and layout to ensure clean downloads,building scraping and parsing systems to transform raw data into astructured form, and offering operations support to ensure highavailability and zero data losses. Additionally, you will be involved inother tasks such as storing the extracted data in the recommendeddatabases, building high-performing, scalable data extraction systems,and automating data pipelines.

Who We Are Looking For

The ideal candidate should hold-

Basic Qualifications

─ 2-4 years of experience in website data extraction and scraping─ Good knowledge of relational databases, writing complex queries inSQL, and dealing with ETL operations on databases─ Proficiency in Python for performing operations on data─ Expertise in Python frameworks like Requests, UrlLib2, Selenium,Beautiful Soup, and Scrapy─ A good understanding of HTTP requests and responses, HTML, CSS,XML, JSON, and JavaScript─ Expertise with debugging tools in Chrome to reverse engineerwebsite dynamics─ A good academic background and accomplishments─ A BCA/MCA/BS/MS degree with a good foundation and practicalapplication of knowledge in data structures and algorithms─ Problem-solving and analytical skills─ Good debugging skills