Database Executive – Web Scraping & Data Management

Job Type: Full-Time

Experience Level: 1–3 years preferred (open to strong freshers with demonstrable skills)

About the Role:

We are seeking a Database Executive with strong skills in web scraping, data extraction, and data organization to support our data acquisition efforts. This role involves identifying data sources, automating data collection, and organizing data into structured formats that support business insights, lead generation, or content operations.

You will work closely with internal teams (marketing, sales, analytics, etc.) to build robust datasets from public and semi-structured online sources, ensuring accuracy, relevance, and compliance with data practices.

Key Responsibilities:

Data Acquisition & Scraping:

• Identify relevant websites, directories, and platforms to scrape or extract data from.

• Develop web scraping scripts using tools such as Python (BeautifulSoup, Scrapy, Selenium) or other automated extraction tools.

• Monitor websites for structural changes or anti-scraping measures and adapt scripts accordingly.

• Work with APIs when available to pull data more efficiently and reliably.

Data Cleaning & Structuring:

• Clean and normalize raw data to ensure it is free from duplicates, errors, and inconsistencies.

• Convert scraped data into structured formats (CSV, Excel, JSON, SQL) for easy integration into databases or CRM systems.

• Tag, categorize, and format data to align with internal taxonomy or business use cases.

Database Management:

• Create and manage databases using platforms like MySQL, PostgreSQL, MongoDB, or Google Sheets/Excel for lighter use cases.

• Ensure data is stored in a secure, scalable, and searchable format.

• Regularly update and maintain datasets to reflect new additions, changes, or deletions.

Collaboration & Reporting:

• Work with the sales, marketing, or analytics teams to understand data requirements and deliver relevant datasets.

• Document scraping logic, data sources, and scripts for reusability and transparency.

• Provide timely reports on data coverage, quality, and update frequency.

Required Skills & Qualifications:

• Proficiency in Python for scripting and automation (Beautiful Soup, Scrapy, Requests, Selenium, Pandas, etc.)

• Solid understanding of HTML, CSS, XPath, JSON, and Regex for data parsing.

• Experience with SQL and managing relational databases.

• Familiarity with tools like Excel, Google Sheets, and data handling libraries.

• Understanding ethical web scraping practices, bot detection, CAPTCHA, and rate-limiting.

• Ability to work independently, manage deadlines, and prioritize tasks across multiple projects.

• Attention to detail in maintaining clean, accurate, and well-structured datasets.

Preferred Qualifications:

• Experience using APIs (REST, GraphQL) for data extraction.

• Knowledge of cloud databases or data warehouses (e.g., AWS RDS, Google Big Query).

• Exposure to CRM platforms (e.g., HubSpot, Salesforce) for lead or contact data syncing.

• Ability to visualize data using BI tools (Tableau, Google Data Studio, etc.) is a plus.

• Prior experience in domains like real estate, e-commerce, market research, or lead generation.

Tools You Might Use:

• Python: Beautiful Soup, Scrapy, Selenium

• SQL: MySQL, PostgreSQL

• Data Tools: Excel, Google Sheets, Pandas

• APIs: REST, GraphQL

• Others: Postman, Zapier, Airflow (for automation)