Data Analyst

Role Overview: - Your primary responsibility as a skilled Web Scraping Data Analyst will involve collecting, cleaning, and analyzing data from various online sources using Python-based scraping frameworks. - You will design, develop, and maintain robust web scraping scripts utilizing tools such as Python, BeautifulSoup, Scrapy, Selenium, and more. - Implementing IP rotation, proxy management, and anti-bot evasion techniques to ensure efficient data collection will be part of your tasks. - Collaborate with data analysts and data engineers to integrate web-sourced data into internal databases and reporting systems. - Conduct exploratory data analysis (EDA) to derive valuable insights from the scraped data while adhering to website scraping policies and data privacy regulations. Key Responsibilities: - Collect, clean, and analyze data from various online sources. - Design, develop, and maintain robust web scraping scripts using Python-based frameworks. - Implement IP rotation, proxy management, and anti-bot evasion techniques for efficient data collection. - Collaborate with data analysts and data engineers to integrate web-sourced data into internal systems. - Conduct exploratory data analysis (EDA) to derive valuable insights from the data. - Adhere to website scraping policies, robots.txt guidelines, and data privacy regulations. Qualifications Required: - Proficiency in Python and experience with libraries like Requests, BeautifulSoup, Scrapy, and Pandas. - Knowledge of proxy/VPN usage, IP rotation, and web traffic routing tools. - Familiarity with cloud platforms such as AWS, Azure, or GCP, and Linux-based environments. - Experience in deploying scraping scripts on edge servers or containerized environments. - Strong understanding of HTML, CSS, JSON, and browser dev tools. - Analytical mindset with experience in data cleansing, transformation, and visualization. - Proficiency in SQL and basic data querying. - Experience with headless browsers like Puppeteer or Playwright and scheduling tools like Airflow or Cron. - Background in data analytics or reporting using tools like Tableau, Power BI, or Jupyter Notebooks. Please note that this full-time role requires an in-person work location.,