Data Analyst

Role Overview: As a skilled Web Scraping Data Analyst, your primary responsibility will involve collecting, cleaning, and analyzing data from various online sources. You will leverage your expertise in Python-based scraping frameworks to design, develop, and maintain robust web scraping scripts using tools such as Python, BeautifulSoup, Scrapy, Selenium, and more. Additionally, you will be tasked with implementing IP rotation, proxy management, and anti-bot evasion techniques to ensure efficient data collection. Your role will be instrumental in constructing data pipelines that drive our analytics and business intelligence initiatives. Key Responsibilities: - Collect, clean, and analyze data from various online sources - Design, develop, and maintain web scraping scripts using Python, BeautifulSoup, Scrapy, Selenium, etc. - Implement IP rotation, proxy management, and anti-bot evasion techniques for efficient data collection - Collaborate with data analysts and data engineers to integrate web-sourced data into internal databases and reporting systems - Conduct exploratory data analysis (EDA) to derive valuable insights from the scraped data - Adhere to website scraping policies, robots.txt guidelines, and data privacy regulations to ensure compliance - Build data pipelines that support analytics and business intelligence initiatives Qualifications Required: - Proficiency in Python and experience with libraries like Requests, BeautifulSoup, Scrapy, and Pandas - Knowledge of proxy/VPN usage, IP rotation, and web traffic routing tools for effective data collection - Familiarity with cloud platforms such as AWS, Azure, or GCP, and Linux-based environments - Experience in deploying scraping scripts on edge servers or containerized environments - Understanding of HTML, CSS, JSON, and browser dev tools - Strong analytical mindset with experience in data cleansing, transformation, and visualization - Proficiency in SQL and basic data querying - Experience with headless browsers like Puppeteer or Playwright, scheduling tools like Airflow or Cron, and data analytics/reporting tools like Tableau, Power BI, or Jupyter Notebooks Additional Details: This full-time role requires an in-person work location.,