Data Acquisition Specialist - Web Scraping

You will be responsible for developing cutting-edge solutions by designing, developing, and maintaining robust web scraping solutions to extract large datasets from various websites, supporting our data-driven initiatives. Your role involves mastering Python programming to implement and optimize sophisticated scraping scripts and tools. You will be leveraging industry-leading tools such as BeautifulSoup, Scrapy, Selenium, and other scraping frameworks to efficiently collect and process data. Additionally, you will innovate with AI technologies like ChatGPT prompt skills to automate and enhance data extraction processes, pushing the boundaries of what is possible. Your duties will also include optimizing data management by cleaning, organizing, and storing extracted data in structured formats for seamless analysis and usage. Ensuring peak performance of scraping scripts for efficiency, scalability, and reliability will be crucial. You will troubleshoot data scraping issues with precision, guaranteeing data accuracy and completeness. It is essential to maintain clear and comprehensive documentation of scraping processes, scripts, and tools for transparency and knowledge sharing purposes. To qualify for this position, you must have a minimum of 5 years of experience in web data scraping, with a strong emphasis on handling large datasets. Advanced skills in Python programming, particularly in the context of web scraping, are required. Proficiency in tools such as BeautifulSoup, Scrapy, Selenium, and other relevant scraping tools is necessary. Strong skills in data cleaning, organization, and storage, along with excellent problem-solving and analytical skills to tackle complex scraping challenges, are essential. Meticulous attention to detail is crucial for ensuring data accuracy and completeness. The ability to work independently, manage multiple tasks, and meet deadlines effectively is also a key requirement. Preferred skills for this role include experience with API integration for data extraction, familiarity with cloud platforms like AWS, Azure, or Google Cloud for data storage and processing, understanding of database management systems and SQL for data storage and retrieval, and proficiency in using version control systems like Git.,