Data Acquisition Specialist

You will be responsible for developing cutting-edge solutions by designing, developing, and maintaining robust web scraping solutions to extract large datasets from various websites, supporting our data-driven initiatives. Your role will involve mastering Python programming to implement and optimize sophisticated scraping scripts and tools. You will leverage industry-leading tools such as BeautifulSoup, Scrapy, Selenium, and other scraping frameworks to efficiently collect and process data. Additionally, you will innovate with AI technologies like ChatGPT to automate and enhance data extraction processes, pushing the boundaries of what is possible. It will be crucial to optimize data management by cleaning, organizing, and storing extracted data in structured formats for seamless analysis and usage. Ensuring peak performance by optimizing scraping scripts for efficiency, scalability, and reliability will also be part of your responsibilities. You will troubleshoot data scraping issues with precision to maintain data accuracy and completeness, along with maintaining clear and comprehensive documentation of scraping processes, scripts, and tools for transparency and knowledge sharing. As a qualified candidate, you should have a minimum of 5 years of experience in web data scraping, with a strong emphasis on handling large datasets. Advanced skills in Python programming, especially in the context of web scraping, are essential for this role. You are expected to have in-depth knowledge and experience with tools such as BeautifulSoup, Scrapy, Selenium, and other relevant scraping tools. Strong expertise in data cleaning, organization, and storage, along with excellent problem-solving and analytical skills to address complex scraping challenges, will be required. Meticulous attention to detail is crucial to ensure data accuracy and completeness, and the ability to work independently, manage multiple tasks, and meet deadlines effectively is essential. Preferred skills for this role include experience with API integration for data extraction, familiarity with cloud platforms like AWS, Azure, or Google Cloud for data storage and processing, understanding of database management systems and SQL for data storage and retrieval, and proficiency in using version control systems like Git.,