AI & Data Crawling Programmer

As an AI and Data Crawling Programmer with 12 years of hands-on experience in building data-driven solutions, your role will involve designing efficient crawlers, developing scalable web crawlers, and contributing to AI model development. Your practical exposure to AI/ML concepts, data crawling, and web scraping will be essential in collecting, cleaning, and preprocessing large datasets to support AI/ML pipelines. Additionally, your prior experience in website development or data integration will be advantageous in this role. Key Responsibilities: - Design, develop, and maintain scalable web crawlers and scraping tools. - Collect, clean, and preprocess large datasets to support AI/ML pipelines. - Work with data scientists and engineers to integrate crawled data into AI models. - Research and implement techniques to improve data accuracy, efficiency, and automation. - Monitor and troubleshoot crawling processes, ensuring robust data extraction from complex websites. - Document processes, maintain code quality, and contribute to knowledge sharing across the team. Required Skills & Qualifications: - Bachelor's degree in AI, IT, Computer Science, or a related field. - 1-2 years of professional experience in web scraping, data crawling, or related roles. - Proficiency in Python with experience in libraries such as BeautifulSoup, Scrapy, Pandas, NumPy. - Strong understanding of web technologies (HTML, CSS, JavaScript) and site structures. - Hands-on experience working with RESTful APIs, JSON, and XML. - Good problem-solving, analytical, and debugging skills. - Strong communication skills and ability to work in a collaborative environment. Preferred Qualifications: - Prior experience in website development or front-end/back-end integration. - Exposure to AI/ML frameworks (TensorFlow, PyTorch, Scikit-learn). - Familiarity with cloud platforms (AWS, GCP, Azure) or data storage solutions. - Ability to optimize crawlers for scalability and performance. (Note: Company details were not provided in the job description),