AI & Data Crawling Programmer

Key Responsibilities

• Design, develop, and maintain scalable web crawlers and scraping tools.
• Collect, clean, and preprocess large datasets to support AI/ML pipelines.
• Work with data scientists and engineers to integrate crawled data into AI models.
• Research and implement techniques to improve data accuracy, efficiency, and automation.
• Monitor and troubleshoot crawling processes, ensuring robust data extraction from complex websites.
• Document processes, maintain code quality, and contribute to knowledge sharing across the team.
  

Required Skills & Qualifications

• Bachelors degree in AI, IT, Computer Science, or a related field.
• 1-2 years of professional experience in web scraping, data crawling, or related roles.
• Proficiency in Python with experience in libraries such as BeautifulSoup, Scrapy, Pandas, NumPy.
• Strong understanding of web technologies (HTML, CSS, JavaScript) and site structures.
• Hands-on experience working with RESTful APIs, JSON, and XML.
• Good problem-solving, analytical, and debugging skills.
• Strong communication skills and ability to work in a collaborative environment.
  

Preferred Qualifications

• Prior experience in website development or front-end/back-end integration.
• Exposure to AI/ML frameworks (TensorFlow, PyTorch, Scikit-learn).
• Familiarity with cloud platforms (AWS, GCP, Azure) or data storage solutions.
• Ability to optimize crawlers for scalability and performance.