Python Web Crawling || 5 days Working || Gurgaon

Designation-

Experience-

Location-

ABOUT US:

Founded in 1998, BYLD is the largest group in the South Asian region, offering technology-enabled HR and business productivity solutions. We have served 5,00,000+ individuals, worked with more than 50% of the Fortune 500 and over 60% of the Business World top 1000 companies.

Please read about us

Role & Responsibilities:

• Collaborate with cross-functional teams to define, design, and implement new features.
• Ensure the performance, quality, and responsiveness of web crawling systems.
• Identify and correct bottlenecks and fix bugs in web crawling processes.
• Help maintain code quality, organization, and automation.
• Stay up-to-date with the latest industry trends and technologies.

Skills:

• 3+ years of experience in Web Scraping or Crawling through Scrapy, Selenium or other frameworks and related libraries (like BeautifulSoup, puppeteer).
• Should be an expert on the latest version of Python.
•  Should have very good experience on fetching data from multiple online sources, cleanse it and build APIs on top of it.
• Good understanding of data structure and algorithms, as well as how they affect system performance in real world applications
• Sound knowledge in bypassing Bot Detection techniques.
• Web RestFul APIs / Microservices Development Experience.
• Think deeply about developing large scale scraping tools including data integrity, health and monitoring systems.
• Develop a deep understanding of our vast data sources on the web and know exactly how, when, and which data to scrape, parse and store.
• Work with SQL and NoSQL databases to store raw data.
• Develop frameworks for automating and maintaining constant flow of data from multiple sources.
• Good knowledge of distributed technologies, real-time systems of high throughput, low latency, and highly scalable systems.
• Work independently with little supervision to research and test innovative solutions.
• Should have a strong passion for coding.
• Must take quality, security and performance seriously.
• Ability to pair with other engineers and cross-team as needed.
• Excellent communication skills, including the ability to present effectively to both business and technical

talentacquisition.aad@byldgroup.com