Data Engineer (Python)

You will be responsible for designing, developing, and maintaining web scraping scripts using Python. Your expertise will be essential in utilizing web scraping libraries like Beautiful Soup, Scrapy, Selenium, and other tools to extract data from various websites. It will be crucial to write reusable, testable, and efficient code to extract both structured and unstructured data effectively. Additionally, you will play a key role in developing and maintaining software documentation for the web scraping scripts you create. Collaboration with software developers, data scientists, and other stakeholders will be necessary to strategize, design, develop, and launch new web scraping projects. Troubleshooting, debugging, and optimizing web scraping scripts will also be part of your responsibilities. Staying informed about the latest industry trends and technologies in automated data collection and cleaning will be expected. Your involvement in maintaining code quality, organizing projects, participating in code reviews, and ensuring solutions align with standards will be crucial for success in this role. Creating automated test cases to validate the functionality and performance of the code will also be part of your duties. Integration of data storage solutions such as SQL/NoSQL databases, message brokers, and data streams for storing and analyzing scraped data will be another aspect of your work. A bachelor's degree in Computer Science, Software Engineering, or a related field from a reputable institution is required, along with a minimum of 3-4 years of deep coding experience in Python. Experience with Python development and web scraping techniques is essential for this position. Familiarity with web frameworks like Django and Flask, as well as technologies such as SQL, Git, and Linux, is also necessary. Strong analytical and problem-solving skills, along with effective communication and teamwork abilities, will be key attributes for success in this role. This position is located in Gurgaon, and the work model is Hybrid. If you possess the required skills and experience, we encourage you to apply for this job or refer someone who would be a good fit for this role. Stay updated with the latest industry trends and technologies to excel in this dynamic work environment.,