Job Overview:
We are seeking a talented and experienced Software Development Engineer (SDE) I with expertise in Python, Machine learning, and web crawling to join our dynamic engineering team. The ideal candidate will contribute to the design, development, and maintenance of our software products, demonstrating strong technical skills across both frontend and backend technologies.
Responsibilities:
Design, develop, and maintain scalable and high-performance data-crawling infrastructure.
Collaborate with product management and other cross-functional teams to understand requirements and translate them into technical solutions.
Write clean, efficient, and maintainable code adhering to best practices and coding standards.
Conduct code reviews, provide constructive feedback, and mentor junior team members to foster a culture of continuous improvement.
Perform testing, debugging, and troubleshooting of applications to ensure optimal performance and reliability.
Stay updated on emerging technologies, tools, and industry trends to suggest and implement innovative solutions.
Requirements:
Bachelors or Masters degree in Computer Science, Engineering, or a related field.
1-5 years of professional experience as a Data crawling engineer or similar role.
Proficiency in frontend technologies such as Scrapy, Selenium.
Strong backend development skills using languages like Python, Node.js, or similar, along with experience with backend frameworks (e.g., Django, Fast API).
Familiarity with breaking different web security and crawling at scale.
Experience working with databases (SQL, NoSQL) and understanding of database design principles.
Knowledge of RESTful APIs and experience in building and consuming them.
Familiarity with version control systems (e.g., Git), CI/CD pipelines, and cloud services (AWS, Azure, or GCP).
Excellent problem-solving skills and the ability to work in a collaborative team environment.