Machine Learning Engineer II (Big-Data Heavy)

Job Description

Our team is looking for a Machine Learning Engineer to join our Machine Learning Engineering team in Gurgaon. Our team works very closely with Machine Learning Scientists in a fast-paced Agile environment to create and productionize algorithms that directly impacts the traveler journey and experience. We believe in being Different. We seek new ideas, different ways of thinking, diverse backgrounds and approaches, because averages can lie and sameness is dangerous. Expedia is committed to crafting an inclusive work environment with a diverse workforce. All qualified applicants will receive consideration for employment without regard to race, religion, gender, sexual orientation, national origin, disability or age. Experience: 4+ years for Bachelors 2+ years for Masters What you'll Do: Work in a cross-functional team of Machine Learning engineers and ML Scientists to design and code large scale batch and real-time data pipelines on the AWS. Prototype creative solutions quickly by developing minimum viable products and work with seniors and peers in crafting and implementing the technical vision of the team Communicate and work effectively with geographically distributed cross functional teams Participate in code reviews to assess overall code quality and flexibility Resolve problems and roadblocks as they occur with peers and help unblock junior members of the team. Follow through on details and drive issues to closure Define, develop and maintain artifacts like technical design or partner documentation Drive for continuous improvement in software and development process within an agile development team Participate in user story creation in collaboration with the team Support and troubleshoot data and/or system issues as needed Who You Are: Degree in software engineering, computer science, informatics or a similar field. Developed software in a team environment of at least 5 engineers (agile, version control, etc). Built and maintained a software project/product in production environments in public/hybrid cloud infrastructure. Comfortable programming in Python and Scala. Hands-on experience with OOAD, design patterns, SQL and NoSQL. Knowledgeable in big data technologies, in particular Spark, Hive, Hue, Qubole and Databricks. Experience in crafting real-time streaming applications, preferably in Spark streaming, and Kafka/KStreams. Must-have experience: solid experience working on Big Data, good understanding of ML pipelines and ML lifecycle, Batch processing and Inferencing applications, PySpark, SQL Experience of using cloud services (eg AWS). Experience with workflow orchestration tools (eg Airflow). Passionate about learning, especially in the areas of micro-services, system architecture, Data Science and Machine Learning. Experience working with Agile/Scrum methodologies. Good-to-have experience: in real-time / live processing and inferencing applications