Senior Data Engineer

About Info Edge India Ltd.
Info Edge: Info Edge (India) Limited (NSE: NAUKRI) is among the leading internet companies in India. Info Edge, India’spremier online classifieds company is fundamentally in the matching business. With a network of 62 offices located in 43cities throughout India, Info Edge has 5000 plus employees engaged in innovation, product development, integration withmobile and social media, technology and technology updation, research and development, quality assurance, sales,marketing and payment collection.The umbrella brand has an online recruitment classifieds, www.naukri.com– India’s No. 1 Jobsite with over 75% trafficshare, a matrimony classifieds, www.jeevansathi.com, a real estate classifieds, www.99acres.com– India’s largest propertymarketplace and an education classifieds, www.shiksha.com. Find out more about the Company at www.infoedge.inTitle: Data EngineerDesired Experience: 1-3 yearsRequired Educational Qualification: BE/ B.TechWork Location: Info Edge India Ltd. B-8, Sector 132, Noida.Job Objective: This role is responsible for developing and maintaining data ingestion pipeline frommultiple data sources to data science central databases and data lake.This requires expertise in python, creating spark job, familiarity with creating ingestion pipelines usingtools like airflow etc., storage sytems understanding for analytic systems.Job Description: Develop high quality, secure and scalable data pipelines using spark, Scala/ python on Hadoop orobject storage. Leverage new technologies and approaches to innovate with increasingly large data sets. Drive automation and efficiency in Data ingestion, data movement and data access workflows byinnovation and collaboration. Understand, implement and enforce Software development standards and engineeringprinciples in the Big Data space. Work closely with business stakeholders and embedded engineering teams within businessteams in a collaborative manner to help them build scalable products in quick time. Contribute ideas to help ensure that required standards and processes are in place and activelylook for opportunities to enhance standards and improve process efficiency. Perform assigned tasks and production incident independently.Required Skills: Experience in building, and maintaining large-scale applications. Expertise in Python, spark, Hadoop/HDFS Experience of building data ingestion pipelines Understanding of RDBMS and NoSql databases including wide-column databases Understanding of messaging systems e.g. Kafka, Pulsar Exposure of working with Pandas, NumpyWhy Join Us:This is a unique opportunity to work on innovative and disruptive technologies that are shaping the futureof the industry. We are looking for candidates who are willing to work passionately in a fast- pacedenvironment and are ready to enhance their skills by learning something new. Being a part of the InfoEdgeteam, you will be engaged in innovations, product development, integration with mobile and social media,technology, research and development, quality assurance, sales and marketing.To learn more about Info Edge visit http://www.infoedge.in/Technology Attributes: Design & Architecture Project Management Code / Product Optimization Product Release ManagementBehavioral Competencies: Execution Excellence Communication Entrepreneurial Orientation Customer FocusLeadership Attributes: Focus on Results People Leadership Innovation and Openness to Learning