SENIOR, DATA ENGINEER

Demonstrates up-to-date expertise and applies this to the development, execution, and improvement of action plans by providing expert advice and guidance to others in the application of information and best practices; supporting and aligning efforts to meet customer and business needs; and building commitment for perspectives and rationales. Provides and supports the implementation of business solutions by building relationships and partnerships with key stakeholders; identifying business needs; determining and carrying out necessary processes and practices; monitoring progress and results; recognizing and capitalizing on improvement opportunities; and adapting to competing demands, organizational changes, and new responsibilities. Models compliance with company policies and procedures and supports company mission, values, and standards of ethics and integrity by incorporating these into the development and implementation of business plans; using the Open Door Policy; and demonstrating and assisting others with how to apply these in executing business processes and practices.

• Our team which is part of DSI Bangalore is responsible for creating the Customer Platform which is a one stop shop for all customer analytics for Walmart stores, a Machine Learning Platform that provides end- to-end infrastructure for Data Scientists to build ML solutions and an Enterprise Analytics group that provides analytics for HR, Global Governance and Security
• The team is responsible for time critical, business critical and highly reliable systems that influence almost every part of the Walmart business
• The team is spread over multiple locations and the Bangalore center owns critical end to end pieces, that we'design, build and support

• Design, code, test and deploy production grade data engineering solutions including pipeline development, data quality frameworks, data validation and metadata management.
• Design and develop services/backend solutions including REST web services, spring boot and Java/Python . Design and deploy solutions onto cloud ecosystems like Azure/GCP. Collaborate with product and engineering teams across multiple zones, translate business requirements and roadmap into technical solutions. Design cost wise and compute wise efficient data engineering solutions. Architect and design automation and innovation ideas/solutions at Walmart scale that can be leveraged across multiple platforms. Possess exceptional attitude and zeal to learn new skills, optimise sys Possess strong leadership skills and have the capability to mentor team technically.

• Min 7-10 years of Big data development experience using Spark, Hive, Hadoop technologies along with strong enterprise applications development background using Java and REST API.
• Demonstrates up-to-date expertise in designing Data Engineering solutions , including pipeline development, data quality frameworks, data validation and metadata management.
• Design, develop, implement and tune distributed data processing pipelines that process large volume of data; focusing on scalability, low -latency, and fault-tolerance in every system built.
• Demonstrates expertise in writing complex, optimised queries across large data sets
• Proven, working expertise with Big Data Technologies Hadoop, HDFS, Hive, Spark Scala/PySpark, and SQL
• Knowledge and experience in Kafka, Storm, Druid and Presto are added advantages.
• Hands-on experience in ReactJS is an added advantage.

Minimum Qualifications:Option 1: Bachelors degree in Computer Science and 3 years experience in software engineering or related field. Option 2: 5 years experience in software engineering or related field. Option 3: Masters degree in Computer Science and 1 years experience in software engineering or related field. 2 years experience in data engineering, database engineering, business intelligence, or business analytics.