Software Engineer (Big Data)

At NetApp, we have a history of helping customers turn challenges into business opportunities. We bring new thinking to age-old problems, like how to use data most effectively in the most efficient possible way. As an Engineer with NetApp, you'll have the opportunity to work with modern cloud and container orchestration technologies in a production setting. You'll play an important role in scaling systems sustainably through automation and evolving them by pushing for changes to improve reliability and velocity. NetApp is the intelligent data infrastructure company, turning a world of disruption into opportunity for every customer. No matter the data type, workload, or environment, we help our customers identify and realize new business possibilities. And it all starts with our people. As a Software Engineer at NetApp India's R&D division, you'll be responsible for the design, development, and validation of software for Big Data Engineering across both cloud and on-premises environments. You will be part of a highly skilled technical team named NetApp Active IQ. The Active IQ DataHub platform processes over 10 trillion data points per month that feeds a multi-Petabyte DataLake. The platform is built using Kafka, a serverless platform running on Kubernetes, Spark, and various NoSQL databases. This platform enables the use of advanced AI and ML techniques to uncover opportunities to proactively protect and optimize NetApp storage, and then provides the insights and actions to make it happen. We call this actionable intelligence. Your responsibilities will include designing and building our Big Data Platform, understanding scale, performance, and fault-tolerance. You will interact with Active IQ engineering teams globally to leverage expertise and contribute to the tech community. Additionally, you will identify the right tools to deliver product features, work on technologies related to NoSQL, SQL, and in-memory databases, and conduct code reviews to ensure code quality and best practices adherence. Technical Skills: - Big Data hands-on development experience is required. - Demonstrate expertise in Data Engineering and complex data pipeline development. - Design, develop, implement, and tune distributed data processing pipelines focusing on scalability, low-latency, and fault-tolerance. - Awareness of Data Governance and experience with Python, Java, Scala, Kafka, Storm, Druid, Cassandra, or Presto is advantageous. Education: - Minimum 5 years of experience required, 5-8 years preferred. - Bachelor of Science Degree in Electrical Engineering or Computer Science, or equivalent experience required. At NetApp, we embrace a hybrid working environment designed to strengthen connection, collaboration, and culture for all employees. This means that most roles will have some level of in-office and/or in-person expectations, which will be shared during the recruitment process. NetApp offers a healthy work-life balance, comprehensive benefits, professional and personal growth opportunities, and a supportive work environment. If you are passionate about building knowledge and solving big problems, we invite you to join us in this journey.,