Senior Software Engineer - Data

We are seeking a talented and adaptable Senior Software Engineer to contribute to the development and enhancement of our real-time data ingestion platform. Your role will involve working at the crossroads of software engineering and data infrastructure, where you will be responsible for designing and managing scalable systems that facilitate the seamless flow of high-quality data from Kafka to Snowflake through Snowpipe Streaming. Your primary focus will be on ensuring data quality, observability, and pipeline reliability by actively participating in the creation of robust monitoring and alerting systems. You will collaborate closely with a dynamic team, engage in architectural decision-making, and play a key role in shaping the data flow within Zendesk's ecosystem. Please review the responsibilities and qualifications before applying. Kindly note that only candidates located in Karnataka or Maharashtra will be considered for this position. **Key Responsibilities:** - Design, develop, and maintain data quality systems and pipelines. - Utilize tools like Snowflake, Docker/Kubernetes, and Kafka to facilitate scalable and observable data movement. - Collaborate across functions to address skill gaps related to Data Quality and data platform tooling, including contributing to the creation of internal tools that support schema validation, data experimentation, and automated checks. - Engage cross-functionally with data producers, analytics engineers, platform teams, and business stakeholders. - Take ownership of the reliability, scalability, and performance of ingestion systems deployed on AWS. - Architect and construct core components of the real-time ingestion platform using Kafka and Snowpipe Streaming. - Promote software engineering excellence by advocating for testing, observability, CI/CD, and automation. - Lead the development of platform tools that ensure data quality, observability, and lineage through Protobuf-based schema management. - Participate in implementing best practices for ingestion and developing reusable frameworks across data and software engineering teams. **Core Skills:** - Proficient programming skills, preferably in Java. - Experience with distributed data systems such as Kafka and Snowflake. - Familiarity with Data Quality tools and concepts. - Strong knowledge of SQL, especially for diagnostics and Data Quality workflows. - Experience with containerization technologies like Docker and Kubernetes. - Proficient in debugging, observability, and ensuring pipeline reliability. **What You Bring:** - A systems mindset with a solid foundation in software engineering principles. - A passion for constructing resilient, high-throughput, real-time platforms. - Ability to influence technical direction across teams and promote alignment. - Excellent communication and mentoring capabilities. - A preference for automation, continuous improvement, and platform-oriented thinking. **Nice To Haves:** - Experience with GenAI tools or supporting ML/AI data workflows. - Familiarity with cloud-native data platforms (e.g., AWS, GCP). - Exposure to dbt or ELT frameworks. **Why Join Us ** You will collaborate with experienced engineers who value teamwork, pragmatism, and adaptability, focusing on building robust systems and fostering a positive team culture rather than just following trends. Please note that only candidates based in Karnataka or Maharashtra will be considered for this role. Flexibility to work remotely for part of the week will be provided, with a requirement to attend the local office for a portion of the week as determined by the hiring manager. Join Zendesk, the Intelligent Heart Of Customer Experience, where our software is designed to bring tranquility to the realm of customer service, powering billions of conversations with renowned brands. Zendesk is committed to providing a fulfilling and inclusive experience for our employees, offering a hybrid work model that encourages in-person collaboration and remote work flexibility. If you require a reasonable accommodation due to a disability or are a disabled veteran, please reach out to peopleandplaces@zendesk.com with your specific request.,