Staff Software Engineer - Cloud Data Pipeline

Job Description

This position is based in Bangalore, India. Calix is leading a service provider transformation to deliver a differentiated subscriber experience around the Smart Home and Business, while monetizing their network using Role based Cloud Services, Telemetry, Analytics, Automation, and the deployment of Software Driven Adaptive networks. As part of a high performing global team, the right candidate will play a significant role as Calix Cloud Data Engineer involved in architecture design, implementation, technical leadership in data ingestion, extraction, and transformation domain. Responsibilities and Duties: Technical leadership in all phases of software design and development in meeting requirements of service stability, reliability, scalability, and security. Hiring, training, provide technical direction and lead discussions and coordinate deliverables across multiple engineering teams globally. Work closely with Cloud product owners to understand, analyze product requirements, provide feedback, coordinate resources and deliver a complete solution. Drive evaluation and selection of best fit, efficient, cost-effective solution stack for the Calix Cloud data platform. Drive development of scalable data pipeline infrastructure and services for enabling operationally efficient analytics solutions for Calix Cloud suite of products. Create and extend data lake solution to enable data science workbenches and implement quality systems to ensure data quality, consistency, security, compliance, and lineage. Drive continuous optimization of the data pipelines with automation, and tools. Have a Test first mindset and use modern DevSecOps practices for Agile development. Collaborate with senior leadership to translate platform opportunities into an actionable roadmap, track progress, and deliver new platform capabilities on-time and on-budget. Triage and resolve customer escalations and technical issues. Qualifications: 12 + years of highly technical, hands-on software engineering experience with at least 7 years of Cloud based solution development 3+ experience leading and mentoring engineering team with strong technical direction and delivering high quality software on schedule, including delivery for large, cross-functional projects and working with geographically distributed teams Strong, creative problem-solving skills and ability to abstract and share details to create meaningful articulation. Passionate about delivering high quality software solutions and enabling automation in all phases. Good understanding of big data engineering challenges and proven experience with data platform engineering (batch and streaming, ingestion, storage, processing, management, governance, integration, consumption patterns) Experience in designing and performance tuning batch-based, low latency real-time streaming and event-based data solutions (Kafka, Spark, Flink or similar frameworks). Practical experience of architecting with GCP Cloud platform and services and especially the Data ecosystem: BigQuery, Datastream, DataProc, Composer etc. Deep understanding of Data Cataloging, Data Governance, Data Privacy principles and frameworks to integrate into the Data engineering flows. Advanced knowledge of Data Lake technologies, data storage formats (Parquet, ORC, Avro) and query engines and associated concepts for consumption layers. Experience implementing solutions that adhere to best practices and guidelines for different privacy and compliance practices around data (GDPR, CCPA). Hands on expert level on one or more of the following programming languages - Python, Java Organized and goal-focused, ability to deliver in a fast-paced environment. BS degree in Computer Science, Engineering, Mathematics, or relevant industry standard experience to match