End To End Solution Architect

OverView

We are seeking a senior solution Architect to lead the design, integration, and delivery of a large-scale network traffic and data flow system. This role is accountable for ensuring architectural integrity, zero-error tolerance, and robust fallback mechanisms across the entire solution lifecycle. The architect will oversee subscriber data capture, DPI, DR generation, Kafka integration, DWH ingestion. and secure API-based retrieval, ensuring compliance and security regulations.

Roles & responsibilities

Own the end-to-end architecture spanning subscriber traffic capture, DPI, DR generation, Kafka streaming, and data lake ingestion.

Design and document system architecture, data flow diagrams, and integration blueprints across DPI and traffic classification systems, nProbe, Kafka. Spark, and Cloudera CDP

Implement fallback and error-handling mechanisms to ensure zero data loss and high availability across all layers.

Lead cross-functional collaboration with network engineers, Kafka developers. data platform teams, and security stakeholders.

Ensure data govemance, encryption, and compliance using tools like Apache Ranger, Atlas, SDX, and HashiCorp Vault.

Oversee API design and exposure for customer access, including advanced search, session correlation, and audit logging. Drive SIT/UAT planning, performance benchmarking, and production rollout readiness.

Provide technical leadership across multiple vendors and internal teams, ensuring alignment with Business requirements and regulatory standards

Preferred candidate profile

Proven experience in telecom-grade architecture involving DPI, IPFIX/NefFlow, and subscriber metadata enrichment.

Deep knowledge of Apache Kafka, Spark Structured Streaming, and Cloudera CDP (HDFS, Hive, Iceberg, Ranger).

Experience integrating QPtobe with Kafka and downstream analyfics platforms.

Strong understanding of QoE metrics, A/B party correlation, and application traffic classification.

Expertise in RESTful API design, schema management (Avro/JSON), and secure data access protocols.

Familiarity with network interfaces (Gn/Gi, Radius, DNS) and traffic filtering strategies.

Experience implementing fallback mechanisms, error queues, and disaster recovery strategies.

Excellent communication, documentation, and stakeholder management skills.

Cloudera Certified Architect / Kafka Developer / AWS or GCP Solution Architect. Security certifications (e.g., CISSP, CISM) will be advantageous