Technology Infrastructure & Data Management

As a skilled and experienced Technology Stack Administrator, your role will involve managing and optimizing the on-premises infrastructure comprising RedHat OpenShift, Apache Spark, Apache Airflow, Delta Lake, Apache Kafka, and Debezium. Your responsibilities will include: - Platform Administration: - Installing, configuring, and maintaining RedHat OpenShift clusters in an on-premises environment. - Building and orchestrating data pipelines using Apache Airflow. - Implementing and managing Delta Lake for ACID-compliant data lake architecture. - Managing Apache Spark clusters for distributed data processing. - Developing real-time data streaming and CDC solutions using Apache Kafka and Debezium. - Building and deploying containerized applications on RedHat OpenShift. - Integrating and managing Unity Catalog for centralized data governance, access control, and lineage tracking. - Integrating platform components with Nexus Repository Manager for artifact lifecycle management and CI/CD workflows. - Monitoring & Optimization: - Setting up monitoring tools and dashboards (e.g., Prometheus, Grafana, ELK). - Optimizing performance and resource utilization across platforms. - Conducting regular health checks and capacity planning. - Security & Compliance: - Implementing role-based access control (RBAC), TLS encryption, and audit logging. - Ensuring compliance with internal and external data governance policies. - Automation & CI/CD: - Developing and maintaining automation scripts using Ansible, Terraform, or similar tools. - Integrating platforms with CI/CD pipelines for seamless deployment and updates. - Maintaining version control and artifact repositories via Nexus. - Troubleshooting & Support: - Providing L2/L3 support for platform-related issues. - Collaborating with development and data engineering teams to resolve integration challenges. In terms of qualifications, you are expected to have: - 6+ years of experience in administering enterprise-grade technology stacks. - Strong expertise in OpenShift, Spark, Airflow, Kafka, and Debezium. - Experience with Linux system administration and networking fundamentals. - Familiarity with containerization (Docker) and orchestration (Kubernetes). - Proficiency in scripting languages (Bash, Python). - Understanding of data lake architectures and streaming data pipelines. Preferred qualifications include: - RedHat Certified Specialist in OpenShift Administration. - Experience with Hadoop ecosystem, Hive, or Presto is a plus. - Exposure to cloud-native tools (even if deployed on-premise). - Knowledge of DevOps practices and GitOps workflows. Soft skills required for this role encompass strong analytical and problem-solving skills, excellent communication and documentation abilities, and the ability to work independently and in cross-functional teams.,