Sr Technology Engineer (Big Data + DevOps)

As a Senior Technology Engineer specializing in Big Data and DevOps, your role involves a variety of key responsibilities: - DevOps and CI/CD: You will be responsible for designing, implementing, and managing CI/CD pipelines using tools like Jenkins and GitOps to automate and streamline the software development lifecycle. - Containerization and Orchestration: Your tasks will include deploying and managing containerized applications using Kubernetes and OpenShift to ensure high availability and scalability. - Infrastructure Management: You will develop and maintain infrastructure as code (IaC) using tools such as Terraform or Ansible. - Big Data Solutions: Architecting and implementing big data solutions utilizing technologies like Hadoop, Spark, and Kafka. - Distributed Systems: Designing and managing distributed data architectures to ensure efficient data processing and storage. - Collaboration: Working closely with development, operations, and data teams to understand requirements and deliver robust solutions. - Monitoring and Optimization: Implementing monitoring solutions and optimizing system performance, reliability, and scalability. - Security and Compliance: Ensuring that infrastructure and data solutions adhere to security best practices and regulatory requirements. Qualifications required for this role include: - Education: Bachelors or Masters degree in Computer Science, Engineering, or a related field. - Experience: Minimum of 5 years of experience in big data engineering or a related role. Technical skills desired for this position are: - Proficiency in CI/CD tools such as Jenkins and GitOps. - Strong experience with containerization and orchestration tools like Kubernetes and OpenShift. - Knowledge of big data technologies such as Hadoop, Spark, ETLs. - Proficiency in scripting languages such as Python, Bash, or Groovy. - Familiarity with infrastructure as code (IaC) tools like Terraform or Ansible. Soft skills that would be beneficial for this role include: - Excellent problem-solving and analytical skills. - Strong communication and collaboration abilities. - Ability to work in a fast-paced, dynamic environment. Preferred qualifications include certifications in DevOps, cloud platforms, or big data technologies, experience with monitoring and logging tools such as Prometheus, Grafana, or ELK Stack, knowledge of security best practices in DevOps and data engineering, and familiarity with agile methodologies and continuous integration/continuous deployment (CI/CD) practices.,