Platform Engineer

Job Description

Job Title: Platform Engineer Experience: 8 - 10 years Contract Duration: 6 months Location: Bangalore / Chennai Job Type: Contract Job Overview: We are seeking an experienced Platform Data Engineer with a strong background in Python development, workflow automation with Airflow , containerization with Docker/Kubernetes , and solid expertise in observability, CI/CD, and cloud platforms. Key Responsibilities: Python Development : Design, develop, and maintain Python-based backend applications, tools, and services. Airflow Expertise : Utilize Apache Airflow 2.7+ to orchestrate and automate workflows. Configure custom Airflow operators, sensors, and hooks. Docker & Kubernetes : Develop containerized applications using Docker and manage container orchestration using Kubernetes . Experience with Helm charts for deploying applications. Observability & Monitoring : Implement robust monitoring and logging systems using tools such as ELK Stack (Elasticsearch, Logstash, Kibana) , Prometheus , and Grafana for real-time metrics and logging. CI/CD Automation : Design and implement continuous integration/continuous deployment (CI/CD) pipelines using Azure DevOps or other similar platforms. Ensure smooth deployment, integration, and delivery of software. Platform Infrastructure : Collaborate with cross-functional teams to design and implement scalable, secure, and highly available data infrastructure. Technical Skills & Experience: Python : Expertise in Python development, including writing efficient, modular, and scalable code. Airflow 2.7+ : In-depth experience using Apache Airflow for orchestrating data workflows, including knowledge of Airflow internals and the ability to create custom components. Docker & Kubernetes : Strong knowledge of Docker for containerization, and experience with Kubernetes for orchestration and scaling. Familiarity with Helm for deploying applications. Observability Tools : Expertise in monitoring, logging, and alerting with tools like ELK Stack (Elasticsearch, Logstash, Kibana) , Prometheus , and Grafana . CI/CD (Azure DevOps Preferred) : Proven experience in setting up and maintaining CI/CD pipelines using Azure DevOps or similar tools like Jenkins, GitLab CI, etc. Cloud & Infrastructure : Experience with cloud platforms like Azure , AWS , or GCP is a plus. Database Skills : Familiarity with working on SQL and NoSQL databases.