Posted:2 hours ago|
Platform:
Work from Office
Full Time
5 to 7 years of good hands on exposure in :
- Develop and maintain data ingestion pipelines for various data sources, including transactional databases, streaming big data, and batch data, utilizing tools such as GCP, GitHub, Terraform , and PySpark, Kafka, ECS.
- Set up and manage batch orchestration jobs using Apache Airflow, ensuring timely execution and reliability.
- Monitor data pipelines continuously to ensure operational efficiency and address any anomalies or incidents that may arise in a timely manner.
- Collaborate with the data governance team to ensure compliance with data governance guidelines, including data classification and quality, using monitoring tools like Grafana and metrics from Prometheus.
- Document operational procedures, incident reports, and performance metrics to support continuous improvement efforts.
Qualifications:
- bachelor in IT or information systems
- Proficient in GitHub and GitHub Actions, as well as Terraform for infrastructure management.
- Experience with AWS Glue, Python, and PySpark for data processing.
- Familiarity with monitoring and visualization tools such as Grafana and Prometheus.
- A solid understanding of object-oriented programming principles and SOLID principles is a plus.
Desired Skills:
- Strong analytical and problem-solving abilities, particularly in an operational context.
- Capable of effectively communicating technical concepts to non-technical stakeholders.
Tech Mahindra
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Instantly access job listings, apply easily, and track applications.
noida, hyderabad, bengaluru
7.5 - 17.5 Lacs P.A.
noida, hyderabad, bengaluru
7.5 - 17.5 Lacs P.A.
27.5 - 40.0 Lacs P.A.
hyderabad, pune, bengaluru
15.0 - 30.0 Lacs P.A.
hyderabad, chennai, bengaluru
0.5 - 3.0 Lacs P.A.
hyderabad, telangana, india
Salary: Not disclosed
bhubaneswar, indore, nagpur
30.0 - 37.5 Lacs P.A.
kolkata, chennai, coimbatore
30.0 - 37.5 Lacs P.A.
pune, bengaluru, mumbai (all areas)
30.0 - 37.5 Lacs P.A.
bhubaneswar, indore, nagpur
18.0 - 30.0 Lacs P.A.
