Openings GCP Data Engineer Tech Mahindra

5.0 - 8.0 years

7 - 17 Lacs

noida, hyderabad, bengaluru

Work from Office

5 to 7 years of good hands on exposure in : - Develop and maintain data ingestion pipelines for various data sources, including transactional databases, streaming big data, and batch data, utilizing tools such as GCP, GitHub, Terraform , and PySpark, Kafka, ECS. - Set up and manage batch orchestration jobs using Apache Airflow, ensuring timely execution and reliability. - Monitor data pipelines continuously to ensure operational efficiency and address any anomalies or incidents that may arise in a timely manner. - Collaborate with the data governance team to ensure compliance with data governance guidelines, including data classification and quality, using monitoring tools like Grafana and metrics from Prometheus. - Document operational procedures, incident reports, and performance metrics to support continuous improvement efforts. Qualifications: - bachelor in IT or information systems - Proficient in GitHub and GitHub Actions, as well as Terraform for infrastructure management. - Experience with AWS Glue, Python, and PySpark for data processing. - Familiarity with monitoring and visualization tools such as Grafana and Prometheus. - A solid understanding of object-oriented programming principles and SOLID principles is a plus. Desired Skills: - Strong analytical and problem-solving abilities, particularly in an operational context. - Capable of effectively communicating technical concepts to non-technical stakeholders. - A proactive team player with a hands-on mindset, ready to tackle operational challenges Role & responsibilities Preferred candidate profile

Posted 5 hours ago

Apply

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.