Openings GCP Data Engineer Tech Mahindra

5.0 - 8.0 years

7 - 17 Lacs

noida, hyderabad, bengaluru

Work from Office

5 to 7 years of good hands on exposure in : - Develop and maintain data ingestion pipelines for various data sources, including transactional databases, streaming big data, and batch data, utilizing tools such as GCP, GitHub, Terraform , and PySpark, Kafka, ECS. - Set up and manage batch orchestration jobs using Apache Airflow, ensuring timely execution and reliability. - Monitor data pipelines continuously to ensure operational efficiency and address any anomalies or incidents that may arise in a timely manner. - Collaborate with the data governance team to ensure compliance with data governance guidelines, including data classification and quality, using monitoring tools like Grafana and m...

Posted 1 month ago

AI Match Score

Apply

Sr. Test Automation Engineer Amgen Inc

6.0 - 9.0 years

5 - 8 Lacs

hyderabad, telangana, india

On-site

Roles & Responsibilities: Collaborate with the QA Manager to design and implement end-to-end test strategies for data validation, semantic layer testing, and GraphQL API validation. Perform manual validation of data pipelines, including source-to-target data mapping, transformation logic, and business rule verification. Develop and maintain automated data validation scripts using Python and PySpark for both real-time and batch pipelines. Contribute to the design and enhancement of reusable automation frameworks, with components for schema validation, data reconciliation, and anomaly detection. Validate semantic layers (e.g., Looker, dbt models) and GraphQL APIs, ensuring data consistency, co...

Posted 2 months ago

AI Match Score

Apply

Data Engineer Talent Aspire

2.0 - 7.0 years

40 - 45 Lacs

Chandigarh, Bengaluru, Remote

Work from Office

As the Data Engineer, you will play a pivotal role in shaping our data infrastructure and executing against our strategy. You will ideate alongside engineering, data and our clients to deploy data products with an innovative and meaningful impact to clients. You will design, build, and maintain scalable data pipelines and workflows on AWS. Additionally, your expertise in AI and machine learning will enhance our ability to deliver smarter, more predictive solutions. Key Responsibilities Collaborate with other engineers, customers to brainstorm and develop impactful data products tailored to our clients. Leverage AI and machine learning techniques to integrate intelligent features into our off...

Posted 4 months ago

AI Match Score

Apply

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.