Azure Data Engineer

Infogain

6 - 9 years

10 - 11 Lacs

bengaluru

Posted:23 hours ago| Platform:

Apply

Skills Required

computer science telecom automation analytical reconciliation healthcare data quality continuous improvement analytics monitoring

Work Mode

Work from Office

Job Type

Full Time

Job Description

1. Data Quality Development & Monitoring

Design and implement automated data quality rules and validation checks using
Databricks (Delta Lake)
and
PySpark
.
Build and operationalize data quality workflows in
Ataccama ONE / Ataccama Studio
.
Perform data profiling, anomaly detection, and reconciliation across systems and data sources.
Establish thresholds, KPIs, and alerts for data quality metrics.

2. Root Cause Analysis & Issue Management

Investigate data anomalies and quality incidents using SQL, Python, and Ataccama diagnostics.
Collaborate with data engineers and business analysts to identify and remediate root causes.
Document recurring data issues and contribute to preventive automation solutions.

3. Collaboration & Governance Support

Partner with data stewards, governance, and analytics teams to define and maintain DQ rules and SLAs.
Contribute to metadata enrichment, lineage documentation, and data catalog integration.
Support adoption of DQ frameworks and promote data reliability best practices.

4. Automation & Continuous Improvement

Integrate DQ validations into orchestration tools (Airflow, Databricks Workflows, or ADF).
Leverage
Python/Pyspark
libraries to complement existing platforms.
Propose process improvements to enhance automation, monitoring, and exception management

More Jobs at Infogain

Aws Data Engineer

Pune, Delhi NCR, Bengaluru

4 - 6 yrs

INR 13 - 23 Lacs

SAP Developer (Senior)

Bengaluru

5 - 8 yrs

INR 6 - 11 Lacs

Dot NET Fullstack (React) Developer (Senior)

Bengaluru

6 - 8 yrs

INR 13 - 15 Lacs

Application Support Engineer (Senior)

Bengaluru

6 - 8 yrs

INR 8 - 10 Lacs

Dot NET Core Developer (Senior)

Bengaluru

6 - 8 yrs

INR 13 - 15 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.