Posted:1 week ago|
Platform:
Work from Office
Full Time
A data-focused mindset with a passion for building reliable, scalable, and validated data pipelines A strong understanding of both data engineering and data quality assurance practices A meticulous eye for detail and a proactive attitude toward ensuring end-to-end data integrity The ability to collaborate with diverse stakeholders across engineering, analytics, and business A commitment to delivering clean, secure, and accurate data for decision-making
Design, develop, and maintain robust ETL/ELT pipelines to process large volumes of structured and unstructured data using Azure Data Factory, PySpark, and SQL-based tools Collaborate with data architects and analysts to understand transformation requirements and implement business rules correctly Develop and execute complex SQL queries to validate, transform, and performance-tune data workflows Perform rigorous data validation including source-to-target mapping (S2T), data profiling, reconciliation, and transformation rule testing Conduct unit, integration, regression, and performance testing for data pipelines and storage layers Automate data quality checks using Python and frameworks like Great Expectations, DBT, or custom-built tools Monitor data pipeline health and implement observability through logging, alerting, and dashboards Integrate testing into CI/CD workflows using tools like Azure DevOps, Jenkins, or GitHub Actions Troubleshoot and resolve data quality issues, schema changes, and pipeline failures Ensure compliance with data privacy, security, and governance policies Maintain thorough documentation for data flows, test logic, and validation processes
Optisol Business Solutions
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Practice Python coding challenges to boost your skills
Start Practicing Python Now
5.0 - 5.0 Lacs P.A.
gurugram
7.0 - 8.0 Lacs P.A.
jaipur
3.0 - 6.0 Lacs P.A.
mumbai
4.0 - 5.0 Lacs P.A.
8.0 - 15.0 Lacs P.A.
bengaluru
2.5 - 3.5 Lacs P.A.
5.0 - 9.0 Lacs P.A.
hyderabad
13.0 - 16.0 Lacs P.A.
7.2 - 9.6 Lacs P.A.
hyderabad
2.0 - 5.0 Lacs P.A.