Home
Jobs

Data Quality Engineer

5 - 10 years

5 - 9 Lacs

Posted:3 days ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

Job_Description":"
JobDescription: Quality Engineer (Data)
JOBSUMMARY
We areseeking a highly skilled Quality Engineer with 5-10 years of professionalexperience to ensure the integrity, reliability, and performance of our datapipelines and AI/ML solutions within the SmartFM platform. The ideal candidatewill be responsible for defining and implementing comprehensive qualityassurance strategies for data ingestion, transformation, storage, and themachine learning models that generate insights from alarms and notificationsreceived from various building devices. This role is crucial in deliveringhigh-quality, trustworthy data and intelligent recommendations to optimizefacility operations.
ROLES ANDRESPONSIBILITIES
  • Develop and implement end-to-end quality assurance strategies and test plans for data pipelines, data transformations, and machine learning models within the SmartFM platform.
  • Design, develop, and execute test cases for data ingestion processes, ensuring data completeness, consistency, and accuracy from various sources, especially those flowing through IBM StreamSets and Kafka.
  • Perform rigorous data validation and quality checks on data stored in MongoDB, including schema validation, data integrity checks, and performance testing of data retrieval.
  • Collaborate closely with Data Engineers to ensure the robustness and scalability of data pipelines and to identify and resolve data quality issues at their source.
  • Work with Data Scientists to validate the performance, accuracy, fairness, and robustness of Machine Learning, Deep Learning, Agentic Workflows, and LLM-based models. This includes testing model predictions, evaluating metrics, and identifying potential biases.
  • Implement automated testing frameworks for data quality, pipeline validation, and model performance monitoring.
  • Monitor production data pipelines and deployed models for data drift, concept drift, and performance degradation, setting up appropriate alerts and reporting mechanisms.
  • Participate in code reviews for data engineering and data science components, ensuring adherence to quality standards and best practices.
  • Document testing procedures, test results, and data quality metrics, providing clear and actionable insights to cross-functional teams.
  • Stay updated with the latest trends and tools in data quality assurance, big data testing, and MLOps, advocating for continuous improvement in our quality processes.
    REQUIREDTECHNICAL SKILLS AND EXPERIENCE
    • 5-10 years of professional experience in Quality Assurance, with a significant focus on data quality, big data testing, or ML model testing.
    • Strong proficiency in SQL for complex data validation, querying, and analysis across large datasets.
    • Hands-on experience with data pipeline technologies like IBM StreamSets and Apache Kafka.
    • Proven experience in testing and validating data stored in MongoDB or similar NoSQL databases.
    • Proficiency in Python for scripting, test automation, and data validation.
    • Familiarity with Machine Learning and Deep Learning concepts, including model evaluation metrics, bias detection, and performance testing.
    • Understanding of Agentic Workflows and LLMs from a testing perspective, including prompt validation and output quality assessment.
    • Experience with cloud platforms (Azure, AWS, or GCP) and their data/ML services.
    • Knowledge of automated testing frameworks and tools relevant to data and ML (e.g., Pytest, Great Expectations, Deepchecks).
    • Familiarity with Node.js and React environments to understand system integration points.
      ADDITIONALQUALIFICATIONS
      • Demonstrated expertise in written and verbal communication, adept at simplifying complex technical concepts related to data quality and model performance for diverse audiences.
      • Exceptional problem-solving and analytical skills with a keen eye for detail in data.
      • Experienced in collaborating seamlessly with Data Engineers, Data Scientists, Software Engineers, and Product Managers.
      • Highly motivated to acquire new skills, explore emerging technologies in data quality and AI/ML testing, and stay updated on the latest industry best practices.
      • Domain knowledge in facility management, IoT, or building automation is a plus.
        EDUCATIONREQUIREMENTS / EXPERIENCE
        • Bachelors (BE / BTech) / Masters degree (MS/MTech) in Computer Science, Information Systems, Engineering, Statistics, or a related field.


          ","

Mock Interview

Practice Video Interview with JobPe AI

Start Machine Learning Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Algoleap Technologies
Algoleap Technologies

Information Technology

San Francisco

RecommendedJobs for You

Pune, Maharashtra, India

Chennai, Tamil Nadu, India