Data Quality & Automation Engineer

Job Title

Job Type:

About Us:

Our mission at micro1 is to match the most talented people in the world with their dream jobs. If you are looking to be at the forefront of AI innovation and work with some of the fastest-growing companies in Silicon Valley, we invite you to apply for a role. By joining the micro1 community, your resume will become visible to top industry leaders, unlocking access to the best career opportunities on the market.

Job Summary

We are seeking a skilled and innovative Data Quality & Automation Engineer to join our customer's dynamic team. In this role, you will leverage your expertise to ensure the quality and reliability of our data processing systems, playing a crucial role in our commitment to excellence. We are looking for a candidate who possesses a keen eye for detail and a strong ability to communicate both verbally and in writing.

Key Responsibilities

• Develop and execute automated test scripts using Python and Selenium to validate data processing systems.
• Perform rigorous data validation and ensure data integrity across various data platforms.
• Collaborate with data engineers and developers to identify and troubleshoot issues.
• Maintain and enhance existing automation frameworks and scripts.
• Utilize SQL for advanced data querying and validation tasks.
• Implement and manage workflows using Apache Airflow.
• Work with Databricks to test data pipelines and transformations.

Required Skills and Qualifications

• Proven experience in automation testing with a focus on data quality.
• Proficiency in Python programming and Selenium automation tools.
• Strong understanding of SQL for data validation and reporting.
• Experience with ALM.
• Knowledge of data warehousing and data lake architectures.
• Experience in leading and mentoring teams.
• Experience with data testing tools (dbt Test).
• Experience with Apache Airflow for workflow management.
• Familiarity with Databricks for data processing and analytics.
• Exceptional written and verbal communication skills.
• Attention to detail and a proactive approach to problem-solving.

Preferred Qualifications

• Experience with cloud platforms (AWS, Azure) and big data technologies.
• Knowledge of continuous integration and deployment processes.
• Certification in data engineering or software testing is a plus.