Senior Data Engineer

NYU Manager - Owais
UR Delivery Manager - Laxmi

Description:

The EDA team seeks a dedicated and detail-oriented Senior Developer I to join our dynamic team. The responsibility of the successful candidate will be to handle repetitive technical tasks, such as Healthy Planet MS SQL file loads into a data warehouse, monitor Airflow DAGs, manage alerts, and rerun failed processes. Additionally, the role will require the analyst to monitor various daily and weekly jobs, which may include generation of revenue cycle reports and data delivery to external vendors. The perfect candidate will have a robust experience with MS/Oracle SQL, Python, Epic Health Systems, and other relevant technologies.

• Manage and perform Healthy Planet file loads into a data warehouse.


• Monitor Airflow DAGs for successful completion, manage alerts, and rerun failed tasks as necessary.


• Monitor and oversee other daily and weekly jobs, including FGP cash reports and external reports.


• Collaborate with the data engineering team to streamline data processing workflows.


• Develop automation scripts to reduce manual intervention in repetitive tasks using SQL and Python.


• Ensure all data-related tasks are performed accurately and on time.


• Investigate and resolve data discrepancies and processing issues.


• Prepare and maintain documentation for processes and workflows.


• Conduct periodic data audits to ensure data integrity and compliance with defined standards.

Skillset Requirements:

• MS/Oracle SQL


• Python


• Data warehousing and ETL processes


• Monitoring tools such as Apache Airflow


• Data quality and integrity assurance


• Strong analytical and problem-solving abilities


• Excellent written and verbal communication

Additional Skillset

• Familiarity with monitoring and managing Apache Airflow DAGs.

Experience:

• Minimum of 5 years experience in a similar role, with a focus on data management and process automation.


• Proven track record of successfully managing complex data processes and meeting deadlines.

Education:

• Bachelors degree in Computer Science, Information Technology, Data Science, or a related field.

Certifications:

• Epic Cogito


• MS/Oracle SQL, Python, or data management are a plus.