Data Engineer

Continental HR Solutions

5 years

0 Lacs

chennai tamil nadu india

Posted:8 hours ago| Platform:

Apply

Skills Required

data report engineering reporting design sql databricks airflow workflow orchestration integrity consistency pipeline extraction python scripting apache development etl communication collaboration healthcare azure

Work Mode

On-site

Job Type

Full Time

Job Description

About the Role

Pelican Report Engineering team

Key Responsibilities

Design, develop, and optimize scalable data pipelines using SQL and Python.
Leverage Databricks to process large datasets and implement data transformation logic.
Collaborate with cross-functional teams to gather requirements and deliver high-quality data solutions.
Develop and maintain Airflow DAGs for workflow orchestration (good to have).
Ensure data quality, integrity, and consistency across multiple systems.
Monitor and troubleshoot pipeline performance issues and bottlenecks.
Document technical solutions and uphold best practices in data engineering.

Required Skills & Qualifications

3–5 years of experience in Data Engineering or a similar role.
Strong proficiency in SQL for data extraction, transformation, and analysis.
Hands-on experience with Python for scripting and data manipulation.
Experience with Databricks or similar big data platforms.
Familiarity with Apache Airflow and DAG development (a plus).
Solid understanding of data warehousing and ETL/ELT processes.
Strong problem-solving abilities and attention to detail.
Excellent communication and collaboration skills.

Preferred Qualifications

Experience in the healthcare or pharmaceutical domain.
Exposure to cloud platforms such as Azure or AWS.
Knowledge of CI/CD practices in data engineering.

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.