Data Engineer

Taskus

5 - 10 years

4 - 8 Lacs

chennai

Posted:2 hours ago| Platform:

Apply

Skills Required

python pyspark power bi sql tableau azure databricks hive microsoft office applications project management sharepoint impala data architecture data engineering dashboards javascript data bricks powerapps spark pycharm html graph api big data

Work Mode

Work from Office

Job Type

Full Time

Job Description

What you'll do

Develop, maintain, and enhance new data sources and tables, contributing to data engineering efforts to ensure comprehensive and efficient data architecture.
Serves as the liaison between Data Engineer team and the Airport operation teams, developing new data sources and overseeing enhancements to existing database; being one of the main contact points for data requests, metadata, and statistical analysis
Migrates all existing Hive Metastore tables to Unity Catalog, addressing access issues and ensuring smooth transition of jobs and tables.
Collaborate with IT teams to validate package (gold level data) table outputs during the production deployment of developed notebooks
Develop and implement data quality alerting systems and Tableau alerting mechanisms for dashboards, setting up notifications for various thresholds.
Create and maintain standard reports and dashboards to provide insights into airport performance, helping guide stations to optimize operations and improve performance.

All you'll need for success

Preferred Qualifications- Education & Prior Job Experience
- Master's degree UG
- Min 5 -10 years of experience
- Databricks (Azur op)
- Good Communication
- Experience developing solutions on a Big Data platform utilizing tools such as Impala and Spark
- Advanced knowledge/experience with Azure Databricks, PySpark, (Teradata)/Databricks SQL
- Advanced knowledge/experience in Python along with associated development environments (e.g. JupyterHub, PyCharm, etc.)
- Advanced knowledge/experience in building Tableau Dashboard Clikview PowerBi
- Basic idea on HTML and JavaScript
- Immediate Joiner

Skills, Licenses & Certifications
- Strong project management skills
- Proficient with MicrosoftOffice applications (MS Excel, Access and PowerPoint); advanced knowledge of Microsoft Excel
- Advanced aptitude in problem-solving, including the ability to logically structure an appropriate analytical framework
- Proficient in SharePoint, PowerApp and ability to use Graph API

More Jobs at Taskus

Senior Compensation Analyst

Gurugram

5 - 10 yrs

INR 7 - 12 Lacs

IT Support Specialist

Mumbai, Navi Mumbai

1 - 6 yrs

INR 3 - 8 Lacs

WFM Real-Time Analyst

Mohali, Indore

1 - 3 yrs

INR 3 - 5 Lacs

WFM Scheduler

Mohali, Indore

1 - 4 yrs

INR 3 - 7 Lacs

WFM Scheduler

Navi Mumbai, Gurugram

1 - 4 yrs

INR 3 - 7 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.