Data Engineer

6 - 11 years

20 - 27 Lacs

Posted:-1 days ago| Platform: Naukri logo

Apply

Work Mode

Hybrid

Job Type

Full Time

Job Description

Role & responsibilities

1. Airflow Workflow orchestration tool (DAGs = tasks + dependencies) Components: Scheduler, Executor, Workers, Webserver, Metadata DB Features: retries, alerts, integrations with cloud services 2. Python Core scripting for ETL, automation, APIs Key: loops, functions, error handling, OOP, libraries (pandas, sqlalchemy) 3. SQL Querying & transforming data Skills: joins, aggregations, window functions, subqueries, performance tuning 4. Data Warehousing Centralized storage for analytics Concepts: fact vs dimension tables, star/snowflake schema, partitioning, clustering 5. GCP Data Engineering BigQuery (analytics), GCS (storage), Dataflow (processing), Pub/Sub (streaming), Composer (Airflow) IAM & service accounts for security 6. ETL Extract (sources), Transform (clean/aggregate), Load (warehouse) Best practices: incremental loads, error handling, schema evolution, monitoring

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You

chennai, bengaluru