Data Engineer with AWS

3 - 7 years

10 - 15 Lacs

Posted:19 hours ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

  • Project description We are looking for a skilled Data Engineer with strong experience in AWS and Apache Airflow to join a dynamic data team. You will be responsible for building and maintaining scalable data pipelines, orchestrating workflows, and ensuring data quality and availability across platforms.
  • Responsibilities
  • ?Data Pipeline DevelopmentDesign, build, and maintain robust, scalable, and efficient ETL/ELT pipelines for ingesting, transforming, and loading data from various sources into our data lake and data warehouse.
  • ?AWS ExpertiseDevelop and manage data solutions using a wide range of AWS services, including but not limited to
  • ?StorageS3 (for data lakes), RDS (PostgreSQL, MySQL), Redshift (data warehousing), DynamoDB.
  • ?Compute/ProcessingGlue, EMR (Spark), Lambda, Athena.
  • ?Orchestration/WorkflowAWS Step Functions, AWS Data Pipeline.
  • ?Networking & SecurityVPC, IAM, Security Groups.
  • ?Apache Airflow OrchestrationDevelop, deploy, and manage complex Directed Acyclic Graphs (DAGs) in Apache Airflow to schedule, monitor, and automate data workflows. Implement best practices for Airflow DAG design, error handling, logging, and monitoring. Optimize Airflow performance and manage Airflow environments (e.g., using Amazon MWAA or self-hosted).
  • Skills Must have
  • Overall, 8+ years of experience as a Data Engineer and over 5 years of relevant experience in AWS.
  • ?ProgrammingStrong proficiency in Python for data manipulation, scripting, and automation.
  • ?SQLExpert-level SQL skills for querying, manipulating, and optimizing data in relational and analytical databases.
  • ?AWS ServicesProven hands-on experience designing, building, and operating data solutions on AWS (S3, Glue, Redshift, EMR, Lambda, RDS, Step Functions, etc.).
  • ?Apache AirflowIn-depth experience with Apache Airflow for data pipeline orchestration, including DAG development, custom operators, sensors, and managing Airflow environments.
  • ?ETL/ELTSolid understanding and practical experience with ETL/ELT methodologies and tools. Nice to have
  • N/A
  • Mock Interview

    Practice Video Interview with JobPe AI

    Start Data Engineer Interview
    cta

    Start Your Job Search Today

    Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

    Job Application AI Bot

    Job Application AI Bot

    Apply to 20+ Portals in one click

    Download Now

    Download the Mobile App

    Instantly access job listings, apply easily, and track applications.

    coding practice

    Enhance Your Python Skills

    Practice Python coding challenges to boost your skills

    Start Practicing Python Now
    Luxoft logo
    Luxoft

    IT Services and IT Consulting

    Zug New York

    RecommendedJobs for You