AWS Data Engineer

5 - 8 years

Bengaluru east

Posted:1 week ago

Job Description

Roles & Responsibilities Design, develop, and maintain scalable ETL/ELT pipelines on AWS. Build and optimize data ingestion, transformation, and processing frameworks. Develop data solutions using AWS Glue, EMR, Redshift, S3, Athena, and Lambda. Create and optimize PySpark/Spark jobs for large-scale data processing. Design and implement data models, data warehouses, and data lakes. Work with structured and unstructured data from multiple sources. Ensure data quality, governance, security, and compliance standards. Implement workflow orchestration using Airflow or AWS Step Functions. Monitor and troubleshoot data pipelines and performance bottlenecks. Collaborate with Data Scientists, Analysts, and Business teams to deliver data solutions. Optimize cloud infrastructure costs and improve system performance. Participate in code reviews and follow DevOps best practices. Technical Requirements Must Have: 5-8 years of Data Engineering experience. Strong AWS experience with: AWS Glue AWS EMR AWS Redshift AWS Athena AWS S3 AWS Lambda AWS IAM Strong expertise in PySpark and Apache Spark. Advanced SQL skills. Hands-on experience in ETL/ELT development. Experience with Data Warehousing and Data Modeling. Knowledge of Airflow or AWS Step Functions. Strong Python programming skills. Experience with Git and CI/CD processes.
A day in the life of an Infoscion
  • As part of the Infosys delivery team, your primary role would be to interface with the client for quality assurance, issue resolution and ensuring high customer satisfaction.
  • You will understand requirements, create and review designs, validate the architecture and ensure high levels of service offerings to clients in the technology domain.
  • You will participate in project estimation, provide inputs for solution delivery, conduct technical risk planning, perform code reviews and unit test plan reviews.
  • You will lead and guide your teams towards developing optimized high quality code deliverables, continual knowledge management and adherence to the organizational guidelines and processes.
  • You would be a key contributor to building efficient programs/ systems and if you think you fit right in to help our clients navigate their next in their digital transformation journey, this is the place for you! If you think you fit right in to help our clients navigate their next in their digital transformation journey, this is the place for you! Good to Have: Databricks Snowflake Kafka/Kinesis Terraform Docker and Kubernetes Jenkins Delta Lake

Skills Required

AWS ETL Data Ingestion AWS Glue Pyspark Spark Data Processing Data Quality Cloud Infrastructure System Performance Devops Data Engineering

Learn the skills this job asks for

See your skill gap for Data Engineer →

Free courses, interview questions and practice for each skill.

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Infosys logo
Infosys

IT Services and IT Consulting

Bangalore Karnataka

RecommendedJobs for You

Objectways logo

Bengaluru

ADP Private Limited logo

AWS Data Engineer

ADP Private Limited

Hyderabad

EXL Service logo

Bengaluru