AWS Data Engineer

SWITS DIGITAL Private Limited

9 years

0 Lacs

chennai tamil nadu india

Posted:1 day ago| Platform:

Apply

Skills Required

aws data design etl redshift analytics reporting sqs postgresql orchestration airflow processing latency integration security integrity development spark kafka programming python sql scala java relational mysql nosql dynamodb mongodb optimization query tuning strategies devops terraform compliance encryption iam collaboration

Work Mode

On-site

Job Type

Contractual

Job Description

Job Title

: AWS Data Engineer

Experience

: 9+ years total, 7+ years relevantLocation : Chennai

Design, develop, and optimize data pipelines & ETL processes using AWS Glue and EMR.
Build and manage data lakes (S3) and data warehouses (Redshift) for analytics/reporting.
Work with AWS services: Lambda, SNS, SQS, Glue Crawlers, Glue Catalog, Athena, RDS (PostgreSQL).
Integrate diverse data sources into S3 with efficient ingestion and transformation.
Implement and manage orchestration tools (e.g., AWS Airflow).
Ensure smooth batch and real-time processing.
Implement real-time streaming with Amazon Kinesis Data Firehose for low-latency delivery.
Design and maintain APIs for integration with third-party/internal systems.
Collaborate with analysts and business stakeholders to deliver high-quality datasets.
Ensure data quality, security, and integrity across all systems.
Monitor and troubleshoot data workflows & performance issues.

Mandatory Skills

Data Platforms & Tools: AWS (S3, Glue, Redshift, EMR, Kinesis)
ETL/ELT Development: Scalable pipelines using Spark, AWS Glue, Airflow, Kafka
Programming: Python, SQL (advanced), Scala/Java for big data processing
Databases: Relational (PostgreSQL, MySQL), NoSQL (DynamoDB, MongoDB)
Performance Optimization: Query tuning, partitioning, caching strategies

Good To Have

Cloud & DevOps: IaC (Terraform/CloudFormation), CI/CD for pipelines
Security & Compliance: Encryption, IAM, GDPR/HIPAA knowledge
Soft Skills: Problem-solving, collaboration, stakeholder communication

More Jobs at SWITS DIGITAL Private Limited

SQL Developer

Chennai, Tamil Nadu, India

Experience: Not specified

Salary: Not disclosed

Java React Developer

Chennai, Tamil Nadu, India

3 - 10 yrs

Salary: Not disclosed

Databricks Developer ( Pharma Domain )

Ahmedabad, Gujarat, India

5 - 10 yrs

Salary: Not disclosed

Database Administrator

Hyderabad, Telangana, India

5 - 8 yrs

Salary: Not disclosed

Pega Developer

Chennai, Tamil Nadu, India

3 - 5 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.