AWS + Pyspark

Cognizant

4 years

0 Lacs

chennai tamil nadu india

Posted:1 month ago| Platform:

Apply

Skills Required

aws pyspark data design programming pipeline development processing spark sql aggregations storage management dynamodb redshift integrity support analytics reporting vpc iam optimization monitoring collaboration python etl communication

Work Mode

On-site

Job Type

Full Time

Job Description

Skills- AWS +Pyspark

Experience: 4 to 9 years

Location: AIA-Pune

As an AWS Data Engineer, you will design, build, and manage robust data pipelines on the AWS cloud platform. You will leverage your expertise in AWS data services and programming languages to ingest, process, transform, and store data efficiently, enabling data-driven insights and decision-making.

Key Responsibilities

Data Pipeline Development: Design, implement, and maintain scalable data pipelines using AWS services such as S3, Glue, Lambda, EMR, and Kinesis.
Data Processing and Transformation: Utilize PySpark, Spark, and SQL to perform complex data transformations and aggregations on large datasets within the AWS ecosystem.
Data Storage and Management: Design and implement data storage solutions using Amazon S3, RDS, DynamoDB, and Redshift, ensuring data quality, integrity, and accessibility.
Data Modeling and Warehousing: Develop and maintain data models to support analytics and reporting, leveraging Redshift as the data warehousing solution.
Infrastructure and Cloud Technologies: Provision and manage scalable data infrastructure using EC2, VPC, IAM, CloudFormation, and other relevant AWS services.
Performance Optimization and Monitoring: Continuously monitor and optimize data pipelines and systems using CloudWatch, identifying and resolving performance bottlenecks.
Collaboration and Knowledge Sharing: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and provide technical guidance.

Qualifications

Proficiency in Python, SQL, PySpark, and Spark.
Strong expertise in AWS data services (S3, Glue, Lambda, EMR, Redshift, DynamoDB, RDS).
Experience with data warehousing, ETL processes, and data modeling.
Excellent problem-solving, analytical, and communication skills.

More Jobs at Cognizant

Workday: Walk-in drive 10th May Pune with CTS(Full time)

Pune, Mumbai (All Areas)

3 - 8 yrs

INR 7 - 17 Lacs

Java Full Stack Developer

Chennai

5 - 10 yrs

INR 10 - 20 Lacs

Walkin For Freshers @hyderabad

Hyderabad

Experience: Not specified

INR 0 - 2 Lacs

React JS Developer

Hyderabad

2 - 7 yrs

INR 9 - 14 Lacs

Java Developer

Bengaluru

5 - 10 yrs

INR 15 - 30 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.