Aws Data Engineer-Gurugram

Job Title: AWS Data Engineer

Location: Gurugram, India

No of openings:

Experience Required:

Company: PwC India

PwC

Key Responsibilities:

1. AWS Service Implementation:

• Design, develop, and maintain data solutions using AWS services, with a particular focus on S3, Athena, Glue, EMR, and Redshift.
• Implement and optimize data lakes and data warehouses on AWS platforms.

2. Data Pipeline Development:

• Create and maintain efficient ETL processes using PySpark and other relevant tools.
• Develop scalable and performant data pipelines to process large volumes of data.
• Implement data quality checks and monitoring systems to ensure data integrity.

3. Database Management:

• Proficient with SQL and NoSQL databases, optimizing queries and database structures for performance.
• Design and implement database schemas that align with business requirements and data models.

4. Performance Optimization:

• Continuously monitor and optimize the performance of data processing jobs and queries.
• Implement best practices for cost optimization in AWS environments.
• Troubleshoot and resolve performance bottlenecks in data pipelines and analytics processes.

5. Collaboration and Documentation:

• Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
• Develop and maintain comprehensive documentation for data architectures, processes, and best practices.
• Participate in code reviews and contribute to the team's knowledge base.

Required Qualifications:

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• 2-7 years of experience in data engineering, with a focus on AWS technologies.
• Strong hands-on experience with AWS services, particularly S3, Athena, Glue, EMR, and Redshift.
• Proficiency in Python and PySpark for data processing and analysis.
• Extremely good with SQL/PL SQL
• Demonstrated ability to optimize data pipelines and queries for performance.
• Strong problem-solving skills and attention to detail.

Preferred Skills:

• AWS certifications (e.g., AWS Certified Data Analytics - Specialty, AWS Certified Solutions Architect).
• Familiarity with data visualization tools (e.g., Tableau, Power BI).
• Experience with data modeling and data warehouse concepts.
• Innovation thinking and creativity in solution delivery