Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Jobs

Interviews

Home
>
Jobs in kolkata
>
InfoCepts
>
Senior Data Engineer -AWS

Senior Data Engineer -AWS

InfoCepts

5 - 9 years

15 - 17 Lacs

kolkata mumbai new delhi hyderabad pune chennai bengaluru

Posted:2 weeks ago| Platform:

Apply

Skills Required

computer science stress testing linux scheduling windows apache analytics physical design sql python

Work Mode

Work from Office

Job Type

Full Time

Job Description

Study existing technology landscape and understand current data integration framework and do impact assessment for the requirements.

Develop spark jobs using Scala for new project requirements.

Enhance existing spark jobs for any ongoing product enhancement.

Performance tuning of spark jobs, stress testing etc.

Create new data pipelines for developed/enhanced spark jobs using AWS Lambda or Apache Airflow

Responsible for database design process, logical design, physical design, star schema, snowflake schema etc.

Analyze data processing, integration, modelling and reporting requirements & Define data loading strategies considering volume, data types, frequency and analytics specifications.

Ensure optimal balance between cost and performance.

Project documentation, Adheres to Quality guidelines & Schedules.

Works hand in hand with PM for successful delivery of project and provide Estimation, scoping, scheduling assistance.

Manage build phase and quality assure code to ensure fulfilling requirements and adhering to Cloud architecture. Resolve difficult design and develop issues.

Work and Technical Experience:

Must-Have:

Overall 7-9 years of IT Exp

4+ years of AWS related project

Good to have Associate Level and Professional Level AWS Certification

In depth knowledge of following AWS Services required: S3, EC2, EMR, Severless, Athena, AWS Glue, Lambda, Step Functions

Cloud Databases (Must have) AWS Aurora, Singlestore, RedShift, Snowflake

Big Data (Must have) - Hadoop, Hive, Spark, YARN

Programming Language (Must have) Scala, Python, Shell Scripts, PySpark

Operating System (Must have) - Any flavor of Linux, Windows

Must have very strong SQL Skills

Orchestration Tools (Must have): Apache Airflow

Expertise in developing ETL workflows comprising complex transformations like SCD, deduplications, aggregations etc.

Should have thorough conceptual understanding of AWS VPC, Subnets, Security Groups, & Route Tables

Should be a quick and self-learner and be ready to adapt to new AWS Services or new Big Data Technologies as and when required

Qualifications:

Bachelor s degree in computer science, engineering, or related field (Master s degree is a plus)

Demonstrated continued learning through one or more technical certifications or related methods

At least 5+ years of IT experience; Minimum 4 years of experience on Cloud related projects

Qualities:

Hold strong technical knowledge and experience

Should have the capability to deep dive and research in various technical related fields

Self-motivated and focused on delivering outcomes for a fast growing team and firm

Able to communicate persuasively through speaking, writing, and client presentations

Able to consult, write, and present persuasively

Able to work in a self-organized and cross-functional team

Able to iterate based on new information, peer reviews, and feedback

Prior experience of working in a large media company would be added advantage

More Jobs at InfoCepts

Analytics Architect

Pune, Maharashtra

Experience: Not specified

Salary: Not disclosed

Solutions Architect

Pune, Maharashtra, India

Experience: Not specified

Salary: Not disclosed

Cloud Data Engineer (AWS-Big Data)

Pune, Maharashtra, India

7.0 - 7.0 yrs

Salary: Not disclosed

Senior Manager - Data Scientist

Pune, Maharashtra, India

12.0 - 12.0 yrs

Salary: Not disclosed

Data Architect- Snowflake & DBT

Chennai

3.0 - 5.0 yrs

INR 12 - 16 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.