5 - 9 years

0 - 2 Lacs

Posted:1 month ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

Role & responsibilities

• Strong hands-on experience in Python programming and PySpark • Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda) • Experience working with Apache Spark and Hadoop ecosystem. • Experience in writing and optimizing SQL for data manipulations • Good Exposure to scheduling tools. Airflow is preferable. • Must Have Data Warehouse Experience with AWS Redshift or Hive • Experience in implementing security measures for data protection. • Expertise to build/test complex data pipelines for ETL processes (batch and near real time) • Readable documentation of all the components being developed. • Knowledge of Database technologies for OLTP and OLAP workloads

Good understanding of Data warehouse and Data Lakes • Familiarize ETL tools like Netezza or Informatica. • Experience working with NoSQL databases like DynamoDB or MongoDB. • Good to have exposure to AWS services (Step Functions, Athena) • Data Modelling exposure • Familiarity with Investment Banking domain

1Create and maintain optimal data pipeline architecture for efficient and reliable data processing.

2 Assemble large, complex data sets that meet functional / non-functional business requirements.

3 Database management, ETL process, Data modelling, ensuring data quality and integrity.

4 Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

5 Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Tata Consultancy Services logo
Tata Consultancy Services

Information Technology and Consulting

Thane

RecommendedJobs for You

pune, chennai, bengaluru

hyderabad, chennai, bengaluru

hyderabad, pune, bengaluru

pune, chennai, mumbai (all areas)