Associate Data Engineering

You should have expertise in AWS services like EC2, CloudFormation, S3, IAM, SNS, SQS, EMR, Athena, Glue, lake formation, etc. Additionally, you should possess proficiency in Hadoop/EMR/DataBricks with strong debugging skills to resolve hive and spark related issues. It is essential to have a solid understanding of database concepts and experience working with relational or non-relational database types such as SQL, Key-Value, Graphs, etc. Experience in infrastructure provisioning using CloudFormation, Terraform, Ansible, etc., and proficiency in programming languages such as Python/PySpark is required. Effective written and verbal communication skills are also crucial for this role. As part of your key responsibilities, you will work closely with Data lake engineers to provide technical guidance, consultation, and resolution of their queries. You will assist in the development of simple and advanced analytics best practices, processes, technology & solution patterns, and automation. Collaborating with various stakeholders in the US team with a collaborative approach is a key aspect of this role. You will be responsible for developing data pipelines in Python/PySpark to be executed in the AWS cloud, setting up analytics infrastructure in AWS using cloud formation templates, and developing mini/micro batch, streaming ingestion patterns using Kinesis/Kafka. Additionally, you will be involved in seamlessly upgrading applications to higher versions like Spark/EMR upgrade and participating in code reviews of developed modules and applications. Furthermore, you will provide inputs for the formulation of best practices for ETL processes/jobs written in programming languages such as PySpark and BI processes. Working with column-oriented data storage formats such as Parquet, interactive query service such as Athena, and event-driven computing cloud service - Lambda is also part of the responsibilities. Performing R&D on the latest Big data technologies in the market, conducting comparative analysis, and providing recommendations based on current and future enterprise needs are vital aspects of the role. To qualify for this position, you should hold a Bachelor's or Master's degree in Computer Science or a similar field with 2-4 years of strong experience in big data development. Cloud certification (AWS, Azure, or GCP) is preferred. Join Ameriprise India LLP, a U.S.-based financial planning company with a global presence, providing client-based financial solutions for over 125 years. The company focuses on Asset Management and Advice, Retirement Planning, and Insurance Protection. If you are talented, driven, and looking to work for an ethical company that values contribution and community impact, take the next step and build a rewarding career at Ameriprise India LLP. This is a full-time position with working hours from 2:00 pm to 10:30 pm. The role falls under the Technology job family group within the AWMPO AWMP&S President's Office in the India Business Unit.,