Senior Data Engineer

Key Responsibilities

• Design and implement data pipelines using AWS services such as Glue, EMR Serverless, and Athena.

• Develop and optimize ETL workflows leveraging PySpark for large-scale data processing.

• Ensure data security and compliance through proper IAM roles, policies, and encryption standards.

• Architect and maintain data warehouse solutions for structured and semi-structured data.

• Collaborate with data analysts and business teams to deliver reliable datasets for reporting and analytics.

• Implement best practices for data quality, governance, and performance tuning.

• Explore and integrate latest cloud ETL technologies (e.g., AWS Glue Studio, Apache Iceberg, Delta Lake).

• Monitor and troubleshoot data workflows, ensuring high availability and scalability.

• Document technical designs, processes, and standards for data engineering solutions.

• Provide production support to the end-user and technical operations staff as required. Research system/application issues/problems within area/program(s) of responsibility and recommend innovative solutions to prevent recurrence.

Required Qualifications

• Proven experience in designing and implementing data pipelines and ETL workflows in a production environment.

• Strong hands-on expertise with AWS services such as IAM, Glue, EMR Serverless, and Athena.

• Advanced proficiency in PySpark for distributed data processing and transformation.

• Solid understanding of data warehousing concepts including data modeling (star/snowflake schema), partitioning, and indexing.

• Experience with SQL and query optimization across large datasets.

• Knowledge of modern ETL frameworks and best practices in cloud-based data engineering.

• Demonstrated ability to troubleshoot and optimize data workflows for performance and scalability.

• Effective oral and written communication skills with strong analytical and problem-solving abilities.

• Familiarity with data governance, security, and compliance in cloud environments.

Preferred Qualifications

• Experience with data lake technologies and transactional table formats such as Apache Iceberg or Delta Lake.

• Knowledge of orchestration frameworks like Apache Airflow or AWS Step Functions. Knowledge of TIDAL, Tivoli Workload Scheduler is plus.

• Familiarity with DataOps practices for CI/CD in data pipelines.

• Knowledge of Power BI or other visualization tools for reporting and analytics is plus.

• AWS certifications such as AWS Certified Data Analytics – Specialty or AWS Solutions Architect.

• Strong attention to detail, ability to work independently, and comfort in a fast-paced, multi-vendor environment.

About Our Company
Ameriprise India LLP has been providing client based financial solutions to help clients plan and achieve their financial objectives for 125 years. We are a U.S. based financial planning company headquartered in Minneapolis with a global presence. The firm’s focus areas include Asset Management and Advice, Retirement Planning and Insurance Protection. Be part of an inclusive, collaborative culture that rewards you for your contributions and work with other talented individuals who share your passion for doing great work. You’ll also have plenty of opportunities to make your mark at the office and a difference in your community. So if you're talented, driven and want to work for a strong ethical company that cares, take the next step and create a career at Ameriprise India LLP.

Ameriprise India LLP is an equal opportunity employer. We consider all qualified applicants without regard to race, color, religion, sex, genetic information, age, sexual orientation, gender identity, disability, veteran status, marital status, family status or any other basis prohibited by law.