Tech Lead-Data Engineering

7 years

0 Lacs

Andhra Pradesh

Posted:2 days ago| Platform:

Apply

Skills Required

data engineering design auditing research risk service development coding testing support python pyspark spark analytics aws storage scripting etl xml redshift jenkins test devops pipeline debugging api management planning collaborative

Work Mode

On-site

Job Type

Full Time

Job Description

Key Responsibilities Design and develop high-volume, data engineering solutions for mission-critical systems with quality. Making enhancements to various applications that meets business and auditing requirements. Research and evaluate alternative solutions and make recommendations on improving the product to meet business and information risk requirements. Evaluate service level issues and suggested enhancements to diagnose and address underlying system problems and inefficiencies. Participate in full development lifecycle activities for the product (coding, testing, release activities). Support Release activities on weekends as required. Support any application issues reported during weekends. Coordinating day-To-day activities for multiple projects with onshore and offshore team members. Ensuring the availability of platform in lower environments Required Qualifications 7+ years of overall IT experience, which includes hands on experience in Big Data technologies. Mandatory - Hands on experience in Python and PySpark. Build pySpark applications using Spark Dataframes in Python using Jupyter notebook and PyCharm(IDE). Worked on optimizing spark jobs that processes huge volumes of data. Hands on experience in version control tools like Git. Worked on Amazon’s Analytics services like Amazon EMR, Amazon Athena, AWS Glue. Worked on Amazon’s Compute services like Amazon Lambda, Amazon EC2 and Amazon’s Storage service like S3 and few other services like SNS. Experience/knowledge of bash/shell scripting will be a plus. Has built ETL processes to take data, copy it, structurally transform it etc. involving a wide variety of formats like CSV, TSV, XML and JSON. Experience in working with fixed width, delimited , multi record file formats etc. Good to have knowledge of datawarehousing concepts – dimensions, facts, schemas- snowflake, star etc. Have worked with columnar storage formats- Parquet,Avro,ORC etc. Well versed with compression techniques – Snappy, Gzip. Good to have knowledge of AWS databases (atleast one) Aurora, RDS, Redshift, ElastiCache, DynamoDB. Hands on experience in tools like Jenkins to build, test and deploy the applications Awareness of Devops concepts and be able to work in an automated release pipeline environment. Excellent debugging skills. Preferred Qualifications Experience working with US Clients and Business partners. Knowledge on Front end frameworks. Exposure to BFSI domain is a good to have. Hands on experience on any API Gateway and management platform. About Our Company Ameriprise India LLP has been providing client based financial solutions to help clients plan and achieve their financial objectives for 125 years. We are a U.S. based financial planning company headquartered in Minneapolis with a global presence. The firm’s focus areas include Asset Management and Advice, Retirement Planning and Insurance Protection. Be part of an inclusive, collaborative culture that rewards you for your contributions and work with other talented individuals who share your passion for doing great work. You’ll also have plenty of opportunities to make your mark at the office and a difference in your community. So if you're talented, driven and want to work for a strong ethical company that cares, take the next step and create a career at Ameriprise India LLP. Ameriprise India LLP is an equal opportunity employer. We consider all qualified applicants without regard to race, color, religion, sex, genetic information, age, sexual orientation, gender identity, disability, veteran status, marital status, family status or any other basis prohibited by law. Full-Time/Part-Time Full time Timings (2:00p-10:30p) India Business Unit AWMPO AWMP&S President's Office Job Family Group Technology

Mock Interview

Practice Video Interview with JobPe AI

Start Data Interview Now

RecommendedJobs for You