Sr Data Engineer (Life and Annuity)

About Company :

Our client is a trusted global innovator of IT and business services. They help clients transform through consulting, industry solutions, business process services, digital & IT modernization and managed services. Our client enables them, as well as society, to move confidently into the digital future. We are committed to our clients’ long-term success and combine global reach with local client attention to serve them in over 50 countries around the globe.

Job Title: Sr Data Engineer (Life and Annuity)

Location: Pan India

Experience: 6+ yrs

Job Type : Contract to hire

Notice Period:- Immediate joiner

Job Duties:

• At least 6+ years of relevant experience in design, development, complete end-end design of enterprise-wide big data solution.

• Experience in designing & developing a big data solution using Spark, Scala, AWS Glue, Lambda, SNS/SQS, Cloudwatch is a must.

• Strong Application development experience in Scala/Python.

• Strong Database SQL experience, preferably Redshift.

• Experience in Snowflake is an added advantage.

• Experience with ETL/ELT process and frameworks is a must.

• Create integration and application technical design documentation.

• Conduct peer-reviews of functional design documentation.

• Complete development, configuration, test cases and unit testing

• Perform code reviews and ensure standards are applied to each solution component.

• Resolve complex defects during testing phases and identify root causes.

• Support and execute performance testing.

• Familiar with Git repo and CI/CD deployment process

• Production Support: Assist in troubleshooting production environment and tuning environments.

• Ensure best practices are followed from a technical perspective during all phases of the project.

Minimum Skills Required:

• Strong background in AWS cloud services like lambda, glue, s3, emr, sns, sqs, cloudwatch, redshift

• Expertise in SQL and experience with relational databases like Oracle, MySql, PostgreSQL

• Proficient in Python programming for data engineering tasks, automations

• Experience with shell scripting in Linux/Unix environments.

• Experience with Big Data – Hadoop, Spark

• Financial Services experience required

• Nice to have - knowledge in Machine Learning models, regression, validation