Data Engineer Sr. Analyst

Location:Kochi, Coimbatore, Trivandrum

Must have skills:Python/Scala, Pyspark/Pytorch

Good to have skills:Redshift

Job
Summary

Youll capture user requirements and translate them into business and digitally enabled solutions across a range of industries. Your responsibilities will include:

Roles and Responsibilities

• Designing, developing, optimizing, and maintaining data pipelines that adhere to ETL principles and business goals
• Solving complex data problems to deliver insights that helps our business to achieve their goals.
• Source data (structured unstructured) from various touchpoints, format and organize them into an analyzable format.
• Creating data products for analytics team members to improve productivity
• Calling of AI services like vision, translation etc. to generate an outcome that can be used in further steps along the pipeline.
• Fostering a culture of sharing, re-use, design and operational efficiency of data and analytical solutions
• Preparing data to create a unified database and build tracking solutions ensuring data quality
• Create Production grade analytical assets deployed using the guiding principles of CI/CD.

Professional and Technical Skills

• Expert in Python, Scala, Pyspark, Pytorch, Javascript (any 2 at least)
• Extensive experience in data analysis (Big data- Apache Spark environments), data libraries (e.g. Pandas, SciPy, Tensorflow, Keras etc.), and SQL. 2-3 years of hands-on experience working on these technologies.
• Experience in one of the many BI tools such as Tableau, Power BI, Looker.
• Good working knowledge of key concepts in data analytics, such as dimensional modeling, ETL, reporting/dashboarding, data governance, dealing with structured and unstructured data, and corresponding infrastructure needs.
• Worked extensively in Microsoft Azure (ADF, Function Apps, ADLS, Azure SQL), AWS (Lambda,Glue,S3), Databricks analytical platforms/tools, Snowflake Cloud Datawarehouse.

Additional Information

• Experience working in cloud Data warehouses like Redshift or Synapse
• Certification in any one of the following or equivalent
  • AWS- AWS certified data Analytics- Speciality
  • Azure- Microsoft certified Azure Data Scientist Associate
  • Snowflake- Snowpro core- Data Engineer
  • Databricks Data Engineering

Experience:3.5 -5 years of experience is required

Educational Qualification:Graduation (Accurate educational details should capture)