Senior Data Engineer

As a Big Data Engineer at the company, you will be responsible for implementing Big Data solutions in Cloud environments. Your technical skill set should include: - 3-5 years of experience in implementing Big Data solutions in Cloud environments - Hands-on experience with Airflow DAG, Spark, Python, Hive, Trino, S3 Bucket, etc - Experience with Cloud Data platforms like SnowFlake and Databricks is a plus - Knowledge of the Financial domain, especially the Credit Card industry, is beneficial Your responsibilities will include: - Creating ELT Data pipelines using Python scripts and Airflow DAG - Optimizing Data pipelines by configuring Spark system resources - Debugging existing Microsoft BI ETLs, understanding business logic, and converting them into Big Data pipelines using Airflow DAG - Interacting with business partners to understand requirements and provide technical solutions - Proficiency with Agile Methodology and active team participation - Overlapping with the Onsite team till 10-11 am Pacific time for attending scrum ceremonies or onsite interactions You will be working offshore and should be prepared for active participation in the Agile Methodology and collaboration with the global team.,