Senior Data Engineer

Designation: Sr. Data Engineer (AS587)

Office Location: Sun Westbank

Position description: We are seeking an experienced and motivated Senior Data Engineer to join our AI & Automation team. The ideal candidate will have 5–8 years of experience in data engineering, with a proven track record of designing and implementing scalable data solutions. A strong background in database technologies, data modelling, and data pipeline orchestration is essential. Additionally, hands-on experience with generative AI technologies and their applications in data workflows will set you apart. In this role, you will lead data engineering efforts to enhance automation, drive efficiency, and deliver data driven insights across the organization.

Primary Responsibilities:

• Design, build, and maintain scalable, high-performance data pipelines and ETL/ELT processes across diverse database platforms. Architect and optimize data storage solutions to ensure reliability, security, and scalability. Leverage generative AI tools and models to enhance data engineering workflows, drive automation, and improve insight generation. Collaborate with cross-functional teams (Data Scientists, Analysts, and Engineers) to understand and deliver on data requirements. Develop and enforce data quality standards, governance policies, and monitoring systems to ensure data integrity. Create and maintain comprehensive documentation for data systems, workflows, and models. Implement data modelling best practices and optimize data retrieval processes for better performance. Stay up-to-date with emerging technologies and bring innovative solutions to the team.

Required Knowledge: • Bachelor's or Master’s degree in Computer Science, Information Technology, or a related field. • 5–8 years of experience in data engineering, designing and managing large-scale data systems. • Strong expertise in database technologies, including: o SQL Databases: PostgreSQL, MySQL, SQL Server o NoSQL Databases: MongoDB, Cassandra o Data Warehouse/ Unified Platforms: Snowflake, Redshift, BigQuery, Microsoft Fabric • Hands-on experience implementing and working with generative AI tools and models in production workflows. • Proficiency in Python and SQL, with experience in data processing frameworks (e.g., Pandas, PySpark). • Experience with ETL tools (e.g., Apache Airflow, MS Fabric, Informatica, Talend) and data pipeline orchestration platforms. • Strong understanding of data architecture, data modelling, and data governance principles. • Experience with cloud platforms (preferably Azure) and associated data services.

Required Skills: • Advanced knowledge of Database Management Systems and ETL/ELT processes. • Expertise in data modeling, data quality, and data governance. • Proficiency in Python programming, version control systems (Git), and data pipeline orchestration tools. • Familiarity with AI/ML technologies and their application in data engineering. • Strong problem-solving and analytical skills, with the ability to troubleshoot complex data issues. • Excellent communication skills, with the ability to explain technical concepts to non-technical stakeholders. • Ability to work independently, lead projects, and mentor junior team members. • Commitment to staying current with emerging technologies, trends, and best practices in the data engineering domain

Job Type: Full-time

Pay: ₹399,549.86 - ₹1,710,866.51 per year

Benefits:

• Flexible schedule
• Food provided
• Health insurance
• Internet reimbursement
• Leave encashment
• Life insurance
• Paid sick time
• Paid time off
• Provident Fund
• Work from home

Work Location: In person