Azure Integration Services Engineer (Senior)

Roles & Responsibilities
About the Role We are looking for an experienced Senior Data Engineer to play a key role in the migration of our legacy RDBMS platforms to PostgreSQL for a mission-critical billing and invoicing system This position requires strong hands-on skills in data migration, transformation, and validation using Apache Spark as the preferred compute engine, The Senior Engineer will work closely with the Lead Data Engineer to implement the migration strategy, ensure performance and accuracy, and deliver a seamless transition while safeguarding customer billing continuity, Key Responsibilities Data Migration Execution Build and optimize ETL/ELT pipelines for bulk data loads, transformations, and Change Data Capture (CDC), Assist in schema conversion, SQL optimization, and data validation processes, Implement Spark-based jobs for high-volume and high-performance migration workloads, Collaboration & Support Work under the guidance of the Lead Data Engineer to deliver migration components, Partner with cross-functional teams (application engineers, DBAs, QA) to ensure smooth integration with PostgreSQL, Provide inputs on tool selection, migration best practices, and automation opportunities, Data Quality & Reliability Develop data validation and reconciliation frameworks to ensure 100% accuracy, Monitor pipeline performance and troubleshoot issues proactively, Maintain high availability, compliance, and security of sensitive customer and financial data, Required Qualifications 5+ years of experience in Data Engineering, with proven work in database migrations, Strong experience in RDBMS to PostgreSQL data migration and SQL performance tuning, Hands-on expertise in Apache Spark (PySpark/Scala) for ETL/ELT workloads, Familiarity with AWS data services (Glue, EMR, RDS, S3, IAM) or similar cloud platforms, Knowledge of data validation frameworks and best practices for reconciliation, Solid programming skills in Python, Preferred Skills Background in financial/billing systems with mission-critical data flows, Exposure to Terraform or Infrastructure-as-Code (IaC), Familiarity with DevOps/DataOps practices (CI/CD for data pipelines, monitoring, observability), Strong problem-solving, debugging, and optimization skills, Experience 6-8 Years Skills Primary Skill: Data Engineering Sub Skill(s): Data Engineering Additional Skill(s): ETL, Microsoft SSIS, SQL, Workflows About The Company Infogain is a human-centered digital platform and software engineering company based out of Silicon Valley We engineer business outcomes for Fortune 500 companies and digital natives in the technology, healthcare, insurance, travel, telecom, and retail & CPG industries using technologies such as cloud, microservices, automation, IoT, and artificial intelligence We accelerate experience-led transformation in the delivery of digital platforms Infogain is also a Microsoft (NASDAQ: MSFT) Gold Partner and Azure Expert Managed Services Provider (MSP), Infogain, an Apax Funds portfolio company, has offices in California, Washington, Texas, the UK, the UAE, and Singapore, with delivery centers in Seattle, Houston, Austin, Krak?w, Noida, Gurgaon, Mumbai, Pune, and Bengaluru,