Platform Data Engineer

As a data engineer at Infiligence, you will play a crucial role in designing, developing, and maintaining scalable data pipelines for batch and real-time data processing. You will have the opportunity to work with cutting-edge technologies on cloud platforms such as Azure or AWS to ensure efficient data flow across systems. Collaboration with cross-functional teams to translate business requirements into robust data models and solutions will be a key aspect of your role. Your responsibilities will also include implementing data quality, governance, and security standards throughout the data lifecycle. You will be expected to develop and maintain documentation, conduct code reviews, unit testing, and peer reviews to ensure code quality and compliance. Troubleshooting, monitoring, and resolving data pipeline and infrastructure issues will be essential to minimize business impact. To succeed in this role, you should have a minimum of 5-7 years of experience in data engineering, with a focus on building and managing large-scale data pipelines. Hands-on experience with Azure Data Services is preferred, but experience with AWS data services is also acceptable. Proficiency in SQL, Python, or Scala for data processing and transformation is required, along with familiarity with data warehousing and real-time databases. A strong understanding of data architecture, ingestion, curation, and consumption patterns is essential, along with knowledge of data quality management, metadata management, data lineage, and data security best practices. Excellent communication skills and the ability to work collaboratively with global teams are highly valued in this role. Preferred skills include experience with CI/CD processes, source control for data engineering workflows, data observability, self-testing pipelines, and exposure to business intelligence and reporting platforms. In return, Infiligence offers comprehensive insurance coverage, a competitive salary, opportunities for professional growth, and an inclusive and collaborative work culture. If you are interested in joining our team, please submit your updated CV and a cover letter via our job URL. Shortlisted candidates will undergo an HR, technical assessment, and interviews. For any queries regarding the position or application process, please contact our Talent team at Infiligence, US or Chennai offices through careers@infiligence.com.,