Software Engineer

About the job

• Minimum of 8 years of experience in designing and developing ETL processes using Informatica PowerCenter or Informatica Intelligent Cloud Services (CDI, Data Quality, Data Profiling & Operational Insights).
• Design, develop, and implement ETL solutions using IICS - CDI to extract, transform, and load data from various sources into the data warehouse.
• Solid understanding of Informatica Cloud REST APIs.
• Strong understanding of data warehousing concepts, ETL/ELT frameworks, and best practices.
• Solid experience with SQL and database technologies such as SQL Server, Oracle, etc. (Preferably Azure Synapse) and distributed file systems: HDFS, ADLS, etc.
• Develop and maintain ETL/ELT mappings, workflows, and schedules using IICS CDI (Cloud Data Integration) & other orchestration tools.
• Ensure data quality, integrity, and consistency by performing data validation, cleansing, and enrichment activities.
• Strong knowledge of SQL and relational database concepts & Semi-structured data such as XML, JSON.
• Collaborate with stakeholders to gather requirements and design ETL processes using IICS and Databricks.
• Develop, test, and maintain ETL workflows that are efficient, scalable, and reliable.
• Perform data profiling, data mapping, and data modeling to ensure data quality and integrity.
• Troubleshoot any issues that may arise during the ETL process and provide timely resolution.
• Work with other teams to ensure that ETL processes integrate effectively with other systems and applications.
• Create and maintain technical documentation for ETL processes, including process flow diagrams, data lineage, and metadata.
• Knowledge of Databricks, Spark, and related technologies.
• Proficiency in Python/Scala to build data processing pipelines.
• Experience with version control tools such as Git and follow CICD practices.
• Experience in leading a team of developers.
• Excellent communication and interpersonal skills.
• Strong problem-solving and analytical skills.
• Ability to work in a fast-paced environment and manage multiple projects simultaneously.
• Experience in Agile software development methodology.

Preferred Certifications

• Informatica Cloud Data and Application Integration R38, Professional Certification.
• AZ-900: Microsoft Azure Fundamentals.
• DP-900: Microsoft Azure Data Fundamentals.
• DP-203: Data Engineering on Microsoft Azure.
• Databricks Certified Data Engineer Associate.