IDQ Developer

Job Description

IDQ Developer A data product comprises of team members with various skills, competencies, domain understandings, and process knowledge to build and support end to end life cycle of any Data Product This require technical competencies or process skills that are specific to technology and domain being used, and some of these skills are core and will be applicable and relevant irrespective of the tool or application being used. E.g. Data Quality(DQ). A developer within data product would understand the concept of Data quality and would be able to identify DQ issues and suggests a mechanism to measure and resolve those. Similarly, if you consider Match process, modeling, etc. a very common functionality, a developer in data product team should be well versed in process. Applications: Informatica Product Suites: Informatica Data Quality (Cloud and On-Prem) used for building data quality mappings/routines that helps in data cleansing and data standardization in most efficient manner. Development efficient & highly tuned data cleansing routines Should be able to use all IDQ transformations including Address Doctors Understands IDQ architecture and performance techniques with industry standard coding practices Should be able to works with exposing data quality rules as webservices and consumed data from third party rest APIs Should be able to work with managed and unmanaged reference table Understands the code deployment & knows to automate it Informatica Analyst Used by Business/ Data analyst & data stewards to profile data, define rule specification and manage business glossary Build profile on heterogenous data sources – Basic profiling, join data profiling Build scorecards Build reference tables Build mapping and rule specifications Build and manage Reference data though reference tables Able to build and manage business glossary Informatica Data Management Cloud Data Integration and Cloud Application Integration services are used for data integration and ETL flows and this helps our program with large scale integration projects with minimum infrastructure Develop efficient & highly tuned data transformation mappings Deploy and manage the secure agents Utilize parametrization features in CDI/CAI Build, execute/schedule mapping tasks and task flows Performance tuning through lookup and other coding best practices Knows SCD Types and its implementation in CDI/CAI Rest API consumptions Informatica Reference 360 Informatica’s SaaS based product for reference data management Build and implement code list Build and implement cross walks Access management on reference data Ingest and export data in and out of Reference -360 Informatica MDM Resource Kit Informatica Command Line Utilities Informatica OOB API Informatica Address Doctor Apigee/Mulesoft/etc Informatica platform administration Informatica Patching/Upgrade utilities Process Scheduling Application: Rundeck / Control-M Build Jobs for execution of IDQ/ MDM processes Build Jobs for execution of Database processes Build Jobs for execution of Shell programs on Linux Build Workflow Jobs and Daily batch processes Setup Alerts/Notification/ Error handling Routines Application Start/Stop Routines Tools/ Utilities: Linux Shell Scripting Build Shell Programs for process executions Application cleanup actions SoapUI Postman CI/CD through Informatica Dev Ops Platform Build Custom Operational Reports and Email Notifications OS Infrastructure Alerts Application Start/Stop routines Documentation: GIT – Global Information Tracker Strong Documentation Skills Follow change management policies Platform Azure Fundamental Cloud computing Databases Oracle Development Project level administration SQL Server, MYSQL Exposure to NOSQL DBs – Graph / Document Databases Functional skills Data Modeling Logical / Physical Modeling Data Integration Batch & Realtime Integration ETL Master Data management Data Governance Business Definition of Data Elements Understand Governance Rules and Policies for Master Data Entity Data Lineage Data Element Definition Relationships Definition Data Stewardship Control Roles based Access to the master data Implement approval / rejection process for create/Edit of master Data Setup Business rules on Create/Edit of master data using IDD/E360 applications Control Quality of Data as per defined Governance rules / Policies Follow process for Manual Merges/ Unmerges Data Quality Match & Merge Cross Referencing BVT (Best Version of the Truth) and Survivorship Process Project management skills: Business Requirements Gathering Logical Design / Technical Design Estimation Team management (For Leads) Demo/Presentations