Data Engineer-Data Integration

Job Description

As a Big Data Engineer, you wi deveop, maintain, evauate, and test big data soutions. You wi be invoved in data engineering activities ike creating pipeines/workfows for Source to Target and impementing soutions that tacke the cients needs. Your primary responsibiities incude: Design, buid, optimize and support new and existing data modes and ETL processes based on our cients business requirements. Buid, depoy and manage data infrastructure that can adequatey hande the needs of a rapidy growing data driven organization. Coordinate data access and security to enabe data scientists and anaysts to easiy access to data whenever they need too. Required education Bacheor's Degree Preferred education Master's Degree Required technica and professiona expertise Design, deveop, and maintain Ab Initio graphs for extracting, transforming, and oading (ETL) data from diverse sources to various target systems. Impement data quaity and vaidation processes within Ab Initio. Data Modeing and Anaysis:. Coaborate with data architects and business anaysts to understand data requirements and transate them into effective ETL processes.. Anayze and mode data to ensure optima ETL design and performance.. Ab Initio Components:. . Utiize Ab Initio components such as Transform Functions, Roup, Join, Normaize, and others to buid scaabe and efficient data integration soutions. Impement best practices for reusabe Ab Initio component Preferred technica and professiona experience Optimize Ab Initio graphs for performance, ensuring efficient data processing and minima resource utiization. Conduct performance tuning and troubeshooting as needed. Coaboration. Work cosey with cross-functiona teams, incuding data anaysts, database administrators, and quaity assurance, to ensure seamess integration of ETL processes.. Participate in design reviews and provide technica expertise to enhance overa soution quaity Documentation