ETL Python

P1,C3,STS

• Design, build data cleansing and imputation, map to a standard data model, transform to satisfy business rules and statistical computations, and validate data content.
  

Develop, modify, and maintain Python and Unix Scripts, and complex SQLPerformance tuning of the existing code and avoid bottlenecks and improve performanceBuild an end-to-end data flow from sources to entirely curated and enhanced data sets.Develop automated Python jobs for ingesting data from various source systemsProvide technical expertise in areas of architecture, design, and implementation.Work with team members to create useful reports and dashboards that provide insight, improve/automate processes, or otherwise add value to the team.Write SQL queries for data validation.Design, develop and maintain ETL processess to extract, transform and load Data from various sources into the data warehoursColloborate with data architects, analysts and other stake holders to understand data requirement and ensure qualityOptimize and tune ETL processes for performance and scalaiblityDevelop and maintain documentation for ETL processes, data flows, and data mappingsMonitor and trouble shoot ETL processes to ensure data accuracy and availabilityImplement data validation and error handling mechanismsWork with large data sets and ensure data integrity and consistency

Skills

Python,ETL Tools like Informatica, Talend, SSIS or similarSQL, Mysql,Expertise in Oracle, SQL Server and TeradataDeV Ops, GIT LabExp in AWS glue or Azure data factory