Senior Integration Consultant

Job Description

Role Overview: We are seeking askilled and detail-oriented Integration Consultant with 5 to 6 years ofexperience to join our team. The ideal candidate will have expertise indesigning, building, and maintaining data pipelines and ETL workflows,leveraging tools and technologies like AWS Glue, CloudWatch, PySpark, APIs,SQL, and Python. KeyResponsibilities: 1. PipelineCreation and Maintenance : -Design, develop, and deploy scalable data pipelines. -Optimize pipeline performance and ensure data accuracy and integrity. 2. ETLDevelopment : - CreateETL workflows using AWS Glue and PySpark to process and transform largedatasets. - Ensurecompliance with data governance and security standards. 3. DataAnalysis and Processing : - Writeefficient SQL queries for data extraction, transformation, and reporting. -Develop Python scripts to automate data tasks and improve workflows. 4. Monitoringand Troubleshooting : -Utilize AWS CloudWatch to monitor pipeline health and performance. -Identify and resolve issues in a timely manner to minimize downtime. 5. APIIntegration : -Integrate and manage APIs to connect external data sources and services. 6. Collaboration : - Workclosely with cross-functional teams to understand data requirements and providesolutions. -Communicate effectively with stakeholders to ensure successful projectdelivery. Requirements RequiredSkills and Qualifications: Experience 5-6Years - o9 solutionsplatform exp is Mandatory. - Strong experiencewith AWS Glue and CloudWatch . - Proficiency in PySpark , Python , and SQL . - Hands-on experiencewith API integration and management. - Solid understandingof ETL processes and pipeline creation. - Strong analyticaland problem-solving skills. - Familiarity withdata security and governance best practices. PreferredSkills: - Knowledge of otherAWS services such as S3, EC2, Lambda, or Redshift. - Experience withPyspark, API, SQL Optimization, Python - Exposure to datavisualization tools or frameworks. Education: - Bachelor degree incomputer science, Information Technology, or a related field.