Data Integration Lead/Developer

As a Talend and Hive experienced Data Integration Lead or Developer, you will be responsible for designing, developing, and implementing solutions to extract, transform, and load data into Target Systems. Your core skills and competencies should include: - Cloud-native experience working in Azure Based Bigdata environment, including ADLS (Data lake services), Azure SQL DB, and Datawarehouse. - Working knowledge of Hive, HiveQL, Design, Optimization, etc. - Good experience in SQL scripting and Programming. - Utilizing the Spark framework in conjunction with Talend to develop and configure Big Data batch Jobs and troubleshoot ETL processes. - Performing performance tuning and administration to build end-to-end data solutions. Your experience should encompass: - Working with Talend Components such as database, file, API, OS system calls, etc., Context management, and Git Deployment. - Hands-on experience connecting and processing data from application sources to target reporting layer using Talend ETL / Bigdata components. - Working on at least two real-world projects in the Technical areas of need. - Analyzing business requirements, Designing, Building, and Deploying complex jobs to load data into data lake. - Knowledge of cloud deployments of BI solutions in Azure cloud eco-system. - Experience in Agile projects and working with Devops based service delivery, specifically GitHub Integration. - Prior exposure to Migration (Data, Process) projects will be beneficial. - Testing using and reconciling data between systems. - Ability to work in a team environment, remotely with minimum supervision, and a strong work ethic. Additionally, you should be willing to work for Global clients (e.g. North America based client) from a time and distributed working perspective. This position offers the flexibility of working from home. Qualifications Required: - 4-8 years of experience in Data Integration and Development. - Strong expertise in Talend, Hive, SQL, Spark, and Azure Bigdata environment. - Experience with ELT/ETL processes and cloud-native data solutions. - Proficiency in Agile methodologies, Devops practices, and testing procedures. - Excellent communication and teamwork skills. Please note that this job opportunity is for a Data Integration Lead or Developer role with a focus on Talend and Hive technologies, working in a Cloud-native environment with Azure Bigdata services.,