Job Description

Experience : 2 Years Responsibilities : Develop and optimize scalable data pipelines for efficient data migration from relational databases to data lakes and data warehouses. Design, build, and manage ETL processes to support business needs and ensure high data availability. Perform complex data transformations using SQL and Spark to enable insightful data analysis. Conduct performance tuning to improve the speed and reliability of data pipelines. Implement data validation and quality checks to ensure data integrity and accuracy throughout the migration process. Collaborate with data analysts, data scientists, and other stakeholders to understand data requirements and deliver high-quality solutions. Troubleshoot and resolve issues in data pipelines and ETL processes to minimize downtime and maintain data consistency.