Key Responsibilities: Development and Implementation: Design, develop, and deploy robust and scalable data pipelines for migrating data from various on-premise sources to cloud platforms. Technical Expertise: Serve as a subject matter expert in the project's core technologies, including Datastage, Azure Data Factory (ADF), Databricks, and PySpark. Solution Design: Collaborate with architects and technical leads to design efficient and effective cloud migration strategies and data transformation solutions. Code Quality: Ensure the delivery of high-quality, well-documented, and maintainable code. Participate in code reviews and provide constructive feedback to peers. Performance Optimization: Analyze and optimize the performance of data pipelines and applications to ensure efficiency and scalability. Problem-Solving: Troubleshoot and resolve complex technical issues related to data migration, data quality, and system performance. Collaboration: Work closely with cross-functional teams, including business analysts, data scientists, and other engineers, to understand requirements and deliver successful outcomes. Mentorship: Provide guidance and technical support to junior engineers, helping them grow their skills and contribute effectively to the team. Required Skills and Qualifications: Minimum of 10 years of experience in the IT industry, with a focus on data engineering and ETL development. Extensive hands-on experience with Datastage for building and managing ETL jobs. Proven experience in Cloud Migration projects , with a strong understanding of the challenges and best practices involved in moving data to the cloud. In-depth knowledge and hands-on experience with Azure Data Factory (ADF) for building and orchestrating data workflows. Strong proficiency in Databricks and its ecosystem, including notebooks, jobs, and Delta Lake. Expertise in PySpark for developing data processing applications on a distributed computing framework. Solid understanding of cloud platforms, preferably Microsoft Azure . Experience with SQL and database concepts. Excellent analytical, problem-solving, and communication skills. Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
Job Description: Tech Lead - Cloud Migration Location: Pune (preferred) / Anywhere in India Experience: Minimum 13 years Project Type: Cloud Migration About the Role: We are seeking an experienced and highly skilled Tech Lead to spearhead our cloud migration initiatives. The ideal candidate will have a minimum of 13 years of experience in the IT industry, with a strong focus on data engineering, ETL, and a proven track record of successfully leading large-scale cloud migration projects. This role requires a hands-on leader who can guide a team, architect solutions, and ensure the successful delivery of complex data transformation projects. Key Responsibilities: Technical Leadership: Lead, mentor, and guide a team of data engineers and developers in the design, development, and implementation of cloud migration solutions. Solution Architecture: Design and architect robust, scalable, and high-performance data pipelines for migrating on-premise data to the cloud. This includes defining the migration strategy, data mapping, and transformation logic. Hands-on Development: Actively participate in the development process, writing and reviewing code, and ensuring best practices are followed. Technology Expertise: Serve as the subject matter expert for the project's technology stack, including Datastage, Azure Data Factory (ADF), Databricks, and PySpark. Performance Optimization: Identify and resolve performance bottlenecks in data pipelines and applications. Stakeholder Collaboration: Work closely with business analysts, project managers, and other technical teams to understand requirements and translate them into technical solutions. Mentorship and Training: Provide technical guidance and training to junior team members to enhance their skills and foster a culture of continuous learning. Required Skills and Qualifications: Minimum of 13 years of experience in the IT industry, with a significant portion focused on data engineering and ETL. Proven experience as a Technical Lead, managing and mentoring a team of developers. Extensive hands-on experience with Datastage for ETL processes. Deep expertise in Cloud Migration projects , with a strong understanding of migrating data from on-premise to cloud environments. Proficiency in Azure Data Factory (ADF) for building and orchestrating data pipelines. Strong experience with Databricks and its functionalities for big data processing and analytics. Expertise in PySpark for developing scalable and efficient data processing applications. Solid understanding of cloud platforms, preferably Microsoft Azure . Experience with other data technologies and concepts like SQL, data warehousing, and dimensional modeling. Excellent problem-solving, communication, and leadership skills.