Key Responsibilities: Development and Implementation: Design, develop, and deploy robust and scalable data pipelines for migrating data from various on-premise sources to cloud platforms. Technical Expertise: Serve as a subject matter expert in the project's core technologies, including Datastage, Azure Data Factory (ADF), Databricks, and PySpark. Solution Design: Collaborate with architects and technical leads to design efficient and effective cloud migration strategies and data transformation solutions. Code Quality: Ensure the delivery of high-quality, well-documented, and maintainable code. Participate in code reviews and provide constructive feedback to peers. Performance Optimization: Analyze and optimize the performance of data pipelines and applications to ensure efficiency and scalability. Problem-Solving: Troubleshoot and resolve complex technical issues related to data migration, data quality, and system performance. Collaboration: Work closely with cross-functional teams, including business analysts, data scientists, and other engineers, to understand requirements and deliver successful outcomes. Mentorship: Provide guidance and technical support to junior engineers, helping them grow their skills and contribute effectively to the team. Required Skills and Qualifications: Minimum of 10 years of experience in the IT industry, with a focus on data engineering and ETL development. Extensive hands-on experience with Datastage for building and managing ETL jobs. Proven experience in Cloud Migration projects , with a strong understanding of the challenges and best practices involved in moving data to the cloud. In-depth knowledge and hands-on experience with Azure Data Factory (ADF) for building and orchestrating data workflows. Strong proficiency in Databricks and its ecosystem, including notebooks, jobs, and Delta Lake. Expertise in PySpark for developing data processing applications on a distributed computing framework. Solid understanding of cloud platforms, preferably Microsoft Azure . Experience with SQL and database concepts. Excellent analytical, problem-solving, and communication skills. Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
Job Description: Tech Lead - Cloud Migration Location: Pune (preferred) / Anywhere in India Experience: Minimum 13 years Project Type: Cloud Migration About the Role: We are seeking an experienced and highly skilled Tech Lead to spearhead our cloud migration initiatives. The ideal candidate will have a minimum of 13 years of experience in the IT industry, with a strong focus on data engineering, ETL, and a proven track record of successfully leading large-scale cloud migration projects. This role requires a hands-on leader who can guide a team, architect solutions, and ensure the successful delivery of complex data transformation projects. Key Responsibilities: Technical Leadership: Lead, mentor, and guide a team of data engineers and developers in the design, development, and implementation of cloud migration solutions. Solution Architecture: Design and architect robust, scalable, and high-performance data pipelines for migrating on-premise data to the cloud. This includes defining the migration strategy, data mapping, and transformation logic. Hands-on Development: Actively participate in the development process, writing and reviewing code, and ensuring best practices are followed. Technology Expertise: Serve as the subject matter expert for the project's technology stack, including Datastage, Azure Data Factory (ADF), Databricks, and PySpark. Performance Optimization: Identify and resolve performance bottlenecks in data pipelines and applications. Stakeholder Collaboration: Work closely with business analysts, project managers, and other technical teams to understand requirements and translate them into technical solutions. Mentorship and Training: Provide technical guidance and training to junior team members to enhance their skills and foster a culture of continuous learning. Required Skills and Qualifications: Minimum of 13 years of experience in the IT industry, with a significant portion focused on data engineering and ETL. Proven experience as a Technical Lead, managing and mentoring a team of developers. Extensive hands-on experience with Datastage for ETL processes. Deep expertise in Cloud Migration projects , with a strong understanding of migrating data from on-premise to cloud environments. Proficiency in Azure Data Factory (ADF) for building and orchestrating data pipelines. Strong experience with Databricks and its functionalities for big data processing and analytics. Expertise in PySpark for developing scalable and efficient data processing applications. Solid understanding of cloud platforms, preferably Microsoft Azure . Experience with other data technologies and concepts like SQL, data warehousing, and dimensional modeling. Excellent problem-solving, communication, and leadership skills.
Job Summary: We are looking for a talented and detail-oriented Database Engineer to join our data engineering team. The ideal candidate will have strong experience working with Oracle databases and Google BigQuery, and will be responsible for designing, optimizing, and maintaining scalable data solutions across both platforms. Key Responsibilities: Design and implement efficient data pipelines and ETL processes between Oracle and BigQuery. Develop and optimize SQL queries, stored procedures, and views for performance and scalability. Migrate data from on-premise Oracle databases to BigQuery, ensuring data integrity and consistency. Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements. Monitor and troubleshoot database performance issues and implement tuning strategies. Ensure data security, compliance, and governance across platforms. Maintain documentation for data models, processes, and workflows. Required Skills & Qualifications: 810 years of experience in data engineering or database development. Strong hands-on experience with Oracle (PL/SQL, performance tuning, data modeling). Experience with Google BigQuery and SQL-based data transformation. Familiarity with data migration strategies and tools (e.g., Dataflow, Apache Beam, Informatica, etc.). Proficiency in writing complex SQL queries and optimizing them for performance. Understanding of data warehousing concepts and dimensional modeling. Experience with version control systems (e.g., Git) and Agile development practices. Preferred Qualifications: Experience with Python or other scripting languages for data manipulation. Exposure to cloud platforms (GCP, AWS, or Azure). Knowledge of data governance and security best practices. Experience with CI/CD pipelines and DevOps practices for data engineering.
Job Summary We are seeking a highly experienced Test Lead with deep expertise in ETL and SQL testing across enterprise data platforms. The ideal candidate will lead testing efforts for complex data pipelines, manage QA teams, and ensure data quality, accuracy, and performance across diverse environments. Key Responsibilities Lead and manage QA teams across multiple projects, ensuring timely and high-quality delivery. Define and execute test strategies for ETL workflows using tools like IBM DataStage, Azure Data Factory (ADF), or Informatica. Perform advanced SQL testing across databases such as Oracle, Snowflake, BigQuery, Synapse, and SQL Server. Validate data transformations, data loads, and reconciliation across source and target systems. Drive automation initiatives for data validation and regression testing. Collaborate with cross-functional teams including data engineers, analysts, and business stakeholders. Conduct root cause analysis of data issues and manage defect lifecycle. Mentor junior testers and foster a culture of continuous improvement. Ensure compliance with data governance, security, and audit requirements. Required Skills & Qualifications 13+ years of experience in software testing, with significant focus on ETL and SQL testing. Strong hands-on experience with ETL tools: DataStage, ADF, or Informatica. Proficient in writing and optimizing SQL queries across multiple database platforms. Proven experience in leading and mentoring QA teams. Familiarity with Agile methodologies and DevOps practices. Experience with test management tools (e.g., JIRA, TestRail, HP ALM). Excellent communication, analytical, and stakeholder management skills. Bachelors or Masters degree in Computer Science, Information Systems, or related field. Preferred Qualifications Experience with cloud data platforms (Azure, GCP, AWS). Exposure to data observability and monitoring tools. ISTQB or equivalent certification. Experience in regulated industries such as finance, healthcare, or telecom.