1016 Etl Process Jobs - Page 40

Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Graph Databases Good to have skills : Life Sciences, Autosys Minimum 7.5 year(s) of experience is required Educational Qualification : BE Summary :As a Data Platform Engineer, you will be responsible for assisting with the blueprint and design of the data platform components. Your typical day will involve collaborating with Integration Architects and Data Architects to ensure cohesive integration between systems and data models, utilizing your expertise in Graph Databases and Life Sciences. Roles & Responsibilities: Assist with the blueprint and design of the data platform components. Collaborate with Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Utilize expertise in Graph Databases to design and implement data models. Develop and maintain data pipelines and ETL processes. Ensure data quality and integrity through testing and validation processes. Professional & Technical Skills: Must To Have Skills:Expertise in Graph Databases. Good To Have Skills:Knowledge of Life Sciences. Experience in designing and implementing data models. Proficiency in developing and maintaining data pipelines and ETL processes. Strong understanding of testing and validation processes for ensuring data quality and integrity. Additional Information: The candidate should have a minimum of 7.5 years of experience in Graph Databases. This position is based at our Bengaluru office. Qualification BE

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Ab Initio Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will be responsible for designing, building, and configuring applications to meet business process and application requirements. You will work closely with the team to ensure the successful delivery of high-quality software solutions. Roles & Responsibilities: Expected to perform independently and become an SME. Required active participation/contribution in team discussions. Contribute in providing solutions to work related problems. Collaborate with cross-functional teams to gather and analyze requirements. Design, develop, and test applications based on business requirements. Troubleshoot and debug issues in existing applications. Ensure the performance, quality, and responsiveness of applications. Participate in code reviews to maintain code quality. Stay up-to-date with emerging technologies and industry trends. Provide technical guidance and support to junior team members. Professional & Technical Skills: Must To Have Skills:Proficiency in Ab Initio. Good To Have Skills:Experience with data integration tools. Strong understanding of ETL concepts and data warehousing principles. Experience in designing and developing ETL workflows using Ab Initio. Knowledge of SQL and database concepts. Familiarity with version control systems such as Git. Excellent problem-solving and analytical skills. Additional Information: The candidate should have a minimum of 3 years of experience in Ab Initio. This position is based at our Bengaluru office. A 15 years full time education is required. Qualifications 15 years full time education

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Ab Initio Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. Your typical day will involve collaborating with team members, analyzing requirements, and developing solutions to meet business needs. Roles & Responsibilities: Expected to be an SME Collaborate and manage the team to perform Responsible for team decisions Engage with multiple teams and contribute on key decisions Provide solutions to problems for their immediate team and across multiple teams Lead and mentor junior professionals Conduct code reviews and ensure coding standards are met Professional & Technical Skills: Must To Have Skills:Proficiency in Ab Initio Strong understanding of ETL processes Experience with data integration and data warehousing concepts Hands-on experience in designing and developing ETL workflows Knowledge of data quality and data governance principles Additional Information: The candidate should have a minimum of 5 years of experience in Ab Initio This position is based at our Pune office A 15 years full-time education is required Qualifications 15 years full time education

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Kinaxis Good to have skills : NA Minimum 12 year(s) of experience is required Educational Qualification : 15 years full time education Key Responsibilities -Play the integration architect role on Kinaxis implementation projects. -Engage with client stakeholders to understand data requirements, carry out fit-gap analysis and work on overall integration architecture landscape. -Review and analyze data provided by client along with its technical & functional intent and inter dependencies. -Guide integration team to build and deploy effective integration packages to validate and transform customer data for integrated business planning and analytics. Key Qualifications (Must Have)-Minimum 10 to 15 years of experience of implementing ETL solutions to integrate Kinaxis Rapid Response and similar other SCM software in client environment. -Should have played Integration Architect role in at least 2 Kinaxis implementation projects. -Working experience in designing integration packages with ETL tools-Experience of leading technical design for inbound / outbound processes-Advanced understanding of Kinaxis Data models, namespaces and partitions-Advanced understanding of Rapid Response Integration Models (Batch, API, Webservices etc)-Advanced understanding of Rapid Response System Administration-Strong collaborator- team player- and individual contributor. -Strong communication skills with comfort in speaking with business stakeholders. Strong problem solver with ability to manage and lead the team to push the solution and drive progress.Preferable Qualifications (Nice to Have)-Talend experience will be an added advantage-Rapid Response Integration Consultant certification will be a plus-SQL/SSIS experience will be an added advantage Professional Attributes -Proven ability to work creatively and analytically in a problem-solving environment. Proven ability to build, manage and foster a team-oriented e-environment -Desire to work in an information systems environment -Excellent communication written and oral and interpersonal skills. Educational Qualification BTech/BE/MCA Additional Information Open to travel - short / long term Qualifications 15 years full time education

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : AWS Glue Good to have skills : PySpark Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your day will involve overseeing the application development process and ensuring seamless communication within the team and stakeholders. Roles & Responsibilities: Expected to be an SME Collaborate and manage the team to perform Responsible for team decisions Engage with multiple teams and contribute on key decisions Provide solutions to problems for their immediate team and across multiple teams Lead the application development process Ensure effective communication within the team and stakeholders Professional & Technical Skills: Must To Have Skills:Proficiency in AWS Glue Good To Have Skills:Experience with PySpark Strong understanding of ETL processes Experience in data transformation and integration Knowledge of cloud computing services Ability to troubleshoot and optimize data pipelines Additional Information: The candidate should have a minimum of 7.5 years of experience in AWS Glue This position is based at our Bengaluru office A 15 years full-time education is required Qualifications 15 years full time education

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : AWS Redshift Good to have skills : PySpark Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. You will oversee the development process and ensure successful project delivery. Roles & Responsibilities: Expected to be an SME Collaborate and manage the team to perform Responsible for team decisions Engage with multiple teams and contribute on key decisions Provide solutions to problems for their immediate team and across multiple teams Lead the application development process Coordinate with stakeholders to gather requirements Ensure timely delivery of projects Professional & Technical Skills: Must To Have Skills:Proficiency in AWS Glue Good To Have Skills:Experience with PySpark Strong understanding of ETL processes Experience in data transformation and integration Knowledge of cloud computing platforms Ability to troubleshoot and resolve technical issues Additional Information: The candidate should have a minimum of 5 years of experience in AWS Glue This position is based at our Bengaluru office A 15 years full-time education is required Qualifications 15 years full time education

Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : SAP BusinessObjects Data Services Good to have skills : Life Sciences Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will analyze, design, code, and test multiple components of application code across one or more clients. You will perform maintenance, enhancements, and/or development work. Your typical day will involve analyzing requirements, designing solutions, writing code, and conducting testing to ensure the quality of the application. You will collaborate with cross-functional teams and contribute to key decisions. Your role will require problem-solving skills and the ability to provide solutions for your immediate team and across multiple teams. Roles & Responsibilities: Expected to be an SME Collaborate and manage the team to perform Responsible for team decisions Engage with multiple teams and contribute on key decisions Provide solutions to problems for their immediate team and across multiple teams Conduct code reviews and provide feedback Participate in design and architecture discussions Identify and resolve technical issues Stay updated with the latest industry trends and technologies Professional & Technical Skills: Must To Have Skills:Proficiency in SAP BusinessObjects Data Services Good To Have Skills:Experience with Life Sciences Strong understanding of data integration and ETL processes Experience in data modeling and database design Knowledge of SQL and database management systems Familiarity with data warehousing concepts Experience with data quality and data governance Ability to troubleshoot and debug complex issues Additional Information: The candidate should have a minimum of 5 years of experience in SAP BusinessObjects Data Services This position is based at our Pune office A 15 years full-time education is required Qualifications 15 years full time education

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Data Warehouse ETL Testing Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. You will collaborate with teams and contribute to key decisions, providing solutions to problems for your immediate team and across multiple teams. Your typical day will involve designing and implementing applications, troubleshooting issues, and ensuring the applications meet the required specifications and standards. Roles & Responsibilities: Expected to be an SME Collaborate and manage the team to perform Responsible for team decisions Engage with multiple teams and contribute on key decisions Provide solutions to problems for their immediate team and across multiple teams Design and implement applications based on business process and application requirements Troubleshoot and resolve issues in applications Ensure applications meet the required specifications and standards Professional & Technical Skills: Must To Have Skills:Proficiency in Data Warehouse ETL Testing Strong understanding of data warehouse concepts and ETL processes Experience in testing data warehouse solutions and ETL pipelines Knowledge of SQL and scripting languages for data manipulation and validation Familiarity with data quality and data governance principles Additional Information: The candidate should have a minimum of 5 years of experience in Data Warehouse ETL Testing This position is based at our Chennai office A 15 years full time education is required Qualifications 15 years full time education

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : GCP Dataflow Good to have skills : Google BigQuery Minimum 3 year(s) of experience is required Educational Qualification : Any Graduate Summary :As a Data Engineer, you will be responsible for designing, developing, and maintaining data solutions for data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across systems using GCP Dataflow. Roles & Responsibilities: Design, develop, and maintain data solutions for data generation, collection, and processing using GCP Dataflow. Create data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across systems. Collaborate with cross-functional teams to identify and resolve data-related issues. Develop and maintain documentation related to data solutions and processes. Stay updated with the latest advancements in data engineering technologies and integrate innovative approaches for sustained competitive advantage. Professional & Technical Skills: Must To Have Skills:Experience in GCP Dataflow. Good To Have Skills:Experience in Google BigQuery. Strong understanding of ETL processes and data migration. Experience in data modeling and database design. Experience in data warehousing and data lake concepts. Experience in programming languages such as Python, Java, or Scala. Additional Information: The candidate should have a minimum of 3 years of experience in GCP Dataflow. The ideal candidate will possess a strong educational background in computer science, information technology, or a related field, along with a proven track record of delivering impactful data-driven solutions. This position is based at our Indore office. Qualification Any Graduate

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : SAP BusinessObjects Data Services Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 year of fulltime education Summary :As an Application Developer for Packaged Application Development, you will be responsible for designing, building, and configuring applications to meet business process and application requirements using SAP BusinessObjects Data Services. Your typical day will involve collaborating with cross-functional teams, analyzing business requirements, and developing solutions to meet those requirements. Roles & Responsibilities: Design, build, and configure applications to meet business process and application requirements using SAP BusinessObjects Data Services. Collaborate with cross-functional teams to analyze business requirements and develop solutions to meet those requirements. Develop and maintain technical documentation related to application development. Provide technical support and troubleshooting for applications developed using SAP BusinessObjects Data Services. Stay updated with the latest advancements in SAP BusinessObjects Data Services and related technologies. Professional & Technical Skills: Must To Have Skills:Proficiency in SAP BusinessObjects Data Services. Good To Have Skills:Experience with SAP HANA, SAP BW, and SAP BOBJ. Strong understanding of ETL processes and data integration. Experience with SQL and database management systems. Experience with data modeling and data warehousing concepts. Additional Information: The candidate should have a minimum of 3 years of experience in SAP BusinessObjects Data Services. The ideal candidate will possess a strong educational background in computer science, information technology, or a related field, along with a proven track record of delivering impactful data-driven solutions. This position is based at our Hyderabad office. Qualifications 15 year of fulltime education

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : AWS Architecture Good to have skills : Amazon Web Services (AWS) Minimum 3 year(s) of experience is required Educational Qualification : 15 years full term education Job Title:AWS Data Engineer About The Role ::We are seeking a skilled AWS Data Engineer with expertise in AWS services such as Glue, Lambda, SageMaker, CloudWatch, and S3, coupled with strong Python/PySpark development skills. The ideal candidate will have a solid grasp of ETL concepts, proficient in writing complex SQL queries, and capable of handling client interactions independently. They should demonstrate a track record of efficiently resolving tickets, tasks, bugs, and enhancements within stipulated timelines. Good communication skills are essential, and basic knowledge of databases is preferred. Project Role Description :Design, build and configure applications to meet business process and application requirements. Must-Have Skills:AWS GlueAWS ArchitechtureAWS Expertise:Python/PySpark Development:SQL Mastery:Advanced knowledge of SQLClient Handling:Problem-Solving Skills:xCommunication Skills:Responsibilities:Develop and maintain AWS-based data solutions utilizing services like Glue, Lambda, SageMaker, CloudWatch,DynamoDb and S3. Implement ETL processes effectively within Glue jobs and PySpark scripts, ensuring optimal performance and reliability. Proficiently write and optimize complex SQL queries to extract, transform, and load data from various sources. Independently handle client interactions, understanding requirements, providing technical guidance, and ensuring client satisfaction. Resolve tickets, tasks, bugs, and enhancements promptly, meeting defined resolution timeframes. Communicate effectively with team members, stakeholders, and clients, providing updates, reports, and insights as required. Maintain a basic understanding of databases, supporting data-related activities and troubleshooting when necessary. Stay updated with industry trends, AWS advancements, and best practices, contributing to continuous improvement initiatives within the team. Requirements:Bachelor's degree in Computer Science, Engineering, or a related field.Proven experience working with AWS services, particularly Glue, Lambda, SageMaker, CloudWatch, and S3.Strong proficiency in Python and/or PySpark development for data processing and analysis.Solid understanding of ETL concepts, databases, and data warehousing principles.Excellent problem-solving skills and ability to work independently or within a team.Outstanding communication skills, both verbal and written, with the ability to interact professionally with clients and colleagues.Ability to manage multiple tasks concurrently and prioritize effectively in a dynamic work environment.Good to have:Basic knowledge of relational databases such as MySQL, PostgreSQL, or SQL Server. Educational Qualification:Bachelor Degree Qualifications 15 years full term education

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Purview Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary : As a Data Engineer, you will design, develop, and maintain data solutions for data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across systems. You will play a crucial role in managing and optimizing data infrastructure to support the organization's data needs. Roles & Responsibilities: - Expected to be an SME, collaborate and manage the team to perform. - Responsible for team decisions. - Engage with multiple teams and contribute on key decisions. - Provide solutions to problems for their immediate team and across multiple teams. - Design and develop scalable data pipelines for data ingestion, transformation, and loading. - Implement and maintain ETL processes to ensure efficient data migration and deployment. - Collaborate with cross-functional teams to understand data requirements and design appropriate solutions. - Ensure data quality and integrity by implementing data validation and cleansing techniques. - Optimize data infrastructure and performance to meet the organization's data processing needs. Professional & Technical Skills: - Must To Have Skills:Proficiency in Microsoft Purview. - Strong understanding of data engineering principles and best practices. - Experience with data modeling, database design, and SQL. - Hands-on experience with data integration tools and technologies. - Familiarity with cloud platforms such as Azure or AWS. - Good To Have Skills:Experience with data visualization tools such as Tableau or Power BI. Additional Information: - The candidate should have a minimum of 5 years of experience in Microsoft Purview. - This position is based at our Bengaluru office. - A 15 years full-time education is required. Qualifications 15 years full time education

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Ab Initio Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will be responsible for designing, building, and configuring applications to meet business process and application requirements. You will collaborate with teams to ensure successful project delivery and implementation. Roles & Responsibilities: Expected to be an SME Collaborate and manage the team to perform Responsible for team decisions Engage with multiple teams and contribute on key decisions Provide solutions to problems for their immediate team and across multiple teams Lead and mentor junior professionals Conduct regular team meetings to discuss progress and challenges Stay updated on industry trends and best practices Professional & Technical Skills: Must To Have Skills:Proficiency in Ab Initio Strong understanding of ETL processes Experience with data integration and data warehousing Knowledge of data quality and data governance principles Hands-on experience with Ab Initio GDE and EME tools Additional Information: The candidate should have a minimum of 5 years of experience in Ab Initio This position is based at our Pune office A 15 years full-time education is required Qualifications 15 years full time education

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : AWS Glue Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : Graduation Summary :As an Application Lead, you will be responsible for leading the effort to design, build, and configure applications using AWS Glue. Your typical day will involve collaborating with cross-functional teams, ensuring timely delivery of projects, and acting as the primary point of contact for the project. Roles & Responsibilities: Lead the effort to design, build, and configure applications using AWS Glue. Collaborate with cross-functional teams to ensure timely delivery of projects. Act as the primary point of contact for the project, providing guidance and support to team members. Ensure adherence to coding standards and best practices, and perform code reviews to maintain code quality. Identify and mitigate risks and issues, and escalate them to the appropriate stakeholders. Professional & Technical Skills: Must To Have Skills:Experience in AWS Glue. Good To Have Skills:Experience in AWS Lambda, AWS S3, and AWS EC2. Strong understanding of ETL processes and data warehousing concepts. Experience in designing and implementing scalable and fault-tolerant systems. Proficiency in programming languages such as Python, Java, or Scala. Experience in working with databases such as MySQL, Oracle, or PostgreSQL. Additional Information: The candidate should have a minimum of 5 years of experience in AWS Glue. The ideal candidate will possess a strong educational background in computer science or a related field, along with a proven track record of delivering impactful solutions. This position is based at our Mumbai office. Qualifications Graduation

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : SAP BusinessObjects Data Services Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : Any Graduation Summary :As an Application Developer, you will be responsible for designing, building, and configuring applications to meet business process and application requirements using SAP BusinessObjects Data Services. Your typical day will involve collaborating with cross-functional teams, analyzing business requirements, and developing solutions to meet those requirements. Roles & Responsibilities: Design, develop, and maintain SAP BusinessObjects Data Services solutions to meet business requirements. Collaborate with cross-functional teams to analyze business requirements and develop solutions to meet those requirements. Develop and maintain technical documentation, including design documents, test plans, and user manuals. Provide technical support and troubleshooting for SAP BusinessObjects Data Services solutions. Professional & Technical Skills: Must To Have Skills:Expertise in SAP BusinessObjects Data Services. Good To Have Skills:Experience with SAP HANA, SAP BW, and SAP ECC. Strong understanding of ETL processes and data integration. Experience with SQL and database management systems. Experience with data modeling and data warehousing concepts. Additional Information: The candidate should have a minimum of 7.5 years of experience in SAP BusinessObjects Data Services. The ideal candidate will possess a strong educational background in computer science, information technology, or a related field, along with a proven track record of delivering impactful data-driven solutions. This position is based at our Hyderabad office. Qualification Any Graduation

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : IBM InfoSphere DataStage Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. Your typical day will involve collaborating with the team to develop and implement solutions, ensuring they align with business needs and standards. You will also engage with multiple teams, contribute to key decisions, and provide problem-solving solutions for your team and across multiple teams. With your creativity and expertise in IBM InfoSphere DataStage, you will play a crucial role in developing efficient and effective applications. Roles & Responsibilities: Expected to be an SME, collaborate and manage the team to perform. Responsible for team decisions. Engage with multiple teams and contribute on key decisions. Provide solutions to problems for their immediate team and across multiple teams. Design, develop, and test applications using IBM InfoSphere DataStage. Collaborate with business analysts and stakeholders to gather requirements. Ensure applications meet business process and application requirements. Troubleshoot and debug applications to resolve issues. Create technical documentation for reference and reporting purposes. Professional & Technical Skills: Must To Have Skills:Proficiency in IBM InfoSphere DataStage. Strong understanding of ETL concepts and data integration. Experience in designing and implementing data integration solutions. Knowledge of SQL and database concepts. Experience with data warehousing and data modeling. Good To Have Skills:Experience with IBM InfoSphere Information Server. Familiarity with other ETL tools such as Informatica or Talend. Additional Information: The candidate should have a minimum of 5 years of experience in IBM InfoSphere DataStage. This position is based at our Bengaluru office. A 15 years full time education is required. Qualifications 15 years full time education

locationsIndia, Bangalore time typeFull time posted onPosted 30+ Days Ago job requisition idJR0034276 Job Title: Big Data Architect About Skyhigh Security Skyhigh Security is a dynamic, fast-paced, cloud company that is a leader in the security industry. Our mission is to protect the worlds data, and because of this, we live and breathe security. We value learning at our core, underpinned by openness and transparency. Since 2011, organizations have trusted us to provide them with a complete, market-leading security platform built on a modern cloud stack. Our industry-leading suite of products radically simplifies data security through easy-to-use, cloud-based, Zero Trust solutions that are managed in a single dashboard, powered by hundreds of employees across the world. With offices in Santa Clara, Aylesbury, Paderborn, Bengaluru, Sydney, Tokyo and more, our employees are the heart and soul of our company. Skyhigh Security Is more than a company; here, when you invest your career with us, we commit to investing in you. We embrace a hybrid work model, creating the flexibility and freedom you need from your work environment to reach your potential. From our employee recognition program, to our Blast Talks' learning series, and team celebrations (we love to have fun!), we strive to be an interactive and engaging place where you can be your authentic self. We are on these too! Follow us on and Twitter . Role Overview: The Big Data Architect will be responsible for the design, implementation, and management of the organizations big data infrastructure. The ideal candidate will have a strong technical background in big data technologies, excellent problem-solving skills, and the ability to work in a fast-paced environment. The role requires a deep understanding of data architecture, data modeling, and data integration techniques. About the Role: Design and implement scalable and efficient big data architecture solutions to meet business requirements. Develop and maintain data pipelines, ensuring the availability and quality of data. Collaborate with data scientists, data engineers, and other stakeholders to understand data needs and provide technical solutions. Lead the evaluation and selection of big data tools and technologies. Ensure data security and privacy compliance. Optimize and tune big data systems for performance and cost-efficiency. Document data architecture, data flows, and processes. Stay up-to-date with the latest industry trends and best practices in big data technologies. About You: Bachelors or Masters degree in Computer Science, Information Technology, or a related field. over all 10+ years exp with 5+ years of experience in big data architecture and engineering. Proficiency in big data technologies such as Hadoop mapredue, Spark batch and streaming, Kafka, HBase, Scala, Elastic Search and others. Experience with AWS cloud platform. Strong knowledge of data modeling, ETL processes, and data warehousing. Proficiency in programming languages such as Java, Scala, Spark Familiarity with data visualization tools and techniques. Excellent communication and collaboration skills. Strong problem-solving abilities and attention to detail. Company Benefits and Perks: We work hard to embrace diversity and inclusion and encourage everyone to bring their authentic selves to work every day. We offer a variety of social programs, flexible work hours and family-friendly benefits to all of our employees. Retirement Plans Medical, Dental and Vision Coverage Paid Time Off Paid Parental Leave Support for Community Involvement We're serious about our commitment to diversity which is why we prohibit discrimination based on race, color, religion, gender, national origin, age, disability, veteran status, marital status, pregnancy, gender expression or identity, sexual orientation or any other legally protected status.

Azure Data Engineer JOB_DESCRIPTION.SHARE.HTML CAROUSEL_PARAGRAPH JOB_DESCRIPTION.SHARE.HTML Pune, India India Enterprise IT - 22756 about our diversity, equity, and inclusion efforts and the networks ZS supports to assist our ZSers in cultivating community spaces, obtaining the resources they need to thrive, and sharing the messages they are passionate about. What you'll do: Create and maintain optimal data pipeline architecture. Identify, design, and implement internal process improvements, automating manual processes, optimizing data delivery, re-designing infrastructure for scalability. Design, develop and deploy high volume ETL pipelines to manage complex and near-real time data collection. Develop and optimize SQL queries and stored procedures to meet business requirements. Design, implement, and maintain REST APIs for data interaction between systems. Ensure performance, security, and availability of databases. Handle common database procedures such as upgrade, backup, recovery, migration, etc. Collaborate with other team members and stakeholders. Prepare documentations and specifications. What you'll bring: Bachelors degree in computer science, Information Technology, or related field 1+ years of experience SQL, TSQL, Azure Data Factory or Synapse or relevant ETL technology. Prepare documentations and specifications. Strong analytical skills (impact/risk analysis, root cause analysis, etc.) Proven ability to work in a team environment, creating partnerships across multiple levels. Demonstrated drive for results, with appropriate attention to detail and commitment. Hands-on experience with Azure SQL Database Perks & Benefits ZS offers a comprehensive total rewards package including health and well-being, financial planning, annual leave, personal growth and professional development. Our robust skills development programs, multiple career progression options and internal mobility paths and collaborative culture empowers you to thrive as an individual and global team member. We are committed to giving our employees a flexible and connected way of working. A flexible and connected ZS allows us to combine work from home and on-site presence at clients/ZS offices for the majority of our week. The magic of ZS culture and innovation thrives in both planned and spontaneous face-to-face connections. Travel Travel is a requirement at ZS for client facing ZSers; business needs of your project and client are the priority. While some projects may be local, all client-facing ZSers should be prepared to travel as needed. Travel provides opportunities to strengthen client relationships, gain diverse experiences, and enhance professional growth by working in different environments and cultures. Considering applying? At ZS, we're building a diverse and inclusive company where people bring their passions to inspire life-changing impact and deliver better outcomes for all. We are most interested in finding the best candidate for the job and recognize the value that candidates with all backgrounds, including non-traditional ones, bring. If you are interested in joining us, we encourage you to apply even if you don't meet 100% of the requirements listed above. ZS is an equal opportunity employer and is committed to providing equal employment and advancement opportunities without regard to any class protected by applicable law. To Complete Your Application Candidates must possess or be able to obtain work authorization for their intended country of employment.An on-line application, including a full set of transcripts (official or unofficial), is required to be considered. NO AGENCY CALLS, PLEASE. Find Out More At

Position Summary Delivery Director - Big Data & Cloud Data Management This position is part of the Senior leadership in data warehousing and Business Intelligence areas. Someone who can work on multiple project streams and clients for better business decision making especially in the area of Lifesciences/ Pharmaceutical domain. Functional Domain Life Sciences focusing on Pharma Commercial aspect Technology Domain Big DataCloud Data Management ( EDW/ Data Lake/ Big Data) Location Noida/Gurgaon Qualification B.Tech. or equivalent degree is a minimum criterion Job Responsibilities Lead the delivery of major engagements on a day-to-day basis, providing hands on technical leadership to the delivery team.Global program planning and execution for Data Management programs across Enterprise DWH, Data Lake, Big Data, Business Intelligence & Reporting, Master Data Management solutions. This includes setting up project plans, scopes, budgets, staffing resources, leading client workshops, creating and coordinatingfinal deliverables, providing high quality and insightful advice to our clients in terms of Cloud Data Management strategy, architecture, operating model etc.Drive data management business requirements across pharma commercial data sets in a workshop setting with client business teams and onshore counterparts.Be able to guide the team to deliver the logical and physical data models for Pharma Commercial Data Lakes and Warehouse Maintain responsibility for risk management, quality and profitability on engagements and liaise with the client lead and onshore delivery partners .Drive Clear and Timely communication across program stakeholders to ensure everyone is on the same page on the weekly progress.Must maintain high standards of quality and thoroughness. Should be able to set-up adequate controls within team to perform code reviews and monitor the quality Represent the Business Information Management (BIM) practice as a SME in cloud data management space.Coach, mentor and develop middle and junior level staff. Performance management of all the team members rolling up to the role.Develop the manager layers to be leaders of the future.Be known as a Thought Leader in a specific aspect of Information Management technology spectrum or Pharma domain.Direct the training & skill enhancement of the team, in line with pipeline opportunities Understand wider Product and service offerings of Axtria to co-ordinate these to ensure our clients get the best level of advice and support.Should be able to work on large Cloud data management deals within Life Sciences domain.Work with Vertical/Onshore teams to drive Business Development and growth for the practice Education BE/B.Tech Master of Computer Application Work Experience Candidate should have 14+ years of prior experience in delivering customer focused Cloud Data Management solution(s)Enterprise Data Warehouse, Enterprise Data Lake, Master Data Management System, Business Intelligence & Reporting solutions, IT Architecture Consulting, Cloud Platforms ( AWS/AZURE), SaaS/PaaS based solutions in the Life Science industry.Minimum of 5 years of relevant experience in Pharma domain. (Must)Should have successfully program managed/solutioned 2-3 end to end DW Cloud implementations on AWS/Redshift/Cloud in Pharma or Life Sciences Business domains (Must)Candidate must have prior hands-on working experience on big data and ETL technologies.Tech stack exposure (hands on/project mgmt. on few of these)from amongst AWS, ETL, Data modelling, Python, Qlik/Tableau/MicroStrategy, Dataiku, Databricks, Airflow, Graph DB, Full stack.Good to have working knowledge of toolsAt least 2 of the following QlikView, Qlik Sense, Tableau, MicroStrategy, Spotfire, MS PBI. Must have a very good understanding of end-to-end pharma commercial landscape covering both enterprise and syndicated data sets.Decent exposure to Business processes like alignment, market definition, segmentation, sales crediting, activity metrics calculation and Exposure on advanced analytics such as next best action implementation.Ability to handle large teams of IT professionals.Ability to lead large RFP responses.Ability to handle P&L.Ability to handle different stakeholders customers, vendors, internal teams.Strong project/program management capabilities.Strong written and verbal communication skills Behavioural Competencies Project Management Communication Attention to P&L Impact Teamwork & Leadership Motivation to Learn and Grow Lifescience Knowledge Ownership Cultural Fit Scale of resources managed Scale of revenues managed / delivered Problem solving Talent Management Capability Building / Thought Leadership Account management Technical Competencies Delivery Management- BIM/ Cloud Info Management AWS EMR Amazon Redshift Business Intelligence(BI)

As a Data Engineer at IBM, you'll play a vital role in the development, design of application, provide regular support/guidance to project teams on complex coding, issue resolution and execution. Your primary responsibilities include: Led the design and construction of new solutions using the latest technologies, always looking to add business value and meet user requirements. Strive for continuous improvements by testing the build solution and working under an agile framework. Discover and implement the latest technologies trends to maximize and build creative solutions Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Very good experience on Continuous Flow Graph tool used for point based development Design, develop, and maintain ETL processes using Ab Initio tools. Write, test, and deploy Ab Initio graphs, scripts, and other necessary components. Troubleshoot and resolve data processing issues and improve performance. Data IntegrationExtract, transform, and load data from various sources into data warehouses, operational data stores, or other target systems Work with different data formats, including structured, semi-structured, and unstructured data Preferred technical and professional experience You thrive on teamwork and have excellent verbal and written communication skills. Ability to communicate with internal and external clients to understand and define business needs, providing analytical solutions Ability to communicate results to technical and non-technical audiences

Who you areA highly skilled Data Engineer specializing in Data Modeling with experience in designing, implementing, and optimizing data structures that support the storage, retrieval and processing of data for large-scale enterprise environments. Having expertise in conceptual, logical, and physical data modeling, along with a deep understanding of ETL processes, data lake architectures, and modern data platforms. Proficient in ERwin, PostgreSQL, Apache Iceberg, Cloudera Data Platform, and Denodo. Possess ability to work with cross-functional teams, data architects, and business stakeholders ensures that data models align with enterprise data strategies and support analytical use cases effectively. What you’ll doAs a Data Engineer – Data Modeling, you will be responsible for: Data Modeling & Architecture Designing and developing conceptual, logical, and physical data models to support data migration from IIAS to Cloudera Data Lake. Creating and optimizing data models for structured, semi-structured, and unstructured data stored in Apache Iceberg tables on Cloudera. Establishing data lineage and metadata management for the new data platform. Implementing Denodo-based data virtualization models to ensure seamless data access across multiple sources. Data Governance & Quality Ensuring data integrity, consistency, and compliance with regulatory standards, including Banking/regulatory guidelines. Implementing Talend Data Quality (DQ) solutions to maintain high data accuracy. Defining and enforcing naming conventions, data definitions, and business rules for structured and semi-structured data. ETL & Data Pipeline Optimization Supporting the migration of ETL workflows from IBM DataStage to PySpark, ensuring models align with the new ingestion framework. Collaborating with data engineers to define schema evolution strategies for Iceberg tables. Ensuring performance optimization for large-scale data processing on Cloudera. Collaboration & Documentation Working closely with business analysts, architects, and developers to translate business requirements into scalable data models. Documenting data dictionary, entity relationships, and mapping specifications for data migration. Supporting reporting and analytics teams (Qlik Sense/Tableau) by providing well-structured data models. Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise 4-7 years of experience in data modeling, database design, and data engineering. Hands-on experience with ERwin Data Modeler for creating and managing data models. Strong knowledge of relational databases (PostgreSQL) and big data platforms (Cloudera, Apache Iceberg). Proficiency in SQL and NoSQL database concepts. Understanding of data governance, metadata management, and data security principles. Familiarity with ETL processes and data pipeline optimization. Strong analytical, problem-solving, and documentation skills. Preferred technical and professional experience Experience working on Cloudera migration projects. Exposure to Denodo for data virtualization and Talend DQ for data quality management. Knowledge of Kafka, Airflow, and PySpark for data processing. Familiarity with GitLab, Sonatype Nexus, and CheckMarx for CI/CD and security compliance. Certifications in Data Modeling, Cloudera Data Engineering, or IBM Data Solutions.

Who you areA highly skilled Data Engineer specializing in Data Modeling with experience in designing, implementing, and optimizing data structures that support the storage, retrieval and processing of data for large-scale enterprise environments. Having expertise in conceptual, logical, and physical data modeling, along with a deep understanding of ETL processes, data lake architectures, and modern data platforms. Proficient in ERwin, PostgreSQL, Apache Iceberg, Cloudera Data Platform, and Denodo. Possess ability to work with cross-functional teams, data architects, and business stakeholders ensures that data models align with enterprise data strategies and support analytical use cases effectively. What you’ll doAs a Data Engineer – Data Modeling, you will be responsible for: Data Modeling & Architecture Designing and developing conceptual, logical, and physical data models to support data migration from IIAS to Cloudera Data Lake. Creating and optimizing data models for structured, semi-structured, and unstructured data stored in Apache Iceberg tables on Cloudera. Establishing data lineage and metadata management for the new data platform. Implementing Denodo-based data virtualization models to ensure seamless data access across multiple sources. Data Governance & Quality Ensuring data integrity, consistency, and compliance with regulatory standards, including Banking/regulatory guidelines. Implementing Talend Data Quality (DQ) solutions to maintain high data accuracy. Defining and enforcing naming conventions, data definitions, and business rules for structured and semi-structured data. ETL & Data Pipeline Optimization Supporting the migration of ETL workflows from IBM DataStage to PySpark, ensuring models align with the new ingestion framework. Collaborating with data engineers to define schema evolution strategies for Iceberg tables. Ensuring performance optimization for large-scale data processing on Cloudera. Collaboration & Documentation Working closely with business analysts, architects, and developers to translate business requirements into scalable data models. Documenting data dictionary, entity relationships, and mapping specifications for data migration. Supporting reporting and analytics teams (Qlik Sense/Tableau) by providing well-structured data models. Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Experience in Cloudera migration projects in the banking or financial sector. Knowledge of PySpark, Kafka, Airflow, and cloud-native data processing. Experience with Talend DQ for data quality monitoring. Preferred technical and professional experience Experience in Cloudera migration projects in the banking or financial sector. Knowledge of PySpark, Kafka, Airflow, and cloud-native data processing. Experience with Talend DQ for data quality monitoring. Familiarity with graph databases (DGraph Enterprise) for data relationships. Experience with GitLab, Sonatype Nexus, and CheckMarx for CI/CD and security compliance. IBM, Cloudera, or AWS/GCP certifications in Data Engineering or Data Modeling.

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Ab Initio Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will be involved in designing, building, and configuring applications to meet business process and application requirements. Your typical day will revolve around creating innovative solutions to address various business needs and ensuring seamless application functionality. Roles & Responsibilities: Expected to be an SME Collaborate and manage the team to perform Responsible for team decisions Engage with multiple teams and contribute on key decisions Provide solutions to problems for their immediate team and across multiple teams Lead the team in implementing efficient coding practices Conduct code reviews and provide constructive feedback Stay updated on industry trends and best practices Professional & Technical Skills: Must To Have Skills: Proficiency in Ab Initio Strong understanding of ETL processes Experience with data integration and data warehousing Knowledge of data quality and data governance principles Hands-on experience in developing and maintaining applications using Ab Initio Additional Information: The candidate should have a minimum of 5 years of experience in Ab Initio This position is based at our Pune office A 15 years full-time education is required Qualification 15 years full time education

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Data Warehouse ETL Testing Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. Your typical day will involve collaborating with teams to develop innovative solutions and ensure seamless application functionality. Roles & Responsibilities: Expected to be an SME Collaborate and manage the team to perform Responsible for team decisions Engage with multiple teams and contribute on key decisions Provide solutions to problems for their immediate team and across multiple teams Lead testing efforts to ensure the quality and performance of applications Develop and execute test plans, test cases, and test scripts Identify and report defects to ensure quality assurance Professional & Technical Skills: Must To Have Skills: Proficiency in Data Warehouse ETL Testing Strong understanding of ETL processes and tools Experience in SQL querying and data validation Knowledge of data warehousing concepts and methodologies Hands-on experience with ETL testing tools and techniques Additional Information: The candidate should have a minimum of 5 years of experience in Data Warehouse ETL Testing This position is based at our Gurugram office A 15 years full-time education is required Qualification 15 years full time education

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Data Engineering Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with various teams to understand their needs, developing solutions, and ensuring that applications function seamlessly to support business operations. You will engage in problem-solving activities and contribute to the overall success of projects by leveraging your expertise in application development. Roles & Responsibilities: Expected to be an SME. Collaborate and manage the team to perform. Responsible for team decisions. Engage with multiple teams and contribute on key decisions. Provide solutions to problems for their immediate team and across multiple teams. Facilitate knowledge sharing sessions to enhance team capabilities. Monitor project progress and ensure alignment with business objectives. Professional & Technical Skills: Must To Have Skills: Proficiency in Data Engineering. Strong understanding of data modeling and ETL processes. Experience with cloud platforms such as AWS or Azure. Familiarity with data warehousing solutions and big data technologies. Ability to work with various programming languages relevant to data engineering. Additional Information: The candidate should have minimum 5 years of experience in Data Engineering. This position is based at our Bengaluru office. A 15 years full time education is required. Qualification 15 years full time education