390 Glue Jobs - Page 16

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Developed the Pysprk code for AWS Glue jobs and for EMR.. Worked on scalable distributed data system using Hadoop ecosystem in AWS EMR, MapR distribution.. Developed Python and pyspark programs for data analysis.. Good working experience with python to develop Custom Framework for generating of rules (just like rules engine). Developed Hadoop streaming Jobs using python for integrating python API supported applications.. Developed Python code to gather the data from HBase and designs the solution to implement using Pyspark. Apache Spark DataFrames/RDD's were used to apply business transformations and utilized Hive Context objects to perform read/write operations.. Re - write some Hive queries to Spark SQL to reduce the overall batch time Preferred technical and professional experience Understanding of Devops. Experience in building scalable end-to-end data ingestion and processing solutions Experience with object-oriented and/or functional programming languages, such as Python, Java and Scala

Hiring Data Engineer with expertise in AWS (Redshift, Glue), Spark, SQL, and Airflow to build scalable data pipelines, optimize ETL workflows, and process real-time streaming data. Experience in CI/CD, MLFlow, and Agile/Scrum preferred. Required Candidate profile Immediate joiners welcome!

Responsibilities As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developing streaming pipelines Experience to work with Hadoop / AWS eco system components to implement scalable solutions to meet the ever-increasing data volumes, using big data/cloud technologies Apache Spark, Kafka, any Cloud computing etc Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Minimum 4+ years of experience in Big Data technologies with extensive data engineering experience in Spark / Python or Scala ; Minimum 3 years of experience on Cloud Data Platforms on AWS; Experience in AWS EMR / AWS Glue / DataBricks, AWS RedShift, DynamoDB Good to excellent SQL skills Exposure to streaming solutions and message brokers like Kafka technologies Preferred technical and professional experience Certification in AWS and Data Bricks or Cloudera Spark Certified developers

Responsibilities As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developing streaming pipelines Experience to work with Hadoop / AWS eco system components to implement scalable solutions to meet the ever-increasing data volumes, using big data/cloud technologies Apache Spark, Kafka, any Cloud computing etc Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Total 5 - 7+ years of experience in Data Management (DW, DL, Data Platform, Lakehouse) and Data Engineering skills Minimum 4+ years of experience in Big Data technologies with extensive data engineering experience in Spark / Python or Scala. Minimum 3 years of experience on Cloud Data Platforms on AWS; Exposure to streaming solutions and message brokers like Kafka technologies. Experience in AWS EMR / AWS Glue / DataBricks, AWS RedShift, DynamoDB Good to excellent SQL skills Preferred technical and professional experience Certification in AWS and Data Bricks or Cloudera Spark Certified developers

Responsibilities As a senior SAP Consultant, you will serve as a client-facing practitioner working collaboratively with clients to deliver high-quality solutions and be a trusted business advisor with deep understanding of SAP Accelerate delivery methodology or equivalent and associated work products. You will work on projects that assist clients in integrating strategy, process, technology, and information to enhance effectiveness, reduce costs, and improve profit and shareholder value. There are opportunities for you to acquire new skills, work across different disciplines, take on new challenges, and develop a comprehensive understanding of various industries. Your primary responsibilities include:Strategic SAP Solution Focus:Working across technical design, development, and implementation of SAP solutions for simplicity, amplification, and maintainability that meet client needs. Comprehensive Solution Delivery:Involvement in strategy development and solution implementation, leveraging your knowledge of SAP and working with the latest technologies. Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Total 5 - 7+ years of experience in Data Management (DW, DL, Data Platform, Lakehouse) and Data Engineering skills Minimum 4+ years of experience in Big Data technologies with extensive data engineering experience in Spark / Python or Scala. Minimum 3 years of experience on Cloud Data Platforms on AWS; Exposure to streaming solutions and message brokers like Kafka technologies. Experience in AWS EMR / AWS Glue / DataBricks, AWS RedShift, DynamoDB Good to excellent SQL skills Preferred technical and professional experience Certification in AWS and Data Bricks or Cloudera Spark Certified developers

High-level design proficiency following UML / C4 / ArchiMate. Excellent knowledge of Core Java, AWS, and JavaScript. Knowing Postgres, and AWS is Mandatory. Working knowledge of Scala, GLUE, and Spark.is an added advantage

Urgent Hiring for AWS Data Analyst/Data Engineer Location- Pan INDIA/ Bangalore preferred Exp range 8+ years Shift Timings : 2-11 PM IST JOB DESCRIPTION--- For Data Analyst - AWS Athena, AWS Redshift and very strong SQL are must AWS Data Analyst JD Experience : 4-8 years of experience as a Data Analyst, with a focus on data analysis, reporting, and SQL-based querying. SQL Expertise : Strong proficiency in SQL, with the ability to write complex queries, optimize performance, and work with large datasets. AWS Services : Familiarity with AWS services such as Athena for query execution, Glue for ETL processes, and Redshift for data warehousing. Data Modeling : Understanding of data modeling principles and experience in designing and implementing efficient data structures. ETL Processes : Hands-on experience with ETL processes, including data extraction, transformation, and loading from various sources. Data Quality and Validation : Skilled in data validation, ensuring data accuracy and integrity, and resolving data discrepancies. Analytical Skills : Strong analytical mindset, with the ability to derive actionable insights from complex data and support decision-making. Communication and Documentation : Excellent communication skills to convey insights effectively to stakeholders, along with strong documentation practices for data processes. Added advantage Data Visualization : Experience with data visualization tools, such as Tableau, QuickSight to generate insightful dashboards and reports.

Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : AWS BigData Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will analyze, design, code, and test multiple components of application code across one or more clients. You will perform maintenance, enhancements, and/or development work. Your typical day will involve analyzing requirements, designing solutions, writing code, and conducting testing to ensure the quality of the application. You will collaborate with cross-functional teams and contribute to key decisions, ensuring the successful delivery of projects. Roles & Responsibilities: Expected to be an SME, collaborate, and manage the team to perform. Responsible for team decisions. Engage with multiple teams and contribute to key decisions. Provide solutions to problems for their immediate team and across multiple teams. Conduct code reviews and provide feedback to team members. Participate in design discussions and propose innovative solutions. Troubleshoot and debug application issues. Stay updated with the latest technologies and industry trends. Mentor junior team members and provide guidance. Ensure adherence to coding standards and best practices. Professional & Technical Skills: Must To Have Skills:Proficiency in AWS BigData. Experience with data processing frameworks like Apache Spark or Hadoop. Strong understanding of distributed computing and parallel processing. Hands-on experience with AWS services like S3, EMR, Glue, and Redshift. Solid knowledge of SQL and NoSQL databases. Experience with data warehousing and data modeling concepts. Additional Information: The candidate should have a minimum of 5 years of experience in AWS BigData. This position is based at our Chennai office. A 15 years full-time education is required. Qualifications 15 years full time education

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : PySpark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :The ideal candidate will work in a team environment that demands technical excellence, whose members are expected to hold each other accountable for the overall success of the end product. Focus for this team is on the delivery of innovative solutions to complex problems, but also with a mind to drive simplicity in refining and supporting of the solution by others About The Role :& Responsibilities: Be accountable for delivery of business functionality. Work on the AWS cloud to migrate/re-engineer data and applications from on premise to cloud. Responsible for engineering solutions conformant to enterprise standards, architecture, and technologies Provide technical expertise through a hands-on approach, developing solutions that automate testing between systems. Perform peer code reviews, merge requests and production releases. Implement design/functionality using Agile principles. Proven track record of quality software development and an ability to innovate outside of traditional architecture/software patterns when needed. A desire to collaborate in a high-performing team environment, and an ability to influence and be influenced by others. Have a quality mindset, not just code quality but also to ensure ongoing data quality by monitoring data to identify problems before they have business impact. Be entrepreneurial, business minded, ask smart questions, take risks, and champion new ideas. Take ownership and accountability. Experience Required:3 to 5 years of experience in application program development Experience Desired: Knowledge and/or experience with healthcare information domains. Documented experience in a business intelligence or analytic development role on a variety of large-scale projects. Documented experience working with databases larger than 5TB and excellent data analysis skills. Experience with TDD/BDD Experience working with SPARK and real time analytic frameworks Education and Training Required:Bachelor's degree in Engineering, Computer Science Primary Skills: PYTHON, Databricks, TERADATA, SQL, UNIX, ETL, Data Structures, Looker, Tableau, GIT, Jenkins, RESTful & GraphQL APIs. AWS services such as Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, S3, VPC, EC2, RDS, IAM Additional Skills: Ability to rapidly prototype and storyboard/wireframe development as part of application design. Write referenceable and modular code. Willingness to continuously learn & share learnings with others. Ability to communicate design processes, ideas, and solutions clearly and effectively to teams and clients. Ability to manipulate and transform large datasets efficiently. Excellent troubleshooting skills to root cause complex issues Qualifications 15 years full time education

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : PySpark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :The ideal candidate will work in a team environment that demands technical excellence, whose members are expected to hold each other accountable for the overall success of the end product. Focus for this team is on the delivery of innovative solutions to complex problems, but also with a mind to drive simplicity in refining and supporting of the solution by others About The Role :& Responsibilities: Be accountable for delivery of business functionality. Work on the AWS cloud to migrate/re-engineer data and applications from on premise to cloud. Responsible for engineering solutions conformant to enterprise standards, architecture, and technologies Provide technical expertise through a hands-on approach, developing solutions that automate testing between systems. Perform peer code reviews, merge requests and production releases. Implement design/functionality using Agile principles. Proven track record of quality software development and an ability to innovate outside of traditional architecture/software patterns when needed. A desire to collaborate in a high-performing team environment, and an ability to influence and be influenced by others. Have a quality mindset, not just code quality but also to ensure ongoing data quality by monitoring data to identify problems before they have business impact. Be entrepreneurial, business minded, ask smart questions, take risks, and champion new ideas. Take ownership and accountability. Experience Required:3 to 5 years of experience in application program development Experience Desired: Knowledge and/or experience with healthcare information domains. Documented experience in a business intelligence or analytic development role on a variety of large-scale projects. Documented experience working with databases larger than 5TB and excellent data analysis skills. Experience with TDD/BDD Experience working with SPARK and real time analytic frameworks Education and Training Required:Bachelor's degree in Engineering, Computer Science Primary Skills: PYTHON, Databricks, TERADATA, SQL, UNIX, ETL, Data Structures, Looker, Tableau, GIT, Jenkins, RESTful & GraphQL APIs. AWS services such as Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, S3, VPC, EC2, RDS, IAM Additional Skills: Ability to rapidly prototype and storyboard/wireframe development as part of application design. Write referenceable and modular code. Willingness to continuously learn & share learnings with others. Ability to communicate design processes, ideas, and solutions clearly and effectively to teams and clients. Ability to manipulate and transform large datasets efficiently. Excellent troubleshooting skills to root cause complex issues Qualifications 15 years full time education

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Python (Programming Language) Good to have skills : Oracle Procedural Language Extensions to SQL (PLSQL), AWS Architecture Minimum 3 year(s) of experience is required Educational Qualification : Any technical graduation Summary :As an Application Developer, you will be responsible for designing, building, and configuring applications to meet business process and application requirements using Python. Your typical day will involve working with Oracle Procedural Language Extensions to SQL (PLSQL), AWS Architecture, and other related technologies to develop and maintain applications. Key Responsibilities Design and implementation of end to end with Python in AWS environment. Develop node.js and python code in AWS environment. Create an inspiring team environment with an open communication culture.(For Leads) Monitor team performance and report on metrics (For leads) Discover training needs and provide coaching (For leads) Architecting pilots and proofs-of-concept effort to spur innovation. Working in all stages of the development lifecycle Automation of manual data object creation and test cases (For Leads) Ask smart questions, collaborate, team up, take risks, and champion new ideas (For Leads) Job Description/Skills: Strong hands-on experience in solutioning AWS components. Experience in CI/CD and DevOps pipeline Experience in DevOps Tools and development model Develop node.js and python code in AWS environment. Experience working in AWS components (Step Function, Lambda, EventBridge, S3, SNS, SQS, RDS, Glue, IAM, VPC, Secret Manager, CloudWatch, DynamoDB) Experience in with different workflows of version control like git / bit bucket Experience in code coverage and fixing sonar issues Good knowledge of CI/CD pipelines using AWS/OpenShift Good to have front end UI experience with react JS / Angular Minimum 1 Experience in Agile methodology Deep understanding of database concepts and design for SQL (primarily) and NoSQL (secondarily) -- schema design, optimization, scalability, etc. Good experience with git software version control and good understanding of code branching strategies and organization for code reuseWilling to work in B shift Qualification Any technical graduation

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Python (Programming Language) Good to have skills : Oracle Procedural Language Extensions to SQL (PLSQL) Minimum 3 year(s) of experience is required Educational Qualification : Any graduation Summary :As an Application Developer, you will be responsible for designing, building, and configuring applications to meet business process and application requirements using Python. Your typical day will involve working with Oracle Procedural Language Extensions to SQL (PLSQL) and collaborating with cross-functional teams to deliver impactful data-driven solutions. Key Responsibilities Design and implementation of end to end with Python in AWS environment. Develop node.js and python code in AWS environment. Create an inspiring team environment with an open communication culture.(For Leads) Monitor team performance and report on metrics (For leads) Discover training needs and provide coaching (For leads) Architecting pilots and proofs-of-concept effort to spur innovation. Working in all stages of the development lifecycle Automation of manual data object creation and test cases (For Leads) Ask smart questions, collaborate, team up, take risks, and champion new ideas (For Leads) Job Description/Skills: Strong hands-on experience in solutioning AWS components. Experience in CI/CD and DevOps pipeline Experience in DevOps Tools and development model Develop node.js and python code in AWS environment. Experience working in AWS components (Step Function, Lambda, EventBridge, S3, SNS, SQS, RDS, Glue, IAM, VPC, Secret Manager, CloudWatch, DynamoDB) Experience in with different workflows of version control like git / bit bucket Experience in code coverage and fixing sonar issues Good knowledge of CI/CD pipelines using AWS/OpenShift Good to have front end UI experience with react JS / Angular Minimum 1 Experience in Agile methodology Deep understanding of database concepts and design for SQL (primarily) and NoSQL (secondarily) -- schema design, optimization, scalability, etc. Good experience with git software version control and good understanding of code branching strategies and organization for code reuse Additional Information: The candidate should have a minimum of 3 years of experience in Python. The ideal candidate will possess a strong educational background in computer science or a related field. This position is based at our Hyderabad office.Resource is willing to work in B shift Qualification Any graduation

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : PySpark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :The ideal candidate will work in a team environment that demands technical excellence, whose members are expected to hold each other accountable for the overall success of the end product. Focus for this team is on the delivery of innovative solutions to complex problems, but also with a mind to drive simplicity in refining and supporting of the solution by others Job Description & Responsibilities: Be accountable for delivery of business functionality. Work on the AWS cloud to migrate/re-engineer data and applications from on premise to cloud. Responsible for engineering solutions conformant to enterprise standards, architecture, and technologies Provide technical expertise through a hands-on approach, developing solutions that automate testing between systems. Perform peer code reviews, merge requests and production releases. Implement design/functionality using Agile principles. Proven track record of quality software development and an ability to innovate outside of traditional architecture/software patterns when needed. A desire to collaborate in a high-performing team environment, and an ability to influence and be influenced by others. Have a quality mindset, not just code quality but also to ensure ongoing data quality by monitoring data to identify problems before they have business impact. Be entrepreneurial, business minded, ask smart questions, take risks, and champion new ideas. Take ownership and accountability. Experience Required: 3 to 5 years of experience in application program development Experience Desired: Knowledge and/or experience with healthcare information domains. Documented experience in a business intelligence or analytic development role on a variety of large-scale projects. Documented experience working with databases larger than 5TB and excellent data analysis skills. Experience with TDD/BDD Experience working with SPARK and real time analytic frameworks Education and Training Required: Bachelor's degree in Engineering, Computer Science Primary Skills: PYTHON, Databricks, TERADATA, SQL, UNIX, ETL, Data Structures, Looker, Tableau, GIT, Jenkins, RESTful & GraphQL APIs. AWS services such as Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, S3, VPC, EC2, RDS, IAM Additional Skills: Ability to rapidly prototype and storyboard/wireframe development as part of application design. Write referenceable and modular code. Willingness to continuously learn & share learnings with others. Ability to communicate design processes, ideas, and solutions clearly and effectively to teams and clients. Ability to manipulate and transform large datasets efficiently. Excellent troubleshooting skills to root cause complex issues Qualification 15 years full time education

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : AWS Glue Good to have skills : NA Minimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Summary:As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. You will be responsible for overseeing the entire application development process and ensuring its successful implementation. This role requires strong leadership skills and the ability to effectively communicate with stakeholders and team members. Roles & Responsibilities:- Expected to perform independently and become an SME.- Required active participation/contribution in team discussions.- Contribute in providing solutions to work-related problems.- Lead the design, development, and implementation of applications.- Act as the primary point of contact for all application-related matters.- Collaborate with stakeholders to gather requirements and understand business needs.- Provide technical guidance and mentorship to the development team.- Ensure the successful delivery of high-quality applications.- Identify and mitigate risks and issues throughout the development process. Professional & Technical Skills:- Must To Have Skills:Proficiency in AWS Glue.- Strong understanding of cloud computing concepts and architecture.- Experience with AWS services such as S3, Lambda, and Glue.- Hands-on experience with ETL (Extract, Transform, Load) processes.- Familiarity with data warehousing and data modeling concepts.- Good To Have Skills:Experience with AWS Redshift.- Knowledge of SQL and database management systems.- Experience with data integration and data migration projects. Additional Information:- The candidate should have a minimum of 2 years of experience in AWS Glue.- This position is based at our Bengaluru office.- A 15 years full-time education is required. Qualifications 15 years full time education

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Python (Programming Language) Good to have skills : Oracle Procedural Language Extensions to SQL (PLSQL), AWS Architecture Minimum 5 year(s) of experience is required Educational Qualification : Any technical graduation Summary :As an Application Developer, you will be responsible for designing, building, and configuring applications to meet business process and application requirements using Python. Your typical day will involve working with Oracle Procedural Language Extensions to SQL (PLSQL) and AWS Architecture to develop and maintain applications. Key Responsibilities Design and implementation of end to end with Python in AWS environment. Develop node.js and python code in AWS environment. Create an inspiring team environment with an open communication culture.(For Leads) Monitor team performance and report on metrics (For leads) Discover training needs and provide coaching (For leads) Architecting pilots and proofs-of-concept effort to spur innovation. Working in all stages of the development lifecycle Automation of manual data object creation and test cases (For Leads) Ask smart questions, collaborate, team up, take risks, and champion new ideas (For Leads) Job Description/Skills: Strong hands-on experience in solutioning AWS components. Experience in CI/CD and DevOps pipeline Experience in DevOps Tools and development model Develop node.js and python code in AWS environment. Experience working in AWS components (Step Function, Lambda, EventBridge, S3, SNS, SQS, RDS, Glue, IAM, VPC, Secret Manager, CloudWatch, DynamoDB) Experience in with different workflows of version control like git / bit bucket Experience in code coverage and fixing sonar issues Good knowledge of CI/CD pipelines using AWS/OpenShift Good to have front end UI experience with react JS / Angular Minimum 1 Experience in Agile methodology Deep understanding of database concepts and design for SQL (primarily) and NoSQL (secondarily) -- schema design, optimization, scalability, etc. Good experience with git software version control and good understanding of code branching strategies and organization for code reuseWilling to work in B shift Qualifications Any technical graduation