988 Glue Jobs - Page 10

Role & responsibilities ETL Lead Developer- (8+ yrs-Need minimum 5 yrs Lead Exp) Mandatory Skills ETL - Datawarehouse concepts AWS, Glue SQL python SNOWFLAKE CI/CD Tools (Jenkins, GitHub), Azure, Datastage

Role & responsibilities Primary / Must to have Skills Consumer Integration, AWS Lamda, ECS, glue, cloud watch and dynamo db. Good to have Skills (Not mandate) Terraform , Github and java(good to have). Preferred candidate profile

Job Description Requirement: 5+ years of experience in the software industry Experience in working with AWS Cloud Services Exposure to at least 3+ AWS services including Glue, Lambda, EMR, Elastic Beanstalk, DocumentDB, ElasticCache (Redis), S3, Cloud Formation, Kinesis, Firehose, Redshift, Neptune, EKS*, ECS*, MCS* Strong experience in Relational Database (SQL/PostgreSQL) and data warehousing Strong experience in design/architectural patterns Experience in working on Node.JS Mandatory Skills: AWS SQL Data Warehousing Node.JS Nice to have: Experience in Apache Spark and Hadoop Experience in React.JS/Angular.JS Knowledge on Android Studio, Blue stack Emulator / Simulator Knowledge in NoSQL Da...

Join us as a Solution Architect at Barclays, where you will play a crucial role in supporting the successful delivery of location strategy projects. Your responsibilities will include ensuring projects are completed within planned budgets, meeting quality standards, and adhering to governance procedures. You will lead the evolution of our digital landscape, driving innovation and excellence to enhance our digital offerings and provide exceptional customer experiences. To excel in this role, you should possess expertise in the following areas: - Advanced Ab>Initio and ETL Experience - AWS Architecture, Glue, S3, Iceberg - ETL and Warehouse Architecture - SQL and RDBMS Knowledge - Unix, Linux,...

Overview Annalect is currently seeking a data engineering lead to join our technology team. In this role you will be building data pipelines and developing data set processes. We are looking for people who have a shared passion for technology, design & development, data, and fusing these disciplines together to build cool things. In this role, you will lead teams working on one or more software and data products in the Annalect Engineering Team. You will participate in technical architecture, design and development of software products as well as research and evaluation of new technical solutions. You will also help us drive the vision forward for data engineering projects by helping us exte...

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Responsibilities: Design and implement the data modeling, data ingestion and data processing for various datasets Design, develop and maintain ETL Framework for various new data source Develop data ingestion using AWS Glue/ EMR, data pipeline using PySpark, Python and Databricks. Build orchestration workflow using Airflow & databricks Job workflow Develop and execute adhoc data ingestion to support business analytics. Proactively interact with vendors for any questions and...

Design, implement, and maintain data pipelines for processing large datasets, ensuring data availability, quality, and efficiency for machine learning model training and inference. Collaborate with data scientists to streamline the deployment of machine learning models, ensuring scalability, performance, and reliability in production environments. Develop and optimize ETL (Extract, Transform, Load) processes, ensuring data flow from various sources into structured data storage systems. Automate ML workflows using ML Ops tools and frameworks (e.g., Kubeflow, MLflow, TensorFlow Extended (TFX)). Ensure effective model monitoring, versioning, and logging to track performance and metrics in a pro...

Expert in Python(5+ years) Expert in Django or any similar frameworks (5+ years) Experience (2+ years) inTypeScript, JavaScript and JS frameworks (Angular > 2 with Angular Material) Good knowledge of RDMS (preferably Postgres) Experience and sound knowledge of AWS services (ECS, lambda, deployment pipelines etc). Excellent written and verbal communication skills. Very good analytical and problem-solving skills. Ability to pick up new technologies. Write clean, maintainable and efficient code. Willingness to learn and understand the business domain. Mandatory Competencies Programming Language - Python - Django Beh - Communication User Interface - Typescript - Typescript User Interface - JavaS...

Project description We are looking for a skilled Data Engineer with strong experience in AWS and Apache Airflow to join a dynamic data team. You will be responsible for building and maintaining scalable data pipelines, orchestrating workflows, and ensuring data quality and availability across platforms. esponsibilities Data Pipeline DevelopmentDesign, build, and maintain robust, scalable, and efficient ETL/ELT pipelines for ingesting, transforming, and loading data from various sources into our data lake and data warehouse. AWS ExpertiseDevelop and manage data solutions using a wide range of AWS services, including but not limited to StorageS3 (for data lakes), RDS (PostgreSQL, MySQL), Redsh...

Project description We are looking for a skilled Data Engineer with strong experience in AWS and Apache Airflow to join a dynamic data team. You will be responsible for building and maintaining scalable data pipelines, orchestrating workflows, and ensuring data quality and availability across platforms. esponsibilities Data Pipeline DevelopmentDesign, build, and maintain robust, scalable, and efficient ETL/ELT pipelines for ingesting, transforming, and loading data from various sources into our data lake and data warehouse. AWS ExpertiseDevelop and manage data solutions using a wide range of AWS services, including but not limited to StorageS3 (for data lakes), RDS (PostgreSQL, MySQL), Redsh...

Project description We are looking for a skilled Data Engineer with strong experience in AWS and Apache Airflow to join a dynamic data team. You will be responsible for building and maintaining scalable data pipelines, orchestrating workflows, and ensuring data quality and availability across platforms. esponsibilities Data Pipeline DevelopmentDesign, build, and maintain robust, scalable, and efficient ETL/ELT pipelines for ingesting, transforming, and loading data from various sources into our data lake and data warehouse. AWS ExpertiseDevelop and manage data solutions using a wide range of AWS services, including but not limited to StorageS3 (for data lakes), RDS (PostgreSQL, MySQL), Redsh...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelor...

Key Responsibilities Lead the architecture and design of Databricks-based data lakehouse platforms. Implement Delta Lakehouse patterns (time travel, schema evolution, CDC). Drive adoption of Delta Live Tables, Auto Loader, Unity Catalog for enterprise-scale governance and automation. Optimize Spark workloads and Photon-powered queries for performance and cost efficiency. Oversee data governance, RBAC, lineage, and compliance via Unity Catalog. Enable real-time pipelines using Structured Streaming (Kafka, Event Hub, Kinesis). Partner with business teams to define data strategy, standards, and best practices . Mentor junior engineers, perform code reviews, and drive engineering excellence. Int...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

Requirements 5 to 10 years of BI experience Medium to expert level in SQL (Advanced/ Complex Queries) Knowledge of ETL concepts and experience in any ETL/Data Integration tool such as Informatica, ODI, Pentaho or other similar tools. Familiarity with one or more reporting tools such as Microstrategy / PowerBI / Tableau, Jaspersoft or other similar tools. Knowledge on Python & Cloud infrastructure Exposure to AWS Data Integration technologies such as Airflow, Glue is preferred but not mandatory. Programming experience in Java/Scala is preferred but not mandatory. Proven abilities to take initiative and be innovative Analytical mind with a problem-solving aptitude Education Must Have B. Tech /...

Job Summary: We are seeking a skilled Cloud Migration Consultant with hands-on experience in assessing and migrating complex applications from AWS to Azure. The ideal candidate will work closely with Microsoft business units, participating in application intake, assessment, and migration planning. This role includes creating migration artifacts, leading client interactions, and supporting application modernization initiatives on Azure with occasional AWS exposure. Key Responsibilities: Assess application readiness by documenting architecture, dependencies, and migration strategies. Conduct interviews with stakeholders and generate discovery insights using tools like Azure Migrate, CloudockIt...

Role Description: As a Senior Cloud Data Platform (AWS) Specialist at Incedo, you will be responsible for designing, deploying and maintaining cloud-based data platforms on the AWS platform. You will work with data engineers, data scientists and business analysts to understand business requirements and design scalable, reliable and cost-effective solutions that meet those requirements. Roles & Responsibilities: Designing, developing and deploying cloud-based data platforms using Amazon Web Services (AWS) Integrating and processing large amounts of structured and unstructured data from various sources Implementing and optimizing ETL processes and data pipelines Developing and maintaining secu...

Role & responsibilities Build and deploy data platforms, data warehouses, and big data solutions across industries (BFSI, Manufacturing, Healthcare, eCommerce, IoT, Digital Twin, etc) Integrating, transforming, and consolidating data from various structured and unstructured data systems. Expert in data ingestion, transformation, storage, and analysis, often using Azure services and migration from legacy on-premise services Essential skills include SQL, Python, R and knowledge of ETL/ELT processes and big data technologies like Apache Spark, Scala, PySpark. Maintain data integrity, resolve data-related issues, and ensure the reliability and performance of data solutions Work with stakeholders...

Role & responsibilities As a Data Engineering Trainer , your key responsibilities will include delivering high-quality technical training and mentoring students to become job-ready data engineers. You are expected to lead with industry knowledge, hands-on expertise, and strong mentoring skills. Deliver Technical Sessions: Teach Python, SQL, PySpark/Spark, AWS services, Azure, and ApacheAirflow strictly following the published syllabus. Create Learning Assets: Build concise slide decks, handson labs, assignments, and realworld miniprojects. Mentor & Support Learners: Hold doubtclearing hours, code reviews, and careerprep mock interviews. Assess Progress: Design quizzes, grade submissions and ...

We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorgan Chase within Asset and Wealth Management, you play a crucial role in an agile team dedicated to improving, developing, and providing reliable, cutting-edge technology solutions that are secure, stable, and scalable. As a key technical contributor, you are tasked with implementing essential technology solutions across diverse technical domains within various business functions to support the firm's strategic goals. Job responsibilities Executes creative software solutions, design, development, and technical troubleshooting with ability...

As a Data Engineer, you will design and implement data pipelines and integrations across cloud platforms to support AI and GenAI workloads. You’ll work closely with Data Scientists and ML Engineers to enable GenAI-powered applications through clean, secure, and optimized data flows. Key Responsibilities - Data Engineering Build and maintain ETL/ELT pipelines for structured, semi-structured, and unstructured data. Work with data warehouses/lakehouses (Snowflake, BigQuery, Databricks, Redshift). Develop real-time streaming pipelines using Kafka, Spark, or Flink. Ensure data quality, validation, and error handling. Prepare and manage data pipelines to feed LLMs and GenAI models. Work with vecto...

Job Summary: We are seeking a skilled Cloud Migration Consultant with hands-on experience in assessing and migrating complex applications from AWS to Azure. The ideal candidate will work closely with Microsoft business units, participating in application intake, assessment, and migration planning. This role includes creating migration artifacts, leading client interactions, and supporting application modernization initiatives on Azure with occasional AWS exposure. Key Responsibilities: Assess application readiness by documenting architecture, dependencies, and migration strategies. Conduct interviews with stakeholders and generate discovery insights using tools like Azure Migrate, CloudockIt...

Job Summary: We are seeking a skilled Cloud Migration Consultant with hands-on experience in assessing and migrating complex applications from AWS to Azure. The ideal candidate will work closely with Microsoft business units, participating in application intake, assessment, and migration planning. This role includes creating migration artifacts, leading client interactions, and supporting application modernization initiatives on Azure with occasional AWS exposure. Key Responsibilities: Assess application readiness by documenting architecture, dependencies, and migration strategies. Conduct interviews with stakeholders and generate discovery insights using tools like Azure Migrate, CloudockIt...

Role Description: As a Senior Cloud Data Platform (AWS) Specialist at Incedo, you will be responsible for designing, deploying and maintaining cloud-based data platforms on the AWS platform. You will work with data engineers, data scientists and business analysts to understand business requirements and design scalable, reliable and cost-effective solutions that meet those requirements. Roles & Responsibilities: Designing, developing and deploying cloud-based data platforms using Amazon Web Services (AWS) Integrating and processing large amounts of structured and unstructured data from various sources Implementing and optimizing ETL processes and data pipelines Developing and maintaining secu...