1547 Glue Jobs - Page 5

Primary skill - AWS , Python , ETL , Pyspark , Airflow Secondary skill - SQL Experience - 7 years - 10 years Location - Pune / Mumbai / Chennai / Bangalore Strong ETL experience and hands-on expertise in AWS Glue, Airflow, Python, and SQL-based systems. This role focuses on building scalable data pipelines, performing efficient data transformations, and managing data across cloud and relational platforms. Design, develop, and maintain robust ETL workflows using AWS Glue and Airflow Write and optimize stored procedures in SQL Server and PostgreSQL Build and manage data pipelines for ingestion, transformation, and delivery Develop reusable Python scripts for data processing and validation Work...

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Python (Programming Language), AWS Aurora, PySpark, Oracle Procedural Language Extensions to SQL (PLSQL) Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will be responsible for designing, building, and configuring applications to meet business process and application requirements. Your typical day will involve collaborating with team members to develop innovative solutions and ensure seamless applic...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelor...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelor...

Skills- AWS Data Engineer Experience: 9 to 13 years Location: AIA-Pune We are seeking skilled and dynamic Cloud Data Engineers specializing in AWS, Databricks. The ideal candidate will have a strong background in data engineering, with a focus on data ingestion, transformation, and warehousing. They should also possess excellent knowledge of PySpark or Spark, and a proven ability to optimize performance in Spark job executions. Key Responsibilities: - Design, build, and maintain scalable data pipelines for a variety of cloud platforms including AWS. - Implement data ingestion and transformation processes to facilitate efficient data warehousing. - Utilize cloud services to enhance data proce...

AWS data developers with 6-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferred Skills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shift Good communication skills and can deliver independently. Mandatory Competencies Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift Big Data - Big Data - Pyspark Beh - Communication Database - Database Programming - SQL.

Skills- AWS +Pyspark Experience: 4 to 9 years Location: AIA-Pune As an AWS Data Engineer, you will design, build, and manage robust data pipelines on the AWS cloud platform. You will leverage your expertise in AWS data services and programming languages to ingest, process, transform, and store data efficiently, enabling data-driven insights and decision-making. Key Responsibilities : - Data Pipeline Development: Design, implement, and maintain scalable data pipelines using AWS services such as S3, Glue, Lambda, EMR, and Kinesis. - Data Processing and Transformation: Utilize PySpark, Spark, and SQL to perform complex data transformations and aggregations on large datasets within the AWS ecosy...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : AWS Glue Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementin...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : AWS Glue Good to have skills : Data Analysis Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and ...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Snowflake Data Warehouse Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand projec...

Primary Skills - Python , microservices and aws cloud and their services like lambda , glue , s3 , ec2 etc.

The AWS Data Engineer will be responsible for designing, building, and optimizing large-scale data pipelines and data architectures on AWS. This role involves working with cross-functional teams to deliver scalable, high-performance data solutions that power business intelligence, analytics, and machine learning initiatives. The ideal candidate will have deep hands-on expertise with AWS native data services, ETL/ELT development, and modern data engineering practices. Key Responsibilities Design and implement scalable, secure, and high-performance data architectures to support enterprise data warehousing and analytics. Develop and maintain ETL/ELT pipelines leveraging AWS services such as Glu...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : AWS Glue Good to have skills : PySpark Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implem...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : AWS Glue Good to have skills : PySpark Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implem...

About The Role Project Role : Application Designer Project Role Description : Assist in defining requirements and designing applications to meet business process and application requirements. Must have skills : Python (Programming Language) Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Designer, you will assist in defining requirements and designing applications to meet business process and application requirements. Your typical day will involve collaborating with various stakeholders to gather and analyze requirements, creating design specifications, and ensuring that the applications ...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : AWS Glue Good to have skills : PySpark Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implem...

Primary Skills: PySpark + AWS (Lambda, Athena, Glue + S3) Secondary Skills: Data Warehousing + ETL Skills Location: Pune, Bangalore, Chennai Interested can share your resume to uthirakumar.k@tekskills.in Details required Full Name as Per Pan Card : Email id - Contact number: Alternative Number and Mail ID : Total Exp in IT industry: Relevant experience (Particular skill as per JD): Current CTC ( fixed and variable) : Expected CTC (in INR): Official Notice Period: If Serving Notice Period When is your LWD: Any offers in hand?: (Y/N): Do you have any career Gap?: Current Location: Preferred Location: Reason for job change:

We are looking for a skilled Data Engineer with expertise in PySpark, AWS, and SQL to support data processing and analytical initiatives. This role involves working closely with data engineering and data science teams to build, maintain, and optimize large-scale data pipelines and integrations on AWS. The ideal candidate will be proficient in ETL processes using PySpark and SQL, with a deep understanding of cloud data infrastructure, specifically within the AWS ecosystem. Key Responsibilities : Data Pipeline Development : - Design, build, and optimize ETL pipelines using PySpark for data ingestion, transformation, and storage on AWS. - Collaborate with stakeholders to understand data require...

JD and required Skills & Responsibilities: Actively participate in all phases of the software development lifecycle, including requirements gathering, functional and technical design, development, testing, roll-out, and support. Solve complex business problems by utilizing a disciplined development methodology. Produce scalable, flexible, efficient, and supportable solutions using appropriate technologies. Analyse the source and target system data. Map the transformation that meets the requirements. Interact with the client and onsite coordinators during different phases of a project. Design and implement product features in collaboration with business and Technology stakeholders. Anticipate...

As a Senior Data Engineer, you will be responsible for designing, building, and maintaining ETL/ELT pipelines. You will integrate data from multiple sources or vendors to provide holistic insights, build and manage Data warehouse solutions, design data models, create ETL processes, and implement data quality mechanisms. Additionally, you will perform exploratory data analysis to troubleshoot data-related issues, assist in issue resolution, interact with clients, mentor juniors, and provide guidance. Key Responsibilities: - Designing, building, and maintaining ETL/ELT pipelines - Integrating data from multiple sources for comprehensive insights - Managing Data warehouse solutions and designin...

Role Overview: As a Solution Designer (Cloud Data Integration) at Barclays, you will be responsible for supporting the successful delivery of location strategy projects to plan, budget, agreed quality, and governance standards. You will spearhead the evolution of the digital landscape, driving innovation and excellence. Your role will involve harnessing cutting-edge technology to revolutionize digital offerings, ensuring unparalleled customer experiences. Key Responsibilities: - Hands-on experience working with large-scale data platforms and developing cloud solutions in the AWS data platform with a proven track record in driving business success. - Strong understanding of AWS and distribute...

You will be responsible for enhancements, new development, defect resolution, and production support of ETL development using AWS native services. Your role will involve the integration of data sets using AWS services such as Glue and Lambda functions. Additionally, you will utilize AWS SNS to send emails and alerts. Authoring ETL processes using Python and PySpark will be a key part of your responsibilities, along with ETL process monitoring using CloudWatch events. You will also be connecting with different data sources like S3 and validating data using Athena. Experience in CI/CD using GitHub Actions and proficiency in Agile methodology are essential for this role. Key Responsibilities: -...

As an experienced professional in designing, implementing, and testing Python applications, your role will involve the following key responsibilities: - Must have programming experience with Python; familiarity with Java/Scala is a plus - Experience with AWS technologies such as AppSync, Lambda, Step Functions, and Event Bridge - Solid understanding and hands-on experience with various AWS services including CloudFormation, S3, Glue, EMR/Spark, RDS, DynamoDB, Lambda, Step Functions, IAM, KMS, SM, etc. - Knowledge of modern cloud-native data warehouses like AWS Redshift, Snowflake, or Azure Synapse Analytics - Implementation of metadata solutions utilizing AWS non-relational data solutions li...

Role Proficiency: This role requires proficiency in data pipeline development including coding and testing data pipelines for ingesting wrangling transforming and joining data from various sources. Must be skilled in ETL tools such as Informatica Glue Databricks and DataProc with coding expertise in Python PySpark and SQL. Works independently and has a deep understanding of data warehousing solutions including Snowflake BigQuery Lakehouse and Delta Lake. Capable of calculating costs and understanding performance issues related to data solutions. Outcomes: Act creatively to develop pipelines and applications by selecting appropriate technical options optimizing application development mainten...

Experience: 6-8 years of hands-on experience in data engineering and architecture. Demonstrated expertise with: Palantir Foundry (Quiver pipelines, Ontology modeling, Workshop) AWS data services (S3, Glue, Redshift, Lambda, IAM, Athena) Snowflake (warehouse design, query tuning, secure sharing) Key Responsibilities Design and maintain an integrated data architecture connecting Palantir Foundry , AWS services , and Snowflake for secure and scalable data access. Drive performance optimization strategies including partitioning , clustering , caching , and materialized views . Ensure interoperability across Foundry (Quiver, Workshop, Ontology) , Snowflake schemas , and AWS S3-based data lakes . ...