1547 Glue Jobs - Page 3

Role- Data Architect Location- Pan India Year of Experience - 10 to 15 years Skills Required - Databricks, AWS/Azure/GCP Cloud, Data Architecture Job Description: 10-15 years of total experience and at least 3+ years of expertise in Cloud data warehouse technologies Azure data platform covering ADF, ADLS, Synapse, Microsoft Fabric, databricks etc. AWS data platform covering Glue, EMR, RedShift, databricks etc. At least one End-to-end AWS data platform implementation is a must covering all aspects including architecture, design, data engineering, data visualization and data governance (specifically data quality and lineage). GCP data platform covering Cloud Storage, Data Flow, Data Proc, BigQ...

Role Proficiency: This role requires proficiency in developing data pipelines including coding and testing for ingesting wrangling transforming and joining data from various sources. The ideal candidate should be adept in ETL tools like Informatica Glue Databricks and DataProc with strong coding skills in Python PySpark and SQL. This position demands independence and proficiency across various data domains. Expertise in data warehousing solutions such as Snowflake BigQuery Lakehouse and Delta Lake is essential including the ability to calculate processing costs and address performance issues. A solid understanding of DevOps and infrastructure needs is also required. Outcomes: Act creatively ...

Role Proficiency: This role requires proficiency in data pipeline development including coding and testing data pipelines for ingesting wrangling transforming and joining data from various sources. Must be adept at using ETL tools such as Informatica Glue Databricks and DataProc with coding skills in Python PySpark and SQL. Works independently and demonstrates proficiency in at least one domain related to data with a solid understanding of SCD concepts and data warehousing principles. Outcomes: Collaborate closely with data analysts data scientists and other stakeholders to ensure data accessibility quality and security across various data sources.rnDesign develop and maintain data pipelines...

Role Proficiency: This role requires proficiency in data pipeline development including coding and testing data pipelines for ingesting wrangling transforming and joining data from various sources. Must be skilled in ETL tools such as Informatica Glue Databricks and DataProc with coding expertise in Python PySpark and SQL. Works independently and has a deep understanding of data warehousing solutions including Snowflake BigQuery Lakehouse and Delta Lake. Capable of calculating costs and understanding performance issues related to data solutions. Outcomes: Act creatively to develop pipelines and applications by selecting appropriate technical options optimizing application development mainten...

As a Data Platform developer at Barclays, you'll play a crucial role in the evolution of the digital landscape, driving innovation and excellence. By harnessing cutting-edge technology, you will revolutionize digital offerings to ensure unparalleled customer experiences. You'll work collaboratively with fellow engineers, business analysts, and stakeholders to deliver technology stacks that meet business requirements and deliver quality solutions. Your role will involve solving complex technical problems that require strong analytical skills and detailed analysis. **Key Responsibilities:** - Hands-on coding experience, preferably in Python - Strong knowledge and hands-on experience of AWS dev...

As a Senior Data Engineer, your role will involve architecting, developing, and maintaining an end-to-end data ingestion framework for extracting, transforming, and loading data from diverse sources. You will use AWS services such as Glue, Lambda, EMR, ECS, EC2, and Step Functions to build scalable, resilient automated data pipelines. Your responsibilities will also include developing and implementing automated data quality checks, validation routines, and error-handling mechanisms. Additionally, you will establish comprehensive monitoring, logging, and alerting systems for data quality issues. Key Responsibilities: - Architect, develop, and maintain end-to-end data ingestion framework - Use...

As an experienced Data Engineer, you will be leading a small team of data engineers to leverage AWS native technologies such as Lambda and Glue in building a data Lakehouse environment. Your role will involve the following responsibilities: - Lead and mentor a team of data engineers to foster a collaborative and innovative environment. - Design, develop, and maintain scalable data pipelines using AWS native technologies like AWS Glue and Lambda. - Implement best practices for data management including data quality, data governance, and data security. - Ensure high standards by reviewing architecture, design, and code. - Collaborate with cross-functional teams to deliver and operate large sca...

Greetings from Tata Consultancy Services!! We are hiring for Python Developer Required Skillset: Digital: Python E2 SQL: E2 Experience :6-8 years Location : PAN INDIA Job Description: Advanced proficiency in SQL for querying and manipulating data - experience with database design and optimization Strong programming skills in Python - experience with data processing libraries and frameworks. Expert in using Github, Github Actions Good To Have: Expert in AWS Tech stack including but not limited to Lambda, Step Functions, Glue, S3, Kafka, Kinesis, RDS, EC2 etc Expertise in using AWS CDK, Terraform etc. Thanks & Regards, Ria Aarthi A

Experience: 6-9 years Location: Chennai, Bengaluru Notice Period: Immediate to 30 Days Job Description Technical Skills: Strong hands-on experience with Apache Spark, PySpark, and Scala. Proficiency in SQL and data manipulation techniques. Experience with Hadoop ecosystem tools (HDFS, Hive, YARN, etc.). Knowledge of cloud platforms (AWS, Azure, or GCP) and managed Spark services (e.g., Databricks, EMR, Glue). Familiarity with data lakehouse concepts, Delta Lake, or Iceberg is a plus. Experience with CI/CD, Git, and workflow orchestration tools (Airflow, Oozie, etc.). Understanding of data modeling, partitioning, and schema evolution strategies. Exposure to containerization (Docker, Kubernete...

About Us At TymeX, we're empowering Tyme Group's digital banking ecosystem across Asia and Africa. Our mission: build a secure, scalable, intelligent data & AI platform that delivers real-time, personalized experiences to millions of users. We are seeking a Senior Solutions Architect - Data & AI Platforms someone who blends deep technical mastery with the ability to engage directly with stakeholders, understand their business needs, and design/implement high-impact solutions. Your Role As a Senior Solutions Architect - Data & AI Platforms , you will be the trusted technical advisor to our stakeholders, guiding them through their data & AI journeys. You will represent TymeX's capabilities acr...

Dear Candidate, Looking for Skilled AWS Data Engineer, Interested candidates please find the JD below: Bachelor's Degree and 3+ years experience in the implementation of modern data ecosystems in AWS/Cloud platforms. 3+ years experience in Python, SQL. 3+ years experience in Lambda 3+ years experience in Glue 3+ years experience in Redshift, Aurora, RDS, S3 and other AWS services. Experience in Security, Policies and IAM. Location - Bengaluru Experience - 3 to 10 Years We are organizing a drive for AWS Data Engineer. We would appreciate if you would register for the same through the below mentioned link. AWS Data Engineer - Banglore Fill out form

Data Architect ?( 8+ years in data architecture) Job Summary: We're seeking a skilled Data Architect to lead the design and delivery of innovative, scalable data solutions that power our business. With deep expertise in Databricks and cloud platforms like Azure and AWS, you'll architect high-performance data systems and drive impactful analytics. If you thrive on solving complex data challenges, this is your chance to shine. Key Responsibilities: Design scalable data lakes, warehouses, and real-time streaming architectures. Build and optimize data pipelines and Delta Lake solutions using Databricks (Spark, Workflows, SQL Analytics). Develop cloud-native data platforms on Azure (Synapse, Data...

About the role: LRN is seeking a Data engineer to support our product team. You will work closely with team to develop new features and enhancements for our product. You will work independently with required support from wider technology team including BI developers, Data Engineers and Quality assurance team to deliver on requirements. . Your responsibilities will include: Analyze and organize raw data. Build data systems and pipelines. Combine raw information from different sources. Prepare data for prescriptive and predictive modelling. Build algorithms and create Proof of concepts. Explore ways to enhance data quality and reliability. Person should have relevant work experience in analyti...

As a Consultant & Senior Consultant in our Consulting team, you ll build and nurture positive working relationships with teams and clients with the intention to exceed client expectations. You ll: We are seeking experienced AWS Data Engineers to design, implement, and maintain robust data pipelines and analytics solutions using AWS services. The ideal candidate will have a strong background in AWS data services, big data technologies, and programming languages. Key Responsibilities: 1. Design and implement scalable, high-performance data pipelines using AWS services 2. Develop and optimize ETL processes using AWS Glue, EMR, and Lambda 3. Build and maintain data lakes using S3 and Delta Lake ...

Dear Candidate Greetings from TATA Consultancy Services Job Openings at TCS Skill : AWS Data Engineer Exp range: 6 yrs to 10 yrs Location : Chennai/Hyderbad/ Kochi/Kolkata//Pune Notice period : Less than 30 Pls find the Job Description below. Hands on working experience in AWS GLUE ETL tool and having good knowledge on any of the ETL tools(Informatica cloud,Talend etc Must have working experience with SQL, and databases (e.g.: Postgres, Redshift) implementing Data Models. Expertise with Python Language and Apache Spark. Have working experience in projects involving these. Strong hands on exposure to AWS Analytics services particulary Lambda,Step functions, Athena, Glue, Data-Pipelines • Unde...

Job Description SN Required Information Details 1 Role Technical Lead/Developer 2 Required Technical Skill Set Hadoop,Spark, Pyspark, Hive, Scala, AWS Desired Competencies (Technical/Behavioral Competency) Must-Have Hadoop,Spark, Pyspark, Hive, Scala Good-to-Have Agile and good communication skills SN Responsibility of / Expectations from the Role 1 Ingest data from disparate sources (Structured, unstructured and semi-structured) and develop ETL jobs using the above skills. 2 Do impact analysis and come up with estimates 3 Take responsibility for end-to-end deliverable. 4 Create Project Plan & Work on Implementation Strategy 5 Need to have comprehensive understanding on ETL concepts and Cros...

Job Summary We are seeking a skilled Cloud Data Architect(IS Specialist) to join our India CoE-Integration & Engg -CAT IT Division We are seeking a visionary Data Architect to lead the design and governance of data architecture specializing in Snowflake architecture, cloud migrations, data engineering and analytics. The incumbent would have proven expertise in designing scalable data architectures, implementing high-performance ETL/ELT pipelines and optimizing cloud data solutions for actionable business insights. Adept at leading cross-functional teams, ensuring data governance, and driving cost-efficient, secure, and compliant environments. Recognized for delivering innovative solutions th...

Strong technical acumen in AWS including expert working knowledge of AWS services such as Glue, ,EC2, ECS, Lamda, Step Functions, IAM, Athena, HUE, Presto, S3, Redshift etc. Strong technical acumen in Data Engineering enablement, and working knowledge of frameworks/languages such as Python, SPARK etc. Dremino knowledge is a plus.

JOB PURPOSE: Cat Digital Data Analytics & engineering team is looking for a talented and motivated Senior Data Scientist to help improve platform data quality by defining and implementing quality metrics, performing root cause analysis of data quality problems, and developing algorithms as well as ML/AI models to address the most challenging data quality issues. In this role, you will apply machine learning and other analytics techniques on a very large set of diverse data from IoT-connected assets and our integrated network of dealers. You will also use analytics and visualization methods to solve problems for Caterpillars internal customers. Top candidates will have prior experience in dev...

Role & responsibilities 6+ years of experience in software development, data engineering, ETL, and analytics reporting development Experience in building and maintaining data and system integrations using dimensional data modelling and optimized ETL pipelines. Proven track record of designing and implementing complex data solutions Demonstrated understanding and experience using: Python & PySpark: Ability to write efficient scripts for data transformation, and pipeline orchestration, knowledge of Spark or any distributing frameworks Knowledge of data modelling and data architecture principles Familiarity with event-driven architectures , API -based data sources , data quality validation, arc...

Role Description : As a Data Engineer, you will play a crucial role in designing and implementing data pipelines to support business intelligence and analytics initiatives. You will work closely with data analysts, data scientists, and business stakeholders to understand data requirements and create efficient data models. Key Responsibilities : - Design and implement data pipelines to extract, transform, and load data from various sources into a centralized data warehouse or data lake - Collaborate with data analysts and business stakeholders to understand data requirements and create efficient data models - Optimize data pipelines for performance, scalability, and reliability using tools li...

Location: India Position Overview Purpose & Scope: We are looking for a Data Engineer to join our Retail Analytics & Engineering team, focused on modernizing our data ecosystem by migrating legacy pipelines to Databricks and Prophecy, and driving business outcomes in planning, merchandising, and supply chain. In this role, you will work closely with Retail business users and Cloud Engineering teams to re-engineer legacy data workflows, build scalable pipelines, and deliver high-performance data products supporting retail operations. You will be responsible for both business-driven retail analytics use cases and technical platform migration and optimization, enabling our transition to a moder...

Job Description About KPMG in India KPMG entities in India are professional services firm(s). These Indian member firms are affiliated with KPMG International Limited. KPMG was established in India in August 1993. Our professionals leverage the global network of firms, and are conversant with local laws, regulations, markets and competition. KPMG has offices across India in Ahmedabad, Bengaluru, Chandigarh, Chennai, Gurugram, Jaipur, Hyderabad, Jaipur, Kochi, Kolkata, Mumbai, Noida, Pune, Vadodara and Vijayawada. KPMG entities in India offer services to national and international clients in India across sectors. We strive to provide rapid, performance-based, industry-focused and technology-e...

Your Job Data Engineer will be a part of an international team that designs, develops and delivers new applications for Koch Industries. Koch Industries is a privately held global organization with over 120,000 employees around the world, with subsidiaries involved in manufacturing, trading, and investments. Koch Global Service India (KGSI) is being developed in India to extend its IT operations, as well as act as a hub for innovation in the IT function. As KTC rapidly scales up its operations in India, its employees will get opportunities to carve out a career path for themselves within the organization. This role will have the opportunity to join on the ground floor and will play a critica...

Key Responsibilities Design, develop, and maintain Python-based data processing pipelines for on-prem and file-based systems. Work with large structured and unstructured datasets for data ingestion, transformation, and validation. Implement and optimize ETL/ELT processes, ensuring data quality, consistency, and performance. Collaborate with cross-functional teams to design end-to-end data solutions, including integration with cloud and on-premise environments. Leverage AWS services (such as S3, Lambda, Glue, Step Functions, or EC2) for data processing and automation. Participate in solution design discussions and contribute to architectural decisions. Monitor, troubleshoot, and improve exist...