1564 Glue Jobs - Page 24

Dear Candidate Greetings from TATA Consultancy Services Job Openings at TCS Skill - AWS Data Engineer - Redshift, Pyspark, Glue Exp range - 5 yrs - 8yrs Location- Chennai Notice period 30 days Pls find the Job Description below. Good hands-on experience in Python programming and Pyspark Data Engineering experience using AWS core services (Lambda, Glue, EMR and RedShift) Required skill set- SQL, Airflow • Must – Have Experience with snowflake or Hive or AWS S3 Responsibility – Will be accountable for build/test complex data pipelines (batch and near real time) • Expectation – Readable documentation of all the components being develop Experience in writing SQLs and stored procedures Working ex...

The Modern Data Engineer is responsible for designing, implementing, and maintaining scalable data architectures using cloud technologies, primarily on AWS, to support our next evolutionary stage of the Investment Process. They build robust data pipelines, optimize data storage, and access patterns, and ensure data quality while collaborating across engineering teams to deliver high-value data products Core Technical Skills Overall, 3 to 5 years of relevant experience in below skills Cloud Platforms: Proficient with cloud-based data platforms (Snowflake, data lakehouse architecture) AWS Ecosystem : Strong knowledge of AWS services including Lambda, Glue, and S3 Streaming Architecture : Under...

10-14 years experienced Project cum Technical Manager with 3-4 years of project management experience Experience in handling and managing end to end project taking complete ownership Good understanding of ETL and Data Warehousing concepts along with any cloud (AWS/Azure) data services Experience in carrying out estimations, proposal writing, resource planning and loading, client presentations Delegating, tracking, and managing project tasks with project team ensuring productivity and effective utilization Experience in status reporting, risk management, client handling and to use any project management tool Experience with private and public cloud architectures, pros/cons, and migration cons...

Introduction to the Role: Are you passionate about unlocking the power of data to drive innovation and transform business outcomes? Join our cutting-edge Data Engineering team and be a key player in delivering scalable, secure, and high-performing data solutions across the enterprise. As aData Engineer, you will play a central role in designing and developing modern data pipelines and platforms that support data-driven decision-making and AI-powered products. With a focus onPython,SQL,AWS,PySpark, andDatabricks, you'll enable the transformation of raw data into valuable insights by applying engineering best practices in a cloud-first environment. We are looking for a highly motivated profess...

7+ years of experience in data engineering or equivalent technical role. 5+ years of hands-on experience with AWS Cloud Development and DevOps. Strong expertise in SQL , data modeling , and ETL/ELT pipelines . Deep experience with Oracle (PL/SQL, performance tuning, data extraction). Proficiency in Python and/or Scala for data processing tasks. Strong knowledge of cloud infrastructure (networking, security, cost optimization). Experience with infrastructure as code (Terraform). Familiarity with CI/CD pipelines and DevOps tooling (e.g., Jenkins, GitHub Actions). Roles and Responsibilities Data Engineering & Architecture Design, build, and maintain scalable data pipelines and data products. De...

Project description Our client is a leading global Financial markets data provider runs a number of change programs to deliver of high-quality software that connects Financial Markets across the globe in a real-time, high frequency and low-latency data management chain. The projects are technically challenging in a very engaging environment making the most of cutting-edge technologies. Responsibilities Design, build, and maintain scalable ETL/ELT data pipelines to support analytics, reporting, and machine learning use cases. Develop and optimize data models and warehouse structures in Snowflake to ensure high performance and reliability. Collaborate with data analysts, data scientists, and b...

Project description Our client is a leading global Financial markets data provider runs a number of change programs to deliver of high-quality software that connects Financial Markets across the globe in a real-time, high frequency and low-latency data management chain. The projects are technically challenging in a very engaging environment making the most of cutting-edge technologies. Responsibilities Design, build, and maintain scalable ETL/ELT data pipelines to support analytics, reporting, and machine learning use cases. Develop and optimize data models and warehouse structures in Snowflake to ensure high performance and reliability. Collaborate with data analysts, data scientists, and b...

Project description Support one of the top Australian banks as they seek to modernise their data and analytics platform. You will be working directly with IT and business stakeholders in Data and Platform team to implement banks data strategy to become the best AI bank of the world. Responsibilities Create technology blueprints and engineering roadmaps for multi-year data transformational programs. knowledgeable of architectural patterns, cloud-native solutions on AWS, microservices architecture, solutions integration, and containerisation. Extensive knowledge of AWS services, particularly those related to data storage and processing, including S3, RDS, Redshift, DataZone, and Glue. Expert i...

We are hiring for - Role: Senior Data Engineer Experience Range: 3 to 5 Years Qualification: Degree in Computer Science (or similar), alternatively well-founded professional experience in the desired field Roles & Responsibilities: As a Senior Data Engineer, you manage and develop the solutions in close alignment with various business and Spoke stakeholders. You are responsible for the implementation of the IT governance guidelines. Collaborate with the Spokes Data Scientists, Data Analysts, and Business Analysts, when relevant. Tasks Create and manage data pipeline architecture for data ingestion, pipeline setup and data curation Experience working with and creating cloud data solutions Ass...

As a software engineer at Equifax, you will have the opportunity to work on a variety of meaningful projects with a team of talented engineers using leading-edge technology. Your role will involve: - Performing general application development activities, such as unit testing, code deployment, and technical documentation. - Contributing to unfamiliar code written by team members on one or more projects. - Diagnosing and resolving performance issues. - Participating in estimation processes, use case specifications, test plan reviews, and project planning. - Documenting code and processes for easy understanding by other developers. - Developing and operating high-scale applications from backend...

JD for AWS Data Engineer Profile : What's this role about? As an AWS Technical Specialist, you will be responsible for migration to AWS Data Cloud or implementing data solutions using AWS Data Cloud services including integration with existing data and analytics platforms and tools. Here's how you'll contribute: You will contribute to the role by: Creating Impact faster: Delivering more Impact In less time by quickly deploying solutions or augmenting existing ones to enable teams to accelerate business results and Increase time to value Breaking through barriers: Helping create better customer experience by taking the data first approach and deliver Insights Adapting to anything: Agility to ...

Description:Hands-on experience with AWS services including S3, Lambda,Glue, API Gateway, and SQS.Strong skills in data engineering on AWS, with proficiency in Python ,pyspark & SQL.Experience with batch job scheduling and managing data dependencies.Knowledge of data processing tools like Spark and Airflow.Automate repetitive tasks and build reusable frameworks to improve efficiency.Provide Run/DevOps support and manage the ongoing operation of data services. Location - Bangalore, Mumbai, Pune, Chennai, Kolkata, Hyderabad

Experience- 8 to 16 years Location- Pan India Key Responsibilities: Design and implement data architecture solutions using Databricks on AWS or Azure cloud platforms. Lead the development of robust ETL/ELT pipelines for batch and real-time data processing. Optimize compute, storage, and network resources to ensure cost-effective and high-performance data solutions. Collaborate with cross-functional teams (Data Engineers, Data Scientists, DevOps, and Product teams) to define data requirements and delivery approaches. Implement data governance, security controls, access management, and compliance protocols. Architect data lakes and Delta Lake implementations for structured and unstructured dat...

About The Role Role IT Support Specialist Shift timings8.00am to 5.00pm or 12.00pm to 9.00pm IST Work locationBangalore The main objective of this position is to maintain system functions and provide daily support to business. Responsibilities : Provide first-line and second-line technical support for IT products, addressing technical issues and providing solutions in a timely manner. Troubleshoot and resolve software bugs, system errors, and performance issues for internal users or customers. L2 Support for multiple applications by oneself and together with the team. Analyzing the issues and resolving the same, proposing a workaround to maintain business continuity and ensuring minimum busi...

About The Role Project Role : Engineering Services Practitioner Project Role Description : Assist with end-to-end engineering services to develop technical engineering solutions to solve problems and achieve business objectives. Solve engineering problems and achieve business objectives using scientific, socio-economic, technical knowledge and practical experience. Work across structural and stress design, qualification, configuration and technical management. Must have skills : Java Full Stack Development Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Engineering Services Practitioner, you will ass...

About The Role Project Role : Engineering Services Practitioner Project Role Description : Assist with end-to-end engineering services to develop technical engineering solutions to solve problems and achieve business objectives. Solve engineering problems and achieve business objectives using scientific, socio-economic, technical knowledge and practical experience. Work across structural and stress design, qualification, configuration and technical management. Must have skills : PySpark Good to have skills : NA Minimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Engineering Services Practitioner, you will assist with end-to-end ...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelor...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelor...

Hands-on experience with AWS services including S3, Lambda,Glue, API Gateway, and SQS.Strong skills in data engineering on AWS, with proficiency in Python ,pyspark & SQL.Experience with batch job scheduling and managing data dependencies. Knowledge of data processing tools like Spark and Airflow.Automate repetitive tasks and build reusable frameworks to improve efficiency.Provide Run/DevOps support and manage the ongoing operation of data services. (Immediate Joiners).

Hands-on experience with AWS services including S3, Lambda,Glue, API Gateway, and SQS. Strong skills in data engineering on AWS, with proficiency in Python ,pyspark & SQL. Experience with batch job scheduling and managing data dependencies. Knowledge of data processing tools like Spark and Airflow.Automate repetitive tasks and build reusable frameworks to improve efficiency. Provide Run/DevOps support and manage the ongoing operation of data services. (Immediate Joiners).

Hands-on experience with AWS services including S3, Lambda,Glue, API Gateway, and SQS. Strong skills in data engineering on AWS, with proficiency in Python ,pyspark & SQL. Experience with batch job scheduling and managing data dependencies. Knowledge of data processing tools like Spark and Airflow. Automate repetitive tasks and build reusable frameworks to improve efficiency. Provide Run/DevOps support and manage the ongoing operation of data services. (Immediate Joiners). Location - Bengaluru,Mumbai,Pune,Chennai,Kolkata,Hyderabad.

Hands-on experience with AWS services including S3, Lambda,Glue, API Gateway, and SQS. Strong skills in data engineering on AWS, with proficiency in Python ,pyspark & SQL. Experience with batch job scheduling and managing data dependencies. Knowledge of data processing tools like Spark and Airflow. Automate repetitive tasks and build reusable frameworks to improve efficiency. Provide Run/DevOps support and manage the ongoing operation of data services. (Immediate Joiners).

Tech Stack - AWS Big Data Stack Expertise in ETL, SQL, Python and AWS tools like Redshift,S3, Glue, Data pipeline, Lambda is a must. Good to have knowledge on Glue Workflows, Step Functions, Quick sight, Athena, Terraform and Dockers. Responsibilities -Assists in the analysis, design and development of a roadmap, design pattern, and implementation based upon a current vs. future state from a architecture viewpoint. Participates in the data related technical and business discussions relative to future serverless architecture. Responsible for working with our Enterprise customers and migrate data into Cloud. Set up scalable ETL process to move data into Cloud warehouse. Deep understanding in D...

AWS data developers with 6-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferred Skills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shift Good communication skills and can deliver independently Mandatory Competencies Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift Big Data - Big Data - Pyspark Beh - Communication Database - Database Programming - SQL Perks and Benefits for Irisians we offer world-class benefits designed to support the financial, health and well-being needs of our associates to help achieve harmony between their professional and personal growth. From comprehensive health ...