1831 Aws Glue Jobs - Page 7

Candidates with more experience are also welcome and salary is negotiable according to experience and the last drawn. Applications are open to immediate joiners only. Role & responsibilities Strong programming skills in Python and SQL . Experience with data processing leveraging programming skills in Python and Spark In-depth understanding of the Kafka platform for (real-time) data ingestion and processing of high-volume data. Design and architect data flows, data management in Cloud environment which are scalable, repeatable and eliminate time consuming steps. Clear skills in using version control systems like GIT and developing (technical) documentation (e.g., in WIKI). Experiences at infr...

Primary Skills: Python, Pyspark, Glue, Redshift, Lambda, DMS, RDS ,Cloud Formation and other AWS serverless Strong exp in SQL

Looking for a Data Engineer skilled in AWS, PySpark, Glue, S3, Snowflake, Lambda, SNS/SQS, and ETL pipeline development. Must design/optimize data lakes/warehouses, build scalable frameworks, handle transformations, and troubleshoot end-to-end.

Role Overview: You will be working as a Data Engineer - Scala at the forefront of Experian's cloud modernization within the Credit & Verification Services. This role is a hybrid one, requiring you to travel to the Hyderabad office 40% of the month. You will have the opportunity to be part of a collaborative team that uses Agile DevSecOps principles to deliver business value. Key Responsibilities: - Develop and maintain batch data processing pipelines using Scala and Apache Spark. - Optimize Spark jobs for performance and scalability in a cloud-native environment (AWS). - Collaborate with data engineers and analysts to understand data requirements and deliver high-quality solutions. - Ensure ...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : AWS Glue Good to have skills : PySpark, Snowflake Data Warehouse, Data Engineering Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary: As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensu...

Job Description: What will you do? Design, develop and own robust data pipelines, ensuring optimal performance, scalability, and maintainability. Design and implement Data Lake, Dare Warehouse and Lakehouse solutions with different architecture patterns. Ensure data quality, integrity and governance across all stages of data lifecycle. Monitor and optimize performance of data engineering pipelines. Contribute to design principles, best practices, and documentation. Collaborate closely with cross-functional teams to deeply understand business requirements, translating them into effective technical design, implementations that support the organization's data-driven initiatives. Provide mentors...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : AWS Architecture Good to have skills : Python (Programming Language)Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quali...

Job description Are you an experienced tech professional ready for a change? Vidushi Infotech is hosting a Mega Tech Walk-In Drive at Hyderabad with exciting opportunities across multiple cutting-edge technologies! We are looking for talented, experienced individuals, with immediate joiners prioritized. Hiring For: SAP Functional and Technical roles in MM, P2P, FICO, SD SAP ABAP and Fiori Developers Supply chain: Hiring for Functional, Technical, Techno-Functional and Architect roles in BY, O9, Cloud: Azure Data Engineer, AWS Data Engineer, React.js developers Experience: 3-10 years (1-8 years for React.js) Priority: Immediate Joiners Walk-in Date & Location: Hyderabad: December 13, 2025 fro...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Python (Programming Language) Good to have skills : DevOps, Data Engineering, AWS Glue, REST API, Lambda Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing inn...

Your role and responsibilities As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the pl...

Your role and responsibilities As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform * Responsibilities * Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS * Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on ...

At Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities,"collaborating closely with clients to deliver cutting-edge solutions. Join us to drive transformation tailored to our client's challenges of today and tomorrow."Informed and validated by science and data. Superpowered by creativity and design. All underpinned by technology created with purpose. Your role As a Senior Azure Data Engineer, you will be responsible for architecting, developing, and optimizing enterprise-grade data solutions on Microsoft Azure. You will lead the design and implementation of scalable data platforms, data la...

TCS is hiring... Role: AWS Data Engineer/Python (Walk in Drive) EXP: 5 - 10 YEARS LOCATION: Kumaran Nagar, 415/21-24, TNHB Main Rd, Chennai, Tamil Nadu 600119 Job Description AWS Pyspark/ Python/Hive AWS Glue, Lambda, Athena Good hands-on experience in Python programming and Pyspark/Scala Data Engineering experience using AWS core services (Lambda, Glue, EMR, S3 and RedShift) Good knowledge on any of the ETL tools and SQLs

ETL Development AWS Glue PYTHON ETL Developer

Role & responsibilities Responsibilities: Data Modeling and Design: Design and implement efficient data models, including dimensional and normalized models. ETL/ELT Development: Develop and maintain robust ETL/ELT pipelines. Data Pipeline Optimization: Optimize data pipelines for performance and scalability. Database Performance Tuning: Identify and resolve performance bottlenecks in database queries and indexes. Data Quality Assurance: Implement data quality checks and monitoring to ensure data accuracy and consistency. Collaboration: Work closely with data scientists, data engineers, and leadership to understand business requirements and translate them into technical solutions. Cloud Infra...

Job description Are you an experienced tech professional ready for a change? Vidushi Infotech is hosting a Mega Tech Walk-In Drive with exciting opportunities across multiple cutting-edge technologies! We are looking for talented, experienced individuals, with immediate joiners prioritized. Hiring For: SAP, BY, O9, Azure Data Engineer, AWS Data Engineer, and React.js Experience: 3-10 years (1-8 years for React.js) Priority: Immediate Joiners Walk-in Date & Location: Hyderabad: December 13, 2025 (Please note: Exact venue details will be provided upon successful registration.) How to Participate To ensure a smooth process and secure your slot, please register your self on below link: https://v...

Key Responsibilities: Cloud & Data Engineering: Design, develop, and maintain data pipelines and ETL workflows using AWS ETL Development and AWS Glue must services (S3, Glue, EMR, Lambda, Redshift). Implement distributed data processing using PySpark on AWS EMR or Databricks. Optimize data storage and retrieval for performance and cost efficiency. Programming & Automation: Develop reusable scripts and automation tools in Python for data ingestion, transformation, and validation. Implement best practices for code quality, testing, and version control (Git). Data Architecture & Integration: Work with structured and unstructured data from multiple sources. Integrate data pipelines with analytic...

Educational Requirements Bachelor of Engineering Service Line Data & Analytics Unit Responsibilities A day in the life of an Infoscion As part of the Infosys delivery team, your primary role would be to design, build and deploy highly secure and performant data engineering solutions You will analyze the requirements and specifications to understand the client requirements in a detailed manner and translate them into production grade data applications that meet the client requirements. You would be a key contributor to building efficient programs/ systems and if you think you fit right in to help our clients navigate their next in their digital transformation journey If you think you fit righ...

Role Overview : We are seeking an experienced AWS Data Architect with strong hands-on expertise in designing, building, and optimizing scalable data lake and analytics platforms on AWS. The ideal candidate will combine deep technical proficiency in AWS services with a strong understanding of data architecture principles, governance, and best practices for analytical enablement. Key Responsibilities Architect and Design: Define and implement scalable, secure, and cost-efficient AWS-based data lake architectures using S3, Glue, Athena, and Lake Formation. Data Engineering: Develop robust ETL/ELT pipelines using PySpark, Glue, and Lambda for batch and near-real-time data ingestion and transform...

We are seeking an experienced Python Developer with strong AWS expertise to design, develop, and maintain scalable cloud-based data solutions. The ideal candidate will have hands-on experience in Python programming, AWS services, and SQL , along with a good understanding of data pipelines and automation . Key Responsibilities: Develop and deploy data processing and automation workflows using Python and AWS services. Design, implement, and manage solutions using AWS Glue, Lambda, S3, and CloudFormation/AWS Stacks . Write optimized SQL queries and manage data transformations and integrations. Collaborate with data engineering and DevOps teams to ensure scalability and reliability of systems. I...

About Us DataZymes is a data-driven organization focused on delivering actionable insights through advanced analytics and business intelligence. We are looking for an AWS Data Engineer with strong hands-on experience in building scalable data pipelines and cloud data solutions. Responsibilities Design and implement scalable data pipelines using AWS services such as S3, Glue, PySpark, and EMR . Develop and maintain robust data transformation scripts using Python and SQL . Optimize data storage and retrieval using Redshift, RDS, DynamoDB , and other AWS database services. Build and manage data warehouse layers tailored to business requirements. Apply ETL and data modeling best practices to ens...

Role Overview: As an AWS Developer at PwC - AC, you will be responsible for interacting with Offshore Manager/ Onsite Business Analyst to understand requirements and implementing Cloud data engineering solutions like Enterprise Data Lake and Data hub in AWS. Your role will involve end-to-end implementation of these solutions to meet client needs. Key Responsibilities: - Architect and deliver highly scalable, distributed, cloud-based enterprise data solutions - Implement Cloud data engineering solutions like Enterprise Data Lake, Data hub in AWS - Utilize Snowflake utilities, SnowSQL, SnowPipe, ETL data Pipelines, and Big Data model techniques using Python / Java - Load disparate data sets an...

Role Overview: At PwC, as an Associate in the Data, Analytics & Specialist Managed Service Tower, you will be part of a team of problem solvers, assisting in solving complex business issues from strategy to execution. Your responsibilities will include using feedback and reflection to develop self-awareness, demonstrating critical thinking, ensuring ticket quality and deliverables review, adhering to SLAs, incident management, change management, and problem management. You will also seek and embrace opportunities for growth, communicate effectively, uphold ethical standards, demonstrate leadership capabilities, work in a team environment, and contribute to COE activities. Additionally, as an...

As a Data Engineering & Analytics Architect at NTT DATA, you will be responsible for owning the strategy, governance, and end-to-end architecture for backend data pipelines, transformation logic, and real-time/batch analytics. Your role will include defining data-first architecture, standards, and blueprints across various layers, leading the design of batch and streaming pipelines, establishing semantic/serving models, and enforcing security, privacy, and compliance. **Key Responsibilities:** - Define data-first architecture, standards, and blueprints for ingestion, cleansing, enrichment, modeling, and serving layers. - Lead the design of batch and streaming pipelines using technologies suc...

Role Overview: As a Software Engineer III at JPMorgan Chase within the Consumer and Community Banking - Wealth Management, you will be a key member of an agile team, responsible for designing and delivering reliable, market-leading technology products that are secure, stable, and scalable. Your role involves implementing essential technology solutions across diverse technical domains, supporting various business functions to achieve the firm's strategic goals. Key Responsibilities: - Execute software solutions, design, development, and technical troubleshooting with the ability to think beyond routine or conventional approaches to build solutions or break down technical problems. - Create se...