1333 Aws Glue Jobs - Page 24

As a Data Engineer at IBM, you'll play a vital role in the development, design of application, provide regular support/guidance to project teams on complex coding, issue resolution and execution. Your primary responsibilities include: Lead the design and construction of new solutions using the latest technologies, always looking to add business value and meet user requirements. Strive for continuous improvements by testing the build solution and working under an agile framework. Discover and implement the latest technologies trends to maximize and build creative solutions Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise De...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelor...

Develop full-stack forecasting and simulation tools using React, Node.js, and Python on AWS Modernize Excel/VBA tools into scalable cloud-native web applications Deploy solutions efficiently with AWS services, CI/CD, and infrastructure-as-code tools Food allowance Annual bonus Health insurance Provident fund

You will be working at Paras Twin Tower, Gurgaon as a full-time employee for Falcon, a Series-A funded cloud-native, AI-first banking technology & processing platform. Falcon specializes in assisting banks, NBFCs, and PPIs to efficiently launch cutting-edge financial products like credit cards, credit lines on UPI, prepaid cards, fixed deposits, and loans. Since its inception in 2022, Falcon has processed over USD 1 billion in transactions, collaborated with 12 of India's top financial institutions, and generated revenue exceeding USD 15 million. The company is supported by prominent investors from Japan, the USA, and leading Indian ventures and banks. To gain more insights about Falcon, vis...

As a Senior Developer in AWS Data Engineering, you will be responsible for utilizing your expertise in AWS Glue, Spark, S3, Redshift, Python, and SQL to design, build, and optimize large-scale data pipelines on the AWS platform. This role presents an exciting opportunity to create high-performance analytics and AI-ready data platforms. Your primary responsibilities will include building and managing data pipelines using Glue, Spark, and S3. You will also be tasked with optimizing Redshift queries, schema, and performance, as well as supporting large-scale data ingestion and transformation processes. Additionally, you will integrate with upstream APIs and external platforms to ensure seamless...

NTT DATA is looking for a Data Engineer with expertise in Snowflake, AWS Glue, Kafka, and API to join the team in Bangalore, Karnataka, India. As a Data Engineer, you should have at least 6 years of experience in Data Engineering or a related role. Your responsibilities will include working hands-on with Snowflake for tasks such as data modeling, performance tuning, query optimization, Snowpipe, Time Travel, Streams & Tasks. Proficiency in AWS Glue for ETL job development, orchestration, and optimization is essential. You should also have a strong grasp of AWS services like S3, Lambda, Redshift, Athena, Step Functions, Kinesis, and CloudWatch. Strong programming skills in Python and/or PySpa...

You will be responsible for leading the development of foundational components for a lakehouse architecture on AWS and overseeing the migration of existing data processing workflows to the new lakehouse solution. Your role will involve collaborating with the Data Engineering team to design and implement scalable data infrastructure and processes using technologies such as Python, PySpark, EMR Serverless, Iceberg, Glue, and Glue Data Catalog. The primary objective of this position is to ensure a successful migration and establish robust data quality governance across the new platform to enable reliable and efficient data processing. To excel in this position, you will need to demonstrate deep...

As a Data Engineer, you will be responsible for building scalable data pipelines using PySpark. Your role will involve implementing complex business logic using Spark SQL, DataFrame, and RDD APIs. You should have strong programming skills in Python, with a solid understanding of data structures, algorithms, and software engineering principles. Your expertise in designing, developing, and maintaining batch and streaming data pipelines will be crucial. You should be familiar with ETL/ELT processes and best practices for data transformation, data quality, and performance optimization. Knowledge of the modern data engineering ecosystem, including distributed data processing, storage systems, and...

As a Senior Software Engineer at our company, you will be part of a dynamic and talented engineering team working on cutting-edge IoT and cloud technologies. You will play a crucial role in designing, developing, and maintaining scalable applications and backend services that interface with IoT gateways using MQTT, while leveraging AWS cloud services such as Lambda, Glue, Athena, and S3. Your key responsibilities will include designing, building, and maintaining scalable backend services using Node.js and Python, developing interactive front-end interfaces using React or Angular, integrating and managing IoT Gateways, designing and managing relational databases with PostgreSQL, building and ...

As an AWS Senior Data Engineer at EY, you will play a crucial role in designing, developing, and maintaining scalable data pipelines for data ingestion and processing using Python, Spark, and various AWS services. With a minimum of 5+ years of experience, you will be responsible for ensuring data quality, optimizing data storage solutions, and collaborating with cross-functional teams to deliver solutions that meet business needs. Your key responsibilities will include working with on-prem Oracle databases, batch files, and Confluent Kafka for data sourcing, implementing ETL processes using AWS Glue and EMR for batch and streaming data, and developing data storage solutions using Medallion A...

As a Data Engineer at IBM, you'll play a vital role in the development, design of application, provide regular support/guidance to project teams on complex coding, issue resolution and execution. Your primary responsibilities include: Lead the design and construction of new solutions using the latest technologies, always looking to add business value and meet user requirements. Strive for continuous improvements by testing the build solution and working under an agile framework. Discover and implement the latest technologies trends to maximize and build creative solutions Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise De...

Capgemini Invent Capgemini Invent is the digital innovation, consulting and transformation brand of the Capgemini Group, a global business line that combines market leading expertise in strategy, technology, data science and creative design, to help CxOs envision and build whats next for their businesses. Your Role Should have developed/Worked for atleast 1 Gen AI project. Has data pipeline implementation experience with any of these cloud providers - AWS, Azure, GCP. Experience with cloud storage, cloud database, cloud data warehousing and Data lake solutions like Snowflake, Big query, AWS Redshift, ADLS, S3. Has good knowledge of cloud compute services and load balancing. Has good knowledg...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Python (Programming Language) Good to have skills : AWS Architecture, AWS Glue Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing application features, and ensuring that the applications function seamlessly within the...

Role & responsibilities Seeking a developer who has good Experience in Athena, Python code, Glue, Lambda, DMS , RDS, Redshift Cloud Formation and other AWS serverless resources. Can optimize data models for performance and efficiency. Able to write SQL queries to support data analysis and reporting Design, implement, and maintain the data architecture for all AWS data services. Work with stakeholders to identify business needs and requirements for data-related projects Design and implement ETL processes to load data into the data warehouse Good Experience in Athena, Python code, Glue, Lambda, DMS, RDS, Redshift, Cloud Formation and other AWS serverless resources. Preferred candidate profile

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : AWS Glue Good to have skills : Data Engineering, Python (Programming Language), Microsoft SQL Server Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education About The Role :Developing a customer insights platform that will provide an ID graph and Digital customer view to help drive improvements in marketing decisions. Responsibilities:Design, build, and maintain data pipelines using AWS services (Glue, Neptune, S3).Participate in code reviews, testing, and ...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Python (Programming Language) Good to have skills : AWS Glue, AWS Lambda Administration, AWS S3 (Simple Storage Service) Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing innovative solutions, and ensuring that appli...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : AWS BigData Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project milestones are met, facilitating discussions to address challenges, and guiding your team in implementing effective solutions. You will also en...

Roles and responsibilities Design AWS architectures based on business requirements. Create architectural diagrams and documentation. Present cloud solutions to stakeholders. Skills and Qualifications: Strong knowledge of AWS services: EC2, S3, RDS, Lambda, IAM, VPC, CloudFormation, CloudWatch, etc. Experience with serverless architectures (AWS Lambda, API Gateway, Step Functions). Experience of AWS networking (VPC, Route 53, ELB, Security Groups, etc.). Experience with AWS CloudFormation for automating infrastructure. Proficiency in scripting languages such as Python or Bash. Experience with automation tools (AWS Systems Manager, AWS Lambda) Experience of containerization (Docker, Kubernetes...

Educational Requirements Bachelor of Engineering Service Line Data & Analytics Unit Responsibilities A day in the life of an Infoscion As part of the Infosys delivery team, your primary role would be to interface with the client for quality assurance, issue resolution and ensuring high customer satisfaction. You will understand requirements, create and review designs, validate the architecture and ensure high levels of service offerings to clients in the technology domain. You will participate in project estimation, provide inputs for solution delivery, conduct technical risk planning, perform code reviews and unit test plan reviews. You will lead and guide your teams towards developing opti...

Administer and optimize AWS Data Lake infrastructure using services like S3, Lake Formation, Glue, Athena, and Redshift , ensuring secure, scalable, and efficient operations. Design and manage ETL workflows with AWS Glue and Step Functions , enabling seamless data ingestion, transformation, and cataloging. Implement access controls and data governance using Lake Formation, IAM policies, and resource tagging to ensure compliance and data security. Use SQL and automation scripts for data validation, performance tuning, and supporting analytics teams with curated, query-ready datasets.

As a Data Engineer, your primary responsibility will be to design and develop ETL pipelines for data transformation and integration. You should have expertise in PySpark and Python for data processing and analytics. Additionally, you must possess strong hands-on experience as a Snowflake Developer and in AWS Glue. Collaborating on AWS cloud infrastructure with a specific focus on AWS Solutions Architect practices will be a key part of your role. You should also have exposure to DevOps for CI/CD pipelines and deployment automation. Your leadership skills will be essential in guiding junior engineers and driving technical decisions within the team. Key Requirements for this role include experi...

We are Hiring: AWS Data Architect at Coforge Ltd. Join Coforge Ltd as a Lead AWS Data Architect. Job Location: Hyderabad (Onsite Only) Experience Required: 1215 Years Position Type: Full-Time Company: Coforge Ltd. How to Apply Interested candidates can share their CV directly with: Gaurav.2.Kumar@coforge.com WhatsApp: 9667427662 About the Role:- Coforge Ltd is seeking a visionary Lead AWS Data Architect to spearhead our cloud-first data initiatives. This is a strategic leadership role where youll shape the future of data architecture, mentor top-tier talent, and deliver scalable, secure, and innovative solutions using cutting-edge AWS technologies. Key Responsibilities:- Team Leadership & Me...

You will be responsible for designing and implementing highly performant algorithms to process, transform, and analyze large volumes of data. You will apply advanced DSA concepts like Trees, Graphs, Tries, Heaps, and Hashing for data indexing, filtering, and routing. Additionally, you will develop and optimize data pipelines, stream processors, or caching systems, and architect scalable systems for data ingestion, storage, and retrieval (structured/unstructured). Collaboration with cross-functional teams to integrate and deploy performant services will be a key part of your role. You will also perform profiling, tuning, and memory optimization to ensure low-latency operations. Writing clean,...