1844 Aws Glue Jobs - Page 30

About The Role Project Role : Cloud Platform Engineer Project Role Description : Designs, builds, tests, and deploys cloud application solutions that integrate cloud and non-cloud infrastructure. Can deploy infrastructure and platform environments, creates a proof of architecture to test architecture viability, security and performance. Must have skills : AWS Analytics Good to have skills : Banking Strategy Minimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Position Overview:As a Junior AWS Cloud Data Engineer, you will support the design, development, and maintenance of our AWS-based data infrastructure. This entry-level position offers an e...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

Urgent Hiring: AWS Data Engineer, Senior Data Engineers & Lead Data Engineers Apply Now: Send your resume to heena.ruchwani@gspann.com Location: Bangalore (6+ Years Experience) Company: GSPANN Technologies, Inc. GSPANN Technologies is seeking talented professionals with 4+ years of experience to join our team in Bangalore. We are looking for immediate joiners who are passionate about data engineering and eager to take on exciting challenges. Key Skills & Experience: 6+ years of hands-on experience with AWS Data Services (Glue, Redshift, S3, Lambda, EMR, Athena, etc.) Strong expertise in Big Data Technologies (Spark, Hadoop, Kafka) Proficiency in SQL, Python, and Scala Hands-on experience wit...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : AWS Glue Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementin...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Data Engineering, Python (Programming Language), AWS Administration, AWS Glue Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that application requirements are met, overseeing the development process, and provid...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : AWS Architecture Good to have skills : AWS BigData, AWS Administration, AWS AI Services Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that application development aligns with organizational goals, addressing challenges that arise duri...

About The Role Skill required: Delivery - Cloud Enabled Customer Data Architecture Designation: I&F Decision Sci Practitioner Sr Analyst Qualifications: BE/BTech Years of Experience: 5 to 8 years What would you do? Accenture is a global professional services company with leading capabilities in digital, cloud and security. Combining unmatched experience and specialized skills across more than 40 industries, we offer Strategy and Consulting, Technology and Operations services, and Accenture Song all powered by the worlds largest network of Advanced Technology and Intelligent Operations centers. Our 699,000 people deliver on the promise of technology and human ingenuity every day, serving clie...

The Opportunity As a Data Analytics Test Lead, you will be responsible for testing Business Intelligence Data warehousing Solutions both in on premise and cloud platform and should ensure Quality of deliverables. You will work closely with Test Manager for the Projects under Test. Testing proficiency in ETL, data-warehousing, and Business Intelligence area are required for this position. Added advantage to have experience in testing Big Data/unstructured data using Hadoop/Spark framework, cloud platform knowledge either in AWS/Azure, knowledge in predictive analytics, Machine Learning and Artificial intelligence. Skills and attributes for success Develop Test Strategy for Testing BI DWH Proj...

Job Overview The Senior Data Engineer will play a critical leadership role within our Data Engineering team, driving the design, development, and optimization of scalable, high-performance data pipelines and infrastructure. You will be responsible for overseeing multiple data projects, collaborating with cross-functional business and technical teams, and ensuring timely and accurate delivery of data solutions that align with enterprise goals. This role requires strong technical expertise in PySpark, Databricks, AWS Glue, S3, and SQL , as well as proven experience in leading large-scale data initiatives. The ideal candidate will combine hands-on engineering capability with leadership skills t...

Collaborate with software engineers, business stake holders and/or domain experts to translate business requirements into product features, tools, projects. ? Develop, implement, and deploy ETL solutions. ? Preprocess and analyze large datasets to identify patterns, trends, and insights. ? Evaluate, validate, and optimize data models to ensure efficiency, and generalizability. ? Monitor and maintain the performance of data pipeline, data models in production environments, identifying opportunities for improvement and update as needed. ? Document development processes, results, and lessons learned to facilitate knowledge sharing and continuous improvement.

Job TitleAWS Senior Data Engineer Experience RequiredMinimum 3-7 years Job Summary: We are seeking a skilled Data Engineer with a strong background in data ingestion, processing, and storage. The ideal candidate will have experience working with various data sources and technologies, particularly in a cloud environment. You will be responsible for designing and implementing data pipelines, ensuring data quality, and optimizing data storage solutions. Key Responsibilities: Design, develop, and maintain scalable data pipelines for data ingestion and processing using Python, Spark, and AWS services. Work with on-prem Oracle databases, batch files, and Confluent Kafka for data sourcing. Implemen...

Description: Server Side Integration Services (SSIS) is a Microsoft data integration tool that allows developers to extract transform and load (ETL) data between different relational databases and file formats. It's a powerful tool for data warehousing data migration and data cleansing. About The Role : for an SSIS Developer: An SSIS developer is responsible for designing developing and maintaining data integration solutions using SSIS. They work closely with business analysts data architects and database administrators to understand data requirements and create efficient ETL processes. Key Responsibilities: Data Analysis:Analyze source and target data systems to understand data structures r...

AWS Data Engineer 8-11 years AWS Data Engineer, Python Python, S3, RDS, Glue, Lambda, IAM, SNS, SQL , Quicksight

Description: 1.Hands on industry experience in design and coding from scratch in AWS Glue-Pyspark with services like S3 DynamoDB StepFunctions etc. 2.Hands on industry experience in design and coding from scratch in Snowflake 3.Experience in Pyspark/Snowflake 1 to 3 years with overall around 5 years of experience in building data/analytics solutions Level Senior Consultant or below Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade :C Level :To Be Defined Named Job Posting? (if Yes - needs to be approved by SCSC) :No Remote work possibility :Yes Global Role Family :60236 (P) Software Engineering Local Role Name :6361 Software Engineer Local Skills :593...

Role:Sr Python Developer Must have:Python Spark/Postgres SQL ,Spark / Apache Spark (AWS) Strong development experience using Python and SQL on AWS using Glue, Lambda.

Description Responsibilities Must have 1. Strong expertise in SQL Python PySpark. 2. Good knowledge on Data warehousing techniques. 3. Good knowledge on AWS Big Data services and snowflake. Design develop and maintain scalable data pipelines and architectures for data processing and integration. Implement data streaming solutions to handle real-time data ingestion and processing. Utilize Python and PySpark to develop and optimize data workflows. Leverage AWS services such as S3 Redshift Glue Kinesis and Lambda for data storage processing and analytics. Collaborate with data scientists analysts and other stakeholders to understand data requirements and deliver solutions. Ensure data quality i...

Description 1.Hands on industry experience in design and coding from scratch in AWS Glue-Pyspark with services like S3 DynamoDB StepFunctions etc. 2.Hands on industry experience in design and coding from scratch in Snowflake 3.Experience in Pyspark/Snowflake 1 to 3 years with overall around 5 years of experience in building data/analytics solutions Level Senior Consultant or below Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade C Level To Be Defined Named Job Posting? (if Yes - needs to be approved by SCSC) No Remote work possibility Yes Global Role Family 60236 (P) Software Engineering Local Role Name 6361 Software Engineer Local Skills 59383 AWS G...

Description Primary/Mandatory Experience - Experience building data pipeline in Python along with AWS services (S3 SNS CloudWatch Lambda Step Function etc) - Proficient in AWS Server less technologies - Technical knowledge of Extract/Transform/Load (ETL) solutions for running analytic projects on the cloud - Candidate must have hands-on technical experience on the AWS cloud native technologies along with traditional ETL tools -Snowflake & DWH experience is a plus Daily Activity Excellent written and verbal communication skills and be able to lead meetings with technical peers and clients regarding the solution designs. Ability to communicate with the Business Analysts Data Modellers Cloud Ar...

Description Primary/Mandatory Experience - Experience building data pipeline in Python along with AWS services (S3 SNS CloudWatch Lambda Step Function etc) - Proficient in AWS Server less technologies - Technical knowledge of Extract/Transform/Load (ETL) solutions for running analytic projects on the cloud - Candidate must have hands-on technical experience on the AWS cloud native technologies along with traditional ETL tools -Snowflake & DWH experience is a plus Daily Activity Excellent written and verbal communication skills and be able to lead meetings with technical peers and clients regarding the solution designs. Ability to communicate with the Business Analysts Data Modellers Cloud Ar...

Sr. Data Engineer About the Role The Senior Data Engineer will play a pivotal role in designing, developing, and maintaining scalable, high-performance data pipelines and infrastructure. You will lead multiple data engineering initiatives, collaborate with cross-functional teams, and deliver enterprise-grade data solutions aligned with business goals. This role is ideal for a proactive problem solver with strong leadership skills, hands-on expertise in PySpark, AWS Glue, Databricks, and S3 , and the ability to translate complex technical concepts into actionable insights for business stakeholders. Key Responsibilities Lead functional teams and manage multiple data engineering projects simult...

Skills Required: Should have a minimum 2+ years in Data Engineering, Data Analytics platform. Should have strong hands-on design and engineering background in AWS, across a wide range of AWS services with the ability to demonstrate working on large engagements. Strong experience with Python, SQL, pySpark, Scala, Shell Scripting etc. Strong experience with workflow management & Orchestration tools (Airflow) Build and manage ETL workflows on AWS Glue Develop and orchestrate data workflows using Apache Airflow Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements Optimize existing data solutions for performance and scalability Ensure data qua...

Immediate Joiners & Ready to Relocate to Madurai Roles and Responsibilities Design, develop, test, deploy, and maintain large-scale data processing pipelines using PySpark on Azure Databricks. Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions that meet business needs. Troubleshoot complex issues related to big data processing, ETL processes, and SQL queries. Ensure scalability, performance, and reliability of the system by monitoring logs, debugging techniques, and implementing optimization strategies. Stay up-to-date with industry trends in big data technologies such as Hadoop ecosystem (HDFS), Spark (PySpark), AWS Glue.

As a Data Engineer at Tredence, you will be responsible for working with various AWS technologies like Glue, Redshift, S3 Tables, and PySpark to build and maintain data pipelines. Your expertise in AWS services will be crucial in ensuring smooth data processing and analysis for the organization. - Utilize AWS Glue and Glue catalogue for data extraction, transformation, and loading processes. - Work with AWS Redshift/Redshift Spectrum to manage and optimize data warehousing solutions. - Implement Managed Airflow/Step Function for orchestrating data workflows efficiently. - Create and manage AWS S3 Tables/Iceberg/Athena for storing and querying large datasets. - Develop data processing tasks u...

As an SQL ETL Snowflake Developer, you will leverage your expertise in advanced SQL with a focus on Snowflake. Your primary role involves working in the data integration area and utilizing ETL tools such as Datastage, Informatica, or Snaplogic. Your ability to translate technical requirements into data collection queries is crucial. Collaboration with business and IT teams to convert requirements into queries and a strong understanding of ETL architecture and design are key aspects of your role. - Utilize advanced SQL skills with a specialization in Snowflake for data integration tasks - Use ETL tools like Datastage, Informatica, or Snaplogic to transform technical requirements into data col...

Job Description: Cloud platform: AWS, Snowflake AWS: Athena, AWS Glue, Glue workflow, Lambda, S3, EC2, EBS, CloudWatch, VPC, DynamoDB, API Gateway, IAM, CloudFormation, Kinesis, SQS, SNS, Step Functions, QuickSight, Redshift. Programming languages: Python, PySpark, SQL, Java Scheduler tool: Talend, Airflow Infrastructure as a code tool: Terraform Ticketing Tools: Jira Operating System: Linux, Windows. Responsibilities: Perform data engineering activities that include data modeling, analysis, cleansing, processing, extraction and transformation. Build batch or near real time ETL data pipelines using Talent, AWS Glue, Lambda, Kinesis, SQS. Write ETL scripts using Python/Pyspark and SQL. Also, ...