869 Aws Glue Jobs - Page 11

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

As a Data Engineer, you will design and implement data pipelines and integrations across cloud platforms to support AI and GenAI workloads. You’ll work closely with Data Scientists and ML Engineers to enable GenAI-powered applications through clean, secure, and optimized data flows. Key Responsibilities - Data Engineering Build and maintain ETL/ELT pipelines for structured, semi-structured, and unstructured data. Work with data warehouses/lakehouses (Snowflake, BigQuery, Databricks, Redshift). Develop real-time streaming pipelines using Kafka, Spark, or Flink. Ensure data quality, validation, and error handling. Prepare and manage data pipelines to feed LLMs and GenAI models. Work with vecto...

Role Description : As a Senior Cloud Data Platform (AWS) Specialist at Incedo, you will be responsible for designing, deploying and maintaining cloud-based data platforms on the AWS platform. You will work with data engineers, data scientists and business analysts to understand business requirements and design scalable, reliable and cost-effective solutions that meet those requirements. Roles & Responsibilities: Designing, developing and deploying cloud-based data platforms using Amazon Web Services (AWS) Integrating and processing large amounts of structured and unstructured data from various sources Implementing and optimizing ETL processes and data pipelines Developing and maintaining sec...

5-10 years of experience in database development or a related field. Proven experience with database design, development, and management. Experience working with large-scale databases and complex data environments Experience with data modelling and database design. Knowledge of database performance tuning and optimization. Architect, Develop and maintain tables, views, procedures, functions and packages in Database MUST HAVE Performing complex relational databases queries using SQL (AWS RDS for PostgreSQL) and Oracle PLSQL MUST HAVE Familiarity with ETL processes and tools (AWS Batch, AWS Glue etc) MUST HAVE Familiarity with CI/CD Pipelines, Jenkins Deployment, Git Repository MUST HAVE Perfo...

Role Description: As a Senior Cloud Data Platform (AWS) Specialist at Incedo, you will be responsible for designing, deploying and maintaining cloud-based data platforms on the AWS platform. You will work with data engineers, data scientists and business analysts to understand business requirements and design scalable, reliable and cost-effective solutions that meet those requirements. Roles & Responsibilities: Designing, developing and deploying cloud-based data platforms using Amazon Web Services (AWS) Integrating and processing large amounts of structured and unstructured data from various sources Implementing and optimizing ETL processes and data pipelines Developing and maintaining secu...

Role & responsibilities Design, develop, and deploy interactive dashboards, reports, and data visualizations using Power BI to support business decision-making. • Extract, transform, and load (ETL) data from various sources (e.g., SQL databases, Excel, APIs, cloud platforms) for analysis and reporting. • Collaborate with business stakeholders to gather requirements, identify key performance indicators (KPIs), and deliver tailored BI solutions. • Optimize data models to ensure performance, scalability, and accuracy of reporting outputs. • Integrate AI analytics capabilities into data and reporting services • Maintain and enhance existing BI solutions, troubleshoot issues, and ensure data inte...

We are seeking an experienced Amazon Redshift Developer / Data Engineer to design, develop, and optimize cloud-based data warehousing solutions. The ideal candidate should have expertise in Amazon Redshift, ETL processes, SQL optimization, and cloud-based data lake architectures. This role involves working with large-scale datasets, performance tuning, and building scalable data pipelines. Key Responsibilities: Design, develop, and maintain data models, schemas, and stored procedures in Amazon Redshift. Optimize Redshift performance using distribution styles, sort keys, and compression techniques. Build and maintain ETL/ELT data pipelines using AWS Glue, AWS Lambda, Apache Airflow, and dbt. ...

Key Responsibilities: Team Leadership & Technical Mentorship: Lead, manage, and mentor a team of data engineers, fostering a culture of technical excellence and collaborative problem-solving. Conduct code reviews, provide architectural guidance. Hands-On Technical Contribution: Architecting and implementing critical components of the data platform. Expertise with PySpark, Scala, and SQL will be essential. Architectural Ownership: Design and own the roadmap for the data ecosystem. Lead the architecture of scalable and resilient data solutions, including Data Lakehouse , real-time streaming services using Kafka , and large-scale batch processing jobs using Apache Spark . Platform Modernization...

Role Description: As a Senior Cloud Data Platform (AWS) Specialist at Incedo, you will be responsible for designing, deploying and maintaining cloud-based data platforms on the AWS platform. You will work with data engineers, data scientists and business analysts to understand business requirements and design scalable, reliable and cost-effective solutions that meet those requirements. Roles & Responsibilities: Designing, developing and deploying cloud-based data platforms using Amazon Web Services (AWS) Integrating and processing large amounts of structured and unstructured data from various sources Implementing and optimizing ETL processes and data pipelines Developing and maintaining secu...

About the Role : Sr. AWS Data Engineer Specialization : Must have : AWS(8) Key Responsibilities : 8+ Exp 8+ years of Data Engineering experience in a Production cloud infrastructure AWS services - Glue, Redshift, RDS, CloudWatch, CloudFormation, S3, IAM etc. 5+ years’ experience working in a Big Data ecosystem processing data; includes file systems, data structures/databases, automation, security, messaging, movement, etc. • 6+years in Glue development and 4+ years of experience in development in Python. • Experience in translation of Data mapping documents into PySpark ETL code compatible to be able to run on Glue. • Proficiency in Python and SQL is a must. Qualifications : BTech Additional...

About The Role Project Role : Cloud Platform Engineer Project Role Description : Designs, builds, tests, and deploys cloud application solutions that integrate cloud and non-cloud infrastructure. Can deploy infrastructure and platform environments, creates a proof of architecture to test architecture viability, security and performance. Must have skills : AWS Analytics Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Cloud Platform Engineer, you will design, build, test, and deploy cloud application solutions that seamlessly integrate both cloud and non-cloud infrastructure. Your typical day will involv...

About The Role Project Role : Cloud Platform Engineer Project Role Description : Designs, builds, tests, and deploys cloud application solutions that integrate cloud and non-cloud infrastructure. Can deploy infrastructure and platform environments, creates a proof of architecture to test architecture viability, security and performance. Must have skills : AWS Analytics Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Cloud Platform Engineer, you will design, build, test, and deploy cloud application solutions that seamlessly integrate both cloud and non-cloud infrastructure. Your typical day will involv...

About The Role Project Role : Cloud Platform Engineer Project Role Description : Designs, builds, tests, and deploys cloud application solutions that integrate cloud and non-cloud infrastructure. Can deploy infrastructure and platform environments, creates a proof of architecture to test architecture viability, security and performance. Must have skills : AWS Analytics, C#, WorkFlows Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Cloud Platform Engineer, you will design, build, test, and deploy cloud application solutions that seamlessly integrate both cloud and non-cloud infrastructure. Your typical ...

Must-Have: Overall 4-9 years of IT Exp 4+ years of AWS related project Good to have Associate Level and Professional Level AWS Certification In depth knowledge of following AWS Services required: S3, EC2, EMR, Severless, Athena, AWS Glue, Lambda, Step Functions Cloud Databases (Must have) AWS Aurora, Singlestore, RedShift, Snowflake Big Data (Must have) - Hadoop, Hive, Spark, YARN Programming Language (Must have) Scala, Python, Shell Scripts, PySpark Operating System (Must have) - Any flavor of Linux, Windows Must have very strong SQL Skills Orchestration Tools (Must have): Apache Airflow Expertise in developing ETL workflows comprising complex transformations like SCD, deduplications, aggre...

We are looking for Data Engineer ( AWS, Confluent & Snaplogic ) Data Integration : Integrate data from various Siemens organizations into our data factory, ensuring seamless data flow and real-time data fetching. Data Processing : Implement and manage large-scale data processing solutions using AWS Glue, ensuring efficient and reliable data transformation and loading. Data Storage : Store and manage data in a large-scale data lake, utilizing Iceberg tables in Snowflake for optimized data storage and retrieval. Data Transformation : Apply various data transformations to prepare data for analysis and reporting, ensuring data quality and consistency. Data Products : Create and maintain data pro...

We are looking for Data Engineer ( AWS, Confluent & Snaplogic ) Data Integration : Integrate data from various Siemens organizations into our data factory, ensuring seamless data flow and real-time data fetching. Data Processing : Implement and manage large-scale data processing solutions using AWS Glue, ensuring efficient and reliable data transformation and loading. Data Storage : Store and manage data in a large-scale data lake, utilizing Iceberg tables in Snowflake for optimized data storage and retrieval. Data Transformation : Apply various data transformations to prepare data for analysis and reporting, ensuring data quality and consistency. Data Products : Create and maintain data pro...

Role & responsibilities Cloud and AWS Expertise: In-depth knowledge of AWS services related to data engineering: EC2, S3, RDS, DynamoDB, Redshift, Glue, Lambda, Step Functions, Kinesis, Iceberg,EMR, and Athena. Strong understanding of cloud architecture and best practices for high availability and fault tolerance. Data Engineering Concepts: Expertise in ETL/ELT processes, data modeling, and data warehousing. Knowledge of data lakes, data warehouses, and big data processing frameworks like Apache Hadoop and Spark. Proficiency in handling structured and unstructured data. Programming and Scripting: Proficiency in Python, Pyspark and SQLfor data manipulation and pipeline development. Expertise ...

Mandatory Skills : Data Engineer-Combination of skills- Strong expertise in Snowflake including data modeling, ETL processes, and performance tuning. Proficient in programming languages such as Python, Java, and with Strong SQL. Familiarity with cloud platforms (AWS) and their integration with Snowflake. Detailed JD with Roles & Responsibilities : MUST SKILLS AWS-30% SQL-50% Python-20% Airflow- 20% SF- Basic Detailed JD Lead Data Engineer to play a key role in a critical data platform migration initiative. In this role, you will lead a team of talented data engineers in transitioning our existing data infrastructure from PySpark, Athena, and BigQuery to a modern stack centered around dbt and...

We seek a Senior-Level AWS Data Engineer who shares our passion for innovation and change. This role is critical to helping our business partners evolve and adapt to consumers' personalized expectations in this new technological era. Looking at highly skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will have a strong background in designing, developing, and managing data pipelines, working with cloud technologies, and optimizing data workflows. You will play a key role in supporting our data-driven initiatives and ensuring the seamless integration and analysis of large datasets. What will help you succeed: Fluent English Python, PySpark, SparkSQL, and SQL. A...

Role & responsibilities : AWS Resdshift, AWS Glue

Role & responsibilities : AWS Resdshift, AWS Glue

Role & responsibilities : AWS Resdshift, AWS Glue

Desired Knowledge and Skills: Experience with most of the cloud products such as Amazon AWS. Experience as developer in multiple cloud technologies including AWS EC2, S3, Amazon API Gateway, , AWS Lambda, AWS Glue, AWS RDS. Good knowledge on AWS environment and Service knowledge with S3 storage understanding. Must have good knowledge of AWS Glue and serverless architecture. • Collaborate with data analysts and stakeholders to meet data requirements. • Must have hands on experience of Amazon Redshift Architecture. AWS Redshift experience for DB design AWS Pipeline knowledge to develop ETL for data movement to Redshift, experience to map the source to target rules and fields. Strong in writing...

Desired Knowledge and Skills: Experience with most of the cloud products such as Amazon AWS. Experience as developer in multiple cloud technologies including AWS EC2, S3, Amazon API Gateway, , AWS Lambda, AWS Glue, AWS RDS. Good knowledge on AWS environment and Service knowledge with S3 storage understanding. Must have good knowledge of AWS Glue and serverless architecture. • Collaborate with data analysts and stakeholders to meet data requirements. • Must have hands on experience of Amazon Redshift Architecture. AWS Redshift experience for DB design AWS Pipeline knowledge to develop ETL for data movement to Redshift, experience to map the source to target rules and fields. Strong in writing...

Desired Knowledge and Skills: Experience with most of the cloud products such as Amazon AWS. Experience as developer in multiple cloud technologies including AWS EC2, S3, Amazon API Gateway, , AWS Lambda, AWS Glue, AWS RDS. Good knowledge on AWS environment and Service knowledge with S3 storage understanding. Must have good knowledge of AWS Glue and serverless architecture. • Collaborate with data analysts and stakeholders to meet data requirements. • Must have hands on experience of Amazon Redshift Architecture. AWS Redshift experience for DB design AWS Pipeline knowledge to develop ETL for data movement to Redshift, experience to map the source to target rules and fields. Strong in writing...