1333 Aws Glue Jobs - Page 30

About The Role Project Role : Cloud Platform Engineer Project Role Description : Designs, builds, tests, and deploys cloud application solutions that integrate cloud and non-cloud infrastructure. Can deploy infrastructure and platform environments, creates a proof of architecture to test architecture viability, security and performance. Must have skills : AWS Analytics Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Cloud Platform Engineer, you will design, build, test, and deploy cloud application solutions that seamlessly integrate both cloud and non-cloud infrastructure. Your typical day will involv...

About The Role Project Role : Cloud Platform Engineer Project Role Description : Designs, builds, tests, and deploys cloud application solutions that integrate cloud and non-cloud infrastructure. Can deploy infrastructure and platform environments, creates a proof of architecture to test architecture viability, security and performance. Must have skills : AWS Analytics, C#, WorkFlows Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Cloud Platform Engineer, you will design, build, test, and deploy cloud application solutions that seamlessly integrate both cloud and non-cloud infrastructure. Your typical ...

Must-Have: Overall 4-9 years of IT Exp 4+ years of AWS related project Good to have Associate Level and Professional Level AWS Certification In depth knowledge of following AWS Services required: S3, EC2, EMR, Severless, Athena, AWS Glue, Lambda, Step Functions Cloud Databases (Must have) AWS Aurora, Singlestore, RedShift, Snowflake Big Data (Must have) - Hadoop, Hive, Spark, YARN Programming Language (Must have) Scala, Python, Shell Scripts, PySpark Operating System (Must have) - Any flavor of Linux, Windows Must have very strong SQL Skills Orchestration Tools (Must have): Apache Airflow Expertise in developing ETL workflows comprising complex transformations like SCD, deduplications, aggre...

We are looking for Data Engineer ( AWS, Confluent & Snaplogic ) Data Integration : Integrate data from various Siemens organizations into our data factory, ensuring seamless data flow and real-time data fetching. Data Processing : Implement and manage large-scale data processing solutions using AWS Glue, ensuring efficient and reliable data transformation and loading. Data Storage : Store and manage data in a large-scale data lake, utilizing Iceberg tables in Snowflake for optimized data storage and retrieval. Data Transformation : Apply various data transformations to prepare data for analysis and reporting, ensuring data quality and consistency. Data Products : Create and maintain data pro...

We are looking for Data Engineer ( AWS, Confluent & Snaplogic ) Data Integration : Integrate data from various Siemens organizations into our data factory, ensuring seamless data flow and real-time data fetching. Data Processing : Implement and manage large-scale data processing solutions using AWS Glue, ensuring efficient and reliable data transformation and loading. Data Storage : Store and manage data in a large-scale data lake, utilizing Iceberg tables in Snowflake for optimized data storage and retrieval. Data Transformation : Apply various data transformations to prepare data for analysis and reporting, ensuring data quality and consistency. Data Products : Create and maintain data pro...

Role & responsibilities Cloud and AWS Expertise: In-depth knowledge of AWS services related to data engineering: EC2, S3, RDS, DynamoDB, Redshift, Glue, Lambda, Step Functions, Kinesis, Iceberg,EMR, and Athena. Strong understanding of cloud architecture and best practices for high availability and fault tolerance. Data Engineering Concepts: Expertise in ETL/ELT processes, data modeling, and data warehousing. Knowledge of data lakes, data warehouses, and big data processing frameworks like Apache Hadoop and Spark. Proficiency in handling structured and unstructured data. Programming and Scripting: Proficiency in Python, Pyspark and SQLfor data manipulation and pipeline development. Expertise ...

Mandatory Skills : Data Engineer-Combination of skills- Strong expertise in Snowflake including data modeling, ETL processes, and performance tuning. Proficient in programming languages such as Python, Java, and with Strong SQL. Familiarity with cloud platforms (AWS) and their integration with Snowflake. Detailed JD with Roles & Responsibilities : MUST SKILLS AWS-30% SQL-50% Python-20% Airflow- 20% SF- Basic Detailed JD Lead Data Engineer to play a key role in a critical data platform migration initiative. In this role, you will lead a team of talented data engineers in transitioning our existing data infrastructure from PySpark, Athena, and BigQuery to a modern stack centered around dbt and...

We seek a Senior-Level AWS Data Engineer who shares our passion for innovation and change. This role is critical to helping our business partners evolve and adapt to consumers' personalized expectations in this new technological era. Looking at highly skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will have a strong background in designing, developing, and managing data pipelines, working with cloud technologies, and optimizing data workflows. You will play a key role in supporting our data-driven initiatives and ensuring the seamless integration and analysis of large datasets. What will help you succeed: Fluent English Python, PySpark, SparkSQL, and SQL. A...

Role & responsibilities : AWS Resdshift, AWS Glue

Role & responsibilities : AWS Resdshift, AWS Glue

Role & responsibilities : AWS Resdshift, AWS Glue

Desired Knowledge and Skills: Experience with most of the cloud products such as Amazon AWS. Experience as developer in multiple cloud technologies including AWS EC2, S3, Amazon API Gateway, , AWS Lambda, AWS Glue, AWS RDS. Good knowledge on AWS environment and Service knowledge with S3 storage understanding. Must have good knowledge of AWS Glue and serverless architecture. • Collaborate with data analysts and stakeholders to meet data requirements. • Must have hands on experience of Amazon Redshift Architecture. AWS Redshift experience for DB design AWS Pipeline knowledge to develop ETL for data movement to Redshift, experience to map the source to target rules and fields. Strong in writing...

Desired Knowledge and Skills: Experience with most of the cloud products such as Amazon AWS. Experience as developer in multiple cloud technologies including AWS EC2, S3, Amazon API Gateway, , AWS Lambda, AWS Glue, AWS RDS. Good knowledge on AWS environment and Service knowledge with S3 storage understanding. Must have good knowledge of AWS Glue and serverless architecture. • Collaborate with data analysts and stakeholders to meet data requirements. • Must have hands on experience of Amazon Redshift Architecture. AWS Redshift experience for DB design AWS Pipeline knowledge to develop ETL for data movement to Redshift, experience to map the source to target rules and fields. Strong in writing...

Desired Knowledge and Skills: Experience with most of the cloud products such as Amazon AWS. Experience as developer in multiple cloud technologies including AWS EC2, S3, Amazon API Gateway, , AWS Lambda, AWS Glue, AWS RDS. Good knowledge on AWS environment and Service knowledge with S3 storage understanding. Must have good knowledge of AWS Glue and serverless architecture. • Collaborate with data analysts and stakeholders to meet data requirements. • Must have hands on experience of Amazon Redshift Architecture. AWS Redshift experience for DB design AWS Pipeline knowledge to develop ETL for data movement to Redshift, experience to map the source to target rules and fields. Strong in writing...

Desired Knowledge and Skills: Experience with most of the cloud products such as Amazon AWS. Experience as developer in multiple cloud technologies including AWS EC2, S3, Amazon API Gateway, , AWS Lambda, AWS Glue, AWS RDS. Good knowledge on AWS environment and Service knowledge with S3 storage understanding. Must have good knowledge of AWS Glue and serverless architecture. • Collaborate with data analysts and stakeholders to meet data requirements. • Must have hands on experience of Amazon Redshift Architecture. AWS Redshift experience for DB design AWS Pipeline knowledge to develop ETL for data movement to Redshift, experience to map the source to target rules and fields. Strong in writing...

Desired Knowledge and Skills: Experience with most of the cloud products such as Amazon AWS. Experience as developer in multiple cloud technologies including AWS EC2, S3, Amazon API Gateway, , AWS Lambda, AWS Glue, AWS RDS. Good knowledge on AWS environment and Service knowledge with S3 storage understanding. Must have good knowledge of AWS Glue and serverless architecture. • Collaborate with data analysts and stakeholders to meet data requirements. • Must have hands on experience of Amazon Redshift Architecture. AWS Redshift experience for DB design AWS Pipeline knowledge to develop ETL for data movement to Redshift, experience to map the source to target rules and fields. Strong in writing...

Desired Knowledge and Skills: Experience with most of the cloud products such as Amazon AWS. Experience as developer in multiple cloud technologies including AWS EC2, S3, Amazon API Gateway, , AWS Lambda, AWS Glue, AWS RDS. Good knowledge on AWS environment and Service knowledge with S3 storage understanding. Must have good knowledge of AWS Glue and serverless architecture. • Collaborate with data analysts and stakeholders to meet data requirements. • Must have hands on experience of Amazon Redshift Architecture. AWS Redshift experience for DB design AWS Pipeline knowledge to develop ETL for data movement to Redshift, experience to map the source to target rules and fields. Strong in writing...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

We are seeking a highly skilled and experienced Senior Data Engineer to lead the end-to-end development of complex models for compliance and supervision. The ideal candidate will have deep expertise in cloud-based infrastructure, ETL pipeline development, and financial domains, with a strong focus on creating robust, scalable, and efficient solutions. Key Responsibilities : Model Development: Lead the development of advanced models using AWS services such as EMR, Glue, and Glue Notebooks. Cloud Infrastructure: Design, build, and optimize scalable cloud infrastructure solutions with a minimum of 5 years of experience. ETL Pipeline Development : Create, manage, and optimize ETL pipelines using...

Role & responsibilities 1+ years of experience in the software industry Basic proficiency in Python for data processing and automation tasks Foundational knowledge of SQL, with some exposure to working with tools like Redshift, Snowflake, or Big Query is an advantage. Understanding of workflow orchestration concepts, with exposure to tools like Apache Airflow. Hands-on experience in any GCP or AWS services, such as Dataproc, Cloud Functions, and Cloud Storage. Interest in or familiarity with low-code reporting tools, like Retool for building reporting interfaces. Familiarity with data transformation and modelling tools, such as Dataform or DBT (prior hands-on experience is a plus). Awareness...

Greetings from Encora Innovation Labs!(Encora)! Encora is looking for DataOps Engineer with 5-8 years experience in Data Engineer, Spark, AWS services, Python, AWS Glue, Redshift, Lambda and Airflow. Pease find the below detailed job description and the company profile for your better understanding. Position: DataOps Engineer Experience: 5-8 years Job Location: Chennai/Bangalore/Pune/Hyderabad/Noida Position Type: Full time Qualification: Any graduate Technical Skills: AWS services AWS Glue, Redshift, Lambda, IAM, IaC Terraform, CloudFormation, GitHub. Programming - Python, SQL and Spark Data Engineering - Data pipelines, Airflow orchestration Job Summary Responsibilities and Duties • Monito...

Strong hands-on experience with AWS Glue, PySpark, Lambda, S3, Athena, and RDS (Aurora/Postgres). Experience in API Gateway.

Role & responsibilities Job Description Summary The purpose of this role is to oversee the development of our database marketing solutions, using database technologies such as Microsoft SQL Server/Azure, Amazon Redshift, Google BigQuery. The role will be involved in design, specifications, troubleshooting and issue resolution. The ability to communicate to both technical and non-technical audiences is key. Business Title Associate Technical Architect Years of Experience 10+ Years Must have skills 1. Database (one or more of MS SQL Server, Oracle, Cloud SQL, Cloud Spanner, etc.) 2. Data Warehouse (one or more of Big Query, SnowFlake, etc.) 3. ETL tool (two or more of Cloud Data Fusion, Datafl...

We are seeking a Lead/Senior Data Engineer with 7-12 years of experience to architect, develop, and optimize data solutions in a cloud-native environment. The role requires strong expertise in AWS Glue, PySpark, and Python with a proven ability to design scalable data pipelines and frameworks for large-scale enterprise systems. Prior exposure to financial services or regulated environments is a strong advantage. Key Responsibilities Design and implement secure, scalable pipelines using AWS Glue, PySpark, EMR, S3, Lambda, and other AWS services. Lead ETL development for structured and semi-structured data, ensuring high performance and reliability. Build reusable frameworks, automation tools,...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...