15749 Hadoop Jobs - Page 38

Design, build, and maintain scalable ETL/ELT pipelines using AWS Glue, Lambda, Step Functions, and Apache Spark . Develop and optimize data lake and data warehouse architectures using AWS S3, Redshift, and Athena . Implement data ingestion, transformation, and storage solutions using AWS Glue, Kinesis, and Kafka . Work with structured and unstructured data to develop efficient data pipelines . Optimize query performance in SQL-based and NoSQL databases (Redshift, DynamoDB, Aurora, PostgreSQL, etc.). Ensure data security, compliance, and governance using IAM roles, KMS encryption, and AWS Lake Formation . Automate data workflows using Terraform, CloudFormation, or CDK . Monitor and troublesho...

Design, build, and maintain scalable ETL/ELT pipelines using AWS Glue, Lambda, Step Functions, and Apache Spark . Develop and optimize data lake and data warehouse architectures using AWS S3, Redshift, and Athena . Implement data ingestion, transformation, and storage solutions using AWS Glue, Kinesis, and Kafka . Work with structured and unstructured data to develop efficient data pipelines . Optimize query performance in SQL-based and NoSQL databases (Redshift, DynamoDB, Aurora, PostgreSQL, etc.). Ensure data security, compliance, and governance using IAM roles, KMS encryption, and AWS Lake Formation . Automate data workflows using Terraform, CloudFormation, or CDK . Monitor and troublesho...

Design, build, and maintain scalable ETL/ELT pipelines using AWS Glue, Lambda, Step Functions, and Apache Spark . Develop and optimize data lake and data warehouse architectures using AWS S3, Redshift, and Athena . Implement data ingestion, transformation, and storage solutions using AWS Glue, Kinesis, and Kafka . Work with structured and unstructured data to develop efficient data pipelines . Optimize query performance in SQL-based and NoSQL databases (Redshift, DynamoDB, Aurora, PostgreSQL, etc.). Ensure data security, compliance, and governance using IAM roles, KMS encryption, and AWS Lake Formation . Automate data workflows using Terraform, CloudFormation, or CDK . Monitor and troublesho...

Design, build, and maintain scalable ETL/ELT pipelines using AWS Glue, Lambda, Step Functions, and Apache Spark . Develop and optimize data lake and data warehouse architectures using AWS S3, Redshift, and Athena . Implement data ingestion, transformation, and storage solutions using AWS Glue, Kinesis, and Kafka . Work with structured and unstructured data to develop efficient data pipelines . Optimize query performance in SQL-based and NoSQL databases (Redshift, DynamoDB, Aurora, PostgreSQL, etc.). Ensure data security, compliance, and governance using IAM roles, KMS encryption, and AWS Lake Formation . Automate data workflows using Terraform, CloudFormation, or CDK . Monitor and troublesho...

Design, build, and maintain scalable ETL/ELT pipelines using AWS Glue, Lambda, Step Functions, and Apache Spark . Develop and optimize data lake and data warehouse architectures using AWS S3, Redshift, and Athena . Implement data ingestion, transformation, and storage solutions using AWS Glue, Kinesis, and Kafka . Work with structured and unstructured data to develop efficient data pipelines . Optimize query performance in SQL-based and NoSQL databases (Redshift, DynamoDB, Aurora, PostgreSQL, etc.). Ensure data security, compliance, and governance using IAM roles, KMS encryption, and AWS Lake Formation . Automate data workflows using Terraform, CloudFormation, or CDK . Monitor and troublesho...

Primary Skills Azure Data Factory, Azure Synapse Analytics, Azure Databricks: Extensive experience in building and managing scalable data pipelines for data integration, transformation, and analysis.Azure Data Lake Storage, Azure SQL Database: Proven ability to manage and optimize data storage solutions, ensuring data accessibility and reliability. Azure Machine Learning: Expertise in developing, training, and deploying machine learning models using Azure's machine learning tools and services. Data Warehousing & Data Modeling: Strong experience with designing and maintaining data warehouses, with deep understanding of ETL processes and data models. Programming in Python or R: Skilled in writ...

Design, build, and maintain scalable ETL/ELT pipelines using AWS Glue, Lambda, Step Functions, and Apache Spark . Develop and optimize data lake and data warehouse architectures using AWS S3, Redshift, and Athena . Implement data ingestion, transformation, and storage solutions using AWS Glue, Kinesis, and Kafka . Work with structured and unstructured data to develop efficient data pipelines . Optimize query performance in SQL-based and NoSQL databases (Redshift, DynamoDB, Aurora, PostgreSQL, etc.). Ensure data security, compliance, and governance using IAM roles, KMS encryption, and AWS Lake Formation . Automate data workflows using Terraform, CloudFormation, or CDK . Monitor and troublesho...

Design, build, and maintain scalable ETL/ELT pipelines using AWS Glue, Lambda, Step Functions, and Apache Spark . Develop and optimize data lake and data warehouse architectures using AWS S3, Redshift, and Athena . Implement data ingestion, transformation, and storage solutions using AWS Glue, Kinesis, and Kafka . Work with structured and unstructured data to develop efficient data pipelines . Optimize query performance in SQL-based and NoSQL databases (Redshift, DynamoDB, Aurora, PostgreSQL, etc.). Ensure data security, compliance, and governance using IAM roles, KMS encryption, and AWS Lake Formation . Automate data workflows using Terraform, CloudFormation, or CDK . Monitor and troublesho...

Design, build, and maintain scalable ETL/ELT pipelines using AWS Glue, Lambda, Step Functions, and Apache Spark . Develop and optimize data lake and data warehouse architectures using AWS S3, Redshift, and Athena . Implement data ingestion, transformation, and storage solutions using AWS Glue, Kinesis, and Kafka . Work with structured and unstructured data to develop efficient data pipelines . Optimize query performance in SQL-based and NoSQL databases (Redshift, DynamoDB, Aurora, PostgreSQL, etc.). Ensure data security, compliance, and governance using IAM roles, KMS encryption, and AWS Lake Formation . Automate data workflows using Terraform, CloudFormation, or CDK . Monitor and troublesho...

Design, build, and maintain scalable ETL/ELT pipelines using AWS Glue, Lambda, Step Functions, and Apache Spark . Develop and optimize data lake and data warehouse architectures using AWS S3, Redshift, and Athena . Implement data ingestion, transformation, and storage solutions using AWS Glue, Kinesis, and Kafka . Work with structured and unstructured data to develop efficient data pipelines . Optimize query performance in SQL-based and NoSQL databases (Redshift, DynamoDB, Aurora, PostgreSQL, etc.). Ensure data security, compliance, and governance using IAM roles, KMS encryption, and AWS Lake Formation . Automate data workflows using Terraform, CloudFormation, or CDK . Monitor and troublesho...

Design, build, and maintain scalable ETL/ELT pipelines using AWS Glue, Lambda, Step Functions, and Apache Spark . Develop and optimize data lake and data warehouse architectures using AWS S3, Redshift, and Athena . Implement data ingestion, transformation, and storage solutions using AWS Glue, Kinesis, and Kafka . Work with structured and unstructured data to develop efficient data pipelines . Optimize query performance in SQL-based and NoSQL databases (Redshift, DynamoDB, Aurora, PostgreSQL, etc.). Ensure data security, compliance, and governance using IAM roles, KMS encryption, and AWS Lake Formation . Automate data workflows using Terraform, CloudFormation, or CDK . Monitor and troublesho...

Design, build, and maintain scalable ETL/ELT pipelines using AWS Glue, Lambda, Step Functions, and Apache Spark . Develop and optimize data lake and data warehouse architectures using AWS S3, Redshift, and Athena . Implement data ingestion, transformation, and storage solutions using AWS Glue, Kinesis, and Kafka . Work with structured and unstructured data to develop efficient data pipelines . Optimize query performance in SQL-based and NoSQL databases (Redshift, DynamoDB, Aurora, PostgreSQL, etc.). Ensure data security, compliance, and governance using IAM roles, KMS encryption, and AWS Lake Formation . Automate data workflows using Terraform, CloudFormation, or CDK . Monitor and troublesho...

Design, build, and maintain scalable ETL/ELT pipelines using AWS Glue, Lambda, Step Functions, and Apache Spark . Develop and optimize data lake and data warehouse architectures using AWS S3, Redshift, and Athena . Implement data ingestion, transformation, and storage solutions using AWS Glue, Kinesis, and Kafka . Work with structured and unstructured data to develop efficient data pipelines . Optimize query performance in SQL-based and NoSQL databases (Redshift, DynamoDB, Aurora, PostgreSQL, etc.). Ensure data security, compliance, and governance using IAM roles, KMS encryption, and AWS Lake Formation . Automate data workflows using Terraform, CloudFormation, or CDK . Monitor and troublesho...

Senior DE: Same as above but need to have experience managing data engineers, have experience working with stakeholders, actively engaging for key technical discussion and have a very good technical knowledge. Should have at least 7 years experience working in data engineering. Job responsibilities Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and ...

Senior DE: Same as above but need to have experience managing data engineers, have experience working with stakeholders, actively engaging for key technical discussion and have a very good technical knowledge. Should have at least 7 years experience working in data engineering. Job responsibilities Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and ...

Senior DE: Same as above but need to have experience managing data engineers, have experience working with stakeholders, actively engaging for key technical discussion and have a very good technical knowledge. Should have at least 7 years experience working in data engineering. Job responsibilities Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and ...

Senior DE: Same as above but need to have experience managing data engineers, have experience working with stakeholders, actively engaging for key technical discussion and have a very good technical knowledge. Should have at least 7 years experience working in data engineering. Job responsibilities Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and ...

Senior DE: Same as above but need to have experience managing data engineers, have experience working with stakeholders, actively engaging for key technical discussion and have a very good technical knowledge. Should have at least 7 years experience working in data engineering. Job responsibilities Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and ...

Senior DE: Same as above but need to have experience managing data engineers, have experience working with stakeholders, actively engaging for key technical discussion and have a very good technical knowledge. Should have at least 7 years experience working in data engineering. Job responsibilities Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and ...

Senior DE: Same as above but need to have experience managing data engineers, have experience working with stakeholders, actively engaging for key technical discussion and have a very good technical knowledge. Should have at least 7 years experience working in data engineering. Job responsibilities Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and ...

Senior DE: Same as above but need to have experience managing data engineers, have experience working with stakeholders, actively engaging for key technical discussion and have a very good technical knowledge. Should have at least 7 years experience working in data engineering. Job responsibilities Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and ...

Senior DE: Same as above but need to have experience managing data engineers, have experience working with stakeholders, actively engaging for key technical discussion and have a very good technical knowledge. Should have at least 7 years experience working in data engineering. Job responsibilities Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and ...

Senior DE: Same as above but need to have experience managing data engineers, have experience working with stakeholders, actively engaging for key technical discussion and have a very good technical knowledge. Should have at least 7 years experience working in data engineering. Job responsibilities Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and ...

Senior DE: Same as above but need to have experience managing data engineers, have experience working with stakeholders, actively engaging for key technical discussion and have a very good technical knowledge. Should have at least 7 years experience working in data engineering. Job responsibilities Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and ...

Senior DE: Same as above but need to have experience managing data engineers, have experience working with stakeholders, actively engaging for key technical discussion and have a very good technical knowledge. Should have at least 7 years experience working in data engineering. Job responsibilities Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and ...