1330 Aws Glue Jobs - Page 6

AWS data developers with 8-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferred Skills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shift Good communication skills and can deliver independently Mandatory Competencies Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift Beh - Communication Big Data - Big Data - Pyspark Database - Database Programming - SQL Programming Language - Python - Apache Airflow

Responsibilities Data Architecture: Develop and maintain the overall data architecture, ensuring scalability, performance, and data quality. AWS Data Services: Expertise in using AWS data services such as AWS Glue, S3, SNS, SES, Dynamo DB, Redshift, Cloud formation, Cloud watch, IAM, DMS, Event bridge scheduler etc. Data Warehousing: Design and implement data warehouses on AWS, leveraging AWS Redshift or other suitable options. Data Lakes: Build and manage data lakes on AWS using AWS S3 and other relevant services. Data Pipelines: Design and develop efficient data pipelines to extract, transform, and load data from various sources. Data Quality: Implement data quality frameworks and best pra...

Mandatory Skills 3+ years of hands-on strong experience in Ab-Initio, Conduct IT technology Very good knowledge of Datawarehouse, ETL concepts, Unix commands and shell/bash script Strong knowledge of Oracle database, SQL queries, performance tuning of queries Good understanding of processing data using XML JSON Experience with Agile (Scrum) methodology and software development approach Must come financial services/capital markets/investment banking Great interpersonal and communication skills Can work independently with minimum supervision Good Communication and analytical skills Flexible and adaptable working style to work with multiple stakeholders Open to work in UK Shift (10 AM to 9 PM I...

Looking to onboard a skilled professional with 6-8 years of experience in Pyspark, SQL, and AWS Glue. The ideal candidate will have a strong background in these technologies and excellent problem-solving skills. This position is located across Pan India. Roles and Responsibility Design, develop, and implement data processing pipelines using Pyspark and AWS Glue. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data warehouses using Snowflake and Snowpark. Optimize data processing workflows for performance and scalability. Troubleshoot and resolve technical issues related to data processing and storage. Ensure data quali...

We are looking for a skilled AWS Data Pipeline Engineer with 4 to 12 years of experience to manage data storage solutions on AWS, implement data processing workflows, and collaborate with cross-functional teams. The ideal candidate will have a strong understanding of core AWS services, cloud concepts, and the AWS Well-Architected Framework. Roles and Responsibility Managing data storage solutions on AWS, including Amazon S3, Amazon Redshift, and Amazon DynamoDB. Implementing and optimizing data processing workflows using AWS services like AWS Glue, Amazon EMR, and AWS Lambda. Collaborating with Spotfire Engineers and business analysts to ensure data accessibility and usability for analysis a...

Hi, Greetings from the IDES LABS, Job Posting Title: Senior Platform Engineer Description: Bachelors degree (Computer Science), masters degree or Technical Diploma or equivalent At least 8 years of experience in a similar role At least 5 years of experience on AWS and/or Azure At least 5 years of experience on Databricks At least 5 years of experience on multiples Azure and AWS PaaS solutions: Azure Data Factory, MSSQL, Azure storage, AWS S3, Cognitive search, CosmosDB, Event Hub, AWS glue Strong knowledge of AWS and Azure architecture design best practices Knowledge of ITIL & AGILE methodologies (certifications are a plus) Experience working with DevOps tools such as Git, CI/CD pipelines, A...

We are looking for a skilled AWS Datalake Lead with 4 to 8 years of experience to lead the technical design and architecture of AWS datalake and its related services, ensuring alignment with customer requirements, industry best practices, and project objectives. This position is based in Hyderabad. Roles and Responsibility Lead the technical design and architecture of AWS datalake and its related services. Conduct reviews to ensure adherence to coding standards and best practices. Provide technical support and resolve incidents, service requests, and minor enhancements. Manage datasets in AWS Data Lake, including adding, updating, or deleting them. Monitor storage usage and handle capacity p...

Plan, design, and execute end-to-end data migration projects from various data sources to Amazon Aurora PostgreSQL and Amazon DynamoDB. Collaborate with cross-functional teams to understand data requirements, perform data analysis, and define migration strategies. Develop and implement data transformation and manipulation procedures using Talend, AWS Glue, and AWS DMS to ensure data accuracy and integrity during the migration process. Optimize data migration workflows for efficiency and reliability, and monitor performance to identify and address potential bottlenecks. Collaborate with database administrators, data engineers, and developers to troubleshoot and resolve data-related issues. En...

PF Detection is mandatory Job Description: Minimum 5 years of experience in database development and ETL tools. Strong expertise in SQL and database platforms (e.g. SQL Server Oracle PostgreSQL). Proficiency in ETL tools (e.g. Informatica SSIS Talend DataStage) and scripting languages (e.g. Python Shell). Experience with data modeling and schema design. Familiarity with cloud databases and ETL tools (e.g. AWS Glue Azure Data Factory Snowflake). Understanding of data warehousing concepts and best practices

AWS data developers with 6-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferred Skills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shift Good communication skills and can deliver independently Mandatory Competencies Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift Big Data - Big Data - Pyspark Beh - Communication Database - Database Programming - SQL

AWS data developers with 8-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferred Skills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shift Good communication skills and can deliver independently Mandatory Competencies Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift Beh - Communication Big Data - Big Data - Pyspark Database - Database Programming - SQL Programming Language - Python - Apache Airflow

Airflow Data Engineer in AWS platform Job Title Apache Airflow Data Engineer ROLE” as per TCS Role Master • 4-8 years of experience in AWS, Apache Airflow (on Astronomer platform), Python, Pyspark, SQL • Good hands-on knowledge on SQL and Data Warehousing life cycle is an absolute requirement. • Experience in creating data pipelines and orchestrating using Apache Airflow • Significant experience with data migrations and development of Operational Data Stores, Enterprise Data Warehouses, Data Lake and Data Marts. • Good to have: Experience with cloud ETL and ELT in one of the tools like DBT/Glue/EMR or Matillion or any other ELT tool • Excellent communication skills to liaise with Business & ...

About the Role We are looking for a skilled Python Developer to join our development team. You will be responsible for designing, developing, and maintaining scalable backend applications and APIs using Python. The ideal candidate is passionate about writing clean, efficient code and enjoys solving complex technical challenges. Key Responsibilities Design, develop, and maintain backend applications and RESTful APIs using Python . Collaborate with front-end developers, product managers, and other stakeholders to define and implement technical solutions. Write clean, reusable, and efficient code following best practices. Integrate third-party APIs and data sources. Develop automated unit and i...

We are seeking an experienced PySpark Developer with strong expertise in big data processing and distributed computing. The candidate will design, develop, and optimize data pipelines to support large-scale analytics and data integration initiatives. Key Responsibilities Design, develop, and maintain scalable ETL pipelines using PySpark and Spark SQL. Work with large datasets in Hadoop, Databricks, or AWS/GCP/Azure environments. Optimize Spark jobs for performance and reliability. Collaborate with data engineers, analysts, and business teams to define data requirements. Integrate data from various sources (structured and unstructured). Implement best practices for data governance, quality, a...

Role Overview: You are a skilled PySpark Data Engineer who will be joining a dynamic team at Viraaj HR Solutions in India. Your role will involve designing and implementing robust data pipelines, optimizing data processing workflows, and collaborating with data scientists and analysts. Your strong analytical skills and ability to work in a fast-paced environment will be crucial for this position. Role Responsibilities: - Design, develop, and maintain robust data pipelines using PySpark. - Implement ETL processes for data extraction, transformation, and loading. - Work with structured and unstructured data sources to ensure data quality. - Optimize data processing workflows for better perform...

Role Overview: You are a highly skilled and experienced Senior ETL & Data Streaming Engineer with over 10 years of experience. Your main responsibility will be to design, develop, and maintain robust data pipelines. Your expertise in both batch ETL processes and real-time data streaming technologies, along with hands-on experience with AWS data services, will be crucial. Your track record in working with Data Lake architectures and traditional Data Warehousing environments will be essential for this role. Key Responsibilities: - Design, develop, and implement highly scalable, fault-tolerant, and performant ETL processes using industry-leading ETL tools to extract, transform, and load data fr...

Responsibilities: Design, develop, and deploy scalable, secure applications using AWS cloud-native technologies. Use AWS services like Lambda, Kinesis, Redshift, and API Gateway to build high-performance solutions. Architect serverless applications using AWS Lambda for event-driven computing. Build and maintain real-time or batched data pipelines Design and optimize data warehouses with Amazon Redshift for large-scale data storage and analysis. Implement event-driven architectures for efficient communication between various AWS services. Write and optimize PySpark code for the data processes to transform and load data. Ensure security and compliance with AWS best practices, including VPC, IA...

Responsibilities: Design, develop, and deploy scalable, secure applications using AWS cloud-native technologies. Use AWS services like Lambda, Kinesis, Redshift, and API Gateway to build high-performance solutions. Architect serverless applications using AWS Lambda for event-driven computing. Build and maintain real-time or batched data pipelines Design and optimize data warehouses with Amazon Redshift for large-scale data storage and analysis. Implement event-driven architectures for efficient communication between various AWS services. Write and optimize PySpark code for the data processes to transform and load data. Ensure security and compliance with AWS best practices, including VPC, IA...

Job description Hiring for AWS Developer Mandatory Skills: AWS cloud , AWS Lambda/Glue Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and detailed fun...

Job Title: Sr. Data Engineer Position Summary: We are seeking an experienced Data Engineer in leveraging AWS native technologies such as Lambda and Glue to build a data Lakehouse environment. The ideal candidate will have a strong background in Data Architecture, Data Modelling, data engineering, a deep understanding of AWS services, and proven leadership skills Job Functions And Responsibilities Design, develop, and maintain scalable Data Models, data pipelines using AWS native technologies including AWS Glue, Lamda, MySql Aurora / Heatwave databases etc. Implement best practices for data management, including data quality, data governance, and data security. Ensure high standards by review...

Role Overview: You are applying for the position of Senior Technical Director at Accordion in Hyderabad, Telangana. As a Senior Technical Director, you will be responsible for designing, developing, configuring/deploying, and maintaining technology solutions. Your role will involve understanding various tools & technologies to design and implement scalable solutions for clients. You must evaluate existing architectures, recommend upgrades, and enhance performance for both on-premises and cloud-based solutions. Strong business knowledge, familiarity with industry standards, and effective communication skills are essential for this role. Key Responsibilities: - Partner with clients to understa...

As the Director of Artificial Intelligence at Acentra Health's AI Center of Excellence, you will play a crucial role in shaping the enterprise AI strategy, working closely with business lines to identify and prioritize high-value AI opportunities. Your expertise in machine learning, generative AI, and agentic AI will be instrumental in providing architectural leadership, model selection, model tuning, and ML Ops support. **Key Responsibilities:** - **AI Strategy & Vision** - Contribute to defining Acentra Health's AI strategy within the AI Center of Excellence. - Collaborate with business lines to pinpoint high-value AI opportunities in ML, GenAI, and agents. - **Team Leadership** - Lead and...

Role Overview: Working at Bristol Myers Squibb is a unique experience where you will be challenged with meaningful work that transforms the lives of patients and your own career. As a Full Stack Developer II based in Hyderabad, India, you will be part of the GDD Business Insights & Technology team, contributing to data and analytics capabilities for RWD, Portfolio & Trial Operations functions. Your role involves building, designing, and enhancing user experience for data products, platforms, and services using Python, SQL, and React JS. You will collaborate with various stakeholders to ensure that user experience aligns with business objectives and technical requirements in a fast-paced envi...

Capgemini is hiring a Data Engineer to design, build, and maintain data architecture, databases, and ETL processes for a leading U.S. insurance client. The role involves working with SQL/NoSQL databases, optimizing ETL pipelines, and collaborating with analysts and stakeholders to deliver reliable data solutions. Candidates must have strong experience in Informatica , Snowflake , and SQL , along with good communication and analytical skills. Key Skills: AWS Glue Pyspark AWS Lambda Informatica Snowflake SQL

Senior Associate/ Manager - AWS Data Engineer (Contractual Role) We are seeking a highly skilled Senior Associate/ Manager - AWS Data Engineer to join our team in Kochi The ideal candidate will have experience in designing, developing, and deploying data engineering solutions on AWS The role is contractual for 6 months Responsibilities Design, develop, and deploy data engineering solutions on AWS, leveraging AWS services such as S3, DynamoDB, and Redshift Develop and maintain ETL processes using PySpark and AWS Glue, ensuring data quality and integrity Collaborate with cross-functional teams to design and implement data pipelines, ensuring seamless integration with existing systems Develop a...