1847 Aws Glue Jobs - Page 27

PF Detection is mandatory Job Description: Minimum 5 years of experience in database development and ETL tools. Strong expertise in SQL and database platforms (e.g. SQL Server Oracle PostgreSQL). Proficiency in ETL tools (e.g. Informatica SSIS Talend DataStage) and scripting languages (e.g. Python Shell). Experience with data modeling and schema design. Familiarity with cloud databases and ETL tools (e.g. AWS Glue Azure Data Factory Snowflake). Understanding of data warehousing concepts and best practices

AWS data developers with 6-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferred Skills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shift Good communication skills and can deliver independently Mandatory Competencies Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift Big Data - Big Data - Pyspark Beh - Communication Database - Database Programming - SQL

AWS data developers with 8-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferred Skills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shift Good communication skills and can deliver independently Mandatory Competencies Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift Beh - Communication Big Data - Big Data - Pyspark Database - Database Programming - SQL Programming Language - Python - Apache Airflow

Airflow Data Engineer in AWS platform Job Title Apache Airflow Data Engineer ROLE” as per TCS Role Master • 4-8 years of experience in AWS, Apache Airflow (on Astronomer platform), Python, Pyspark, SQL • Good hands-on knowledge on SQL and Data Warehousing life cycle is an absolute requirement. • Experience in creating data pipelines and orchestrating using Apache Airflow • Significant experience with data migrations and development of Operational Data Stores, Enterprise Data Warehouses, Data Lake and Data Marts. • Good to have: Experience with cloud ETL and ELT in one of the tools like DBT/Glue/EMR or Matillion or any other ELT tool • Excellent communication skills to liaise with Business & ...

About the Role We are looking for a skilled Python Developer to join our development team. You will be responsible for designing, developing, and maintaining scalable backend applications and APIs using Python. The ideal candidate is passionate about writing clean, efficient code and enjoys solving complex technical challenges. Key Responsibilities Design, develop, and maintain backend applications and RESTful APIs using Python . Collaborate with front-end developers, product managers, and other stakeholders to define and implement technical solutions. Write clean, reusable, and efficient code following best practices. Integrate third-party APIs and data sources. Develop automated unit and i...

We are seeking an experienced PySpark Developer with strong expertise in big data processing and distributed computing. The candidate will design, develop, and optimize data pipelines to support large-scale analytics and data integration initiatives. Key Responsibilities Design, develop, and maintain scalable ETL pipelines using PySpark and Spark SQL. Work with large datasets in Hadoop, Databricks, or AWS/GCP/Azure environments. Optimize Spark jobs for performance and reliability. Collaborate with data engineers, analysts, and business teams to define data requirements. Integrate data from various sources (structured and unstructured). Implement best practices for data governance, quality, a...

Role Overview: You are a skilled PySpark Data Engineer who will be joining a dynamic team at Viraaj HR Solutions in India. Your role will involve designing and implementing robust data pipelines, optimizing data processing workflows, and collaborating with data scientists and analysts. Your strong analytical skills and ability to work in a fast-paced environment will be crucial for this position. Role Responsibilities: - Design, develop, and maintain robust data pipelines using PySpark. - Implement ETL processes for data extraction, transformation, and loading. - Work with structured and unstructured data sources to ensure data quality. - Optimize data processing workflows for better perform...

Role Overview: You are a highly skilled and experienced Senior ETL & Data Streaming Engineer with over 10 years of experience. Your main responsibility will be to design, develop, and maintain robust data pipelines. Your expertise in both batch ETL processes and real-time data streaming technologies, along with hands-on experience with AWS data services, will be crucial. Your track record in working with Data Lake architectures and traditional Data Warehousing environments will be essential for this role. Key Responsibilities: - Design, develop, and implement highly scalable, fault-tolerant, and performant ETL processes using industry-leading ETL tools to extract, transform, and load data fr...

Responsibilities: Design, develop, and deploy scalable, secure applications using AWS cloud-native technologies. Use AWS services like Lambda, Kinesis, Redshift, and API Gateway to build high-performance solutions. Architect serverless applications using AWS Lambda for event-driven computing. Build and maintain real-time or batched data pipelines Design and optimize data warehouses with Amazon Redshift for large-scale data storage and analysis. Implement event-driven architectures for efficient communication between various AWS services. Write and optimize PySpark code for the data processes to transform and load data. Ensure security and compliance with AWS best practices, including VPC, IA...

Responsibilities: Design, develop, and deploy scalable, secure applications using AWS cloud-native technologies. Use AWS services like Lambda, Kinesis, Redshift, and API Gateway to build high-performance solutions. Architect serverless applications using AWS Lambda for event-driven computing. Build and maintain real-time or batched data pipelines Design and optimize data warehouses with Amazon Redshift for large-scale data storage and analysis. Implement event-driven architectures for efficient communication between various AWS services. Write and optimize PySpark code for the data processes to transform and load data. Ensure security and compliance with AWS best practices, including VPC, IA...

Job description Hiring for AWS Developer Mandatory Skills: AWS cloud , AWS Lambda/Glue Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and detailed fun...

Job Title: Sr. Data Engineer Position Summary: We are seeking an experienced Data Engineer in leveraging AWS native technologies such as Lambda and Glue to build a data Lakehouse environment. The ideal candidate will have a strong background in Data Architecture, Data Modelling, data engineering, a deep understanding of AWS services, and proven leadership skills Job Functions And Responsibilities Design, develop, and maintain scalable Data Models, data pipelines using AWS native technologies including AWS Glue, Lamda, MySql Aurora / Heatwave databases etc. Implement best practices for data management, including data quality, data governance, and data security. Ensure high standards by review...

Role Overview: You are applying for the position of Senior Technical Director at Accordion in Hyderabad, Telangana. As a Senior Technical Director, you will be responsible for designing, developing, configuring/deploying, and maintaining technology solutions. Your role will involve understanding various tools & technologies to design and implement scalable solutions for clients. You must evaluate existing architectures, recommend upgrades, and enhance performance for both on-premises and cloud-based solutions. Strong business knowledge, familiarity with industry standards, and effective communication skills are essential for this role. Key Responsibilities: - Partner with clients to understa...

As the Director of Artificial Intelligence at Acentra Health's AI Center of Excellence, you will play a crucial role in shaping the enterprise AI strategy, working closely with business lines to identify and prioritize high-value AI opportunities. Your expertise in machine learning, generative AI, and agentic AI will be instrumental in providing architectural leadership, model selection, model tuning, and ML Ops support. **Key Responsibilities:** - **AI Strategy & Vision** - Contribute to defining Acentra Health's AI strategy within the AI Center of Excellence. - Collaborate with business lines to pinpoint high-value AI opportunities in ML, GenAI, and agents. - **Team Leadership** - Lead and...

Role Overview: Working at Bristol Myers Squibb is a unique experience where you will be challenged with meaningful work that transforms the lives of patients and your own career. As a Full Stack Developer II based in Hyderabad, India, you will be part of the GDD Business Insights & Technology team, contributing to data and analytics capabilities for RWD, Portfolio & Trial Operations functions. Your role involves building, designing, and enhancing user experience for data products, platforms, and services using Python, SQL, and React JS. You will collaborate with various stakeholders to ensure that user experience aligns with business objectives and technical requirements in a fast-paced envi...

Capgemini is hiring a Data Engineer to design, build, and maintain data architecture, databases, and ETL processes for a leading U.S. insurance client. The role involves working with SQL/NoSQL databases, optimizing ETL pipelines, and collaborating with analysts and stakeholders to deliver reliable data solutions. Candidates must have strong experience in Informatica , Snowflake , and SQL , along with good communication and analytical skills. Key Skills: AWS Glue Pyspark AWS Lambda Informatica Snowflake SQL

Senior Associate/ Manager - AWS Data Engineer (Contractual Role) We are seeking a highly skilled Senior Associate/ Manager - AWS Data Engineer to join our team in Kochi The ideal candidate will have experience in designing, developing, and deploying data engineering solutions on AWS The role is contractual for 6 months Responsibilities Design, develop, and deploy data engineering solutions on AWS, leveraging AWS services such as S3, DynamoDB, and Redshift Develop and maintain ETL processes using PySpark and AWS Glue, ensuring data quality and integrity Collaborate with cross-functional teams to design and implement data pipelines, ensuring seamless integration with existing systems Develop a...

Project description We're seeking a proactive and technically strong Cloud Platform Automation Analyst with deep expertise in Azure DevOps and GitHub Enterprise. In this role, you will help drive governance, automation, and standardization across large-scale, multi-cloud DevOps platforms. You will have the opportunity to manage cloud landing zones, CI/CD pipelines, and infrastructure automation across Azure and AWS, supporting global engineering teams.At Luxoft, our culture emphasizes innovation, collaboration, and engineering excellence. This role supports enterprise-wide DevOps modernization, governance, and automation initiatives that impact mission-critical applications across regulated ...

Location : Chennai Hybrid (3 Days a Week in Office) Employment Type: Contract Shift : UK Shift (if applicable) Job Summary We are looking for a highly skilled Python Lead Developer with strong expertise in Python, SQL, AWS, and Apache Airflow. The ideal candidate will lead a team of developers to build scalable data pipelines, backend systems, and cloud-based solutions, ensuring high performance, maintainability, and adherence to best practices. Key Responsibilities Lead and mentor a team of Python developers, ensuring delivery of high-quality software solutions. Design, develop, and optimize data pipelines and backend systems using Python and Airflow. Work with AWS services (S3, Lambda, EC2...

Urgent requirement for AWS Data Engineer. Top 3 skills AWS data technologies (S3, Redshift, Athena, Glue), Python, Pyspark, SQL, ETL toolsets, inc. Informatica CDC, ETL, Kafka Work location NTTData office India (Hybrid) Shift timings Normal shift Experience 7+ yrs POSITION OVERVIEW : Data Engineer Position Overview Summary: The Data Engineer will expand and optimize the data and data pipeline architecture, as well as optimize data flow and collection for cross functional teams The Data Engineer will perform data architecture analysis, design, development and testing to deliver data applications, services, interfaces, ETL processes, reporting and other workflow and management initiatives The ...

Stellantis is seeking a passionate, innovative, results-oriented Information Communication Technology (ICT) Manufacturing AWS Cloud Architect to join the team. As a Cloud architect, the selected candidate will leverage business analysis, data management, and data engineering skills to develop sustainable data tools supporting Stellantiss Manufacturing Portfolio Planning. This role will collaborate closely with data analysts and business intelligence developers within the Product Development IT Data Insights team. Job responsibilities include but are not limited to: Having deep expertise in the design, creation, management, and business use of large datasets, across a variety of data platform...

Pyspark SparkSQL SQL and Glue. ii. AWS cloud experience iii. Good understanding of dimensional modelling iv. Good understanding DevOps CloudOps DataOps CI/CD & with a SRE mindset v. Understanding of Lakehouse and DW architecture vi. strong analysis and analytical skills vii. understanding of version control systems specifically Git viii. strong in software engineering APIs Microservices etc. Soft skills i. written and oral communication skills ii. ability to translate business needs to system. Location - Hyderabad,Kolkata,Peth,Pune

Plan, design, and execute end-to-end data migration projects from various data sources to Amazon Aurora PostgreSQL and Amazon DynamoDB. Collaborate with cross-functional teams to understand data requirements, perform data analysis, and define migration strategies. Develop and implement data transformation and manipulation procedures using Talend, AWS Glue, and AWS DMS to ensure data accuracy and integrity during the migration process. Optimize data migration workflows for efficiency and reliability, and monitor performance to identify and address potential bottlenecks. Collaborate with database administrators, data engineers, and developers to troubleshoot and resolve data-related issues. En...

Design and develop integration of Snowflake with a cloud platform and platform enhancements, integrations, and performance optimisation. Work on data ingestion using Python, cataloguing, and lineage tracking, Develop and architect ETL workflows. Required Candidate profile 5 years in developing and scaling data platforms centered around Snowflake, with Azure. Hands on Python Understanding of modern data architectures such as Data Mesh, Lakehouse, and ELT.

Job Summary We are looking for a highly skilled Python Lead Developer with strong expertise in Python, SQL, AWS, and Apache Airflow. The ideal candidate will lead a team of developers to build scalable data pipelines, backend systems, and cloud-based solutions, ensuring high performance, maintainability, and adherence to best practices. Key Responsibilities Lead and mentor a team of Python developers, ensuring delivery of high-quality software solutions. Design, develop, and optimize data pipelines and backend systems using Python and Airflow. Work with AWS services (S3, Lambda, EC2, Glue, Redshift, RDS, etc.) for deployment, data storage, and automation. Write and optimize complex SQL queri...