1330 Aws Glue Jobs - Page 13

Design and develop integration of Snowflake with a cloud platform and platform enhancements, integrations, and performance optimisation. Work on data ingestion using Python, cataloguing, and lineage tracking, Develop and architect ETL workflows. Required Candidate profile 5 years in developing and scaling data platforms centered around Snowflake, with Azure. Hands on Python Understanding of modern data architectures such as Data Mesh, Lakehouse, and ELT.

Position Overview: We are seeking a highly skilled and motivated Data Engineer to join our team. This role will be responsible for designing, developing, and maintaining robust data pipelines that transform raw data into actionable insights. The ideal candidate will have strong technical expertise in Python, SQL, and AWS data services, with experience in dimensional modeling, data governance, and building analytical solutions. This position offers an opportunity to work in a collaborative environment where innovation and problem-solving are encouraged. The Data Engineer will play a key role in ensuring that high-quality, reliable, and scalable data solutions support business intelligence, an...

Job Profile: Develop Innovative and Visually Appealing Qlik Sense Dashboards and Reports that Provide Actionable Insights to Stakeholders. Hands on Experience in Design, Implement, Test and Support Reports and Dashboards Within in the agreed SLA.Power BI to Qlik sense Migration experience is a plus Good skill set in advanced expression building. Working knowledge on Extensions in Qlik sense. Strong Knowledge on Optimization Techniques of Dashboard.Good Knowledge on AWS features like S3 buckets, Athena, Glue Jobs, Crawler, AWS lake formation, Python etc Relocation Supported: Visa Sponsorship Approved: At Fujitsu, we are committed to creating a diverse and inclusive workplace where everyone fe...

Role Description Experience Required: 7+ yearsLocation: offshore Role Overview: We are looking for a skilled Backend Developer with strong Python expertise andexperience in building scalable microservices The candidate should be comfortableworking in AWS environments and collaborating with cross-functional teams Key Responsibilities:- Develop and maintain microservices-based backend systems - Design and implement efficient APIs - Optimize database queries and schema design - Support production systems and troubleshoot issues - Collaborate with team members on code reviews and development practices - Work with GitHub workflows and CI/CD pipelines - Integrate with ElasticSearch where needed - ...

As a Data Governance and Data Quality Specialist at our company, your role will involve developing, implementing, and maintaining data governance frameworks and processes to ensure the accuracy, completeness, and reliability of organizational data. You will collaborate with various stakeholders to define data standards, policies, and procedures, and oversee compliance with regulatory requirements related to data management. **Key Responsibilities:** - Collaborate with cross-functional teams to define data quality standards and metrics and establish processes for monitoring and improving data quality. - Design and implement data quality assurance processes, including data profiling, cleansing...

You are a skilled and motivated Data Engineer Lead at DevOn, a leading provider of innovative technology solutions focusing on data-driven decision-making, cloud computing, and advanced analytics. Your role involves leading the design, development, and maintenance of data pipelines and ETL workflows using modern cloud technologies like Python, PySpark, AWS Glue, RedShift, SQL, Jenkins, Bitbucket, EKS, and Airflow. **Key Responsibilities:** - Lead the design and implementation of scalable data pipelines and ETL workflows on AWS. - Develop and manage data ingestion, transformation, and storage frameworks using AWS Glue, PySpark, and RedShift. - Architect complex SQL queries for large datasets ...

As a Senior Data Engineer specializing in Data Quality, Ingestion & API Development, your role will involve leading the development of a scalable data ingestion framework with a strong focus on ensuring high data quality and validation. You will also be responsible for designing and implementing robust APIs for seamless data integration. Your expertise in building and managing big data pipelines using modern AWS-based technologies will be crucial for driving quality and efficiency in data processing systems. - **Data Ingestion Framework:** - **Design & Development:** Architect, develop, and maintain an end-to-end data ingestion framework that efficiently extracts, transforms, and loads data ...

Azure - ADF, SQL, Synapse, Azure data lake store, keyvaults AWS - Redshift,Glue

Job Description: Strong expertise in Python (including data processing/manipulation libraries such as pandas, PySpark). Hands-on experience in designing and maintaining ETL pipelines. Proficiency with AWS cloud services (Glue, Lambda, EMR, ECS, Lake Formation, etc.). Experience with orchestration tools such as Airflow and AWS Step Functions. Exposure to databases like Redshift, Aurora, Postgres, or Snowflake. Experience with Reshift is preferred.

Role Overview: We are looking for a skilled Backend Developer with strong Python expertise and experience in building scalable microservices. The candidate should be comfortable working in AWS environments and collaborating with cross-functional teams. Key Responsibilities: - Develop and maintain microservices-based backend systems. - Design and implement efficient APIs. - Optimize database queries and schema design. - Support production systems and troubleshoot issues. - Collaborate with team members on code reviews and development practices. - Work with GitHub workflows and CI/CD pipelines. - Integrate with ElasticSearch where needed. - Utilize AWS services including AWS Glue for ETL and d...

Role Proficiency: This role requires proficiency in data pipeline development including coding testing and implementing data pipelines for ingesting wrangling transforming and joining data from various sources. Must be adept at using ETL tools such as Informatica Glue Databricks and DataProc along with coding skills in Python PySpark and SQL. Works independently according to work allocation. Outcomes: Operate with minimal guidance to develop error-free code test applications and document the development process. Understand application features and component designs to develop them in accordance with user stories and requirements. Code debug test document and communicate the stages of product...

Role Proficiency: This role requires proficiency in data pipeline development including coding testing and implementing data pipelines for ingesting wrangling transforming and joining data from various sources. Must be adept at using ETL tools such as Informatica Glue Databricks and DataProc along with coding skills in Python PySpark and SQL. Works independently according to work allocation. Outcomes: Operate with minimal guidance to develop error-free code test applications and document the development process. Understand application features and component designs to develop them in accordance with user stories and requirements. Code debug test document and communicate the stages of product...

Role Proficiency: This role requires proficiency in data pipeline development including coding testing and implementing data pipelines for ingesting wrangling transforming and joining data from various sources. Must be adept at using ETL tools such as Informatica Glue Databricks and DataProc along with coding skills in Python PySpark and SQL. Works independently according to work allocation. Outcomes: Operate with minimal guidance to develop error-free code test applications and document the development process. Understand application features and component designs to develop them in accordance with user stories and requirements. Code debug test document and communicate the stages of product...

You will be part of a team working on challenging issues in financial services and technology at FIS. The team at FIS is described as open, collaborative, entrepreneurial, passionate, and fun. In the competitive private equity market, organizations are under pressure to deliver superior returns and meet stringent reporting requirements. Your role will involve developing core versions of software applications for sale to external clients, identifying client purchasing requirements, and technical specifications. You will also interact with engineering groups to assist in design changes and train clients on systems application. The shift timing for this role is from 4 PM to 1 AM. - Proficiency ...

Role Overview: You will be responsible for handling data services on AWS, where your expertise in various AWS services such as AWS Glue, AWS Lambda, AWS RDS, AWS S3, Dynamo DB, and PySpark will be crucial. Key Responsibilities: - Utilize AWS Glue for ETL processes and data preparation tasks - Implement serverless functions using AWS Lambda - Manage databases on AWS RDS - Handle data storage and retrieval using AWS S3 - Work with Dynamo DB for NoSQL database requirements - Develop data processing applications using PySpark Qualifications Required: - Proficiency in AWS services like AWS Glue, AWS Lambda, AWS RDS, AWS S3, Dynamo DB - Experience with PySpark for data processing - 5 to 12 years o...

As a Lead Data AI/ML Engineer - Vice President at Barclays, you will spearhead the evolution of the Corporate Data Services function. Your role will involve effective stakeholder management, leadership, and decision-making to support business strategy and risk management. **Key Responsibilities:** - Participating in daily stand-up meetings to discuss progress, blockers, and plans for the day. - Working on deploying AI/ML models into production environments using AWS services like Glue, Lambda, and Step Functions. - Building and maintaining data pipelines using Spark and Python to ensure seamless data flow and integration. - Collaborating with data scientists, software engineers, and other st...

Role & responsibilities Around 6+ years of experience in data engineering or cloud computing data development Design, develop, and optimize ETL/ELT data pipelines using Apache Spark (PySpark or Scala), AWS Glue, and Azure Data Factory Work with structured and unstructured data to build scalable ingestion and transformation workflows across cloud platforms. Build data lake and data warehouse solutions using AWS S3, Azure Data Lake Collaborate with data scientists, analysts, and application developers to support advanced analytics, reporting, and ML workflows Implement job orchestration, monitoring, and error handling for reliable pipeline execution. Maintenance and support of Data Pipeline. D...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : AWS Architecture Good to have skills : Python (Programming Language)Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quali...

Role Description The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services. Responsibilities: Lead the design, implementation, and optimization of scalable data pipelines and architectures utilizing AWS Glue, Elastic MapReduce (EMR), Lambda, Redshift, Athena, DynamoDB, OpenSearch, and S3 Use Spark on AWS for data transformation and processing across large datasets Develop and maintain efficient data workflows with SQS for task queueing and orchestration Integrate, transform, and manage data using Mulesoft and Talend for seamless data integration Ensure high-performance data storage, retrieval, and analytics across Redshift, Dyna...

Role Description: As a Technical Lead - Cloud Data Platform (AWS) at Incedo, you will be responsible for designing, deploying and maintaining cloud-based data platforms on the AWS platform You will work with data engineers, data scientists and business analysts to understand business requirements and design scalable, reliable and cost-effective solutions that meet those requirements Roles & Responsibilities: Designing, developing and deploying cloud-based data platforms using Amazon Web Services (AWS) Integrating and processing large amounts of structured and unstructured data from various sources Implementing and optimizing ETL processes and data pipelines Developing and maintaining securit...

Role Description: As a Senior Cloud Data Platform (AWS) Specialist at Incedo, you will be responsible for designing, deploying and maintaining cloud-based data platforms on the AWS platform. You will work with data engineers, data scientists and business analysts to understand business requirements and design scalable, reliable and cost-effective solutions that meet those requirements. Roles & Responsibilities: Designing, developing and deploying cloud-based data platforms using Amazon Web Services (AWS) Integrating and processing large amounts of structured and unstructured data from various sources Implementing and optimizing ETL processes and data pipelines Developing and maintaining secu...

Role Description As a Senior Cloud Data Platform (AWS) Specialist at Incedo, you will be responsible for designing, deploying and maintaining cloud-based data platforms on the AWS platform. You will work with data engineers, data scientists and business analysts to understand business requirements and design scalable, reliable and cost-effective solutions that meet those requirements. Roles & Responsibilities: Designing, developing and deploying cloud-based data platforms using Amazon Web Services (AWS) Integrating and processing large amounts of structured and unstructured data from various sources Implementing and optimizing ETL processes and data pipelines Developing and maintaining secur...

Role Description: As a Technical Lead - Cloud Data Platform (AWS) at Incedo, you will be responsible for designing, deploying and maintaining cloud-based data platforms on the AWS platform. You will work with data engineers, data scientists and business analysts to understand business requirements and design scalable, reliable and cost-effective solutions that meet those requirements. Roles & Responsibilities: Designing, developing and deploying cloud-based data platforms using Amazon Web Services (AWS) Integrating and processing large amounts of structured and unstructured data from various sources Implementing and optimizing ETL processes and data pipelines Developing and maintaining secur...

The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services. Responsibilities: Lead the design, implementation, and optimization of scalable data pipelines and architectures utilizing AWS Glue, Elastic MapReduce (EMR), Lambda, Redshift, Athena, DynamoDB, OpenSearch, and S3. Use Spark on AWS for data transformation and processing across large datasets. Develop and maintain efficient data workflows with SQS for task queueing and orchestration. Integrate, transform, and manage data using Mulesoft and Talend for seamless data integration. Ensure high-performance data storage, retrieval, and analytics across Redshift, DynamoDB, and Ath...