869 Aws Glue Jobs - Page 12

Desired Knowledge and Skills: Experience with most of the cloud products such as Amazon AWS. Experience as developer in multiple cloud technologies including AWS EC2, S3, Amazon API Gateway, , AWS Lambda, AWS Glue, AWS RDS. Good knowledge on AWS environment and Service knowledge with S3 storage understanding. Must have good knowledge of AWS Glue and serverless architecture. • Collaborate with data analysts and stakeholders to meet data requirements. • Must have hands on experience of Amazon Redshift Architecture. AWS Redshift experience for DB design AWS Pipeline knowledge to develop ETL for data movement to Redshift, experience to map the source to target rules and fields. Strong in writing...

Desired Knowledge and Skills: Experience with most of the cloud products such as Amazon AWS. Experience as developer in multiple cloud technologies including AWS EC2, S3, Amazon API Gateway, , AWS Lambda, AWS Glue, AWS RDS. Good knowledge on AWS environment and Service knowledge with S3 storage understanding. Must have good knowledge of AWS Glue and serverless architecture. • Collaborate with data analysts and stakeholders to meet data requirements. • Must have hands on experience of Amazon Redshift Architecture. AWS Redshift experience for DB design AWS Pipeline knowledge to develop ETL for data movement to Redshift, experience to map the source to target rules and fields. Strong in writing...

Desired Knowledge and Skills: Experience with most of the cloud products such as Amazon AWS. Experience as developer in multiple cloud technologies including AWS EC2, S3, Amazon API Gateway, , AWS Lambda, AWS Glue, AWS RDS. Good knowledge on AWS environment and Service knowledge with S3 storage understanding. Must have good knowledge of AWS Glue and serverless architecture. • Collaborate with data analysts and stakeholders to meet data requirements. • Must have hands on experience of Amazon Redshift Architecture. AWS Redshift experience for DB design AWS Pipeline knowledge to develop ETL for data movement to Redshift, experience to map the source to target rules and fields. Strong in writing...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

We are seeking a highly skilled and experienced Senior Data Engineer to lead the end-to-end development of complex models for compliance and supervision. The ideal candidate will have deep expertise in cloud-based infrastructure, ETL pipeline development, and financial domains, with a strong focus on creating robust, scalable, and efficient solutions. Key Responsibilities : Model Development: Lead the development of advanced models using AWS services such as EMR, Glue, and Glue Notebooks. Cloud Infrastructure: Design, build, and optimize scalable cloud infrastructure solutions with a minimum of 5 years of experience. ETL Pipeline Development : Create, manage, and optimize ETL pipelines using...

Role & responsibilities 1+ years of experience in the software industry Basic proficiency in Python for data processing and automation tasks Foundational knowledge of SQL, with some exposure to working with tools like Redshift, Snowflake, or Big Query is an advantage. Understanding of workflow orchestration concepts, with exposure to tools like Apache Airflow. Hands-on experience in any GCP or AWS services, such as Dataproc, Cloud Functions, and Cloud Storage. Interest in or familiarity with low-code reporting tools, like Retool for building reporting interfaces. Familiarity with data transformation and modelling tools, such as Dataform or DBT (prior hands-on experience is a plus). Awareness...

Greetings from Encora Innovation Labs!(Encora)! Encora is looking for DataOps Engineer with 5-8 years experience in Data Engineer, Spark, AWS services, Python, AWS Glue, Redshift, Lambda and Airflow. Pease find the below detailed job description and the company profile for your better understanding. Position: DataOps Engineer Experience: 5-8 years Job Location: Chennai/Bangalore/Pune/Hyderabad/Noida Position Type: Full time Qualification: Any graduate Technical Skills: AWS services AWS Glue, Redshift, Lambda, IAM, IaC Terraform, CloudFormation, GitHub. Programming - Python, SQL and Spark Data Engineering - Data pipelines, Airflow orchestration Job Summary Responsibilities and Duties • Monito...

Strong hands-on experience with AWS Glue, PySpark, Lambda, S3, Athena, and RDS (Aurora/Postgres). Experience in API Gateway.

Role & responsibilities Job Description Summary The purpose of this role is to oversee the development of our database marketing solutions, using database technologies such as Microsoft SQL Server/Azure, Amazon Redshift, Google BigQuery. The role will be involved in design, specifications, troubleshooting and issue resolution. The ability to communicate to both technical and non-technical audiences is key. Business Title Associate Technical Architect Years of Experience 10+ Years Must have skills 1. Database (one or more of MS SQL Server, Oracle, Cloud SQL, Cloud Spanner, etc.) 2. Data Warehouse (one or more of Big Query, SnowFlake, etc.) 3. ETL tool (two or more of Cloud Data Fusion, Datafl...

We are seeking a Lead/Senior Data Engineer with 7-12 years of experience to architect, develop, and optimize data solutions in a cloud-native environment. The role requires strong expertise in AWS Glue, PySpark, and Python with a proven ability to design scalable data pipelines and frameworks for large-scale enterprise systems. Prior exposure to financial services or regulated environments is a strong advantage. Key Responsibilities Design and implement secure, scalable pipelines using AWS Glue, PySpark, EMR, S3, Lambda, and other AWS services. Lead ETL development for structured and semi-structured data, ensuring high performance and reliability. Build reusable frameworks, automation tools,...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

We are looking for skilled Data Engineer to join our team. This role involves robust ETL/ELT pipelines, developing dashboards using Power BI. Work in AWS & Conduct data profiling, validation & QC. Follow best practices in data architecture. Health insurance Provident fund

AWS-Specific Skills AWS Storage & Compute Services S3: Deep understanding of bucket policies, lifecycle rules, and data organization Glue: For ETL jobs, crawlers, and data cataloging Athena: Querying data directly from S3 using SQL EMR: For big data processing using Spark/Hadoop Lakehouse Technologies Apache Hudi: Knowledge of transactional data lakes, schema evolution, etc Data Cataloging & Governance AWS Glue Data Catalog Integration with Lake Formation Security & Compliance IAM roles and policies Encryption Data masking and tokenization strategies Mandatory Competencies Cloud - AWS - AWS S3, S3 glacier, AWS EBS Big Data - Big Data - Hadoop Big Data - Big Data - SPARK Database - Database P...

Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose the relentless pursuit of a world that works better for people – we serve and transform leading enterprises, including the Fortune Global 500, with our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI. Inviting applications for the role of Lead Consultant-Data Engineer, AWS+Python, Spark, Kafka for ETL! Responsibilities Develop, deploy, and manage ETL...

Build data pipelines using Spark, PySpark, Python. Strong in Data Lake/Warehouse, SQL, EMR, Iceberg, Parquet. Expertise in NoSQL/Relational DBs, data modeling, AWS, APIs, CI/CD (GitLab), Docker, Kubernetes, microservices, and messaging systems.

Role: AWS Glue Data Engineer Location: Chennai/Bangalore/Hyderabad Mode Of Hire: Permanent Work Mode: Work from office / Hybrid Notice Period: Immediate joiners preferred. Required Skills: 510 years of overall data engineering experience Minimum 3+ years hands-on with AWS Glue and PySpark Proficiency in SQL, Python, and AWS data tools Strong understanding of data lake architecture Good communication and problem-solving skills Experience with AWS Lake Formation Familiarity with CI/CD, Terraform, or CloudFormation AWS Certifications (Data Analytics, Solutions Architect)

Job details: Title AWS Data Engineer Type Hybrid Location Chennai Key Skills AWS Glue, RedShift, S3, Lambda Athena. Hands on experience in Data Engineer with AWS, Glue, Lambda, SQL, Python, Redshift. Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred). Must be able to work with large volumes of data coming from various sources. Perform data cleansing, data validation etc Hands on ETL developer who is good at python, SQL. AWS services like glue, glue crawlers, lambda, red shift, athena, s3, EC2, IAM, Monitoring and Logging mechanisms- AWS cloudwatch, setting up alerts. Deployment knowledge on cloud. Integrate CI/CD pipeline...

As a Senior Cloud Data Platform (AWS) Specialist at Incedo, you will be responsible for designing, deploying and maintaining cloud-based data platforms on the AWS platform. You will work with data engineers, data scientists and business analysts to understand business requirements and design scalable, reliable and cost-effective solutions that meet those requirements. Roles & Responsibilities: Designing, developing and deploying cloud-based data platforms using Amazon Web Services (AWS) Integrating and processing large amounts of structured and unstructured data from various sources Implementing and optimizing ETL processes and data pipelines Developing and maintaining security and access co...

Role Description As a Senior Cloud Data Platform (AWS) Specialist at Incedo, you will be responsible for designing, deploying and maintaining cloud-based data platforms on the AWS platform. You will work with data engineers, data scientists and business analysts to understand business requirements and design scalable, reliable and cost-effective solutions that meet those requirements. Roles & Responsibilities: Designing, developing and deploying cloud-based data platforms using Amazon Web Services (AWS) Integrating and processing large amounts of structured and unstructured data from various sources Implementing and optimizing ETL processes and data pipelines Developing and maintaining secur...

Role Description As a Senior Cloud Data Platform (AWS) Specialist at Incedo, you will be responsible for designing, deploying and maintaining cloud-based data platforms on the AWS platform. You will work with data engineers, data scientists and business analysts to understand business requirements and design scalable, reliable and cost-effective solutions that meet those requirements. Roles & Responsibilities: Designing, developing and deploying cloud-based data platforms using Amazon Web Services (AWS) Integrating and processing large amounts of structured and unstructured data from various sources Implementing and optimizing ETL processes and data pipelines Developing and maintaining secur...

Technical Skills Experience building data transformation pipelines using DBT and SSIS Moderate programming experience with Python Moderate experience with AWS Glue Strong experience with SQL and ability to write efficient code and manage it through GIT repositories Nice-to-have skills Experience working with SSIS Experience working in a Wealth management industry Experience in agile development methodologies

As a Technical Lead - Cloud Data Platform (AWS) at Incedo, you will be responsible for designing, deploying and maintaining cloud-based data platforms on the AWS platform. You will work with data engineers, data scientists and business analysts to understand business requirements and design scalable, reliable and cost-effective solutions that meet those requirements. Roles & Responsibilities: Designing, developing and deploying cloud-based data platforms using Amazon Web Services (AWS) Integrating and processing large amounts of structured and unstructured data from various sources Implementing and optimizing ETL processes and data pipelines Developing and maintaining security and access con...

Job Requirements Mandatory Skills Bachelors degree in computer science, Data Science, engineering, mathematics, information systems, or a related technical discipline 7+ years of relevant experience in data engineering roles Detailed knowledge of data warehouse technical architectures, data modelling, infrastructure components, ETL/ ELT and reporting/analytic tools and environments, data structures and hands-on SQL coding Proficient in at least one or more programming languages: Java, Python, Ruby, Scala Experienced with AWS services such as Redshift, S3, EC2, Lambda, Athena, EMR, AWS Glue, Datapipeline. Exposure to data visualization and reporting with tools such as Amazon QuickSight, Metab...