869 Aws Glue Jobs - Page 16

Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose the relentless pursuit of a world that works better for people – we serve and transform leading enterprises, including the Fortune Global 500, with our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI. Inviting applications for the role of Lead Consultant-Data Engineer, AWS+Python, Spark, Kafka for ETL! Responsibilities Develop, deploy, and manage ETL...

Job Summary: We are looking for a talented Data Engineer cum Database Developer with a strong background in the banking sector. The ideal candidate will have experience with SQL Server, AWS PostgreSQL, AWS Glue, and ETL tools, along with expertise in data ingestion frameworks and Control-M scheduling Key Responsibilities: Design, develop, and maintain scalable data pipelines to support data ingestion and transformation processes. Collaborate with cross-functional teams to gather requirements and implement solutions tailored to banking applications. Utilize SQL Server and AWS PostgreSQL for database development, optimization, and management. Implement data ingestion frameworks to ensure effic...

As an Associate Software Developer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big ...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelo...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelor...

NTT DATA is looking for a Sr Information Security Engineer to be a part of their team based in Bangalore, Karnataka (IN-KA), India. As a Sr Information Security Engineer, you will bring your expertise and experience in IT Technology, AI / ML, data engineering, python coding, and enterprise-wide integration programs to contribute to our innovative and forward-thinking organization. **Required Skills:** - You should have at least 5 years of experience in IT Technology. - With a minimum of 2 years of experience in AI / ML, you should possess a strong working knowledge in neural networks. - Having 2+ years of data engineering experience, preferably using AWS Glue, Cribl, SignalFx, OpenTelemetry,...

As a Senior Digital Solutions Consultant at Worley, you will have the opportunity to work on the world's most complex projects and be a part of a collaborative and inclusive team. Your role will be varied and challenging, allowing you to contribute to innovative solutions that drive sustainability in projects. Worley, a global professional services company specializing in energy, chemicals, and resources, is at the forefront of bridging the transition to more sustainable energy sources. By partnering with customers, Worley delivers integrated data-centric solutions throughout the lifecycle of assets, from consulting and engineering to decommissioning and remediation. As part of your role, yo...

As a Dynatrace Developer/Consultant, you will be responsible for setting up and maintaining monitoring systems to track the health and performance of data pipelines. Your role will involve configuring alerts and notifications to promptly identify and respond to issues or anomalies in data pipelines. You will develop procedures and playbooks for incident response and resolution, collaborating with data engineers to optimize data flows and processing. Your experience in working with data, ETL, Data warehouse & BI Projects will be invaluable as you continuously monitor and analyze pipeline performance to identify bottlenecks and areas for improvement. Implementing logging mechanisms and error h...

Role Overview: We are looking for a skilled Data Engineer with hands-on expertise in Snowflake, Python, and AWS services to support end-to-end data migration and warehousing solutions. The ideal candidate will design, develop, and maintain scalable Snowflake data structures, implement efficient ETL pipelines using Python and AWS (S3, Lambda, Step Functions), and collaborate with cross-functional teams to deliver high-performance data solutions. Proficiency in Power BI for dashboarding and data visualization is essential. Experience in healthcare data is a plus. Key Responsibilities: • Design, develop, test, deploy, and maintain Snowflake tables/views/stored procedures/streams/tasks using Sno...

Job Title: Snowflake Developer Location: Hyderabad or Bangalore. ( Hybrid Working ) Experience: 5+ Years Responsibilities: Use data mappings and models provided by the data modeling team to build robust pipelines in Snowflake . Design and implement data pipelines with proper 2NF/3NF normalization standards. Develop and maintain ETL processes for integrating data from multiple ERP and source systems. Create scalable and secure data architecture in Snowflake that supports DQ needs. Raise CAB requests through Carriers change process and manage deployment to production. Provide UAT support and transition finalized pipelines to support teams. Document all technical artifacts for traceability and ...

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : AWS Redshift Good to have skills : PySparkMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. You will oversee the development process and ensure successful project delivery. Roles & Responsibilities:- Expected to be an SME- Collaborate and manage the team to perform- Responsible for team decisions- Engage with multiple teams ...

1. Job Purpose The Senior Data Analytics Analyst will play a key role in delivering hands-on analytics solutions across the UK and Ireland. This role focuses on bespoke report building, dashboard development, and advanced data analysis using technologies such as Power BI, Microsoft Fabric, Snowflake, Azure, AWS, Python, SQL, and R. Experience in data science is highly advantageous, including the application of machine learning and predictive modelling to solve business problems 2. Accountabilities & Activities • Design and build interactive dashboards and reports using Power BI and Microsoft Fabric. • Perform advanced data analysis and visualisation to support business decision-making. • Dev...

As a Database Designer / Senior Data Engineer at VE3, you will be responsible for architecting and designing modern, scalable data platforms on AWS and/or Azure, ensuring best practices for security, cost optimization, and performance. You will develop detailed data models and document data dictionaries and lineage to support data solutions. Additionally, you will build and optimize ETL/ELT pipelines using languages such as Python, SQL, Scala, and services like AWS Glue, Azure Data Factory, and open-source frameworks like Spark and Airflow. Collaboration is key in this role as you will work closely with data analysts, BI teams, and stakeholders to translate business requirements into data so...

Looking for an AWS & DevOps trainer to take 1-hour daily virtual classes (MonFri). Should cover AWS services, DevOps tools (Jenkins, Docker, K8s, etc.), give hands-on tasks, guide on interviews & certs, and support doubt sessions.

Hexaware Technologies is Hiring AWS Redshift developers Primary Skill set - AWS redshift, Glue, Lambda, Pyspark Total Exp Required - 6 + years to 12yrs Location - Bangalore & Hyderabad only Work mode - Hybrid Job Description: Mandatory Skills: 8 to 10 years Experience with most of the cloud products such as Amazon AWS. Experience as developer in multiple cloud technologies including AWS EC2, S3, Amazon API Gateway , AWS Lambda, AWS Glue, AWS RDS, AWS Step Functions. Good knowledge on AWS environment and Service knowledge with S3 storage understanding. Must have good knowledge of AWS Glue and serverless architecture. Must have good knowledge of Pyspark. Must have good knowledge of SQL. Nice t...

Key Responsibilities: Platform Architecture Design : Lead the design and architecture of the digital platform , ensuring that the data infrastructure is scalable, secure, and reliable. Focus on utilizing AWS services (e.g., S3 , Redshift , Glue , Lambda , Kinesis ) and Databricks to build a robust, cloud-based data architecture. Data Integration & ETL Pipelines : Architect and implement ETL/ELT pipelines to integrate data from multiple sources (e.g., transactional databases, third-party services, APIs) into the platform, using AWS Glue , Databricks , and other tools for efficient data processing. Cloud Strategy & Deployment : Implement cloud-native solutions, leveraging AWS tools and Databri...

DevOn is a leading provider of innovative technology solutions focusing on data-driven decision-making, cloud computing, and advanced analytics. We are passionate about solving complex business problems through technology and currently seeking a skilled and motivated Data Engineer Lead to join our dynamic team. As a Data Engineer Lead at DevOn, your primary responsibility will be to lead the design, development, and maintenance of data pipelines and ETL workflows, utilizing modern cloud technologies. You will collaborate closely with cross-functional teams to ensure data availability, reliability, and scalability, facilitating data-driven decision-making throughout the organization. This rol...

You will be working as a software development partner for a very large enterprise financial products and services firm listed on NYSE. Your main task will involve re-architecting and migrating 30-year legacy systems to cloud-based microservices on AWS. The application you will be working on is crucial for their trading, journal, and bookkeeping platforms. Your responsibilities will include: - Developing an event-driven ETL pipeline using AWS services to transfer end-of-day securities data from the mainframe to a relational database. - Building highly resilient and available containerized microservices. - Automating build and deployment processes using Jenkins and Terraform for various enviro...

Role: Lead Data Engineer Exp: 8-12 Yrs Loc : Pune, Hyd, Bang, Gur(Hybrid) NP : Imme Joiner to 15 Days Skills: Python, Spark, SQL, ETL, Snowflake, Azure, Airflow, BigQuery, AWS(Glue)

You must have knowledge in Azure Datalake, Azure function, Azure Databricks, Azure Data Factory, and PostgreSQL. Working knowledge in Azure DevOps and Git flow would be an added advantage. Alternatively, you should have working knowledge in AWS Kinesis, AWS EMR, AWS Glue, AWS RDS, AWS Athena, and AWS RedShift. Demonstrable expertise in working with timeseries data is essential. Experience in delivering data engineering/data science projects in Industry 4.0 is an added advantage. Knowledge of Palantir is required. You must possess strong problem-solving skills with a focus on sustainable and reusable development. Proficiency in using statistical computer languages like Python/PySpark, Pandas,...

We are looking for a skilled AI/ML Ops Engineer to join our team to bridge the gap between data science and production systems. You will be responsible for deploying, monitoring, and maintaining machine learning models and data pipelines at scale. This role involves close collaboration with data scientists, engineers, and DevOps to ensure that ML solutions are robust, scalable, and reliable. Key Responsibilities: Design and implement ML pipelines for model training, validation, testing, and deployment. Automate ML workflows using tools such as MLflow, Kubeflow, Airflow, or similar. Deploy machine learning models to production environments (cloud). Monitor model performance, drift, and data q...

Experience Required : Minimum 4.5+ years Job Summary: We are seeking a skilled Data Engineer with a strong background in data ingestion, processing, and storage. The ideal candidate will have experience working with various data sources and technologies, particularly in a cloud environment. You will be responsible for designing and implementing data pipelines, ensuring data quality, and optimizing data storage solutions. Key Responsibilities: Design, develop, and maintain scalable data pipelines for data ingestion and processing using Python, Spark, and AWS services. Work with on-prem Oracle databases, batch files, and Confluent Kafka for data sourcing. Implement and manage ETL processes usi...

Design, develop, and maintain robust data pipelines and ETL/ELT processes on AWS. Leverage AWS services such as S3, Glue, Lambda, Redshift, Athena, EMR , and others to build scalable data solutions. Write efficient and reusable code using Python for data ingestion, transformation, and automation tasks. Collaborate with cross-functional teams including data analysts, data scientists, and software engineers to support data needs. Monitor, troubleshoot, and optimize data workflows for performance, reliability, and cost efficiency. Ensure data quality, security, and governance across all systems. Communicate technical solutions clearly and effectively with both technical and non-technical stakeh...

Key Responsibilities Senior professional level role and hands-on enterprise level architect/ solution leader with deep experience in Data Engineering technologies and on public cloud like AWS Azure/ GCP Engage with client managers to understand their current state, business problems/ opportunities, conceptualize solution options, discuss and finalize with client stakeholders, help bootstrap a team and deliver PoCs/PoTs/MVP etc. Help build overall competency within teams working in related client engagements and rest of Iris in Data & Analytics, including Data Engineering, Analytics, Data Science, AI/ML, ML and Data Ops, Data Governance etc. related solution patterns, platforms, tools and tec...

As a Technical Lead - Cloud Data Platform (AWS) at Incedo, you will be responsible for designing, deploying and maintaining cloud-based data platforms on the AWS platform. You will work with data engineers, data scientists and business analysts to understand business requirements and design scalable, reliable and cost-effective solutions that meet those requirements. Roles & Responsibilities: Designing, developing and deploying cloud-based data platforms using Amazon Web Services (AWS) Integrating and processing large amounts of structured and unstructured data from various sources Implementing and optimizing ETL processes and data pipelines Developing and maintaining security and access con...