1570 Glue Jobs - Page 37

Join us as a Data Engineer responsible for supporting the successful delivery of Location Strategy projects to plan, budget, agreed quality and governance standards. You'll spearhead the evolution of our digital landscape, driving innovation and excellence. You will harness cutting-edge technology to revolutionise our digital offerings, ensuring unparalleled customer experiences. To be successful as a Data Engineer, you should have experience with hands-on experience in pyspark and strong knowledge of Dataframes, RDD, and SparkSQL. Additionally, experience in developing, testing, and maintaining applications on AWS Cloud is crucial. A strong hold on the AWS Data Analytics Technology Stack (G...

At Lilly, the global healthcare leader headquartered in Indianapolis, Indiana, we are dedicated to uniting caring with discovery to make life better for people around the world. Our 35,000 employees are committed to discovering and delivering life-changing medicines, improving disease management, and contributing to our communities through philanthropy and volunteerism. At Lilly, we prioritize putting people first and giving our best effort to our work. The LCCI Tech Team is currently seeking a motivated leader for the Enterprise Data Organization. This individual will play a crucial role in optimizing data extraction, enhancing data infrastructure, and aligning operations with organizationa...

Job description Requires deep knowledge and hands-on experience with Terraform Requires in-depth knowledge and hands-on experience with AWS services like S3 bucket, Ec2 instance, load balancer, IAM role, Athena, IAM policy, Secret Manager, Parameter Store, lambda, and AWS Code Build Must have knowledge of at least one CICD tool like Jenkins Basic knowledge in AWS Data services like Redshift, MySQL, Glue, Athena, S3, EBS is required Experience in infrastructure support of any data analytic tool like Databricks, EMR, or Glue is desirable Experience in infrastructure support of any data lake or data warehouse tool is a plus.

Join us as a Cloud Data Engineer (AWS) at Barclays, where you will be responsible for supporting the successful delivery of location strategy projects to plan, budget, agreed quality, and governance standards. You'll spearhead the evolution of our digital landscape, driving innovation and excellence. You will harness cutting-edge technology to revolutionize our digital offerings, ensuring unparalleled customer experiences. To be successful as a Cloud Data Engineer (AWS) you should have experience with AWS cloud services such as S3, Glue, Athena, Lake Formation, CloudFormation, etc. You should also have a strong SQL knowledge, proficiency in PySpark, a very good understanding of writing and d...

The AVP, Principal Product Engineer at Synchrony plays a pivotal role in modernizing workloads by leading vendor refactoring efforts, executing break-fix tasks, and devising user enablement strategies. This role requires a profound understanding of AWS analytics services such as EMR Studio, S3, Redshift, Glue, and Tableau, coupled with robust skills in user engagement, training development, and change management. Collaboration with vendors, business users, and cloud engineering teams is essential to refactor legacy code, ensure seamless execution of fixes, and create comprehensive training materials and user job aids. Additionally, as the Principal Product Engineer, overseeing user testing, ...

As a DAML Presales Engineer with 10-16 years of experience, your primary role will be to act as a trusted advisor to customers, advocating for DAML-based solutions integrated with modern AWS data architectures. Your responsibilities will include collaborating with sales teams and AWS stakeholders to design smart contract solutions using DAML and AWS Data Lake and analytics services. You will be expected to deliver compelling demos, PoCs, and technical presentations showcasing DAML solutions and AWS data platforms like Glue, EMR, and Redshift. Your expertise in AWS data lake components such as Glue, EMR, and Redshift will be crucial in designing solutions that balance performance, cost, and r...

As a QA Engineer at Capco, a Wipro company, you will play a vital role in ensuring the quality and reliability of ETL pipelines and data integration workflows. With a focus on automation and industry-standard tools, you will be responsible for designing and implementing automated test strategies to validate data ingestion, transformation, and delivery processes. Your expertise will be crucial in performing regression, performance, and functional testing of data-centric applications and APIs. With 6+ years of experience in QA Engineering, you will leverage your hands-on experience with Apache Kafka and proficiency in validating data pipelines on AWS (S3, Lambda, Glue, Redshift, or EMR). Your ...

You are a talented and innovative AI/ML Engineer with a strong background in machine learning and deep learning. You have a keen interest in Generative AI (GenAI) and are excited to explore, implement, and scale GenAI models. Your primary responsibilities include designing and deploying end-to-end AI/ML solutions, experimenting with cutting-edge GenAI frameworks and tools, and collaborating with cross-functional teams to solve business problems using ML solutions. Your key responsibilities involve designing and developing robust ML models, including traditional and deep learning approaches. You will also build, train, fine-tune, and deploy Generative AI models for various use cases such as t...

Role Responsibilities : Lead and mentor data engineering teams, ensuring alignment with technical and business objectives. Architect, design, and implement scalable and high-performance data pipelines. Collaborate with cross-functional teams to deliver comprehensive data solutions. Oversee project execution, ensuring timely delivery using tools like JIRA and best practices. Job Requirements : 810 years of experience in data engineering and AWS technologies. Expertise in Python, PySpark, and Spark architecture. Hands-on experience with AWS Glue, Redshift, Lambda, S3, and Athena. Familiarity with Infrastructure as Code (IaC) tools like CloudFormation and Terraform.

Responsibilities Workday Adaptive development exp is must. Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL and AWS big-data technologies. Prepare High Level Design and ETL design Creation and support of batch and real-time data pipelines built on AWS technologies including Glue, Redshift/Spectrum, Kinesis, EMR and Athena Able to design AWS ETL workflows and ETL mapping. Maintain large ETL workflows, Review and test ETL programs Minimum qualifications Workday Adaptive development experience of 4-7 years Bachelors Degree in Computer Science, Information Technology or other relevant fields Experience in AWS Athena and Glue...

Job Description Job Description: We are seeking a highly motivated and enthusiastic Senior Data Scientist with over 8 years of experience to join our dynamic team. The ideal candidate will have a strong background in AI/ML analytics and a passion for leveraging data to drive business insights and innovation. Key Responsibilities Develop and implement machine learning models and algorithms. Work closely with project stakeholders to understand requirements and translate them into deliverables. Utilize statistical and machine learning techniques to analyze and interpret complex data sets. Stay updated with the latest advancements in AI/ML technologies and methodologies. Collaborate with cross-f...

You should have hands-on experience working with Marketing Domain datasets and at least 2 years of applicable work experience in Machine Learning. With 5+ years of hands-on experience in Snowflake and 2+ years of experience on Generative AI projects, you should also possess proficiency with the Python Machine Learning stack, including Pandas, and knowledge of experimental design and analysis of results. Demonstrating experience in applying Machine Learning, both Deep Learning (PyTorch) and Classical ML (Scikit-Learn), is essential. Furthermore, you should have experience in leading Machine Learning teams to deploy and enhance ML features in production and collaborating in cross-functional te...

We are looking for an Executive Manager in Data Engineering with 12-20 years of experience to join our team in Bangalore. You will be working from the office 3 days a week. Your responsibilities include collaborating with Crew Leaders to inspire and enable the chapter to deliver in line with squad strategy to maximize customer outcomes. Your role will focus on enabling agility within the Chapter, inspiring the squad to embody future ways of working to implement, support, and deliver consistently in line with strategic outcomes of the practice area. We are seeking individuals who are naturally talented at balancing cultural, people, and technology requirements. You should be able to communica...

You should have expertise in AWS services like EC2, CloudFormation, S3, IAM, SNS, SQS, EMR, Athena, Glue, lake formation, etc. Additionally, you should possess proficiency in Hadoop/EMR/DataBricks with strong debugging skills to resolve hive and spark related issues. It is essential to have a solid understanding of database concepts and experience working with relational or non-relational database types such as SQL, Key-Value, Graphs, etc. Experience in infrastructure provisioning using CloudFormation, Terraform, Ansible, etc., and proficiency in programming languages such as Python/PySpark is required. Effective written and verbal communication skills are also crucial for this role. As part...

Role Overview We are looking for a highly skilled Data Engineer with strong expertise in building data pipelines, managing cloud-based data platforms, and deploying scalable data architectures on AWS. The ideal candidate should have hands-on experience with AWS services and must hold a valid AWS certification. Key Responsibilities Design, build, and maintain robust, scalable, and efficient data pipelines and ETL/ELT processes on AWS. Work closely with data scientists, analysts, and business teams to understand data requirements and deliver solutions. Integrate data from multiple internal and third-party sources into unified data platforms. Optimize data lake and data warehouse performance (e...

Position Description Job Title: Data EngineerExperience Level: 5+ YearsLocation: Hyderabad Job Summary We are looking for a seasoned and innovative Senior Data Engineer to join our dynamic data team. This role is ideal for professionals with a strong foundation in data engineering, coupled with hands-on experience in machine learning workflows, statistical analysis, and big data technologies. You will play a critical role in building scalable data pipelines, enabling advanced analytics, and supporting data science initiatives. Proficiency in Python is essential, and experience with PySpark is a strong plus. Key Responsibilities Data Pipeline Development: Design and implement scalable, high-p...

As a Senior Data Lake Developer at BCSS, you will play a crucial role in the advancement and expansion of our advanced analytics practice. Your primary responsibility will involve designing and developing data lakes, managing data flows, and integrating information from diverse sources into a unified data lake platform through an ETL Tool. Furthermore, you will code and oversee delta lake implementations on S3 utilizing technologies such as Databricks or Apache Hoodie. It will be your responsibility to triage, debug, and resolve technical issues related to Data Lakes, as well as design and develop data warehouses for scalability. Evaluating data models, designing data access patterns, and co...

As a Full Stack Data Engineer Lead Analyst at Evernorth, you will be a key player in the Data & Analytics Engineering organization of Cigna, a leading Health Services company. Your role will involve delivering business needs by understanding requirements and deploying software into production. To excel in this position, you should be well-versed in critical technologies, eager to learn, and committed to adding value to the business. Ownership, a thirst for knowledge, and an open mindset are essential attributes for a successful Full Stack Engineer like yourself. In addition to delivery responsibilities, you will be expected to embrace an automation-first and continuous improvement mindset. Y...

Were looking for a Cloud Architect / Lead to design, build, and manage scalable AWS infrastructure that powers our analytics and data product initiatives. This role focuses on automating infrastructure provisioning, application/API hosting, and enabling data and GenAI workloads through a modern, secure cloud environment. Key Responsibilities ? Design and provision AWS infrastructure using Terraform or AWS CloudFormation to support evolving data product needs. ? Develop and manage CI/CD pipelines using Jenkins, AWS CodePipeline, CodeBuild, or GitHub Actions. ? Deploy and host internal tools, APIs, and applications using ECS, EKS, Lambda, API Gateway, and ELB. ? Provision and support analytics...

As a Solution Designer (Cloud Data Integration) at Barclays within the Customer Digital and Data Business Area, you will play a vital role in supporting the successful delivery of location strategy projects. Your responsibilities will include ensuring projects are delivered according to plan, budget, quality standards, and governance protocols. By spearheading the evolution of the digital landscape, you will drive innovation and excellence, utilizing cutting-edge technology to enhance our digital offerings and deliver unparalleled customer experiences. To excel in this role, you should possess hands-on experience working with large-scale data platforms and developing cloud solutions within t...

You will be part of a team responsible for developing a next-generation Data Analytics Engine that converts raw market and historical data into actionable insights for the electronics supply chain industry. This platform processes high-volume data from suppliers, parts, and trends to provide real-time insights and ML-driven applications. We are seeking an experienced Lead or Staff Data Engineer to assist in shaping and expanding our core data infrastructure. The ideal candidate should have a strong background in designing and implementing scalable ETL pipelines and real-time data systems in AWS and open-source environments such as Airflow, Spark, and Kafka. This role involves taking technica...

As an ETL Testing professional at CGI, you will be part of a dynamic team that is committed to helping clients succeed in their IT and business process services. With 5-8 years of experience, you will be based in Chennai or Bangalore, working full-time from the office on a Monday to Friday schedule from 12:30 PM to 9:30 PM. Your role will involve utilizing your analytics skills to understand requirements, develop test cases, and manage data effectively. You will need strong SQL skills and hands-on experience testing data pipelines built using Glue, S3, Redshift, and Lambda. Collaboration with developers to build automated testing and a solid understanding of data concepts like data lineage, ...

You are invited to apply for the position of Executive Manager - Data Engineering with a requirement of 12-20 years of experience. The location for this role is in Bangalore, and the work mode involves being present in the office for 3 out of 5 days. Your primary responsibilities as a Chapter Area Lead will involve collaborating with Crew Leaders to motivate and empower the chapter to align with the squad strategy to enhance customer outcomes. Your focus will be on fostering agility within the Chapter, motivating the squad to embody future ways of working, and ensuring consistent delivery in accordance with the strategic outcomes of the practice area. We are looking for individuals who posse...

As an AWS Senior Data Engineer (SDE) at Infosys in India, you will be responsible for working on various technologies and tools related to cloud data engineering. Your role will involve expertise in SQL, Pyspark, API endpoint ingestion, Glue, S3, Redshift, Step Functions, Lambda, Cloudwatch, AppFlow, CloudFormation, and administrative tasks related to cloud services. Additionally, you will be expected to have knowledge of SDLF & OF frameworks, S3 ingestion patterns, and exposure to Git, Jfrog, ADO, SNOW, Visual Studio, DBeaver, and SF inspector. Your primary focus will be on leveraging these technologies to design, develop, and maintain data pipelines, ensuring efficient data processing and ...

Sykatiya Technology Pvt Ltd is a leading Semiconductor Industry innovator committed to leveraging cutting-edge technology to solve complex problems. We are currently looking for a highly skilled and motivated Data Scientist to join our dynamic team and contribute to our mission of driving innovation through data-driven insights. As the Lead Data Scientist and Machine Learning Engineer at Sykatiya Technology Pvt Ltd, you will play a crucial role in analyzing large datasets to uncover patterns, develop predictive models, and implement AI/ML solutions. Your responsibilities will include working on projects involving neural networks, deep learning, data mining, and natural language processing (N...