1547 Glue Jobs - Page 2

Job Summary: We are seeking a skilled and detail-oriented Big Data Engineer with over 5 years of IT experience, including at least 3 years specializing in Big Data application development using the Hadoop ecosystem and Cloud platforms (AWS/Azure) . The ideal candidate will have strong expertise in PySpark , ETL pipeline development , data integration , and workflow orchestration to build scalable and efficient data solutions. Key Responsibilities: Design, develop, and optimize Big Data pipelines using PySpark , Hive , Sqoop , and Spark SQL . Implement ETL processes for ingesting, transforming, and loading large-scale structured and unstructured data from diverse sources (JSON, Parquet, Avro,...

Must have skills: Python/Scala, Pyspark/Pytorch Good to have skills: Redshift Job Summary Youll capture user requirements and translate them into business and digitally enabled solutions across a range of industries. Your responsibilities will include: Roles and Responsibilities Designing, developing, optimizing, and maintaining data pipelines that adhere to ETL principles and business goals Solving complex data problems to deliver insights that helps our business to achieve their goals. Source data (structured unstructured) from various touchpoints, format and organize them into an analyzable format. Creating data products for analytics team members to improve productivity Calling of AI ser...

Job Title : Python Lead Developer Location : Chennai - Hybrid (3 Days a Week in Office) Experience : 8- 10 Years Employment Type : Contract Shift : UK Shift (if applicable) Job Summary We are looking for a highly skilled Python Lead Developer with strong expertise in Python, SQL, AWS, and Apache Airflow. The ideal candidate will lead a team of developers to build scalable data pipelines, backend systems, and cloud-based solutions, ensuring high performance, maintainability, and adherence to best practices. Key Responsibilities Lead and mentor a team of Python developers, ensuring delivery of high-quality software solutions. Design, develop, and optimize data pipelines and backend systems usi...

Roles and Responsibilities Create and maintain optimal data pipeline architecture; assemble large, complex data sets that meet functional non-functional requirements. Design the right schema to support the functional requirement and consumption patter. Design and build production data pipelines from ingestion to consumption. Build the necessary datamarts, data warehouse required for optimal extraction, transformation, and loading of data from a wide variety of data sources. Create necessary preprocessing and postprocessing for various forms of data for training/ retraining and inference ingestions as required Create data visualization and business intelligence tools for stakeholders and data...

Solid experience, knowledge and skills in Data Engineering, BI/software development such as ELT/ETL, data extraction and manipulation in Data Lake/Data Warehouse environment. Proven experience in data modelling, analysis, and profiling. Experience of working in diverse data domains. Continuous improvement and performance optimisation practice ensuring high levels of performance, availability and integrity. Proven consulting and mentoring experience. Experience in working within an Agile environment. Experience in applying DevOps practices, SDLC, CI/CD principles to build automated pipelines and deployment. Other capabilities Hands on in SQL and its Big Data variants (Hive-QL, Databricks) Pyt...

We are currently considering only candidates based in Bangalore who can attend in-person interviews after CV shortlisting. We're open to considering candidates with 3 to 12 years of experience, provided you are a hands-on coder with strong technical skills. The Modern Data Engineer is responsible for designing, implementing, and maintaining scalable data architectures using cloud technologies, primarily on AWS, to support the next evolutionary stage of the Investment Process. They build robust data pipelines, optimize data storage, and access patterns, and ensure data quality while collaborating across engineering teams to deliver high-value data products Key Responsibilities • Implement and...

Data Engineering and Data Warehousing Strong experience in SQL and MySQL Expertise in Azure Data Factory ADF and Snowflake Understanding of Medallion Architecture Hands on with ETL and ELT pipeline testing Cloud Computing and Fundamentals Knowledge of Microsoft Azure Fundamentals Data Quality and Testing Experience with automated testing and validation frameworks Python and SODA Skills in data profiling cleansing and anomaly detection Ability to perform root cause analysis and data reconciliation

The Supply Chain & Manufacturing team at ZS is dedicated to optimizing and transforming supply chain operations for our clients across various industries. Out team offers a comprehensive range of services from stragegy and advanced analytics to planning and technology, aimed at optimizing resource deployment while maintaining high customer service levels. We are committed to driving innvotation and efficiency through cutting-edge solutions that address the complex challenges of supply chain and manufacturing operations. What youll do: Lead the technical team consisting of Developers, Senior Engineers, etc. to solve the business problems and lead end to end technical delivery in collaboration...

As a Senior Data Engineer in the healthcare domain, your role involves architecting, developing, and managing large-scale, secure, and high-performance data pipelines on Databricks using Spark, Delta Lake, and cloud-native tools. You will be responsible for designing and implementing healthcare-specific data models to support analytics, AI/ML, and operational reporting. Your expertise will be crucial in ingesting and transforming complex data types such as 837/835 claims, EHR/EMR records, provider/member files, lab results, and clinical notes. Additionally, you will lead data governance, quality, and security initiatives ensuring compliance with HIPAA, HITECH, and organizational policies. Co...

As an Internal Data Warehouse Developer & Administrator in Chennai, Tamil Nadu, you will be responsible for the following: - Designing, developing, and executing detailed test plans and test cases for ETL processes. - Conducting end-to-end data validation across various data sources such as claims, member, and provider data. - Collaborating with data engineers, business analysts, and product owners to understand ETL requirements and test accordingly. - Utilizing ICEDQ or similar tools for ETL data testing and reconciliation. - Performing SQL-based backend testing and managing test data. - Documenting test results and providing root cause analysis for data quality issues. - Participating in A...

As an experienced candidate, you will be expected to have the following skills and qualifications for the Python Developer position: **Role Overview:** You should have experience in designing, implementing, and testing Python applications with a good understanding of object-oriented programming, multi-tier architecture, and parallel/multi-threaded programming. Programming experience with Python is a must, and familiarity with Java/Scala would be a plus. Additionally, you should have a solid background in AWS technologies, including AppSync, Lambda, Step Functions, and Event Bridge. **Key Responsibilities:** - Solid experience with various AWS services such as CloudFormation, S3, Glue, EMR/Sp...

Role & responsibilities 1. Strong experience in AWS Data Engineering 2. Experience in Python/Pyspark 3. Experience Airflow/Databricks

Job Title: AWS Data Engineering Senior Solution Architect (Financial Domain) Job Overview Lead the architecture and delivery of end-to-end AWS data engineering solutions for financial services clients. Partner with cross-functional teams to design, build, and optimize data pipelines, data lakes, and analytics platforms tailored for financial use cases including risk, compliance, and real-time reporting. Key Responsibilities ? Architect scalable, secure AWS-based data platforms (S3, Redshift, Glue, EMR, Lambda, Lake Formation) for large-scale financial data. [1][2] ? Analyze client requirements, design technical solutions, and create reference architectures for banking, insurance, fintech, an...

Job description Hiring for AWS Architect Mandatory Skills: AWS services, Data & Analytics Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and detailed ...

AWS Data Engineer Experience: 4 - 8 Years Exp. Salary : Competitive Preferred Notice Period : Within 7 Days Shift : 12:00 PM to 9:00 PM IST Opportunity Type: Hybrid , Hyderabad, Telangana Placement Type: Permanent (*Note: This is a requirement for one of Uplers' Clients) Must have skills required : AWS Services, Cloud analytics, Data Integration, Data lake, ETL, Data Modelling, Python, Redshift Clovertex (One of Uplers' Clients) is Looking for: AWS Data Engineer who is passionate about their work, eager to learn and grow, and who is committed to delivering exceptional results. If you are a team player, with a positive attitude and a desire to make a difference, then we want to hear from you....

Senior Data Scientist Enterprise Analytics Want to be part of the Data & Analytics organization, whose strategic goal is to create a world-class Data & Analytics company by building, embedding, and maturing a data-driven culture across Thomson Reuters. We are looking for a highly motivated individual with strong organizational and technical skills for the position of Senior Data Scientist. You will play a critical role working on cutting edge of analytics, leveraging predictive models, machine learning and generative AI to drive business insights and facilitating informed decision-making and help Thomson Reuters rapidly scale data-driven initiatives. About The Role In this opportunity as Sen...

We are looking for an experienced *Software Engineer - Informatica* with 4 to 6 years of hands-on expertise* in designing, developing, and optimizing large-scale *ETL solutions* using *Informatica PowerCenter*. The ideal candidate will lead ETL projects, mentor junior developers, and ensure high-performance data integration across enterprise systems. About The Role In this role as Software Engineer, you will: - Analyze business and functional requirements to design and implement scalable data integration solutions - Understand and interpret High-Level Design (HLD) documents and convert them into detailed Low-Level Design (LLD) - Develop robust, reusable, and optimized Informatica mappings, s...

Role Proficiency: Independently develops error free code with high quality validation of applications guides other developers and assists Lead 1 - Software Engineering Outcomes: Understand and provide input to the application/feature/component designs; developing the same in accordance with user stories/requirements. Code debug test document and communicate product/component/features at development stages. Select appropriate technical options for development such as reusing improving or reconfiguration of existing components. Optimise efficiency cost and quality by identifying opportunities for automation/process improvements and agile delivery models Mentor Developer 1 - Software Engineerin...

Education : B.tech or M.Tech Location : India - SEZ - Hyderabad, India Required Skill Set : AWS Cloud, aws data engineer Roles and responsibilities Design AWS architectures based on business requirements. Create architectural diagrams and documentation. Present cloud solutions to stakeholders. Skills and Qualifications: Design, develop, and maintain scalable ETL/ELT pipelines using AWS services like Glue, Lambda, and Step Functions. Work with batch and real-time data processing using AWS Glue, Kinesis, Kafka, or Apache Spark. Optimize data pipelines for performance, scalability, and cost-effectiveness. Identify bottlenecks and optimize query performance on Redshift, Athena, and Glue. Strong ...

AWS Data Engineer 8-11 years AWS Data Engineer, Python Python, S3, RDS, Glue, Lambda, IAM, SNS, SQL , Quicksight

Description Skills Required Strong experience working in Cloud-based Engineering teams preferably using AWS. Solid understanding of dimensional modelling. Thorough understanding of Python and SQL for data exploration and transformation ideally within Spark environments (Pyspark SparkSQL) such as within Glue jobs. Strong written and oral communication skills and presentation skills with the ability to translate business needs to system and software/data requirements. Strong analysis and analytical skills with attention to detail within complex systems and datasets particularly on relationships between them. Solid understanding of version control systems specifically Git. Named Job Posting? (i...

Description Responsibilities Must have 1. Strong expertise in SQL Python PySpark. 2. Good knowledge on Data warehousing techniques. 3. Good knowledge on AWS Big Data services and snowflake. Design develop and maintain scalable data pipelines and architectures for data processing and integration. Implement data streaming solutions to handle real-time data ingestion and processing. Utilize Python and PySpark to develop and optimize data workflows. Leverage AWS services such as S3 Redshift Glue Kinesis and Lambda for data storage processing and analytics. Collaborate with data scientists analysts and other stakeholders to understand data requirements and deliver solutions. Ensure data quality i...

We are seeking a talented individual to join our Tech team at MMC Corporate.This role will be based in Gurgaon/ Noida/Pune/Mumbai. This is a hybrid role that has a requirement of working at least three days a week in the office. Senior Principal Engineer Data Engineering What can you expect? As a Data Engineer, you will be responsible for designing and implementing scalable data pipelines and AI Based solution using Databricks. You will handle end-to-end ETL/ELT processes, manage large datasets, and work with tools like Python, PySpark, and AWS S3 to ensure data is transformed and optimized for analytical use. Youll work on cutting-edge cloud and hybrid data projects, transforming raw data i...

Department ISS Reports To Data Engineers Lead Level 6 About your role This role sits within the ISS Data Engineering. The Data Engineering team is responsible for building and maintaining the data applications and platform that enables the ISS business to operate. This role is appropriate for a senior data engineer capable of taking ownership and a delivering a subsection of the wider data platform or data applications. As a Senior Data Engineer, you will directly contribute to our key organizational objectives of Accelerated Innovation, Cost Optimization, Risk Mitigation, and Business Enablement Key Responsibilities Design, develop and maintain scalable data pipelines and architectures to s...

Role Description: We are seeking a highly skilled and detail-oriented Data Engineering Test Automation Engineer to ensure the quality, reliability, and performance of our data pipelines and platforms. The ideal candidate has strong experience in data testing, ETL validation, and automation frameworks, and will work closely with data engineers, analysts, and DevOps to build robust test suites. This role involves designing and executing both manual and automated tests for real-time and batch data pipelines across AWS and Databricks platforms, while applying QA best practices in test planning, defect tracking, and lifecycle management to ensure high-quality data delivery. In addition, the resou...