1564 Glue Jobs - Page 19

As a Machine Learning Engineer, you will be responsible for designing, developing, deploying, and maintaining scalable ML solutions in a cloud-native environment. Your key responsibilities will include: - Designing and implementing machine learning models and pipelines using AWS SageMaker and related services. - Developing and maintaining robust data pipelines for training and inference workflows. - Collaborating with data scientists, engineers, and product teams to translate business requirements into ML solutions. - Implementing MLOps best practices including CI/CD for ML, model versioning, monitoring, and retraining strategies. - Optimizing model performance and ensuring scalability and r...

As a Senior Data Engineer, you will be responsible for designing and optimizing large-scale data pipelines using Databricks and the AWS ecosystem. Your expertise in Databricks and AWS with a minimum of 7 years of experience is mandatory for this role. Key Responsibilities: - Designing and optimizing large-scale data pipelines using Databricks and AWS technologies - Working with Databricks tools such as PySpark, Delta Lake, and MLflow - Utilizing AWS services including Glue, S3, Lambda, Redshift, and EMR - Developing and maintaining Data Lake, ETL pipelines, CI/CD processes - Proficiency in Python and SQL for data processing and analysis Qualifications Required: - Minimum 7 years of experienc...

Position: AWS Data Engineer Experience: 57 years Domain Preference: Healthcare data engineering About the Role We are seeking a highly skilled AWS Data Engineer with 57 years of experience to join our data engineering team. The ideal candidate will design, build, and maintain robust, secure, and scalable data pipelines on AWS. Prior experience in healthcare data projects (EHR/CCD/HL7/FHIR, claims, HCC) is preferred. You will be responsible for creating and enabling Medallion Architecture (Bronze -Silver-Gold layers), optimizing large-scale data processing, ensuring compliance (HIPAA, SOC II), and supporting downstream analytics and other initiatives. Key Responsibilities Design, implement, a...

Job Description Role Purpose The purpose of this role is to provide significant technical expertise in architecture planning and design of the concerned tower (platform, database, middleware, backup etc) as well as managing its day-to-day operations Job Summary: We are seeking a highly skilled Senior Tableau Developer with a strong background in Snowflake and AWS cloud services to join our data analytics team. This role is ideal for a data visualization expert who can work closely with business stakeholders to design and develop scalable, insightful dashboards and reports. The ideal candidate has a deep understanding of data warehousing, cloud data architecture, and business intelligence bes...

We are looking for a skilled AWS Data Pipeline Engineer with 4 to 12 years of experience to manage data storage solutions on AWS, implement data processing workflows, and collaborate with cross-functional teams. The ideal candidate will have a strong understanding of core AWS services, cloud concepts, and the AWS Well-Architected Framework. Roles and Responsibility Managing data storage solutions on AWS, including Amazon S3, Amazon Redshift, and Amazon DynamoDB. Implementing and optimizing data processing workflows using AWS services like AWS Glue, Amazon EMR, and AWS Lambda. Collaborating with Spotfire Engineers and business analysts to ensure data accessibility and usability for analysis a...

The architect will play a crucial role in designing, implementing and maintaining data and technology solutions that align with our client's business goals and objectives. This role requires a deep understanding of AWS data services, good understanding of AWS Infra & Ops services, and the ability to translate business requirements into scalable and efficient solutions. Job Responsibilities 10+ years of Experience 5+ years relevant experience. Data Architecture and Cloud Strategy - MUST HAVE Develop and maintain a comprehensive data architecture and cloud strategy that aligns with the organization's goals and needs. Design, implement and manage cloud-based data infrastructure on AWS, ensuring...

Dear Candidate Greetings from TATA Consultancy Services Job Openings at TCS Skill: AWS Data Engineer Exp range: 6 yrs to 10 yrs location : Bangalore Notice period 30 45 days Pls find the Job Description below. Hands-on experience in Pyspark, Glue Experience on EMR, S3, IAM, Lambda, Cloud formation, Python AMI Rehydration, Python, ELB and other AWS components knowledge AWS monitoring setup and building the traffic dashboard and SNOW incidents for AWS related traffic and services CI/CD build and deployment support Ensure reliability of data pipelines, ETL processes, data transformations Identify areas of improvement in data quality processes, propose solutions to enhance data reliability, accu...

Pyspark SparkSQL SQL and Glue. ii. AWS cloud experience iii. Good understanding of dimensional modelling iv. Good understanding DevOps CloudOps DataOps CI/CD & with a SRE mindset v. Understanding of Lakehouse and DW architecture vi. strong analysis and analytical skills vii. understanding of version control systems specifically Git viii. strong in software engineering APIs Microservices etc. Soft skills i. written and oral communication skills ii. ability to translate business needs to system. Location - Hyderabad,Kolkata,Peth,Pune

Primary Skills: Extensive experience with AWS services : IAM, S3, Glue, CloudFormation and CloudWatch In-depth understanding of AWS IAM policy evaluation for permissions and access control Proficient in using Bitbucket, Confluence, GitHub, and Visual Studio Code Proficient in policy languages, particularly Rego scriptingGood to Have Skills : Experience with the WIZ tool for security and compliance Good programming skills in Python Advanced knowledge of additional AWS services : ECS, EKS, Lambda, SNS and SQSRoles & ResponsibilitiesSenior Developer on the Wiz team specializing in Rego and AWS- -Project Manager - One to Three Years,AWS Cloud Formation - Four to Six Years,AWS IAM - Four to Six Y...

Stellantis is seeking a passionate, innovative, results-oriented Information Communication Technology (ICT) Manufacturing AWS Cloud Architect to join the team. As a Cloud architect, the selected candidate will leverage business analysis, data management, and data engineering skills to develop sustainable data tools supporting Stellantiss Manufacturing Portfolio Planning. This role will collaborate closely with data analysts and business intelligence developers within the Product Development IT Data Insights team. Job responsibilities include but are not limited to: Having deep expertise in the design, creation, management, and business use of large datasets, across a variety of data platform...

Key Responsibilities Design, build, and optimize scalable data pipelines on AWS. Develop and maintain data models to support analytics and business intelligence. Implement orchestration workflows using Airflow or AWS Step Functions . Work with structured and semi-structured data across S3, Redshift, Glue, Lambda . Write efficient, reusable, and modular Python and SQL code for ETL processes. Ensure data reliability, scalability, and performance tuning of pipelines. Integrate third-party and internal APIs into data workflows. Collaborate with stakeholders to translate business requirements into technical solutions. Required Skillset Strong expertise in AWS architecture & optimization (S3, Reds...

About the Role We are seeking a highly skilled Lead Data Engineer to define and drive the data migration strategy from legacy RDBMS platforms to PostgreSQL for a mission-critical billing and invoicing system. This role requires a hands-on technical leader who can design the migration architecture, oversee implementation, and ensure seamless transition without disruption to core business functions. The ideal candidate will have deep expertise in data migration frameworks, large-scale distributed processing (Spark preferred), and experience with both open-source and AWS ecosystem tools. They will work closely with business stakeholders and customers to manage expectations, deliver with precisi...

Urgent requirement for AWS Data Engineer. Top 3 skills AWS data technologies (S3, Redshift, Athena, Glue), Python, Pyspark, SQL, ETL toolsets, inc. Informatica CDC, ETL, Kafka Work location NTTData office India (Hybrid) Shift timings Normal shift Experience 7+ yrs POSITION OVERVIEW : Data Engineer Position Overview Summary: The Data Engineer will expand and optimize the data and data pipeline architecture, as well as optimize data flow and collection for cross functional teams The Data Engineer will perform data architecture analysis, design, development and testing to deliver data applications, services, interfaces, ETL processes, reporting and other workflow and management initiatives The ...

As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data processing systems in cloud-based Big Data environments. Your passion for data architecture and experience in creating reliable pipelines using modern technologies will be crucial for this role. **Key Responsibilities:** - Understand business requirements and translate them into scalable and efficient data solutions. - Design, develop, and maintain robust data pipelines for batch and stream processing. - Build data lakes, warehouses, and data mesh solutions for enterprise-level consumption. - Transform complex data from various sources into actionable insights and production-ready data p...

As an Azure DB Architect with 8+ years of experience, your role will involve: - Designing Databricks workspaces and Unity Catalog for multi-tenant environments - Architecting Lakehouse solutions with Delta Lake - Demonstrating expertise in Spark core for real-time and batch pipeline designing - Implementing data modelling, security & governance using RBAC and ABAC - Ensuring data lineage and metadata management - Orchestrating workflows using Databricks Workflows - Applying best practices for artifact organization and naming conventions in Databricks Qualifications required for this role include: - Minimum of 10 years of experience in the field - Deep understanding of AWS services such as Re...

As a Sr. BI Systems Analyst, you will: - Lead our efforts in monitoring data quality and processes across multiple platforms, from raw file and object stores to relational databases and the dashboards and reports that rely on them, to ensure our data is accurate for end users. - Take the lead in developing improvements to those workflows and processes that enhance the accuracy and timeliness of our data. - Assist in the design and planning of how new data sources or data details will integrate into those existing processes. - Assist in the monitoring and management of report usage and the retirement or sunsetting of reports as the need for them declines. - Help support ad hoc needs for BI an...

We are looking for a skilled professional with 5 to 10 years of experience in Snowflake, including enterprise-level architecture and operations. The ideal candidate should have strong SQL development skills and knowledge of data modeling best practices. This position is based in Chennai/GNDC/Pune. Roles and Responsibility Design and implement scalable and efficient data storage solutions using Snowflake. Develop and maintain complex SQL queries for data analysis and reporting. Collaborate with cross-functional teams to identify and prioritize project requirements. Troubleshoot and resolve performance tuning issues in Snowflake. Ensure data quality and integrity by implementing data validatio...

Job Description Summary We are seeking an experienced Data Architect to design and develop a scalable, secure, and efficient data platform. The successful candidate will have a strong background in cloud computing, and software architecture and implementation with a passion for technology innovation and cross functional collaboration. The data Architect will be responsible for designing and implementing the data architecture platform, ensuring seamless integration with our existing systems, and providing technical leadership to the development team. GE Healthcare is a leading global medical technology and digital solutions innovator. Our mission is to improve lives in the moments that matter...

Job Description Job Description Join our dynamic team of innovators and technologists as a Applied AI/ML Associate , where your mission will be to revolutionize how the Private Bank services and advises clients, deepen client engagements, and drive process transformation. You will analyze existing processes and vast amounts of data to design autonomous AI agents. We seek individuals passionate about leveraging advanced data analysis, statistical modeling, and AI/ML techniques to solve complex business challenges through high-quality, cloud-centric software delivery. Our culture thrives on experimentation, continuous improvement, and learning. You will work in a collaborative, trusting, and i...

Job Title: Senior Data Engineer Employment Type: Full-Time Location: Ahmedabad, Onsite Experience Required: 5+ Years About Techiebutler Techiebutler is looking for an experienced Data Engineer to develop and maintain scalable, secure data solutions. You will collaborate closely with data science, business analytics, and product development teams, deploying cutting-edge technologies and leveraging best-in-class third-party tools. You will also ensure compliance with security, privacy, and regulatory standards while aligning data solutions with industry best practices. Tech Stack Languages: SQL, Python Pipeline Orchestration: Dagster (Legacy: Airflow) Data Stores: Snowflake, Clickhouse Platfor...

Desired Knowledge and Skills: Experience with most of the cloud products such as Amazon AWS. Experience as developer in multiple cloud technologies including AWS EC2, S3, Amazon API Gateway, , AWS Lambda, AWS Glue, AWS RDS. Good knowledge on AWS environment and Service knowledge with S3 storage understanding. Must have good knowledge of AWS Glue and serverless architecture. • Collaborate with data analysts and stakeholders to meet data requirements. • Must have hands on experience of Amazon Redshift Architecture. AWS Redshift experience for DB design AWS Pipeline knowledge to develop ETL for data movement to Redshift, experience to map the source to target rules and fields. Strong in writing...

Desired Knowledge and Skills: Experience with most of the cloud products such as Amazon AWS. Experience as developer in multiple cloud technologies including AWS EC2, S3, Amazon API Gateway, , AWS Lambda, AWS Glue, AWS RDS. Good knowledge on AWS environment and Service knowledge with S3 storage understanding. Must have good knowledge of AWS Glue and serverless architecture. • Collaborate with data analysts and stakeholders to meet data requirements. • Must have hands on experience of Amazon Redshift Architecture. AWS Redshift experience for DB design AWS Pipeline knowledge to develop ETL for data movement to Redshift, experience to map the source to target rules and fields. Strong in writing...

Degree in Computer Science (or similar), alternatively well-founded professional experience in the desired field Roles Responsibilities: As a Senior Data Engineer, you manage and develop the solutions in close alignment with various business and Spoke stakeholders. You are responsible for the implementation of the IT governance guidelines. Collaborate with the Spokes Data Scientists, Data Analysts, and Business Analysts, when relevant. Tasks Create and manage data pipeline architecture for data ingestion, pipeline setup and data curation Experience working with and creating cloud data solutions Assemble large, complex data sets that meet functional/non-functional business requirements Implem...

Educational Qualification: Bachelors/master's degree in computer science, Engineering, or a related field 60% above in academics Responsibility: Provide sustainable and well-structured solutions along with documentation. Expertise with cloud services eg. AWS, Azure, GCP Expertise in Spark Expertise in Python and SQL programming. Experience with BI tools: QuickSight, Plotly-Dash, PowerBI, Tableau etc. Development and maintenance of Machine Learning pipelines for existing ML models. Requirements: Expertise in AWS services eg. Glue, SageMaker etc Good analytical skills Experience of working with International clients. Alignment with counterpart for requirements and results. Continuous learning ...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Data Engineering Good to have skills : Amazon Web Services (AWS), Machine Learning, Big Data Analysis Tool and Techniques Minimum 3 year of experience is required Educational Qualification : BE or similar Education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with cross-functional teams to gather requirements, ...