988 Glue Jobs - Page 37

Were Hiring: Sr. AWS Data Engineer – GSPANN Technologies Locations: Bangalore, Pune, Hyderabad, Gurugram Experience: 6+ Years | Immediate Joiners Only Looking for experts in: AWS Services: Glue, Redshift, S3, Lambda, Athena Big Data: Spark, Hadoop, Kafka Languages: Python, SQL, Scala ETL & Data Engineering Apply now: heena.ruchwani@gspann.com #AWSDataEngineer #HiringNow #DataEngineering #GSPANN

Role Overview We are seeking an experienced Lead Data Engineer to join our Data Engineering team at Paytm, India's leading digital payments and financial services platform. This is a critical role responsible for designing, building, and maintaining large-scale, real-time data streams that process billions of transactions and user interactions daily. Data accuracy and stream reliability are essential to our operations, as data quality issues can result in financial losses and impact customer a Lead Data Engineer at Paytm, you will be responsible for building robust data systems that support India's largest digital payments ecosystem. You'll architect and implement reliable, real-time data st...

Need to have strong exp : AWS Services (S3, Glue, Lambda etc) Strong exp on SQL, Python Pyspark

About The Role Data Engineer -2 (Experience 2-5 years) What we offer Our mission is simple Building trust. Our customer's trust in us is not merely about the safety of their assets but also about how dependable our digital offerings are. That"™s why, we at Kotak Group are dedicated to transforming banking by imbibing a technology-first approach in everything we do, with an aim to enhance customer experience by providing superior banking services. We welcome and invite the best technological minds in the country to come join us in our mission to make banking seamless and swift. Here, we promise you meaningful work that positively impacts the lives of many. About our team DEX is a central data...

Overview Technology for today and tomorrow People-driven culture Find your future with us At Boeing, we are all innovators on a mission to connect, protect, explore and inspire. From the seabed to outer space, youll learn and grow, contributing to work that shapes the world. Find your future with us. Data Analytics team is looking for Experienced Cloud Data Solution Architect to help build cloud-based Data Products. This position will focus on supporting the Boeing IT&DA goals of developing cloud native applications/adopting multi-cloud strategy. This role will be based out of Bangalore , India . Position Responsibilities: Hands-on experience in understanding aerospace domain specific data M...

The Senior QA Engineer will be responsible for ensuring complete test coverage of data platform and product functionality, development, and maintenance of comprehensive test automation infrastructure, helping with debugging and validating fixes for production issue. This role is responsible for performing a variety of QA engineering tasks including design and development of automation test frameworks, executing and automating tests, actively participating in grooming, participating in production calls, and helping with resolving production issues, raising appropriate questions very early in feature development. The ideal candidate will have the necessary skills and experience and love to wor...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelor...

Position: Data Engineer Location: Bangalore, India About Dodge Dodge Construction Network exists to deliver the comprehensive data and connections the construction industry needs to build thriving communities. Our legacy is deeply rooted in empowering our customers with transformative insights, igniting their journey towards unparalleled business expansion and success. We serve decision-makers who seek reliable growth and who value relationships built on trust and quality. By combining our proprietary data with cutting-edge software, we deliver to our customers the essential intelligence needed to excel within their respective landscapes. We propel the construction industry forward by transf...

Overview: As a Data Engineer, you will work with multiple teams to deliver solutions on the AWS Cloud using core cloud data engineering tools such as Databricks on AWS, AWS Glue, Amazon Redshift, Athena, and other Big Data-related technologies. This role focuses on building the next generation of application-level data platforms and improving recent implementations. Hands-on experience with Apache Spark (PySpark, SparkSQL), Delta Lake, Iceberg, and Databricks is essential. Responsibilities: • Design and develop data lakes, manage data flows that integrate information from various sources into a common data lake platform through an ETL Tool • Code and manage delta lake implementations on S3 u...

Location- PAN India Exp- 5 to 12 Years Key Responsibilities: 1. Design, implement, and maintain end-to-end ML pipelines for model training, evaluation, and deployment 2. Collaborate with data scientists and software engineers to operationalize ML models 3. Develop and maintain CI/CD pipelines for ML workflows 4. Implement monitoring and logging solutions for ML models 5. Optimize ML infrastructure for performance, scalability, and cost-efficiency 6. Ensure compliance with data privacy and security regulations Required Skills and Qualifications: 1. Strong programming skills in Python, with experience in ML frameworks 2. Expertise in containerization technologies (Docker) and orchestration pla...

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Python (Programming Language), AWS Aurora, PySpark, Oracle Procedural Language Extensions to SQL (PLSQL) Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will be responsible for designing, building, and configuring applications to meet business process and application requirements. Your typical day will involve collaborating with team members to develop innovative solutions and ensure seamless applic...

5+ years of experience in data engineering with a strong focus on AWS services . Proven expertise in: Amazon S3 for scalable data storage AWS Glue for ETL and serverless data integration using Amazon S3, DataSync, EMR, Redshift for data warehousing and analytics Proficiency in SQL , Python , or PySpark for data processing. Experience with data modeling , partitioning strategies , and performance optimization . Familiarity with orchestration tools like AWS Step Functions , Apache Airflow , or Glue Workflows . Strong understanding of data lake and data warehouse architectures. Excellent problem-solving and communication skills. Mandatory Competencies Beh - Communication ETL - ETL - AWS Glue Bi...

Design, implement, and maintain data pipelines for processing large datasets, ensuring data availability, quality, and efficiency for machine learning model training and inference. Collaborate with data scientists to streamline the deployment of machine learning models, ensuring scalability, performance, and reliability in production environments. Develop and optimize ETL (Extract, Transform, Load) processes, ensuring data flow from various sources into structured data storage systems. Automate ML workflows using ML Ops tools and frameworks (e.g., Kubeflow, MLflow, TensorFlow Extended (TFX)). Ensure effective model monitoring, versioning, and logging to track performance and metrics in a pro...

Inviting applications for the role of Principal Consultant- AWS Developer We are seeking an experienced Developer with expertise in AWS-based big data solutions, particularly leveraging Apache Spark on AWS EMR, along with strong backend development skills in Java and Spring. The ideal candidate will also possess a solid background in data warehousing, ETL pipelines, and large-scale data processing systems.. Responsibilities Design and implement scalable data processing solutions using Apache Spark on AWS EMR. Develop microservices and backend components using Java and the Spring framework. Build, optimize, and maintain ETL pipelines for structured and unstructured data. Integrate data pipeli...

Description: Year of exp- 5 to 8 Years Location- Pune, Noida, Bangalore Requirements: Strong experience with MS SQL Server and Snowflake Solid knowledge of AWS cloud services (e.g., S3, EC2, Glue, Lambda) Proficient in Python and C# for scripting, API integration, and data processing Experience working with Apache NiFi for data ingestion and orchestration Hands-on with Apache Airflow for scheduling and managing workflows Proficient in Apache Spark for big data processing and transformation Experience working with Qubole or similar data lake platforms Strong problem-solving skills and attention to detail Excellent communication and collaboration abilities Job Responsibilities: Design and deve...

Highly skilled AWS Data Engineer in data analytics, data engineering, and data warehousing. Having strong expertise in AWS cloud services, excellent problem-solving skills & the ability to collaborate effectively across technical and business teams.

Stellantis is seeking a passionate, innovative, results-oriented Information Communication Technology (ICT) Manufacturing AWS Cloud Architect to join the team. As a Cloud architect, the selected candidate will leverage business analysis, data management, and data engineering skills to develop sustainable data tools supporting Stellantiss Manufacturing Portfolio Planning. This role will collaborate closely with data analysts and business intelligence developers within the Product Development IT Data Insights team. Job responsibilities include but are not limited to Having deep expertise in the design, creation, management, and business use of large datasets, across a variety of data platforms...

PF Detection is mandatory : Managing data storage solutions on AWS, such as Amazon S3, Amazon Redshift, and Amazon DynamoDB. Implementing and optimizing data processing workflows using AWS services like AWS Glue, Amazon EMR,and AWS Lambda. Working with Spotfire Engineers and business analysts to ensure data is accessible and usable for analysisand visualization. Collaborating with other engineers, and business stakeholders to understand requirements and deliversolutions. Writing code in languages like SQL, Python, or Scala to build and maintain data pipelines and applications. Using Infrastructure as Code (IaC) tools to automate the deployment and management of datainfrastructure. A strong u...

Pyspark SparkSQL SQL and Glue. ii. AWS cloud experience iii. Good understanding of dimensional modelling iv. Good understanding DevOps CloudOps DataOps CI/CD & with a SRE mindset v. Understanding of Lakehouse and DW architecture vi. strong analysis and analytical skills vii. understanding of version control systems specifically Git viii. strong in software engineering APIs Microservices etc. Soft skills i. written and oral communication skills ii. ability to translate business needs to system.

Extensive experience with AWS services : IAM, S3, Glue, CloudFormation and CloudWatch In-depth understanding of AWS IAM policy evaluation for permissions and access control Proficient in using Bitbucket, Confluence, GitHub, and Visual Studio Code Proficient in policy languages, particularly Rego scriptingGood to Have Skills : Experience with the WIZ tool for security and compliance Good programming skills in Python Advanced knowledge of additional AWS services : ECS, EKS, Lambda, SNS and SQSRoles & ResponsibilitiesSenior Developer on the Wiz team specializing in Rego and AWS------ ------Project Manager - One to Three Years,AWS Cloud Formation - Four to Six Years,AWS IAM - Four to Six Years--...

Exp level: 6to 15 years Location: Hyd/Pune/Bang Hybrid : mode Note: Please share relevant profiles PA00920780@techmahindra.com AWS data stack knowledge (Glue, Lambda, S3, Postgres, Snowflake, DBT) Knowledge of Informatica BDM/IDMC (to support legacy to cloud migration) Insurance domain understanding (IFRS 17, actuarial models) Experience in tools like Calibra, Click, Sigma, Power Platform Regards, Priya 7827XXXXXX

Experience: 6+ years Work Location: Bangalore Shift - 1 to 10pm IST Job Summary: We are looking for a highly skilledAWS Data Engineer with strong experience in data architecture, DevOps practices, and code quality tools like SonarQube. You will be responsible for designing scalable data storage and access patterns using AWS services such asDynamo DB, Redis, Glue, Lambda, and Kafka. This role focuses on ensuring efficient, secure, and maintainable data solutions to support both short-term and long-term consumption across our platforms. Key Responsibilities: Design and implement robust data architectures that support scalability, high availability, and performance within theAWS ecosystem. Deve...

Lead Software Engineer (AWS Cloud, Platform Engineering)We are seeking an experienced and motivated Lead Software Engineer to join Mastercard's AWS Platform Engineering Team. This role is critical in designing, building, and maintaining a scalable, secure, and highly available cloud platform on AWS. You will collaborate with cross-functional teams to ensure optimal platform performance, cost efficiency, and alignment with best practices. The ideal candidate is expected to have a strong understanding of AWS services, DevOps practices, and infrastructure automation and to focus on enabling application teams to deliver value rapidly and securely. The Role Design, implement, and maintain a scala...

Roles and Responsibilities: Experience in GLUE AWS Experience with one or more of the following: Spark, Scala, Python, and/or R . Experience in API development with NodeJS Experience with AWS (S3, EC2) or other cloud provider Experience in Data Virtualization tools like Dremio and Athena is a plus Should be technically proficient in Big Data concepts Should be technically proficient in Hadoop and noSQL (MongoDB) Good communication and documentation skills

AWS: Lambda Glue Kafka/Kinesis RDBMS Oracle, MySQL, RedShift, PostgreSQL, Snowflake Gateway Cloudformation / Terraform Step Functions Cloudwatch Python Pyspark Job role & responsibilities: Looking for a Software Engineer/Senior Software engineer with hands on experience in ETL projects and extensive knowledge in building data processing systems with Python, pyspark and Cloud technologies(AWS). Experience in development in AWS Cloud (S3, Redshift, Aurora, Glue, Lambda, Hive, Kinesis, Spark, Hadoop/EMR) Required Skills: Amazon Kinesis, Amazon Aurora, Data Warehouse, SQL, AWS Lambda, Spark, AWS QuickSight Advanced Python Skills Data Engineering ETL and ELT Skills Experience of Cloud Platforms (...