1564 Glue Jobs - Page 23

Role Overview: As a Senior Software Engineer with 5-8 years of experience, you will be responsible for developing efficient and scalable software solutions. Your primary focus will be on utilizing Core JAVA (8 or above), Springboot, RESTful APIs, and Microservices architecture to deliver high-quality applications. Additionally, you will be expected to work with Maven and possess strong AWS skills, particularly in services like S3 bucket, step functions, storage gateway, ECS, EC2, DynamoDB, AuroraDB, Lambda functions, and Glue. Key Responsibilities: - Expertise in Code management using Git - Setting up CI/CD Pipelines with tools like Jenkins/GitHub - Working with Docker/Kubernetes for contain...

We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will have a strong background in designing, developing, and managing data pipelines, working with cloud technologies, and optimizing data workflows. Note: We have Face to Face interview process during weekdays in our Magarpatta/Hinjewadi Phase 1 office. Only apply if you are willing to attend the F2F interview. Also we are looking for September and October joiners only. Experience: 6 to 10 Years Work: Hybrid If interested, please refer to the JD below and share the resume with required details. Total Exp: Exp as a Data Engineer: Relevant Exp in AWS Services: Relevant Exp in Python: Relev...

We are looking forward to hirePalantir Professionals in the following areas : SCOPE OF RESPONSIBILITY: As a Data Architect Data Engineering, you will play a key role in shaping Client Life Science's modern data ecosystem that integrates Palantir Foundry, AWS cloud services, and Snowflake. Your responsibility will be to architect scalable, secure, and high-performing data pipelines and platforms that power advanced analytics, AI/ML use cases, and digital solutions across the enterprise. You will lead design efforts and provide architectural governance across data ingestion, transformation, storage, and consumption layersensuring seamless interoperability across platforms while enabling compli...

We are looking forward to hireAWS Professionals in the following areas : AWS Data Engineer JD as below: Primary skillsets :AWS services including Glue, Pyspark, SQL, Databricks, Python Secondary skillset- Any ETL Tool, Github, DevOPs(CI-CD) Experience: 3-4yrs Degree in computer science, engineering, or similar fields Mandatory Skill Set: Python, PySpark , SQL, AWS with Designing , developing, testing and supporting data pipelines and applications. 3+ years working experience in data integration and pipeline development. 3+ years of Experience with AWS Cloud on data integration with a mix of Apache Spark, Glue, Kafka, Kinesis, and Lambda in S3 Redshift, RDS, MongoDB/DynamoDB ecosystems Databr...

Design, build, and maintain scalable data pipelines for finance-related datasets. Partner with finance stakeholders (product & business teams) to understand requirements and translate them into robust technical solutions. Ensure data accuracy, consistency, and timeliness across reporting layers and downstream systems. Optimize SQL queries and Spark jobs for large-scale datasets to improve performance and cost efficiency. Implement scheduling, orchestration, and monitoring of workflows using Airflow (or similar tools). Collaborate with cross-functional teams (Finance, Product, Analytics, Engineering) to deliver business-critical solutions. Adhere to best practices for coding, testing, and dep...

Engages with internal partners to understand business strategy, questions and goals. Brings structure to business requests, translates requirements into an analytical project approach, and leads projects through completion. Delegates tasks and provides tactical and strategic guidance to peers. Acquires and compiles structured and unstructured data and verifies its quality, accuracy and reasonableness. Performs analyses of historical data to surface trends and insights using advanced analytical methods. Validates analytical techniques employed by other analysts. Advanced SQL, Python, Tableau Visualization and Data story telling. Experience with AWS tools like Athena, Glue, S3, CloudFormation ...

Experience - 5+ Years Location - PAN India Notice period - Immediate What were looking for: 5+ years Strong hands-on experience in AWS data services & pipelines Proficiency in Python & PySpark for ETL/ELT Solid understanding of data warehousing & big data concepts Problem-solving mindset with the ability to work in fast-paced environments Key Skills: AWS Data Services (Redshift, Glue, EMR, S3, Lambda, Kinesis, Athena) Strong in Python/SQL/Spark (PySpark) Data modeling, pipeline design & performance optimization Team handling + stakeholder management experience

We are looking forward to hireAWS Professionals in the following areas : Module Lead in AWS Skillset JD as below: Primary skillsets :AWS services including Glue, Pyspark, SQL, Databricks, Python Secondary skillset- Any ETL Tool, Github, DevOPs(CI-CD) Experience: 6-7yrs Degree in computer science, engineering, or similar fields Mandatory Skill Set: Python, PySpark , SQL, AWS with Designing , developing, testing and supporting data pipelines and applications. Strong understanding and hands-on experience with AWS services like EC2, S3, EMR, Glue, Redshift. Strong in developing and maintaining applications using Python and PySpark for data manipulation, transformation, and analysis. Design and i...

We are looking forward to hireAWS Professionals in the following areas : AWS Data Engineer JD as below: Primary skillsets :AWS services including Glue, Pyspark, SQL, Databricks, Python Secondary skillset- Any ETL Tool, Github, DevOPs(CI-CD) Experience: 3-4yrs Degree in computer science, engineering, or similar fields Mandatory Skill Set: Python, PySpark , SQL, AWS with Designing , developing, testing and supporting data pipelines and applications. 3+ years working experience in data integration and pipeline development. 3+ years of Experience with AWS Cloud on data integration with a mix of Apache Spark, Glue, Kafka, Kinesis, and Lambda in S3 Redshift, RDS, MongoDB/DynamoDB ecosystems Databr...

We are looking for a skilled AWS Cloud Engineer with a minimum of 5 years of hands-on experience in managing and implementing cloud-based solutions on AWS. The ideal candidate will have expertise in AWS core services such as S3, EC2, MSK, Glue, DMS, and SageMaker, along with strong programming and containerization skills using Python and Docker.Design, implement, and manage scalable AWS cloud infrastructure solutions. Hands-on experience with AWS services: S3, EC2, MSK, Glue, DMS, and SageMaker. Develop, deploy, and maintain Python-based applications in cloud environments. Containerize applications using Docker and manage deployment pipelines. Troubleshoot infrastructure and application issu...

Role & responsibilities • Strong hands-on experience in Python programming and PySpark • Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda) • Experience working with Apache Spark and Hadoop ecosystem. • Experience in writing and optimizing SQL for data manipulations • Good Exposure to scheduling tools. Airflow is preferable. • Must Have Data Warehouse Experience with AWS Redshift or Hive • Experience in implementing security measures for data protection. • Expertise to build/test complex data pipelines for ETL processes (batch and near real time) • Readable documentation of all the components being developed. • Knowledge of Database technologies for OLTP and OLAP workloads Good...

Roles & Responsibilities: Understanding the current business functionalities of the ETL processes and identifying areas for improvement. Designing and building AWS Glue workflows to replace existing ETL processes. Standardizing code across all workflows to maintain consistency and scalability. Conducting unit tests on all converted jobs to ensure accuracy and reliability. Loading initial data into the required workflows and validating data integrity. Implementing a layered architecture in AWS and Snowflake for efficient data consumption. Creating comprehensive mapping documents for all existing processes and assets. Developing additional views and logic to supplement reporting requirements. ...

As a Big Data Engineer, you will play a crucial role in developing and managing our company's Big Data solutions. Your responsibilities will include: - Meeting with managers to determine the company's Big Data needs. - Developing Big Data solutions on AWS, utilizing tools such as Apache Spark, Databricks, Delta Tables, EMR, Athena, Glue, and Hadoop. - Loading disparate data sets and performing pre-processing services using Athena, Glue, and Spark. - Collaborating with software research and development teams. - Building cloud platforms for company application development. - Maintaining production systems. To excel in this role, you are required to meet the following qualifications: - 5+ years...

Strong technical skills in services like S3,Athena, Lambda, RGlue and Glue(Pyspark), SQL, Data Warehousing, Informatica, OracleDesign, develop, and implement custom solutions within the Collibra platform to support data governance initiatives. Snowflake, Agile methodology and Tableau. Proficiency in Python/Scala, Spark architecture, complex SQL, and RDBMS. Hands-on experience with ETL tools (e.g., Informatica) and SCD1, SCD2. 2-6 years of DWH, AWS Services and ETL design knowledge. Develop ETL processes for data ingestion, transformation, and loading into data lakes and warehouses. Collaborate with data scientists and analysts to ensure data availability for analytics and reporting.

Hands on experience in Dimensional, Data vault and relation modelling Expertise in Data warehousing and ETL Design and implementation Hands on experience with Programming language like Python/Scala Good understanding of Spark architecture along with internals Hand on experience using AWS services like Glue(Pyspark), Lambda, S3, Athena, RDS, IAM, Lake formation Experience on Mulesoft is good to have Hands on experience on implementing different loading strategies like SCD1 and SCD2, Table/ partition refresh, insert update, Swap Partitions, Experience in consuming and writing data from and to Flat files, RDMBS systems, MPPS, JSON and XML, Service, Streams, queues, CDC etc. Experience in Parall...

Requirements: Proficiency in Python, PySpark architecture, complex SQL, and RDBMS. Hands-on experience with ETL tools (e.g., Informatica) and SCD1, SCD2. 2-6 years of DWH, AWS Services and ETL design knowledge Hand on experience using AWS services like Glue (Pyspark), Lambda, S3, Athena, experience on implementing different loading strategies like SCD1 and SCD2, Table/ partition refresh, insert update, Swap Partitions

Delivers secure, scalable tech solutions using Java/Python, AWS, DevOps, and cloud-native practices expert in agile, automation, and financial services IT. As a Lead Software Engineer at JPMorgan Chase within the Consumer & Commercial Banking area, you play a crucial role in an agile team dedicated to enhancing, building, and delivering trusted, market-leaading technology products in a secure, stable, and scalable manner. As a core technical contributor, you are tasked with implementing critical technology solutions across multiple technical domains, supporting various business functions to achieve the firm's business objectives. Job responsibilities Executes creative software solutions, des...

Required Skills & Qualifications: * Bachelor's or master's degree in computer science, Engineering, or a related discipline. * Minimum of 5 years of practical experience in a data engineering or comparable position. * Demonstrated expertise in SQL and Python (or similar languages such as Scala/Java). * Extensive experience with data pipeline orchestration tools (e.g., Airflow, dbt, ). * Proficiency in cloud data platforms, including AWS (Redshift, S3, Glue), or GCP (BigQuery, Dataflow), or Azure (Data Factory, Synapse). Familiarity with big data technologies (e.g., Spark, Kafka, Hive) and other data tools. Solid grasp of data warehousing principles, data modeling techniques, and performance ...

As an Integration Technical Specialist at Nasdaq Technology in Bangalore, India, you will play a crucial role in the Enterprise Solutions team. Nasdaq is known for its adaptability to market changes and its dedication to developing cutting-edge solutions in the financial markets industry. Your primary tasks will involve delivering intricate technical systems to clients, exploring emerging technologies in FinTech, and supporting key initiatives within Nasdaq's technology portfolio. Your key responsibilities will include: - Collaborating with global teams to provide solutions and services - Engaging with internal stakeholders to gather requirements - Designing integrations with both internal s...

Role Overview: You will be responsible for working with AWS CDK using Type Script and CloudFormation template to manage various AWS services such as Redshift, Glue, IAM roles, KMS keys, Secrets Manager, Airflow, SFTP, AWS Lambda, S3, and Event Bridge. Your tasks will include executing grants, store procedures, queries, and Redshift Spectrum to query S3, defining execution roles, debugging jobs, creating IAM roles with fine-grained access, integrating and deploying services, managing KMS keys, configuring Secrets Manager, creating Airflow DAGs, executing serverless AWS Lambda functions, debugging Lambda functions, managing S3 object storage including lifecycle configuration, resource-based po...

Job Requisition ID # 25WD91419 Position Overview We are seeking a highly experienced Principal Engineer to lead the design, development, and evolution of our Batch Processing platform , which powers Autodesk's Analytics Data Platform (ADP). This role requires deep technical expertise in distributed data systems, large-scale pipeline orchestration, and hands-on leadership in shaping next-generation data platform capabilities. You will partner closely with Engineering Managers, Architects, Product teams, and Partner Engineering to modernize our data lakehouse architecture, deliver highly reliable data pipelines, and establish technical excellence across ingestion, processing, and governance. R...

As a Senior Data Scientist at our company, you will be an integral part of our dynamic team, leveraging your 5-8 years of experience in AI/ML analytics to drive business insights and innovation. Your main responsibilities will include: - Developing and implementing machine learning models and algorithms - Collaborating with project stakeholders to understand requirements and translate them into deliverables - Analyzing and interpreting complex data sets using statistical and machine learning techniques - Staying updated with the latest advancements in AI/ML technologies and methodologies - Supporting various AI/ML initiatives by collaborating with cross-functional teams To qualify for this r...

Roles and responsibilities Design AWS architectures based on business requirements. Create architectural diagrams and documentation. Present cloud solutions to stakeholders. Skills and Qualifications: Design, develop, and maintain scalable ETL/ELT pipelines using AWS services like Glue, Lambda, and Step Functions. Work with batch and real-time data processing using AWS Glue, Kinesis, Kafka, or Apache Spark. Optimize data pipelines for performance, scalability, and cost-effectiveness. Identify bottlenecks and optimize query performance on Redshift, Athena, and Glue. Strong knowledge of AWS services: EC2, S3, RDS, Lambda, IAM, VPC, CloudFormation, CloudWatch, etc. Experience with serverless ar...

Years of experience: 4 to 10 years (with minimum 4 years of relevant experience) Key Skills: Python, Snowflake, SQL, AWS services- (S3, Glue, Lambda), Spark - (Mandate) call me 9701923036 or gopi.c@acesoftlabs.com

Required Skills: Data Engineer, AWS, Spark, Apache Airflow, Kafka, Snowflake, DBT, Flink, CI / CD Pipelines, Apache Iceberg, Glue