869 Aws Glue Jobs - Page 18

Role & responsibilities Skill - Lead Data Engineer, Python, AWS Glue, API, fast API, rest API, ETL, SQL Location - Gurugram Exp - 10+ Yrs. Notice period - only immediate joiners needed Job Descriptio n Job Summary: We are seeking an experienced Lead Data Engineer with strong expertise in Python, AWS cloud services, ETL pipelines, and system integrations. The ideal candidate will lead the design, development, and optimization of scalable data solutions and ensure seamless API and data integrations across systems. You will collaborate with cross-functional teams to implement robust DataOps and CI/CD pipelines. Key Responsibilities: Responsible for implementation of scalable, secure, and high-p...

Handling of petabytes of data and experience required in design and delivery of distributed system in cloud by using server less architecture & in Data lakes and data sourcing platforms and in python and pyspark immediate joiners are prefer.

We are a technology-led healthcare solutions provider. We are driven by our purpose to enable healthcare organizations to be future-ready. We offer accelerated, global growth opportunities for talent that is bold, industrious and nimble. With Indegene, you gain a unique career experience that celebrates entrepreneurship and is guided by passion, innovation, collaboration and empathy. To explore exciting opportunities at the convergence of healthcare and technology, check out www.careers.indegene.com What if we told you that you can move to an exciting role in an entrepreneurial organization without the usual risks associated with it? We understand that you are looking for growth and variety ...

As a Senior Lead Engineer specializing in Python and Spark within AWS, you will be tasked with designing, building, and maintaining robust, scalable, and efficient ETL pipelines. Your primary focus will be ensuring alignment with the data lakehouse architecture on AWS. You will leverage your extensive expertise in Python and Spark to develop and optimize workflows using AWS services such as Glue, Glue Data Catalog, Lambda, and S3. In this role, you will implement data quality and governance frameworks to guarantee reliable and consistent data processing across the platform. Collaborating with cross-functional teams, you will gather requirements, provide technical insights, and deliver high-q...

NTT DATA is looking for a Sr Information Security Engineer to be a part of their team in Bangalore, Karnataka (IN-KA), India. As a Sr Information Security Engineer, you will be responsible for various tasks, including but not limited to: - Having 5+ years of experience in IT Technology. - Possessing 2+ years of experience in AI / ML with a strong working knowledge in neural networks. - Demonstrating 2+ years of data engineering experience, preferably using AWS Glue, Cribl, SignalFx, OpenTelemetry, or AWS Lambda. - Having 2+ years of python coding experience using numpy, vectorization, and Tensorflow. - Leading complex enterprise-wide integration programs and efforts for a minimum of 2 years ...

You are looking for an AWS Serverless Developer to join our team in Bengaluru with 3-5 years of experience. As an AWS Serverless Developer, your role will involve designing, developing, and maintaining serverless data pipelines using AWS Lambda, AWS Glue, I AM Roles & Policies, RDS, and other AWS services to ensure scalability and efficiency. You will be responsible for building Audit & logging processes, ensuring data quality and governance, implementing CICD and Git repo for code versioning, and developing new features with testing. Collaboration with the Lead Developer, Business Analyst, and application Architect is essential to align on project goals. You will troubleshoot issues, perfor...

We are looking for a Cloud Data Engineer with strong hands-on experience in data pipelines, cloud-native services (AWS), and modern data platforms like Snowflake or Databricks. Alternatively, were open to Data Visualization Analysts with strong BI experience and exposure to data engineering or pipelines. You will collaborate with technology and business leads to build scalable data solutions, including data lakes, data marts, and virtualization layers using tools like Starburst. This is an exciting opportunity to work with modern cloud tech in a dynamic, enterprise-scale financial services environment. Key Responsibilities: Design and develop data pipelines for structured/unstructured data i...

Senior AWS Administrator Req number: R5740 Employment type: Full time Worksite flexibility: Remote Who we are CAI is a global technology services firm with over 8,500 associates worldwide and a yearly revenue of $1 billion+. We have over 40 years of excellence in uniting talent and technology to power the possible for our clients, colleagues, and communities. As a privately held company, we have the freedom and focus to do what is right—whatever it takes. Our tailor-made solutions create lasting results across the public and commercial sectors, and we are trailblazers in bringing neurodiversity to the enterprise. Job Summary We are seeking an experienced Senior AWS Administrator to join our ...

JOB DESCRIPTION - Modelling Engineers Key Responsibilities Complete Data Modelling Tasks Initiate and manage Gap Analysis and Source-to-Target Mapping Exercises. Gain a comprehensive understanding of the EA extract. Map the SAP source used in EA extracts to the AWS Transform Zone, AWS Conform Zone, and AWS Enrich Zone. Develop a matrix view of all Excel/Tableau reports to identify any missing fields or tables from SAP in the Transform Zone. Engage with SMEs to finalize the Data Model (DM). Obtain email confirmation and approval for the finalized DM. Perform data modelling using ER Studio and STTM. Generate DDL scripts for data engineers to facilitate implementation. Complete Data Engineering...

Hi all, We are hiring for the role C&S ETL Engineer Experience: 6 - 8 Years Location: Bangalore Notice Period: Immediate - 15 Days Skills: Mandatory Skills: AWS Glue Job Description: Minimum experience of 6 years in building, optimizing, and maintaining scalable data pipelines as an ETL Engineer. Hands-on experience in coding techniques with a proven record. Hands-on experience in end-to-end data workflows, including pulling data from third-party and in-house tools via APIs, transforming and loading it into data warehouses, and improving performance across the ETL lifecycle. Hands-on experience with scripting (Python, shell scripting), relational databases (PostgreSQL, Redshift), REST APIs (...

You are a skilled Data Engineer with a strong background in Python, Snowflake, and AWS. Your primary responsibility will involve constructing and refining scalable data pipelines, integrating various data sources, and supporting analytics and business intelligence solutions within a cloud-based setting. An essential aspect of your role will entail the design and supervision of AWS Glue Jobs to facilitate efficient, serverless ETL workflows. Your key duties will revolve around designing and executing robust data pipelines using AWS Glue, Lambda, and Python. You will extensively collaborate with Snowflake for data warehousing, modeling, and analytics assistance. Managing ETL/ELT jobs using AWS...

Job Title Senior DevOps EngineerExperience 7-14 YearsLocation Bangalore : Looking for a senior resource with min 7+ years of hands-on experience in AWS DevOps. Must have experience in Terraform/Terrgrunt Azure DevOps pipeline CI/CD Pipeline (GitHub Actions/Jenkins) Hands on experience in provisioning AWS services such as ALB, ECS, Lambda, IAM, KMS, RDS-Postgres, AWS glue Experienced in HA-DR topologies Good to have experience in scripting language like Shell Scripting, Qualification: Bachelors or masters degree in computer science, Information Systems, Engineering or equivalent.

Job Title:AWS Data EngineerExperience5-10 YearsLocation:Bangalore : Technical Skills: 5 + Years of experience as AWS Data Engineer, AWS S3, Glue Catalog, Glue Crawler, Glue ETL, Athena write Glue ETLs to convert data in AWS RDS for SQL Server and Oracle DB to Parquet format in S3 Execute Glue crawlers to catalog S3 files. Create catalog of S3 files for easier querying Create SQL queries in Athena Define data lifecycle management for S3 files Strong experience in developing, debugging, and optimizing Glue ETL jobs using PySpark or Glue Studio. Ability to connect Glue ETLs with AWS RDS (SQL Server and Oracle) for data extraction and write transformed data into Parquet format in S3. Proficiency...

Job Title:DEVOPS- AWS Glue, KMS, ALB , ECS and Terraform/TerragruntExperience5-10YearsLocation:Bangalore : DEVOPS, AWS, Glue, KMS, ALB , ECS, Terraform, Terragrunt

Design, implement, and maintain data pipelines for processing large datasets, ensuring data availability, quality, and efficiency for machine learning model training and inference. Collaborate with data scientists to streamline the deployment of machine learning models, ensuring scalability, performance, and reliability in production environments. Develop and optimize ETL (Extract, Transform, Load) processes, ensuring data flow from various sources into structured data storage systems. Automate ML workflows using ML Ops tools and frameworks (e.g., Kubeflow, MLflow, TensorFlow Extended (TFX)). Ensure effective model monitoring, versioning, and logging to track performance and metrics in a pro...

Proven experience in AWS serverless functions and Node.js. Strong understanding of test-driven development and unit testing. Proficiency in using Confluence and Jira. Excellent problem-solving skills and attention to detail. Ability to work independently and as part of a team. Strong communication skills and ability to collaborate effectively with stakeholders. Experience with other AWS services (e.g., DynamoDB, API Gateway). Knowledge of microservices architecture. Familiarity with CI/CD pipelines and DevOps practices Mandatory Competencies ETL - ETL - AWS Glue Beh - Communication User Interface - Other User Interfaces - node.JS Cloud - AWS - AWS S3, S3 glacier, AWS EBS Middleware - API Mid...

Job Title: Data Associate - Cloud Data Engineering Experience: 4+ Years Employment Type: Full-Time Industry: Information Technology / Data Engineering / Cloud Platforms Job Summary: We are seeking a highly skilled and experienced Senior Data Associate to join our data engineering team. The ideal candidate will have a strong background in cloud data platforms, big data processing, and enterprise data systems, with hands-on experience across both AWS and Azure ecosystems. This role involves building and optimizing data pipelines, managing large-scale data lakes and warehouses, and enabling advanced analytics and reporting. Key Responsibilities: Design, develop, and maintain scalable data pipel...

Hiring for a FAANG company. Note: This position is open only for women professionals returning to the workforce after a career break (9+ months career gap, e.g, last working day prior to NOV 2024). We encourage you to apply only if you fit this criteria. Position Overview This is a Level 5 Data Engineer role within a leading e-commerce organization's Selling Partner Services division in India. The position focuses on building and scaling API authorization and customization systems that serve thousands of global selling partners. This is a senior-level position requiring significant technical expertise and leadership capabilities. Team Context & Mission Organization : Selling Partner Services...

8+ years of experience in data engineering with a strong focus on AWS services . Proven expertise in: Amazon S3 for scalable data storage AWS Glue for ETL and serverless data integration using Amazon S3, DataSync, EMR, Redshift for data warehousing and analytics Proficiency in SQL , Python , or PySpark for data processing. Experience with data modeling , partitioning strategies , and performance optimization . Familiarity with orchestration tools like AWS Step Functions , Apache Airflow , or Glue Workflows . Strong understanding of data lake and data warehouse architectures. Excellent problem-solving and communication skills. Mandatory Competencies Beh - Communication ETL - ETL - AWS Glue Bi...

The successful candidate for the Full Stack Developer position at U.S. Pharmacopeial Convention (USP) will have a demonstrated understanding of the organization's mission and a commitment to excellence through inclusive and equitable behaviors and practices. They should possess the ability to quickly build credibility with stakeholders. As a Full Stack Developer, you will be part of the Digital & Innovation group at USP, responsible for building innovative digital products using cutting-edge cloud technologies. Your role will be crucial in creating an amazing digital experience for customers. Your responsibilities will include building scalable applications and platforms using the latest clo...

Seekify Global is looking for an experienced and motivated Data Catalog Engineer to join the Data Engineering team. The ideal candidate should have a significant background in designing and implementing metadata and data catalog solutions within AWS-centric data lake and data warehouse environments. As a Data Catalog Engineer at Seekify Global, you will play a crucial role in improving data discoverability, governance, and lineage across our enterprise data assets. Your responsibilities will include leading the end-to-end implementation of a data cataloging solution within AWS, establishing and managing metadata frameworks for structured and unstructured data assets, and integrating the data...

You are an experienced Python + Databricks Developer who will be a valuable addition to our data engineering team. Your expertise in Python programming, data processing, and hands-on experience with Databricks will be instrumental in building and optimizing data pipelines. Your key responsibilities will include designing, developing, and maintaining scalable data pipelines using Databricks and Apache Spark. You will be expected to write efficient Python code for data transformation, cleansing, and analytics. Collaboration with data scientists, analysts, and engineers is essential to understand data needs and deliver high-performance solutions. Optimizing and tuning data pipelines for perform...

As a Senior Information Security Engineer at NTT DATA in Bangalore, Karnataka (IN-KA), India, you will be part of a dynamic team that values exceptional, innovative, and passionate individuals who are eager to grow with us. If you are seeking to join an inclusive, adaptable, and forward-thinking organization, this opportunity is for you. You should have a minimum of 5 years of experience in IT Technology, with at least 2 years of hands-on experience in AI / ML, particularly with a strong working knowledge in neural networks. Additionally, you should possess 2+ years of data engineering experience, preferably using tools such as AWS Glue, Cribl, SignalFx, OpenTelemetry, or AWS Lambda. Profici...

As a Senior Lead Engineer specializing in Python and Spark in AWS, you will be responsible for designing, building, and maintaining robust, scalable, and efficient ETL pipelines. Your primary focus will be on ensuring alignment with data lakehouse architecture on AWS and optimizing workflows using services such as Glue, Lambda, and S3. Collaborating with cross-functional teams, you will gather requirements, provide technical insights, and deliver high-quality data solutions. Your role will involve driving the migration of existing data processing workflows to the lakehouse architecture, leveraging Iceberg capabilities, and enforcing best practices for coding standards and system architecture...

Python, AWS Glue, Data Lake, SQL Orchestration tool (Example - Airflow) Data Ingestion Framework