1330 Aws Glue Jobs

Job Title: AWS Senior Data Engineer Experience Required: Minimum 4+ years Job Summary : We are seeking a skilled Data Engineer with a strong background in data ingestion, processing, and storage. The ideal candidate will have experience working with various data sources and technologies, particularly in a cloud environment. You will be responsible for designing and implementing data pipelines, ensuring data quality, and optimizing data storage solutions. Key Responsibilities: Design, develop, and maintain scalable data pipelines for data ingestion and processing using Python, Spark, and AWS services. Work with on-prem Oracle databases, batch files, and Confluent Kafka for data sourcing. Impl...

Dear Candidate Greetings from TATA Consultancy Services Job Openings at TCS Skill : AWS Data engineer+ Pyspark Exp range: 4 yrs to 7 yrs Location : Pune/Hyd/Indore Notice period Immediate Pls find the Job Description below. Hands-on experience in Glue, Pyspark Experience on EMR, S3, IAM, Lambda, Cloud formation, Python AMI Rehydration, Python, ELB and other AWS components knowledge AWS monitoring setup and building the traffic dashboard and SNOW incidents for AWS related traffic and services CI/CD build and deployment support Ensure reliability of data pipelines, ETL processes, data transformations Identify areas of improvement in data quality processes, propose solutions to enhance data rel...

Skill Name AWS Data Engineer Work Location Open for all USI Detailed JD Experience 5 to 8 (preferred Senior first) Mandatory: .AWS Glue (5 yrs), S3, Lamda, Apache, Airflow. Good to have: Client facing role need best comms, Individual contributor Rounds of interview R1 and R2 – Sr Consultant level Mode of interview (Virtual/ In-person) Virtual Work timing 11 PM – 8 PM Work Mode (Remote/ On-site/ Hybrid) Hybrid (2 days a week)

- AWS Services - Data Architecture - Data Solutioning - AWS GLUE , S3, RDS Watsapp Anuj - 8249759636 for more details

Role Overview: You will be a hands-on Senior Data Engineer responsible for overseeing database administration, optimization, and development of a centralized Data Warehouse to support the company's analytics and AI strategy. Your role will involve ensuring the performance, reliability, and security of the database infrastructure, designing and implementing scalable data pipelines, and collaborating with various teams to enable data-driven decision-making. Key Responsibilities: - Ensure performance, availability, and security of the database infrastructure, including tuning, optimization, and backup/recovery strategies for approximately 75 instances. - Lead the design, development, and implem...

As a Software Developer at our organization, you will work in a constantly evolving environment, due to technological advances and the strategic direction of the organization. Your main responsibilities will include creating, maintaining, auditing, and improving systems to meet specific needs, often as advised by a systems analyst or architect. You will be testing both hardware and software systems to diagnose and resolve system faults. Additionally, you will be writing diagnostic programs, designing, and writing code for operating systems and software to ensure efficiency. When required, you will also make recommendations for future developments. Key Responsibilities: - Develop, test, deplo...

As a talented Snowflake Developer at the company, your role will involve designing, developing, and maintaining efficient data storage and retrieval solutions within the Snowflake platform. You will need to have a deep understanding of data warehousing concepts, strong SQL skills, and experience in implementing Snowflake best practices. Working closely with cross-functional teams, you will gather requirements, design data models, and optimize performance for data-driven applications and client interactions. It is essential that you have experience working in an Agile manner to execute projects effectively. Key Responsibilities: - Designing and developing ETL pipelines using SQL and other tec...

Job description Hiring for AWS Architect Mandatory Skills: AWS services, Data & Analytics Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and detailed ...

An AWS Data Engineer designs and builds data pipelines using AWS services like Glue, Redshift, and S3. They manage data extraction, transformation, and loading (ETL) from multiple sources. They ensure data accuracy, security, and high performance in AWS environments. They work with analysts and business teams to deliver data for reporting and insights. They also monitor, optimize, and automate data workflows for better efficiency.

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : AWS Architecture Good to have skills : Python (Programming Language)Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quali...

As a Data Engineer, youll be building and scaling mission-critical data products that power worldwide operations business decisions. In this role, youll drive technical excellence while building data infrastructure and products. Youll be working on scalable solutions that process petabytes of data daily, serving diverse user personas from front-line operators to corporate leadership. We expect you to bring strong technical acumen to solve difficult problems at scale, while maintaining high operational standards and driving innovation in both traditional analytics and AI/ML domains. Design and implement scalable, secure data pipelines and infrastructure using AWS technologies and big data too...

Your role and responsibilities As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the pl...

Your role and responsibilities As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform * Responsibilities * Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS * Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on ...

At Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities,"collaborating closely with clients to deliver cutting-edge solutions. Join us to drive transformation tailored to our client's challenges of today and tomorrow."Informed and validated by science and data. Superpowered by creativity and design. All underpinned by technology created with purpose. Your role As a Senior Azure Data Engineer, you will be responsible for architecting, developing, and optimizing enterprise-grade data solutions on Microsoft Azure. You will lead the design and implementation of scalable data platforms, data la...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Python (Programming Language) Good to have skills : DevOps, Data Engineering, AWS Glue, REST API, Lambda Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing inn...

Job Title: Snowflake Developer Location: Hyderabad or Bangalore. ( Hybrid Working ) Experience: 5+ Years Responsibilities: Use data mappings and models provided by the data modeling team to build robust pipelines in Snowflake . Design and implement data pipelines with proper 2NF/3NF normalization standards. Develop and maintain ETL processes for integrating data from multiple ERP and source systems. Create scalable and secure data architecture in Snowflake that supports DQ needs. Raise CAB requests through Carriers change process and manage deployment to production. Provide UAT support and transition finalized pipelines to support teams. Document all technical artifacts for traceability and ...

Position name- Cloud Engineer Key Skills- API development,AWS Services, data processing. Exp- 8+ years Hyderabad Only send cv - komal@contactxindia.com call on 9987334349 JD- Key Responsibilities: API Development : Design and maintain RESTful APIs for seamless integration and ensure security and documentation. AWS Glue : Utilize AWS Glue for ETL processes, managing jobs and crawlers for data cataloging. AWS Lambda : Implement serverless applications with AWS Lambda, optimizing for performance and cost. Amazon Athena : Use Amazon Athena for querying data in S3, optimizing storage formats for performance. PySpark : Develop PySpark applications for big data processing and collaborate with data ...

Position Overview We are seeking a hands-on, senior-level Snowflake Administrator / Engineer with strong expertise in both administration and development. The ideal candidate will be responsible for managing, securing, and optimizing large-scale Snowflake environments. This role includes overseeing our Snowflake SaaS instance (deployed via AWS), integrating with tools such as Prefect, dbt, and Python-based data pipelines , and ensuring performance, cost efficiency, and compliance across the platform. This is a remote, offshore contract role reporting to the Cloud Platform Engineering leadership team . Key Responsibilities Snowflake Administration Manage and maintain the Snowflake SaaS enviro...

Python and Libraries: Expertise in Python, with hands-on experience in popular libraries such as Boto3, FastAPI , and NumPy. AWS Cloud Services: Proficiency in AWS services, including: o Compute & Networking: AWS Lambda, Lambda Layers, ECS, EC2. o Integration & APIs: AWS API Gateway, IAM, S3, KMS, DynamoDB, MSK. o Infrastructure as Code ( IaC ): AWS CloudFormation, AWS CDK. o Monitoring & Logging: AWS CloudWatch. o CI/CD & DevOps: Experience with CI/CD tools such as Azure DevOps and GitHub Actions. Experience with additional AWS services: o Workflow & Data Processing: Apache Airflow, AWS AppFlow , AWS Glue, Athena. o Real-time Data Streaming & Messaging: AWS Kinesis, SNS, SQS. o Security & S...

Lead ETL Developer Data Warehouse | Banking Domain Experience: 812 years Location: Hyderabad Job Type: Full-time | Hybrid Notice : 0-20 Days Only About the Role Join our dynamic Data Warehouse team and help the bank leverage data as a strategic asset. As a Lead ETL Developer , youll lead a team of developers to design, develop, and enhance robust data solutions, ensuring adherence to IT SDLC processes. You will collaborate across technology teams to build scalable and secure data systems that power business insights. If you consider data a strategic enabler, advocate for data-driven decisions, and thrive on continuous improvement—this role is for you. Key Responsibilities Translate business ...

Design, develop, and maintain SQL queries, stored procedures, triggers, and functions. Analyze, troubleshoot, and optimize existing database structures and queries for performance improvements. Create and manage ETL (Extract, Transform, Load) processes for data integration between systems. Develop and maintain documentation related to database designs, standards, and best practices. Collaborate with stakeholders to gather and define business and technical requirements. Implement data quality and data governance processes as needed. Ensure database security, integrity, stability, and system availability. Provide technical support and training to other team members regarding SQL best practices...

Role & responsibilities: We are looking for an experienced Data Engineering Manager with strong hands-on expertise in AWS cloud data services, Python, SQL, and PySpark . The ideal candidate will lead the design, development, and deployment of scalable data pipelines, data lakes, and data warehouse solutions using AWS technologies. This role requires strong technical leadership, project management, and stakeholder collaboration to deliver high-quality data solutions for analytics and business intelligence. Preferred candidate profile: Lead and manage a team of data engineers to design, build, and optimize ETL pipelines using AWS Glue, PySpark, and SQL . Develop and maintain data lakes, data m...

Role & responsibilities: We are looking for an experienced Data Engineering Manager with strong hands-on expertise in AWS cloud data services, Python, SQL, and PySpark . The ideal candidate will lead the design, development, and deployment of scalable data pipelines, data lakes, and data warehouse solutions using AWS technologies. This role requires strong technical leadership, project management, and stakeholder collaboration to deliver high-quality data solutions for analytics and business intelligence. Preferred candidate profile: Lead and manage a team of data engineers to design, build, and optimize ETL pipelines using AWS Glue, PySpark, and SQL . Develop and maintain data lakes, data m...

Role: Solutions Architect - AWS Data and Analytics GTM Experience: 8+ Years, Minimum 5 years on AWS Work location: Mumbai/Bangalore/ Trivandrum (Hybrid) Responsibilities Be a trusted technical advisor to customers and solutions for complex Cloud & Data related technical challenges. Be a thought leader in architecture design and development of cloud data analytics solutions. Liaison with internal and external stakeholders to design optimized data analytics solutions on AWS cloud Partner with SMEs and Solutions Architects from leading cloud providers to present solutions to customers Support Quantiphi Sales and GTM teams from a technical perspective in building proposals and SOWs Lead discover...

Role : AWS Data Engineer/AWS Architect Job location : Chennai/Kolkata/Nagpur Notice : Immediate to 30 days