1844 Aws Glue Jobs - Page 22

Your role and responsibilities As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the pl...

Your role and responsibilities As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform * Responsibilities * Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS * Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on ...

At Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities,"collaborating closely with clients to deliver cutting-edge solutions. Join us to drive transformation tailored to our client's challenges of today and tomorrow."Informed and validated by science and data. Superpowered by creativity and design. All underpinned by technology created with purpose. Your role As a Senior Azure Data Engineer, you will be responsible for architecting, developing, and optimizing enterprise-grade data solutions on Microsoft Azure. You will lead the design and implementation of scalable data platforms, data la...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Python (Programming Language) Good to have skills : DevOps, Data Engineering, AWS Glue, REST API, Lambda Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing inn...

Job Title: Snowflake Developer Location: Hyderabad or Bangalore. ( Hybrid Working ) Experience: 5+ Years Responsibilities: Use data mappings and models provided by the data modeling team to build robust pipelines in Snowflake . Design and implement data pipelines with proper 2NF/3NF normalization standards. Develop and maintain ETL processes for integrating data from multiple ERP and source systems. Create scalable and secure data architecture in Snowflake that supports DQ needs. Raise CAB requests through Carriers change process and manage deployment to production. Provide UAT support and transition finalized pipelines to support teams. Document all technical artifacts for traceability and ...

Position name- Cloud Engineer Key Skills- API development,AWS Services, data processing. Exp- 8+ years Hyderabad Only send cv - komal@contactxindia.com call on 9987334349 JD- Key Responsibilities: API Development : Design and maintain RESTful APIs for seamless integration and ensure security and documentation. AWS Glue : Utilize AWS Glue for ETL processes, managing jobs and crawlers for data cataloging. AWS Lambda : Implement serverless applications with AWS Lambda, optimizing for performance and cost. Amazon Athena : Use Amazon Athena for querying data in S3, optimizing storage formats for performance. PySpark : Develop PySpark applications for big data processing and collaborate with data ...

Position Overview We are seeking a hands-on, senior-level Snowflake Administrator / Engineer with strong expertise in both administration and development. The ideal candidate will be responsible for managing, securing, and optimizing large-scale Snowflake environments. This role includes overseeing our Snowflake SaaS instance (deployed via AWS), integrating with tools such as Prefect, dbt, and Python-based data pipelines , and ensuring performance, cost efficiency, and compliance across the platform. This is a remote, offshore contract role reporting to the Cloud Platform Engineering leadership team . Key Responsibilities Snowflake Administration Manage and maintain the Snowflake SaaS enviro...

Python and Libraries: Expertise in Python, with hands-on experience in popular libraries such as Boto3, FastAPI , and NumPy. AWS Cloud Services: Proficiency in AWS services, including: o Compute & Networking: AWS Lambda, Lambda Layers, ECS, EC2. o Integration & APIs: AWS API Gateway, IAM, S3, KMS, DynamoDB, MSK. o Infrastructure as Code ( IaC ): AWS CloudFormation, AWS CDK. o Monitoring & Logging: AWS CloudWatch. o CI/CD & DevOps: Experience with CI/CD tools such as Azure DevOps and GitHub Actions. Experience with additional AWS services: o Workflow & Data Processing: Apache Airflow, AWS AppFlow , AWS Glue, Athena. o Real-time Data Streaming & Messaging: AWS Kinesis, SNS, SQS. o Security & S...

Lead ETL Developer Data Warehouse | Banking Domain Experience: 812 years Location: Hyderabad Job Type: Full-time | Hybrid Notice : 0-20 Days Only About the Role Join our dynamic Data Warehouse team and help the bank leverage data as a strategic asset. As a Lead ETL Developer , youll lead a team of developers to design, develop, and enhance robust data solutions, ensuring adherence to IT SDLC processes. You will collaborate across technology teams to build scalable and secure data systems that power business insights. If you consider data a strategic enabler, advocate for data-driven decisions, and thrive on continuous improvement—this role is for you. Key Responsibilities Translate business ...

Design, develop, and maintain SQL queries, stored procedures, triggers, and functions. Analyze, troubleshoot, and optimize existing database structures and queries for performance improvements. Create and manage ETL (Extract, Transform, Load) processes for data integration between systems. Develop and maintain documentation related to database designs, standards, and best practices. Collaborate with stakeholders to gather and define business and technical requirements. Implement data quality and data governance processes as needed. Ensure database security, integrity, stability, and system availability. Provide technical support and training to other team members regarding SQL best practices...

Role & responsibilities: We are looking for an experienced Data Engineering Manager with strong hands-on expertise in AWS cloud data services, Python, SQL, and PySpark . The ideal candidate will lead the design, development, and deployment of scalable data pipelines, data lakes, and data warehouse solutions using AWS technologies. This role requires strong technical leadership, project management, and stakeholder collaboration to deliver high-quality data solutions for analytics and business intelligence. Preferred candidate profile: Lead and manage a team of data engineers to design, build, and optimize ETL pipelines using AWS Glue, PySpark, and SQL . Develop and maintain data lakes, data m...

Role & responsibilities: We are looking for an experienced Data Engineering Manager with strong hands-on expertise in AWS cloud data services, Python, SQL, and PySpark . The ideal candidate will lead the design, development, and deployment of scalable data pipelines, data lakes, and data warehouse solutions using AWS technologies. This role requires strong technical leadership, project management, and stakeholder collaboration to deliver high-quality data solutions for analytics and business intelligence. Preferred candidate profile: Lead and manage a team of data engineers to design, build, and optimize ETL pipelines using AWS Glue, PySpark, and SQL . Develop and maintain data lakes, data m...

Role: Solutions Architect - AWS Data and Analytics GTM Experience: 8+ Years, Minimum 5 years on AWS Work location: Mumbai/Bangalore/ Trivandrum (Hybrid) Responsibilities Be a trusted technical advisor to customers and solutions for complex Cloud & Data related technical challenges. Be a thought leader in architecture design and development of cloud data analytics solutions. Liaison with internal and external stakeholders to design optimized data analytics solutions on AWS cloud Partner with SMEs and Solutions Architects from leading cloud providers to present solutions to customers Support Quantiphi Sales and GTM teams from a technical perspective in building proposals and SOWs Lead discover...

Role : AWS Data Engineer/AWS Architect Job location : Chennai/Kolkata/Nagpur Notice : Immediate to 30 days

Responsibilities: * Design, develop & maintain data pipelines using Python, AWS Glue & Redshift * Ensure data accuracy, security & compliance standards met * Collaborate with cross-functional teams on project delivery

Hi, Greetings from HR Central !! Job Role - Data Engineer Location: Airoli, Navi Mumbai. Notice Period: Immediate /30 days Education / Qualification BE / B. Tech Certification in Cloud Platforms, AWS or GCP Qualifications & Skills Total Experience: 4 to 8 years in Data Engineering. Mandatory: Strong hands-on coding experience in Python . Experience with Big Data tools and cloud platforms (AWS preferred). Work extensively with Big Data cloud platforms such as AWS (Redshift, Glue, Lambda). Proficiency in SQL , Spark , and PySpark . Exposure to data pipeline orchestration tools like Airflow , Luigi , or Azkaban . Strong problem-solving and analytical skills. Excellent communication and teamwork...

Job Title : AWS Data Engineer Location : Bangalore Experience : 5-10 Years Description: We are seeking a talented and experienced AWS Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, particularly within the AWS ecosystem, and will be responsible for designing, developing, and maintaining scalable data pipelines and systems. Key Responsibilities: Design and Development: Design and implement data pipelines and ETL processes using AWS services such as Glue, Redshift, Lambda, and S3. Develop and maintain scalable data storage solutions using AWS services like RDS, DynamoDB, and Redshift. Optimize and tune data processing and storage systems f...

Experienced developer using Python Experience in building integration solutions using various integration techniques, e g APIs, file-based integration, web services Experience in factoring code to run in containerized environments or native cloud services: Event Bridge, Step Function, Lambda Function, AWS Glue, SNS, SQS, SPARK Broad knowledge of AWS native services (compute, database, serverless) Experienced developer using Java Experience in factoring code to run in containerized environments or microservices on ROSA platform Location: Bengaluru,Chennai,Hyderabad,Pune Contact Number : 8097548621

Role & responsibilities Outcome/Deliverable/Timetable/Project Plan Engagement duration 3 months + 6 months optional to renew Skillset : AWS Quicksight , AWS Sakemaker, AWS Glue, AWS S3

Data Engineering and Data Warehousing Strong experience in SQL and MySQL Expertise in Azure Data Factory ADF and Snowflake Understanding of Medallion Architecture Hands on with ETL and ELT pipeline testing Cloud Computing and Fundamentals Knowledge of Microsoft Azure Fundamentals Data Quality and Testing Experience with automated testing and validation frameworks Python and SODA Skills in data profiling cleansing and anomaly detection Ability to perform root cause analysis and data reconciliation

Design, develop new features for a large-scale cloud data platform using Databricks, snowflake and Fabric, Deeply understand legacy data platforms, and drive their modernization, Provide production support Design data pipelines and data warehouse. Required Candidate profile 5 years in developing and scaling data platforms using Snowflake, databricks, Fabric, Strong Python and SQL Intermediate C# Understanding of modern data architectures such as Data Mesh, Lakehouse

As a Senior Data Analyst at Arcgate, you will be a key player in delivering high-quality data analysis and reporting to drive decision-making across clients" product, operations, strategy, and leadership teams. Responsibilities: - Conduct deep-dive analysis on internal datasets to uncover trends, patterns, and actionable insights. - Build, maintain, and enhance internal dashboards and reports using data visualization tools (e.g., Metabase, Amplitude). - Collaborate with cross-functional stakeholders to understand data needs, define analysis requirements, and deliver clear, timely outputs. - Translate complex data findings into concise, business-friendly recommendations. - Work with internal ...

Job description Hiring for AWS Architect Mandatory Skills: AWS services, Data & Analytics Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and detailed ...

Design and develop integration of Snowflake with a cloud platform and platform enhancements, integrations, and performance optimisation. Work on data ingestion using Python, cataloguing, and lineage tracking, Develop and architect ETL workflows. Required Candidate profile 5 years in developing and scaling data platforms centered around Snowflake, with Azure. Hands on Python Understanding of modern data architectures such as Data Mesh, Lakehouse, and ELT.

Educational Requirements Bachelor of Engineering Service Line Data & Analytics Unit Responsibilities A day in the life of an Infoscion As part of the Infosys delivery team, your primary role would be to design, build and deploy highly secure and performant data engineering solutions You will analyze the requirements and specifications to understand the client requirements in a detailed manner and translate them into production grade data applications that meet the client requirements. You would be a key contributor to building efficient programs/ systems and if you think you fit right in to help our clients navigate their next in their digital transformation journey If you think you fit righ...