1717 Aws Glue Jobs - Page 9

About Astrosoft Technologies www.astrosofttech.com Astrosoft is an award-winning IT solutions provider specializing in Data, Analytics, Cloud, AI/ML, and Digital Innovation . Founded in 2004 , we have offices in the USA (HQ Florida) and India ( Hyderabad ). We are recognized for our customer-first mindset , technical expertise, and consistent project delivery. Benefits at Astrosoft H1B Sponsorship (based on project & performance) Lunch & Dinner provided daily Health Insurance Group coverage Industry-standard leave policy Skill enhancement & certifications Hybrid work model Position Details: Role: Senior AWS Data Engineer Location: Hyderabad Gachibowli (Vasavi SkyCity) Experience: 7+ years (A...

Job Summary: We are seeking a skilled and proactive Data Engineer to design, build, and maintain robust data pipelines and architectures. The ideal candidate will work with large datasets, ensure data quality and availability, and support analytics and business intelligence initiatives by providing reliable data infrastructure. Key Responsibilities: Design, develop, and maintain scalable data pipelines to ingest, process, and transform data from various sources. Build and manage data warehouses, databases, and data lakes to support analytics and reporting. Ensure data quality, integrity, consistency, and security across systems. Collaborate with data analysts, data scientists, and business s...

Design and develop integration of Snowflake with a cloud platform and platform enhancements, integrations, and performance optimisation. Work on data ingestion using Python, cataloguing, and lineage tracking, Develop and architect ETL workflows. Required Candidate profile 5 years in developing and scaling data platforms centered around Snowflake, with Azure. Hands on Python Understanding of modern data architectures such as Data Mesh, Lakehouse, and ELT.

Dear Candidate, Greetings of the Day!!!!! I am hiring for AWS DATA ENGINEER with 4+ Relevant Exp revert with below details ON swati@thinkpeople.in Total Experience Rel exp IN DATA ENGINEER AWS EXP : Current CTC Expected CTC Current Location Preferred location: (ONLY PUNE / BANGALORE) Notice Period: Current Organization DO YOU HAVE PF DEDUCTION IN CURRENT & LAST ARE YOU C2H EMPLOYEE: ALTERNATE MAIL ID ALTERNATE NUMBER: WORK FROM OFFICE 1ST ROUND: Hackers TEST (Online Link will be given) FOR PUNE: FACE 2 FACE INTERVIEW 6TH DEC & FOR BANGALORE : F2F INTERVIEW 13 DEC JD: Hands on experience in pyspark and strong knowledge on Dataframes, RDD and SparkSQL Hands on Experience in developing, testing...

-Python and Pyspark + AWS Glue -6-9 Years of total and 4-5 years of relevant experience -AWS Data services.

AWS Glue, AWS Redshift/Spectrum, S3, API Gateway, Athena, Step and Lambda functions Experience in Extract Transform Load (ETL) and Extract Load & Transform (ELT) data integration pattern. Experience in designing and building data pipelines. Development experience in one or more object-oriented programming languages, preferably Python Advanced SQL knowledge/Strong SQL Experience designing and implementing large-scale distributed systems Maintains and improves CI / CD pipeline

About the Role We are looking for a detail-oriented and analytical Data Analyst to join our team. The ideal candidate will be responsible for collecting, analyzing, and interpreting complex datasets to help drive business decisions. You will work closely with cross-functional teams to deliver insights, dashboards, and data-driven recommendations. Key Responsibilities Collect, clean, and preprocess data from various sources. Analyze large datasets to identify trends, patterns, and actionable insights. Create and maintain dashboards , reports , and visualizations using BI tools. Collaborate with business, product, and engineering teams to understand data needs. Develop and automate data models...

Were looking for a highly skilled AWS Data Engineer with strong hands-on experience in modern data engineering and cloud-native ETL pipelines. Required Skills: AWS EMR (Hadoop/Spark) AWS Glue (ETL, PySpark, Workflows) Apache Iceberg (Lakehouse, ACID tables) Amazon Redshift (Data Warehouse, Spectrum) Apache Airflow (DAG orchestration) Strong experience in building scalable data lakes & cloud-based pipelines Location: Chennai and Bangalore Availability: Immediate / Short Notice Preferred

About the Role We are seeking an experienced AWS Data Engineer to design, build, and maintain scalable data pipelines and cloud-based data platforms on Amazon Web Services. The ideal candidate will have strong experience with big data technologies, data modeling, ETL/ELT development, and cloud-oriented architecture. Key Responsibilities Design, develop, and maintain data pipelines using AWS services such as Glue, Lambda, Step Functions, EMR, Kinesis, and Data Pipeline . Build and optimize data lakes , data warehouses , and analytics platforms using S3, Redshift, Athena, Lake Formation , and Glue Catalog . Develop and implement ETL/ELT workflows for structured and unstructured data. Work with...

As a Senior Data Platform Engineer at Zywave, your role will involve leading the design, development, and optimization of the enterprise data platform. You will be responsible for implementing scalable ELT pipelines using DBT and Azure Data Factory to ingest, transform, and load data into Snowflake. Collaborating with data analysts, data scientists, and business stakeholders to understand data requirements and deliver robust data models will be a key aspect of your job. Additionally, you will optimize Snowflake performance through clustering, partitioning, and query tuning, and develop and maintain reusable DBT models for data consistency and transparency. Ensuring data quality, governance, ...

Job Title: AI Systems Engineer Enterprise AI Agent & Executive Assistant Location: Kolkata Experience: 4–10 years Department: AI & Data Platform Reports To: CTO / Managing Director Type: Full-time Role Summary We are hiring an AI Systems Engineer to lead the development of Enterprise AI Agent. The system connects to real-time company data (ERP, BI, CRM, HRMS, Sales, Finance) and provides: Executive insights Predictive analytics AI-driven decision support Automated reporting Voice-based interactions Multi-channel access (web, WhatsApp, Slack, mobile) You will own the architecture, development, integration, deployment, and scaling of this enterprise-grade AI platform. Your work will be impleme...

Warm Greetings from SP Staffing!! Role :AWS Data Engineer Experience Required :4 to 6 yrs Work Location: Bangalore/Pune/Noida Required Skills, Glue Pyspark Redshift Data Modelling Interested candidates can send resumes to nandhini.spstaffing@gmail.com

Designation: AWS Data Engineer Experience: 6+Years Skill Tech stack : AWS Data Engineer, Python, Pyspark, SQL, Data Pipeline, AWS, AWS Glue, lambda Notice Period Immediate to 2 week Joiner only Location: Pune, Hyderabad and Bangalore Job Description: 6+ years of experience in data engineering, specifically in cloud environments like AWS. Dont Not Share Data Science Profiles. Proficiency in Python and PySpark for data processing and transformation tasks. Solid experience with AWS Glue for ETL jobs and managing data workflows. Hands-on experience with AWS Data Pipeline (DPL) for workflow orchestration. Strong experience with AWS services such as S3, Lambda, Redshift, RDS, and EC2. Technical Sk...

The Data Engineer will build secure, scalable, and automated data pipelines using AWS cloud services. The role involves developing ETL/ELT workflows, implementing CI/CD automation, setting up automated testing frameworks, and creating monitoring dashboards. The engineer will collaborate with data modelers and architects to ensure alignment with business needs. Mandatory Skills: Programming: Python, SQL, Shell scripting AWS: Glue, Redshift, S3, Lambda, CloudWatch, DynamoDB Automation & CI/CD: Terraform, Jenkins, AWS CodePipeline Data Integration: ETL/ELT processes, data quality, performance testing Soft Skills: Problem-solving, collaboration, communication Perks and benefits Excellent in the ...

Required Skills & Qualifications Proven experience as a Python Developer. • Proficiency in Python and its core libraries. • Solid understanding of object-oriented programming (OOP). • Experience with a web framework like Django, Flask, or FastAPI. • Experience with task queues (e.g., Celery/RQ/ ActiveMQ/RabbitMQ or similar queues). • Experience with cache databases (e.g., Redis/Memcached/AeroSpike) • Familiarity with relational databases (e.g., PostgreSQL, MySQL) and ORMs (e.g., SQLAlchemy). • Experience with NoSQL databases (e.g., Aerospike/MongoDB). • Experience with data streaming and processing frameworks (e.g., Apache Kafka/Apache Flink). • Experience with version control systems, prefe...

Job Overview: The Data Engineer will work closely with data analysts, data scientists, and software engineers to ensure reliable data flow, storage, and accessibility. You will be responsible for building and optimizing data pipelines, implementing ETL processes, and maintaining large-scale data infrastructure. Key Responsibilities: Design, develop, and maintain scalable and efficient data pipelines and architectures. Implement ETL/ELT processes to collect, transform, and load data from multiple sources. Ensure data quality, consistency, and integrity across systems. Collaborate with data scientists, analysts, and software engineers to meet business data requirements. Optimize data storage a...

Qualifications •Bachelor's degree in Computer Science, Software Engineering, MIS or equivalent combination of education and experience •8+ years of experience as Data Engineer on AWS Stack with experience on DevOps tool •AWS Solutions Architect or AWS Developer Certification required •Solid experience of AWS services such as CloudFormation, S3, Athena, Glue, Glue DataBrew, EMR/Spark, RDS, Redshift, DataSync, DMS, DynamoDB, Lambda, Step Functions, IAM, KMS, SM, EventBridge, EC2, SQS, SNS, LakeFormation, CloudWatch, Cloud Trail •Implement high velocity streaming solutions and orchestration using Amazon Kinesis, AWS Managed Airflow and AWS Managed Kafka (preferred) •Solid experience building so...

You will be working as a Software development partner for a very large enterprise financial products and services firm listed in NYSE. Your role will involve re-architecting and migrating 30-year legacy systems and moving them to cloud (AWS) based microservices. The application you will be working on is consumed by their trading, journal & bookkeeping platforms. **Key Responsibilities:** - Develop an event-driven ETL pipeline using AWS services to transfer end-of-day securities data from the mainframe to a relational database. - Build highly resilient and highly available containerized microservices. - Automate build and deployment using Jenkins and Terraform for the Sandbox, Dev, QA, UAT, a...

As a Reporting - Snowflake/SQL at Barclays, you will spearhead the evolution of infrastructure and deployment pipelines, driving innovation and operational excellence. You will utilize cutting-edge technology to build and manage robust, scalable, and secure infrastructure to ensure seamless delivery of digital solutions. **Key Responsibilities:** - Performing exploratory data analysis and data cleansing to prepare data for visualization. - Translating complex data into clear, concise, and visually appealing charts, graphs, maps, and other data storytelling formats. - Utilizing best practices in data visualization principles and design aesthetics to ensure clarity, accuracy, and accessibility...

Greetings from HCL! Currently Hiring for "AWS Glue+DBT+Snowflake" Experience - 3-5 years Location Hyderabad / Chennai/ Noida /Bangalore / Pune Notice period - Immediate to 30 days Only CTC - Can be discussed Interested candidate please share below details along with update resume Name- contact Number- Email ID- Total Experience- Relevant Experience- Current company- Preferred location- Notice Period- Current CTC- Expected CTC- Skill- Interested candidate please drop mail to "kushmathattanda.baby@hcltech.com"

Design and maintain AWS-based data lake / warehouse (S3, Glue, Redshift/Snowflake) Implement secure, automated ingestion from MDM, Datawarehouse, FTP/-email feeds and servicer reports Build performance ELT pipelines Optimize complex SQL Required Candidate profile 7+ years in data engineering Hands on experience with Cloud: AWS (S3, Glue, Lambda, Redshift/Snowflake or Aurora), IAM, networking basics, Azure 5+ years with SQL and Python Data engineering

Design and maintain AWS-based data lake / warehouse (S3, Glue, Redshift/Snowflake) Implement secure, automated ingestion from MDM, Datawarehouse, FTP/-email feeds and servicer reports Build performance ELT pipelines Optimize complex SQL Required Candidate profile 7+ years in data engineering Hands on experience with Cloud: AWS (S3, Glue, Lambda, Redshift/Snowflake or Aurora), IAM, networking basics, Azure 5+ years with SQL and Python Data engineering

As a Lead Software Engineer at JPMorgan Chase within the Consumer & Community Banking, you have the opportunity to impact your career and embark on an adventure where you can push the limits of what's possible. You will play a crucial role as part of an agile team dedicated to enhancing, building, and delivering trusted, market-leading technology products in a secure, stable, and scalable manner. - Executes creative software solutions, design, development, and technical troubleshooting with the ability to think beyond routine or conventional approaches to build solutions or break down technical problems - Develops secure high-quality production code, reviews, and debugs code written by other...

We are looking for an experienced Data Engineering Manager with a strong foundation in Python, SQL, and Spark , and hands-on expertise in AWS, Databricks . In this role, you will build and maintain scalable data pipelines and architecture to support analytics, data science, and business intelligence initiatives. Youll work closely with cross-functional teams to drive data reliability, quality, and performance. Responsibilities: Design, develop, and optimize scalable data pipelines using Databricks in AWS such as Glue, S3, Lambda, EMR, Databricks notebooks, workflows and jobs. Building data lake in WS Databricks. Build and maintain robust ETL/ELT workflows using Python and SQL to handle struc...

Job Title: Data Engineer Job Type: Contract (Full-time) Location: Hybrid Delhi, Pune Job Summary: Join our customer’s team as a Data Engineer and play a key role in building scalable data solutions. In this hybrid role, you will work on designing data pipelines, ensuring data quality, and collaborating with cross-functional teams using Agile methodologies. Key Responsibilities: Design and maintain scalable data pipelines and architectures Cleanse, evaluate, and integrate data from multiple sources Implement data validation , data completeness , and quality checks Automate ETL processes using Python and SQL Manage repositories and documentation using Bitbucket , Jira , and Confluence Conduct ...