1844 Aws Glue Jobs - Page 28

immediate Joiner AWS Data Engineer with SCD, SQL,Python,Pyspark, AWS Data Engineer WIth SCD ,Pyhton,Pyspark,SQL,AWS @Hyd,Chen ,Noida,Bangalore,Pune Work mode :Hybrid Key skillsScdSQLPysparkPythonAWSExperience4 to 9Job locationHyderabad, Chennai, NoidaAnnual offered salary 15 lacs to 27.5 lacsJob description Immediate Joiner For AWS Data Engineer @ Hyderabad ,Chennai ,Noida Location. Skill Rating: Communication, DWH/ETL , PySpark, SQL, AWS Experience: Total Exp : 4-9 Yrs Data Eng AWS (S3, Lambda, Glue, Athena, DMS, Airflow, IAM, SNS-SQS) PySpark SQL Python Questions/Topics: SCD Type 1 vs SCD Type 2 key components of Airflow boto3 S3 life cycle policy AWS secret manager schema evolution handli...

Role & responsibilities Proficient in Python for data processing and automation. Strong experience with Apache Spark for large-scale data processing. Familiarity with AWS S3 for data storage and management. Experience with Kafka for real-time data streaming. Knowledge of Redshift for data warehousing solutions. Proficient in Oracle databases for data management. Experience with AWS Glue for ETL processes. Familiarity with Apache Airflow for workflow orchestration. Experience with EMR for big data processing. Mandatory: Strong AWS data engineering skills. Apply link : https://careers.ey.com/job-invite/1625618/

Job Description: Senior Data Engineer AWS & Python Location: Bangalore Experience Level: 5+ Years Employment Type: Full-Time Role Overview We are seeking a seasoned ETL Developer with deep expertise in AWS serverless architecture and Python programming. The ideal candidate will architect and optimize data pipelines using AWS Lambda, Step Functions, and Glue Jobs, ensuring scalable, cost-efficient, and high-performance ETL workflows across diverse data domains. Key Responsibilities - Design, develop, and maintain ETL pipelines using AWS Glue, Lambda, and Step Functions - Implement scalable data ingestion, transformation, and orchestration workflows - Optimize Python-based data processing scri...

Role & responsibilities Experience building on AWS using S3, EC2, Redshift, Glue, EMR, DynamoDB, Lambda, Quick Sight, etc. Experience in Pyspark/Spark / Scala Experience using software version control tools (Git, Jenkins, Apache Subversion) AWS certifications or other related professional technical certifications Experience with cloud or on-premises middleware and other enterprise integration technologies. Experience in writing MapReduce and/or Spark jobs. Demonstrated strength in architecting data warehouse solutions and integrating technical components. Good analytical skills with excellent knowledge of SQL. 3+ years of work experience with very large data warehousing environment 3+ years ...

Data Engineer - About Us Founded in 2007, Biz2Credit is rated as the Number 1 small business financing resource in the U.S. by Entrepreneur Magazine. Till date, we've facilitated more than $2.5+ billion in small business lending. Biz2Credit, an all - in - one financing solution for entrepreneurs to get a small business loan with fast approval process. Explore the best small business financing options with us! Biz2Credit offers an innovative way for lenders and small business borrowers to connect through our online credit marketplace. Our robust network includes more than 1,200 lenders and tens of thousands of small businesses who connect to the network through partnerships with Paychex, Star...

Job Title: Lead Data Engineer Location: Mumbai / Pune Experience: 8+ yrs Job Summary: We are seeking a technically strong and delivery-focused Lead Engineer to support and enhance enterprise-grade data and application products under the Durables model. The ideal candidate will act as the primary technical interface for the client, ensuring high system availability, performance, and continuous improvement. This role requires a hands-on technologist with strong team management experience, cloud (AWS) expertise, and excellent communication skills to handle client interactions and drive technical decisions. Key Responsibilities: Support & Enhancement Leadership Act as the primary technical lead ...

Job description Job Summary: We are looking for a skilled AWS Engineer with 4-5 years of hands-on experience in cloud infrastructure, automation, and deployment. The ideal candidate will be responsible for building, managing, and optimizing AWS environments, ensuring scalability, performance, and security. Key Responsibilities: Deploy, configure, and manage AWS cloud infrastructure (EC2, S3, RDS, VPC, IAM, CloudWatch, etc.). Implement Infrastructure as Code (IaC) using tools like Terraform or CloudFormation . Ensure security best practices, including IAM roles, policies, and compliance monitoring. Monitor system performance, troubleshoot issues, and optimize cloud costs. Set up CI/CD pipelin...

About The Role Project Role Application Lead Project Role Description Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills Data Engineering, Python (Programming Language), AWS Administration, AWS Glue Good to have skills NA Minimum 5 year(s) of experience is required Educational Qualification 15 years full time education Summary As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that application requirements are met, overseeing the development process, and providing guidanc...

About The Role Project Role Application Lead Project Role Description Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills AWS Glue Good to have skills NA Minimum 5 year(s) of experience is required Educational Qualification 15 years full time education Summary As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project milestones are met, addressing any challenges that arise, and providing guidance to team members to foster a productive work environment. You will also engag...

About The Role Project Role Application Developer Project Role Description Design, build and configure applications to meet business process and application requirements. Must have skills Python (Programming Language) Good to have skills Java, AWS Administration Minimum 5 year(s) of experience is required Educational Qualification 15 years full time education Key Responsibilities : Design, build, and manage robust and scalable data pipelines (batch and real-time). Develop ETL processes to acquire, transform, and integrate data from multiple sources. Build and maintain data warehouses, data lakes, and other storage solutions. Optimize data systems for performance, reliability, and scalability...

About The Role Project Role Application Developer Project Role Description Design, build and configure applications to meet business process and application requirements. Must have skills AWS BigData Good to have skills NA Minimum 2 year(s) of experience is required Educational Qualification 15 years full time education Summary As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing application features, and ensuring that the applications function seamlessly within the existing infrastructure. You will also engage in tes...

Job Title: Data Engineer Experience Required: 6 - 8 Years Location: Gurugram/Noida Employment Type: Full-time About SID Global Solutions SID Global Solutions is a premier Google implementation partner and global technology services firm helping Fortune 500 enterprises across BFSI, Healthcare, Retail, Manufacturing, and Public Sector accelerate digital transformation. We specialize in AI, Cloud, Automation, API Management, and Modern Data Platforms driving innovation and business growth at scale. About the Role: We are seeking an experienced Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate will have strong expertise in modern data te...

Project Duration 3 months and can get extended. Data Engineer (Databricks experience is mandatory) Exp: 3-8 Years Qualification: B. Tech/B.Sc. (IT) Expertise in Python, PySpark , and Apache Spark for data engineering Strong experience in building and optimizing ETL/data transformation pipelines Proficient in Databricks and Delta Lake storage format (Databricks experience is mandatory) Cloud platforms like AWS (Glue, EMR), Snowflake, Dataiku, Alteryx Skilled in managing large-scale, multi-dimensional datasets and designing scalable data architectures Solid understanding of data modeling and data warehouse concepts (On-Prem & Cloud) Familiar with modern data tools and continually updated on em...

Role : Snowflake Data engineer Work Time : 2:00pm to 11:00pm IST Location : Bangalore, India (Onsite)Only Mode of work: WFO, India. Interview : 3 rounds + online assessment. All candidates will have to go through an online assessment prior to submission. KEY RESPONSIBILITIES: • Designing, implementing, managing scalable data solutions using Snowflake environment for optimized data storage and processing. • Migrate existing data domains/flows from relational data store to cloud data store (Snowflake). • Identify and optimize new/existing data workflows. • Identify and implement data integrity practices. • Integrate data governance and data science tools with Snowflake ecosystem as per practic...

Hi, Hope you are doing well. Please find the below Job description. Kindly share resume along with your LWD or Notice time join and your Current CTC and Expected CTC. Exact area in Bangalore and share it to manju@nam-it.com for immediate Response. Send resumes with details for immediate response to manju@nam-it.com Job Title: Data Lake Delivery Lead (Snowflake/Databricks on AWS) Company: NAM India Pvt. Ltd. Location: Bangalore, India Experience: 1214 Years Employment Type: Full-time Mode: All 5 Days Onsite ( Banashankari 2nd Stage location of work) Need Immediate Joiners only locals to Bangalore only. Required Skills & Experience 1214 years of overall experience in data engineering, analytic...

As an AWS Glue Developer with 6 to 9 years of experience, you will be responsible for the following: - Hands-on experience in AWS Glue ETL development for at least 3 years - Strong programming skills in Python and PySpark for data transformation - Proficiency in AWS services such as S3, Redshift, Athena, Lambda, and EMR - Experience working with data formats like Parquet, Avro, JSON, CSV, and ORC - Advanced SQL skills for data querying and transformation - Deep understanding of ETL/ELT design patterns and best practices - Knowledge of dimensional modeling, star/snowflake schemas - Experience with Git/Bitbucket for code management Preferred skills for this role include: - Experience with Vang...

Role Overview: You will be responsible for designing, developing, and maintaining data pipelines and solutions using Databricks, Apache Spark, and other related tools to process large datasets and extract actionable business insights. Your role will involve building metrics deck and dashboards for KPIs, including the underlying data models. Additionally, you will be required to design, implement, and maintain a platform providing secured access to large datasets. Key Responsibilities: - Hold a Bachelor's degree in computer science, Data Science, engineering, mathematics, information systems, or a related technical discipline - Possess 5+ years of relevant experience in data engineering roles...

Responsibilities: * Design, develop & maintain cloud data pipelines using AWS/Azure & Python. * Optimize ETL processes with PySpark, SQL & DataBricks. * Collaborate on data warehouse architecture & implementation.

Determining, creating, and implementing internal process improvements Building necessary infrastructure using AWS and SQL technologies Helping stakeholders, including the data, design, product, and executive teams, with technical data difficulties. Required Candidate profile Knowledge of AWS mandatory

POSITION DESCRIPTION POSITION TITLE: Data Engineer LOCATION: Noida- India TOTAL YEARS: 5-7 years PERSON SPECIFICATION: Summary: Looking for a Data Engineer with 57 years of experience in designing and implementing scalable data pipelines and solutions on AWS. Must be proficient in AWS Glue, PySpark, Spark SQL, S3, and RDS, with expertise in database design, ETL development, and data integration. Hands-on experience in Master Data Management, Data Quality frameworks, and governance practices is essential, along with the ability to optimize performance and ensure data reliability at scale. Technical Skillset – Data Engineer (5–7 Years of Experience) PySpark & Spark SQL: Hands-on experience in ...

Role Overview: As a Technical Lead Engineer - Data at our company, you will be responsible for architecting, implementing, and scaling our end-to-end data platform built on AWS S3, Glue, Lake Formation, and DMS. Your role will involve leading a small team of engineers and collaborating cross-functionally with stakeholders from various departments to ensure reliable, timely, and secure data access across the business. Additionally, you will champion best practices in data design, governance, and observability, leveraging GenAI tools to enhance engineering productivity and accelerate time to insight. Key Responsibilities: - Own the design and scalability of the data lake architecture for both ...

As a highly experienced leader for the Data Engineering Center of Excellence (CoE), your role will involve strategic leadership, hands-on expertise, and building differentiators in the data space. You will be responsible for establishing and scaling the Data Engineering CoE, developing cutting-edge capabilities, and contributing to strategic customer engagements and proposals. - Lead Data CoE to build capabilities and differentiators in the data engineering field, including Data migration, Data modernization, and Data governance. - Define differentiating solutions for Data-related RFPs and proposals. - Build the Data Engineering practice with a strong foundation. - Drive customer discussions...

As a software development partner for a very large enterprise financial products and services firm listed on NYSE, your role involves re-architecting and migrating 30-year legacy systems to cloud-based microservices on AWS. The application is utilized by trading, journal, and bookkeeping platforms. Key Responsibilities: - Develop an event-driven ETL pipeline using AWS services to transfer end-of-day securities data from the mainframe to a relational database. - Build highly resilient and highly available containerized microservices. - Automate build and deployment using Jenkins and Terraform for Sandbox, Dev, QA, UAT, and Prod environments. - Write unit tests to achieve test coverage of over...

As a software development partner for a very large enterprise financial products and services firm listed on NYSE, your role involves re-architecting and migrating 30-year legacy systems to cloud-based microservices on AWS. The application you will be working on is essential for their trading, journal, and bookkeeping platforms. **Key Responsibilities:** - Develop an event-driven ETL pipeline using AWS services to transfer end-of-day securities data from the mainframe to a relational database. - Build highly resilient and highly available containerized microservices. - Automate build and deployment using Jenkins and Terraform for Sandbox, Dev, QA, UAT, and Prod environments. - Write unit tes...

As a Senior Data Engineer at our company, you will be responsible for leading the design, build, and evolution of our in-house data platforms. You will work closely with various stakeholders to construct datasets, build and maintain data pipelines, and collaborate with data analysts, data scientists, and business application development teams to deliver data solutions. **Role Overview:** You will analyze raw data to generate BI and Advanced Analytics datasets as per stakeholders" requirements. Additionally, you will design data pipelines, data marts, and data model changes aligning with our data warehouse standards. Your role will also involve executing data migration activities and ensuring...