1330 Aws Glue Jobs - Page 8

Hi, Hope you are doing well. Please find the below Job description. Kindly share resume along with your LWD or Notice time join and your Current CTC and Expected CTC. Exact area in Bangalore and share it to manju@nam-it.com for immediate Response. Send resumes with details for immediate response to manju@nam-it.com Job Title: Data Lake Delivery Lead (Snowflake/Databricks on AWS) Company: NAM India Pvt. Ltd. Location: Bangalore, India Experience: 1214 Years Employment Type: Full-time Mode: All 5 Days Onsite ( Banashankari 2nd Stage location of work) Need Immediate Joiners only locals to Bangalore only. Required Skills & Experience 1214 years of overall experience in data engineering, analytic...

As an AWS Glue Developer with 6 to 9 years of experience, you will be responsible for the following: - Hands-on experience in AWS Glue ETL development for at least 3 years - Strong programming skills in Python and PySpark for data transformation - Proficiency in AWS services such as S3, Redshift, Athena, Lambda, and EMR - Experience working with data formats like Parquet, Avro, JSON, CSV, and ORC - Advanced SQL skills for data querying and transformation - Deep understanding of ETL/ELT design patterns and best practices - Knowledge of dimensional modeling, star/snowflake schemas - Experience with Git/Bitbucket for code management Preferred skills for this role include: - Experience with Vang...

Role Overview: You will be responsible for designing, developing, and maintaining data pipelines and solutions using Databricks, Apache Spark, and other related tools to process large datasets and extract actionable business insights. Your role will involve building metrics deck and dashboards for KPIs, including the underlying data models. Additionally, you will be required to design, implement, and maintain a platform providing secured access to large datasets. Key Responsibilities: - Hold a Bachelor's degree in computer science, Data Science, engineering, mathematics, information systems, or a related technical discipline - Possess 5+ years of relevant experience in data engineering roles...

Responsibilities: * Design, develop & maintain cloud data pipelines using AWS/Azure & Python. * Optimize ETL processes with PySpark, SQL & DataBricks. * Collaborate on data warehouse architecture & implementation.

Determining, creating, and implementing internal process improvements Building necessary infrastructure using AWS and SQL technologies Helping stakeholders, including the data, design, product, and executive teams, with technical data difficulties. Required Candidate profile Knowledge of AWS mandatory

POSITION DESCRIPTION POSITION TITLE: Data Engineer LOCATION: Noida- India TOTAL YEARS: 5-7 years PERSON SPECIFICATION: Summary: Looking for a Data Engineer with 57 years of experience in designing and implementing scalable data pipelines and solutions on AWS. Must be proficient in AWS Glue, PySpark, Spark SQL, S3, and RDS, with expertise in database design, ETL development, and data integration. Hands-on experience in Master Data Management, Data Quality frameworks, and governance practices is essential, along with the ability to optimize performance and ensure data reliability at scale. Technical Skillset – Data Engineer (5–7 Years of Experience) PySpark & Spark SQL: Hands-on experience in ...

Role Overview: As a Technical Lead Engineer - Data at our company, you will be responsible for architecting, implementing, and scaling our end-to-end data platform built on AWS S3, Glue, Lake Formation, and DMS. Your role will involve leading a small team of engineers and collaborating cross-functionally with stakeholders from various departments to ensure reliable, timely, and secure data access across the business. Additionally, you will champion best practices in data design, governance, and observability, leveraging GenAI tools to enhance engineering productivity and accelerate time to insight. Key Responsibilities: - Own the design and scalability of the data lake architecture for both ...

As a highly experienced leader for the Data Engineering Center of Excellence (CoE), your role will involve strategic leadership, hands-on expertise, and building differentiators in the data space. You will be responsible for establishing and scaling the Data Engineering CoE, developing cutting-edge capabilities, and contributing to strategic customer engagements and proposals. - Lead Data CoE to build capabilities and differentiators in the data engineering field, including Data migration, Data modernization, and Data governance. - Define differentiating solutions for Data-related RFPs and proposals. - Build the Data Engineering practice with a strong foundation. - Drive customer discussions...

As a software development partner for a very large enterprise financial products and services firm listed on NYSE, your role involves re-architecting and migrating 30-year legacy systems to cloud-based microservices on AWS. The application is utilized by trading, journal, and bookkeeping platforms. Key Responsibilities: - Develop an event-driven ETL pipeline using AWS services to transfer end-of-day securities data from the mainframe to a relational database. - Build highly resilient and highly available containerized microservices. - Automate build and deployment using Jenkins and Terraform for Sandbox, Dev, QA, UAT, and Prod environments. - Write unit tests to achieve test coverage of over...

As a software development partner for a very large enterprise financial products and services firm listed on NYSE, your role involves re-architecting and migrating 30-year legacy systems to cloud-based microservices on AWS. The application you will be working on is essential for their trading, journal, and bookkeeping platforms. **Key Responsibilities:** - Develop an event-driven ETL pipeline using AWS services to transfer end-of-day securities data from the mainframe to a relational database. - Build highly resilient and highly available containerized microservices. - Automate build and deployment using Jenkins and Terraform for Sandbox, Dev, QA, UAT, and Prod environments. - Write unit tes...

As a Senior Data Engineer at our company, you will be responsible for leading the design, build, and evolution of our in-house data platforms. You will work closely with various stakeholders to construct datasets, build and maintain data pipelines, and collaborate with data analysts, data scientists, and business application development teams to deliver data solutions. **Role Overview:** You will analyze raw data to generate BI and Advanced Analytics datasets as per stakeholders" requirements. Additionally, you will design data pipelines, data marts, and data model changes aligning with our data warehouse standards. Your role will also involve executing data migration activities and ensuring...

Job description Hiring for AWS Architect Mandatory Skills: AWS services, Data & Analytics Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and detailed ...

Job description Hiring for AWS Architect Mandatory Skills: AWS services, Data & Analytics Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and detailed ...

Data Engineer Location: India (Hyderabad - Preferred/Remote Flexibility) Type: Full time, Paid The Role Were looking for an AWS focused Data Engineer with hands-on experience building production-grade pipelines at scale. The ideal candidate has 1 to 4 years of experience in data engineering and is excited to solve tough data problems in a fast-paced startup environment. What You Will Do Design, build, and maintain production-level data pipelines that handle terabytes of structured and unstructured data. Own end-to-end ETL/ELT processes, ensuring reliability, scalability, and high availability. Work with AWS services (S3, EC2, RDS, DynamoDB, Athena, Redshift, etc.) to power large-scale data w...

Adventus.io is a B2B2C SaaS-based marketplace supporting institutions, recruiters, and students within the international student placement sector. Our innovative platform allows institutions, recruiters, and students to directly connect with one another, resulting in matching the right international study experience with students across the world. Founded in 2018, we're on a mission to change the way the world accesses international education. Behind the technology, we have over 500 amazingly talented humans making it all happen. We're looking for ambitious self-starters who want to be part of our vision and create a positive legacy. The Product and Tech team is responsible for growing Adven...

Role Overview: At PwC, as a Senior Associate in the Data, Analytics & Specialist Managed Service tower, you will work as part of a team of problem solvers, helping to solve complex business issues from strategy to execution. Your responsibilities at this management level include, but are not limited to: Key Responsibilities: - Use feedback and reflection to develop self-awareness, personal strengths, and address development areas. - Be flexible to work in stretch opportunities/assignments. - Demonstrate critical thinking and the ability to bring order to unstructured problems. - Review ticket quality and deliverables, provide status reporting for the project. - Adhere to SLAs, with experienc...

Role Overview: As an IT professional at Capgemini Invent, you will be responsible for creating data warehouses, data lakes, ETL/ELT, and data pipelines on cloud platforms. Your focus will be on delivering cutting-edge solutions tailored to the challenges faced by clients in the Life Sciences Domain. You will leverage your expertise in cloud storage, cloud database, and data warehousing solutions such as Snowflake, BigQuery, AWS Redshift, ADLS, and S3. Additionally, you will use cloud data integration services like Azure Databricks, Azure Data Factory, Azure Synapse Analytics, AWS Glue, AWS EMR, Dataflow, and Dataproc for handling structured, semi-structured, and unstructured data. Your role ...

Role Overview: As a Data Architect at DATAECONOMY, you will be responsible for leading the design and implementation of scalable, secure, and high-performance data solutions. Your expertise in data architecture, cloud platforms, and modern data frameworks will be crucial in guiding clients and teams in building next-generation data platforms. Key Responsibilities: - Lead end-to-end design and architecture of enterprise-scale data solutions across cloud and hybrid environments. - Define and implement data strategies, governance, and architecture best practices aligned to business needs. - Architect and optimize data pipelines, ETL/ELT frameworks, and real-time data processing solutions. - Pro...

As a software development partner for a very large enterprise financial products and services firm listed in NYSE, your role involves re-architecting and migrating 30-year legacy systems to cloud-based microservices on AWS. The application you work on is crucial for their trading, journal & bookkeeping platforms. Key Responsibilities: - Develop an event-driven ETL pipeline using AWS services to transfer end-of-day securities data from the mainframe to a relational database. - Build highly resilient and highly available containerized microservices. - Automate build and deployment using Jenkins and Terraform for the Sandbox, Dev, QA, UAT, and Prod environments. - Write unit tests to provide te...

Required Skills & Experience: 7+ years of experience as a Data Engineer who have hands on experience on Databricks . Strong hands-on experience with: Apache Spark Databricks, PySpark & Python SQL AWS S3 AWS Athena Snowflake (Good to have but candidate must be proficient in writing SQL queries for data analysis) GitHub & GitHub Actions Solid understanding of AWS Cloud services related to data engineering. Experience working with Snowflake is an added advantage. Strong understanding of data modelling, data warehousing, and spark jobs performance optimization. Excellent problem-solving and analytical skills. Key Responsibilities: Design, build, and maintain ETL/ELT pipelines using Databricks in...

We are seeking a hands-on data engineer with a strong understanding of both data engineering and reporting . The ideal candidate will design and maintain data pipelines, curate analytical datasets, and build reports and dashboards that empower business stakeholders with insights. Youll work across ETL development, data modelling, and business reporting ensuring our data ecosystem is accurate, scalable, and reliable. Key Responsibilities Design, develop, and maintain ETL/ELT pipelines using AWS Glue, Python, and SQL to integrate data from multiple sources (MySQL, MongoDB, Postgres, Redshift, APIs, and S3). Build and manage Power BI dashboards and reports for business teams (Sales, Marketing, ...

Location: Chennai Hybrid (3 Days a Week in Office) Employment Type: Contract Shift: UK Shift (if applicable) Job Summary We are looking for a highly skilled Python Lead Developer with strong expertise in Python, SQL, AWS, and Apache Airflow. The ideal candidate will lead a team of developers to build scalable data pipelines, backend systems, and cloud-based solutions, ensuring high performance, maintainability, and adherence to best practices. Key Responsibilities Lead and mentor a team of Python developers, ensuring delivery of high-quality software solutions. Design, develop, and optimize data pipelines and backend systems using Python and Airflow. Work with AWS services (S3, Lambda, EC2, ...

Job Title: AWS Data Engineer Location: Hyderabad/Bangalore/Gurugram( Remote) Job Type: Full time Shift time: 1PM-10PM About Straive: Straive is a market leading Content and Data Technology company providing data services, subject matter expertise, & technology solutions to multiple domains. Data Analytics & Al Solutions, Data Al Powered Operations and Education & Learning form the core pillars of the companys long-term vision. The company is a specialized solutions provider to business information providers in finance, insurance, legal, real estate, life sciences and logistics. Straive continues to be the leading content services provider to research and education publishers. Data Analytics ...

Design and develop integration of Snowflake with a cloud platform and platform enhancements, integrations, and performance optimisation. Work on data ingestion using Python, cataloguing, and lineage tracking, Develop and architect ETL workflows. Required Candidate profile 5 years in developing and scaling data platforms centered around Snowflake, with Azure. Hands on Python Understanding of modern data architectures such as Data Mesh, Lakehouse, and ELT.

Experience needed: 8--12 years Type: Full-Time Mode: WFO Shift: IST Location: Hyderabad, India Notice Period: Immediate to 15 days About the Role We are seeking an experienced Databricks Implementation Lead to spearhead end-to-end delivery of a large-scale data engineering and analytics project built on the Databricks Lakehouse platform . The ideal candidate will have deep expertise in data architecture , hands-on experience with Databricks (SQL, PySpark, Delta Lake, MLflow) , and the ability to lead teams through solution design, migration, optimization, and production rollout . Key Responsibilities 1. Project Leadership Own the complete Databricks implementation lifecycle from requirement ...