1844 Aws Glue Jobs - Page 29

Job description Hiring for AWS Architect Mandatory Skills: AWS services, Data & Analytics Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and detailed ...

Job description Hiring for AWS Architect Mandatory Skills: AWS services, Data & Analytics Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and detailed ...

Data Engineer Location: India (Hyderabad - Preferred/Remote Flexibility) Type: Full time, Paid The Role Were looking for an AWS focused Data Engineer with hands-on experience building production-grade pipelines at scale. The ideal candidate has 1 to 4 years of experience in data engineering and is excited to solve tough data problems in a fast-paced startup environment. What You Will Do Design, build, and maintain production-level data pipelines that handle terabytes of structured and unstructured data. Own end-to-end ETL/ELT processes, ensuring reliability, scalability, and high availability. Work with AWS services (S3, EC2, RDS, DynamoDB, Athena, Redshift, etc.) to power large-scale data w...

Adventus.io is a B2B2C SaaS-based marketplace supporting institutions, recruiters, and students within the international student placement sector. Our innovative platform allows institutions, recruiters, and students to directly connect with one another, resulting in matching the right international study experience with students across the world. Founded in 2018, we're on a mission to change the way the world accesses international education. Behind the technology, we have over 500 amazingly talented humans making it all happen. We're looking for ambitious self-starters who want to be part of our vision and create a positive legacy. The Product and Tech team is responsible for growing Adven...

Role Overview: At PwC, as a Senior Associate in the Data, Analytics & Specialist Managed Service tower, you will work as part of a team of problem solvers, helping to solve complex business issues from strategy to execution. Your responsibilities at this management level include, but are not limited to: Key Responsibilities: - Use feedback and reflection to develop self-awareness, personal strengths, and address development areas. - Be flexible to work in stretch opportunities/assignments. - Demonstrate critical thinking and the ability to bring order to unstructured problems. - Review ticket quality and deliverables, provide status reporting for the project. - Adhere to SLAs, with experienc...

Role Overview: As an IT professional at Capgemini Invent, you will be responsible for creating data warehouses, data lakes, ETL/ELT, and data pipelines on cloud platforms. Your focus will be on delivering cutting-edge solutions tailored to the challenges faced by clients in the Life Sciences Domain. You will leverage your expertise in cloud storage, cloud database, and data warehousing solutions such as Snowflake, BigQuery, AWS Redshift, ADLS, and S3. Additionally, you will use cloud data integration services like Azure Databricks, Azure Data Factory, Azure Synapse Analytics, AWS Glue, AWS EMR, Dataflow, and Dataproc for handling structured, semi-structured, and unstructured data. Your role ...

Role Overview: As a Data Architect at DATAECONOMY, you will be responsible for leading the design and implementation of scalable, secure, and high-performance data solutions. Your expertise in data architecture, cloud platforms, and modern data frameworks will be crucial in guiding clients and teams in building next-generation data platforms. Key Responsibilities: - Lead end-to-end design and architecture of enterprise-scale data solutions across cloud and hybrid environments. - Define and implement data strategies, governance, and architecture best practices aligned to business needs. - Architect and optimize data pipelines, ETL/ELT frameworks, and real-time data processing solutions. - Pro...

As a software development partner for a very large enterprise financial products and services firm listed in NYSE, your role involves re-architecting and migrating 30-year legacy systems to cloud-based microservices on AWS. The application you work on is crucial for their trading, journal & bookkeeping platforms. Key Responsibilities: - Develop an event-driven ETL pipeline using AWS services to transfer end-of-day securities data from the mainframe to a relational database. - Build highly resilient and highly available containerized microservices. - Automate build and deployment using Jenkins and Terraform for the Sandbox, Dev, QA, UAT, and Prod environments. - Write unit tests to provide te...

Required Skills & Experience: 7+ years of experience as a Data Engineer who have hands on experience on Databricks . Strong hands-on experience with: Apache Spark Databricks, PySpark & Python SQL AWS S3 AWS Athena Snowflake (Good to have but candidate must be proficient in writing SQL queries for data analysis) GitHub & GitHub Actions Solid understanding of AWS Cloud services related to data engineering. Experience working with Snowflake is an added advantage. Strong understanding of data modelling, data warehousing, and spark jobs performance optimization. Excellent problem-solving and analytical skills. Key Responsibilities: Design, build, and maintain ETL/ELT pipelines using Databricks in...

We are seeking a hands-on data engineer with a strong understanding of both data engineering and reporting . The ideal candidate will design and maintain data pipelines, curate analytical datasets, and build reports and dashboards that empower business stakeholders with insights. Youll work across ETL development, data modelling, and business reporting ensuring our data ecosystem is accurate, scalable, and reliable. Key Responsibilities Design, develop, and maintain ETL/ELT pipelines using AWS Glue, Python, and SQL to integrate data from multiple sources (MySQL, MongoDB, Postgres, Redshift, APIs, and S3). Build and manage Power BI dashboards and reports for business teams (Sales, Marketing, ...

Location: Chennai Hybrid (3 Days a Week in Office) Employment Type: Contract Shift: UK Shift (if applicable) Job Summary We are looking for a highly skilled Python Lead Developer with strong expertise in Python, SQL, AWS, and Apache Airflow. The ideal candidate will lead a team of developers to build scalable data pipelines, backend systems, and cloud-based solutions, ensuring high performance, maintainability, and adherence to best practices. Key Responsibilities Lead and mentor a team of Python developers, ensuring delivery of high-quality software solutions. Design, develop, and optimize data pipelines and backend systems using Python and Airflow. Work with AWS services (S3, Lambda, EC2, ...

Job Title: AWS Data Engineer Location: Hyderabad/Bangalore/Gurugram( Remote) Job Type: Full time Shift time: 1PM-10PM About Straive: Straive is a market leading Content and Data Technology company providing data services, subject matter expertise, & technology solutions to multiple domains. Data Analytics & Al Solutions, Data Al Powered Operations and Education & Learning form the core pillars of the companys long-term vision. The company is a specialized solutions provider to business information providers in finance, insurance, legal, real estate, life sciences and logistics. Straive continues to be the leading content services provider to research and education publishers. Data Analytics ...

Design and develop integration of Snowflake with a cloud platform and platform enhancements, integrations, and performance optimisation. Work on data ingestion using Python, cataloguing, and lineage tracking, Develop and architect ETL workflows. Required Candidate profile 5 years in developing and scaling data platforms centered around Snowflake, with Azure. Hands on Python Understanding of modern data architectures such as Data Mesh, Lakehouse, and ELT.

Experience needed: 8--12 years Type: Full-Time Mode: WFO Shift: IST Location: Hyderabad, India Notice Period: Immediate to 15 days About the Role We are seeking an experienced Databricks Implementation Lead to spearhead end-to-end delivery of a large-scale data engineering and analytics project built on the Databricks Lakehouse platform . The ideal candidate will have deep expertise in data architecture , hands-on experience with Databricks (SQL, PySpark, Delta Lake, MLflow) , and the ability to lead teams through solution design, migration, optimization, and production rollout . Key Responsibilities 1. Project Leadership Own the complete Databricks implementation lifecycle from requirement ...

You will play a crucial role in leading the design efforts and formulating implementation strategies for AI solutions within the CPG integrated Marketing department. Your responsibilities will involve: - Leading the development and deployment of AI-enhanced BI solutions across various cloud platforms. - Building and optimizing data pipelines, models, and dashboards to derive real-time insights. - Collaborating with architects and stakeholders to ensure alignment with business objectives. - Implementing MLOps practices to facilitate continuous integration and delivery of ML models. - Ensuring adherence to data governance, privacy, and security standards. - Mentoring junior developers to foste...

We are seeking a skilled Data Engineer with hands-on experience in building, optimizing, and maintaining large-scale data pipelines and cloud-based data solutions. The ideal candidate will have strong expertise in AWS services , DBT , and Power BI , with a deep understanding of data modeling, transformation, and analytics for manufacturing data systems. Roles and Responsibilities Design, develop, and maintain ETL/ELT pipelines for data ingestion, transformation, and integration. Work extensively with AWS Glue , Athena , and S3 to manage and optimize data workflows. Develop and maintain SQL transformation code in DBT (Data Build Tool) . Ensure data quality, reliability, and performance optimi...

Job description We are seeking a highly experienced Senior Data Engineer to lead the design, development, and optimization of scalable data pipelines using AWS Redshift and Apache Airflow. The ideal candidate will have deep expertise in cloud-based data warehousing, workflow orchestration, and ETL processes, with a strong background in SQL and Python. Responsibilities: • Design, build, and maintain robust ETL/ELT pipelines using Apache Airflow. • Integrate data from various sources into AWS Redshift for analytics and reporting. • Develop and optimize Redshift schemas, tables, and queries. • Monitor and tune Redshift performance for large-scale data operations. • Implement and manage DAGs in ...

Job Requirements Data layer architecting in the Data Architecture domain, responsible for the design and creation of standard and benchmark data models using Layered Scalable Architecture principles / Medallion Architecture to deliver the Data Marts across all Businesses of Titan with highest data quality, performance & costs. Design optimization to handle high volumes having several decades of Business Data, External Data and complex structures. Managing and maintaining data dictionary/ glossary/ERD Creation of Conceptual, Logical and Physical Data Models Project management Work Experience Strong Technical knowledge of SQL (Advanced SQL store procedures, performance tuning), RDBMS, Data War...

About The Role Project Role : Cloud Platform Engineer Project Role Description : Designs, builds, tests, and deploys cloud application solutions that integrate cloud and non-cloud infrastructure. Can deploy infrastructure and platform environments, creates a proof of architecture to test architecture viability, security and performance. Must have skills : AWS Analytics Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Cloud Platform Engineer, you will engage in the design, construction, testing, and deployment of cloud application solutions that seamlessly integrate both cloud and non-cloud infrastructu...

About The Role Project Role : Cloud Platform Engineer Project Role Description : Designs, builds, tests, and deploys cloud application solutions that integrate cloud and non-cloud infrastructure. Can deploy infrastructure and platform environments, creates a proof of architecture to test architecture viability, security and performance. Must have skills : AWS Analytics Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Cloud Platform Engineer, you will engage in the design, construction, testing, and deployment of cloud application solutions that seamlessly integrate both cloud and non-cloud infrastructu...

About The Role Project Role : Cloud Platform Engineer Project Role Description : Designs, builds, tests, and deploys cloud application solutions that integrate cloud and non-cloud infrastructure. Can deploy infrastructure and platform environments, creates a proof of architecture to test architecture viability, security and performance. Must have skills : AWS Analytics Good to have skills : NA Minimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Position Overview:As a Junior AWS Cloud Data Engineer, you will support the design, development, and maintenance of our AWS-based data infrastructure. This entry-level position offers an excellent oppor...

About The Role Project Role : Cloud Platform Engineer Project Role Description : Designs, builds, tests, and deploys cloud application solutions that integrate cloud and non-cloud infrastructure. Can deploy infrastructure and platform environments, creates a proof of architecture to test architecture viability, security and performance. Must have skills : AWS Analytics, O365, Power Apps Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Cloud Platform Engineer, you will design, build, test, and deploy cloud application solutions that seamlessly integrate both cloud and non-cloud infrastructure. Your typi...

About The Role Project Role : Cloud Platform Engineer Project Role Description : Designs, builds, tests, and deploys cloud application solutions that integrate cloud and non-cloud infrastructure. Can deploy infrastructure and platform environments, creates a proof of architecture to test architecture viability, security and performance. Must have skills : AWS Analytics Good to have skills : AWS Architecture Minimum 12 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Cloud Platform Engineer, you will engage in the design, construction, testing, and deployment of cloud application solutions that seamlessly integrate both cloud and non-clo...

About The Role Project Role : Cloud Platform Engineer Project Role Description : Designs, builds, tests, and deploys cloud application solutions that integrate cloud and non-cloud infrastructure. Can deploy infrastructure and platform environments, creates a proof of architecture to test architecture viability, security and performance. Must have skills : AWS Analytics Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Cloud Platform Engineer, you will engage in the design, construction, testing, and deployment of cloud application solutions that seamlessly integrate both cloud and non-cloud infrastructu...

About The Role Project Role : Cloud Platform Engineer Project Role Description : Designs, builds, tests, and deploys cloud application solutions that integrate cloud and non-cloud infrastructure. Can deploy infrastructure and platform environments, creates a proof of architecture to test architecture viability, security and performance. Must have skills : AWS Analytics Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Cloud Platform Engineer, you will engage in the design, construction, testing, and deployment of cloud application solutions that seamlessly integrate both cloud and non-cloud infrastructu...