1844 Aws Glue Jobs - Page 16

Role Overview: You will be responsible for utilizing your solid software engineering and DataSecOps background to effectively translate complex technical concepts into simple terms. Your expertise in CICD tools will be crucial in this role. Additionally, your experience with Databricks and knowledge of recent features available in the tool will be essential. You will work with the Microsoft Azure analytics stack and real-time analytics tools, demonstrating advanced proficiency in SQL and familiarity with various databases. Your understanding of data modeling techniques for analytics will be key in this position. Key Responsibilities: - Perform root cause analysis on internal and external dat...

Role Overview: At PwC, you will be a part of the managed services team focusing on providing outsourced solutions and support to clients across various functions. Your role will involve streamlining operations, reducing costs, and enhancing efficiency by managing key processes and functions for clients. You will utilize your skills in project management, technology, and process optimization to deliver high-quality services. Key Responsibilities: - Lead end-to-end delivery of managed data analytics services to clients, ensuring projects meet business requirements, timelines, and quality standards - Set up Incident Management and Problem Management processes for the engagement - Collaborate wi...

As a Software Engineer working with one of the top Australian banks to modernize their data and analytics platform, your role will involve collaborating with IT and business stakeholders in the Data and Platform team to implement the bank's data strategy towards becoming the leading AI bank globally. Key Responsibilities: - Design and implement robust, scalable software solutions. - Develop automation frameworks for performance, integration, security, and testing. - Embed unit, integration, and contract tests into CI/CD pipelines following a shift-left approach. - Collaborate with teams to ensure testability, observability, and resilience. - Drive quality strategy and establish engineering d...

Data Pipeline Development Design and develop scalable ETL/ELT pipelines using PySpark on AWS Glue or EMR . Build and maintain AWS-based data ingestion solutions using Kinesis , Firehose , DMS , and Lambda . Process structured, semi-structured (JSON/Parquet), and unstructured datasets. 2. Data Lake & Storage Implement and manage data lakes on Amazon S3 following raw curated consumption zone architecture. Optimize storage and query performance using partitioning, bucketing, and compression . Catalog metadata using Glue Data Catalog and AWS Lake Formation . Role & responsibilities

About The Role Project Role : Cloud Platform Engineer Project Role Description : Designs, builds, tests, and deploys cloud application solutions that integrate cloud and non-cloud infrastructure. Can deploy infrastructure and platform environments, creates a proof of architecture to test architecture viability, security and performance. Must have skills : AWS Analytics Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Cloud Platform Engineer, you will engage in the design, construction, testing, and deployment of cloud application solutions that seamlessly integrate both cloud and non-cloud infrastructu...

Role & responsibilities Mandatory Skills: • 9+ Years of experience as a Data Engineer • Strong technical expertise in SQL Advanced SQL querying skills (joins, subqueries, CTEs, aggregation) • Strong knowledge of joints and common table expressions (CTEs) • Strong experience with Python • Experience in Snowflake, ETL, SQL, CI/CD • Strong expertise in ETL process and with various data model concepts • Knowledge of Star Schema and snowflake schema • Good to know about AWS services such as S3, Athena, Glue, EMR/Spark with a major emphasis on S3 and Glue. Nice to Have: • Experience with Big Data Tools and technologies • Good Understanding of data structures and data analysis • Knowledge of Insura...

Greetings of the day!! My name is Arumugam Veera, and I'm reaching out to you regarding an exciting opportunity with TechMango. You can connect with me on LinkedIn https://www.linkedin.com/in/arumugamv/ Position : AWS Data Engineer - Python & Pyspark Experience: 2 to 5 Years Job Location: Madurai Work Mode: Hybrid(3 Days of WFO in a week) Mandate Skills: AWS, Python, Pyspark, RedShift, Snowflake, Writing complex SQL Queries. Notice Period: We Prefer only immediate joiner who can join with in 1st week of Dec'25 (Not looking for high notice 30/60/90 Days) Shift: 2 to 11 PM About Us At TechMango IT Services, we empower enterprises through data-driven transformation. We design, build, and manage...

Dear Candidate, Greetings from Ahana Systems and Solutions Pvt Ltd. About the Role We are looking for a highly skilled Senior Data Engineer who can design, build, and maintain scalable data pipelines and analytics systems. The ideal candidate will have strong experience in AWS, big-data tools, and modern programming languages, with a passion for data quality and process optimization. Key Responsibilities Design, develop, and maintain scalable data pipelines Work with cross-functional teams to understand data requirements and deliver reliable solutions Optimize and enhance existing data workflows Implement best practices for data modeling, data governance, and data quality Collaborate with en...

Job Title: Database Tech Lead Experience: 7-8 years Location: Mumbai Job Type: Full-time Type of Hire : On Roll About Us: CRISIL is a leading rating company that is seeking an experienced Database Software Engineer to join our team. We are looking for a skilled and motivated individual who can design, develop, and maintain our database systems and ETL pipelines to support our growing business. Job Summary: We are seeking a highly skilled Database Tech Lead with 7-8 years of experience to join our team. Ability to work in a fast-paced environment and prioritize multiple tasks and projects. The successful candidate will be responsible for designing, developing, and maintaining our database sys...

Solid software engineering and DataSecOps background, including CICD tools expertise Strong ability to effectively translate complex technical concepts into simple terms Experience with Data bricks, including recent features available in the tool Experience on Microsoft Azure analytics stack, as well as real-time analytics tools Advanced proficiency in SQL and familiarity with various databases Understanding of data modelling techniques for analytics Ability to perform root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement Experience with data security operations, preferably on the Azure stack Ability t...

You will be responsible for designing, developing, and supporting scalable ETL processes using open source tools and data frameworks such as AWS Glue, AWS Athena, Redshift, Apache Kafka, Apache Spark, Apache Airflow, and Pentaho Data Integration (PDI). Additionally, you will design, create, and maintain data lakes and data warehouse on the AWS cloud. Your role will involve maintaining and optimizing the data pipeline architecture, formulating complex SQL queries for big data processing, collaborating with product and engineering teams for designing a platform for data modeling and machine learning operations, implementing various data structures and algorithms, ensuring data privacy and comp...

Role Overview: You will be responsible for utilizing your strong experience in PySpark, Python, and Unix scripting to work on data processing tasks. Your expertise in SparkSQL and Hive will be essential in writing SQLs and creating views. Additionally, your excellent communication skills will be valuable in collaborating with team members. Knowledge of the Insurance domain is a plus, along with a good understanding of the Hadoop Ecosystem and Architecture, including HDFS, Map Reduce, Pig, Hive, Oozie, and Yarn. You will also need familiarity with AWS services such as Glue, AWS S3, Lambda function, Step Function, and EC2. Data migration exposure from platforms like Hive/S3 to Data Bricks will...

**Job Description:** As a Data Engineer at our company, you will play a crucial role in simplifying our organization by developing innovative data-driven solutions through data pipelines, modeling, and ETL design. Your primary focus will be on creating effortless, digital-first customer experiences while ensuring the safety and security of our customers" data. **Key Responsibilities:** - Build advanced automation of data engineering pipelines by eliminating manual stages - Incorporate new data techniques into the business through role modeling, training, and overseeing experiment design - Provide a clear understanding of data platform costs to meet cost-saving and income targets - Source new...

You are a highly motivated and experienced Senior Software Engineer with expertise in backend development using Node.js and Python, as well as frontend development experience in React or Angular. You have a strong understanding of IoT systems and will be responsible for designing, developing, and maintaining scalable applications and backend services that interface with IoT gateways using MQTT and AWS cloud services. **Key Responsibilities:** - Design, build, and maintain scalable backend services using Node.js and Python - Develop interactive front-end interfaces using React or Angular - Integrate and manage IoT Gateways, including MQTT protocol communication - Design and manage relational ...

As a Senior Data Warehouse Administrator at our company, you will play a crucial role in architecting, managing, and optimizing large-scale data warehousing environments. Your expertise in modern data lake architectures, particularly with Apache Iceberg, and practical experience in building and maintaining data ingestion pipelines will be essential. You will be responsible for driving the efficiency and reliability of our data platform through deep SQL performance tuning and ensuring timely data flow using Change Data Capture (CDC) tools. **Role Overview:** - Design, implement, and maintain scalable and secure data warehouse environments. - Optimize data warehouse performance by fine-tuning ...

As a Data Engineer, your role will involve: - Conducting tests on data pipelines and evaluating results against data quality and performance specifications. - Applying and optimizing data models for efficient storage, retrieval, and processing of large datasets. - Communicating and explaining design/development aspects to customers. - Estimating time and resource requirements for developing/debugging features/components. - Participating in RFP responses and solutioning. - Mentoring team members and guiding them in relevant upskilling and certification. Qualifications required: - Bachelors or masters degree The company also values strong development experience in Snowflake, Cloud (AWS, GCP), ...

Role Overview: You will be responsible for designing, developing, and optimizing data pipelines using PySpark and Spark SQL to support large-scale analytics and data integration initiatives. Additionally, you will work with large datasets in Hadoop, Databricks, or AWS/GCP/Azure environments, and collaborate with various teams to define data requirements and integrate data from different sources. Key Responsibilities: - Design, develop, and maintain scalable ETL pipelines using PySpark and Spark SQL. - Work with large datasets in Hadoop, Databricks, or AWS/GCP/Azure environments. - Optimize Spark jobs for performance and reliability. - Collaborate with data engineers, analysts, and business t...

Design, develop new features for a large-scale cloud data platform using Databricks, snowflake and Fabric, Deeply understand legacy data platforms, and drive their modernization, Provide production support Design data pipelines and data warehouse. Required Candidate profile 5 years in developing and scaling data platforms using Snowflake, databricks, Fabric, Strong Python and SQL Intermediate C# Understanding of modern data architectures such as Data Mesh, Lakehouse

Warm Greetings from SP Staffing!! Role :AWS Data Engineer Experience Required :4 to 6 yrs Work Location: Bangalore/Pune/Noida Required Skills, Glue Pyspark Redshift Interested candidates can send resumes to nandhini.spstaffing@gmail.com

Role Proficiency: This role requires proficiency in developing data pipelines including coding and testing for ingesting wrangling transforming and joining data from various sources. The ideal candidate should be adept in ETL tools like Informatica Glue Databricks and DataProc with strong coding skills in Python PySpark and SQL. This position demands independence and proficiency across various data domains. Expertise in data warehousing solutions such as Snowflake BigQuery Lakehouse and Delta Lake is essential including the ability to calculate processing costs and address performance issues. A solid understanding of DevOps and infrastructure needs is also required. Outcomes: Act creatively ...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : AWS Glue Good to have skills : PySpark, Snowflake Data Warehouse, Data Engineering Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary: As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensu...

Dear Aspirant, Please find the below mentioned job details and if you are suitable to the below role. please share me updated resume to smouni@deloitte.com/god1@deloitte.com along with the below details. Skill: Data Engineer with AWS (Pyspark, SQL, AWS) Experience: 4 to 10 years Job Locations: Chennai Notice Period: Immediate to 45 days Details Required Names Skill Current Company Name Total years of experience Relevant Exp Current Location Preferred Location Notice Period Current CTC Expected CTC Regards Mounika S

Greetings!!! TCS is hiring... Role: AWS Cloud Engineer EXP: 6 - 10 YEARS LOCATION: Chennai/Delhi/Pune/Bangalore Notice Period- *** 30 DAYS *** Job Description AWS Platform Engineer with Terraform 1) Extensive experience in Infrastructure as a Code (IaC) using Terraform. 2) Rich experience with container frameworks like Docker, Kubernetes and cloud native container services. 3)Good expertise in scripting and automation using languages like Bash/Shell, Python, PowerShell. 4)Should be able to troubleshoot and fix any configuration issue in AWS cloud. 5) AWS native services along with Data Engineering services like EMR, Athena, Glue 6) Exposure to AWS Production environment 7) Any scripting lang...

Dear Candidate, Greetings from TATA Consultancy Services!! Thank you for expressing your interest in exploring a career possibility with the TCS Family. Hiring For:- AWS Data Engg(AWS+Python+Glue) Location: Noida/ Kolkata/ Pune/ Bangalore/ Chennai/Hyderabad Experience: 4 to 7yrs Advanced working Scala ,SQL,Python/PySpark knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases. Experience building and optimizing Cloud big data’ data pipelines, architectures and data sets. Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify op...

Greetings of the day!! My name is Arumugam Veera, and I'm reaching out to you regarding an exciting opportunity with TechMango. You can connect with me on LinkedIn https://www.linkedin.com/in/arumugamv/ Position : Senior/Lead AWS Data Engineer Experience: 8 to 15 Years Job Location: Bangalore/Madurai Budget: Open Work Mode: Remote Mandate Skills: AWS, RedShift, Snowflake, Writing complex SQL Queries. Notice Period: We Prefer only immediate joiner who can join with in 1st week of Dec'25 (Not looking for high notice 30/60/90 Days) Job Description Were looking for a seasoned Data Engineer to join our Engineering organization and take ownership of the systems that power our data-driven decisions...