1844 Aws Glue Jobs - Page 20

Description: Primary/Mandatory Experience: - Experience building data pipeline in Python along with AWS services (S3 SNS CloudWatch Lambda Step Function etc) - Proficient in AWS Server less technologies - Technical knowledge of Extract/Transform/Load (ETL) solutions for running analytic projects on the cloud - Candidate must have hands-on technical experience on the AWS cloud native technologies along with traditional ETL tools -Snowflake & DWH experience is a plus Daily Activity: Excellent written and verbal communication skills and be able to lead meetings with technical peers and clients regarding the solution designs. Ability to communicate with the Business Analysts Data Modellers Cloud...

About The Role :: As a Data Engineer with AWS experience at [Your Company Name], you will play a crucial role in the design, development, and maintenance of our data infrastructure. Your work will empower data-driven decision-making and contribute to the success of our data-driven initiatives. Key Responsibilities: Data Integration:Develop and maintain data pipelines to extract, transform, and load (ETL) data from various sources into AWS data stores for both batch and streaming data ingestion. AWS Expertise:Utilize your expertise in AWS services such as Amazon EMR , S3, AWS Glue, Amazon Redshift, AWS Lambda, and more to build and optimize data solutions. Data Modeling:Design and implement d...

Responsibilities: Develop and implement data governance frameworks and policies to ensure data trust. Establish data quality standards metrics and processes for monitoring and improving data integrity. Implement data privacy measures and ensure compliance with regulations. Collaborate with cross-functional teams to define data stewardship roles and responsibilities. Conduct regular audits and assessments to maintain data quality and security. Implement data management tools and technologies to support data governance initiatives. Provide training and guidance on data trust best practices to internal stakeholders. Stay informed on industry trends and best practices in data governance and priv...

Description: Responsibilities: Develop and implement data governance frameworks and policies to ensure data trust. Establish data quality standards metrics and processes for monitoring and improving data integrity. Implement data privacy measures and ensure compliance with regulations. Collaborate with cross-functional teams to define data stewardship roles and responsibilities. Conduct regular audits and assessments to maintain data quality and security. Implement data management tools and technologies to support data governance initiatives. Provide training and guidance on data trust best practices to internal stakeholders. Stay informed on industry trends and best practices in data govern...

SUMMARY Summary: As a Snowflake Data Warehouse Application Lead, you will play a pivotal role in driving the design, development, and optimization of enterprise-grade data solutions within a cloud-native environment. You will serve as the primary technical authority and strategic leader for Snowflake-based data warehouse initiatives, ensuring alignment with business goals, scalability, and performance excellence. This role demands deep expertise in Snowflake, strong leadership capabilities, and the ability to guide cross-functional teams through complex data challenges. You will be responsible for shaping data architecture, fostering innovation, and ensuring timely delivery of high-quality d...

Location : Any PSL Location JD - DBT/AWS Glue/Python/Pyspark Hands-on experience in data engineering, with expertise in DBT/AWS Glue/Python/Pyspark. Strong knowledge of data engineering concepts, data pipelines, ETL/ELT processes, and cloud data environments (AWS) Technology DBT, AWS Glue, Athena, SQL, Spark, PySpark Good understanding of Spark internals and how it works. Goot skills in PySpark Good understanding of DBT basically should be to understand DBT limitations and when it will end-up in model explosion Good hands-on experience in AWS Glue AWS expertise should know different services and should know how to configure them and infra-as-code experience Basic understanding of different o...

EXP 4 to 6 yrs Location Any PSL Location Rate below 14$ JD - DBT/AWS Glue/Python/Pyspark Hands-on experience in data engineering, with expertise in DBT/AWS Glue/Python/Pyspark. Strong knowledge of data engineering concepts, data pipelines, ETL/ELT processes, and cloud data environments (AWS) Technology DBT, AWS Glue, Athena, SQL, Spark, PySpark Good understanding of Spark internals and how it works. Goot skills in PySpark Good understanding of DBT basically should be to understand DBT limitations and when it will end-up in model explosion Good hands-on experience in AWS Glue AWS expertise should know different services and should know how to configure them and infra-as-code experience Basic ...

EXP 4 to 6 yrs Location Any PSL Location Rate below 14$ JD - DBT/AWS Glue/Python/Pyspark Hands-on experience in data engineering, with expertise in DBT/AWS Glue/Python/Pyspark. Strong knowledge of data engineering concepts, data pipelines, ETL/ELT processes, and cloud data environments (AWS) Technology DBT, AWS Glue, Athena, SQL, Spark, PySpark Good understanding of Spark internals and how it works. Goot skills in PySpark Good understanding of DBT basically should be to understand DBT limitations and when it will end-up in model explosion Good hands-on experience in AWS Glue AWS expertise should know different services and should know how to configure them and infra-as-code experience Basic ...

Skills Required: Strong proficiency in Pyspark , Scala , and Python Experience with AWS Glue Experience Required: Minimum 5 years of relevant experience Location: Available across all UST locations Notice Period: Immediate joiners

About the Role: We are seeking a highly skilled and motivated Data Engineer to design, develop, and maintain scalable data pipelines and architectures that support analytics, reporting, and data-driven decision-making. The ideal candidate will have hands-on experience with modern data technologies, cloud-based platforms, and a strong understanding of ETL processes, database systems, and data modeling. Key Responsibilities: Design, build, and maintain robust, scalable, and efficient data pipelines for processing structured and unstructured data. Develop and implement ETL/ELT processes to collect, clean, transform, and load data from multiple sources. Work with data analysts and data scientist...

Platform & Expectations The enterprise-level data platform already exists. Role involves enhancement and building on top of it. Candidates should be ready to work on various data solutions, not just ADP. Experience Requirement 5-6 years total experience preferred. Minimum 3-4 years as an AWS Data Engineer. For 8+ years total experience, 56 years in AWS data engineering is expected. Must-Have Skills AWS Services: S3, Lambda, Glue, Redshift, SNS, Step Functions, DataBrew. Python and Spark: Strong proficiency required. Data warehousing, lakehouses, ETL/data pipelines. Full-stack data engineering capabilities. Basic DevOps and automation experience. Soft Skills Strong communication (multi-stakeh...

Job Summary We are seeking a highly skilled Technical Architect with deep expertise in Big Data technologies and AWS Cloud services. The ideal candidate will lead the design and implementation of scalable, secure, and high-performance data solutions using Python, PySpark, Spark, Hive, AWS EMR, and AWS Glue. This role requires strong leadership, architectural vision, and hands-on technical proficiency. We are looking for immediate joiner or (Max 15 Day NP) Multiple Location - Indore/Pune/Hyderabad/Noida/Gurgaon/Bangalore Key Responsibilities Architect and design end-to-end Big Data solutions on AWS Cloud Lead development of scalable data pipelines using PySpark, Spark, and Hive Optimize perfo...

Responsibilities: Design, develop & maintain ETL processes using AWS Glue, lambda, Python & SQL. Optimize performance with Airflow workflows or Step Functions. Sound knowledge on Python, spark & optimisation techniques Knowledge of Redshift

Role Overview: You will be responsible for designing, building, and maintaining scalable and efficient data pipelines for moving data between cloud-native databases and SaaS providers using AWS Glue and Python. Your role will involve implementing and managing ETL/ELT processes to ensure seamless data integration and transformation. It will be essential to maintain information security and comply with data governance standards. Additionally, you will work on maintaining and enhancing data environments, including data lakes, warehouses, and distributed processing systems. Efficient utilization of version control systems like GitHub for code management and collaboration with the team will be a ...

Role Overview: You will be working as an Associate/Architect - Data (AbInitio) at Quantiphi. The role is based in Bangalore, Mumbai, or Trivandrum with a hybrid work setup. With over 7 years of experience, you will play a key role in migrating ETL jobs from existing Ab Initio to AWS Cloud. Your responsibilities will include designing and implementing a migration strategy, interpreting complex graphs/jobs, guiding the Data Engineering team, creating high-level block diagrams, validating output data, and serving as a technical point of contact between clients and the offshore team. Your ability to communicate technical details effectively and your familiarity with SDLC concepts will be crucial...

Role Overview: As a Senior Technical Director at Accordion, you will be responsible for the design, development, configuration/deployment, and maintenance of the technology stack. Your role will involve having an in-depth understanding of various tools & technologies in the domain to design and implement robust and scalable solutions that address client current and future requirements at optimal costs. You will evaluate existing architectures and recommend ways to upgrade and improve the performance of architectures both on-premises and cloud-based solutions. A successful Senior Technical Director at Accordion should possess strong working business knowledge, familiarity with multiple tools ...

Job Title: Data Engineer About the Role Were seeking a Data Engineer with 3–4 years of experience to join our growing tech team. The ideal candidate will have hands-on experience in building and managing scalable data systems on AWS, with strong expertise in data pipelines, real-time streaming, and modern data frameworks.in building and managing scalable data systems on AWS using Spark and modern data frameworks. Key Responsibilities Design, build, and maintain end-to-end data pipelines for ingestion, transformation, and delivery of high-volume data. Develop Spark-based ETL/ELT workflows for both batch and real-time streaming data. Core Skills: Spark, AWS (S3, Glue, Redshift, Kinesis), Kafka...

Skill AWS Data Engineer (Senior) Location Pan India (Hybrid Mode) Type of Role Client facing role Must to Have Skill - Python and Pyspark + AWS Glue -6-9 Years of total and 4-5 years of relevant experience -AWS Data services

We are looking for a Manager Software Engineering to join our IMS Team in Bangalore . This is an amazing opportunity to work on Big Data technologies involved in content ingestion. The team consists of 10-12 engineers and is reporting to the Sr Manager. We have a great skill set in Spark, Java, Scala, Hive, Sql, XSLT, AWS EMR, S3, etc and we would love to speak with you if you have skills in the same. About You experience, education, skills, and accomplishments: Work Experience: Minimum 7 years experience in Big Data projects involved in content ingestion, curation, transformation Technical Skill: Databricks, Spark, Python/Java , Scala, AWS EMR, S3, SQS, Hive, XSLT, Education (bachelors degr...

Role & responsibilities Position name- ML Engineer Exp- 8+ years Hyderabad Only Send Cv on komal@contactxindia.com , call on 9987334349 JD- Key Responsibilities: ML Engineer (MLE) 11-14 years of experience in data engineering and ML engineering 7-8 years as a data engineer before transitioning to ML engineering roles, feature engineering, feature stores Experience with SQL, NoSQL, graph databases, Oracle/Snowflake/Cloudera, Vector DBs, RAG architecture, prompt tuning Experience with at least one cloud platform. Strongly preferred: AWS, Sagemaker, Bedrock, AWS Glue, EMR, Lambda, IAM, Athena, Redshift, Kakfa Experience creating, monitoring and fixing model pipelines/data pipelines for data at ...

As the Director of Artificial Intelligence at a leading healthcare technology provider, your role will involve identifying and prioritizing high-value AI opportunities across machine learning, generative AI, and intelligent agents. You will lead and mentor cross-functional teams of AI/ML, data, BI, and full-stack engineers, fostering excellence and collaboration. Your responsibilities will also include driving AI solution development, implementing scalable MLOps pipelines for model training, deployment, and monitoring, and integrating AI seamlessly into products and workflows. **Key Responsibilities:** - Identify and prioritize high-value AI opportunities across machine learning, generative ...

We are looking for a highly skilled and motivated AWS Data Engineer who thrives on solving complex problems, building scalable systems, and driving innovation. Key Responsibilities Design, develop, and maintain scalable data pipelines and ETL workflows using AWS services. Build and automate data processing, transformation, and integration solutions using Python . Optimize and manage SQL queries, stored procedures, and database performance across multiple environments. Implement cloud security , cost optimization , and performance tuning best practices within AWS infrastructure. Collaborate closely with business analysts, data scientists, and application teams to deliver high-quality data sol...

Job Description: Experience: 2.5 5 Years Location: Bengaluru Designation: Sr. Software / Software Engineer Job Summary We are looking for a skilled Data Engineer with strong expertise in AWS cloud technologies and a solid understanding of data pipelines, ETL processes, and data modelling. The ideal candidate will design, build, and optimize scalable data infrastructure to support analytics, machine learning, and business intelligence needs. Key Roles & Responsibilities 1. Data Pipeline Development Design, develop, and maintain end-to-end data pipelines on AWS using services such as Glue, Lambda, Step Functions, EMR, Kinesis, and S3. Implement ETL/ELT workflows to extract data from multiple s...

Role: Sr AWS Data engineer - Data Migration Experience: 6+ years Location: Hyderabad Fission Labs , headquartered in Sunnyvale, with offices in Dallas & Hyderabad, Fission Labs is a leading software development company, specializing in crafting flexible, agile, and scalable solutions that propel businesses forward. With a comprehensive range of services, including product development, cloud engineering, big data analytics, QA, DevOps consulting, and AI/ML solutions, we empower clients to achieve sustainable digital transformation that aligns seamlessly with their business goals. Responsibilities Experience leading and driving large scale data migration projects Experience in working with all...

Role Proficiency: This role requires proficiency in data pipeline development including coding and testing data pipelines for ingesting wrangling transforming and joining data from various sources. Must be adept at using ETL tools such as Informatica Glue Databricks and DataProc with coding skills in Python PySpark and SQL. Works independently and demonstrates proficiency in at least one domain related to data with a solid understanding of SCD concepts and data warehousing principles. Outcomes: Collaborate closely with data analysts data scientists and other stakeholders to ensure data accessibility quality and security across various data sources.rnDesign develop and maintain data pipelines...