1330 Aws Glue Jobs - Page 12

Job Description We are seeking a talented and motivated ML Engineer to join our founding team in India. This role is central to building AI solutions on the Axyo platform that solve high-value problems for enterprise clients. As an early member of our India team, you will work closely with the VP of Data Science, Data Engineers, and Product Managers to design, train, and deploy machine learning models that power Axyo AI Apps. Responsibilities Applied Machine Learning & Modeling Design, train, and evaluate predictive, classifi cation, forecasting, and optimization models. Build and experiment with ML pipelines across traditional statistical methods and modern ML/deep learning approaches. Appl...

Job Description We are seeking a talented and motivated ML Engineer to join our founding team in India. This role is central to building AI solutions on the Axyo platform that solve high-value problems for enterprise clients. As an early member of our India team, you will work closely with the VP of Data Science, Data Engineers, and Product Managers to design, train, and deploy machine learning models that power Axyo AI Apps. Responsibilities Applied Machine Learning & Modeling Design, train, and evaluate predictive, classifi cation, forecasting, and optimization models. Build and experiment with ML pipelines across traditional statistical methods and modern ML/deep learning approaches. Appl...

Develop, test, and maintain ETL pipelines from TMS source systems to canonical layers. Implement data transformation, cleansing, and validation logic. Support QA by fixing data defects and ensuring completeness of load. Mandatory Competencies ETL - ETL - Tester Beh - Communication ETL - ETL - AWS Glue Data Science and Machine Learning - Data Science and Machine Learning - Databricks

We are currently looking for an experienced Lead Data Engineer with demonstrated technical experience within pySpark, Phyton, and Java technologies to join the team in India, within our global Technology department. If this sounds interesting to you and you are skilled in Query engines Postgres/SQL/AWS/Java/Kotlin, we would love to speak with you. About You experience, education, skills, and accomplishments: Bachelor/master's degree in computer science, computer engineering, information technology, or relevant field At least 8+ years experience in working in software development At least 8+ years experience in building massively scalable distributed data processing solutions At least 6+ year...

We are currently looking for an experienced Lead Data Engineer with demonstrated technical experience within pySpark, Phyton, and Java technologies to join the team in India, within our global Technology department. If this sounds interesting to you and you are skilled in Query engines Postgres/SQL/AWS/Java/Kotlin, we would love to speak with you. About You experience, education, skills, and accomplishments: At least 6+ years experience in working in software development At least 6+ years experience in building massively scalable distributed data processing solutions At least 6+ years experience of database design & development. Alt least 4 years of experience in Apache Spark, ElasticSearch ...

We are seeking a highly skilled Senior Lead Data Engineer to join our R&D Data Engineering Team. In this role, you will be a key player in shaping the architecture and technical direction of our data platform, ensuring that it meets the evolving needs of the business while adhering to best practices and industry standards. If you're looking for an opportunity to combine your technical skills with strategic thinking and make a real difference, we want to hear from you. About You experience, education, skills, and accomplishments: Bachelors Degree or equivalent At least 7 years of Relevant Experience At least 5+ Years in Software Development: Demonstrated experience in software development, wi...

Key Responsibilities Technical Leadership & Project Execution Provide technical thought leadership, compare different technologies to meet business requirements and cost control drivers. Work with Business and IT groups to design and deliver a data lake platform. Produce & maintain the overall solution design for the entire Data Lake Platform. Execution of data strategy, help in the design and architecture of solutions on the platform Enforce technical best practices for Big Data management and solutions, from software selection to technical architectures and implementation processes. Document and publish best practices, guidelines, and training information. Ensures all functional solutions ...

We are looking for a Manager Software Engineering to join our IMS Team in Bangalore . This is an amazing opportunity to work on Big Data technologies involved in content ingestion. The team consists of 10-12 engineers and is reporting to the Sr Manager. We have a great skill set in Spark, Java, Scala, Hive, Sql, XSLT, AWS EMR, S3, etc and we would love to speak with you if you have skills in the same. About You experience, education, skills, and accomplishments: Work Experience: Minimum 7 years experience in Big Data projects involved in content ingestion, curation, transformation Technical Skill: Databricks, Spark, Python/Java , Scala, AWS EMR, S3, SQS, Hive, XSLT, Education (bachelors degr...

Walk-In Drive Data Engineer (2-5 Years, Azure & AWS) Date & Time: 10th October | 11:00 AM 3:00 PM Venue: The Hive, 24/7, 10th Floor, Prestige Tech Platina 2, Kadubeesanahalli, Marathahalli Outer Ring Road, Bangalore 560087 Location Map: [Insert Link] About the Role We are hiring skilled Data Engineers with 24 years of experience in designing, building, and maintaining scalable data pipelines and architectures using Azure and AWS cloud platforms. Key Responsibilities Design, develop, and optimize scalable ETL/ELT workflows using Azure Data Factory, AWS Glue , or similar tools. Build and maintain data integration solutions between on-premises and cloud systems. Work with data storage and wareh...

We are seeking a Data Engineer with strong expertise in Data Engineeringincluding data modeling, ETL pipeline development, data governance, and Data Build Tool (DBT)—along with proficiency in Python, PySpark, and AWS services such as Glue, Redshift, Lambda, and DynamoDB. Candidates should also have in-depth knowledge of MySQL, including core and advanced concepts. JD: Proficiency with Python and SQL for data processing (spark is a bonus) Working experience with AWS storage and database/data warehouse services - s3, Redshift, RDS, DynamoDB etc. Hands on experience with AWS compute services such as EC2, ECR, Lambda (layers/triggers) etc. Ensure proper logging, error handling, and performance m...

Bachelors Degree preferably in Computer Science, Engineering, Management Information Systems, or equivalent work experience. 4 years of full stack software development with an emphasis on architecting, designing, implementing, testing and delivering highly scalable web and client/server solutions. 4+ years of experience in Data Engineering development Strong experience with: AWS Glue - Python, Big Data – Pyspark, Control-M – ETL Batch job implementation stack AWS Aurora, Dynamo, S3 – Data Storage AWS IAM, Cloud formation, Bamboo – Infra as code and CI/CD Lambda, Step function – Orchestration

As a Senior Data Engineer, your role involves building and maintaining automated data pipelines to ensure smooth data flow. You will also be responsible for ensuring data integrity, validation, and transformation for accurate analysis. Working efficiently with large datasets and maintaining data quality standards will be crucial. Additionally, collaborating effectively with cross-functional teams to meet project requirements is an essential part of your responsibilities. Qualifications Required: - Strong hands-on experience in SQL (Postgres/Other RDBMS), Python for data processing, Apache Spark, and cloud-based ETL tools such as AWS Glue, Lambda, Step Functions, Azure Data Factory, or Databr...

You will be responsible for working on small/medium-scale technology solution delivery engagements, with a focus on ETL interfacing technologies such as Informatica, Talend, SSIS, data warehousing, SQL, and exposure to Cloud Platforms like AWS Glue, Azure, GCP. Additionally, you will be leading a team in this role. - Work on small/medium-scale technology solution delivery engagements - Utilize ETL interfacing technologies like Informatica, Talend, SSIS - Handle data warehousing tasks and SQL queries - Gain exposure to Cloud Platforms such as AWS Glue, Azure, GCP - Lead and manage a team effectively Qualifications Required: - Bachelor's degree in Computer Science, IT, or related field - 4+ ye...

You are a hands-on Senior Data Engineer experienced in migrating and building large-scale data pipelines on Databricks using Azure or AWS platforms. Your focus will be on implementing batch and streaming pipelines, applying the bronze-silver-gold data lakehouse model, and ensuring scalable and reliable data solutions. - Design, develop, and operationalize scalable data pipelines on Databricks following medallion architecture principles. - Migrate and transform large data volumes from traditional on-prem systems (Oracle, Hadoop, Exadata) into cloud data platforms. - Develop efficient Spark (PySpark/Scala) jobs for ingestion, transformation, aggregation, and publishing of data. - Implement dat...

As an Integration Developer at Worley, you will play a crucial role in developing and maintaining data pipelines for ingesting and collecting data from various sources into a centralized data platform. Your responsibilities will include optimizing and troubleshooting AWS Glue jobs, utilizing Python and PySpark for data handling, collaborating with data architects on designing data models, and creating ETL processes using tools like Airflow, Python, and PySpark. Additionally, you will be involved in implementing monitoring solutions, managing databases, and working with Infrastructure as Code tools like Terraform and AWS CDK. Key Responsibilities: - Develop and implement data pipelines for co...

Job Duties: At least 6+ years of relevant experience in design, development, complete end-end design of enterprise-wide big data solution. Experience in designing & developing a big data solution using Spark, Scala, AWS Glue, Lambda, SNS/SQS, Cloudwatch is a must. Strong Application development experience in Scala/Python. Strong Database SQL experience, preferably Redshift. Experience in Snowflake is an added advantage. Experience with ETL/ELT process and frameworks is a must. Create integration and application technical design documentation. Conduct peer-reviews of functional design documentation. Complete development, configuration, test cases and unit testing Perform code reviews and ensu...

6+ years of experience in Data Engineering or related role. Hands-on experience with Snowflake (data modelling, performance tuning, query optimization, Snowpipe, Time Travel, Streams & Tasks). Strong expertise in AWS Glue for ETL job development, orchestration, and optimization. Proficiency with AWS services such as S3, Lambda, Redshift, Athena, Step Functions, Kinesis, and CloudWatch. Strong programming skills in Python and/or PySpark. Knowledge of SQL and experience with performance tuning for large datasets. Experience with data warehouse and data lake architectures. Familiarity with CI/CD pipelines and infrastructure-as-code tools (Terraform, CloudFormation). Preferred Qualifications: AW...

Job description: Expert knowledge in AWS Data Lake implementation and support (S3, Glue,DMS Athena, Lambda, API Gateway, Redshift) Handling of data related activities such as data parsing, cleansing quality definition data pipelines, storage and ETL scripts Experiences in programming language Python/Pyspark/SQL Experience with data migration with hands-on experience Experiences in consuming rest API using various authentication options with in AWS Lambda architecture orchestrate triggers, debug and schedule batch job using a AWS Glue, Lambda and step functions understanding of AWS security features such as IAM roles and policies Exposure to Devops tools AWS certification in AWS is highly pre...

5-10 years of experience in database development or a related field. Proven experience with database design, development, and management. Experience working with large-scale databases and complex data environments Experience with data modelling and database design. Knowledge of database performance tuning and optimization. Architect, Develop and maintain tables, views, procedures, functions and packages in Database MUST HAVE Performing complex relational databases queries using SQL (AWS RDS for PostgreSQL) and Oracle PLSQL MUST HAVE Familiarity with ETL processes and tools (AWS Batch, AWS Glue etc) MUST HAVE Familiarity with CI/CD Pipelines, Jenkins Deployment, Git Repository MUST HAVE Perfo...

Job Description Job Title: Vanguard AWS Glue Developer Location: Pune Experience: 6 - 11 Years Employment Type: Contract Work Mode: Onsite About the Role: We are seeking an experienced AWS Glue Developer with strong expertise in building scalable ETL pipelines and data integration solutions on AWS cloud platform. The ideal candidate will have hands-on experience with Vanguard applications and AWS Glue ecosystem, capable of designing, developing, and optimizing large-scale data workflows. Key Responsibilities: Design, develop, and maintain ETL pipelines using AWS Glue for data ingestion, transformation, and loading Build and optimize Glue jobs using Python/PySpark for processing large-scale d...

Key Responsibilities: Design, build, and maintain scalable ETL pipelines using AWS Glue , PySpark , and SQL . Develop and optimize data models for Snowflake and other cloud data warehouses. Ensure efficient data integration from multiple structured and unstructured sources. Work closely with data architects and analysts to define data requirements and best practices. Implement data quality, validation, and performance tuning processes. Monitor and troubleshoot ETL workflows and ensure high data reliability. Mentor junior engineers and review code for best practices and scalability. Required Skills & Qualifications: 7+ Years of experience is must with at-least 2+ years as lead. Strong hands-o...

,. Job Description: We are looking for an experienced Data Engineer with strong expertise in data pipeline development, cloud-based data processing, and analytics solutions. The ideal candidate should have hands-on experience working with AWS data services and be proficient in programming and data integration tools. Key Responsibilities: Design, develop, and maintain robust, scalable, and efficient data pipelines and ETL workflows. Work with large and complex datasets using Python and SQL for data transformation and analysis. Develop distributed data processing solutions using Spark (Scala or PySpark) Spark Scala preferred . Implement and manage AWS data services including S3, Lambda, Glue C...

Communication, problem-solving Responsibilities: * Collaborate with cross-functional teams on pipeline design & governance * Design, develop & maintain AWS data pipelines using GLUE, Redshift, Lambda & Python Provident fund

As a Data Engineer at Zupee, you will play a crucial role in developing the next generation of the Data platform. Your collaboration across various functions like product, marketing, design, innovation/growth, strategy/scale, customer experience, data science & analytics, and technology will be essential for the success of the platform. **Core Responsibilities:** - Understand, implement, and automate ETL and data pipelines with up-to-date industry standards. - Hands-on involvement in the design, development, and implementation of optimal and scalable AWS services. **Qualifications and Skills:** - 2-4 years of professional experience in a data engineering profile. - BS or MS in Computer Scien...

Role & responsibilities Sr. Data Engineer AWS, Python, Spark/Snow park, SQL