869 Aws Glue Jobs - Page 4

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : AWS Architecture, Python (Programming Language), AWS Lambda Administration, AWS Glue Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with team members to understand project needs, developin...

6+ years of experience in Data Engineering or related role. Hands-on experience with Snowflake (data modelling, performance tuning, query optimization, Snowpipe, Time Travel, Streams & Tasks). Strong expertise in AWS Glue for ETL job development, orchestration, and optimization. Proficiency with AWS services such as S3, Lambda, Redshift, Athena, Step Functions, Kinesis , and CloudWatch . Strong programming skills in Python and/or PySpark . Knowledge of SQL and experience with performance tuning for large datasets. Experience with data warehouse and data lake architectures. Familiarity with CI/CD pipelines and infrastructure-as-code tools (Terraform, CloudFormation). Preferred Qualifications:...

Job Duties: Design and implement AWS infrastructure to support ETL and database migration workloads. Set up and optimize AWS Glue, Amazon RDS (PostgreSQL), and related services. Ensure secure, scalable, and cost-effective architecture for data migration and processing. Collaborate with Data Engineers to ensure smooth integration between ETL tools and AWS infrastructure. Automate deployments using AWS CloudFormation/Terraform. Integrate AWS workloads with existing Unix systems. Implement monitoring, logging, and alerting solutions (CloudWatch, AWS Config). Minimum Skills Required: Proven experience with AWS (Glue, RDS PostgreSQL, S3, IAM, CloudFormation/Terraform). Strong Unix/Linux administr...

Exp: 10+ years Job Role : AWS Architect with Databricks Job Location: Noida / Mumbai / Pune / Bangalore / Gurgaon / Kochi (Hybrid Work) Role & responsibilities Design, build, and optimize ETL/ELT pipelines using Databricks (PySpark, Delta Lake) on AWS. Ingest and process structured, semi-structured, and unstructured data from multiple sources (RDBMS, APIs, streaming). Integrate AWS services such as S3, Glue, Lambda, Kinesis, Athena, Redshift with Databricks. Implement data quality checks, validation frameworks, and monitoring for production workloads. Optimize data storage, partitioning, and caching strategies for performance and cost efficiency. Collaborate with Data Architects and Analysts...

You are being sought after to take on the role of a Senior Data Engineer, where your primary responsibility will be leading the development of a scalable data ingestion framework. In this capacity, you will play a crucial role in ensuring high data quality and validation, as well as designing and implementing robust APIs for seamless data integration. Your expertise in building and managing big data pipelines using modern AWS-based technologies will be put to good use, making sure that quality and efficiency are at the forefront of data processing systems. Key Responsibilities: - **Data Ingestion Framework**: - Design & Development: You will architect, develop, and maintain an end-to-end dat...

Why Choose Decision Point At Decision Point , we empower data-driven transformation by delivering innovative, scalable, and future-ready analytics solutions. With a proven track record in the CPG, Retail, and Manufacturing industries, we combine deep domain expertise with cutting-edge technologies to enable smarter decisions at every level of the enterprise. By joining our team, youll be part of a collaborative culture that values creativity, learning, and continuous improvement. We offer opportunities to work on high-impact projects with global clients, and leverage the latest cloud and data engineering tools to solve real-world business challenges. Key Responsibilities Design, develop, and...

Mandatory Skills 5+ years of Advanced level of expertise in databases, SQL queries with Teradata or Oracle or SQL Server. 5+ years of expertise in ETL Testing Good knowledge of ETL Tools - Ab Initio Very good knowledge of Datawarehouse, ETL concepts, Unix commands, shell/bash script or any other script language like Python Good understanding of Testing fundamentals Development and implementation of comprehensive test plans and strategies to validate software functionality and ensure compliance with established quality standards Demonstrated expertise in SQL, test data Preparation, Defect identification Collaboration with cross-functional teams to analyze requirements, participate in design d...

Develop and maintain Python scripts to support the deployment and integration of GenAI models. Automate data ingestion, preprocessing, and model execution workflows using Python and other relevant tools. Build interfaces between GenAI models and existing systems or APIs. Monitor and optimize performance of deployed models and pipelines. Ensure robust logging, error handling, and system reliability. Stay updated with advancements in GenAI technologies and suggest improvements. Experience in Agile Development Process. Excellent communication skills, problem solving and debugging and troubleshooting Skills. Mandatory Competencies Data Science and Machine Learning - Data Science and Machine Lear...

Design and implement scalable data processing solutions usingApache SparkandJava. Develop and maintain high-performance backend services and APIs. Collaborate with data scientists, analysts, and other engineers to understand data requirements. Optimize Spark jobs for performance and cost-efficiency. Ensure code quality through unit testing, integration testing, and code reviews. Work with large-scale datasets in distributed environments (e.g., Hadoop, AWS EMR, Databricks). Monitor and troubleshoot production systems and pipelines. Experience in Agile Development Process. Excellent communication skills, problem solving and debugging and troubleshooting Skills. Mandatory Competencies Architect...

AWS data developers with 8-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferred Skills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shift Good communication skills and can deliver independently Mandatory Competencies Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift Beh - Communication Big Data - Big Data - Pyspark Database - Database Programming - SQL Programming Language - Python - Apache Airflow

AWS data developers with 6-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferred Skills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shift Good communication skills and can deliver independently Mandatory Competencies Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift Big Data - Big Data - Pyspark Beh - Communication Database - Database Programming - SQL

EPAM has presence across 40+ countries globally with 55,000 + professionals & numerous delivery centers, Key locations are North America, Eastern Europe, Central Europe, Western Europe, APAC, Mid East & Development Centers in India (Hyderabad, Pune & Bangalore). Exp: 10-14 years Location: Bengaluru Work Mode: Hybrid (2-3 days office in a week) Job Description: 10-14 Years of in Big Data & Data related technology experience Expert level understanding of distributed computing principles Expert level knowledge and experience in Apache Spark Hands on programming with Python Experience with building stream-processing systems, using technologies such as Apache Storm or Spark-Streaming Experience w...

SUMMARY Key Responsibilities: Design and execute ETL test plans and cases, including automated scripts. Validate data transformations and loading processes, utilizing automation where possible. Identify and document data discrepancies and errors, automating error detection. Perform data quality profiling and analysis, employing automated data quality checks. Write and execute SQL queries for data validation, and automate data validation processes. Test database stored procedures and functions, creating automated test suites. Document test results and create detailed reports, automating report generation. Track and manage defects using bug tracking tools, and automate defect reporting. Collab...

Senior Data Engineer: Design, build, & optimize data platforms on AWS. Expertise in Python, Scala, SQL, Redshift, Terraform, Docker, & Jenkins. Skills include Glue, Lambda, Apache Airflow, Spark, & Databricks. Join our Hyderabad team.

We are seeking a detail-oriented Data Analyst who will ensure that organizational data is accurately transformed, validated, and prepared for downstream consumption.

Responsibilties: AWS Cloud Dev Engineer having experience working on Dev platform Design and build scalable data pipelines using AWS services like AWS Glue, Amazon Redshift, and S3. CDK scripting/hands on dev exp. with services like Fargate, Redshift, Glue, Airflow, Athena etc.,/Angular/Node.js/SQL/Stored Proc/Python Develop efficient ETL processes for data extraction, transformation, and loading into data warehouses and lakes. Create and manage applications using Python, SQL, Databricks, and various AWS technologies. Automate repetitive tasks and build reusable frameworks to improve efficiency. Skill Proficiency Level expected AWS Cloud Data Engineer - AWS Glue, Amazon Redshift, S3 ETL Proc...

5-10 years of experience in database development or a related field. Proven experience with database design, development, and management. Experience working with large-scale databases and complex data environments Experience with data modelling and database design. Knowledge of database performance tuning and optimization. Architect, Develop and maintain tables, views, procedures, functions and packages in Database MUST HAVE Performing complex relational databases queries using SQL (AWS RDS for PostgreSQL) and Oracle PLSQL MUST HAVE Familiarity with ETL processes and tools (AWS Batch, AWS Glue etc) MUST HAVE Familiarity with CI/CD Pipelines, Jenkins Deployment, Git Repository MUST HAVE Perfo...

Why Join Decision Point? Work with a top-tier analytics consulting firm known for data-driven innovation. Get exposure to Fortune 500 clients and real-world impact projects. Be part of a collaborative culture that encourages leadership and learning. Solve complex business problems using cutting-edge tech across domains Key Responsibilities Lead and deliver end-to-end data engineering projects in a fast-paced environment Design and implement scalable data pipelines using PySpark , SQL , and orchestration tools Develop robust data models to support analytics and reporting Optimize data storage and processing on AWS (Glue, S3, Redshift, Lambda) and Azure (ADF, Synapse, Blob Storage) Collaborate...

As an AWS Senior Developer at PwC Advisory Acceleration Center, your role involves interacting with Offshore Manager/ Onsite Business Analyst to understand requirements and taking responsibility for end-to-end implementation of Cloud data engineering solutions like Enterprise Data Lake and Data hub in AWS. Your strong experience in AWS cloud technology, planning, organization skills, and ability to work as a cloud developer/lead on an agile team to provide automated cloud solutions will be crucial for success. **Key Responsibilities:** - Architect and deliver highly scalable, distributed, cloud-based enterprise data solutions - Implement Cloud data engineering solutions like Enterprise Data ...

You have an exciting opportunity as a Software Engineer III at JPMorgan Chase within the Consumer and Community Banking - Consumer Card Technology. You will be a key member of an agile team, designing and delivering innovative technology products. This role offers the chance to work on critical technology solutions that support the firm's business objectives in a secure, stable, and scalable manner. **Key Responsibilities:** - Executes software solutions, design, development, and technical troubleshooting with the ability to think beyond routine approaches - Creates secure and high-quality production code and maintains algorithms - Produces architecture and design artifacts for complex appli...

As a member of the Analytics and Insights Managed Services team, you will play a crucial role in leveraging industry expertise, technology, data management, and managed services experience to drive sustained outcomes for our clients and enhance business performance. Your responsibilities will involve empowering companies to revamp their analytics and insights approach, optimize processes for efficiency, and enhance client satisfaction. A deep understanding of IT services, operational excellence, and client-centric solutions will be key to excelling in this role. **Key Responsibilities:** - Serve as the primary point of contact for client interactions, nurturing strong relationships. - Manage...

Key Responsibilities Lead and mentor a team of data engineers, providing technical guidance, performance feedback, and career development. Architect, develop, and maintain scalable ETL/ELT pipelines using AWS services , PySpark , SQL , and Python . Drive the design and implementation of robust data models and data warehouses/lakes to support analytics and reporting. Ensure data quality, security, and governance across all stages of the data lifecycle. Collaborate with product and engineering teams to integrate data solutions into production environments. Optimize data workflows and performance across large, complex datasets. Manage stakeholder relationships and translate business needs into ...

Who We Are At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities. The Role Are you ready to dive headfirst into the captivating world of data engineering at Kyndryl? As a Data Engineer, you'll be the visionary behind our data platforms, crafting them into powerful tools for decision-makers. Your role? Ensuring a treasure trove of pristine, harmonized data is at everyone's fingertips. As a Data Engineer at Kyndryl, you...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : AWS BigData Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project milestones are met, addressing any challenges that arise, and providing guidance to team members to foster a productive work environment. You...

Job Purpose The Property Data Engineer is responsible for developing and maintaining data conversion programs that transform raw property assessment data into standardized formats based on specifications by Property Data Analyst and Senior Analysts. This role requires not only advanced programming and ETL skills but also a deep understanding of the structure, nuances, and business context of assessment data. Even with clear and well-documented conversion instructions, engineers without prior exposure to this domain often face significant challenges in interpreting and transforming the data accurately. Data Engineer plays a critical role in ensuring the accuracy, efficiency and scalability of...