1333 Aws Glue Jobs - Page 23

EPAM has presence across 40+ countries globally with 55,000 + professionals & numerous delivery centers, Key locations are North America, Eastern Europe, Central Europe, Western Europe, APAC, Mid East & Development Centers in India (Hyderabad, Pune & Bangalore). Exp: 10-14 years Location: Bengaluru Work Mode: Hybrid (2-3 days office in a week) Job Description: 10-14 Years of in Big Data & Data related technology experience Expert level understanding of distributed computing principles Expert level knowledge and experience in Apache Spark Hands on programming with Python Experience with building stream-processing systems, using technologies such as Apache Storm or Spark-Streaming Experience w...

SUMMARY Key Responsibilities: Design and execute ETL test plans and cases, including automated scripts. Validate data transformations and loading processes, utilizing automation where possible. Identify and document data discrepancies and errors, automating error detection. Perform data quality profiling and analysis, employing automated data quality checks. Write and execute SQL queries for data validation, and automate data validation processes. Test database stored procedures and functions, creating automated test suites. Document test results and create detailed reports, automating report generation. Track and manage defects using bug tracking tools, and automate defect reporting. Collab...

Senior Data Engineer: Design, build, & optimize data platforms on AWS. Expertise in Python, Scala, SQL, Redshift, Terraform, Docker, & Jenkins. Skills include Glue, Lambda, Apache Airflow, Spark, & Databricks. Join our Hyderabad team.

We are seeking a detail-oriented Data Analyst who will ensure that organizational data is accurately transformed, validated, and prepared for downstream consumption.

Responsibilties: AWS Cloud Dev Engineer having experience working on Dev platform Design and build scalable data pipelines using AWS services like AWS Glue, Amazon Redshift, and S3. CDK scripting/hands on dev exp. with services like Fargate, Redshift, Glue, Airflow, Athena etc.,/Angular/Node.js/SQL/Stored Proc/Python Develop efficient ETL processes for data extraction, transformation, and loading into data warehouses and lakes. Create and manage applications using Python, SQL, Databricks, and various AWS technologies. Automate repetitive tasks and build reusable frameworks to improve efficiency. Skill Proficiency Level expected AWS Cloud Data Engineer - AWS Glue, Amazon Redshift, S3 ETL Proc...

5-10 years of experience in database development or a related field. Proven experience with database design, development, and management. Experience working with large-scale databases and complex data environments Experience with data modelling and database design. Knowledge of database performance tuning and optimization. Architect, Develop and maintain tables, views, procedures, functions and packages in Database MUST HAVE Performing complex relational databases queries using SQL (AWS RDS for PostgreSQL) and Oracle PLSQL MUST HAVE Familiarity with ETL processes and tools (AWS Batch, AWS Glue etc) MUST HAVE Familiarity with CI/CD Pipelines, Jenkins Deployment, Git Repository MUST HAVE Perfo...

Why Join Decision Point? Work with a top-tier analytics consulting firm known for data-driven innovation. Get exposure to Fortune 500 clients and real-world impact projects. Be part of a collaborative culture that encourages leadership and learning. Solve complex business problems using cutting-edge tech across domains Key Responsibilities Lead and deliver end-to-end data engineering projects in a fast-paced environment Design and implement scalable data pipelines using PySpark , SQL , and orchestration tools Develop robust data models to support analytics and reporting Optimize data storage and processing on AWS (Glue, S3, Redshift, Lambda) and Azure (ADF, Synapse, Blob Storage) Collaborate...

As an AWS Senior Developer at PwC Advisory Acceleration Center, your role involves interacting with Offshore Manager/ Onsite Business Analyst to understand requirements and taking responsibility for end-to-end implementation of Cloud data engineering solutions like Enterprise Data Lake and Data hub in AWS. Your strong experience in AWS cloud technology, planning, organization skills, and ability to work as a cloud developer/lead on an agile team to provide automated cloud solutions will be crucial for success. **Key Responsibilities:** - Architect and deliver highly scalable, distributed, cloud-based enterprise data solutions - Implement Cloud data engineering solutions like Enterprise Data ...

You have an exciting opportunity as a Software Engineer III at JPMorgan Chase within the Consumer and Community Banking - Consumer Card Technology. You will be a key member of an agile team, designing and delivering innovative technology products. This role offers the chance to work on critical technology solutions that support the firm's business objectives in a secure, stable, and scalable manner. **Key Responsibilities:** - Executes software solutions, design, development, and technical troubleshooting with the ability to think beyond routine approaches - Creates secure and high-quality production code and maintains algorithms - Produces architecture and design artifacts for complex appli...

As a member of the Analytics and Insights Managed Services team, you will play a crucial role in leveraging industry expertise, technology, data management, and managed services experience to drive sustained outcomes for our clients and enhance business performance. Your responsibilities will involve empowering companies to revamp their analytics and insights approach, optimize processes for efficiency, and enhance client satisfaction. A deep understanding of IT services, operational excellence, and client-centric solutions will be key to excelling in this role. **Key Responsibilities:** - Serve as the primary point of contact for client interactions, nurturing strong relationships. - Manage...

Key Responsibilities Lead and mentor a team of data engineers, providing technical guidance, performance feedback, and career development. Architect, develop, and maintain scalable ETL/ELT pipelines using AWS services , PySpark , SQL , and Python . Drive the design and implementation of robust data models and data warehouses/lakes to support analytics and reporting. Ensure data quality, security, and governance across all stages of the data lifecycle. Collaborate with product and engineering teams to integrate data solutions into production environments. Optimize data workflows and performance across large, complex datasets. Manage stakeholder relationships and translate business needs into ...

Who We Are At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities. The Role Are you ready to dive headfirst into the captivating world of data engineering at Kyndryl? As a Data Engineer, you'll be the visionary behind our data platforms, crafting them into powerful tools for decision-makers. Your role? Ensuring a treasure trove of pristine, harmonized data is at everyone's fingertips. As a Data Engineer at Kyndryl, you...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : AWS BigData Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project milestones are met, addressing any challenges that arise, and providing guidance to team members to foster a productive work environment. You...

Job Purpose The Property Data Engineer is responsible for developing and maintaining data conversion programs that transform raw property assessment data into standardized formats based on specifications by Property Data Analyst and Senior Analysts. This role requires not only advanced programming and ETL skills but also a deep understanding of the structure, nuances, and business context of assessment data. Even with clear and well-documented conversion instructions, engineers without prior exposure to this domain often face significant challenges in interpreting and transforming the data accurately. Data Engineer plays a critical role in ensuring the accuracy, efficiency and scalability of...

Roles and Responsibilities Design, develop, and maintain large-scale data pipelines using Amazon Redshift, EMR, and AWS Glue. Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions on time. Develop complex SQL queries to optimize database performance and troubleshoot issues. Implement data security measures to ensure compliance with company policies. Participate in code reviews to improve overall quality of the software. Desired Candidate Profile 5-10 years of experience as a Data Engineer with expertise in Amazon Redshift, EMR, and AWS Glue. Strong understanding of Lambda functions and their integration with other AWS services. Proficiency in writi...

POSITION DESCRIPTION POSITION TITLE: Data Engineer LOCATION: Noida- India TOTAL YEARS: 5-7 years PERSON SPECIFICATION: Summary: Looking for a Data Engineer with 57 years of experience in designing and implementing scalable data pipelines and solutions on AWS. Must be proficient in AWS Glue, PySpark, Spark SQL, S3, and RDS, with expertise in database design, ETL development, and data integration. Hands-on experience in Master Data Management, Data Quality frameworks, and governance practices is essential, along with the ability to optimize performance and ensure data reliability at scale. Technical Skillset – Data Engineer (5–7 Years of Experience) PySpark & Spark SQL: Hands-on experience in ...

As the Lead SAP Datasphere implementations, you will be responsible for overseeing various aspects including data modeling, ETL, integration, and performance optimization. Your role will involve developing and maintaining SAC stories, dashboards, and planning models with advanced formulas & allocations. You will also be expected to handle What-If planning & scenario modeling, predictive forecasting & planning cycles, and the migration and integration of SAP BPC models into Datasphere and SAC. In addition to the above, you will provide support for monthly financial close, budgeting, and forecasting activities. You will be the point of contact for production support, troubleshooting, and deplo...

As a Principal Data Engineer at FTSE Russell, you will play a crucial role in leading the development of foundational components for a lakehouse architecture on AWS. Your primary responsibility will involve driving the migration of existing data processing workflows to the new lakehouse solution. Collaboration across the Data Engineering organization is essential as you design and implement scalable data infrastructure and processes using cutting-edge technologies such as Python, PySpark, EMR Serverless, Iceberg, Glue, and Glue Data Catalog. Success in this role hinges on your deep technical expertise, exceptional problem-solving skills, and your ability to lead and mentor within an agile te...

You are a highly skilled Data Engineering Lead with expertise in AWS and Snowflake. Your role involves designing and delivering scalable data engineering solutions, particularly within the telecommunications industry. Your deep knowledge of end-to-end data architectures, layered data processing frameworks, and optimized data pipelines will be crucial in this position. Your responsibilities include designing, developing, and maintaining scalable data architectures and pipelines for large-scale data platforms. You will be tasked with building and optimizing Data Lakes to consolidate structured and unstructured data sources. Implementing real-time and batch data processing using Snowflake featu...

Job Title: Techno-Functional Consultant / Data Modeler BI Location: Titan Corporate limited Experience: 4+ years Job Description We are looking for a Techno-Functional Consultant / Data Modeler BI to design and build scalable data models, manage enterprise-wide data layers, and deliver high-performance Data Marts. The role involves working with large-scale business data, cross-functional teams, and modern BI/ETL tools to enable data-driven decision-making across Titan businesses. Key Responsibilities Architect layered data models (LSA / Medallion) ensuring scalability, quality & performance. Design, optimize, and maintain data dictionaries, glossaries, and ERDs. Translate business requiremen...

Roles and responsibilities Design AWS architectures based on business requirements. Create architectural diagrams and documentation. Present cloud solutions to stakeholders. Skills and Qualifications: Strong knowledge of AWS services: EC2, S3, RDS, Lambda, IAM, VPC, CloudFormation, CloudWatch, etc. Experience with serverless architectures (AWS Lambda, API Gateway, Step Functions). Experience of AWS networking (VPC, Route 53, ELB, Security Groups, etc.). Experience with AWS CloudFormation for automating infrastructure. Proficiency in scripting languages such as Python or Bash. Experience with automation tools (AWS Systems Manager, AWS Lambda) Experience of containerization (Docker, Kubernetes...

Role & responsibilities AWS AWS Glue or Databricks Python Pyspark

Educational Requirements Bachelor of Engineering Service Line Data & Analytics Unit Responsibilities A day in the life of an Infoscion As part of the Infosys delivery team, your primary role would be to interface with the client for quality assurance, issue resolution and ensuring high customer satisfaction. You will understand requirements, create and review designs, validate the architecture and ensure high levels of service offerings to clients in the technology domain. You will participate in project estimation, provide inputs for solution delivery, conduct technical risk planning, perform code reviews and unit test plan reviews. You will lead and guide your teams towards developing opti...

Urgent Hiring: AWS Data Engineer, Senior Data Engineers & Lead Data Engineers Apply Now: Send your resume to heena.ruchwani@gspann.com Location: Bangalore (5+ Years Experience) Company: GSPANN Technologies, Inc. GSPANN Technologies is seeking talented professionals with 5+ years of experience to join our team in Bangalore. We are looking for immediate joiners who are passionate about data engineering and eager to take on exciting challenges. Key Skills & Experience: 5+ years of hands-on experience with AWS Data Services (Glue, Redshift, S3, Lambda, EMR, Athena, etc.) Strong expertise in Big Data Technologies (Spark, Hadoop, Kafka) Proficiency in SQL, Python, and Scala Hands-on experience wit...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...