1333 Aws Glue Jobs - Page 34

As a Data Engineer, you will be responsible for designing, building, and maintaining data pipelines to ensure data quality and reliability. Your main tasks will include data cleansing, imputation, mapping to standard data models, transforming data to meet business rules and statistical computations, and validating data content. You will be developing, modifying, and maintaining Python and Unix scripts, as well as complex SQL queries. Performance tuning of existing code to enhance efficiency and avoid bottlenecks will be a key part of your role. Building end-to-end data flows from various sources to curated and enhanced datasets will be crucial. Additionally, you will develop automated Python...

You will be responsible for leading as a Cloud App Developer at Wipro Limited, a leading technology services and consulting company that specializes in creating innovative solutions for complex digital transformation needs. With a global presence spanning over 65 countries and a workforce of more than 230,000 employees and partners, we are committed to helping our clients, colleagues, and communities thrive in a dynamic world. As a Lead Cloud App Developer, you will need to possess expertise in Terraform, AWS, and DevOps. Additionally, you should hold certifications such as AWS Certified Solution Architect Associate and AWS Certified DevOps Engineer Professional. Your role will involve lever...

Role & responsibilities Responsibilities Design, Develop, and maintain reports and dashboards within Power BI and Salesforce in a timely manner based on the needs of the business. Build and maintain Power BI data models, including relationships, calculated columns, and measures. Automate data refresh schedules and ensure the reports are up-to-date with the latest information. Work with data sources such as SQL databases, Excel, SharePoint, and other external APIs to gather, transform, and load data for reporting. Work tickets assigned to you via Jira through our Analytics Sprint planning process. Providing visible progress and closed-loop communication through updates on the tickets. Work wi...

Face to face interview on 2nd august 2025 in Hyderabad Apply here - Job description - https://careers.ey.com/job-invite/1604461/ Experience Required: Minimum 8 years Job Summary: We are seeking a skilled Data Engineer with a strong background in data ingestion, processing, and storage. The ideal candidate will have experience working with various data sources and technologies, particularly in a cloud environment. You will be responsible for designing and implementing data pipelines, ensuring data quality, and optimizing data storage solutions. Key Responsibilities: Design, develop, and maintain scalable data pipelines for data ingestion and processing using Python, Spark, and AWS services. W...

You are a Data Engineer with 3+ years of experience, proficient in SQL and Python development. You will be responsible for designing, developing, and maintaining scalable data pipelines to support ETL processes using tools like Apache Airflow, AWS Glue, or similar. Your role involves optimizing and managing relational and NoSQL databases such as MySQL, PostgreSQL, MongoDB, or Cassandra for high performance and scalability. You will write advanced SQL queries, stored procedures, and functions to efficiently extract, transform, and analyze large datasets. Additionally, you will implement and manage data solutions on cloud platforms like AWS, Azure, or Google Cloud, utilizing services such as R...

As a Senior Staff Software Engineer in Data Lake House Engineering, you will play a crucial role in designing and implementing the Data Lake house platform, supporting both Data Engineering and Data Lake house applications. Your responsibilities will include overseeing Data Engineering pipeline productionalization, end-to-end data pipelines, model development, deployment, monitoring, refresh, etc. Additionally, you will be involved in driving technology development and architecture to ensure the platforms, systems, tools, models, and services meet the technical standards for security, quality, reliability, usability, scalability, performance, efficiency, and operability to meet the evolving ...

Tech stack- Database: Mongodb: S3 Postgres Strong experience on Data pipelines; mapping React; Node; Python Aws; Lambda About the job Summary We are seeking a detail-oriented and proactive Data Analyst to lead our file and data operations, with a primary focus on managing data intake from our clients and ensuring data integrity throughout the pipeline. This role is vital to our operational success and will work cross-functionally to support data ingestion, transformation, validation, and secure delivery. The ideal candidate must have hands-on experience with healthcare datasets, especially medical claims data, and be proficient in managing ETL processes and data operations at scale. Responsi...

Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose the relentless pursuit of a world that works better for people – we serve and transform leading enterprises, including the Fortune Global 500, with our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI. Inviting applications for the role of Lead Consultant-Data Engineer, AWS+Python, Spark, Kafka for ETL! Responsibilities Develop, deploy, and manage ETL...

We are looking for an experienced Senior Data Engineer to lead the development of scalable AWS-native data lake pipelines with a strong focus on time series forecasting and upsert-ready architectures. This role requires end-to-end ownership of the data lifecycle, from ingestion to partitioning, versioning, and BI delivery. The ideal candidate must be highly proficient in AWS data services, PySpark, versioned storage formats like Apache Hudi/Iceberg, and must understand the nuances of data quality and observability in large-scale analytics systems. Role & responsibilities Design and implement data lake zoning (Raw Clean Modeled) using Amazon S3, AWS Glue, and Athena. Ingest structured and uns...

You will be working as a software development partner for a very large enterprise financial products and services firm listed on NYSE. Your main responsibility will involve re-architecting and migrating 30-year legacy systems to cloud-based microservices on AWS. The application you will be working on is crucial for their trading, journal, and bookkeeping platforms. Your contributions at BeeHyv will include developing an event-driven ETL pipeline using AWS services to transfer end-of-day securities data from the mainframe to a relational database. You will also be building highly resilient and highly available containerized microservices to enhance the application's performance. Automation wi...

Thoucentric, the Consulting arm of Xoriant, a renowned digital engineering services company with 5000 employees, is looking for a skilled Integration Consultant with 5 to 6 years of experience to join their team. As a part of the Consulting business of Xoriant, you will be involved in Business Consulting, Program & Project Management, Digital Transformation, Product Management, Process & Technology Solutioning, and Execution across various functional areas such as Supply Chain, Finance & HR, Sales & Distribution in the US, UK, Singapore, and Australia. Your role will involve designing, building, and maintaining data pipelines and ETL workflows using tools like AWS Glue, CloudWatch, PySpark, ...

Seekify Global is looking for an experienced and driven Data Catalog Engineer to join the Data Engineering team. The ideal candidate should have a strong background in designing and implementing metadata and data catalog solutions specifically in AWS-centric data lake and data warehouse environments. As a Data Catalog Engineer, you will play a crucial role in improving data discoverability, governance, and lineage across the organization's data assets. Your key responsibilities will include leading the end-to-end implementation of a data cataloging solution within AWS, establishing and managing metadata frameworks for diverse data assets, integrating the data catalog with AWS-based storage s...

As an experienced ETL platform administrator, you will be responsible for managing Informatica Powercenter, Informatica Cloud (IICS), AWS Glue, and Snowflake Data Platforms. With over 4 years of experience in Informatica Platform Administration, you will bring a wealth of knowledge to the team. Your role will involve working with various databases such as DB2, Oracle, SqlServer, and others, leveraging your 4+ years of experience in handling multiple database systems effectively. Your expertise in ETL platform administration will be crucial in ensuring seamless data integration and management across different platforms and databases.,

As a Senior Analyst - Data Analytics, you will leverage your 3+ years of experience in Data Analytics and reporting to design and build interactive dashboards and reports using Power BI and Microsoft Fabric. Your strong technical expertise in Power BI, Microsoft Fabric, Snowflake, SQL, Python, and R will be instrumental in performing advanced data analysis and visualization to support business decision-making. You will utilize your experience with Azure Data Factory, Databricks, Synapse Analytics, and AWS Glue to develop and maintain data pipelines and queries using SQL and Python. Applying data science techniques such as predictive modeling, classification, clustering, and regression, you w...

Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose the relentless pursuit of a world that works better for people – we serve and transform leading enterprises, including the Fortune Global 500, with our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI. Inviting applications for the role of Lead Consultant-Data Engineer, AWS+Python, Spark, Kafka for ETL! Responsibilities Develop, deploy, and manage ETL...

Job Summary: We are looking for a talented Data Engineer cum Database Developer with a strong background in the banking sector. The ideal candidate will have experience with SQL Server, AWS PostgreSQL, AWS Glue, and ETL tools, along with expertise in data ingestion frameworks and Control-M scheduling Key Responsibilities: Design, develop, and maintain scalable data pipelines to support data ingestion and transformation processes. Collaborate with cross-functional teams to gather requirements and implement solutions tailored to banking applications. Utilize SQL Server and AWS PostgreSQL for database development, optimization, and management. Implement data ingestion frameworks to ensure effic...

As an Associate Software Developer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big ...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelo...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelor...

NTT DATA is looking for a Sr Information Security Engineer to be a part of their team based in Bangalore, Karnataka (IN-KA), India. As a Sr Information Security Engineer, you will bring your expertise and experience in IT Technology, AI / ML, data engineering, python coding, and enterprise-wide integration programs to contribute to our innovative and forward-thinking organization. **Required Skills:** - You should have at least 5 years of experience in IT Technology. - With a minimum of 2 years of experience in AI / ML, you should possess a strong working knowledge in neural networks. - Having 2+ years of data engineering experience, preferably using AWS Glue, Cribl, SignalFx, OpenTelemetry,...

As a Senior Digital Solutions Consultant at Worley, you will have the opportunity to work on the world's most complex projects and be a part of a collaborative and inclusive team. Your role will be varied and challenging, allowing you to contribute to innovative solutions that drive sustainability in projects. Worley, a global professional services company specializing in energy, chemicals, and resources, is at the forefront of bridging the transition to more sustainable energy sources. By partnering with customers, Worley delivers integrated data-centric solutions throughout the lifecycle of assets, from consulting and engineering to decommissioning and remediation. As part of your role, yo...

As a Dynatrace Developer/Consultant, you will be responsible for setting up and maintaining monitoring systems to track the health and performance of data pipelines. Your role will involve configuring alerts and notifications to promptly identify and respond to issues or anomalies in data pipelines. You will develop procedures and playbooks for incident response and resolution, collaborating with data engineers to optimize data flows and processing. Your experience in working with data, ETL, Data warehouse & BI Projects will be invaluable as you continuously monitor and analyze pipeline performance to identify bottlenecks and areas for improvement. Implementing logging mechanisms and error h...

Role Overview: We are looking for a skilled Data Engineer with hands-on expertise in Snowflake, Python, and AWS services to support end-to-end data migration and warehousing solutions. The ideal candidate will design, develop, and maintain scalable Snowflake data structures, implement efficient ETL pipelines using Python and AWS (S3, Lambda, Step Functions), and collaborate with cross-functional teams to deliver high-performance data solutions. Proficiency in Power BI for dashboarding and data visualization is essential. Experience in healthcare data is a plus. Key Responsibilities: • Design, develop, test, deploy, and maintain Snowflake tables/views/stored procedures/streams/tasks using Sno...

Job Title: Snowflake Developer Location: Hyderabad or Bangalore. ( Hybrid Working ) Experience: 5+ Years Responsibilities: Use data mappings and models provided by the data modeling team to build robust pipelines in Snowflake . Design and implement data pipelines with proper 2NF/3NF normalization standards. Develop and maintain ETL processes for integrating data from multiple ERP and source systems. Create scalable and secure data architecture in Snowflake that supports DQ needs. Raise CAB requests through Carriers change process and manage deployment to production. Provide UAT support and transition finalized pipelines to support teams. Document all technical artifacts for traceability and ...

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : AWS Redshift Good to have skills : PySparkMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. You will oversee the development process and ensure successful project delivery. Roles & Responsibilities:- Expected to be an SME- Collaborate and manage the team to perform- Responsible for team decisions- Engage with multiple teams ...