1333 Aws Glue Jobs - Page 25

As a Data Engineer, you will be responsible for designing, developing, and optimizing data pipelines and ETL workflows using AWS Glue, AWS Lambda, and Apache Spark. Your role will involve implementing big data processing solutions utilizing AWS EMR and AWS Redshift. You will also be tasked with developing and maintaining data lakes and data warehouses on AWS, including S3, Redshift, and RDS. Ensuring data quality, integrity, and governance will be a key aspect of your responsibilities, which will be achieved through leveraging AWS Glue Data Catalog and AWS Lake Formation. It will be essential for you to optimize data storage and processing for both performance and cost efficiency. Working wi...

Data Architecture Design: Develop and maintain a comprehensive data architecture strategy that aligns with the business objectives and technology landscape. Data Modeling: Create and manage logical, physical, and conceptual data models to support various business applications and analytics. Database Design: Design and implement database solutions, including data warehouses, data lakes, and operational databases. Data Integration: Oversee the integration of data from disparate sources into unified, accessible systems using ETL/ELT processes. Data Governance: Implement and enforce data governance policies and procedures to ensure data quality, consistency, and security. Technology Evaluation: ...

Overall Responsibilities Design, develop, and maintain scalable data pipelines and architectures to support analytical and operational needs Implement data integration solutions, ensuring high data quality, security, and compliance standards Collaborate with data scientists, analysts, and engineering teams to translate business requirements into technical solutions Optimize data workflows for performance, reliability, and cost-efficiency in cloud environments Develop and enforce best practices for data governance, security, and privacy Lead efforts in automating data processes and providing documentation for data systems Monitor data system performance, troubleshoot issues, and implement imp...

BMC is looking for a Product Owner to join our amazing team! The BMC AMI Cloud Analytics product can quickly transfer, transform, and integrate mainframe data so it could be shared with the organizational data lake to be used by artificial intelligence, machine learning (AI/ML) and analytics solutions. In this role, you will lead the transformation of this cutting-edge product originally developed by Model9, a startup acquired by BMC, into a solution designed to meet the rigorous demands of enterprise customers. This exciting opportunity combines innovation, scalability, and leadership, giving you a chance to shape the products evolution as it reaches new heights in enterprise markets. Youll...

We are looking for a Manager Software Engineering to join our IMS Team in Bangalore . This is an amazing opportunity to work on Big Data technologies involved in content ingestion. The team consists of 10-12 engineers and is reporting to the Sr Manager. We have a great skill set in Spark, Java, Scala, Hive, Sql, XSLT, AWS EMR, S3, etc and we would love to speak with you if you have skills in the same. About You experience, education, skills, and accomplishments: Work Experience: Minimum 7 years experience in Big Data projects involved in content ingestion, curation, transformation Technical Skill: Databricks, Spark, Python/Java , Scala, AWS EMR, S3, SQS, Hive, XSLT, Education (bachelors degr...

We are seeking a highly skilled Senior Lead Data Engineer to join our R&D Data Engineering Team. In this role, you will be a key player in shaping the architecture and technical direction of our data platform, ensuring that it meets the evolving needs of the business while adhering to best practices and industry standards. If you're looking for an opportunity to combine your technical skills with strategic thinking and make a real difference, we want to hear from you. About You experience, education, skills, and accomplishments: Bachelors Degree or equivalent At least 7 years of Relevant Experience At least 5+ Years in Software Development: Demonstrated experience in software development, wi...

Position Description: AWS Data Engineer Job Description: We are seeking a skilled and motivated AWS Data Engineer with hands-on experience in building and managing data pipelines using AWS Glue, S3, and Athena. The ideal candidate will have a strong background in ETL processes, data modeling, and cloud-native data engineering practices Key Responsibilities: 5 years of experience in data engineering with focused on AWS. Design, develop, and maintain scalable ETL pipelines using AWS Glue , PySpark and Python Manage data lakes and data warehouses using Amazon S3, Athena, and Redshift. Develop and maintain Athena queries for data analysis and reporting. Collaborate with data analysts, data scien...

Job Requirements Data layer architecting in the Data Architecture domain, responsible for the design and creation of standard and benchmark data models using Layered Scalable Architecture principles / Medallion Architecture to deliver the Data Marts across all Businesses of Titan with highest data quality, performance & costs. Design optimization to handle high volumes having several decades of Business Data, External Data and complex structures. Managing and maintaining data dictionary/ glossary/ERD Creation of Conceptual, Logical and Physical Data Models Project management Work Experience Strong Technical knowledge of SQL (Advanced SQL store procedures, performance tuning), RDBMS, Data War...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : AWS Architecture Good to have skills : Python (Programming Language)Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, en...

6+ years of hands-on experience in data engineering or platform engineering roles. Strong coding skills in Python, Scala, and SQL. Expertise in AWS data ecosystem: EC2, S3, Glue, Redshift, Lambda, ETL pipelines, data architecture.

We are looking for a Senior Software Engineer- Data Engineer to join our team in India. This is an amazing opportunity to work on different project with our Data engineering team having different competencies to compete and learn together. We have a great skill set in the team related to Pypark, AWS, Apahe, databrics. About You experience, education, skills, and accomplishments: Bachelors degree in engineering or masters degree (BE, ME, B Tech, MTech, MCA, MS) 5+ years of experience working in software development 3+ years experience in building massively scalable distributed data processing solutions 3+ years experience in database design & development Strong data analysis skills, strong an...

You will be joining Accordion, working at the intersection of sponsors and management teams to provide hands-on, execution-focused support for enhancing the capabilities of the CFO's office. Working at Accordion means being part of a team of 1,000+ analytics, finance, and technology experts in a high-growth, agile, and entrepreneurial environment. You will play a significant role in changing the way portfolio companies drive value and contribute to Accordions future by embracing a culture rooted in collaboration and a commitment to building something great together. As part of Accordion's Data & Analytics (D&A) team, you will offer cutting-edge, intelligent solutions to a global clientele by...

As a Data Engineer at our company, you will play a crucial role in designing, developing, and maintaining data pipeline architecture to ensure the efficient flow of data across the organization. Your expertise in AWS Glue, Apache Airflow, Kafka, SQL, Python, and DataOps tools will be essential in integrating various data sources and optimizing data pipelines for performance and reliability. Your responsibilities will include developing robust and scalable data pipelines, integrating data sources like SAP HANA and SQL databases, and optimizing pipelines for efficiency. You will also be involved in designing data transformation processes, utilizing SQL and Python for ETL tasks, and ensuring da...

We are seeking a highly skilled Python QA Engineer with ETL testing experience to become a valuable member of our team. The ideal candidate should possess a solid background in automation testing, ETL processes, and data validation. Your responsibilities will include developing and implementing test plans, test cases, and test scripts for ETL processes and data pipelines. You will be required to automate ETL and data validation testing utilizing Python and SQL. Collaboration with data engineers and developers to ensure data integrity and accuracy will be a key aspect of this role. Additionally, you will design, create, and maintain automated test frameworks for data pipelines and ETL workflo...

Role & responsibilities Design and build scalable data pipelines using AWS services like AWS Glue, Amazon Redshift, and S3. Develop efficient ETL processes for data extraction, transformation, and loading into data warehouses and lakes. Create and manage applications using Python, SQL, Databricks, and various AWS technologies. Automate repetitive tasks and build reusable frameworks to improve efficiency.

Java Developer (AWS Glue) Experience: 6-15 Years Exp Salary : Competitive Preferred Notice Period: Within 30 Days Shift: 10:00AM to 7:00PM IST Opportunity Type: Hybrid (Pune) Placement Type: Permanent (*Note: This is a requirement for one of Uplers' Clients) Must have skills required : Java and AWS Glue and Springboot SoHo Dragon (One of Uplers' Clients) is Looking for: Java Developer (AWS Glue) who is passionate about their work, eager to learn and grow, and who is committed to delivering exceptional results. If you are a team player, with a positive attitude and a desire to make a difference, then we want to hear from you. Role Overview Description About SoHo Dragon We are a full-service S...

Java Developer (AWS Glue) Experience: 6-15 Years Exp Salary : Competitive Preferred Notice Period: Within 30 Days Shift: 10:00AM to 7:00PM IST Opportunity Type: Hybrid (Pune) Placement Type: Permanent (*Note: This is a requirement for one of Uplers' Clients) Must have skills required : Java and AWS Glue and Springboot SoHo Dragon (One of Uplers' Clients) is Looking for: Java Developer (AWS Glue) who is passionate about their work, eager to learn and grow, and who is committed to delivering exceptional results. If you are a team player, with a positive attitude and a desire to make a difference, then we want to hear from you. Role Overview Description About SoHo Dragon We are a full-service S...

Java Developer (AWS Glue) Experience: 6-15 Years Exp Salary : Competitive Preferred Notice Period: Within 30 Days Shift: 10:00AM to 7:00PM IST Opportunity Type: Hybrid (Pune) Placement Type: Permanent (*Note: This is a requirement for one of Uplers' Clients) Must have skills required : Java and AWS Glue and Springboot SoHo Dragon (One of Uplers' Clients) is Looking for: Java Developer (AWS Glue) who is passionate about their work, eager to learn and grow, and who is committed to delivering exceptional results. If you are a team player, with a positive attitude and a desire to make a difference, then we want to hear from you. Role Overview Description About SoHo Dragon We are a full-service S...

Must have skills : 15 years of experience in design and delivery of Distributed Systems capable of handling petabytes of data in a distributed environment. 10 years of experience in the development of Data Lakes with Data Ingestion from disparate data sources, including relational databases, flat files, APIs, and streaming data. Experience in providing Design and development of Data Platforms and data ingestion from disparate data sources into the cloud. Expertise in core AWS Services including AWS IAM, VPC, EC2, EKS/ECS, S3, RDS, DMS, Lambda, CloudWatch, CloudFormation, CloudTrail, CloudWatch. Proficiency in programming languages like Python and PySpark to ensure efficient data processing. ...

Must have skills : 15 years of experience in design and delivery of Distributed Systems capable of handling petabytes of data in a distributed environment. 10 years of experience in the development of Data Lakes with Data Ingestion from disparate data sources, including relational databases, flat files, APIs, and streaming data. Experience in providing Design and development of Data Platforms and data ingestion from disparate data sources into the cloud. Expertise in core AWS Services including AWS IAM, VPC, EC2, EKS/ECS, S3, RDS, DMS, Lambda, CloudWatch, CloudFormation, CloudTrail, CloudWatch. Proficiency in programming languages like Python and PySpark to ensure efficient data processing. ...

Capco, a Wipro company, is a global technology and management consulting firm that has been recognized for its deep transformation execution and delivery. With a presence in 32 cities across the globe, Capco supports over 100 clients in the banking, financial, and energy sectors. Awarded Consultancy of the year in the British Bank Award and ranked in the Top 100 Best Companies for Women in India 2022 by Avtar & Seramount, Capco is committed to delivering disruptive work that is changing the energy and financial services industries. At Capco, you will have the opportunity to make an impact by providing innovative thinking, delivery excellence, and thought leadership to help clients transform ...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

Key Responsibilities: Design, develop, and maintain scalable and secure ETL pipelines using PySpark , Python , and SQL . Build and orchestrate data workflows leveraging AWS services such as Glue , Lambda , Step Functions , S3 , Athena , and Redshift . Perform data profiling, cleansing, and transformation to ensure data quality and consistency. Optimize and tune data pipelines for performance and cost-efficiency. Work with data architects, analysts, and stakeholders to understand data requirements and translate them into technical solutions. Develop and maintain technical documentation for all ETL processes and data flows. Monitor data pipelines and troubleshoot any issues related to performa...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

World Wide Technology Holding Co, LLC (WWT) is a privately held global technology integrator and supply chain solutions provider. Through our culture of innovation, we inspire, build and deliver business results, from idea to outcome. Based in St. Louis, WWT works closely with industry leaders such as Cisco, VMware, NetApp, Dell EMC, HPE and several others, but also include emerging tech players. WWT employs more than 10,000 people and operates in more than 2 million square feet of state-of-the-art warehousing, distribution and integration space strategically located throughout the world. WWT ranks Glassdoors Best Places to Work and has been on Fortune’s 100 Best Companies to Work For list 1...