268 Aws Emr Jobs - Page 2

Design and develop integration of Snowflake with a cloud platform and platform enhancements, integrations, and performance optimisation. Work on data ingestion using Python, cataloguing, and lineage tracking, Develop and architect ETL workflows. Required Candidate profile 5 years in developing and scaling data platforms centered around Snowflake, with Azure. Hands on Python Understanding of modern data architectures such as Data Mesh, Lakehouse, and ELT.

As an Applied AI ML Lead within the Digital Intelligence team at JPMorgan, you will collaborate with all lines of business and functions to deliver software solutions. You will experiment, develop, and productionize high-quality machine learning models, services, and platforms to make a significant impact on technology and business. You will design and implement highly scalable and reliable data processing pipelines. Additionally, you will perform analysis and insights to promote and optimize business results. You will contribute to a transformative journey and make a substantial impact on a wide range of customer products. - Research, develop, and implement machine learning algorithms to so...

AWS Data Engineer Experience :- 5+ years Location : Remote Job Description Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code Integration of data storage solutions in spark especially with AWS S3 object storage. Performance tuning of pySpark scripts. Need to ensure overall build delivery quality is good and on-time delivery is done at all times. Should be able to handle meetings with customers with ease. Need to have excellent communication skills to interact with the customer. Be a team player and willing to work in an onsite-offshore model, mentor other folks in the team (...

Urgent Hiring: AWS Data Engineer, Senior Data Engineers & Lead Data Engineers Apply Now: Send your resume to heena.ruchwani@gspann.com Location: Bangalore (6+ Years Experience) Company: GSPANN Technologies, Inc. GSPANN Technologies is seeking talented professionals with 4+ years of experience to join our team in Bangalore. We are looking for immediate joiners who are passionate about data engineering and eager to take on exciting challenges. Key Skills & Experience: 6+ years of hands-on experience with AWS Data Services (Glue, Redshift, S3, Lambda, EMR, Athena, etc.) Strong expertise in Big Data Technologies (Spark, Hadoop, Kafka) Proficiency in SQL, Python, and Scala Hands-on experience wit...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

Requirements for the candidate: Data Engineer with a minimum of 7+ years of experience of data engineering experience. The role will require deep knowledge of data engineering techniques to create data pipelines and build data assets. At least 4+ years of Strong hands on programming experience with Pyspark / Python / Boto3 including Python Frameworks, libraries according to python best practices. Strong experience in code optimization using spark SQL and pyspark. Understanding of Code versioning, Git repository, JFrog Artifactory. AWS Architecture knowledge specially on S3, EC2, Lambda, Redshift, CloudFormation etc and able to explain benefits of each Code Refactorization of Legacy Codebase:...

As the Data Platform Engineering Lead at JPMorgan Chase within Asset and Wealth Management, you play a crucial role as part of an agile team dedicated to enhancing, building, and delivering cutting-edge technology products securely and at scale. Your responsibilities involve leading the design, development, and implementation of scalable data pipelines, mentoring a team of data engineers, collaborating with stakeholders, and ensuring optimal data infrastructure on cloud platforms. - Lead the design, development, and implementation of scalable data pipelines and ETL batches using Python/PySpark on AWS. - Execute standard software solutions, design, development, and technical troubleshooting. ...

Lead Data Engineer Skills Mandatory- S3, Glue, Lambda, Step Function, Snowflake . Skills - Primary - PySpark, Snowflake. Skills - Good to have - Cassandra Total Experience - 7+ years ; Relevant Experience - 5+ years Work Location : Cochin/TVM Job Purpose Responsible for consulting for the client to understand their data needs and delivering data solution to the client. Job Description / Duties & Responsibilities Data Ingestion Framework: oDesign & Development: Design, develop, and maintain an end-to-end data ingestion framework that efficiently extracts, transforms, and loads data from diverse sources. oFramework Optimization: Use AWS services such as AWS Glue, Lambda, EC2 and Step Functions...

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...

We are seeking a talented and motivated Data Engineer to join our founding team in India. This role is critical in shaping the data foundation of the Axyo AI platform and our enterprise applications. As an early member of our India team, you will work closely with the VP of Data Science, ML Engineers, and DevOps Engineers to design and implement robust data pipelines, scalable infrastructure, and high-quality data systems that power our AI products. Responsibilities Data Infrastructure & Pipelines Design, develop, and maintain scalable, eff icient, and reliable automated ETL pipelines. Integrate diverse structured and unstructured data sources into unifi ed data models. Implement data qualit...

Job Description We are seeking a talented and motivated ML Engineer to join our founding team in India. This role is central to building AI solutions on the Axyo platform that solve high-value problems for enterprise clients. As an early member of our India team, you will work closely with the VP of Data Science, Data Engineers, and Product Managers to design, train, and deploy machine learning models that power Axyo AI Apps. Responsibilities Applied Machine Learning & Modeling Design, train, and evaluate predictive, classifi cation, forecasting, and optimization models. Build and experiment with ML pipelines across traditional statistical methods and modern ML/deep learning approaches. Appl...

Job Description We are seeking a talented and motivated ML Engineer to join our founding team in India. This role is central to building AI solutions on the Axyo platform that solve high-value problems for enterprise clients. As an early member of our India team, you will work closely with the VP of Data Science, Data Engineers, and Product Managers to design, train, and deploy machine learning models that power Axyo AI Apps. Responsibilities Applied Machine Learning & Modeling Design, train, and evaluate predictive, classifi cation, forecasting, and optimization models. Build and experiment with ML pipelines across traditional statistical methods and modern ML/deep learning approaches. Appl...

Kick-start your software engineering career as an entry-level Software Engineer I. Be part of a team that is pushing the boundaries of what's possible. As a Software Engineer I at JPMorgan Chase within the Commercial and Investment Bank's Global Banking Team, you are part of an agile team that works to enhance, design, and deliver the software components to the firm's state-of-the-art technology products in a secure, stable, and scalable way. As an entry-level member of a software engineering team, you execute basic software solutions through the design, development, and troubleshooting of a single technical area within a business function, while gaining skills and experience to grow within ...

We are looking for a Manager Software Engineering to join our IMS Team in Bangalore . This is an amazing opportunity to work on Big Data technologies involved in content ingestion. The team consists of 10-12 engineers and is reporting to the Sr Manager. We have a great skill set in Spark, Java, Scala, Hive, Sql, XSLT, AWS EMR, S3, etc and we would love to speak with you if you have skills in the same. About You experience, education, skills, and accomplishments: Work Experience: Minimum 7 years experience in Big Data projects involved in content ingestion, curation, transformation Technical Skill: Databricks, Spark, Python/Java , Scala, AWS EMR, S3, SQS, Hive, XSLT, Education (bachelors degr...

As a skilled PySpark Developer with hands-on experience in Reltio MDM, your role will involve designing and implementing scalable data processing solutions using PySpark and integrating with Reltio's cloud-native MDM platform. Key Responsibilities: - Develop and maintain data pipelines using PySpark in distributed computing environments such as AWS EMR and Databricks. - Integrate and synchronize data between enterprise systems and the Reltio MDM platform. - Design and implement data transformation, cleansing, and enrichment processes. - Collaborate with data architects, business analysts, and Reltio solution architects to ensure high-quality data modeling. - Work on API-based integration bet...

Design and develop integration of Snowflake with a cloud platform and platform enhancements, integrations, and performance optimisation. Work on data ingestion using Python, cataloguing, and lineage tracking, Develop and architect ETL workflows. Required Candidate profile 5 years in developing and scaling data platforms centered around Snowflake, with Azure. Hands on Python Understanding of modern data architectures such as Data Mesh, Lakehouse, and ELT.

As a Senior Data Engineer specializing in Data Quality, Ingestion & API Development, your role will involve leading the development of a scalable data ingestion framework with a strong focus on ensuring high data quality and validation. You will also be responsible for designing and implementing robust APIs for seamless data integration. Your expertise in building and managing big data pipelines using modern AWS-based technologies will be crucial for driving quality and efficiency in data processing systems. - **Data Ingestion Framework:** - **Design & Development:** Architect, develop, and maintain an end-to-end data ingestion framework that efficiently extracts, transforms, and loads data ...

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...

Data Architect Pando (www.pando.ai) is pioneering the future of autonomous logistics with innovative AI capabilities. Trusted by Fortune 500 enterprises with global customers across North America, Europe, and Asia Pacific regions, we are leading the global disruption of supply chain software, with our AI-powered, no-code, & unified platform empowering Autonomous Supply Chain. We have been recognized by Gartner for our transportation management capabilities, by the World Economic Forum (WEF) as a Technology Pioneer, by G2 as a Market Leader in Freight Management, and named one of the fastest-growing technology companies by Deloitte. Why Pando? We are one of the fastest growing companies reima...

Role: Sr. DevOps Engineer Exp: 7+ Location: Pune /Gurgaon Work Mode: Hybrid Key Role and Responsibilities: Responsible for building and managing our cloud infrastructure (AWS) with a first mindset code. Design and architect ETL/ELT pipelines running on AWS EMR and Snowflake Performance tune data pipelines using technologies such as Apache Spark, Hive and Trino Write and maintain high-quality code and participate in design discussions and code reviews. Implement data storage solutions such as S3, ERDS and NoSQL databases. Automate workflows using orchestration systems like airflow, oozie etc. Build monitoring and observability dashboards. Cost optimization and management. Enforce security (cr...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

Role & Responsibilities : - Design, develop, and maintain robust AWS-based data pipelines using Python and PySpark. - Implement efficient ETL processes, ensuring data integrity and optimal performance across AWS services (S3, Glue, EMR, Redshift). - Collaborate with cross-functional teams to integrate data engineering solutions within broader business-critical applications. - Troubleshoot and optimize existing data workflows, ensuring high availability, scalability, and security of cloud solutions. - Exercise best practices in coding, version control, and documentation to maintain a high standard of engineering excellence. Skills & Qualifications : Must-Have : 4+ years of hands-on experience...

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose to uplift everyone, everywhere by being the best way to pay and be paid. Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa. Job Description The Global Data Team With data and AI being the fuel that drives ...

Job Responsibilities Our cloud-based platforms - Axtria DataMax™, Axtria InsightsIQ™, Axtria SalesIQ™, and Axtria MarketingIQ™ - enable customers to efficiently manage data, leverage data science to deliver insights for sales and marketing planning, and manage end-to-end commercial operations. DataMAx™ is a next-generation cloud-based commercial Life Sciences data management software that delivers actionable business insights from trustworthy data for intelligent decision making. SalesIQ™ is the leading sales planning and operations solution for the global life sciences industry that enables effective and motivated sales teams resulting in higher commercial success. With the sales rep role c...