268 Aws Emr Jobs - Page 4

Design, develop new features for a large-scale cloud data platform using Databricks, snowflake and Fabric, Deeply understand legacy data platforms, and drive their modernization, Provide production support Design data pipelines and data warehouse. Required Candidate profile 5 years in developing and scaling data platforms using Snowflake, databricks, Fabric, Strong Python and SQL Intermediate C# Understanding of modern data architectures such as Data Mesh, Lakehouse

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelor...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelor...

Design and implement scalable data processing solutions usingApache SparkandJava. Develop and maintain high-performance backend services and APIs. Collaborate with data scientists, analysts, and other engineers to understand data requirements. Optimize Spark jobs for performance and cost-efficiency. Ensure code quality through unit testing, integration testing, and code reviews. Work with large-scale datasets in distributed environments (e.g., Hadoop, AWS EMR, Databricks). Monitor and troubleshoot production systems and pipelines. Experience in Agile Development Process. Experience in leading a 3-5 member team on the technology front Excellent communication skills, problem solving and debugg...

AWS data developers with 6-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferred Skills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shift Good communication skills and can deliver independently Mandatory Competencies Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift Big Data - Big Data - Pyspark Beh - Communication Database - Database Programming - SQL Perks and Benefits for Irisians we offer world-class benefits designed to support the financial, health and well-being needs of our associates to help achieve harmony between their professional and personal growth. From comprehensive health ...

Role Overview: As an AWS Snowflake DBT Developer at PWC AC, you will be responsible for architecting and delivering highly scalable, distributed, cloud-based enterprise data solutions. You will work on implementing Cloud data engineering solutions like Enterprise Data Lake and Data hub in AWS. Your role will involve hands-on experience with Snowflake utilities, SnowSQL, SnowPipe, ETL data Pipelines, and Big Data model techniques using Python/Java. Additionally, you will be expected to deploy Snowflake features, ensure data security and access controls, and design relational as well as NoSQL data stores. Key Responsibilities: - Architect and deliver highly scalable, distributed, cloud-based e...

Key Responsibilities: Team Leadership & Technical Mentorship: Lead, manage, and mentor a team of data engineers, fostering a culture of technical excellence and collaborative problem-solving. Conduct code reviews, provide architectural guidance. Hands-On Technical Contribution: Architecting and implementing critical components of the data platform. Expertise with PySpark, Scala, and SQL will be essential. Architectural Ownership: Design and own the roadmap for the data ecosystem. Lead the architecture of scalable and resilient data solutions, including Data Lakehouse , real-time streaming services using Kafka , and large-scale batch processing jobs using Apache Spark . Platform Modernization...

Job Role AWS data developers with 8-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferred Skills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shift Good communication skills and can deliver independently Mandatory Competencies Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift Beh - Communication Big Data - Big Data - Pyspark Database - Database Programming - SQL Programming Language - Python - Apache Airflow

Design and implement scalable data processing solutions usingApache SparkandJava. Develop and maintain high-performance backend services and APIs. Collaborate with data scientists, analysts, and other engineers to understand data requirements. Optimize Spark jobs for performance and cost-efficiency. Ensure code quality through unit testing, integration testing, and code reviews. Work with large-scale datasets in distributed environments (e.g., Hadoop, AWS EMR, Databricks). Monitor and troubleshoot production systems and pipelines. Experience in Agile Development Process. Experience in leading a 3-5 member team on the technology front Excellent communication skills, problem solving and debugg...

Design and implement scalable data processing solutions usingApache SparkandJava. Develop and maintain high-performance backend services and APIs. Collaborate with data scientists, analysts, and other engineers to understand data requirements. Optimize Spark jobs for performance and cost-efficiency. Ensure code quality through unit testing, integration testing, and code reviews. Work with large-scale datasets in distributed environments (e.g., Hadoop, AWS EMR, Databricks). Monitor and troubleshoot production systems and pipelines. Experience in Agile Development Process. Excellent communication skills, problem solving and debugging and troubleshooting Skills. Mandatory Competencies Architect...

AWS data developers with 6-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferred Skills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shift Good communication skills and can deliver independently Mandatory Competencies Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift Big Data - Big Data - Pyspark Beh - Communication Database - Database Programming - SQL.

AWS data developers with 8-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferred Skills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shift Good communication skills and can deliver independently Mandatory Competencies Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift Beh - Communication Big Data - Big Data - Pyspark Database - Database Programming - SQL Programming Language - Python - Apache Airflow.

Role Overview: You will be responsible for architecting and delivering highly scalable, distributed, cloud-based enterprise data solutions. Your role will involve designing scalable data architectures with Snowflake, integrating cloud technologies such as AWS, Azure, GCP, and ETL/ELT tools like DBT. Additionally, you will guide teams in proper data modeling, transformation, security, and performance optimization. Key Responsibilities: - Architect and deliver highly scalable, distributed, cloud-based enterprise data solutions - Design scalable data architectures with Snowflake and integrate cloud technologies like AWS, Azure, GCP, and ETL/ELT tools such as DBT - Guide teams in proper data mod...

Role Overview: We are seeking a highly skilled Senior Lead AWS Expert with strong experience in Big Data Analytics to join our team. The ideal candidate will be able to work independently, design scalable solutions, and support customer initiatives from the front line. Non-Negotiable Requirements: Excellent communication and articulation skills Ability to work independently without supervision or guidance Proven hands-on experience with: AWS S3 and Parquet files AWS Lambda, Glue Jobs AWS EMR / Spark AWS Networking (Private Links, Route53, Cross-OU/Account Routing, etc.) API Gateways Terraform Strong solution design capabilities Other Key Details: Location: Bangalore - Experience: Min 6+ Rele...

Job Purpose ICE Mortgage Technology is driving value to every customer through our effort to automate everything that can be automated in the residential mortgage industry. Our integrated solutions touch each aspect of the loan lifecycle, from the borrower's \"point of thought\" through e-Close and secondary solutions. Drive real automation that reduces manual workflows, increases productivity, and decreases risk. You will be working in a dynamic product development team while collaborating with other developers, management, and customer support teams. You will have an opportunity to participate in designing and developing services utilized across product lines. The ideal candidate should po...

As a Data Science and AI / ML professional at LTIMindtree, you will play a crucial role in leveraging digital technologies to drive innovation and growth for our clients. With over 6 years of experience in the field, you will be expected to have a deep understanding of machine learning techniques and algorithms, such as GPTs, CNN, RNN, k-NN, Naive Bayes, SVM, Decision Forests, etc. Your expertise in data frameworks like Hadoop, business intelligence tools like Tableau, and Cloud native skills will be essential in delivering superior business outcomes. Key Responsibilities: - Utilize your knowledge of SQL and Python, with familiarity in Scala, Java, or C++ as an asset, to develop innovative A...

Role Overview: At WRD, we are redefining the world of IT consulting by merging human expertise with cutting-edge AI technology. Join us to work on the forefront of AI-powered innovation, where your skills drive real impact, creativity meets advanced technology, and each project sets a new standard in IT excellence. Key Responsibilities: - Develop & Maintain data pipelines to support business and analytical needs. - Work with structured and unstructured data to ensure high data quality and availability. - Build scalable and efficient data workflows using SQL, Python, and Java/Scala. - Manage and process large datasets on AWS EMR and other cloud platforms. - Develop and maintain batch and stre...

You are being sought after to take on the role of a Senior Data Engineer, where your primary responsibility will be leading the development of a scalable data ingestion framework. In this capacity, you will play a crucial role in ensuring high data quality and validation, as well as designing and implementing robust APIs for seamless data integration. Your expertise in building and managing big data pipelines using modern AWS-based technologies will be put to good use, making sure that quality and efficiency are at the forefront of data processing systems. Key Responsibilities: - **Data Ingestion Framework**: - Design & Development: You will architect, develop, and maintain an end-to-end dat...

Design and implement scalable data processing solutions usingApache SparkandJava. Develop and maintain high-performance backend services and APIs. Collaborate with data scientists, analysts, and other engineers to understand data requirements. Optimize Spark jobs for performance and cost-efficiency. Ensure code quality through unit testing, integration testing, and code reviews. Work with large-scale datasets in distributed environments (e.g., Hadoop, AWS EMR, Databricks). Monitor and troubleshoot production systems and pipelines. Experience in Agile Development Process. Excellent communication skills, problem solving and debugging and troubleshooting Skills. Mandatory Competencies Architect...

AWS data developers with 8-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferred Skills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shift Good communication skills and can deliver independently Mandatory Competencies Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift Beh - Communication Big Data - Big Data - Pyspark Database - Database Programming - SQL Programming Language - Python - Apache Airflow

AWS data developers with 6-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferred Skills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shift Good communication skills and can deliver independently Mandatory Competencies Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift Big Data - Big Data - Pyspark Beh - Communication Database - Database Programming - SQL

EPAM has presence across 40+ countries globally with 55,000 + professionals & numerous delivery centers, Key locations are North America, Eastern Europe, Central Europe, Western Europe, APAC, Mid East & Development Centers in India (Hyderabad, Pune & Bangalore). Exp: 10-14 years Location: Bengaluru Work Mode: Hybrid (2-3 days office in a week) Job Description: 10-14 Years of in Big Data & Data related technology experience Expert level understanding of distributed computing principles Expert level knowledge and experience in Apache Spark Hands on programming with Python Experience with building stream-processing systems, using technologies such as Apache Storm or Spark-Streaming Experience w...

As an AWS Senior Developer at PwC Advisory Acceleration Center, your role involves interacting with Offshore Manager/ Onsite Business Analyst to understand requirements and taking responsibility for end-to-end implementation of Cloud data engineering solutions like Enterprise Data Lake and Data hub in AWS. Your strong experience in AWS cloud technology, planning, organization skills, and ability to work as a cloud developer/lead on an agile team to provide automated cloud solutions will be crucial for success. **Key Responsibilities:** - Architect and deliver highly scalable, distributed, cloud-based enterprise data solutions - Implement Cloud data engineering solutions like Enterprise Data ...

Role Overview: At Toyota Connected, you will have the opportunity to change the way the world works, transform the automotive industry, and positively impact others on a global scale. In a collaborative and fast-paced environment, you will focus on continual improvement and work iteratively to deliver exceptional value through connected products and services that amaze and delight customers worldwide. Join us in re-imagining what mobility can be today and for years to come! Key Responsibilities: - Design, develop, and maintain automation test frameworks and scripts specifically for API-level testing. - Validate and verify complex Machine Learning applications, ensuring accurate performance o...