1526 Emr Jobs - Page 17

As a Big Data Engineer, you will be responsible for working on collecting, storing, processing, and analyzing huge sets of data. Your primary focus will be on choosing optimal solutions for these purposes, then maintaining, implementing, and monitoring them. Additionally, you will integrate these solutions with the architecture used across the company. Key Responsibilities: - 6+ years" experience in Big Data Hadoop, MapReduce, Hive, Sqoop, and Spark with hands-on expertise in designing and implementing high data volume solutions (ETL & Streaming). - Experience in building stream-processing systems using solutions like Storm, Spark-Streaming, and Kafka streams. - Extensive experience working ...

As a Senior Data Engineer, you will be responsible for designing and optimizing large-scale data pipelines using Databricks and the AWS ecosystem. Your expertise in Databricks and AWS with a minimum of 7 years of experience is mandatory for this role. Key Responsibilities: - Designing and optimizing large-scale data pipelines using Databricks and AWS technologies - Working with Databricks tools such as PySpark, Delta Lake, and MLflow - Utilizing AWS services including Glue, S3, Lambda, Redshift, and EMR - Developing and maintaining Data Lake, ETL pipelines, CI/CD processes - Proficiency in Python and SQL for data processing and analysis Qualifications Required: - Minimum 7 years of experienc...

We are looking for a skilled AWS Data Pipeline Engineer with 4 to 12 years of experience to manage data storage solutions on AWS, implement data processing workflows, and collaborate with cross-functional teams. The ideal candidate will have a strong understanding of core AWS services, cloud concepts, and the AWS Well-Architected Framework. Roles and Responsibility Managing data storage solutions on AWS, including Amazon S3, Amazon Redshift, and Amazon DynamoDB. Implementing and optimizing data processing workflows using AWS services like AWS Glue, Amazon EMR, and AWS Lambda. Collaborating with Spotfire Engineers and business analysts to ensure data accessibility and usability for analysis a...

The architect will play a crucial role in designing, implementing and maintaining data and technology solutions that align with our client's business goals and objectives. This role requires a deep understanding of AWS data services, good understanding of AWS Infra & Ops services, and the ability to translate business requirements into scalable and efficient solutions. Job Responsibilities 10+ years of Experience 5+ years relevant experience. Data Architecture and Cloud Strategy - MUST HAVE Develop and maintain a comprehensive data architecture and cloud strategy that aligns with the organization's goals and needs. Design, implement and manage cloud-based data infrastructure on AWS, ensuring...

Dear Candidate Greetings from TATA Consultancy Services Job Openings at TCS Skill: AWS Data Engineer Exp range: 6 yrs to 10 yrs location : Bangalore Notice period 30 45 days Pls find the Job Description below. Hands-on experience in Pyspark, Glue Experience on EMR, S3, IAM, Lambda, Cloud formation, Python AMI Rehydration, Python, ELB and other AWS components knowledge AWS monitoring setup and building the traffic dashboard and SNOW incidents for AWS related traffic and services CI/CD build and deployment support Ensure reliability of data pipelines, ETL processes, data transformations Identify areas of improvement in data quality processes, propose solutions to enhance data reliability, accu...

Job Description: Must to have skills • Min 4 years of AWS Infra SRE/Operation experience. SRE/Operation experience on S3, IAM, KMS, EMR, EKS, MSK services • Experience on Infrastructure automation as code in AWS using Terraform (preferred) or cloud formation • Experience on Python scripting language • AWS networking knowledge on VPC, NAT, DNS, Gateways etc • Experience on EMR and EKS is must to have • Knowledge of Kubernetes internals & components. Good to have skills • SQL database support like MySQL or Oracle • Knowledge & experience on Snowflake Role & responsibilities Preferred candidate profile Perks and benefits

Skill:Data Engineer Notice Period:Immediate. Employment Type: Contract Job Description : Experience in Cloud platform, e.g., AWS, GCP, Azure, etc. Experience in distributed technology tools, viz. SQL, Spark, Python, PySpark, Scala Performance Turing Optimize SQL, PySpark for performance Airflow workflow scheduling tool for creating data pipelines GitHub source control tool & experience with creating/ configuring Jenkins pipeline Experience in EMR/ EC2, Databricks etc. DWH tools incl. SQL database, Presto, and Snowflake Streaming, Serverless Architecture .

We are looking for a skilled Hadoop Admin with 7 to 12 years of experience, located in Hyderabad, Bangalore, Chennai, and Bhubaneshwar. The ideal candidate will have hands-on experience in building EKS clusters, Spark on EKS, AWS (EMR, S3, RDS), Python as programming skills, Shell scripting, and any CI/CD. Roles and Responsibility Manage and maintain large-scale Hadoop clusters for high availability and performance. Design and implement scalable data processing pipelines using Spark and Airflow instances. Integrate Ranger and Hive Metastore services in EKS for secure data storage and access. Collaborate with cross-functional teams to identify and resolve technical issues. Develop and impleme...

About the Role We are seeking a highly skilled Lead Data Engineer to define and drive the data migration strategy from legacy RDBMS platforms to PostgreSQL for a mission-critical billing and invoicing system. This role requires a hands-on technical leader who can design the migration architecture, oversee implementation, and ensure seamless transition without disruption to core business functions. The ideal candidate will have deep expertise in data migration frameworks, large-scale distributed processing (Spark preferred), and experience with both open-source and AWS ecosystem tools. They will work closely with business stakeholders and customers to manage expectations, deliver with precisi...

Gainwell Technologies LLC Summary As a Product Owner -US Healthcare at Gainwell,you will play a key role in driving product vision, strategy, and execution within the US healthcare and pharmacy domain. You will work closely with stakeholders, development teams, and business units to define product requirements, prioritize features, and ensure successful product delivery in alignment with business objectives. Your role in our mission Key Responsibilities • Act as the primary point of contact for the product, owning the roadmap and backlog. • Collaborate with cross-functional teams, including business stakeholders, engineering, UX/UI, and quality assurance, to define and deliver high-impact pr...

We are looking for a skilled ETL Testing professional with 8 to 11 years of experience to join our team in Chennai. The ideal candidate will have expertise in ETL testing, SQL queries, and Informatica Power Center. Roles and Responsibility Design and develop comprehensive test plans for ETL processes to ensure data integrity and accuracy. Develop and execute automated tests using Informatica Power Center to validate ETL workflows. Collaborate with cross-functional teams to identify and resolve data-related issues. Analyze and report defects found during testing, providing recommendations for improvement. Participate in the development of best practices and standards for ETL testing. Work clo...

We are looking for a skilled PySpark Lead with 6-8 years of experience to join our team in Bangalore. The ideal candidate will have expertise in SQL, PySpark (or Spark with Scala), and Design Aspects - ETL/ Data Engineering Pipeline. Roles and Responsibility Design and develop scalable data pipelines using PySpark and other relevant technologies. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data systems, ensuring high performance and reliability. Troubleshoot and resolve complex technical issues related to data processing and analysis. Implement automated testing and validation frameworks to ensure data quality and ...

We are looking for a skilled Hadoop Admin with 4 to 9 years of experience. The ideal candidate will have expertise in Hadoop administration, CDP distribution, Dataflow, and Big data platform. Roles and Responsibility Manage and maintain large-scale Hadoop clusters for high availability and performance. Design and implement data pipelines using Kafka and Nifi profiles. Develop and execute Linux shell scripts for automation and monitoring. Collaborate with cross-functional teams to resolve technical issues and improve processes. Ensure compliance with security best practices and industry standards. Troubleshoot and optimize HBase databases for improved query performance. Job Requirements Stron...

We are looking for a skilled PySpark Lead with 5-8 years of experience to join our team in Bangalore. The ideal candidate will have expertise in designing and developing ETL/ Data Engineering Pipelines using PySpark. Roles and Responsibility Design and develop scalable data pipelines using PySpark. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data processing systems using PySpark. Ensure high-quality data processing and analysis by implementing robust testing and validation frameworks. Optimize data pipeline performance and efficiency by analyzing system metrics and identifying areas for improvement. Provide technic...

We are looking for a skilled PySpark Lead with 5 to 8 years of experience, based in Bangalore. The ideal candidate will have expertise in PySpark, SQL, ETL/Data Engineering Pipeline, Cloud understanding, CI/CD, Data Modelling, Airflow, Kafka, EMR/Databricks, Snowflake, and Hive. Roles and Responsibility Design and develop scalable data pipelines using PySpark and other relevant technologies. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data systems, ensuring high performance and reliability. Troubleshoot and resolve complex technical issues related to data processing and analysis. Implement automated testing and val...

Position Summary You will manage and oversee the development & deployment of high-quality software products. You will ensure that the development teams adopt and follow modern engineering practices to deliver a high-quality, high-value product. You will be responsible towards working with different stakeholders to accomplish business and software engineering goals. You will improve the teams capabilities, improve engagement, and minimize business risks. Key duties & responsibilities Develop high performing teams that are equipped with right capabilities in terms of skills, tools, technology, and resources to continuously deliver high-quality and high-value software. Collaborate with the -Agi...

Position Summary As a staff engineer you will be part of development team and apply your expert technical knowledge, broad knowledge of software engineering best practices, problem solving, critical thinking and creativity to build and maintain software products that achieve technical, business and customer experience goals and inspire other engineers to do the same. You will be responsible towards working with different stakeholders to accomplish business and software engineering goals.Key duties & responsibilitiesEstimates and develops scalable solutions using .Net technologies in a highly collaborative agile environment with strong experience in C#, ASP.net Core, Web API.Maintain relevant...

Role Objective: To bill out medical accounts with accuracy within defined timelines and reduce rejections for payers. Essential Duties and Responsibilities: Process Accounts accurately basis US medical billing within defined TAT Able to process payer rejection with accuracy within defined TAT. 24*7 Environment, Open for night shifts Good analytical skills and proficiency with MS Word, Excel, and PowerPoint Qualifications: Graduate in any discipline from a recognized educational institute. Good analytical skills and proficiency with MS Word, Excel, and PowerPoint. Good communication Skills (both written & verbal)Skill Set: Candidate should have good healthcare knowledge. Candidate should have...

Develop high performing teams that are equipped with right capabilities in terms of skills, tools, technology, and resources to continuously deliver high-quality and high-value software. Collaborate with the -Agile practitioners to help avoid distractions for the team, so that the team is focused on delivering their sprint commitments. Drive adoption of modern engineering practices such as Continuous Integration, Continuous Deployment, Code Reviews, TDD, Functional\Non-Functional testing, Test Automation, Performance Engineering etc. to deliver high-quality, high-value software for 2-3 scrum teams. Craft individual development plans for team members and provide growth opportunities. Mentor, ...

Senior Cloud Engineering Lead As a Senior Cloud Engineering Lead , you will be an individual contributor and subject matter expert who maintains and participates in the design and implementation of technology solutions. The engineer will collaborate within a team of technologists to produce enterprise scale solutions for our clients needs. This position will be working with the latest Amazon Web Services technologies around cloud architecture, infrastructure automation, and network security. What You'll Do: Identify, test prototype solution and proof of concepts on public clouds Help develop architectural standards and guidelines for scalability, performance, resilience, and efficient operat...

As a Senior Cloud Platform Engineer, you will be an individual contributor and subject matter expert who maintains and participates in the design and implementation of technology solutions. The engineer will collaborate within a team of technologists to produce enterprise scale solutions for our clients needs. This professional will be working with the latest Amazon Web Services technologies around cloud architecture, infrastructure automation, and network security. What you'll do: Design and implement automated disaster recovery (DR) solutions for cloud-native and hybrid applications hosted on AWS Develop and maintain infrastructure-as-code (IaC) scripts (e.g., Terraform, CloudFormation) to...

What youll do : Work with business stakeholders to understand their business needs. Create data pipelines that extract, transform, and load (ETL) from various sources into a usable format in a Data warehouse. Clean, filter, and validate data to ensure it meets quality and format standards. Develop data model objects (tables, views) to transform the data into unified format for downstream consumption. Expert in monitoring, controlling, configuring, and maintaining processes in cloud data platform. Optimize data pipelines and data storage for performance and efficiency. Participate in code reviews and provide meaningful feedback to other team members. Provide technical support and troubleshoot...

We are currently seeking applicants for a Senior Cloud Application Administrator (Tableau & PowerBI) position to join our Pune office. Qualified candidates will possess the skills detailed below and relevant work experience. What you'll do: Strong understanding of Tableau Server and Tableau Cloud architecture and administration Admin Certification preferred. Experience as Tableau administrator, installing, configuring and administering multi-tenant Tableau Server on Windows and Linux platform Good knowledge of Tableau Metadata tables and experience in Tableau scripting (TABCMD and TABADMIN) Experience in setting up different authentication types along with SSO on Tableau server Expertise in ...

What youll do : Collaborate with ZS internal teams and client teams to shape and implement high quality technology solutions that address critical business problems Develop a deep understanding of the business problems and effectively translate them into technical designs Lead modules and workstreams within projects while participating in hands on implementation Work with technical architects to validate the technical design and implementation approach Apply appropriate development methodologies and best practices to ensure exceptional client and project team experience Support the project lead in project delivery, including project planning, people management, staffing, and risk mitigation ...

Bachelor's degree in Computer Science, Information Technology, or related field. Proven experience with Oracle WebLogic and AWS cloud services. Strong knowledge of database management systems including Oracle Database, Oracle MySQL Enterprise, Microsoft SQL Server, and IBM DB2. Familiarity with .NET interoperability and middleware integration. Experience with security models and best practices in cloud environments. Excellent problem-solving skills and ability to work under pressure. Strong communication skills and ability to collaborate with clients and team members. Certification in Oracle WebLogic and AWS is a plus. #Skill :Oracle Weblogic #Notice Period:Immediate #Employment Mode: Contra...