122 Hadoop Ecosystem Jobs - Page 2

As a Pre-Sales Solution Engineer in India, your role will involve engaging with customers in the evaluation process, conducting product demonstrations, and supporting marketing activities. Your main focus will be on pre-sales experience with software or analytics products, demonstrating expertise in various technical skills and tools such as OLAP, Microsoft Analysis services, data engineering, ETL, Hadoop ecosystem, AWS, Azure, GCP Cluster, Tableau, Microstrategy, BI tools, Hive QL, Spark SQL, PLSQL, TSQL, SQL programming, MDX queries, Linux, Python, Java, and JavaScript. Key Responsibilities: - Act as the primary point of contact for customer interactions - Handle product demonstrations for...

About You: You are a numbers person with proven attention to detail. You enjoy taking data and turning into a solution. You are a troubleshooter and passionate about what you do. What You'll Do: Work with data scientists and software engineers to support data quality initiatives, data solution ideation, and implementation Work with technical and business leads to transfer global business requirements into sound solutions and implementation Share support responsibilities for implemented components What You'll Need: 7+ years of demonstrated ability with Hive, Python, Spark/Scala, SQL, etc. Google Cloud Platform Experience, Big Query, Cloud Storage, Dataproc, Data Flow, Cloud Composer, Cloud SQ...

Position Summary To be a driven business analyst who can work on complex Analytical problems and help the customer in better business decision making especially in the area of pharma/life sciences (domain). Job Responsibilities o Technical Able to comprehend complex tasks assigned and executes them with little to no supervision. o Logical Thinking Able to think analytically, use a systematic and logical approach to analyze data, problems, and situations. Notices discrepancies and inconsistencies in information and materials. o Task Management Basic level of project management knowledge and experience. Should be able to plan tasks, discuss and work on priorities. o Communication Able to conve...

Role Overview: As a Big Data Lead at Persistent, you will be responsible for managing data sets that are too large for traditional database systems to handle. Your primary tasks will involve creating, designing, and implementing data processing jobs to transform data into a more usable format. Additionally, you will play a crucial role in ensuring data security and compliance with industry standards to safeguard the company's information. Key Responsibilities: - Manage customer priorities of projects and requests - Assess customer needs using a structured requirements process to prioritize business needs, advise on options, risks, and costs - Design and implement software products related to...

Minimum of 5 Years of Mongo DBA Architect, Strong Internals, Aggregation framework, Indexing and experience with MongoDB Atlas Minimum of 5+ Years of Hadoop DBA Architect, experience with Hadoop distributions (Cloudera, Hortonworks, or Apache) and Strong knowledge of Hadoop ecosystem components: HDFS, YARN, Hive, HBase, Spark, Oozie, Zookeeper, etc Minimum of 2 years experience with open source or cloud-based databases Recent experience with Apache Hadoop versions 3 -4 and 3 -3Proficiency in Hadoop ecosystem tools like Pig, Hive, HBase, and OozieExperience integrating MongoDB with big data ecosystems (Kafka, Spark, etc ) is a plus Recent experience with MariaDB, PostgreSQL, Snowflake, SQL Se...

As a Delivery Consultant, you will work closely with IBM clients and partners to design, deliver, and optimize IBM Technology solutions that align with your clients' goals. In this role, you will apply your technical expertise to ensure world-class delivery while leveraging your consultative skills such as problem-solving issue- / hypothesis-based methodologies, communication, and service orientation skills. As a member of IBM Technology Expert Labs, a team that is client focused, courageous, pragmatic, and technical, you'll collaborate with clients to optimize and trailblaze new solutions that address real business challenges. If you are passionate about success with both your career and so...

What you will be doing: Service Management: Administer, configure, and maintain Hadoop ecosystem services within both Cloudera Data Platform (CDP) and Cloudera Distributed Hadoop (CDH), including HDFS, YARN, Hive, Spark, Ranger, Sentry, Kerberos security, KMS, KTS, Zookeeper, and more. Job Scheduling and Workflow Management : Utilize Oozie, Zena, Airflow to schedule and orchestrate complex data jobs and workflows, meeting business requirements efficiently. This includes day-end SLA jobs to ensure timely data processing. Security and Access Control: Manage security measures such as Kerberos authentication, safeguarding Hadoop clusters and data in both CDP and CDH environments. Implement and m...

Role Overview: You will be joining the Technology, Data, and Innovation (TDI) Private Bank team as a GCP - Senior Engineer in Pune. Your main focus will be on Partner data, the central client reference data system in Germany, involving mainframe, on-premise cloud, restful services, and an angular frontend. Your responsibilities will include the implementation of new projects on GCP, migration of current functionalities to Google Cloud, ensuring application landscape stability, and supporting software releases. Additionally, you will be involved in coding as part of an agile team in the CTM area. Key Responsibilities: - Implement new projects on GCP (Spark, Dataproc, Dataflow, BigQuery, Terra...

Project Role :Custom Software Engineer Project Role Description :Design, build and configure applications to meet business process and application requirements. Must have skills :Apache Hadoop Good to have skills :Python (Programming Language) Minimum 3 year(s) of experience is required Educational Qualification :15 years full time education Summary:As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing innovative solutions, and ensuring that applications are opt...

As a Data Architect at Niveus Solutions, you will be responsible for designing, building, and maintaining robust data platforms on Azure and GCP to drive business growth and decision-making. **Key Responsibilities:** - Develop and implement comprehensive data architectures, including data warehouses, data lakes, and data lake houses on Azure and GCP platforms. - Design and create data models aligning with business requirements for efficient data analysis and reporting. - Develop and optimize ETL/ELT pipelines using tools like Databricks, Azure Data Factory, or GCP Data Fusion. - Design and implement scalable data warehouses on Azure Synapse Analytics or GCP BigQuery for enterprise reporting ...

Project Role : Security Architect Project Role Description : Define the cloud security framework and architecture, ensuring it meets the business requirements and performance goals. Document the implementation of the cloud security controls and transition to cloud security-managed operations. Must have skills : Splunk Security Information and Event Management (SIEM) Good to have skills : Hadoop Administration Minimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Summary :The Analyst will be responsible for supporting the day-to-day operations, maintenance, and optimization of QRadar, Splunk, and Hadoop platforms. The role focuses on ensuring pla...

We are unencumbered and will need your contribution to make it a world class engineering center with the focus on excellence. Bachelor's or Master's degree in Computer Science Engineering or related field 12+ years of experience in the software industry with 3+ years in Engineering Management leading agile teams on design, development, and delivery of highly scalable products. Strong, demonstrable track record for hiring and retaining top-tier talent. Outstanding verbal and written communication skills with the ability to clearly communicate a vision and get people invested in success. Exposure to the process and nuances of operationalising and supporting products and services used by thousa...

You will be responsible for architecting and implementing scalable offline data pipelines for manufacturing systems, including AMHS, MES, SCADA, PLCs, vision systems, and sensor data. Your role will involve designing and optimizing ETL/ELT workflows using Python, Spark, SQL, and orchestration tools like Airflow to transform raw data into actionable insights. Additionally, you will lead database design and performance tuning across SQL and NoSQL systems, optimizing schema design, queries, and indexing strategies for manufacturing data. To enforce robust data governance, you will implement data quality checks, lineage tracking, access controls, security measures, and retention policies. You wi...

Role Overview: You will be responsible for developing and maintaining Java applications, REST APIs, and Spring Boot services. Additionally, you will be required to work on front-end technologies such as Angular JS, React JS, or Vue JS. Your role will involve handling data cleaning, visualization, and reporting tasks while ensuring smooth operations in an agile environment. Your strong analytical and problem-solving skills will be crucial in this role, along with effective communication and interpersonal abilities. Key Responsibilities: - Develop and maintain Java applications, REST APIs, and Spring Boot services. - Work on front-end technologies like Angular JS, React JS, or Vue JS. - Handle...

Develop, test, and deploy data processing applications using Apache Spark and Scala. Optimize and tune Spark applications for better performance on large-scale data sets. Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions. Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions. Design and implement high-performance data processing and analytics solutions. Ensure data integrity, accuracy, and security across all processing tasks. Troubleshoot and resolve performance issues in Spark, Cloudera, and related technologies. Implement version control an...

Greetings Everyone We are seeking a big data engineer with Java experience to join our modernization initiative team. The candidate will be responsible for implementing and maintaining high volume online and offline batch and transactional client facing applications in cloud and On-prem. Candidate will also responsible for the creation and maintenance of our Code & database infrastructure, including collecting and maintaining data, ensuring the integrity of our data, and training data models. Responsibilities: * Design and implement efficient data handling system based on Java and Spark. * Perform and oversee tasks such as programming, writing scripts, calling APIs, and writing complex SQL q...

Key Responsibilities: Develop, test, and deploy data processing applications using Apache Spark and Scala. Optimize and tune Spark applications for better performance on large-scale data sets. Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions. Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions. Design and implement high-performance data processing and analytics solutions. Ensure data integrity, accuracy, and security across all processing tasks. Troubleshoot and resolve performance issues in Spark, Cloudera, and related technologies. Implem...

We are seeking a highly skilled and motivated Big Data Engineer to join our data engineering team The ideal candidate will have hands-on experience with Hadoop ecosystem, Apache Spark, and programming expertise in Python (PySpark), Scala, and Java You will be responsible for designing, developing, and optimizing scalable data pipelines and big data solutions to support analytics and business intelligence initiatives

As a Mid/Senior Software Engineer at this company, your role will involve developing and maintaining the Data Management Platform within the Big Data Team. You will work alongside a cross-functional international Agile team comprising skilled engineers, product managers, and leaders across multiple global locations. Your primary programming language will be Java/Scala, with a focus on tasks within the Hadoop ecosystem. Key Responsibilities: - Autonomously develop well-defined tasks, test, and deploy code changes and services - Collaborate with and learn from other teammates - Follow Adform and team coding and testing practices - Actively participate in Scrum ceremonies, raise questions, and ...

As a member of Apple's Data Services Data Analytics and Engineering team, your role will involve designing, architecting, engineering, and mentoring in Big Data and MPP technologies. You will have the opportunity to lead the development and management of new solutions using cutting-edge technologies like SingleStore, Vertica, Clickhouse, and Doris across different environments. Your responsibilities will include creating scalable and robust systems that adapt to evolving business requirements, optimizing system/datastore performance, developing proofs of concept for emerging technologies, and recommending tools and processes to accelerate the development and maintenance of Analytics workload...

Role Overview: You will be responsible for utilizing your strong experience in PySpark, Python, and Unix scripting to work on data processing tasks. Your expertise in SparkSQL and Hive will be essential in writing SQLs and creating views. Additionally, your excellent communication skills will be valuable in collaborating with team members. Knowledge of the Insurance domain is a plus, along with a good understanding of the Hadoop Ecosystem and Architecture, including HDFS, Map Reduce, Pig, Hive, Oozie, and Yarn. You will also need familiarity with AWS services such as Glue, AWS S3, Lambda function, Step Function, and EC2. Data migration exposure from platforms like Hive/S3 to Data Bricks will...

About The Role : Job Title - GCP - Senior Engineer - PD Location - Pune Role Description Our team is part of the area Technology, Data, and Innovation (TDI) Private Bank. Within TDI, Partner data is the central client reference data system in Germany. As a core banking system, many banking processes and applications are integrated and communicate via >2k interfaces. From a technical perspective, we focus on mainframe but also build solutions on premise cloud, restful services, and an angular frontend. Next to the maintenance and the implementation of new CTB requirements, the content focus also lies on the regulatory and tax topics surrounding a partner/ client. We are looking for a very mot...

Position Summary To be a technology expert architecting solutions and mentoring people in BI / Reporting processes with prior expertise in the Pharma domain. Job Responsibilities o Technology Leadership Lead guide the team independently or with little support to design, implement deliver complex reporting and BI project assignments. o Technical portfolio Expertise in a range of BI and hosting technologies like the AWS stack (Redshift, EC2), Qlikview, QlikSense, Tableau, Microstrategy, Spotfire o Project Management Get accurate briefs from the Client and translate into tasks for team members with priorities and timeline plans. Must maintain high standards of quality and thoroughness. Should b...

At Sogeti, we believe the best is inside every one of us. Whether you are early in your career or at the top of your game, we’ll encourage you to fulfill your potential?to be better. Through our shared passion for technology, our entrepreneurial culture , and our focus on continuous learning, we’ll provide everything you need to do?your best work and become the best you can be. ? Your Role Design and develop data pipelines using Hadoop ecosystem and GCP tools. Implement Spark/Scala/PySpark jobs for data transformation and aggregation. Ensure code quality through peer reviews and unit testing. Collaborate with Business Analysts and manage smooth production deployments. Strong experience in Ha...

We are looking for a Senior Big Data Engineer with deep expertise in large-scale data processing technologies and frameworks. This is a remote, contract-based position suited for a data engineering expert with strong experience in the Big Data ecosystem including Snowflake (Snowpark), Spark, MapReduce, Hadoop, and more. Key Responsibilities Design, develop, and maintain scalable data pipelines and big data solutions Implement data transformations using Spark, Snowflake (Snowpark), Pig, and Sqoop Process large data volumes from diverse sources using Hadoop ecosystem tools Build end-to-end data workflows for batch and streaming pipelines Optimize data storage and retrieval processes in HBase, ...