52 Hadoop Ecosystem Jobs

As a Business Analytics Analyst (Officer) in the Internal Audit Analytics Team at Citi, your role involves working with the Digital Solutions and Innovation (DSI) team within the Citi Internal Audit Innovation function to identify opportunities, design, develop, and implement analytics to support audit activities. Your proficiency in analytics technology and tools will contribute to enhancing audit efficiency and effectiveness while having a functional knowledge of banking processes and related risks and controls. **Key Responsibilities:** - Participate in the innovative use of audit analytics through direct involvement in all audit phases. - Support defining data needs, designing, and execu...

Job Title: Hadoop Administrator Location: Chennai, India Experience: 4+yrs of experience in IT, with At least 3+ years of experience with cloud and system administration. At least 3 years of experience with and strong understanding of big data technologies in Hadoop ecosystem Hive, HDFS, Map/Reduce, Flume, Pig, Cloudera, HBase Sqoop, Spark etc. Company: Smartavya Analytica Private limited is a niche Data and AI company. Based in Pune, we are pioneers in data-driven innovation, transforming enterprise data into strategic insights. Established in 2017, our team has experience in handling large datasets up to 20 PBs in a single implementation, delivering many successful data and AI projects acr...

As a Business Analytics Int Analyst at Citi, you will be part of the Digital Solutions and Innovation team within the Citi Internal Audit Innovation function. Your role will involve working with members of Internal Audit to identify opportunities, design, develop, and implement analytics to support audit activities, as well as automation activities to enhance efficiency and expand coverage. You will need to be proficient in analytics technology and tools, have functional knowledge of banking processes, and related risks and controls. **Key Responsibilities:** - Participate in the innovative use of audit analytics through all phases of audits - Support defining data needs, designing, and exec...

As a Senior Spark Data Engineer at Barclays, you will play a crucial role in the evolution of the digital landscape, driving innovation and excellence. Your main responsibilities will include: - Designing, building, and maintaining data processing systems using Apache Spark and related big data technologies. - Ensuring data quality, integrity, and security throughout the data lifecycle. - Developing and maintaining data processing frameworks and reusable components. - Creating and maintaining documentation for data pipelines and processes. - Supporting the migration of legacy data processing systems to modern big data platforms. - Utilizing technologies such as Spark, Hive, Solace, Kafka, Ja...

As a Data Engineer in our company, your role will involve designing and implementing data migration, ingestion, processing, and analytics pipelines using a variety of technologies including AWS (S3, Glue, Lambda, Athena, RDS Aurora, Databricks) and Azure (ADF, ADLS, Synapse, Databricks). You will be expected to apply your strong expertise in SQL, data modeling, schema design, and data quality management. Additionally, you will need to ensure governance, security, compliance, metadata management, MDM, and data catalog practices are followed. Working with big data, NoSQL, relational DBs, and data warehouse solutions will be part of your responsibilities. Building real-time pipelines with Kafka...

As an Applications Development Senior Programmer Analyst at Citi, you will be responsible for participating in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. Your role will involve contributing to applications systems analysis and programming activities. You will have the opportunity to work on various tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establishing new or revised applications systems to meet specific business needs. Additionally, you will monitor and control all phases of the development process, provide...

As a Senior Architect AI/ML, you will be leading cutting-edge data and AI solution initiatives leveraging your expertise of over 10 years. Your role will be crucial in architecting enterprise-grade AI/ML platforms and implementing GenAI technologies. This will involve designing cloud-native data pipelines and ensuring scalable solutions from data ingestion to inference. Collaboration with cross-functional teams will be essential to align data and AI strategies with business requirements. - Architect and deploy AI models utilizing platforms like MLflow, Azure ML, SageMaker, and KubeFlow. - Design cloud-based big data architectures on Azure, AWS, or GCP. - Provide guidance on Gen AI integratio...

As an Applications Development Technology Lead Analyst at our company, your role involves establishing and implementing new or revised application systems and programs in coordination with the Technology team. Your main objective will be to develop and lead applications systems analysis and programming activities. **Responsibilities:** - Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements - Resolve a variety of high-impact problems/projects through an in-depth evaluation of complex business processes, system processes, and industry stand...

As an Assistant Vice President - Internal Audit_Business Analyst at Citi, you will have the opportunity to shape your career and contribute to the global function of Citi Internal Audit (IA). You will be part of the Digital Solutions and Innovation (DSI) team within the Citi Internal Audit Innovation (IA) function, specifically as a Business Analyst. Your main responsibility will be to join the IA Centralized Analytics Team and ensure that Internal Audit members have the necessary technology, governance, and analytics platform to enhance audit activities effectively and efficiently. - Participate in designing and delivering innovative tools for Auditors - Demonstrate subject matter expertise...

Role Overview: As an Infra and DevOps Engineer at DWS India in Pune, you will play a crucial role in providing top-notch shared services across build, release, and QA Automation domains. Your responsibilities will involve collaborating with various stakeholders to enhance project delivery by building and maintaining non-prod and prod environments, setting up alerting and monitoring systems, and overseeing the transition of projects to L2 support teams post-Go Live. Key Responsibilities: - Drive automation processes including automated build, test, and deployment - Support and manage Data/Digital systems architecture in alignment with the architectural vision set by the Digital Design Organiz...

Role Overview: You will be joining the ICG TTS Operations Technology (OpsTech) Group to assist in the implementation of the next generation Digital Automation Platform and Imaging Workflow Technologies. Your role as a Lead Spark Scala Engineer will involve managing development teams in the distributed systems Eco-System and collaborating effectively as a team player. Your primary objective will be to contribute to applications, systems analysis, and programming activities. Key Responsibilities: - Develop, test, and deploy production-grade Spark applications in Scala, ensuring optimal performance, scalability, and resource utilization. - Provide technical leadership and guidance to a team of ...

As a Senior Data Engineer (Scala) at EY in the Advisory - Data and Analytics team, you will play a crucial role in leveraging your expertise in the Financial Services domain to solve complex issues and capitalize on opportunities that deliver better outcomes for businesses. Your primary responsibilities will include: - Demonstrating strong knowledge in Spark, with a good understanding of the Spark framework and performance tuning. - Proficiency in Scala & SQL to effectively work with data. - Exposure to at least one of the Cloud technologies - GCP/ Azure/ AWS. - Designing, building, and maintaining scalable data pipelines and solutions to efficiently manage and process large datasets. - Taki...

Role Overview: As the Applications Development Group Manager at our company, you will be a senior management level position responsible for leading a team to establish and implement new or revised application systems and programs in coordination with the Technology Team. Your main objective will be to drive applications systems analysis and programming activities. Key Responsibilities: - Manage multiple teams of professionals to achieve established goals and handle personnel duties for the team such as performance evaluations, hiring, and disciplinary actions - Provide strategic influence, exercise control over resources, budget management, and planning, while monitoring end results - Utiliz...

Role Overview: You will be working as a Lead Spark Scala Engineer under ICG TTS Operations Technology (OpsTech) Group to help in the implementation of the next generation Digital Automation Platform and Imaging Workflow Technologies. Your role will involve managing development teams in the distributed systems Eco-System and being a strong team player. It is expected that you will have superior technical knowledge of current programming languages, technologies, and other leading-edge development tools to contribute to applications, systems analysis, and programming activities. Key Responsibilities: - Develop, test, and deploy production-grade Spark applications in Scala, ensuring optimal perf...

As a Pre-Sales Solution Engineer in India, your role will involve engaging with customers in the evaluation process, conducting product demonstrations, and supporting marketing activities. Your main focus will be on pre-sales experience with software or analytics products, demonstrating expertise in various technical skills and tools such as: - OLAP - Microsoft Analysis services - Data engineering - ETL - Hadoop ecosystem - AWS, Azure, GCP Cluster - Tableau, Microstrategy, BI tools - Hive QL, Spark SQL, PLSQL, TSQL, SQL programming - MDX queries - Linux, Python, Java, and JavaScript You will act as the primary point of contact for customer interactions, handle product demonstrations for pote...

As an Applications Development Senior Programmer Analyst at our company, you will play a crucial role in establishing and implementing new or revised application systems and programs in coordination with the Technology team. Your main objective will be to contribute to applications systems analysis and programming activities. Your responsibilities will include: - Conducting tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establishing and implementing new or revised applications systems and programs to meet specific business needs or user areas. - Monitoring and controlling all phases of the developm...

**Job Description:** As a Java Developer at our company, you will be responsible for developing and maintaining Java applications with a focus on REST API and Spring Boot. Your primary responsibilities will include: - Utilizing your 8 to 10 years of experience in Java, REST API, and Spring Boot to design and implement robust and scalable solutions. - Demonstrating hands-on experience in Angular JS, React JS, or View JS to enhance the user interface and overall user experience. - Collaborating with cross-functional teams to ensure the successful delivery of projects in an agile environment. - Applying your expertise in data cleaning, visualization, and reporting to extract actionable insights...

As a Mid/Senior Software Engineer at our company, you will play a crucial role in developing and maintaining the Data Management Platform within the Big Data Team. You will be an integral part of a cross-functional international Agile team consisting of talented engineers, product managers, and leaders across various locations globally. Your primary programming language will be Java/Scala, and the majority of your work will revolve around the Hadoop ecosystem. **Role Overview:** - As a Mid/Senior Software Engineer, you will have a significant impact on the team by contributing to the development and management of high scale/load distributed systems. Your work will provide essential data to k...

About You: You are a numbers person with proven attention to detail. You enjoy taking data and turning into a solution. You are a troubleshooter and passionate about what you do. What You'll Do: Work with data scientists and software engineers to support data quality initiatives, data solution ideation, and implementation Work with technical and business leads to transfer global business requirements into sound solutions and implementation Share support responsibilities for implemented components What You'll Need: 3+ years of demonstrated ability with Hive, Python, Spark/Scala, SQL, etc. Google Cloud Platform Experience, Big Query, Cloud Storage, Dataproc, Data Flow, Cloud Composer, Cloud SQ...

As an individual with expertise in Neo4j, your role will involve designing and implementing graph database solutions. This includes creating and maintaining graph schemas, models, and architectures, as well as developing and deploying graph-based solutions using Neo4j. You will be responsible for defining data models, creating nodes, relationships, and properties, and implementing Cypher queries for data retrieval and manipulation. Migrating data from relational or other databases into Neo4j will also be a key aspect of your responsibilities. Additionally, optimizing Cypher queries for performance and integrating Neo4j with BI and other systems will be part of your duties. Key Responsibiliti...

Job Title: Hadoop Administrator Location: Chennai, India Experience: 5 yrs of experience in IT, with At least 2+ years of experience with cloud and system administration. At least 3 years of experience with and strong understanding of big data technologies in Hadoop ecosystem Hive, HDFS, Map/Reduce, Flume, Pig, Cloudera, HBase Sqoop, Spark etc. Company: Smartavya Analytica Private limited is a niche Data and AI company. Based in Pune, we are pioneers in data-driven innovation, transforming enterprise data into strategic insights. Established in 2017, our team has experience in handling large datasets up to 20 PBs in a single implementation, delivering many successful data and AI projects acr...

Role Overview: As an Applications Development Senior Programmer Analyst at our company, you will be responsible for participating in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. Your main objective will be to contribute to applications systems analysis and programming activities. Key Responsibilities: - Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas - Monitor and control all phases of devel...

Role Overview: At Goldman Sachs, you will be part of the Engineering team that focuses on solving challenging engineering problems for clients and building massively scalable software and systems. You will have the opportunity to connect people and capital with ideas, guard against cyber threats, and leverage machine learning to turn data into action. As an Engineer at Goldman Sachs, you will play a crucial role in transforming finance and exploring various opportunities in a dynamic environment that requires innovative strategic thinking. Key Responsibilities: - Curate, design, and catalogue high-quality data models to ensure accessibility and reliability of data - Build highly scalable dat...

Core Requirements 8+ years with Linux, Bash, Python, SQL. 4+ years with Spark, Hadoop ecosystem, and team leadership. Strong AWS experience: EMR, Glue, Athena, Redshift. Proven expertise in designing data flows and integration APIs. Passion for solving complex problems using modern tech. Preferred Skills Degree in CS or related field. Python, C++, or similar programming language. Experience with petabyte-scale data, data catalogs (Hive, Glue), and pipeline tools (Airflow, dbt). Familiarity with AWS and/or GCP.

As a Big Data Engineer at our company, you will be an integral part of our data engineering team. Your primary responsibility will be to design, develop, and optimize scalable data pipelines and big data solutions. To excel in this role, you should have hands-on experience with the Hadoop ecosystem, Apache Spark, and programming languages such as Python (PySpark), Scala, and Java. Your expertise in these technologies will enable you to support analytics and business intelligence initiatives effectively. By leveraging your skills, you will contribute to the success of our data-driven projects and help drive insights that can positively impact our business. If you are a highly skilled and moti...