393 Apache Nifi Jobs - Page 8

Position Description: 8 - 12 years of Experience with java Full Stack Technical Skills: Strong expertise with Core Java, Microservice Architecture, Spring Boot. Good understanding of Cloud based technologies, Good to have knowledge of Camunda, Kafka, Apache NIFI and Angular. We are looking for senior full stack Java Developer to join our awesome team and deliver a streamlined user experience. We want a team member who strives to develop a first class codebase using industry best practices. As a full stack Developer, you will implement a complete end to end functionality for both Backend and front end. Perform product analysis and development tasks of increasingly complex nature which may req...

Lead Software Engineer - Apache Nifi, Python, PySpark, Hadoop, Cloudera platforms, and Airflow Title and Summary Lead Software Engineer - Apache Nifi, Python, PySpark, Hadoop, Cloudera platforms, and AirflowWho is Mastercard? Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments, and businesses realize their greatest potential. Our decency quotient, or DQ, drives our culture and e...

Overview This position is for Lead Data Engineer in the Commercial Data as a Service group. In this position you will enjoy being responsible for helping define and maintain the data systems key to delivering successful outcomes for our customers. You will be hands on and work closely to guide a team of Data Engineers in the associated data maintenance, integrations, enhancements, loads and transformation processes for the organization. This key individual will work closely with Data Architects to design and implement solutions and insure successful implementations. Role Leads initiatives to build and maintain database technologies, environments, and applications, seeking opportunities for i...

Overview Mastercard is looking for a Senior Software Engineer to join the Account Level Management(ALM) team in our Pune office thats focused on building ALM Services with Data warehouse skills. The Mastercard Account Level Management platform empowers real-time card level decisioning. As consumers progress along their life stages as card holders, with increasing disposable income and more refined preferences, ALM provides services to issuers so they can effectively offer more relevant benefits and rewards at each stage, to drive loyalty and spend. Role o Develop high quality, secure and scalable data pipelines using spark, Scala/Python/Java on Hadoop or object storage like MinIO. o Leverage...

Overall Responsibilities Design, develop, and maintain scalable data pipelines and architectures to support analytical and operational needs Implement data integration solutions, ensuring high data quality, security, and compliance standards Collaborate with data scientists, analysts, and engineering teams to translate business requirements into technical solutions Optimize data workflows for performance, reliability, and cost-efficiency in cloud environments Develop and enforce best practices for data governance, security, and privacy Lead efforts in automating data processes and providing documentation for data systems Monitor data system performance, troubleshoot issues, and implement imp...

BMC is looking for a Product Owner to join our amazing team! The BMC AMI Cloud Analytics product can quickly transfer, transform, and integrate mainframe data so it could be shared with the organizational data lake to be used by artificial intelligence, machine learning (AI/ML) and analytics solutions. In this role, you will lead the transformation of this cutting-edge product originally developed by Model9, a startup acquired by BMC, into a solution designed to meet the rigorous demands of enterprise customers. This exciting opportunity combines innovation, scalability, and leadership, giving you a chance to shape the products evolution as it reaches new heights in enterprise markets. Youll...

Title and Summary Lead Data EngineerOverview We are the global technology company behind the worlds fastest payments processing network. We are a vehicle for commerce, a connection to financial systems for the previously excluded, a technology innovation lab, and the home of Priceless. We ensure every employee has the opportunity to be a part of something bigger and to change lives. We believe as our company grows, so should you. We believe in connecting everyone to endless, priceless possibilities. Our team within Mastercard Services: The Services org is a key differentiator for Mastercard, providing the cutting-edge services that are used by some of the world's largest organizations to mak...

Title and Summary Senior Specialist, Product DevelopmentAbout Mastercard: Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships, and passion, our innovations and solutions help individuals, financial institutions, governments, and businesses realize their greatest potential. Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company. With connections across more than 210 countries and territories, we are building a sustainable world...

Overview This position is for Manager Data Engineering in the Commercial Data as a Service group. In this position you will enjoy being responsible for helping define and maintain the data systems key to delivering successful outcomes for our customers. will lead a software development team focused on our core services someone who combines deep technical experience with great people management skills and can help elevate our teams and our approach to engineering. We are building a culture that fosters innovation, built on a foundation of inclusion and diversity. We are looking for a candidate that has proven experience in coding, architecture leadership, and leading engineers in a fast-paced...

We are looking for an innovative software engineering lead who will lead the technical design and development of an Analytic Foundation. The Analytic Foundation is a suite of individually commercialized analytical capabilities (think prediction as a service, matching as a service or forecasting as a service) that also includes a comprehensive data platform. These services will be offered through a series of APIs that deliver data and insights from various points along a central data store. This individual will partner closely with other areas of the business to build and enhance solutions that drive value for our customers. Engineers work in small, flexible teams. Every team member contribut...

Overview Mastercard Data Warehouse builds and supports various analytics and reporting platform that includes Domo, Power BI, Tableau, SSRS and WebFOCUS. The ecosystem also includes Microsoft BI stack involving SSAS & SSIS and Alteryx ETL tool. Role Work with cross-functional agile teams that include Front-end Developers, Report/BI Developers and Product Owners to implement the next generation of enterprise application Identify and resolve performance bottlenecks proactively Work with the customer support group as needed to resolve performance issues in the field Explore automation opportunity and develop tools to automate some of the day to day operations tasks Provide performance metrics a...

Position Description: We are looking for a Java Full Stack Developer (13 years' experience) with strong skills in Core Java, Spring Boot, and Microservices to develop scalable backend services and contribute to frontend development. Familiarity with cloud technologies and tools like Angular, Kafka, or Camunda is a plus. Your future duties and responsibilities: Develop, test, and maintain high-quality, scalable, and maintainable Java-based backend services using Core Java, Spring Boot, and Microservices Architecture. Support front-end development using modern web technologies; Angular knowledge is a plus. Assist in building cloud-native applications and contribute to the deployment process us...

The Universal Data Catalog (UDC) / Visa Data Catalog (VDC) is a comprehensive metadata management platform designed to provide a centralized repository for all data-related information across the organization. The platform enables efficient data discovery, governance, and utilization by offering detailed metadata definitions for tables, columns, and other data assets. It supports various business units by improving data accessibility, enhancing data quality, and facilitating compliance with data governance policies. Our implementation leverages the open-source Datahub project, ensuring a robust, flexible, and scalable solution. Key Responsibilities Develop and maintain the Enterprise Data Ca...

The Natural Language Query (NLQ) platform is an innovative initiative designed to transform the way users interact with data. Our platform leverages advanced natural language processing (NLP) to convert user queries in plain language into executable SQL queries, enabling seamless data retrieval and analysis without the need for SQL expertise. The NLQ platform will be powered by the Enterprise Data Catalog, ensuring comprehensive and accurate metadata definitions for all table and column information. This platform empowers different business units to build external-facing conversational BI chatbots to handle customer requests, while also significantly reducing data exploration efforts for int...

As a Fullstack Developer, you will be based in Bangalore and will be responsible for developing web applications using Java, Springboot, React, and PostgreSQL or any other Relational database. Additionally, you will work with Kafka for real-time data processing. Developers with additional skills in Apache Nifi or Apache Spark will be preferred for this role. If you are passionate about fullstack development and have experience with the mentioned technologies, we encourage you to apply for this exciting opportunity.,

Job Title: Senior Data Engineer Company Name: NCSi Job Description: NCSi is seeking a highly skilled Senior Data Engineer to join our dynamic team. In this role, you will be responsible for designing, developing, and optimizing data pipelines and architectures to support our data-driven initiatives. You will collaborate with cross-functional teams to understand data requirements and implement robust solutions that enhance data accessibility and reliability. The ideal candidate should have a strong background in data engineering and a passion for transforming raw data into actionable insights. Key Responsibilities: - Design, build, and maintain scalable data pipelines and ETL processes. - Col...

As a skilled professional with over 7 years of experience, you will be responsible for reviewing and understanding business requirements to ensure timely completion of development tasks with rigorous testing to minimize defects. Collaborating with a software development team is crucial to implement best practices and enhance the performance of Data applications, meeting client needs effectively. In this role, you will collaborate with various teams within the company and engage with customers to comprehend, translate, define, and design innovative solutions for their business challenges. Your tasks will also involve researching new Big Data technologies to evaluate their maturity and alignme...

As a Data Engineering Lead, you will be responsible for developing and implementing data engineering projects, including enterprise data hubs or Big data platforms. Your role will involve defining reference data architecture, leveraging cloud-native data platforms in AWS or Microsoft stack, and staying updated on the latest data trends like data fabric and data mesh. You will play a key role in leading the Center of Excellence (COE) and influencing client revenues through innovative data and analytics solutions. Your responsibilities will include guiding a team of data engineers, overseeing the design and deployment of data solutions, and strategizing new data services and offerings. Collabo...

As a Data Engineer with 5 years of experience, you will be based in Noida and work in a hybrid mode. Your responsibilities will include working with AWS/Azure, ETL processes, SQL, Databricks, Python/Scala, Py-Spark/Spark, Apache Nifi, and Hive.,

As an Infrastructure Lead/Architect at our organization, you will be responsible for architecting, designing, and implementing cutting-edge cloud infrastructure solutions. Your role will be crucial in driving cloud and data platform initiatives, ensuring system scalability and security, and providing technical leadership to shape the foundation of our mission-critical applications. Your key responsibilities will include designing and implementing robust, scalable, and secure AWS cloud infrastructure utilizing services like EC2, S3, Lambda, RDS, Redshift, and IAM. You will lead the end-to-end deployment of high-performance Databricks data pipelines and develop data integration workflows using...

Required Skills & Experience: Mandatory: Hands-on experience with MarkLogic. Strong expertise in Apache NiFi for data integration and orchestration. Cloud experience, preferably Azure (Data Factory, Data Lake, Functions, etc.). Proven experience in REST API design & development. Familiarity with Git Bash, Gradle, and any modern IDE (IntelliJ, Eclipse, VS Code, etc.). Prior experience working as part of a DevOps team with CI/CD practices. Excellent problem-solving and communication skills. Madatory: Marklogics

As a Backend Engineer, you will be responsible for architecting and constructing intricate, scalable, and high-performance backend systems. Your role will involve overseeing the complete development and deployment process of features and enhancements. You will be tasked with designing and refining extensive distributed data processing using technologies such as Apache Spark and Nifi. Collaboration with product managers, architects, and various stakeholders to ensure alignment on technical objectives will be a key aspect of your responsibilities. Additionally, you will lead code reviews to guarantee adherence to best practices and maintain high code quality standards. A crucial part of your r...

As a Senior Cloud Data Developer, you will play a crucial role in bridging the gap between data engineering and cloud-native application development. Your primary responsibility will be to design and maintain scalable data solutions in the cloud by leveraging cutting-edge technologies and modern development practices. You will be tasked with developing data-centric applications using Java Spring Boot and various AWS services. Your expertise will be essential in creating and managing efficient data pipelines, ETL processes, data workflows, and orchestrating data processing systems. Real-time data processing solutions using AWS SNS/SQS and AWS Pipes will be a key part of your role. Additionall...

As a Senior Big Data Developer specializing in PySpark, with a robust 57 years of experience, you will be responsible for designing, developing, and optimizing scalable data pipelines. Collaboration with cross-functional teams is essential to deliver reliable, high-performance data solutions in the Apache Big Data ecosystem. Your primary responsibilities will encompass building and enhancing large-scale data processing pipelines using PySpark, working with tools like Apache Hadoop, Hive, HDFS, Spark, and more to manage big data workloads efficiently. Additionally, you will be engaged in ETL development, data ingestion, transformation, integration from diverse sources, and collaborating with ...

About the Role: OSTTRA India The Role Enterprise Architect - Integration The Team The OSTTRA Technology teamis composed of Capital Markets Technology professionals, who build,supportand protect the applications that operate our network. The technology landscapeincludeshigh-performance, high-volume applications as well as compute intensive applications,leveragingcontemporary microservices, cloud-based architectures. The Impact: Together, we build, support, protect and manage high-performance, resilient platforms that process more than 100 million messages a day. Our services are vital to automated trade processing around the globe, managing peak volumes and working with our customers and regu...