249 Apache Nifi Jobs - Page 4

This Position reports to: BL technology Manager, Digital In this role, you will have the opportunity to initiate and drive technology, software, product, and/or solution development using in-depth technical expertise in a specific area. Each day, you will act as the first point of contact in Research and Development (R&D) for in-depth product or technology-related issues. You will also showcase your expertise by supporting strategic corporate technology management and future product/software/solution architecture. This role is contributing to the Process Automation Business of Process Industry Division in Bangalore . You will be mainly accountable for: Architect and implement AI, ML, and Gen...

Overview of the Company: Jio Platforms Ltd. is a revolutionary Indian multinational tech company, often referred to as India's biggest startup, headquartered in Mumbai. Launched in 2019, it's the powerhouse behind Jio, India's largest mobile network with over 400 million users. But Jio Platforms is more than just telecom. It's a comprehensive digital ecosystem, developing cutting-edge solutions across media, entertainment, and enterprise services through popular brands like JioMart, JioFiber, and JioSaavn. Join us at Jio Platforms and be part of a fast-paced, dynamic environment at the forefront of India's digital transformation. Collaborate with brilliant minds to develop next-gen solutions...

About the job : NP : Imm-15 days Rounds : 3 Rounds (Virtual) Mandate Skills : Apache spark, hive, Hadoop, spark, scala, Databricks The Role : - Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. - Constructing infrastructure for efficient ETL processes from various sources and storage systems. - Leading the implementation of algorithms and prototypes to transform raw data into useful information. - Architecting, designing, and maintaining database pipeline architectures, ensuring readiness for AI/ML transformations. - Creating innovative data validation methods and data analysis tools. - Ensuring compliance wit...

The Data Warehouse BizOps team is looking for a Site Reliability Engineer who can help us solve problems and enhance our capabilities by supporting applications, services, and platforms. This position is to support the Data Delivery and Analytics program to support the growing need of the product like MyMPA, QMR. Tech Skills: Unix, Shell Scripting, SQL, Python, Apache Nifi, Splunk, Dynatrace, Jenkins, GIT, XLR etc. We regularly review our run state not only from an internal perspective, but also understanding and providing the feedback loop to our development partners on how we can improve the customer experience of our applications. Responsibilities: Engage in and improve the whole lifecycl...

Your future role Take on a new challenge and apply your data engineering expertise in a cutting-edge field. Youll work alongside collaborative and innovative teammates. You'll play a key role in enabling data-driven decision-making across the organization by ensuring data availability, quality, and accessibility. Day-to-day, youll work closely with teams across the business (e.g., Data Scientists, Analysts, and ML Engineers), mentor junior engineers, and contribute to the architecture and design of our data platforms and solutions. Youll specifically take care of designing and developing scalable data pipelines, but also managing and optimizing object storage systems. Well look to you for: D...

Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : A Engineering graduate preferably Computer Science graduate 15 years of full time education Summary :Overall 7+ years of experience In Industry including 4 Years of experience As Developer using Big Data Technologies like Databricks/Spark and ...

As a Senior Software Engineer - ETL - Python at Incedo, you will be responsible for designing and developing ETL workflows to extract, transform, and load data from various sources to target systems. You will work with data analysts and architects to understand business requirements and translate them into technical solutions. You will be skilled in ETL tools such as Informatica or Talend and have experience in programming languages such as SQL or Python. You will be responsible for writing efficient and reliable code that is easy to maintain and troubleshoot. Roles & Responsibilities: Develop, maintain, and enhance software applications for Extract, Transform, and Load (ETL) processes Desig...

Role Description As a Senior Software Engineer - ETL - Python at Incedo, you will be responsible for designing and developing ETL workflows to extract, transform, and load data from various sources to target systems. You will work with data analysts and architects to understand business requirements and translate them into technical solutions. You will be skilled in ETL tools such as Informatica or Talend and have experience in programming languages such as SQL or Python. You will be responsible for writing efficient and reliable code that is easy to maintain and troubleshoot. Roles & Responsibilities: Develop, maintain, and enhance software applications for Extract, Transform, and Load (ETL...

As a Senior Software Engineer - ETL - Python at Incedo, you will be responsible for designing and developing ETL workflows to extract, transform, and load data from various sources to target systems. You will work with data analysts and architects to understand business requirements and translate them into technical solutions. You will be skilled in ETL tools such as Informatica or Talend and have experience in programming languages such as SQL or Python. You will be responsible for writing efficient and reliable code that is easy to maintain and troubleshoot. Roles & Responsibilities: Develop, maintain, and enhance software applications for Extract, Transform, and Load (ETL) processes Desig...

Role Description : As a Senior Software Engineer - ETL - Python at Incedo, you will be responsible for designing and developing ETL workflows to extract, transform, and load data from various sources to target systems. You will work with data analysts and architects to understand business requirements and translate them into technical solutions. You will be skilled in ETL tools such as Informatica or Talend and have experience in programming languages such as SQL or Python. You will be responsible for writing efficient and reliable code that is easy to maintain and troubleshoot. Roles & Responsibilities: Develop, maintain, and enhance software applications for Extract, Transform, and Load (E...

Role Description Provides leadership for the overall architecture, design, development, and deployment of a full-stack cloud native data analytics platform. Designing & Augmenting Solution architecture for Data Ingestion, Data Preparation, Data Transformation, Data Load, ML & Simulation Modelling, Java BE & FE, State Machine, API Management & Intelligence consumption using data products, on cloud Understand Business Requirements and help in developing High level and Low-level Data Engineering and Data Processing Documentation for the cloud native architecture Developing conceptual, logical and physical target-state architecture, engineering and operational specs. Work with the customer, user...

Data Engineer We're seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure that enable data-driven decision making across the organization. Key Responsibilities: Design and implement robust ETL/ELT pipelines for data ingestion, transformation, and loading Build and maintain data orchestration workflows using tools like Apache Airflow, NiFi, or similar platforms Perform comprehensive data cleansing, validation, and quality assurance processes Implement data security best practices including encryption, access controls, and compliance measures Configure and manage authentication systems and identity management solutions Monitor system performa...

We are seeking a highly skilled and motivated Big Data NiFi Developer to join our growing data engineering team in Pune. The ideal candidate will have hands-on experience with Apache NiFi, strong understanding of big data technologies, and a background in data warehousing or ETL processes. If you are passionate about working with high-volume data pipelines and building scalable data integration solutions, wed love to hear from you. Key Responsibilities: Design, develop, and maintain data flow pipelines using Apache NiFi. Integrate and process large volumes of data from diverse sources using Spark and NiFi workflows . Collaborate with data engineers and analysts to transform business requirem...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : O9 Solutions Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :- As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with various teams to understand their needs, developing innovative solutions, and ensuring that applications are aligned with business objectives. You will engage in problem-solving ac...

The Data Warehouse BizOps team is looking for a Site Reliability Engineer who can help us solve problems and enhance our capabilities by supporting applications, services, and platforms. This position is to support the Data Delivery and Analytics program to support the growing need of the product like MyMPA, QMR. Tech Skills: Unix, Shell Scripting, SQL, Python, Apache Nifi, Splunk, Dynatrace, Jenkins, GIT, XLR etc. We regularly review our run state not only from an internal perspective, but also understanding and providing the feedback loop to our development partners on how we can improve the customer experience of our applications. Responsibilities: Engage in and improve the whole lifecycl...

Mode: Hybrid (3days office) Shift: General YOE: 5+ Years Interview : 2 Rounds Virtual Duration: 12 -24 Months initial (Extended for another 12 Months) Skills Required: NIFI(Set up some login and monitor) Design, develop, and deploy data pipelines in Apache NiFi for ingesting streaming data from Axon(its internal name which MC named for NIFI NOT REQUIRED Axon) Data modelling Manage, store in SQL

You should have a Bachelors Degree in Computer Science, Computer Engineering or related technical field, while a Masters Degree or other advanced degree is preferred. With 4-6+ years of total experience, you should possess at least 2+ years of relevant experience in Big Data platforms. Your skill set should include strong analytical, problem solving, and communication/articulation skills. Furthermore, you are expected to have 3+ years of experience with big data and the Hadoop ecosystem, including Spark, HDFS, Hive, Sqoop, Hudi, Parquet, Apache Nifi, and Kafka. Proficiency in Scala/Spark is required, and knowledge of Python is considered a plus. Hands-on experience with Oracle and MS-SQL dat...

As a Senior Software Engineer within the Financial Crime Solutions team focused on Crypto at our organization, you will play a key role in shaping the technical direction of our powerful risk assessment tool, Crypto Secure. This tool aids banks in gaining deeper insights into crypto spend, transaction volumes, and AML risk exposure through an intuitive dashboard. You will have the opportunity to contribute to high-quality code, mentor fellow engineers, lead architecture discussions, and drive best practices across the team. Your responsibilities will include designing, developing, and maintaining scalable applications using technologies such as Java, Spring Boot, React, PostgresDB, Apache Ni...

As a Senior Software Development Tester, you will leverage your 6 to 8 years of relevant experience to contribute to our testing efforts. You should possess strong Java programming skills and a deep understanding of automation frameworks. Your expertise will be crucial in testing backend services, APIs, and data pipelines. The role requires a detail-oriented approach across the testing lifecycle, from strategy and planning to execution and continuous improvement. You will be responsible for designing, building, and maintaining test automation frameworks for backend APIs and microservices using Java. Your tasks will include developing and executing test plans, test cases, and automated script...

As a Lead Software Engineer at the Loyalty Rewards and Segments Organization within Mastercard, you will play a crucial role in designing, developing, testing, and delivering software frameworks for use in large-scale distributed systems. In this position, you will lead the technical direction, architecture, design, and engineering practices to create cutting-edge solutions in event-driven architecture and zero trust. Your responsibilities will include prototyping new technologies, designing and developing software frameworks using best practices, writing efficient code, debugging and troubleshooting to improve performance, and collaborating with cross-functional teams to deliver high-qualit...

As a Lead Software Engineer for Financial Crime Solutions (Crypto), you will have the opportunity to play a crucial role in the development and leadership of a powerful risk assessment tool called Crypto Secure. This tool aims to provide banks with enhanced visibility of crypto spend, transaction volumes, and AML risk exposure through a user-friendly dashboard. Your responsibilities will include leading technical execution and delivery by designing, developing, and maintaining scalable applications using Java, Spring Boot, React, PostgresDB, Apache NiFi, Hadoop, Snowflake, and other modern technologies. You will also be involved in breaking down high-level requirements into technical solutio...

We are seeking a highly skilled Integration Specialist proficient in Apache NiFi, Java, and Spring Boot to provide support to a leading bank in the UAE from our offshore development center. **Education:** A degree or post-graduate qualification in Computer Science or a related field is required, or equivalent industry experience. **Experience:** - Minimum 5 years of experience in implementing end-to-end integration solutions using NiFi processors. - Minimum 5 years of experience in Java and Spring Boot with Microservices. - Minimum 3 years of experience in application security including SSL Certificates and cryptography. - Minimum 2 years of experience in Distributed architecture. **Technica...

You have a unique opportunity to join as an Integration Architect specializing in Apache Nifi and Kubernetes. Your primary responsibilities will involve developing and performing automated builds, testing, and deployments in conjunction with Apache Nifi v2. This role requires a minimum of 15+ years of relevant experience and an in-depth understanding of various technologies and tools. Your expertise should include proficiency in the Linux CLI, extensive knowledge of SQL, and familiarity with ServiceNow CMDB. You must possess a good grasp of security principles, particularly OAuth basic/2.0, and IP networking concepts such as TCP, UDP, DNS, DHCP, firewalls, and IP routing. Additionally, exper...

The role of Lead, Software Engineer at Mastercard involves playing a crucial part in the Data Unification process across different data assets to create a unified view of data from multiple sources. This position will focus on driving insights from available data sets and supporting the development of new data-driven cyber products, services, and actionable insights. The Lead, Software Engineer will collaborate with various teams such as Product Manager, Data Science, Platform Strategy, and Technology to understand data needs and requirements for delivering data solutions that bring business value. Key responsibilities of the Lead, Software Engineer include performing data ingestion, aggrega...

You should have hands-on experience in deploying and managing large-scale dataflow products such as Cribl, Logstash, or Apache NiFi. Additionally, you should be proficient in integrating data pipelines with cloud platforms like AWS, Azure, Google Cloud, and on-premises systems. It is essential to have experience in developing and validating field extraction using regular expressions. A strong understanding of Operating Systems and Networking concepts is required, including Linux/Unix system administration, HTTP, and encryption. You should possess knowledge of software version control, deployment, and build tools following DevOps SDLC practices such as Git, Jenkins, and Jira. Strong analytica...