393 Apache Nifi Jobs - Page 5

Responsibilities Implement robust software components for data-driven systems, ensuring efficiency and maintainability. Conduct technical analysis and articulate solutions, designing engineering patterns that can be leveraged across multiple product offerings with a high volume of end-users. Optimize and enhance existing solutions, proactively identifying and resolving complex technical challenges while weighing trade-offs in cost, performance, and scalability. Develop reusable components and services, adhering to corporate engineering standards, best practices, and modern development frameworks. Apply software engineering best practices, leveraging automation in testing, deployment, and mon...

Job Title: Data Engineer Job Category: Full-Time Work Location: Hyderabad Qualifications: BE/B.Tech./MTech. /MCA/Degree in Computer Science Experience: 4+ years Key Responsibilities: Build and maintain the ETL pipeline using NiFi and Debezium. Implement data transformations and processing workflows. Configure Iceberg tables and MinIO storage. Optimize query performance with Trino. Required Skills: Proficiency in Apache NiFi, Debezium, and Kafka for data ingestion. Experience with Apache Iceberg and MinIO for data lakehouse setup. Strong SQL skills for data transformation and querying. Familiarity with Trino or Presto for distributed querying. Basic scripting skills (e.g., Python, Bash) for a...

Job Purpose Vi is seeking an experienced Apache NiFi Developer to join our data engineering team. In this role, person will be responsible for designing, building, and managing data flows using Apache NiFi. The ideal candidate has a strong background in data integration and transformation, and experience with real-time data pipelines in enterprise environments. This role requires hands-on experience with NiFi and related data ingestion and processing technologies. Key Result Areas/Accountabilities Data Flow Design and Development : Create, configure, and manage data flows in Apache NiFi to support data integration from diverse sources, such as databases, cloud storage, and APIs. Data Transfo...

Job Title: ETL Developer Position Brief: We are seeking a skilled ETL Developer to design, build, and maintain robust data pipelines that support reporting, analytics, and business intelligence needs. The ETL Developer will be responsible for extracting data from various source systems, transforming it into meaningful formats, and loading it into centralized repositories such as data warehouses or data lakes. This role plays a critical part in enabling data-driven decision-making across the organization. Location: Hyderabad Key Responsibilities: 1. ETL Pipeline Development • Design, develop, and optimize scalable and efficient ETL workflows using tools such as, SSIS, Azure Data Factory (ADF)...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : AWS Architecture, Apache NiFi Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing application features, and ensuring that the applications are aligned with business objectives. You will also en...

Citrix Observability with Splunk ITSI: Expertise in utilizing Citrix observability data with Splunk IT Service Intelligence for comprehensive monitoring and analytics of Citrix environments. VDI and VM Observability: Proficient in monitoring Virtual Desktop Infrastructure (VDI) and Virtual Machines (VMs) for performance, reliability, and scalability. OpenTelemetry, Kafka, and Splunk/Grafana: Hands-on experience with OpenTelemetry for unified telemetry, Kafka for real-time data ingestion, and Splunk/Grafana for powerful data visualization and alerting. Data Science Machine Learning: Proficient in Python, TensorFlow, PyTorch, Scikit-learn, Pandas, NumPy for developing machine learning models f...

Role Description As a Technical Lead - ETL - Python at Incedo, you will be responsible for designing and developing ETL workflows to extract, transform, and load data from various sources to target systems. You will work with data analysts and architects to understand business requirements and translate them into technical solutions. You will be skilled in ETL tools such as Informatica or Talend and have experience in programming languages such as SQL or Python. You will be responsible for writing efficient and reliable code that is easy to maintain and troubleshoot. Roles Responsibilities : Develop, maintain, and enhance software applications for Extract, Transform, and Load (ETL) processes...

As a Software Engineer III at JPMorgan Chase within the Corporate Technology, your role involves serving as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable manner. Your responsibilities include executing software solutions, design, development, and technical troubleshooting with the ability to think innovatively, creating secure and high-quality production code, producing architecture and design artifacts for complex applications, and contributing to software engineering communities of practice and events exploring new technologies. You are also expected to proactively identify hidden problems and patterns ...

As a Sr/Lead Data Engineer at Ccube in Indore, MP (Hybrid Model), you will have the opportunity to work with large and complex sets of data to meet both non-functional and functional business requirements. Your key responsibilities will include: - Gathering and assembling data using skills such as SQL, Python, R, Data Modeling, Data Warehousing, and AWS (S3, Athena) - Creating new data pipelines or enhancing existing pipelines with tools like ETL Tools (e.g., Apache NiFi, Talend), Python (Pandas, PySpark), AWS Glue, JSON, XML, YAML - Identifying, designing, and implementing process improvements with tools like Apache Airflow, Terraform, Kubernetes, AWS Lambda, CI/CD pipelines, Docker - Build...

Role Overview: As a Software Engineer III at JPMorgan Chase within the Corporate Technology, you will be a seasoned member of an agile team responsible for designing and delivering trusted market-leading technology products in a secure, stable, and scalable manner. Your role involves executing software solutions, development, and technical troubleshooting while maintaining high-quality production code and algorithms. You will contribute to the architecture and design of complex applications, ensuring design constraints are met by software code development. Additionally, you will analyze and synthesize data sets to drive continuous improvement of software applications and systems. Your proact...

We are seeking a skilled Backend/Data Engineer with 5 to 7 years of experience in Java , PySpark , Spring Boot , and Microservices . The ideal candidate will be responsible for building scalable backend systems and data processing pipelines that support enterprise-grade applications. Strong proficiency in Java and Spring Boot Experience with Microservices architecture and RESTful APIs Hands-on expertise in Apache PySpark for data processing Familiarity with CI/CD, version control (Git), and agile methodologies Good understanding of system design and backend architecture Key Responsibilities: Develop and maintain backend services using Java and Spring Boot Design and implement microservices a...

Data Pipeline Engineer Cyber Data Platform Location: Bangalore Experience: 5–10 years Employment Type: Full-time About the Role Design, build and maintain large-scale, real-time data pipelines for cyber-security events. Stream data to Elasticsearch , Splunk and other downstream platforms. Work closely with global Cyber Security / Incident Response / Threat Investigation teams. Ensure reliability, scalability and high performance across cloud and on-prem environments. Key Responsibilities Build, deploy and manage dataflow tools: Cribl, Logstash, Apache NiFi . Integrate diverse data sources from AWS / Azure / GCP and on-prem systems. Design and implement data mapping, transformation & routing ...

Role Objective As Lead Software Java/Microservices/Angular Developer you play a key role in creating, maintaining and improving the software Implement and ensure coding standards are followed and in accordance with applicable software, development methodology, release processes and quality requirements Participate in product and/or application definition activities including feature analysis and system trade-offs Estimate level of effort for own work and input in estimates for other developers Maintain strong relationships and communication with offshore delivery teams, providing direction, guidance and challenge. Create and communicate designs for large sets of new functionalities as part o...

You are ready to gain the skills and experience needed to grow within your role and advance your career, and there is a perfect software engineering opportunity for you at JPMorgan Chase within the Corporate Technology team. As a Software Engineer II, you will be part of an agile team that enhances, designs, and delivers the software components of state-of-the-art technology products in a secure, stable, and scalable manner. Your role involves executing software solutions through design, development, and technical troubleshooting of multiple components within a technical product, application, or system while acquiring the necessary skills and experience to advance in your role. **Key Respons...

We are looking for a skilled Hadoop Admin with 4 to 9 years of experience. The ideal candidate will have expertise in Hadoop administration, CDP distribution, Dataflow, and Big data platform. Roles and Responsibility Manage and maintain large-scale Hadoop clusters for high availability and performance. Design and implement data pipelines using Kafka and Nifi profiles. Develop and execute Linux shell scripts for automation and monitoring. Collaborate with cross-functional teams to resolve technical issues and improve processes. Ensure compliance with security best practices and industry standards. Troubleshoot and optimize HBase databases for improved query performance. Job Requirements Stron...

Role & responsibilities Direct Responsibilities Research & Development to find optimized and proper usage of development tools or technologies such as: KAFKA Kubernetes Docker APIGEE Bitbucket, Gitlab Jenkins, Ansible, Sonar, NexusIQ, Fortify ELK Dynatrace Terraform Future Dev Practices tools To contribute technical expertise in related projects that are using the above-mentioned technologies and other technical transformation projects. Assist the development teams on practice adoption (e.g., Unit Testing, Code Reviews, Code Quality) Update maturity matrix Enrich documents and write guidelines for the ADM to follow. Review and ensure compliance of the defined software/ product development be...

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : O9 Solutions Good to have skills : NAMinimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with various teams to understand their needs, developing innovative solutions, and ensuring that applications are aligned with business objectives. You will engage in problem-solving activities, parti...

Senior DE: Same as above but need to have experience managing data engineers, have experience working with stakeholders, actively engaging for key technical discussion and have a very good technical knowledge. Should have at least 7 years experience working in data engineering. Job Description: As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experie...

Senior DE: Same as above but need to have experience managing data engineers, have experience working with stakeholders, actively engaging for key technical discussion and have a very good technical knowledge. Should have at least 7 years experience working in data engineering. Job Description: As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experie...

Senior DE: Same as above but need to have experience managing data engineers, have experience working with stakeholders, actively engaging for key technical discussion and have a very good technical knowledge. Should have at least 7 years experience working in data engineering. Job Description: As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experie...

Senior DE: Same as above but need to have experience managing data engineers, have experience working with stakeholders, actively engaging for key technical discussion and have a very good technical knowledge. Should have at least 7 years experience working in data engineering. Job Description: As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experie...

Senior DE: Same as above but need to have experience managing data engineers, have experience working with stakeholders, actively engaging for key technical discussion and have a very good technical knowledge. Should have at least 7 years experience working in data engineering. Job Description: As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experie...

Senior DE: Same as above but need to have experience managing data engineers, have experience working with stakeholders, actively engaging for key technical discussion and have a very good technical knowledge. Should have at least 7 years experience working in data engineering. Job Description: As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experie...

Senior DE: Same as above but need to have experience managing data engineers, have experience working with stakeholders, actively engaging for key technical discussion and have a very good technical knowledge. Should have at least 7 years experience working in data engineering. Job Description: As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experie...

Senior DE: Same as above but need to have experience managing data engineers, have experience working with stakeholders, actively engaging for key technical discussion and have a very good technical knowledge. Should have at least 7 years experience working in data engineering. Job Description: As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experie...