393 Apache Nifi Jobs - Page 7

Project Role :Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Python (Programming Language) Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing innovative solutions, and ensuring that applications function seamless...

Role & responsibilities We are seeking a highly skilled Senior Data Engineer with strong expertise in data ingestion, transformation, and pipeline development . The ideal candidate will be an individual contributor responsible for designing, implementing, and maintaining robust data engineering solutions using modern tools and platforms. Key Responsibilities: Install, configure, and administer data platforms: StreamSets, Apache Spark, Informatica, Apache NiFi Develop real-time and batch data pipelines using PySpark (Scala is a plus) Administer StreamSets Data Collector and Control Hub for pipeline deployment and monitoring Automate data flows using Apache NiFi , including processor configura...

Project Role :Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Python (Programming Language) Good to have skills : NAMinimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing innovative solutions, and ensuring that applications function seamle...

About The Role The Expertise You Have Expertise in d eveloping and supporting real-time NiFi integration tools to pull data from various AWS services and integration to storage systems. Experience with J ava, JSF, JS and Python Scripting Experience with the Amazon Web Services (AWS) platform (S3, Lambda,SQS) Good Experience with Jenkins, Maven, Apache Nifi, Sonar and Linux Expertise in building and testing large-scale AWS cloud-native digital enterprise applications on micro-services, serverless and event-driven architectures. Ownership of the entire secure SDLC, and extensive experience with DevOps CI/CD practices, TDD, BDD to rapidly deliver, measure, and iterate features to customers whil...

About The Role LocationBangalore Experience6 - 9 Years The Skills required Proficiency in Python API development like Fast API Framework. Understanding of core AWS services like EC2, S3, Lambda, and RDS. Knowledge of managing relational databases like AWS RDS and Proficiency in SQL for querying and managing data, and performance tuning. Experience in working in an Agile environment. The skills that are good to have: Knowledge on Oracle Application R12. Experience with continuous integration and continuous deployment (CI/CD) pipelines usingDevOps tools like Jenkins, Git, Kompass. Knowledge of Kubernetes concepts (pods, services, deployments, namespaces, clusters, scaling, monitoring) and YAML...

Overview of the Company: Jio Platforms Ltd. is a revolutionary Indian multinational tech company, often referred to as India's biggest startup, headquartered in Mumbai. Launched in 2019, it's the powerhouse behind Jio, India's largest mobile network with over 400 million users. But Jio Platforms is more than just telecom. It's a comprehensive digital ecosystem, developing cutting-edge solutions across media, entertainment, and enterprise services through popular brands like JioMart, JioFiber, and JioSaavn. Join us at Jio Platforms and be part of a fast-paced, dynamic environment at the forefront of India's digital transformation. Collaborate with brilliant minds to develop next-gen solutions...

Req ID: 321800 We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karntaka (IN-KA), India (IN). "Job Duties: Key Responsibilities: Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer to infrastructure Demonstrate proficiency in coding skills, utilizing languages such as PySpark, Talend to efficiently move solutions into production while prioritizing pe...

Diverse Lynx is looking for Big Data Developer to join our dynamic team and embark on a rewarding career journey Design, develop, and maintain big data solutions to meet business requirements and support data-driven decision making Work with stakeholders to understand their data needs and determine how to best use big data technologies to meet those needs Design and implement scalable, high-performance big data architectures, using technologies such as Hadoop, Spark, and NoSQL databases Extract, transform, and load large data sets into a big data platform for analysis and reporting Write complex SQL queries and develop custom scripts to process big data Collaborate with data scientists, data...

One Azure backend expert (Strong SC or Specialist Senior) Should have hands-on experience of working with ADLS, ADF and Azure SQL DW Should have minimum 3 Years working experience of delivering Azure projects. Must Have:- 3 to 8 years of experience working on design, develop, and deploy ETL processes on Databricks to support data integration and transformation. Optimize and tune Databricks jobs for performance and scalability. Experience with Scala and/or Python programming languages. Proficiency in SQL for querying and managing data. Expertise in ETL (Extract, Transform, Load) processes. Knowledge of data modeling and data warehousing concepts. Implement best practices for data pipelines, i...

Power Bi and AAS expert (Strong SC or Specialist Senior) Should have hands-on experience of Data Modelling in Azure SQL Data Warehouse and Azure Analysis Service Should be able to write and test Dex queries. Should be able generate Paginated Reports in Power BI Should have minimum 3 Years working experience in delivering projects in Power Bi Must Have:- 3 to 8 years of experience working on design, develop, and deploy ETL processes on Databricks to support data integration and transformation. Optimize and tune Databricks jobs for performance and scalability. Experience with Scala and/or Python programming languages. Proficiency in SQL for querying and managing data. Expertise in ETL (Extract...

Azure backend expert (ADLS, ADF and Azure SQL DW)4+Yrs/Immediate Joiners only One Azure backend expert (Strong SC or Specialist Senior) Should have hands-on experience of working with ADLS, ADF and Azure SQL DW Should have minimum 3 Years working experience of delivering Azure projects. Must Have:- 3 to 8 years of experience working on design, develop, and deploy ETL processes on Databricks to support data integration and transformation. Optimize and tune Databricks jobs for performance and scalability. Experience with Scala and/or Python programming languages. Proficiency in SQL for querying and managing data. Expertise in ETL (Extract, Transform, Load) processes. Knowledge of data modeling...

Power Bi and AAS expert (Strong SC or Specialist Senior) Should have hands-on experience of Data Modelling in Azure SQL Data Warehouse and Azure Analysis Service Should be able to write and test Dex queries. Should be able generate Paginated Reports in Power BI Should have minimum 3 Years working experience in delivering projects in Power Bi Must Have:- 3 to 8 years of experience working on design, develop, and deploy ETL processes on Databricks to support data integration and transformation. Optimize and tune Databricks jobs for performance and scalability. Experience with Scala and/or Python programming languages. Proficiency in SQL for querying and managing data. Expertise in ETL (Extract...

As a Python Developer at our company in Bangalore, you will be responsible for the following: - Writing clean and efficient code using Python programming language. - Utilizing frameworks like FastAPI for building microservices & RESTful APIs, and Pytest for Unit Testing automation. - Demonstrating proficiency in core AWS services such as EC2, S3, Lambda, and RDS. - Implementing AWS security best practices including VPC, security groups, and IAM. - Understanding Kubernetes concepts like pods, services, deployments, namespaces, clusters, scaling, monitoring, and YAML files. - Working with Apache NiFi for automating data flows between systems by configuring and managing NiFi processors for data...

At PwC, we focus on developing cutting-edge software solutions and driving product innovation to meet the evolving needs of our clients. Our software and product innovation team combines technical expertise with creative thinking to deliver innovative software products and solutions. As a member of our software engineering team, you will play a key role in developing software solutions that drive digital transformation and enhance business performance. Your responsibilities will include designing, coding, and testing cutting-edge applications that revolutionize industries and deliver exceptional user experiences. In this dynamic and fast-paced environment, you will have the opportunity to wo...

Minimum of 6 years of experience in ETL testing, data validation, and quality engineering. Strong expertise in SQL and experience writing complex queries for data validation and analysis. Proficient in ETL tools (e.g., Informatica, Talend, Apache NiFi) and data warehousing concepts. Experience with data quality tools and techniques for data profiling and cleansing. Strong analytical and problem-solving skills, with attention to detail. Excellent communication and collaboration skills to work effectively in a team environment. Experience in automated testing frameworks and tools is a plus. Familiarity with Agile methodologies and CI/CD practices is preferred. Bachelors degree in computer scie...

Apache NiFi, ETL/ELT processes, MySQL, PostgreSQL,AWS, Azure, GCP, Python, Bash, Hadoop, Spark, Docker, Kubernetes, GDPR, HIPAA

You are looking for a skilled and motivated Integration Engineer with hands-on experience in Apache NiFi, Groovy scripting, and a strong understanding of Nokia Assurance Center (NAC). Your primary focus will be on integrating network assurance solutions, data flows, and custom scripting for telecom environments. Your responsibilities will include designing, implementing, and optimizing data flows in Apache NiFi to ingest, route, and transform network performance/assurance data. You will also develop and maintain Groovy scripts for custom logic and extensions in NAC and NiFi processors. Integrating and configuring Nokia Assurance Center (NAC) components for telecom service assurance and monit...

As a Data Engineer at Micron Technology, you will play a crucial role in transforming information into intelligence, driving the world to learn, communicate, and advance faster than ever. Your responsibilities will include understanding complex business problems, architecting data management systems, developing ETL processes, and preparing data for analysis. Your primary tasks will involve maintaining a deep understanding of company and department strategies, translating analysis requirements into data requirements, identifying relevant data sources, and developing conceptual models to capture data relationships. As a subject matter expert, you will be responsible for selecting appropriate d...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : AWS Glue Good to have skills : Data Engineering, Python (Programming Language), Microsoft SQL Server Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education About The Role :Developing a customer insights platform that will provide an ID graph and Digital customer view to help drive improvements in marketing decisions. Responsibilities:Design, build, and maintain data pipelines using AWS services (Glue, Neptune, S3).Participate in code reviews, testing, and ...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : O9 Solutions Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :- As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with various teams to understand their needs, developing innovative solutions, and ensuring that applications are aligned with business objectives. You will engage in problem-solving...

About the Role: Grade Level (for internal use): 10 The RoleSenior Software Developer The Team Do you love to collaborate & provide solutionsThis team comes together across eight different locations every single day to craft enterprise grade applications that serve a large customer base with growing demand and usage. You will use a wide range of technologies and cultivate a collaborative environment with other internal teams. The ImpactWe focus primarily developing, enhancing and delivering required pieces of information & functionality to internal & external clients in all client-facing applications. You will have a highly visible role where even small changes have very wide impact. Whats in...

About the Role: Grade Level (for internal use): 10 The Team: Do you love to collaborate & provide solutions? This team comes together across eight different locations every single day to craft enterprise grade applications that serve a large customer base with growing demand and usage. You will use a wide range of technologies and cultivate a collaborative environment with other internal teams. The Impact: We focus primarily developing, enhancing and delivering required pieces of information & functionality to internal & external clients in all client-facing applications. You will have a highly visible role where even small changes have very wide impact. Whats in it for you? - Opportunities ...

As a skilled ETL Developer, you will be responsible for developing and optimizing scalable data pipelines to efficiently extract, transform, and load data from various sources. Leveraging technologies like Spark, Dask, and other modern ETL frameworks, you will play a key role in ensuring the smooth operation of data processes. Your duties will include implementing data quality controls, monitoring processes, and providing mentorship to junior ETL developers. Collaboration with the infrastructure team is vital to ensure the availability, reliability, and scalability of ETL solutions. Additionally, you will participate in code reviews, contribute to coding standards, and stay updated on emergi...

Position Description: 4 - 7 years of Experience with java Full Stack Technical Skills: Strong expertise with Core Java, Microservice Architecture, Spring Boot. Good understanding of Cloud based technologies, Good to have knowledge of Camunda, Kafka, Apache NIFI and Angular. We are looking for senior full stack Java Developer to join our awesome team and deliver a streamlined user experience. We want a team member who strives to develop a first class codebase using industry best practices. As a full stack Developer, you will implement a complete end to end functionality for both Backend and front end. Perform product analysis and development tasks of increasingly complex nature which may requ...

Job Title: GenAI/ML Platform Engineer Years of exp : 6+ yrs. Location: Hybrid (Bellandur, Bangalore) Notice Period : - Immediate joiner (7-12 days) Required Skills: Minimum total experience of 6+ years Bachelor's degree in computer science / information technology/computer information systems or relevant working experience in IT field Experience with Python, R , React , NodeJS , Jupyter notebooks Experience working with various Rest APIs Experience with Docker and Kubernetes Experience in AWS and/or GC Understanding of GenAI, Agentic AI and Machine Learning technologies Hands on with infrastructure automation Familiar with observability tools as; Prometheus, Grafana, Alert Manager, Splunk (o...