236 Apache Nifi Jobs

Diverse Lynx is looking for Big Data Developer to join our dynamic team and embark on a rewarding career journey Design, develop, and maintain big data solutions to meet business requirements and support data-driven decision making Work with stakeholders to understand their data needs and determine how to best use big data technologies to meet those needs Design and implement scalable, high-performance big data architectures, using technologies such as Hadoop, Spark, and NoSQL databases Extract, transform, and load large data sets into a big data platform for analysis and reporting Write complex SQL queries and develop custom scripts to process big data Collaborate with data scientists, data...

One Azure backend expert (Strong SC or Specialist Senior) Should have hands-on experience of working with ADLS, ADF and Azure SQL DW Should have minimum 3 Years working experience of delivering Azure projects. Must Have:- 3 to 8 years of experience working on design, develop, and deploy ETL processes on Databricks to support data integration and transformation. Optimize and tune Databricks jobs for performance and scalability. Experience with Scala and/or Python programming languages. Proficiency in SQL for querying and managing data. Expertise in ETL (Extract, Transform, Load) processes. Knowledge of data modeling and data warehousing concepts. Implement best practices for data pipelines, i...

Power Bi and AAS expert (Strong SC or Specialist Senior) Should have hands-on experience of Data Modelling in Azure SQL Data Warehouse and Azure Analysis Service Should be able to write and test Dex queries. Should be able generate Paginated Reports in Power BI Should have minimum 3 Years working experience in delivering projects in Power Bi Must Have:- 3 to 8 years of experience working on design, develop, and deploy ETL processes on Databricks to support data integration and transformation. Optimize and tune Databricks jobs for performance and scalability. Experience with Scala and/or Python programming languages. Proficiency in SQL for querying and managing data. Expertise in ETL (Extract...

Azure backend expert (ADLS, ADF and Azure SQL DW)4+Yrs/Immediate Joiners only One Azure backend expert (Strong SC or Specialist Senior) Should have hands-on experience of working with ADLS, ADF and Azure SQL DW Should have minimum 3 Years working experience of delivering Azure projects. Must Have:- 3 to 8 years of experience working on design, develop, and deploy ETL processes on Databricks to support data integration and transformation. Optimize and tune Databricks jobs for performance and scalability. Experience with Scala and/or Python programming languages. Proficiency in SQL for querying and managing data. Expertise in ETL (Extract, Transform, Load) processes. Knowledge of data modeling...

Power Bi and AAS expert (Strong SC or Specialist Senior) Should have hands-on experience of Data Modelling in Azure SQL Data Warehouse and Azure Analysis Service Should be able to write and test Dex queries. Should be able generate Paginated Reports in Power BI Should have minimum 3 Years working experience in delivering projects in Power Bi Must Have:- 3 to 8 years of experience working on design, develop, and deploy ETL processes on Databricks to support data integration and transformation. Optimize and tune Databricks jobs for performance and scalability. Experience with Scala and/or Python programming languages. Proficiency in SQL for querying and managing data. Expertise in ETL (Extract...

As a Python Developer at our company in Bangalore, you will be responsible for the following: - Writing clean and efficient code using Python programming language. - Utilizing frameworks like FastAPI for building microservices & RESTful APIs, and Pytest for Unit Testing automation. - Demonstrating proficiency in core AWS services such as EC2, S3, Lambda, and RDS. - Implementing AWS security best practices including VPC, security groups, and IAM. - Understanding Kubernetes concepts like pods, services, deployments, namespaces, clusters, scaling, monitoring, and YAML files. - Working with Apache NiFi for automating data flows between systems by configuring and managing NiFi processors for data...

At PwC, we focus on developing cutting-edge software solutions and driving product innovation to meet the evolving needs of our clients. Our software and product innovation team combines technical expertise with creative thinking to deliver innovative software products and solutions. As a member of our software engineering team, you will play a key role in developing software solutions that drive digital transformation and enhance business performance. Your responsibilities will include designing, coding, and testing cutting-edge applications that revolutionize industries and deliver exceptional user experiences. In this dynamic and fast-paced environment, you will have the opportunity to wo...

Minimum of 6 years of experience in ETL testing, data validation, and quality engineering. Strong expertise in SQL and experience writing complex queries for data validation and analysis. Proficient in ETL tools (e.g., Informatica, Talend, Apache NiFi) and data warehousing concepts. Experience with data quality tools and techniques for data profiling and cleansing. Strong analytical and problem-solving skills, with attention to detail. Excellent communication and collaboration skills to work effectively in a team environment. Experience in automated testing frameworks and tools is a plus. Familiarity with Agile methodologies and CI/CD practices is preferred. Bachelors degree in computer scie...

Apache NiFi, ETL/ELT processes, MySQL, PostgreSQL,AWS, Azure, GCP, Python, Bash, Hadoop, Spark, Docker, Kubernetes, GDPR, HIPAA

You are looking for a skilled and motivated Integration Engineer with hands-on experience in Apache NiFi, Groovy scripting, and a strong understanding of Nokia Assurance Center (NAC). Your primary focus will be on integrating network assurance solutions, data flows, and custom scripting for telecom environments. Your responsibilities will include designing, implementing, and optimizing data flows in Apache NiFi to ingest, route, and transform network performance/assurance data. You will also develop and maintain Groovy scripts for custom logic and extensions in NAC and NiFi processors. Integrating and configuring Nokia Assurance Center (NAC) components for telecom service assurance and monit...

As a Data Engineer at Micron Technology, you will play a crucial role in transforming information into intelligence, driving the world to learn, communicate, and advance faster than ever. Your responsibilities will include understanding complex business problems, architecting data management systems, developing ETL processes, and preparing data for analysis. Your primary tasks will involve maintaining a deep understanding of company and department strategies, translating analysis requirements into data requirements, identifying relevant data sources, and developing conceptual models to capture data relationships. As a subject matter expert, you will be responsible for selecting appropriate d...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : AWS Glue Good to have skills : Data Engineering, Python (Programming Language), Microsoft SQL Server Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education About The Role :Developing a customer insights platform that will provide an ID graph and Digital customer view to help drive improvements in marketing decisions. Responsibilities:Design, build, and maintain data pipelines using AWS services (Glue, Neptune, S3).Participate in code reviews, testing, and ...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : O9 Solutions Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :- As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with various teams to understand their needs, developing innovative solutions, and ensuring that applications are aligned with business objectives. You will engage in problem-solving...

About the Role: Grade Level (for internal use): 10 The RoleSenior Software Developer The Team Do you love to collaborate & provide solutionsThis team comes together across eight different locations every single day to craft enterprise grade applications that serve a large customer base with growing demand and usage. You will use a wide range of technologies and cultivate a collaborative environment with other internal teams. The ImpactWe focus primarily developing, enhancing and delivering required pieces of information & functionality to internal & external clients in all client-facing applications. You will have a highly visible role where even small changes have very wide impact. Whats in...

About the Role: Grade Level (for internal use): 10 The Team: Do you love to collaborate & provide solutions? This team comes together across eight different locations every single day to craft enterprise grade applications that serve a large customer base with growing demand and usage. You will use a wide range of technologies and cultivate a collaborative environment with other internal teams. The Impact: We focus primarily developing, enhancing and delivering required pieces of information & functionality to internal & external clients in all client-facing applications. You will have a highly visible role where even small changes have very wide impact. Whats in it for you? - Opportunities ...

As a skilled ETL Developer, you will be responsible for developing and optimizing scalable data pipelines to efficiently extract, transform, and load data from various sources. Leveraging technologies like Spark, Dask, and other modern ETL frameworks, you will play a key role in ensuring the smooth operation of data processes. Your duties will include implementing data quality controls, monitoring processes, and providing mentorship to junior ETL developers. Collaboration with the infrastructure team is vital to ensure the availability, reliability, and scalability of ETL solutions. Additionally, you will participate in code reviews, contribute to coding standards, and stay updated on emergi...

Position Description: 4 - 7 years of Experience with java Full Stack Technical Skills: Strong expertise with Core Java, Microservice Architecture, Spring Boot. Good understanding of Cloud based technologies, Good to have knowledge of Camunda, Kafka, Apache NIFI and Angular. We are looking for senior full stack Java Developer to join our awesome team and deliver a streamlined user experience. We want a team member who strives to develop a first class codebase using industry best practices. As a full stack Developer, you will implement a complete end to end functionality for both Backend and front end. Perform product analysis and development tasks of increasingly complex nature which may requ...

Job Title: GenAI/ML Platform Engineer Years of exp : 6+ yrs. Location: Hybrid (Bellandur, Bangalore) Notice Period : - Immediate joiner (7-12 days) Required Skills: Minimum total experience of 6+ years Bachelor's degree in computer science / information technology/computer information systems or relevant working experience in IT field Experience with Python, R , React , NodeJS , Jupyter notebooks Experience working with various Rest APIs Experience with Docker and Kubernetes Experience in AWS and/or GC Understanding of GenAI, Agentic AI and Machine Learning technologies Hands on with infrastructure automation Familiar with observability tools as; Prometheus, Grafana, Alert Manager, Splunk (o...

Position Description: 8 - 12 years of Experience with java Full Stack Technical Skills: Strong expertise with Core Java, Microservice Architecture, Spring Boot. Good understanding of Cloud based technologies, Good to have knowledge of Camunda, Kafka, Apache NIFI and Angular. We are looking for senior full stack Java Developer to join our awesome team and deliver a streamlined user experience. We want a team member who strives to develop a first class codebase using industry best practices. As a full stack Developer, you will implement a complete end to end functionality for both Backend and front end. Perform product analysis and development tasks of increasingly complex nature which may req...

Lead Software Engineer - Apache Nifi, Python, PySpark, Hadoop, Cloudera platforms, and Airflow Title and Summary Lead Software Engineer - Apache Nifi, Python, PySpark, Hadoop, Cloudera platforms, and AirflowWho is Mastercard? Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments, and businesses realize their greatest potential. Our decency quotient, or DQ, drives our culture and e...

Overview This position is for Lead Data Engineer in the Commercial Data as a Service group. In this position you will enjoy being responsible for helping define and maintain the data systems key to delivering successful outcomes for our customers. You will be hands on and work closely to guide a team of Data Engineers in the associated data maintenance, integrations, enhancements, loads and transformation processes for the organization. This key individual will work closely with Data Architects to design and implement solutions and insure successful implementations. Role Leads initiatives to build and maintain database technologies, environments, and applications, seeking opportunities for i...

Overview Mastercard is looking for a Senior Software Engineer to join the Account Level Management(ALM) team in our Pune office thats focused on building ALM Services with Data warehouse skills. The Mastercard Account Level Management platform empowers real-time card level decisioning. As consumers progress along their life stages as card holders, with increasing disposable income and more refined preferences, ALM provides services to issuers so they can effectively offer more relevant benefits and rewards at each stage, to drive loyalty and spend. Role o Develop high quality, secure and scalable data pipelines using spark, Scala/Python/Java on Hadoop or object storage like MinIO. o Leverage...

Overall Responsibilities Design, develop, and maintain scalable data pipelines and architectures to support analytical and operational needs Implement data integration solutions, ensuring high data quality, security, and compliance standards Collaborate with data scientists, analysts, and engineering teams to translate business requirements into technical solutions Optimize data workflows for performance, reliability, and cost-efficiency in cloud environments Develop and enforce best practices for data governance, security, and privacy Lead efforts in automating data processes and providing documentation for data systems Monitor data system performance, troubleshoot issues, and implement imp...

BMC is looking for a Product Owner to join our amazing team! The BMC AMI Cloud Analytics product can quickly transfer, transform, and integrate mainframe data so it could be shared with the organizational data lake to be used by artificial intelligence, machine learning (AI/ML) and analytics solutions. In this role, you will lead the transformation of this cutting-edge product originally developed by Model9, a startup acquired by BMC, into a solution designed to meet the rigorous demands of enterprise customers. This exciting opportunity combines innovation, scalability, and leadership, giving you a chance to shape the products evolution as it reaches new heights in enterprise markets. Youll...

Title and Summary Lead Data EngineerOverview We are the global technology company behind the worlds fastest payments processing network. We are a vehicle for commerce, a connection to financial systems for the previously excluded, a technology innovation lab, and the home of Priceless. We ensure every employee has the opportunity to be a part of something bigger and to change lives. We believe as our company grows, so should you. We believe in connecting everyone to endless, priceless possibilities. Our team within Mastercard Services: The Services org is a key differentiator for Mastercard, providing the cutting-edge services that are used by some of the world's largest organizations to mak...