249 Apache Nifi Jobs - Page 3

As an Infrastructure Lead/Architect at our organization, you will be responsible for architecting, designing, and implementing cutting-edge cloud infrastructure solutions. Your role will be crucial in driving cloud and data platform initiatives, ensuring system scalability and security, and providing technical leadership to shape the foundation of our mission-critical applications. Your key responsibilities will include designing and implementing robust, scalable, and secure AWS cloud infrastructure utilizing services like EC2, S3, Lambda, RDS, Redshift, and IAM. You will lead the end-to-end deployment of high-performance Databricks data pipelines and develop data integration workflows using...

Required Skills & Experience: Mandatory: Hands-on experience with MarkLogic. Strong expertise in Apache NiFi for data integration and orchestration. Cloud experience, preferably Azure (Data Factory, Data Lake, Functions, etc.). Proven experience in REST API design & development. Familiarity with Git Bash, Gradle, and any modern IDE (IntelliJ, Eclipse, VS Code, etc.). Prior experience working as part of a DevOps team with CI/CD practices. Excellent problem-solving and communication skills. Madatory: Marklogics

As a Backend Engineer, you will be responsible for architecting and constructing intricate, scalable, and high-performance backend systems. Your role will involve overseeing the complete development and deployment process of features and enhancements. You will be tasked with designing and refining extensive distributed data processing using technologies such as Apache Spark and Nifi. Collaboration with product managers, architects, and various stakeholders to ensure alignment on technical objectives will be a key aspect of your responsibilities. Additionally, you will lead code reviews to guarantee adherence to best practices and maintain high code quality standards. A crucial part of your r...

As a Senior Cloud Data Developer, you will play a crucial role in bridging the gap between data engineering and cloud-native application development. Your primary responsibility will be to design and maintain scalable data solutions in the cloud by leveraging cutting-edge technologies and modern development practices. You will be tasked with developing data-centric applications using Java Spring Boot and various AWS services. Your expertise will be essential in creating and managing efficient data pipelines, ETL processes, data workflows, and orchestrating data processing systems. Real-time data processing solutions using AWS SNS/SQS and AWS Pipes will be a key part of your role. Additionall...

As a Senior Big Data Developer specializing in PySpark, with a robust 57 years of experience, you will be responsible for designing, developing, and optimizing scalable data pipelines. Collaboration with cross-functional teams is essential to deliver reliable, high-performance data solutions in the Apache Big Data ecosystem. Your primary responsibilities will encompass building and enhancing large-scale data processing pipelines using PySpark, working with tools like Apache Hadoop, Hive, HDFS, Spark, and more to manage big data workloads efficiently. Additionally, you will be engaged in ETL development, data ingestion, transformation, integration from diverse sources, and collaborating with ...

About the Role: OSTTRA India The Role Enterprise Architect - Integration The Team The OSTTRA Technology teamis composed of Capital Markets Technology professionals, who build,supportand protect the applications that operate our network. The technology landscapeincludeshigh-performance, high-volume applications as well as compute intensive applications,leveragingcontemporary microservices, cloud-based architectures. The Impact: Together, we build, support, protect and manage high-performance, resilient platforms that process more than 100 million messages a day. Our services are vital to automated trade processing around the globe, managing peak volumes and working with our customers and regu...

Diverse Lynx is looking for Big Data Developer to join our dynamic team and embark on a rewarding career journey Design, develop, and maintain big data solutions to meet business requirements and support data-driven decision making Work with stakeholders to understand their data needs and determine how to best use big data technologies to meet those needs Design and implement scalable, high-performance big data architectures, using technologies such as Hadoop, Spark, and NoSQL databases Extract, transform, and load large data sets into a big data platform for analysis and reporting Write complex SQL queries and develop custom scripts to process big data Collaborate with data scientists, data...

- Data Processing: BigQuery, Apache Spark, Hadoop, Dataflow - BI Tools: Tableau, Power BI, Looker - Languages: Python, SQL, Java, Scala - ETL Tools: Apache Nifi, Talend, Informatica, Dataform - Cloud: GCP (BigQuery, Dataflow, Pub/Sub, Cloud Storage) - Data Modeling: Kimball, Star Schema, Snowflake Schema - Version Control: Git, GitLab

- Data Processing: BigQuery, Apache Spark, Hadoop, Dataflow - BI Tools: Tableau, Power BI, Looker - Languages: Python, SQL, Java, Scala - ETL Tools: Apache Nifi, Talend, Informatica, Dataform - Cloud: GCP (BigQuery, Dataflow, Pub/Sub, Cloud Storage) - Data Modeling: Kimball, Star Schema, Snowflake Schema - Version Control: Git, GitLab

- Data Processing: BigQuery, Apache Spark, Hadoop, Dataflow - BI Tools: Tableau, Power BI, Looker - Languages: Python, SQL, Java, Scala - ETL Tools: Apache Nifi, Talend, Informatica, Dataform - Cloud: GCP (BigQuery, Dataflow, Pub/Sub, Cloud Storage) - Data Modeling: Kimball, Star Schema, Snowflake Schema - Version Control: Git, GitLab

- Data Processing: BigQuery, Apache Spark, Hadoop, Dataflow - BI Tools: Tableau, Power BI, Looker - Languages: Python, SQL, Java, Scala - ETL Tools: Apache Nifi, Talend, Informatica, Dataform - Cloud: GCP (BigQuery, Dataflow, Pub/Sub, Cloud Storage) - Data Modeling: Kimball, Star Schema, Snowflake Schema - Version Control: Git, GitLab

- Data Processing: BigQuery, Apache Spark, Hadoop, Dataflow - BI Tools: Tableau, Power BI, Looker - Languages: Python, SQL, Java, Scala - ETL Tools: Apache Nifi, Talend, Informatica, Dataform - Cloud: GCP (BigQuery, Dataflow, Pub/Sub, Cloud Storage) - Data Modeling: Kimball, Star Schema, Snowflake Schema - Version Control: Git, GitLab

- Data Processing: BigQuery, Apache Spark, Hadoop, Dataflow - BI Tools: Tableau, Power BI, Looker - Languages: Python, SQL, Java, Scala - ETL Tools: Apache Nifi, Talend, Informatica, Dataform - Cloud: GCP (BigQuery, Dataflow, Pub/Sub, Cloud Storage) - Data Modeling: Kimball, Star Schema, Snowflake Schema - Version Control: Git, GitLab

You will be responsible for integrating various ERP endpoints and transactional/NoSQL database systems to ensure data synchronization is well within the accepted SLA and TAT defined. Additionally, you will closely collaborate with the Product Manager and Engineering Manager for product and tech enablement. Your key tasks will include creating, executing, monitoring, and maintaining interfaces supporting multi-tenancy mode. Daily monitoring of the applications running on production and working on new development as per product specifications will also be part of your role. To excel in this position, you should possess an overall experience between 6 to 12 years and have a strong background in...

As a Data Architect with over 6 years of experience, you will be responsible for designing and implementing modern data lakehouse architectures on cloud platforms such as AWS, Azure, or GCP. Your primary focus will be on defining data modeling, schema evolution, partitioning, and governance strategies to ensure high-performance and secure data access. In this role, you will own the technical roadmap for scalable data platform solutions, ensuring they are aligned with enterprise needs and future growth. You will also provide architectural guidance and conduct code/design reviews across data engineering teams to maintain high standards of quality. Your responsibilities will include building an...

We are looking for a Technical Manager (Java & Big Data) to join our team in Bangalore under a hybrid work model. As a seasoned Java professional, you will be responsible for leading talented engineering teams and spearheading key technical initiatives to develop innovative telecom solutions using modern Java and Big Data technologies. With over 8 years of software development experience, including at least 3 years in a people management role, you will lead and mentor a high-performing development team. Your responsibilities will include driving the design, development, and deployment of Java-based applications, overseeing Big Data projects, ensuring seamless integration with cloud platforms...

Join us at Barclays as a Business Architect, VP, where you will be instrumental in creating and enhancing commercial solutions to unlock business and client value. Your primary responsibility will involve designing, constructing, and maintaining data pipelines that drive process mining initiatives. Collaborating closely with process analysts, business stakeholders, and IT teams, you will be pivotal in transforming raw data into actionable insights that enhance operational efficiency, compliance, and customer experience. To excel in this role, you should possess proficiency in SQL and at least one programming language such as Python, Java, or similar. Experience with ETL tools like Talend, In...

As a Lead Software Engineer - Full Stack, you will have the opportunity to play a crucial role in the technical development of Crypto Secure, a risk assessment tool designed to enhance banks" visibility into crypto spend, transaction volumes, and AML risk exposure. Your responsibilities will encompass technical leadership, code quality assurance, and team mentorship. Your primary focus will be on technical execution and delivery, involving the design, development, and maintenance of scalable applications using a range of modern technologies such as Java, Spring Boot, React, PostgresDB, Apache NiFi, Hadoop, and Snowflake. You will be responsible for translating high-level requirements into ac...

You are a meticulous and highly responsible Senior Data Specialist with 4-7 years of professional experience, capable of independently designing, managing, and optimizing data workflows and pipelines. Your expertise lies in databases such as PostgreSQL and MySQL, along with practical experience in modern ETL tools like Apache NiFi, Talend, or Apache Airflow. Your role demands structured work, a sense of ownership, and precise delivery in fast-paced environments. As a Senior Data Specialist, your duties and responsibilities include designing, building, and maintaining scalable ETL pipelines for both structured and unstructured data. You will work with PostgreSQL, MySQL, and other relational d...

Position Purpose DPR team member guarantees application production for both technical and functional support for a given Business Line or Business Line application chain, on the IT asset management for the infrastructure (IAAS , PAAS, CAAS and IT cloud ). He/she ensures that the service is maintained in operational condition. He/she ensures the smooth running of the processes (batch process[1]ing, transfer, etc.) and the proper functioning in the application sense of the term (relevant business data, functional result, correct execution of application workflows, etc.). In a context of accelerating change, he/she manages the various releases within his/her scope. He/she intervenes not only in...

About the Role: Grade Level (for internal use): 10 The Team: Do you love to collaborate & provide solutions? This team comes together across eight different locations every single day to craft enterprise grade applications that serve a large customer base with growing demand and usage. You will use a wide range of technologies and cultivate a collaborative environment with other internal teams. The Impact: We focus primarily developing, enhancing and delivering required pieces of information & functionality to internal & external clients in all client-facing applications. You will have a highly visible role where even small changes have very wide impact. Whats in it for you? - Opportunities ...

DIATOZ SOLUTIONS PVT LTD is looking for Data Engineer Apache NiFi & Groovy to join our dynamic team and embark on a rewarding career journey Liaising with coworkers and clients to elucidate the requirements for each task. Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed. Reformulating existing frameworks to optimize their functioning. Testing such structures to ensure that they are fit for use. Preparing raw data for manipulation by data scientists. Detecting and correcting errors in your work. Ensuring that your work remains backed up and readily accessible to relevant coworkers. Remaining up-to-date with industry standards and technological adv...

Responsibilities What you'll do Engineer, test, document and manage GCP Dataproc, DataFlow and VertexAI services used in high-performance data processing pipelines and Machine Learning. Help developers optimize data processing jobs using Spark, Python, and Java. Collaborate with development teams to integrate data processing pipelines with other cloud services and applications. Utilize Terraform and Tekton for infrastructure as code (IaC) and CI/CD pipelines, ensuring efficient deployment and management. Good to have Experience with Spark for large-scale data processing. Solid understanding and experience with GitHub for version control and collaboration. Experience with Terraform for infras...

Your future role Take on a new challenge and apply your data engineering expertise in a cutting-edge field. Youll work alongside collaborative and innovative teammates. You'll play a key role in enabling data-driven decision-making across the organization by ensuring data availability, quality, and accessibility. Day-to-day, youll work closely with teams across the business (e.g., Data Scientists, Analysts, and ML Engineers), mentor junior engineers, and contribute to the architecture and design of our data platforms and solutions. Youll specifically take care of designing and developing scalable data pipelines, but also managing and optimizing object storage systems. Well look to you for: D...

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : O9 Solutions Good to have skills : NAMinimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with various teams to understand their needs, developing innovative solutions, and ensuring that applications are aligned with business objectives. You will engage in problem-solving activities, parti...