393 Apache Nifi Jobs - Page 3

Location: Manyata Tech Park. Experience: 5-8 years in Data science. JD - Skill Set Required: ? Familiar with forecasting algorithms, such as Time Series (Arima, Prophet), ML (GLM, GBDT, XgBoost), Hierarchical model (Top Down, Bottom Up), DL (Seq2Seq, Transformer), and Ensemble methods. ? Hand-on experience (real-time) in building end-to-end ML models and pipelines. ? SQL, Python, Spark, PySpark. ? Big Data systems - Hadoop Ecosystem (HDFS, Hive, MapReduce) or Cloud ? MLflow, Kubeflow, GCP Vertex AI, Databricks or equivalents. ? Analytics database like Druid, Data visualization/exploration tools like Superset. ? CI\CD ? GIT Secondary Skills (desired): ? Apache Airflow, Apache Oozie, Nifi ? GC...

Role & responsibilities At least 8 years of experience in ground-up development projects with strong expertise in Spring Boot and MVC architecture. With over 10 years of experience , strong application skills in system design and designing microservices using domain-driven design are expected. Developing microservices-based applications using domain-driven design, Spring Boot, Spring Cloud, PostgreSQL, JUnit, Maven, and Git. Experience with functional programming languages such as Clojure, Lisp, or others is a plus. Experience working in an agile model is required. Experience with Kafka and rule engines (Drools/Clara) is required. Experience in building process metrics for business process i...

At EY, youll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And were counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. Position Name Data Engineer Position Level Senior Position Details EYs GDS Assurance Digital teams mission is to develop, implement and integrate technology solutions that better serve our audit clients and engagement teams. As a member of EYs core Assurance practice, youll develop a deep Audit related technical knowledge and outstanding databa...

The opportunity Were looking for Manager Snowflake & Databrick with Big Data or Pyspark with expertise in Financial Services domain hand-on experience with Big data ecosystem. Primary skills and key responsibilities Design and implement scalable and high-performance data warehouse solutions using snowflake. Design and implement scalable data architecture using PySpark. Core technical stackSnowflake, Python/PySpark, SQL, identity/security (SAML/OAuth/OIDC, MFA, RBAC), and often Kubernetes/Docker for deployment patterns. Should have strong technical expertise in Neo4j. Data architecture depthData modelling, data integration/ETL, batch and streaming pipelines, data quality/profiling/cleansing, ...

Senior BizOps EngineerThe Data Warehouse BizOps team is looking for a Site Reliability Engineer who can help us solve problems and enhance our capabilities by supporting applications, services, and platforms. This position is to support solutions build for Merchant Enrichment Initiatives Tech Skills: Unix, Shell Scripting, SQL, Python, Apache Nifi, Splunk, Dynatrace, Jenkins, GIT, XLR etc. We regularly review our run state not only from an internal perspective, but also understanding and providing the feedback loop to our development partners on how we can improve the customer experience of our applications. Responsibilities: Engage in and improve the whole lifecycle of servicesfrom inceptio...

Description: Proficiency in Apache NiFi, including developing, deploying, and managing NiFi data flows.(Primary) Strong knowledge of data integration and ETL processes.(Primary) Databases:Proficient in working with MySQL, Oracle, HBase, and MongoDB.(primary) Languages Frameworks:Expertise in Scripting z. Experience with developing RESTful web services and integrating Apache Kafka.(Secondary) Development Operations:Knowledge of CI/CD pipelines, Jenkins, Docker, Kubernetes, and Git.( Secondary) Required Skills: Big Data Technologies:Experience with Apache NiFi, HDFS, and Hive. (Primary) Cloud Technologies:Hands-on experience with AWS services, including EC2, S3, Elastic Beanstalk, DynamoDB, RD...

Title and Summary Senior Data Engineer - Python Spark & SQLOverview-Mastercard is a global technology company behind the worlds fastest payments processing network We are a vehicle for commerce, a connection to financial systems for the previously excluded, a technology innovation lab, and the home of Priceless We ensure every employee has the opportunity to be a part of something bigger and to change lives We believe as our company grows, so should you We believe in connecting everyone to endless, priceless possibilities Our Data Warehouse provides analytical capabilities to a number of business users who help different customers provide answers to their business problems through data You w...

As an Application Developer - Cloud Full Stack at Arthicus Global, your role will involve developing software applications, programming, integration, and managing databases in Bengaluru. You will play a crucial part in writing clean, scalable code, testing and deploying programs, troubleshooting and modifying existing software, and collaborating with other developers and stakeholders to define requirements and design solutions. Key Responsibilities: - Develop and maintain high-quality, efficient, and scalable backend applications. - Participate in all phases of the software development lifecycle (SDLC). - Write clean, well-documented, and testable code adhering to best practices. - Collabora...

As an experienced ETL Developer, your role will involve developing and optimizing scalable data pipelines for efficient extraction, transformation, and loading (ETL) of data from diverse sources. You will leverage technologies like Spark, Dask, and other modern ETL frameworks to ensure smooth data processing. **Key Responsibilities:** - Developing and implementing data quality controls, including monitoring and remediation processes - Providing technical guidance and mentorship to junior ETL developers - Collaborating with the infrastructure team to ensure the availability, reliability, and scalability of ETL solutions - Participating in code reviews and contributing to the development of co...

Should have experience in building scalable enterprise data integration solutions preferred on the Microsoft SQL Server Azure Data Warehouse Database platforms

Should have experience in building scalable enterprise data integration solutions preferred on the Microsoft SQL Server Azure Data Warehouse Database platforms

Should have experience in building scalable enterprise data integration solutions preferred on the Microsoft SQL Server Azure Data Warehouse Database platforms

Should have experience in building scalable enterprise data integration solutions preferred on the Microsoft SQL Server Azure Data Warehouse Database platforms

Location: Bangalore Experience: 6 - 9 Years The Skills required Proficiency in Python API development like Fast API Framework. Understanding of core AWS services like EC2, S3, Lambda, and RDS. Knowledge of managing relational databases like AWS RDS and Proficiency in SQL for querying and managing data, and performance tuning. Experience in working in an Agile environment. The skills that are good to have: Knowledge on Oracle Application R12. Experience with continuous integration and continuous deployment (CI/CD) pipelines usingDevOps tools like Jenkins, Git, Kompass. Knowledge of Kubernetes concepts (pods, services, deployments, namespaces, clusters, scaling, monitoring) and YAML files. Exp...

Location: Bangalore Experience: 6 - 9 Years Candidate must possess: Proficiency in Python programming, including writing clean and efficient code. Experience with frameworks like FastAPI for building microservices & RESTful APIs, Pytest for Unit Testing automation. Understanding of core AWS services like EC2, S3, Lambda, and RDS. Knowledge of AWS security best practices, including VPC, security groups, and IAM Knowledge of Kubernetes concepts (pods, services, deployments, namespaces, clusters, scaling, monitoring) and YAML files. Experience with Apache NiFi for automating data flows between systems. Ability to configure and manage NiFi processors for data ingestion and transformation. Experi...

Role & responsibilities Direct Responsibilities Design and develop real-time and batch data pipelines using tools like Apache NiFi, Apache Kafka, and Apache Airflow. Implement and maintain ETL/ELT processes, ensuring data quality and integrity across various data sources. Integrate and manage data flows across diverse systems using NiFi and Kafka topics. Monitor and optimize the performance of data pipelines and troubleshoot issues proactively. Work with the ELK stack (Elasticsearch, Logstash, Kibana) for logging, monitoring, and real-time analytics. Write efficient and optimized SQL queries for data extraction, transformation, and reporting. Collaborate with data analysts and business stake...

The Skills that are must to have for this role Strong experience with Java, Spring boot development stack and front-end web applications development using Angular. Experience in Oracle/MS SQL database and writing SQL queries. Experience/Knowledge of cloud computing environments (AWS/Azure). Expertise with Object-Oriented Programming concepts. Strong programming skills with digital mindset, and fluent across technology components including API Services development and consumption using modern frameworks and open-source technologies. Apply state-of-the-art tools and methods to enable efficiency, performance and agility through automating DevOps processes, continuous integration, and delivery p...

Develop, test, and deploy data processing applications using Apache Spark and Scala. Optimize and tune Spark applications for better performance on large-scale data sets. Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions. Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions. Design and implement high-performance data processing and analytics solutions. Ensure data integrity, accuracy, and security across all processing tasks. Troubleshoot and resolve performance issues in Spark, Cloudera, and related technologies. Implement version control an...

Key Responsibilities: Develop, test, and deploy data processing applications using Apache Spark and Scala. Optimize and tune Spark applications for better performance on large-scale data sets. Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions. Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions. Design and implement high-performance data processing and analytics solutions. Ensure data integrity, accuracy, and security across all processing tasks. Troubleshoot and resolve performance issues in Spark, Cloudera, and related technologies. Implem...

Title and Summary Senior Software Engineer-3 Senior Software Development Engineer (DW) Job Posting Title Overview Mastercard is looking for a Senior Software Engineer to join the Account Level Management(ALM) team in our Pune office thats focused on building ALM Services with Data warehouse skills. The Mastercard Account Level Management platform empowers real-time card level decisioning. As consumers progress along their life stages as card holders, with increasing disposable income and more refined preferences, ALM provides services to issuers so they can effectively offer more relevant benefits and rewards at each stage, to drive loyalty and spend. Role o Develop high quality, secure and ...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : O9 Solutions Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :- As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with various teams to understand their needs, developing innovative solutions, and ensuring that applications are aligned with business objectives. You will engage in problem-solving...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : AWS Glue Good to have skills : Microsoft SQL Server, Python (Programming Language), Data Engineering Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education About The Role :Developing a customer insights platform that will provide an ID graph and Digital customer view to help drive improvements in marketing decisions. Responsibilities:Design, build, and maintain data pipelines using AWS services (Glue, Neptune, S3).Participate in code reviews, testing, and ...

A Senior PostgreSQL PL/pgSQL Developer specializes in designing, optimizing, and maintaining complex PostgreSQL databases and developing robust stored procedures, triggers, and functions using PL/pgSQL. Key Responsibilities 1. Database Design and Development o Design, implement, and optimize complex database schemas for performance and scalability. o Develop advanced stored procedures, functions, and triggers using PL/pgSQL. o Write and maintain DDL (Data Definition Language) and DML (Data Manipulation Language) scripts. 2. Performance Optimization o Analyze and optimize query performance using EXPLAIN, ANALYZE, and execution plans. o Implement indexing strategies, partitioning, and material...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : O9 Solutions Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :- As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with various teams to understand their needs, developing innovative solutions, and ensuring that applications are aligned with business objectives. You will engage in problem-solving a...

About The Role Project Role : Architecture Assessment Practitioner Project Role Description : Participates in the execution of architecture assessments for all relevant aspects (ex., infrastructure, platform, application, data, and process). Contributes to the discovery assessment and supports the Lead with recommendations to address weaknesses and opportunities. Must have skills : Oracle Cloud Infrastructure Administration Good to have skills : System Monitoring Tools & Techniques, Cloud Infrastructure, Oracle Cloud Infrastructure Architecture Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Role:Cloudera SME Development & Integration, Lev...