Skip to content

Latest commit

 

History

History
888 lines (706 loc) · 51.5 KB

README.md

File metadata and controls

888 lines (706 loc) · 51.5 KB

Everything Apache NiFi

Timothy Spann @PaaSDev

How to Build Flows

New Processors

Newest Examples

Slides

Updates

Must Watch Video

Install

Don't Run NiFi Batch Jobs... But you can. Try NiFi Stateless, but you don't want to use Airflow try this

Support

Cloudera Data Flow - Kubernetes Deployment

DevOps / Tools / Scripts

Load Balancing

Syslog

Grok

Documentation

Demos / Examples

Cybersecurity

Reprise Demos

Blogs

FHIR / HL7 / Health / Medical

Containers / Docker / K8

Examples

NiFi Frameworks

Sequencing and Ordering

Expression Language:

  • random Description: Returns a random whole number ( 0 to 2^63 - 1) using an insecure random number generator.

  • nextInt Description: Returns a one-up value (starting at 0) and increasing over the lifetime of the running instance of NiFi

  • ${now():toNumber()}

  • SELECT RPATH(message, '/c_ip') as xxx from flowfile

get recordpath for things like nested structured in json or xml

Other Options

Ingest and Process Logs

Community Q&A

SAAS Interfaces

Software Artefacts

Must Read Articles

Conference Talks

Quick Tips

Understanding NiFi Internals / Architecture

Cloud

ETL / ELT / CDC / Load / Ingest

Dockerization / K8

Reporting Tasks

Error Handling

Templates and Examples

Sizing and Performance

Reporting and Monitoring

Use Cases and Examples

Sources & Sinks

NiFi Stateless

Machine Learning, Deep Learning, AI

Best Practices

Tutorials

How To

Integration Testing

IoT, Devices, MQTT, Sensors

Administration,CLI, REST, Management, DevOps, CI/CD, Security

Quick Starts

Workshops & Crash Courses

FLaN(ifi)K

Meetups

Videos

Cloud

Building Custom Processors

Custom Processors

Migrate Flume Flows to NiFi

JMS, RDBMS, Kafka, Syslog, Twitter, Parquet, Kudu, Hive, HDFS, REST

FDLC, SDLC, DevOps, Backup, Restore, Migration, CI/CD

NiFi Notes

Webinars

Integrations

CDP Public Cloud, AWS, Azure, GCP

MemSQL

GreenPlum DB

Teradata

Microsoft SQL Server (MS SQL)

Oracle

S3 Data Indexing

Cloud

CDC / Database

Provenance Checking

Quick Tips: check nifi security policy on provenance, check configuration for repo-type, check for available disk space, unsynced time, restart all servers. Configuration: nifi.provenance.repository.max.storage.time

Videos

Misc

Other Languages

Legacy / Older Editions