streaming

Streaming applications based on Spark Streaming written in Java and Scala

Kafka stream

• Reads csv file and create a messages from it
• Feed messsages to a Kafka topic
• Creates a Spark Stream from it
• Filter stream
• Renders into a HTML file

Log stream

• Reads a log stream of data from a text file
• Creates a Spark Stream from it
• Performs some simple operations
• Renders results into a HTML file