Logs Analyzer Application

This directory contains code from the chapters, assembled together to form a sample logs analyzer application. Other libraries that are not discussed have been used to make this a more finished application. These are the features of our MVP (minimal viable product) logs analyzer application:

• Reads in new log files from a directory and inputs those new files into Spark Streaming.
• Compute stats on the logs using Spark - stats for the last 30 seconds are calculated as well as for all of time.
• Write the calculated stats to an html file on the local file system that gets refreshed on a set interval.

You can use this simple application as a skeleton and combine features from the chapters to produce your own custom logs analysis application. The main class is LogAnalyzerAppMain.java.