ELK

ELK Stack: Real-time machine data analysis tool

Logstash:To combine multiple data sources and parse unstructured or semi-structured to structured data.
Elasticsearch: A search engine which index the data to provide simple, powerful and flexible search functionality.
Kibana: Front-end customizable visualization tool provides real-time analysis of search results.

Logstash

Logs will be input from a file

Log format being defined in Grok. Apart from

standard log format like apache logs, user can write
his own definition of log formats

Output can be sent to elasticsearch and other

multiple interfaces.

An Example of Logstash

Unstructured logs getting parsed into searchable fields.

ELK Search results

Kibana Dashboard