Any modern business generates a lot of logs - from customer transactions all the way to the technical logs of your servers. Many times these logs are thrown away or just sit uselessly somewhere on disk.
I would like to show you how you can make sense of all that data, how to collect and clean them, store them in a scalable fashion and, finally, explore and search across various systems.
Once we have all the data in one place I will go over some examples of more advanced analysis (beyond simple, though very useful, counting of things) like finding patterns and trends in your data.
We will use Elasticsearch, Logstash and Kibana (aka the ELK stack) to achieve that. All tools presented are open source and examples will be using real life use cases.
Honza is a Python programmer and Django team member.
He claims to be scared of the bright and shiny world of browsers, designers, and users. He prefers instead to stay buried deep in infrastructure code, and to provide others with the tools to do the actual site-building.
Since 2008 Honza has been building content-driven web sites for fun and profit. During this time he discovered Elasticsearch, which led to his joining the company behind it in 2013; he now works on Elasticsearch’s Python drivers and integrations.