Mining Your Logs - Gaining Insight Through Visualization

Google Tech Talk (more info below) March 30, 2011 Presented by Raffael Marty. ABSTRACT In this two part presentation we will explore log analysis and log visualization. We will have a look at the history of log analysis; where log analysis stands today, what tools are available to process logs, what is working today, and more importantly, what is not working in log analysis. What will the future bring? Do our current approaches hold up under future requirements? We will discuss a number of issues and will try to figure out how we can address them. By looking at various log analysis challenges, we will explore how visualization can help address a number of them; keeping in mind that log visualization is not just a science, but also an art. We will apply a security lens to look at a number of use-cases in the area of security visualization. From there we will discuss what else is needed in the area of visualization, where the challenges lie, and where we should continue putting our research and development efforts. Speaker Info: Raffael Marty is COO and co-founder of Loggly Inc., a San Francisco based SaaS company, providing a logging as a service platform. Raffy is an expert and author in the areas of data analysis and visualization. His interests span anything related to information security, big data analysis, and information visualization. Previously, he has held various positions in the SIEM and log management space at companies such as Splunk, ArcSight, IBM research, and PriceWaterhouse Coopers. Nowadays, he is frequently consulted as an industry expert in all aspects of log analysis and data visualization. As the co-founder of Loggly, Raffy spends a lot of time re-inventing the logging space and - when not surfing the California waves - he can be found teaching classes and giving lectures at conferences around the world. http://about.me/raffy