Splunk-ing
No I am not talking about visiting caves. Splunking is the process of using a product called Splunk. It’s a security search engine that allows you to view log information from various sources such as firewalls, servers, and other network devices and report on them. Think of it as as Google for IT stuff. Beyond the functionality, which is excellent, the really nice thing about this product is that it’s open source meaning it’s essentially free to use, if you don’t want any professional advice or support and you are not pumping tons of data into it.
This 2 minute video give you all the information you need to get started.
How does it work?
Splunk like Google needs data to work. Google’s strength is that it can not only search through tons of data but it can correlate it, making some assumptions in terms of what should be displayed and in what order. Splunk works much the same way. It uses data generated from virtually any networked computer device and then allows you to search for things that are important, such as signs of potential or known problems. By default it can gather information from Event Logs automatically, syslogs, file shares and with a growing list of plug-in’s can read data from other sources.
So how does it benefit the average company?
Splunk is a framework that can make sense of data. In it’s simplest form, it can show you on one page the condition of a system, security information, change controls, web page stats, etc.
If you’re looking for a way to easily report on the IT log data you already have you should look at Splunk.
August 18th, 2008 at 1:48 pm
“the really nice thing about this product is that it’s open source meaning it’s essentially free to use”
I wanted to point out that while Splunk does have a free version, it is NOT open source. Yes, you can use it and index up to 500 MB of data per day for free, but the source code is distributed in compiled format and is not available for redistribution (without a partner agreement).
Nice write up on splunk though, it’s a great tool, we love and use it as well.
-theHoegg
August 18th, 2008 at 1:59 pm
Thanks for the clarification, Joe!