Logo SharePoint Thoughts   Downloads   About   Up to Bluedog Limited
Working with a different type of Site Usage Analysis
Posted on 6/20/2004 2:31 AM by Maurice Prather
One of the neatest things about technology is the number of different ways one can do various things.
 
Take SharePoint's Usage Analysis feature...  pretty cool at first, it gives you some basic information.  However, if you want any advanced display or different view on the data, then you're gonna quickly find that the Usage Analysis feature is designed to provide basic data and nothing more.  For example, do you want a chart representation?  You can't get it without writing custom code.  Then I started thinking down the path... 
 
"Hmm - surely there's a better way of getting at site usage data.  How can I get to the data locked away in my iis logs?"
After searching the internet a bit, I landed upon an awesome tool for datamining IIS logs.  On help make things better, it's free!!  The tool, Analog.exe, can be found at http://www.analog.cx.  It does a fantastic job at processing your logs to produce full feature usage reports. 
 
Ok... but how does it really compare to the built-in usage analysis?
Given the large breadth of configurability, using Analog.exe to produce reports for your server is without a doubt much more powerful than the built-in usage analysis system. 
 
There is one area, though, where the native system is superior - understanding requests to owssrv.dll.  A large number of requests are handled by this core dll.  Unfortunately, IIS only knows that a request was processed, but id does not know the details of exactly what was requested.  For example, an image on a page does not appear as a singular request for that image, instead it appears as a request to owssrv.dll.  This is exactly where the native usage analysis excels - SharePoint knows how to record the request for "image.jpg" when a owssrv.dll responds.  Overall, I'm fine with losing that bit of information.
 
How can I make this work on a SharePoint server?
It's super simple...
  1. Build a configuration file
  2. Run Analog.exe
  3. Copy the output to your SharePoint server
and once you get things working, you can easily automate the process. 
 
Neat, but how do I automate the process?
Create a batch file which executes steps #2 and #3.  Then using Windows Task Scheduler, setup a job which calls the batch file at your desired intervals.
 
What do you use to copy the files to the SharePoint server?
There are few ways you can do this...
  1. Use web folders to map a drive to your server.  This works really well if your site name and the server machine name are one in the same (authentication is automatically handled for you in this situation). 

    Syntax: net use * \\myServer\myFolder

    Once mapped, then a simple xcopy command will suffice.
  2. Use DAV to directly copy the files to your server.  This is your only option when dealing servers configured to use host headers.  I've created tool, DavCopy.exe, to handle the copy operations.  It operates just like xcopy, but it's designed to use the WebDav protocol.

    Syntax: DavCopy.exe * http://www.myserver.com/myFolder

    The tool has been posted in the Downloads folder (http://www.bluedoglimited.com/Downloads).

Summary
Overall, using Analog to produce usage reports for your SharePoint server is step above the built-in system.  It's fast, powerful and completely configurable.  Once you get things pieced together, you're done - reports start coming on a regularly scheduled basis! 

-Maurice

re: Working with a different type of Site Usage Analysis
Hello, im looking for an Analysis Report SharePoint Tool.
Could you please tell me a little bit more about the process to configure a great SharePoint Analysis?
 
Thanks a Lot.
Luis Du Solier G @ 6/27/2005 9:10 AM
re: Working with a different type of Site Usage Analysis
This post is a great start ... and basically costs nothing (free tool).
 
I would also check out the following post which outlines a few other options:
 
Maurice Prather @ 6/28/2005 9:24 PM
re: Working with a different type of Site Usage Analysis
We use analog to analyze our web server logs and it is a great tool once you get the configuration right. We experienced a slight problem when we upgraded our servers fro Windows 2000 to Windows 2003 in the middle of a month and had to run reports for each day up to the daybefore we swithed operating systems. Then we had to change the configuration to the new OS format and run the rest of the days of the month. The next month we could again run our monthly reports.
 
Any chance of seeing your configuration file for SharePoint?
BobFilipiak @ 8/1/2005 5:34 AM
re: Working with a different type of Site Usage Analysis
Bob:
 
I use a set of 6 files to produce a variety of reports.  There's really nothing special about them other than the options I've turned off/on and the applicable date ranges.
 
Maurice Prather @ 8/2/2005 1:04 AM
re: Working with a different type of Site Usage Analysis
Thanks. Just not as simple as running analog against SPPS 2001 logs, but that is what keeps us busy ;-)
BobFilipiak @ 8/12/2005 6:08 AM
re: Working with a different type of Site Usage Analysis
Hi,
 
You actually dont need a 'DavCopy.exe'.
 
You can map drives directly to the WebDav folder (from XP/2003) and copy.
 
Hence eliminating the need for further custom tools.
 
Great idea though.
 
Cheers,
 
Mick.
 
Mick @ 4/17/2006 11:47 PM
re: Working with a different type of Site Usage Analysis
Mick,
 
True, but the webclient service is not turned on for everyone.  Additionally, what happens if you can't map to the server? :)
 
-Maurice
Maurice Prather @ 4/18/2006 5:42 PM
re: mass import of docs
Hi Guys,
 
any chance to find a way (or tool) for uploading tons of files and setting metadata from a existing XML file?
 
 
Thx in advance,
Jens
Jens @ 10/27/2006 1:43 AM
re: Working with a different type of Site Usage Analysis
Jens,
 
You might want to check out the import/export library ... http://www.bluedoglimited.com/SharePointThoughts/ViewPost.aspx?ID=59
 
Maurice Prather @ 11/1/2006 10:13 AM
re: Working with a different type of Site Usage Analysis
Hi everyone,
Maybe I'm slow but I'm finding this installation very complicated.
first, where do I create the config file and what do with it afterwards?
second, I coppied the entire folder to my server (as explained) after running the exe file, but then I couldn't figure out what page I need to run, in the end I decided on anlgform.html but when I ran it it gave me this error:
 
N.B. This form will not work - e.g. the buttons may not even appear - until you've configured it according to the instructions. When you've configured it, you should remove this paragraph.
I tried configuring the page but it still wouldn't budge - I'm at a loss and would really love to try this tool.
I'll take help from anyone!
thanx

Anna @ 6/26/2007 10:29 PM
RSS feed
Microsoft Certified Master
MVP Logo
Follow me on Twitter!
Keyword Search
 
View by category
 

Disclaimer:
The contents of this site represent thoughts and opinions of the authors , not those of anyone else - such as past, present and future employers.  This a forum of the exchange of ideas centered on SharePoint technologies.  It is not a support channel.  :)

Copyright © 2004-2010 Maurice Prather, Inc. All rights reserved.