Deep Log Analyzer FAQ
Common Questions
What is hit and visit in Deep Log Analyzer?
Hit is a single action (for example,
a click on the link) taken by a user at a website that
corresponds to one line of data in the web server log file.
When user request a web page browser also requests all graphic
elements on located on that page. Each of these request results
in a separate hit recorded to log file and respectively
imported by Deep Log Analyzer.
Visit (sometimes also
called visitor session) is a sequence of requests (hits) made
by a user. Visit begins either when user is referred to the
site through a link on other website, or he types your site URL
into his browser address field (direct request). Visit ends
when there are no additional requests made by the user during
the period of time specified in project settings (default value
is 30 minutes).
What volume of web server logs can be imported by Deep Log Analyzer?
Deep Log Analyzer imports data from log files into MS Access
database. It uses separate database mdb file for each project.
A single mdb file can have size up to 2 Gb. Data in a database
is organized in much more efficient way than in raw log files
since database is designed according to normalization rules.
This is why log files take less space in the database than
their original size. Also Access database can be compressed to
take even less space. Also it is recommended to filter out
graphics requests in project settings in order to have a
smaller database.
How do I optimize Deep Log Analyzer to work faster?
Take into account that Deep Log Analyzer uses an advanced report caching technique for opening reports faster. This means that a report's query is actually executed only when you open report for the first time. Next times report has been loaded from a fast cache and it takes much less time. It allows you to browse your website statistics complex reports in real time without any delay.
Here are some additional advices to make Deep Log Analyzer even faster:
- Consider not importing graphics requests into the project database. Unmark corresponding check box on Excludes tab in Project Settings. Graphics requests usually take about 2/3 or more of all hits and have very limited useful information in them. Excluding improves logs import and report creation speed several times and makes your project database a few times smaller.
- Do not import into the database hits generated by visitors from your company. Such "inside" visits can become a substantial part of all recorded web site activity. Excluding such hits improves import and report execution speed and results in less database size as well as makes your reports more accurate since they include only activity of your real visitors. Enter your companies external IP addresses in list on Exclude tab in Project Settings.
- Consider creating new projects more often. Instead of importing all log files for your web site life time in a single project in Deep Log Analyzer create new project every quarter, month or even week (for larger web sites). Keep old data in other projects so that you could concentrate on the situation on the website. This will make reports much faster and easier to work with by eliminating data for unnecessary time periods. Use wildcards to specify log files sets for particular dates, for example c:\logs\ex0406*.log will import only log files for June 2004.
- When importing log files click Background button located in import dialog window. This will minimize Deep Log Analyzer to system tray and it will continue importing process in the background allowing you to work comfortably with other programs. Deep Log Analyzer will be restored from background automatically when log parsing finishes.
- Make sure your computer configuration matches the minimum system requirements.
Basically Deep Log Analyzer performance
depends most on two main factors: hard drive speed and CPU
speed. Computer also should have enough RAM - 256 to 512 Mb is
appreciated.
How can I make Deep Log Analyzer recognize more search engines?
Deep Log Analyzer currently can recognize more than hundred
most popular internet search engines like Google, Yahoo, MSN,
etc. In log file it can find search engine name and key phrase
that referred visitor to your website. If you receive hits from
some local search sites, you can add them to search engine
definitions in search_engines.ini file.
They will then appear
in all search engine reports in Deep Log Analyzer. Open
search_engines.ini file in Notepad, add new line in the format
like SE114=MySearchEngine into [SearchEngines] section. Than
add new [MySearchEngine] section at the end of file and list
the values that tell how to recognize hit from this search
engine:
EngineIndicator1=mysearchengine.com
EngineIndicator2=mysearchengine.net
SearchPhraseIndicator1=?q=
SearchPhraseIndicator2=&q=
This allows to recognize referrer
URL like http://www.mysearchengine.com?q=phrase1 as a hit
referred by MySearchEngine with search keyword "phrase1" Search
engine definitions are processed at the time of log file
parsing, so the newly added definitions will work only for logs
that you import later on. You may re-import log files to apply
changes to all imported data. It is recommended to back up ini
file after editing or it will be overwritten if you reinstall the
program. Or just keep a copy of added records in a separate
file.
How to add browser, spider or OS definitions?
You can add custom
browser, search engine spider and OS definitions in
user_agents.ini file. Look at Unrecognized Browsers report. It
shows all User Agent fields found in imported log files that
are not described in user_agents.ini. If you get lots of hits
from some kind of user agent (for example new download manager)
that Deep Log Analyzer does not recognize, you can add custom
definition for this user agent. It will be then recognized as a
standard browser. Definitions should be entered in the
following format in [Browsers] section:
BROWSERXX=[Name],[Log file stamp used to find it]
For example: BROWSER22=ReGet (downloader),ReGet
The same format is used for search engine
bots ([Spiders] section on user_agents.ini) and OSs
([Platforms] section in user_agents.ini). Back up edited
ini-file as it can be overwritten when you install new version of
Deep Log Analyzer.
Can I create my own reports in Deep Log Analyzer?
You can
design you own custom reports using SQL queries. It is
potentially possible to create report on any aspect of the
website usage you may ever need since all data from log files
is imported in a well designed relational database. You may
create new report based on any standard report. In this case
SQL query will be copied to your new report and you'll be able
to edit it. Deep Log Analyzer has advanced SQL query editor
with syntax highlighting. To design good and useful reports you
have to become familiar with database structure that you can
see in diagram.jpg file provided with the software. Contact us in case you require
assistance with designing your custom reports.
What log file do I need? Where can I get the log files?
Deep Log Analyzer needs web server log files
in order to analyze your web site and create reports. Every
time the visitors come to your site and click on the links web
server writes these actions to the log file. Log file contains
records about all web pages and graphic elements requested by
the users. Log files are usually stored on the web server
computer. You need to ask you ISP or hosting company how to get
the raw log files for your website. On Unix hosting log files
usually have names similar to access_log or
access_log.gz. On
Winsows/IIS hosting files usually are named like ex040423.log,
ex040424.log.
This software can not analyze log files from
other programs, like proxy server logs, etc. Deep Log Analyzer
can access log files via ftp or read logs from your local drive
if you have copied them from the web server computer. Deep Log
Analyzer can read log files archived in zip or gz.
Where is the projects data actually stored on my hard drive?
I want to back it up/I want to move it to another folder or drive.
Deep Log Analyzer keeps files for all projects inside one
single directory. Exact location varies from computer to
computer and usually is "C:\Documents and Settings\All
Users.WINDOWS\Application Data\DLA Storage\". To see where the
Data Storage is located on your computer click File-Open menu
and look at the bottom of the Open Project dialog. Projects are
located in subfolders inside Data Storage directory. Each
project folder contains hits.mdb file that is MS Access
database containing imported log files. If it is not enough
free space on the hard drive with the storage you may move it
to another drive. Click File-Move Data Storage menu to do it. Deep
Log Analyzer will copy all files to the new location you
entered.
What kind of database does Deep Log Analyzer use?
Deep Log Analyzer imports web server log files into industry
standard MS Access database. There is one separate mdb file for
each project. Database file is named hits.mdb and located in
project's subdirectory inside Data Storage.
You can simply open
database in MS Access using [File-Open Database in MS Access]
menu command. Database is carefully designed according to
normalization rules for speed- and size- efficient storage of
web site log files data. To view database structure diagram
click open diagram.jpg file located in Deep Log Analyzer
directory or click View Database Diagram in Start menu. You can
design custom query in MS Access and create custom report in
the program based on that query. Standard database format makes
it easy to open the database in other programs where you need
to access website statistical data.
How to have the program reports exclude such files as .cgi and .txt?
I basically just want .html and .htm pages. By including .cgi, etc it is throwing off my results.
You can do it. You need to edit some settings of your project manually:
Open
"C:\Documents and Settings\All Users\Application Data\DLA Storage\'Project'\'Project'.dla" file in text editor.
"C:\Documents and Settings\All Users\Application Data\DLA Storage" here is the default root
folder of your Deep Log Analyzer Data Storage
There are two lines in .dla file:
Filter-IncludeFiles=
Filter-ExcludeFiles=
If you want to have only html pages reported enter:
Filter-IncludeFiles=*.htm;*.html
If you want only to exclude cgi and txt files enter:
Filter-ExcludeFiles=*.cgi*;*.txt
When you edit the file Deep Log Analyzer should not be open. After editing dla-file reimport all logs. First click Delete imported logs from DB, then click Import Logs
Is it possible to include our own company logo into the exported reports?
You can customize the look of the exported HTML reports.
Export is based on the template file located in
"C:\Program Files\Deep Log Analyzer\Templates\report.html"
First backup this file.
Open report.html in text editor and add your logo. Do not save this file
from WYSIWYG editors as it's not true HTML file and they can break its structure.
It's possibly better to link to your image located on the web,
so that it's accessible from any place the report is opened.
You can also customize other details of the report look in this template.
For printing reports Deep Log Analyzer uses print.html file located in same folder.
It can be modified same way
Can I customize colors of the exported reports?
You may change the colors and other design aspects of the HTML reports.
Export is based on the template file located in
"C:\Program Files\Deep Log Analyzer\Templates\report.html"
First backup this file. Then open report.html in text editor. Do not save this file
from WYSIWYG editors as it's not true HTML file and they can break its structure.
There is an XML section on top of the document between [$XML_BEG] and [$XML_END] tags.
All colors are defined there in XML format. There are colors defined for 3 levels of
hierarchical reports.
For example, to change table colors modify the following 2 values:
<TableLight>#f2fbfe</TableLight>
<TableDark>#d3f2ff</TableDark>
Purchase Questions
How much is Deep Log Analyzer?
Please look at our Buy Page for current
prices. Licensing is based on the number of computers where program can be
installed. Base license is for one computer. If your organization needs to
install it on more computers and make it available for more users you need additional
licenses.
We offer also volume discounts for multiple license purchases.
Click the 'Volume Discounts Available' link on product's order form.
How can I buy Deep Log Analyzer software?
You can buy Deep Log Analyzer on our web site.
Orders are
processed by our partners Plimus, located in California, USA. They offer
a variety of payment options: MasterCard, Visa, EuroCard, American Express,
Discover/Novus, Diners Club, JCB, US$ Checks, Eurochecks, Wire Transfers.
Payments can be made Online, by Fax, by Mail or by Phone. Purchase orders are also accepted.
Please contact our sales department if you have any questions.
We accept purchase orders from the companies and organizations.
We allow a payment deadline of 30 days from purchase. To order click Buy Now link on the
online order page and select Purchase Order as your Method of payment.
Follow the instructions and fax your purchase order to Plimus.
Basically you will need to print out the Quote and send it together with your Purchase Order.
Unfortunately, Purchase Orders received without the Quote will simply be discarded by Plimus without
further notice.
What happens after I purchase Deep Log Analyzer online?
After you pay you will instantly receive the download link for the fully
functional product and your registration license code. Delivery is performed
via email. Then you download and install full version of the program, enter
registration code and activate the program online. After doing these easy
steps you may start using the program.
Is there any hidden fees?
There is only one flat fee that you pay once and own the license for the
product forever. There is no need to pay for subscription, tech support, etc.
Do I get technical support with my purchase?
As a registered user you get high priority product life time free technical
support via email. Please contact us for with any questions.
How about the upgrades?
We work on improving our software constantly. Product updates and fixes are
available quite often. Registered users get all upgrades for free during one
year since purchase date. We send out emails with the upgrade instructions
periodically. Upgrades after one year are available with large discounts.
I purchased your software with my credit card. What charge will I see in my credit card statement?
Please note that the charge on your credit card statement will appear as: PLI*DEEPSOFTWARE.
PLI is for Plimus that is Deep Software's partner who is processing orders for our software
|