( search forums )
Log parser (stat engine)
Soldat Forums - Soldat Talk - Developers Corner
seacow
April 25, 2003, 11:18 pm
Greetings, I'm new in this community so if this post are in any way misplaced please forgive my error.

To the point:
I have a vision of a program that parses the Soldat Logs and compiles a nice set of figures and statistics. I have the knowledge and will for this but my question is: Are there any programs like this out there already?

If so, the point in this program would be second to zero.

Regards

n2j3
April 25, 2003, 11:58 pm
yeah at least a couple:

this is the most elaborate one , coded in Perl: http://fool.homelinux.org/cgi-bin/sssg-win.pl
it's particularly good for server-specific stats.

SBaL's Log Formatter is the second one, with quite a few options but log-specific (i.e. one log at a time):

http://www.ai.rug.nl/~moonlite/soldat/log-explorer

seacow
April 26, 2003, 4:03 pm
Ahh, ok. Then it seems to be quite a waste of time to develop such a program.

My other thought was to make a remote admin program. Are there any good remote admin programs present?
Please forgive my stupidity. I'm so new to Soldat...

mat
April 27, 2003, 1:56 am
no problem, but next when u start a thread, make sure you search the forum, 'cause these things have been discused already... no offense

Snor
May 22, 2003, 6:49 pm
I have made a really good stat engine:
http://www.snorland.com/soldat/stats/?server=dm
http://www.snorland.com/soldat/stats/?server=dm2
http://www.snorland.com/soldat/stats/?server=ctf

Those are the main stat pages for the 3 servers I'm currently running.

DeMo
July 23, 2003, 11:26 pm
I started working on a Soldat Stats generator in Visual Basic some time ago.
My idea is to make something like Psycho Stats (Half-Life MODs).

The problem is I don't know what's the best method to do that.
Initially I tought of using Arrays.. but that's complicated.

My second idea was using a temporary access database to record data parsed from the logs... then we could use SQL queries to get the results we want. Again.. I don't know if this is the best method.. maybe there's something easier.

Cr4cK
July 31, 2003, 8:09 pm
Snor nice stat engine but... there isnt any stat :(

NightCabbage
August 1, 2003, 12:27 am
snor! :)

hey are you still running your servers??

haven't seen them in the lobby for ages, did you choose not to advertise them?

Vulture
August 3, 2003, 10:17 am
I too tried to make a stats engine
You can see the results here:
http://www.fgs-clan.de/soldatstats

What do you think of it?

Hercule Poirot
August 3, 2003, 10:54 am
umm how that work?

Vulture
August 3, 2003, 11:12 am
it is a php script that generates html-files
i think this is the fastest method, because the script has only to do the work once

peperin
August 9, 2003, 6:05 pm
i think best method is parse and flush logs, with mysql DB for resumes. this method allow a faster parse because the last logs are resumed in mysql and provide a "real time" stats. im improved some.... http://www.espateam.com/soldat-stats/soldat-stats.php

skc.nevermore
August 11, 2003, 3:03 pm
we use soldierstats on : http://selfkill.traffic4all.com/stats1/index.html

its a java-developement, so we have to download the logs from server, run the program, and up the stats. But its still buggy and in developement, but looks quit nice, doestn it ? :)

Vulture
August 16, 2003, 4:52 pm
hmm...i dont want to use a mysql server because not every webspace has one :|
but i think parsing times are quite fast...for about 200 logs 5 seconds on my local machine is ok...

quote:
by skc.nevermore:
we have to download the logs from server, run the program, and up the stats

my script is easier: its just opens the logs via ftp, so nothing more to do then to click update :D

skc.nevermore
August 16, 2003, 8:54 pm
@ Vulture : is there a possibility to download or try your script ?

Looks very sweet :) ( last time i posted your link didn't work )

evildude
August 17, 2003, 7:36 am
Id like to use this stat program as well looks very nice, send us the link

Vulture
August 17, 2003, 11:21 am
http://www.fgs-clan.de/soldatstats.zip
-you have to add a soldatstats/temp folder otherwise you will recieve an error
-you have to edit the config.php
-you may edit the design.css (there are two ATM but they are the same, i just was to lazy to correct this)

there are "some" bugs in it and i hope it will work because i haven't tested it on other machines yet

if there are problems, please contact me:
email: FGS_Vulture@gmx.net
or better via IRC
#fgs-clan @ quakenet, i am the guy named Vulture{} ;)

sparkjim
October 7, 2003, 10:58 pm
Vulture, that link is dead. Your stat engine looks very impressive, I'd really like to try it out.

DeMo
January 27, 2004, 8:21 am
Let me ask you something about the database structure.

When I was designing my log parser I thought in 2 different structures:

1- Use one row for each player found in the logs.
Each row of the table contains: Name, Kills, Deaths, Suicides, Kills With AK, Kills With MP5........
For every player found in the logs, one row like this is created.
And then it is updated every time that player appears in the log.
This results in a smaller database too.

While this method is easier to fetch data about the player when writing the HTML files.. it's also slower to build. I say slower because everytime you have to check the database to see if there's already a row for that player. If it exists.. you just update, else, you create a new row for that player stats.

2- The second method is very simple, it is something like copy & paste the log to a database.
A simple database, with 3 columns: Killer, Victim and Weapon
It consists in passing each event in the log to the database, each kill is added as a new row.
So you get many rows for the same player. But you also get a very bigger database file.

Now I'm clueless about which method I should use.
The second one is easier and faster to build... but the SQL queries to retrieve the data will be a lot more complicated!

I think it's useful to say that the database will be used only for the SQL queries.
I'll add everything to the database and query it for the player with most kills... most deaths.. most kills with MP5 and so on. And then I'll generate the HTML files with this data. You won't need a webserver with ASP support for example, once the HTML files have been created.. the database is useless.

FliesLikeABrick
January 27, 2004, 7:16 pm
I just finished a stats site. I was originally going to use VB to insert the stats into a MySQL database, then read the stats into pages with PHP. Instead, i made it entirely out of php, so that a php page breaks down the logs into the database. The stats are for my server, Ultimate 13 Soldat, so i might as well put a plug in for my server: Ultimate 13 Soldat is up every night at 9PM EST, as well as random other times, and you can get your stats at http://ultimate13.dynu.com:6080 If you would like the source code for my stats pages, let me know and i will make a distribution version that you can use on your site, as long as i get all credit for it.
-Brick

Pr0ger
January 28, 2004, 4:26 am
Soldat Statistics 1.2 almost ready, will go out soon

samthemon
February 1, 2004, 10:54 am
hmm, dont anyone kill me, but i think i good way is a mix of all your suggestions. have a prog running on the same pc as the soldat server. the prog sits there and listens for connections. you could then write a front end if php/perl/whatever(as long as it saupports sockets). the public front end connects to the server, and the server sends back the data.

heck, if ya bother doing that, you could just make the server side prog act like a webserver. run it on port 8080. whenever it gets a GET. spit back a page with all the stats. of course, make sure it looks like vultures and skc's. VERY cool. good job guys!

sAm

Xalion
March 17, 2004, 7:49 pm
Sorry to bump this post, but I would hear if anyone wanted a simple VBs/ASP log parser that saves the info to a database, or should I just throw it into the trashcan?

DNA.styx
March 17, 2004, 8:32 pm
I'm v interested.

samthemon
April 16, 2004, 6:22 am
don't you already have a stat engine dna?

Xalion
April 16, 2004, 11:09 am
It was for the old log format

Fisch.666
August 25, 2004, 9:41 pm
Hi!

Any updates to this thread?

Most links on the first page are down... [:(]

DeMo
November 3, 2004, 1:26 am
quote:Originally posted by XalionSorry to bump this post, but I would hear if anyone wanted a simple VBs/ASP log parser that saves the info to a database, or should I just throw it into the trashcan?


hey, I'm interested!!