Username: Password:
  Create an account Home  ·  Game Manager  ·  Forums  ·  Your Account  
Login
Username

Password

Don't have an account yet? You can create one.

Site Sections
· Home
· Game Manager
· Forums
· Private Messages
· Your Account

Game Manager
· Your games
· Waiting games
· Create new game
· Running games
· Completed games

Recent News

MaBiWeb: Forums

MaBiWeb :: View topic - Collecting Game Logs for Datasets
 Forum FAQForum FAQ   SearchSearch   UsergroupsUsergroups   ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

Collecting Game Logs for Datasets

 
Post new topic   Reply to topic    MaBiWeb Forum Index -> General
View previous topic :: View next topic  
Author Message
anwang



Joined: Feb 16, 2017
Posts: 3

PostPosted: Thu May 21, 2020 10:47 pm    Post subject: Collecting Game Logs for Datasets Reply with quote

I'm not sure if this has come up elsewhere, but I was wondering whether you (MaBi) are saving the game logs of all played games?
They could be very useful for building a dataset to potentially train AI players, or study statistics.

If you are collecting the game logs, do you mind sharing the approximate sizes of how many games you have recorded?
Back to top
View user's profile Send private message
MaBi
Site Admin


Joined: Jan 01, 2006
Posts: 957
Location: Italy

PostPosted: Fri May 22, 2020 8:47 am    Post subject: Reply with quote

I have the logs but I don't think they would be much useful: they are basically the same logs you see in the game while playing, so they would be difficult to parse to even extract simple statistics, let alone to train an AI.

Currently I have 11362 logs, out of 11580 total games played on mabiweb (the first couple hundred games were mostly for debugging and I didn't log them). Each log is a text file of ~100kB (it contains other info beside the log), for a total of ~1.2GB, ~120MB after zipping.
Back to top
View user's profile Send private message Visit poster's website
Logitude



Joined: Jan 06, 2020
Posts: 15

PostPosted: Sun May 24, 2020 12:07 am    Post subject: Reply with quote

I was actually considering running some analysis on Nations games played here. So far, I have written a script that parses the HTML of a finished match and outputs a more readable log format:

http://charles.j.tabony.net/offsite/Nations/scripts/nations_page_parser.txt
(The extension is actually .py, not .txt, but posted as .txt for the web.)

The idea is to then parse the output log format to study things like correlation between cards and points. It would take many games for that to be meaningful though.

Thoughts, MaBi?

Certainly, if I could seed that analysis with more than 7 or 30 days worth of matches, that would be preferable.

With regard to AI, I think you'd need at least millions of games to train a general one for a game like this. I think the best you could do with thousands of games is figure out relative values of cards and then use that in a hand-written evaluation function.
Back to top
View user's profile Send private message
MaBi
Site Admin


Joined: Jan 01, 2006
Posts: 957
Location: Italy

PostPosted: Sun May 24, 2020 9:56 am    Post subject: Reply with quote

Logitude wrote:
The idea is to then parse the output log format to study things like correlation between cards and points. It would take many games for that to be meaningful though.

I had done something similar some time ago, parsing the logs for correlations betweens cards and wins, i.e. counting how many games the player who bought a certain card was the final winner. For example, re-running the script with the current 11000 games:

Abraham Lincoln
2p win rate: 646/1084 (60%)
3p win rate: 292/632 (46%)
4p win rate: 240/691 (35%)
5p win rate: 87/290 (30%)
6p win rate: 21/73 (29%)
Total win rate: 1286/2770 (46%)

Frederick the Great
2p win rate: 422/792 (53%)
3p win rate: 226/625 (36%)
4p win rate: 166/585 (28%)
5p win rate: 41/244 (17%)
6p win rate: 10/73 (14%)
Total win rate: 865/2319 (37%)

But I don't really know how significant or useful are this kind of stats.

Logitude wrote:
Certainly, if I could seed that analysis with more than 7 or 30 days worth of matches, that would be preferable.


If you want I can provide you, or anyone else interested, all the logs I have, then it's up to you to do the parsing.
Back to top
View user's profile Send private message Visit poster's website
Logitude



Joined: Jan 06, 2020
Posts: 15

PostPosted: Sun May 24, 2020 8:49 pm    Post subject: Reply with quote

MaBi wrote:
But I don't really know how significant or useful are this kind of stats.

I don’t know either. For one thing, different cards have different values based not only on player count but also “difficulty level” (prince vs. king, etc.). Also, not every card is in every game, even for the games that use every deck. I’m sure I’d be looking up formulas and scratching my head for a while, and might even give up. I’m not a statistician. It might be interesting to try though.

I was thinking I’d try something like this:
https://boardgamegeek.com/thread/1933554/data-driven-strategy-tips
But Through the Ages has the advantage that you see every card in every civil deck. You won’t buy most of them, but at least they’ll be available. There are also far fewer options for play, just number of players.
Back to top
View user's profile Send private message
adderat



Joined: May 02, 2019
Posts: 1

PostPosted: Tue Jun 09, 2020 10:32 am    Post subject: Reply with quote

I am interested in looking at the logs!
If it is not a problem for you to send them, I would be happy!
Back to top
View user's profile Send private message
MaBi
Site Admin


Joined: Jan 01, 2006
Posts: 957
Location: Italy

PostPosted: Tue Jun 09, 2020 12:49 pm    Post subject: Reply with quote

I will send you a PM with a link to download the archive.
Back to top
View user's profile Send private message Visit poster's website
Display posts from previous:   
Post new topic   Reply to topic    MaBiWeb Forum Index -> General All times are GMT + 1 Hour
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum

Powered by phpBB © 2001, 2005 phpBB Group
Forums ©

 
MaBiWeb copyright 2006 by MaBi
PHP-Nuke Copyright © 2005 by Francisco Burzi.
Page Generation: 0.03 Seconds