A question about training the neural networks about deepholdem

[zhoujz10]

@happypepper

[happypepper]

what was your river loss? or did you solve 2 streets?

[zhoujz10]

@happypepper Hi, thank you for your reply. I solve 2 streets instead of using a river network. And I calculated my exploitability of a turn case, the exploitability is around 2 mbb, so I guess my resolving process is right. Maybe there are bugs in my bucketing?

How many epochs did you use to train your network? I used thousands of epochs but my training loss is still very high.

[happypepper]

After around 80 epochs, it stopped improving. Validation loss after first epoch was 0.08 already.

How did you do bucketing? k means + EMD?

[zhoujz10]

@happypepper I use k-means on the river round, and EMD on other rounds. I used the same bucketing in the reference papers.

I noticed that in your code, you made a change when calculating the loss.

In line 64 in masked_huber_loss.lua, your code is:

local loss_multiplier = (batch_size * feature_size) / self.mask_sum:sum()

This means you average the loss on valid buckets, not on all the 1000 buckets. I think this makes sense, and the author's repo has a bug here.

Is there any way to debug my bucketing? I'm at the end of my rope.

[happypepper]

how is it possible to use k-means for river? There is only one number instead of distribution. EMD is usually used in combination with k-means.

You can email me and we can communicate outside of github somehow, it's easier

[zhoujz10]

@happypepper Hi, I just sent an email to you and described the method of generating river clusters.

[aligatorblood]

Hi, can you send me this email as well?