Play online chess with real chess board

Program that enables you to play online chess using real chess board. Using computer vision it will detect the moves you make on chess board. After that, if it's your turn to move in the online game, it will make the necessary clicks to make the move.

Setup

Turn off all the animations and extra features to keep chess board of online game as simple as possible. You can skip this step if you enter your Lichess API Access Token.
Take screenshots of chess board of online game at starting position, one for when you play white and one for when you play black and save them as "white.JPG" and "black.JPG" similar to the images included in the source code. You can skip this step if you enable "Find chess board of online game without template images." option or enter your Lichess API Access Token.
Enable auto promotion to queen from settings of online game. You can skip this step if you enter your Lichess API Access Token.
Place your webcam near to your chessboard so that all of the squares and pieces can be clearly seen by it.
Remove all pieces from your chess board.
Run "board_calibration.py"(Alternatively, click "Board Calibration" button in the GUI).
Check that corners of your chess board are correctly detected by "board_calibration.py" and press key "q" to save detected chess board corners. You don't need to manually select chess board corners, it should be automatically detected by the program. The square covered by points (0,0), (0,1),(1,0) and (1,1) should be a8. You can rotate the image by pressing key "r" to adjust that. Example chess board detection result:
Note that "constants.bin" file is created or modified.

Usage

Place pieces of chess board to their starting position.
Start the online game.
Run "main.py"(Alternatively, click "Start Game" button in the GUI).
Switch to the online game so that program detects chess board of online game. You have 5 seconds to do this step. You can skip this step if you enter your Lichess API Access Token.
Wait until program says "game started".
Make your move if it's your turn , otherwise make opponent's move.
Notice that program actually makes your move on the internet game if it's your turn. Otherwise, wait until program says starting and ending squares of opponent's move.
Go to step 6.

GUI

You can run "gui.py" to open the GUI. You can use it to do the steps in Setup and Usage sections and customize how you use the software. You can click "Start Game" button instead of running "main.py" and "Board Calibration" button instead of running "board_calibration.py". Also, you can enter your Lichess API Access Token via Connection→Lichess(You need to enable "Play games with the board API" while generating the token).

Video

In this section you can find video content related to the software.

Game against Stockfish 5 2000 ELO

Test game on chess.com

Test game on Lichess against Alper Karayaman

Game against Lionel45 on lichess org

Game against erpalazzi on Lichess

Play online chess with real chess board and web camera | NO DGT BOARD!

Frequently Asked Questions

What is the program doing? How it works?

It tracks your chess board via webcam. You should place it on top of your chess board. Make sure there is enough light in the environment and all squares are clearly visible. When you make a move on your chess board, it understands the move you made and transfers it to chess GUI by simulating mouse clicks(It clicks starting and ending squares of your move). This way, using your chess board, you can play chess in any chess program either websites like lichess.org, chess.com or desktop programs like Fritz, Chessmaster etc.

Placing webcam on top of the chess board sounds difficult. Can I put my laptop aside with the webcam in the laptop display?

Yes, you can do that with a small chess board. However placing webcam on top of the chess board is recommended. Personally, while using the program I am putting my laptop aside and it gives out moves via chess gui and show clocks. Instead of using laptop's webcam, I disable it and use my old android phone's camera as webcam using an app called DroidCam. I place my phone somewhere high enough(bookshelf for instance) so that all of the squares and pieces can be clearly seen by it.

How well it works?

Using this software I am able to make up to 100 moves in 15+10 rapid online game without getting any errors.

If I use the two exe-files (and not the py-files), where do I have to store the new white.JPG and black.JPG files?

If you use the two exe-files( "main.exe" and "board_calibration.exe") you should create a folder for them and put the two exe-files, "white.JPG" and "black.JPG" files into that folder.

I am getting error message "Move registration failed. Please redo your move." What is the problem?

Program asked you to redo your move because it understood that you made a move. However, it failed to figure out which move you made. This can happen if your board calibration is incorrect or color of your pieces are very similar to color of your squares. If latter is the case you will get this error message when playing white piece to light square or black piece to dark square.

Why it takes forever to detect corners of the chess board?

It should detect corners of the chess board almost immediately. Please do not spend any time waiting for it to detect corners of the chess board. If it can't detect corners of the chess board almost immediately, this means that it can't see your chess board well from that position/angle. Placing your webcam somewhere a bit higher or lower might solve the issue.

Required libraries

opencv-python
python-chess
pyautogui
mss
numpy
pyttsx3
scikit-image
pygrabber
mac-say
berserk

rmarquis / play-online-chess-with-real-chess-board Goto Github PK