lichess.org
Donate

OTB tracking with computer vision, promotions, checkmate detection and initial VAR implementation.

I have been implementing new features in my OTB tracking application, ChessGaze.

I've now solidified promotion handling, checkmate detection, and sending games to my cloud server, which I hope can eventually be used by tournament arbiters.

To test all these new features, I played my favorite gambit, the Albin gambit, because it includes an early knight promotion.

Game tracking works really well. It's fast enough that I didn't need to edit the video at all.

https://youtube.com/shorts/x4mHuSgqA3g

First, I set the tournament name and board/table name for arbiter control.

Then I play the gambit and promote to a knight.

For the last three moves, I intentionally played poorly to test the checkmate detection. Everything worked as expected.

Finally, the game is automatically uploaded to my cloud server:
VarPicOnCloud.jpeg

https://games.chessgaze.com/?table=DEMO%3A%3ADEMO

On cloud an arbiter or a teacher can check the moves , check mate and even illegal moves will be send as event which happens a lot in beginner tournaments and an arbiter is not enough to look for everything.

The app requires a tripod my set up is like:
MySetup.jpeg

r/lichess - OTB tracking with computer vision, promotions, checkmate detection and VAR implementation.
I'm hoping these features can be useful both in tournaments and for casual games at home.

Thanks to my 3D printer, I've been able to train the model on many different chess sets. The biggest challenge that remains is wooden sets where the white pieces have a darker, brownish color. Simply adding more training data isn't always the answer, as it can reduce the model's overall generalization.

I am also not sure how to understand when a player resigns, so I can send a event to VAR as well.

I'm also trying to make the setup process more reliable by adding clearer instructions and more pictures inside the app.

It is avaliable on android&ios and download links are avaliable at https://chessgaze.com/

Please let me know if you have any feedback!

I have been implementing new features in my OTB tracking application, ChessGaze. I've now solidified promotion handling, checkmate detection, and sending games to my cloud server, which I hope can eventually be used by tournament arbiters. To test all these new features, I played my favorite gambit, the Albin gambit, because it includes an early knight promotion. Game tracking works really well. It's fast enough that I didn't need to edit the video at all. https://youtube.com/shorts/x4mHuSgqA3g First, I set the tournament name and board/table name for arbiter control. Then I play the gambit and promote to a knight. For the last three moves, I intentionally played poorly to test the checkmate detection. Everything worked as expected. Finally, the game is automatically uploaded to my cloud server: ![VarPicOnCloud.jpeg](https://image.lichess1.org/display?op=noop&path=t5chQnNIg7dU.jpg&sig=045d962f60c075383da02e16839ba853e86efbcd) https://games.chessgaze.com/?table=DEMO%3A%3ADEMO On cloud an arbiter or a teacher can check the moves , check mate and even illegal moves will be send as event which happens a lot in beginner tournaments and an arbiter is not enough to look for everything. The app requires a tripod my set up is like: ![MySetup.jpeg](https://image.lichess1.org/display?op=noop&path=099TK3PigV0B.jpg&sig=68a8ecb6a81c8599c20f9ef8b8bca0d3f0329489) r/lichess - OTB tracking with computer vision, promotions, checkmate detection and VAR implementation. I'm hoping these features can be useful both in tournaments and for casual games at home. Thanks to my 3D printer, I've been able to train the model on many different chess sets. The biggest challenge that remains is wooden sets where the white pieces have a darker, brownish color. Simply adding more training data isn't always the answer, as it can reduce the model's overall generalization. I am also not sure how to understand when a player resigns, so I can send a event to VAR as well. I'm also trying to make the setup process more reliable by adding clearer instructions and more pictures inside the app. It is avaliable on android&ios and download links are avaliable at https://chessgaze.com/ Please let me know if you have any feedback!

Is it available on Android as well. Where can I download it?

Is it available on Android as well. Where can I download it?

@block blast The challenge against the PC was really fun! I was impressed by my opponent's talent.

@[block blast](https://blockblast-2.io/) The challenge against the PC was really fun! I was impressed by my opponent's talent.

VAR = ???
"Video assistant referee"?

VAR = ??? "Video assistant referee"?

@unwittingfeed said ^

@block blast The challenge against the PC was really fun! I was impressed by my opponent's talent.

Thanks a lot for trying it.
Please update daily I am improving it every day. Latest improvements with hand detection made everything much better.

Let me know if any feature requests or suggestions.

@unwittingfeed said [^](/forum/redirect/post/ouHSCZhh) > @[block blast](https://blockblast-2.io/) The challenge against the PC was really fun! I was impressed by my opponent's talent. Thanks a lot for trying it. Please update daily I am improving it every day. Latest improvements with hand detection made everything much better. Let me know if any feature requests or suggestions.

@Cedur216 said ^

VAR = ???
"Video assistant referee"?

Yes it is, forexample the game I replayed playing the immortal game can be viewed by anyone https://games.chessgaze.com/?table=GAME%3A%3AIMMORTAL&game=game19

So anyone can make their games immortal now.
My dream it is being used in tournament so arbiters can see the problems and viewer can view the games remotely so parent don't lobby the tournament area.

@Cedur216 said [^](/forum/redirect/post/HzfXpZiX) > VAR = ??? > "Video assistant referee"? Yes it is, forexample the game I replayed playing the immortal game can be viewed by anyone https://games.chessgaze.com/?table=GAME%3A%3AIMMORTAL&game=game19 So anyone can make their games immortal now. My dream it is being used in tournament so arbiters can see the problems and viewer can view the games remotely so parent don't lobby the tournament area.

For it used in FIDE event you would need to get acceptance for it. I guess some national/regional tournament could try it with out much hassle. In particular for broadcasting that would be fine

For it used in FIDE event you would need to get acceptance for it. I guess some national/regional tournament could try it with out much hassle. In particular for broadcasting that would be fine

@babalalapop said ^

I have been implementing new features in my OTB tracking application, ChessGaze.

I've now solidified promotion handling, checkmate detection, and sending games to my cloud server, which I hope can eventually be used by tournament arbiters.

To test all these new features, I played my favorite gambit, the Albin gambit, because it includes an early knight promotion.

Game tracking works really well...

how much accurcy does thsi model have

@babalalapop said [^](/forum/redirect/post/nKiU7fYs) > I have been implementing new features in my OTB tracking application, ChessGaze. > > I've now solidified promotion handling, checkmate detection, and sending games to my cloud server, which I hope can eventually be used by tournament arbiters. > > To test all these new features, I played my favorite gambit, the Albin gambit, because it includes an early knight promotion. > > Game tracking works really well... how much accurcy does thsi model have

also ,from the board i chessboard image can you implement a connecton to lichess via an API soit can send moves to the analsyis board also make ure its fot for fast paced games ,the CV must perform with 98< accuracy in fast paced games as well is that possible ,that wouls honsetly, GREAT even that would be an understament i wont have to spend hundreds of bucks on a DGT board

also ,from the board i chessboard image can you implement a connecton to lichess via an API soit can send moves to the analsyis board also make ure its fot for fast paced games ,the CV must perform with 98< accuracy in fast paced games as well is that possible ,that wouls honsetly, GREAT even that would be an understament i wont have to spend hundreds of bucks on a DGT board

@Cedur216 said ^

VAR = ???
"Video assistant referee"?

Mr. Referee, I contest, the pawn was offside the square!

And just before, there was a foul !

@Cedur216 said [^](/forum/redirect/post/HzfXpZiX) > VAR = ??? > "Video assistant referee"? Mr. Referee, I contest, the pawn was offside the square! And just before, there was a foul !

This topic has been archived and can no longer be replied to.