VTES for OBS (plugin)

Hi, I have something to share with this community.

It's a plugin for Open Broadcaster Software that detects VTES cards when shown to a camera or webcam. My idea here was trying to improve tournament broadcasts. Basically, trying to show the card that it is being played but entirely fitting it to your screen without any human action. For now, it's only in Spanish.
Then, the idea of adding the whole game logic came in, but I stopped and moved on to do other stuff (this is where I'm at, currently).

For techies
It is written entirely in C++ and/or C.
It's only available for Windows and heavily leverages machine learning libraries (ONNX Runtime, TensorRT, CUDA and OpenCV).
It uses a custom "vtes.engine" trained specifically with all the VTES cards.
I also tried using Tesseract OCR to detect the card titles but it's not working (yet).

The 'stable' build is the v0.1.5. I made it easy to install through an .exe file.

github.com/ChicoCifrado/VTES-for-OBS/releases/download/v0.1.5/VTES-for-OBS.exe

Since I don't want this to become a lost effort, I'm sharing this publicly for you to test it.

Sadly, I no longer have the time to improve it, even tho I'm technically still working on a v0.1.6. But time has passed... So please, if any developers wants to throw any pull requests, I'll be happy to consider merging them if it makes sense.

Huge thanks to the KRCG static files, without them this wouldn't been impossible to achieve.
Also, shoutout to the DeepSeek team for obvious reasons.

Let me know if you find this interesting or want to contribute.

EDIT: I forgot to explain how to test it. So here's how:

1. Install the .exe (autodetects your OBS folder)
2. Start your OBS
3. Add your camera source
4. Add the filter "VTES Card Detector (OBB)" to your camera source
5. Change the Detection Mode to "AI Model (ONNX)"
6. Change the Inference Device to "GPU (CUDA)"
7. Show a card to the camera (should work with any VTES card)

Also, you can click the "Open Card Search" button for an offline website with information about the detections. I intended to make an API for VTES tournament broadcasts with this. Work in progress.

EDIT 2: Don't enable the NIS upscaler, it makes OBS crash.

Ankha wrote:

Nice, I'd like to see it in action somehow. How close to the camera the card has to be?

Here's three screenshots I just took to show you. What mostly affects the detection is motion.

Face down cards are not detected (they're considered to be outside of the game, but this could be changed easily).

EDIT: My cheap webcam is 1280x960 @30 fps, so this could be highly improved with proper streaming equipment.

This is a great idea. Ive seen a similar plugin in practice for Marvel snap, and its really useful for streaming the game in a way that helps viewers understand the whats going on.

Bloodartist wrote:

This is a great idea. Ive seen a similar plugin in practice for Marvel snap, and its really useful for streaming the game in a way that helps viewers understand the whats going on.

Thank you for noticing. I think one of the reasons this 30 year old card game is not more known is because it lacks media coverage to attract new players. That is what this is trying to fix.

Let me tell you, this wasn't easy to make. Specially since a standard match is for 4-5 players.

I have plans to add an overlay, once other problems are fixed or I see there is enough interest in developing this idea.