Balatest - Unit Testing for Balatro | Balatro | Page 1

cloud vine May 1, 2025, 4:18 AM

#

Balatest is a framework for running unit tests on your Balatro mods. Avoid bugs and refactor with confidence!
https://github.com/BakersDozenBagels/Balatest/

GitHub

GitHub - BakersDozenBagels/Balatest

Contribute to BakersDozenBagels/Balatest development by creating an account on GitHub.

astral whale May 1, 2025, 4:26 AM

#

@heavy blaze pepecrazyeyes

heavy blaze May 1, 2025, 4:53 AM

#

Hey @cloud vine, how does this specifically hook into the game code?

#

Are you operating in the normal game flow or doing something weird?

#

I'm doing a VERY similar thing in https://discord.com/channels/1116389027176787968/1364331658261823589 but for remote control, so we might be able to share code

cloud vine May 1, 2025, 4:58 AM

#

heavy blaze Are you operating in the normal game flow or doing something weird?

Mostly I'm calling G.FUNCS.start_run() and using the functions attached to buttons in a separate event queue, but sometimes it's been necessary to execute arbitrary code in a test (e.g. to test rental stickers, jokers with a use button, charms, etc)

#

With regards to Remotro in particular, these are currently non-goals for me:

Defining or triggering tests from outside of a Balatro mod
Interoperating with a language other than Lua
Preventing the user from interacting with running tests
Strictly defining/limiting the capabilities of tests

#

Feel free to steal any of my code, though, it's GPL-3.0 licensed

heavy blaze May 1, 2025, 3:06 PM

#

cloud vine With regards to Remotro in particular, these are currently **non-goals** for me:...

Ah, so Balatest is basically just starting a new game, forcing a particular state, and then testing something within that state only? Yeah our projects are p. different then, remotro is trying to model Balatro's entire game flow into a protocol

heavy blaze May 1, 2025, 3:52 PM

#

So in a sense remotro might be more capable of making integration/e2e tests than Balatest

heavy blaze May 1, 2025, 7:52 PM

#

if you are implementing more e2e-style tests lmk @cloud vine

cloud vine May 1, 2025, 8:02 PM

#

Here's my current (unfinished) test suite running:
http://cdn.gdane.net/balatest3.mp4

▶ Play video

astral whale May 1, 2025, 9:07 PM

#

@heavy blaze ? you could use this a lot, no? they have functions defined for a lot of actions

heavy blaze May 1, 2025, 9:07 PM

#

Would be useful for accelerating my RE efforts @astral whale

#

And unlike balatro's codebase I can pipe it into a sota llm and really speed up me being able to generate various hooks

astral whale May 1, 2025, 9:08 PM

#

ah right async vs sync is the issue here for you, i get it

#

or maybe i don't lol...i still think you could use this basically every action in game

heavy blaze May 2, 2025, 12:41 AM

#

heavy blaze And unlike balatro's codebase I can pipe it into a sota llm and really speed up ...

noticed the reaction. if you dont want me sending ur code to an ai lab i wont do it and instead do it manually or use a on-device llm that cant use ur work as training data lol @cloud vine

cloud vine May 2, 2025, 12:44 AM

#

I can't stop you either way, but it would make me a touch sad

#

It's not that much of an issue, especially if you provide proper attribution

zealous barn May 3, 2025, 11:11 PM

#

interesting

#

this may be of some use if my lovely plans work out the way I want

cloud vine May 6, 2025, 2:35 AM

#

https://youtu.be/bORaae3RC3U

YouTube

BakersDozenBagels

Nine Minutes Of Balatro Unit Tests To Fall Asleep To

Here I'm running Bakery's 292 unit tests via Balatest. These tests set up a game, perform some actions, and the automatically verify that the result is correct. They help me to avoid bugs and diagnose compatibility issues in my mods.

Relevant mods used:
Bakery: https://github.com/BakersDozenBagels/BalatroBakery
Balatest: https://github.com/Bake...

▶ Play video

formal mica May 6, 2025, 2:56 AM

#

to fall asleep to

#

so real

#

wait, does it use Nopeus' unsafe speed or its own

cloud vine May 6, 2025, 2:56 AM

#

its own

formal mica May 6, 2025, 2:57 AM

#

alr good to know

cloud vine May 6, 2025, 2:57 AM

#

it also automatically activates it

formal mica May 6, 2025, 2:57 AM

#

for most devices unsafe speed is overkill

#

but for my 13yo Mac it barely affords my needs

cloud vine May 6, 2025, 2:58 AM

#

the point here is to run the tests as fast as it can because otherwise it takes forever

#

if i turned off the speedups in this these tests would easily take 3X as long

formal mica May 6, 2025, 2:58 AM

#

Ik that

#

as a Balatro modder, testing modded Balatro on a 13yo Mac is a masochistic move

#

yet I'm doing it

cloud vine May 6, 2025, 3:00 AM

#

real

half flicker May 6, 2025, 4:24 AM

#

formal mica as a Balatro modder, testing modded Balatro on a 13yo Mac is a masochistic move

My 14 year old Mac agreea

astral whale May 6, 2025, 4:26 AM

#

my 1 year old macbook paid by my company is happy to jump in if any of you guys need it 😂

#

48 GB memory goes brrrrr

half flicker May 6, 2025, 4:28 AM

#

Well luckily I don't use that Mac that often

#

Just with some lovely development

#

Which is rough cause compilation is slow

icy dome May 6, 2025, 2:57 PM

#

this is really neat

cloud vine May 6, 2025, 3:01 PM

#

I've already found a nice handful of bugs with these, too

icy dome May 6, 2025, 3:02 PM

#

im writing tests for morefluff right now and the api is really clean

cloud vine May 6, 2025, 3:02 PM

#

Hell yeah

#

lmk if you want/need anything else from it

icy dome May 6, 2025, 3:02 PM

#

...though i'm skipping Complexity Creep for now (probably the joker that needs to be tested the most), since i really dont want to get into that now

#

ill get to that at the end

cloud vine May 6, 2025, 3:02 PM

#

big mood

#

i personally saved Proxy and Card Sleeve 'til near the end, haha

#

both of them have so many edge cases :agony:

icy dome May 6, 2025, 3:05 PM

#

the one slight issue i've had (which was my fault) is that .buy()ing a voucher results in it going to your joker slots which makes sense but feels off

cloud vine May 6, 2025, 3:06 PM

#

😭

icy dome May 6, 2025, 3:06 PM

#

that is how the game works though so i can't complain

cloud vine May 6, 2025, 3:06 PM

#

try .useing it?

icy dome May 6, 2025, 3:06 PM

#

yeah that's what i did and it worked

cloud vine May 6, 2025, 3:06 PM

#

dlhlghdgkd

#

this game is so cool

icy dome May 6, 2025, 3:07 PM

#

you should colour the pass/fail messages red/green btw

cloud vine May 6, 2025, 3:08 PM

#

i should do way more with the results reporting tbh

icy dome May 6, 2025, 3:08 PM

#

this is very nice to see this early on in balatro's modding scene

coral siren May 6, 2025, 7:52 PM

#

this is incredible honestly

icy dome May 10, 2025, 2:17 PM

#

oh yeah if you have nopeus installed the unsafe speed doesn't work

#

which is proabbly a non-issue i just thought i'd mention it here for anyone who looks at the thread in future

cloud vine May 10, 2025, 4:18 PM

#

that's fixable and i should fix it soon

icy dome May 11, 2025, 9:25 AM

#

icy dome im writing tests for morefluff right now and the api is really clean

writing the tests helped me find a bug in morefluff. thank you so much for making this

cloud vine May 11, 2025, 9:28 AM

#

i found like half a dozen in bakery lmao

#

it's almost like testing for bugs finds bugs /positive

icy dome May 11, 2025, 9:29 AM

#

True...

coral siren May 11, 2025, 9:33 AM

#

the idea of unit testing mods at all is massive

#

we're lucky to have a well-documented API and testing

cloud vine May 11, 2025, 6:11 PM

#

cloud vine that's fixable and i should fix it soon

oh that's not what i thought you meant, probably not fixable and I don't want to think about the ramifications of that

#

it's called Unsafe for a reason; it can break shit

icy dome May 11, 2025, 6:40 PM

#

oh i just meant like

#

the cards left the hand slowly

#

instead of going all at once

cloud vine May 11, 2025, 6:59 PM

#

that worked for me

#

Works On My Machine™️

next spruce May 14, 2025, 7:49 PM

#

Also having an issue where cards slowly retract back into the deck

#

It only works for the first test, and then doesnt work again

next spruce May 14, 2025, 8:27 PM

#

Uninstalled talisman and it works fine now

cloud vine May 15, 2025, 3:17 AM

#

next spruce Also having an issue where cards slowly retract back into the deck

can you be more specific on this? Do you mean before cash out when cards go from G.discard to G.deck?

next spruce May 15, 2025, 3:17 AM

#

cloud vine can you be more specific on this? Do you mean before cash out when cards go from...

G.hand to G.deck

icy dome May 15, 2025, 3:17 AM

#

icy dome the cards left the hand slowly

that was this issue, i think

next spruce May 15, 2025, 3:17 AM

#

After scoring is complete, and blind is defeated. ^

icy dome May 15, 2025, 3:17 AM

#

it might just be a clash between the two mod's "skip all animations" settings

next spruce May 15, 2025, 3:18 AM

#

Skip anim was off

#

It was just talisman being installed

cloud vine May 15, 2025, 3:19 AM

#

😭 I'll look into it

#

i use talisman so maybe it's a versioning issue?

next spruce May 15, 2025, 3:20 AM

#

Im on an older smods, for whatever reason. 410b

#

Talisman 2.2.0~dev

sacred canopy May 26, 2025, 7:56 PM

#

This is really cool

crisp pelican May 28, 2025, 11:31 PM

#

oh my god what the peak

cloud vine May 29, 2025, 1:29 AM

#

Reminder: LMK if there's anything you want from this that it doesn't already do

#

(currently it's just output log coloring)

astral whale May 30, 2025, 12:17 AM

#

i feel like i'm stupid

#

i defined a test following the example in the readme

#

and it just doesn't select the blind?

#

okay well now it selected the blind but got stuck again

#

i feel like it's doing things too fast maybe?

#

oh it crashed at some point before and got stuck at this game speed

#

nvm, that wasn't the issue....

#

still gets stuck at blind select or hand drawn

cloud vine May 30, 2025, 12:57 AM

#

Can you send your test definition and also your mod list

cloud vine May 30, 2025, 12:58 AM

#

astral whale oh it crashed at some point before and got stuck at this game speed

this is because it sets it ridiculously high and only tries to reset it once the tests complete. i think only one of the arrows works from this state

astral whale May 30, 2025, 12:59 AM

#

cloud vine Can you send your test definition and also your mod list

test definition:

Balatest.TestPlay({
    jokers = {"j_joker"},
    execute = function()
        Balatest.play_hand({"2S"});
    end,
    assert = function()
        Balatest.assert_chips(35);
    end
});

#

mod list is literally just this code, too many jokers, smods and debugplus

#

and obviously balatest

#

i'll try without tmj

cloud vine May 30, 2025, 1:01 AM

#

i'll try it with

astral whale May 30, 2025, 1:02 AM

#

it's actually tmj 😭

#

most unexpected compat issue ever???

cloud vine May 30, 2025, 1:03 AM

#

This is working fine for me, what versions do you have?

astral whale May 30, 2025, 1:04 AM

#

how can i print this? or do i have to crash the game for it somehow?

cloud vine May 30, 2025, 1:04 AM

#

I use Bakery_API.crash() lmao

#

shockingly useful function

astral whale May 30, 2025, 1:05 AM

#

Additional Context:
Balatro Version: 1.0.1o-FULL
Modded Version: 1.0.0~BETA-0527d-STEAMODDED
LÖVE Version: 11.5.0
Lovely Version: 0.7.1
Platform: OS X
Steamodded Mods:
    1: DebugPlus by WilsontheWolf [ID: DebugPlus, Version: 1.5.0~dev, Uses Lovely]
    2: Balatest by BakersDozenBagels [ID: Balatest, Priority: -1000, Version: 1.1.0, Uses Lovely]
    3: Balafuzz by nnmrts [ID: Balafuzz, Priority: -999, Version: 1.0.0]
Lovely Mods:

#

with the above everything works

#

and, one sec

#

with this it doesn't:

Balatro Version: 1.0.1o-FULL
Modded Version: 1.0.0~BETA-0527d-STEAMODDED
LÖVE Version: 11.5.0
Lovely Version: 0.7.1
Platform: OS X
Steamodded Mods:
    1: Too Many Jokers by cg [ID: toomanyjokers, Priority: 1000000, Uses Lovely]
    2: Balafuzz by nnmrts [ID: Balafuzz, Priority: -999, Version: 1.0.0]
    3: Balatest by BakersDozenBagels [ID: Balatest, Priority: -1000, Version: 1.1.0, Uses Lovely]
    4: DebugPlus by WilsontheWolf [ID: DebugPlus, Version: 1.5.0~dev, Uses Lovely]
Lovely Mods:

#

okay wtf

#

just rechecked again

#

and that works

cloud vine May 30, 2025, 1:07 AM

#

????

astral whale May 30, 2025, 1:07 AM

#

i'm soooo done

cloud vine May 30, 2025, 1:07 AM

#

as a friend likes to say, "all technology is shit"

astral whale May 30, 2025, 1:07 AM

#

let me turn of vsync, maybe it was that

#

nah even with vsync off

#

ahhhh i don't even wanna know what that was

#

god just wanted to waste my time i guess

sorry for wasting yours

cloud vine May 30, 2025, 1:08 AM

#

well, I'm glad it works now

#

there's a chance it was something something stale lovely cache something conflicting patches something

astral whale May 30, 2025, 1:09 AM

#

i'm not sure if i'm more curious what that means or more afraid of the answer

cloud vine May 30, 2025, 1:09 AM

#

actually no lovely shouldn't be conflicting for this

#

the one lovely patch here is just for speed

astral whale May 30, 2025, 1:10 AM

#

then again i'm running balatro from source AND self compiled lovely

#

didn't lead to any issues so far but i guess that was it maybe

cloud vine May 30, 2025, 1:11 AM

#

lmk if something like this comes up again

astral whale May 30, 2025, 1:11 AM

#

yup, thanks again

cloud vine May 30, 2025, 1:13 AM

#

cloud vine This is working fine for me, what versions do you have?

for the record, my test suite passes with this (minus #9, biased balance)

#

Hot tip for y'all:
If you have a file like this, you can watch lua it with DebugPlus to auto-run it on save

Balatest.run_test {
    jokers = { "j_joker" },
    consumeables = { "c_pluto" },
    execute = function()
        Balatest.use(G.consumeables.cards[1])
        Balatest.play_hand { "2S" }
    end,
    assert = function()
        Balatest.assert_chips(102)
    end
}

cloud vine May 30, 2025, 1:52 AM

#

You can now specify multiple categories for a test.
Also, the docs for Balatest.hook no longer lie about giving you an already-hooked function

#

I will also be deprecating requires since it's bad and dumb

atomic igloo May 30, 2025, 5:23 PM

#

i'm not too good at lua but i had to make a change to your source to get the mod to work for me
on line 470 and 479 of main.lua you had to_big(a):eq(b) which would throw

Error: [SMODS Balatest "src/main.lua"]:470: attempt to index a number value

I'm not sure why this dosn't work but i just replaced it with to_big(a) == to_big(b) and things started working
my test case is as follows

Balatest.TestPlay {
    name = 'base_test_case',
    requires = {},
    category = 'base_test',

    jokers = { 'j_joker' }, -- Start with a Joker
    
    execute = function()
        Balatest.play_hand { '2S' } -- Play a High Card
    end,
    assert = function()
        Balatest.assert_chips(35) -- Total round score, *not* the last hand
    end
}

my mod version is the latest from the github linked at the top.
i'd submit a pull request if i knew how to. thanks

cloud vine May 30, 2025, 5:25 PM

#

atomic igloo i'm not too good at lua but i had to make a change to your source to get the mod...

What version of Talisman are you using?

#

and what number setting

atomic igloo May 30, 2025, 5:27 PM

#

oh, mb, is talisman required

#

i have it disabled

cloud vine May 30, 2025, 5:27 PM

#

no, it shouldn't be required

#

actually I might have an idea what's happening here

#

I'll put a proper guard in tonight

atomic igloo May 30, 2025, 5:29 PM

#

i have debugplus, flower pot, handy, cartomancer, balatest, 39joker, brainstorm, blueprint, card back injection, my mod and a few other texture mods

atomic igloo May 30, 2025, 5:29 PM

#

cloud vine I'll put a proper guard in tonight

sick

astral whale May 30, 2025, 11:24 PM

#

i'm cooking so much with balatest

astral whale May 31, 2025, 6:18 AM

#

i used balatest to make benchmarks

#1378207010251735191 message

hazy dagger May 31, 2025, 11:20 AM

#

Does balatest have support for testing save file reloading?

#

Like exiting to the menu and going back to the run

cloud vine May 31, 2025, 12:11 PM

#

Not ATM but I can add support for that

hazy dagger Jun 2, 2025, 2:30 PM

#

That'd be great! Thank you so much

cloud vine Jun 5, 2025, 7:25 PM

#

hazy dagger Does balatest have support for testing save file reloading?

That's out now in version 1.3.0 as Balatest.reload()

astral whale Jun 6, 2025, 1:35 AM

#

i am now ready to take over the world

hazy dagger Jun 10, 2025, 3:13 PM

#

How do i run a set of tests with a category?

#

I can't seem to run them for some reason

#

Here are my tests by the way.

cloud vine Jun 10, 2025, 4:13 PM

#

hazy dagger How do i run a set of tests with a category?

Balatest.run_tests('pkrm_gym', 'blind') should be correct. Can you eval Balatest.tests_by_mod_and_category.pkrm_gym for me?

hazy dagger Jun 10, 2025, 4:15 PM

#

#

it gives nil

cloud vine Jun 10, 2025, 4:15 PM

#

Did you forget to actually run the file with your test definitions? What happens if you put a print next to them?

hazy dagger Jun 10, 2025, 4:16 PM

#

no no it runs fine when I do Balatest.run_tests('pkrm_gym')

cloud vine Jun 10, 2025, 4:17 PM

#

i see

hazy dagger Jun 10, 2025, 4:17 PM

#

I think there's a mismatch between the mod_id and actual id used in naming the tests

cloud vine Jun 10, 2025, 4:18 PM

#

oh of course

hazy dagger Jun 10, 2025, 4:18 PM

#

oh i'm dumb

cloud vine Jun 10, 2025, 4:18 PM

#

yeah I use the mod ID not its prefix

hazy dagger Jun 10, 2025, 4:19 PM

#

how come the prefix still works when I use it to run though 🤔

cloud vine Jun 10, 2025, 4:19 PM

#

it's falling back to running everything

#

I'll rework the error handling to be a bit more clear on this

hazy dagger Jun 10, 2025, 4:20 PM

#

thanks a lot!

#

The testing framework is really great. I enjoyed every single moment of using it.

cloud vine Jun 10, 2025, 4:21 PM

#

Thanks! ✨

cloud vine Jun 29, 2025, 12:10 AM

#

The default logging should be colored now. It also now pcalls anything you Balatest.q, which has a small chance of breaking things

cloud vine Jul 22, 2025, 12:15 AM

#

I've pushed a small update for compatibility with bleeding-edge SMODS. As always, let me know if something breaks

crisp pelican Jul 22, 2025, 1:25 AM

#

cinema

cloud vine Jul 22, 2025, 3:21 PM

#

... and another for no_auto_start (and also Balatest.exit_shop() without then starting a blind)

cloud vine Dec 29, 2025, 4:04 AM

#

Another small update to account for more SMODS (smh my head)

cloud vine Jan 22, 2026, 3:41 AM

#

Pushed a very small feature update (an optional parameter to Balatest.wait() to wait multiple times) and a bugfix

cloud vine Jan 27, 2026, 1:20 AM

#

Balatest now has proper LSP-compatible documentation! Also, you can now face multiple distinct blinds in a test.

cloud vine Feb 1, 2026, 1:02 AM

#

New feature: you can specify a set of mods required for a test to run, and Balatest will automatically skip that test if they're not all installed. This makes it easier to have tests for cross-mod content.

#Balatest - Unit Testing for Balatro