I don't think this is an unpopular opinion, and it's especially apparent on decks that have weak early game, like the Black Deck.
Most rougelikes are easy at the beginning, but quickly ramp up the challenge and require you to assemble some kind of build. Balatro (on high stakes) is actually the opposite, being incredibly tough early-game, but a breeze once you get some kind of combo going.
You need that first Small Blind to be a one-shot. You need the first Joker pack to not have an Eternal Egg. At some point, rerolling the first ante becomes incredibly tedious.
And then, if you do get some combo going, the only thing that can stop you is a bad draw or a bad Boss Blind. That's less of an issue, because winning is fun.
I don't think the early game should be easier - that would make the whole game really easy. I think, in some way, the pressure of Ante 1 and 2 should be moved to Ante 3 and 4. I think the design of Stakes is what makes the early game so hard, while not really affecting further Antes. The stickers just mean ~72% of Jokers you'll see early game are unpickable.