STOP THE SPLIT TESTS

[lean copper]

yea, i havent gotten the new player headset challenge yet, or the new menu ui, and those came out like 2 months ago

honestly see no reason why split tests exist

[merry pagoda]

i think there's split tests goin on in roblox cause despite a entire video by kreekcraft i sTILL DON'T HAVE VOICE CHAT

asides from that i don't really
care about split tests
the limited time challenge split test caught me off guard though

things would prolly be better if split tests were stopped

(also things like the vr checklist thing is completely unnecessary to have as a split test)

[lean copper]

next rro is probably a split test

[merry pagoda]

pfff

[lean copper]

i honestly wouldnt be surprised if that happens

making limited time challenges a split test makes no sense why should anything!!

[merry pagoda]

limited time challenges being split is kinda dumb but i see some sense in it

not with the new player challenges

[dark raptor]

there's literally a split test that just stops you from getting a cosmetic item

it's so useless

[merry pagoda]

tf

you mean the vr headset one?

[dark raptor]

yeah

[merry pagoda]

ah

yeah i don't like that one

[swift glacier]

So the ghost bow might get put in the limited-time

L

[dark raptor]

which is also a split test

how tf they gonna make something limited time and a split test

[full pier]

They are probably gonna make the whole game a split test

[shadow glade]

no it is good to only have like 20% of the game to cry when the feature is bad then all 100%

[lean copper]

make the game rr+ exclusive and also a split test

[edgy ibex]

Agreed

[lean copper]

that makes no sense cuz more people complain about not having the feature

[edgy ibex]

I hate how the limited time challenges are split test

Like they are LIMITED TIME

[lean copper]

i would rather have the feature, good or bad, than not have it at all

[shadow glade]

thats a them problem (you)

[dark raptor]

I agree with Nedword on this one

[shadow glade]

yes

[dark raptor]

I'd rather be able to test the new thing to say if it's good or bad

[shadow glade]

but i dont complain about it. so why do you?

[dark raptor]

huh?

I complain about it because I think it's stupid to give some players new features based on luck

[lean copper]

there’s no reason to not give every player a feature at the same time

unless there’s something i missed

[dark raptor]

here's what I think they should do

I think they should put something in the settings that says "turn on experimental features"

and that's how they should do it

until it gets fully released

[merry pagoda]

yes
this

[full pier]

Yea but some people NEVER get into spit tests

I never got in one that i remember of

[shadow glade]

bro really?

you just distracted me

i was bout to beat my own record in deducto

speedrunning bruh

[full pier]

He he

[shadow glade]

i hold WR and almost beat it again

like cmon :(

[merry pagoda]

agony

[shadow glade]

im cracked

[merry pagoda]

welp i think the recent update is a split test between ps4 and ps5

[pearl plaza]

Split testing is good though for game development.
You shouldn’t argue to be apart of a testing that you were randomly not given the opportunity to.
It’s a method of conducting controlled, randomized experiments with the goal of improving many new functions / systems.
Basically giving out the testing to certain amount of people without them knowing trying to get a feedback between the original or a new function.
They won’t just release the feature to everyone as they are sending out tests on the feature which they can determine if it significantly improves the player engagement or interaction of RecRoom.

Split tests are going to keep happening one way or another.

[lean copper]

yea i totally get making experimental features a split test, it makes sense

but i still don’t see how limited time challenges are a split test

unless it’s a new thing they’re doing, new challenges

[pearl plaza]

It’s a new feature that they are bringing out.
It’s not a feature for specific players, it’s a system that is in testing sent out to random users.
The challenges will be come out again and the limited challenges will be sent to other players soon.
They wouldn’t just give the feature to players and they get the limited items and the other half of the community can’t get it.

[keen olive]

i cant go into specifics but split tests are so important to rec room.

[lean copper]

yea now i know more about the tests i understand why it’s needed

rec room needs more control than ever rn and split tests are probably the way to go

[frigid beacon]

True just true. Split tests more like… shit tests? Idk

[stuck hornet]

...they updated the menus AGAIN?

[mortal scaffold]

Hmm yes I can see the importance behind putting different animations behind a split test

[stuck hornet]

Makes sense to me!

-Patrick

[lean copper]

no the one from months ago

[stuck hornet]

Oh

[keen olive]

Seeing how people interact with other people using visual queues. I wouldn't expect you to understand but that kind of data is very valuable to the teams that work on these.

[dark raptor]

@keen olive

[merry pagoda]

megashot put it best really

[keen olive]

Giving them to random people is better for real-world data

[dark raptor]

but it's so annoying to be left out of all the new stuff for months

and honestly some of it just downright stupid

[keen olive]

Stupid to you, invaluable to us.

[dark raptor]

how is holding back a vr headset cosmetic invaluable to you, we already had the new player challenges so why do a split test for another one

[merry pagoda]

yeah i agree on that
some things should be split tested
but not everything

the limited time challenges are fine for a split test
but the new player challenge is kinda dumb to have a split test for

[pearl plaza]

I try my best not to spread false information.

[mortal scaffold]

Big changes that may have an impact on the game, yes. It’s best to air on the side of caution

Smaller things like name tag clicking and an animation set, this is just stupid. I don’t see how an alternative animation for partying up has so much impact to where it needs to be up to a dice roll who gets it or not

[stuck hornet]

New animations shouldnt be split tested tbh

[swift glacier]

Good

[shadow glade]

i

[swift glacier]

Trust me, you don’t wanna experience the club chat 💀💀

[tepid mesa]

So few people bother to understand this. It’s so hard for them to find useful feedback when the entire community is kicking and screaming and crying rather than when only a portion of it is. The features will come out to everybody eventually and i imagine they’ll make up for the limited time tests somehow, i hope more people realise that someday but i can’t say i expect much 😑

[tepid mesa]

It’s not like it’s incredibly important that the community be protected from it or something silly, it’s to see how people play with the feature compared to without it. Also y’all complaining about not having the new player challenges items, what will there be for you to win if they give you the item without having to do the challenge? What if they need to do another split test on it?

[mortal scaffold]

For the record I didn’t say anything about new player challenges, I’m just saying it’s an animation, the way an animation looks doesn’t change the game in a big enough way for it to be up to a dice roll

[tepid mesa]

yeye, that’s why i clarified “y’all complaining about not having the new player challenges items”, i was referring to people who do complain about it

I just talk alot so i try to keep it in fewer messages
👉👈

The little things like animations matter more than you’d think to some people. Think about when they first changed the UI sound effects, some people were losing their minds over it. These little convenience things and cosmetic things add up to really change the player’s experience, so rec room wants to focus on these things too.

[undone moth]

Yes

[distant geyser]

Like I can understand why they do split tests for features, but cosmetics and challenges, why?

[near storm]

simple solution: if it’s not ready for everyone then don’t release it.

[merry pagoda]

pfff yeah lol

[distant geyser]

Exactly

[ebon sparrow]

Closed off testing can only go so far, to a dev it really doesn’t matter what they think about something if it’s being specifically made for players

A split test isn’t inherently hurting anyone by being a split test because eventually the feature either comes out or it gets scrapped / repurposed into something entirely different

I’m surprised people weren’t complaining that content creators were getting features earlier before every other player

Split tests are good and healthy for a game and it’s developers / player base I know FOMO is a thing a majority of the Rec player base deals with (the amulet incident) but you’re really not missing out on much at most you’re not gonna get a rereleased skin that you most likely already have or will be available to you at a later date

In conclusion i don’t think you’re losing sleep over not having a new fist bump animation / item split tests do more good than “harm” so they’ll probably continue down this path

[near storm]

i do have FOMO from time to time, but mostly when games that are really active do something special

[ebon sparrow]

I’d understand if they split test huge Rec room events like imagine if Rec con was split tested or something but in the context of recroom and what it does now it’s not an issue

I do get being resentful of split tests especially when you don’t get them but I’d honestly prefer it to be fixed for the general public first like how timed challenges are broken right now and can be grinded in a day rather than in the weekly/monthly way it’s supposed to be

FOMO is a hell of a thing

[merry pagoda]

honestly if it was the weekly/monthly thing it was supposed to be
the fire sword skin should've been the last reward instead of popcorn

like cmon

[signal kettle]

Mixed Split test and opt in/out is the best idea tbh

Split tests are great for finding out if a feature is a positive or not, BUT knowing how many people are willingly opting in or out for a feature too shows the flow that users prefer for themselves too

Because something like the discord profile colors, that's really not nice to be splitting people's chances for a cosmetic, and then also not allowing to enable discord experiments to try out yourself either is a really bad negative experience for me. Knowing I've been in discord since 2015 and also paying for nitro, it hurts to have an 'algorithm' randomly decide if you're allowed to or not

sure it's just colors, but clicking on profiles for people I have a distrust for and seeing them have a feature I don't, makes me feel like it's against me. Not fun.

Like instead of slamming everyone with a new feature, offer an opt in nudge over and over, suggesting the user its time to get ready as this feature will soon be the default etc.

That'll be probably impossible for some things, but moving a userbase with a grace period of a week or two to learn can help thin out the 'backlash'

[dark raptor]

I still think this is a great idea (for the less important split tests)

[ebon sparrow]

This has the potential to ruin data though

The point of split test is to see how the general public reacts to it if people know they’re gonna get it they’ll have expectations for it which could sway their opinion

[tepid mesa]

Testing it on people can help get it ready faster

[swift glacier]

It’s funny to me

[ebon sparrow]

Oh what the fuck I thought this thread got deleted

[signal kettle]

Being able to see how many people turn on a feature and stay on the feature is also another way to tell how people react and desire a feature too...

[ebon sparrow]

I forgot this was still going on

Look at this combo I did instead

[merry pagoda]

pretty slick

[signal kettle]

like idk, its been a whole year since the dark recroom menu has sufficed to show up to the public, why not let that be an opt in features and see how many people report a bug to fix or whatnot.

I sure would love to enable the new home menu, I wouldn't mind getting used to that menu no problem.

[stuck hornet]

Dark mode for Rec Room menus would be god-tier

[full pier]

Its planned to release with thd new home ui

[stuck hornet]

Home ui?

[distant geyser]

?

[full pier]

Dark mode is meant to release along with the new home ui

I think it was star centyurion who said that

might be another dev tho

[tepid mesa]

I seriously hope they’re not just gonna shove out the same old home UI they tried last time, it’s super cluttered and busy

[full pier]

I think this is whats gonna happen

but we'll see

[tepid mesa]

It’s so bad, and it’s so weird that some stuff is only accessible from the bottom bar but also some stuff is only accessible from the home menu

[full pier]

I always forget the bottom bar even exists lol

[stuck hornet]

I only ever use the bottom bar for friends list lol

[swift glacier]

ikr

[tepid mesa]

It’d be handy if it weren’t so inefficient

[swift glacier]

tbh I think rec room is trying to recreate the entire watch in 2D but it’s taking a long time that’s why we have a mix of 2D and 3D

[tepid mesa]

yeye that’s exactly what they’re doing, they’ve announced it in AMAs, but the home menu in particular was so bad and cluttered that the community went mad and they removed it

I really don’t like it, i don’t wanna be looking at recently played rooms and hot rooms and whatnot in the home menu

In my eyes it’s supposed to be a hub that leads to all the different options, not have bits and pieces of those different options mashed into it.

[merry pagoda]

yknow what i think that's fair

i think if it's one thing they need to do with the new menus

it's add 3d buttons for vr players dammit

[tepid mesa]

They used to have 3D buttons already, they’ve been removing them

Which i’m not as upset about as most people as i have a really easy time learning to interact with VR UIs but still i can understand why some people are upset about it

[sweet saffron]

I disagree

[tepid mesa]

I desperately hope they don’t convert the VR keyboard to 2D though, that’d be downright stupid. Them being squishy and widely spaced apart is very helpful for VR players, who are the only players able to use it.

[rough roost]

they should just reskin/recolor the home menu

the current layout is great

[cunning bridge]

Yep can confirm community lost their shit when they where testing the new home ui also it was the only time they allowed you to disable or enable a feature they where testing

[merry pagoda]

i
i know
i'm saying add 3d buttons to the new menus

i'm fine with using the menus in vr without 3d buttons

but 3d buttons are just more fun imo

[stuck hornet]

Should we just get the community to design the menus and have a huge vote on the best one?

I feel like that would be really effective.