Search Feedback

[storm barn]

[neat eagle]

FINALLY

THANKS

[mellow kernel]

KSG MINER PL

[fiery yacht]

Did you write your own search or did you use something existing? (curious)

[small raven]

E

[sharp juniper]

Someone forgot the 15 minute mod warning ;p

[nimble flower]

wow

[storm barn]

check qa @sharp juniper

whoops

[tame pasture]

im skibidoing your mom

[storm barn]

It's a mix of our own service, but we moved our backing away from postgresql to elastic

[bitter lotus]

That's nice

[fiery yacht]

oh cool, thanks lol

[dawn quiver]

What was wrong with psql?

[opaque pagoda]

ho ello draftman

[fiery yacht]

it's not made for search

[mellow kernel]

@storm barn do u likeeee ksg miner pl? @frail flint

[gentle willow]

[nimble flower]

i hope my tag bot some attention 😀😄😀😀😄😀

[fiery yacht]

elastic search is literally made for search

[opaque pagoda]

y love update TOP.GG

[storm barn]

not built for complex search system

[fiery yacht]

I used typesense for a while

[mellow kernel]

holy shit the search is faster lol

[bitter lotus]

What are the quality signals you're talking about ?

[tender peak]

How do you determine "high confidence in quality"

[fiery yacht]

damn that search is insane... great work

[mellow kernel]

great work!

[bitter lotus]

Hello! Do we know each other?

[storm barn]

we now take your entire bot page in context and run it through a feature matrix to extract more relevant keywords for you. 🫡

[tacit hearth]

Nice

[bitter lotus]

Nice

[last ivy]

I've heard good things about elastic. Good move IMHO
(I am not very experienced so my humble opinion is not worth much but nonetheless)

[storm barn]

your full description, all categories, and some reviews' context is included

[long maple]

ooh fancy

[opaque pagoda]

my old name is BlueMan older owner to BlueBot 😅
and old user to draftbot

[tender peak]

Do you take into account if people search for the bot and click on it? Like do you take CTR into account

[fervent turtle]

high confidence and quality signals will surface more often
what define confidence and quality signals?

[humble temple]

my bot shows up at like position 30 something when i type its exact name lmao

[storm barn]

Not yet, but we built the data pipeline to implement this

[storm barn]

can you share it with me?

[bitter lotus]

#1383232228573577327 message

Time to update/improve our top.gg page

[hexed rose]

same

[fervent turtle]

seo for top.gg?

[storm barn]

one thing thats important to mention, we can't extract context from iframes

[fervent turtle]

im good until we dont have to gamify keywords as if it were google 😄

[long maple]

no web crawlers 😭

[humble temple]

https://top.gg/search?q=astrobot it has 9.9k servers, need to scroll down quite a bit to find it

[storm barn]

checked for you, votes are still important

most of the boosts are a multiplier

we can't get multiply by 0

[tender peak]

time to start employing evil and dishonest seo strategies to maximize my topgg rank

[humble temple]

plenty of 0-vote bots with totally different names show up before mine xD

but its fine, i dont mind

[storm barn]

thats valid

I'll check what's up with that

[long maple]

bro just added an Anti-Tim check

[last ivy]

https://tenor.com/view/ai-gif-27683988

[humble temple]

maybe increase bot's name relevancy priority

[surreal tendon]

@slim talon

[storm barn]

it's quite strong already (around 5x boost for perfect matches)

[bitter lotus]

I find it relevant that those who work on presenting their project for optimal integration with topgg will be advantaged. This seems more positive than a flaw.

[storm barn]

but i think we should set a minimum value for it other than a modifier

[humble temple]

yeah, maybe priorize bot names first, and then after exhausting exact matches, applie other modifiers

[cloud flower]

hi

[storm barn]

Yeah this is part of the system

[humble temple]

which system are you using btw?

something like elasticsearch?

[storm barn]

^

[humble temple]

or a homemande one :)

nice

[tender peak]

How long did this take yall

[storm barn]

Exact matches are the first priority, but we can't give it the definite 1st place because otherwise random bots with generic names will overtake every search query

[mellow kernel]

hi matgroup member

[humble temple]

i see

[exotic flicker]

What makes it appear more in particular. The "higher confidence " doesn't really say what that's based on? Is it based on description or what factors

[storm barn]

@exotic flicker

[long maple]

But you could use "exactness" as a miniscule multiplier?(unless im misunderstanding)

[storm barn]

yeah it's actually approximately a 5x increase in your final score

[tender peak]

Is it still able to understand descriptions that take advantage of using enriched HTML within it

[storm barn]

yes, html is fine

pretty sure we don't trim it yet tho

[long maple]

oop

[tender peak]

How much do votes play a part now?

[storm barn]

it's still a very very strong indicator

[bitter lotus]

With this SEO improvement, is an alternative ranking to the current two rankings (votes and new bots) planned soon?
The top voted bots ranking primarily concentrates bots that offer compensation in exchange for votes.

[storm barn]

your base score is around 90% votes

then modifiers and relevance is what enriches the listing positions

[tender peak]

Does this change tag placements or is it legit just searches

[storm barn]

Do you mean the auctions ones?

[tender peak]

no like top.gg/tag/fun

[storm barn]

Oh, that's still the exact same

[shut drift]

hello

[storm barn]

It doesnt rely on searches

[exotic flicker]

Thanks

[tender peak]

just curious how are the tag placements caluclated

[stuck blaze]

Long time no see Veld. Nice to see good QOL changes to top.gg 🙂

[storm barn]

Hey miyuka! long time no see indeed

Either way, very receptive on feedback right now. If you guys see something that doesnt make sense, feel free to post it here or in my DMs and i'll take a look!

[severe meadow]

Amazing update, love it

[frosty mirage]

Bring bot detective back please

[sharp juniper]

One day, hopefully

[storm barn]

[junior chasm]

pog

[hollow eagle]

Awesome how fast search is now. Definitely elastic search carrying the load here.

[light flax]

If I throw some words in a html comment, would that be included or ignored?

[storm barn]

it would be ignored

not now, but very soon

[light flax]

damn

[storm barn]

as i said above, html isnt being parsed yet

[storm barn]

actually we cache queries

so you're probably hitting redis instead

[light flax]

i use an iframe (which is why i asked)

[storm barn]

ah

[long maple]

Just use a quote

[storm barn]

yeah iframe bad

[long maple]

retweet

#I_Hate_Iframes

[storm barn]

they generally cause a bad UX

so i will always recommend not using them

[long maple]

Real

[valid basin]

Ya know what else is MASSIVE?!

[hollow eagle]

Will you enforce markdown at some point?
I feel like the custom css doesn’t make sense anymore on the “new” website so still having html support is a bit weird.

[hollow eagle]

The universe

[valid basin]

The looooooooooow taaaaaper faaaaade

[hollow eagle]

Besides iframes, which objectively suck, I don’t see a reason to keep html around personally.

[storm barn]

I like the way people use css, but it's a bit of a double-edged blade because bad visibility can harm your bot page.

parsing HTML and fetching the raw text wouldn't be a big deal, so I wouldn't want to enforce it since so many bot devs rely on html already. only thing I'm considering is sandboxing the css inside the box, but we have some features coming to customize your bot page without needing css soon

[hollow eagle]

Maybe having markdown and a separate css field could make sense?

[storm barn]

Yeah something like that would work, I like how GitHub handles it

[sharp juniper]

👀 I have a whole website for this 70% of the way done

made for top.gg

[hollow eagle]

I think the only reason I use css on top.gg is to sync the website theme color to our description highlights or something.

[storm barn]

ooo do share at some point

[storm barn]

do i have a surprise for you

[hollow eagle]

Our description is super old and outdated

[storm barn]

new field in the backend: brandColor

[storm barn]

owie

[hollow eagle]

I’ll rewrite this in markdown for sure.

[storm barn]

i like mine

mainly markdown

[hollow eagle]

Very nice

[slim glen]

https://tenor.com/view/kurt-angle-stare-100-yard-stare-meme-gif-251436459491629941

[polar lantern]

my bot ranks 4th if I search for its exact name

[storm barn]

need a link sir

[polar lantern]

sorry here:
https://top.gg/search?q=InterChat
https://top.gg/search?q=interchat

[storm barn]

your bot shows #1 for me on both

[polar lantern]

oh how interesting

cause this is what I see

should I perhaps clear cache?

oh yes that did the trick

thank you

[storm barn]

ah okay

[spiral inlet]

Same issue

Appears fixed now

[sick storm]

When I search "stickybot" it only shows the bot named stickybot and is not showing the bots with stickybot tags/category

[tender bloom]

Going onto that, it also seems like it doesn’t like spaces for instance “sticky bot” shows a whole different list then “stickybot”

[sick storm]

thats a good catch, "gluestick" doesn't show my bot but "glue stick" does.

[exotic flicker]

Why is my bot 2nd when i search for it EXACTLY. And the bot above it is not even remotely related

@storm barn

[storm barn]

interesting

thanks for reporting!

[exotic flicker]

Yeah np ve;d

veld

Other thing i noticed if it helps at all. It does not change if i change any of the filters. So like switching top to new does not change it at all. Specifing my bot

's server count does not change it. And so forth

[storm barn]

for sorting?

[exotic flicker]

Yeah. I tried changing it to see if its just sorted odd. Dosent change it even remotely almost like it dosent see the filters.

[restive nebula]

I’ve been noticing I’ve been getting more votes since this change rolled out 🙂

[storm barn]

fixed

[exotic flicker]

I dont see a diff due to my bots name lol.

[manic totem]

What exactly got changed? Do we have to redo our bot pages?

[restive nebula]

Unfortunate

“Ostra” is I guess weird enough name to be affected by the update

[storm barn]

nope, we just are smarter with searching now

[restive nebula]

Any way we could get some info on how we’re doing on pages like this in general down the road

We have impressions clicks and ctr for auctions id love to see something like google search console where we can see what terms we appear most in get most clicks in etc. same for tags in general

[sick storm]

Thanks!

[exotic flicker]

i would love this if the analytics page worked right in the first place.

[restive nebula]

Ha yeah it’s not the most helpful in its current state. But the analytics for auctions work pretty well, would like to see it as the building block for those ideas

And auctions suggests that infra is already there and just needs to be tweaked to track all bots on that page

[exotic flicker]

Not even that, You cant access it 95% of the time.

[radiant skiff]

Heyyy Draftman !

[odd creek]

half of the bots don't even have tts, and it's pretty unfair now that voting doesn't seem to like really matter anymore

also I won't even ask why my bot is twice there

[storm barn]

Some bots here don't need to be there. Voting still matters, were still tweaking the systems which is why I'm actively asking for feedback 🤭

[odd creek]

I think voting should still be a strong power - as that's the literal reason voting exists

[exotic flicker]

Im kinda mixed, I think voting should influence it but bots with 500000 votes will always topple. So i think this is kinda a nicer balance.

[storm barn]

Yeah that's kinda what I've been seeing in tests too. Karuta and mudae everywhere #1 because of the sheer number of votes they have

For shorter queries we definitely can optimize but reducing the room for error though

[odd creek]

maybe voting should just be valued less once there is a huge amount of votes

[storm barn]

That's why some bots appear that shouldn't be here

That's what happens now

It's logarithmically scored

[exotic flicker]

Like a antispam bot when i search my bot "antiscammer"?

[odd creek]

but 115k still should kinda be more above like 8 lol

[storm barn]

10 votes is a 1x, 100, 2x, 1000, 3x

I agree

Still being tweaked

[elder kelp]

maybe they should be a bit less important, plenty of irrelevant results in my searches

[storm barn]

Votes dictate ranking

Relevance dictates eligibility

[odd creek]

if you'd decide to make votes less important, than why would I bother annoying my users to vote

[elder kelp]

mhh I understand, but I still think some results are considered as eligible even though they are not relevant

but nothing to do with the votes

[odd creek]

(unrelated but please make ctrl+K and cmd+K focus the search bar)

[storm barn]

You're clearly not listening to what I'm saying

[exotic flicker]

Average day to day interaction with code.

[odd creek]

If youwould

as Kyrela suggested to make them less important

[storm barn]

Ahh noted apologies

[dense ginkgo]

massive?

[spark orbit]

So far my bot had an average of 71 servers per day from top.gg on the last 3 weeks (lowest = 60), and yesterday I got 40 servers. The number of views on the top.gg page has also fallen drastically. It'll be interesting to see what happens over the next few days, but I don't think it's a coincidence. My page is 100% html (not an iframe), so I don't know if it can affect the ranking

[odd creek]

for me

[storm barn]

I got a list of changes, but i still need to test them

[storm barn]

Hi y'all! I updated the algorithm a bit. Let me know if this generally feels better/worse. :)

Give it 5-10 minutes to update the feeds!

[odd creek]

yeah, yeah I think I like it more

still a little odd for such bots to appear on queries like "text to speech" (I doubt that they offer that)

[storm barn]

votes are still very important

so highly voted bots will pop up more easily

can't do much about that without building CTR-based systems :p

[odd creek]

what I mean is off-topic bots showing up, not the ordering

[storm barn]

yeah

that's because we have a very little amount for long descriptions now

larger context while juggling the priority for votes makes them appear more

maybe i can tweak the values, but idk

[nova gust]

does the new search also use long description now as well, or just short desc, bot name and tags?

[odd creek]

@nova gust long desc

[nova gust]

Lol no way its the message above, thank you 😭

[storm barn]

ye

[storm barn]

@nova gust check this :

[nova gust]

Cool thank you 🙂

[odd creek]

so if I look for "shit bot" I get truly awful bots? epic /sarcasm

[sonic gale]

I would like to raise concern regarding how the search filter is working.

• why m getting these extra bot results when I searched for streaks and those bots have nothing to do with streak?
• highly voted will appear at top, that's a nice thing, but why the search results also includes bot that have nothing to do with streaks?

[storm barn]

thanks for bringing that up

I'll take a look

[tender bloom]

Appears a bot is not showing up in the search queue the bot name is Lexora and the url to the bot is https://top.gg/bot/1378674577546281101

[surreal tendon]

told them to edit their page in support 🙏🏽

[bitter fog]

* I also have more bots than there should be

[storm barn]

There should be more bots, but you're #1 which is ok

We do typo tolerance checking now, so not only perfect matches appear

so people can also mistype your bot's name now

[sonic gale]

When a user searches for a word (e.g., "Sky"):

• First priority → List bots whose names contain the word "sky"
• Second priority → List bots that have matching tags
• Third priority → List bots where the description contains that word
  {just the short description ig}

All results sorted in descending order of votes (most voted bots at the top)

just a suggestion

[odd creek]

how can you have a priority of strings when it is only sorted after votes

[sonic gale]

It can be divided in tiers:

• Tier 1 - bot name
• Tier 2 - tags
• Tier 3 - description

Then the sorting takes place as {Tier in ascn order, votes in descn order}

It will (should) be sorted by voted after getting divided by tiers

    bots = fetch_bots_data()  # Simulate dynamic fetch
    keyword = keyword.lower()

    def match_priority(bot):
        name = bot["name"].lower()
        tags = [tag.lower() for tag in bot["tags"]]
        description = bot["description"].lower()

        if keyword in name:
            return 1
        elif any(keyword in tag for tag in tags):
            return 2
        elif keyword in description:
            return 3
        return 4

    # Add dynamic tier info
    for bot in bots:
        bot["match_tier"] = match_priority(bot)

    # Filter only bots with a match
    matched_bots = [bot for bot in bots if bot["match_tier"] < 4]

    # Sort live each time
    sorted_result = sorted(matched_bots, key=lambda b: (b["match_tier"], -b["votes"]))
    return sorted_result

[odd creek]

so if I named my bot "leveling", I'd be above a bot called "some bot" that has 1M votes, even if I had 0 votes

[sonic gale]

.

[odd creek]

bot name is first in your listing

[sonic gale]

(first of all m not the dev of topgg nor m in the team, m just giving my opinions and ideas)

and as for what u said

• first it search the bot name (sorts it desc order based on votes)
• when thats over it will search for tags (sorts it desc order based on votes)
• after that it will look into the short description of the bots (and again sorts it desc order based on votes)

[sonic gale]

in this case, best way to make your bot stand out as much as you can is by giving it a unique name

[odd creek]

I know that you aren't a dev — your suggestion just isn't thought through very well

[sonic gale]

i would like to hear more

[storm barn]

we already do something similar to this, but instead we use weighing ratios

so that votes are still marginally impactful and can leak into upper tiers

Generally I believe the new system is much better and more responsive than the old one and that's already a huge improvement

[sonic gale]

should still give more priority to bots that are most related to what is searched..

[storm barn]

you will need atleast a few votes to get that priority

nearly all "streaks" bots have 0 to 10 votes

which is virtually nothing compared to what they're ranked up against

there's no algorithm that will prioritize 0 over 800k

generally we're already strongly prioritizing content, e.g. taco shack shows up on page 3 for streaks with 40k votes

[sonic gale]

its not just for me personally, like the user that goes their to search for a bot to add to their server, then how do you think they will react seeing all those results which have nothing to do with what they searched

if it needs to be sorted by votes only, why is there any need for the search thing?

search loses its purpose when peoples aren't able to find what they are searching for

[odd creek]

search works just fine on all the tags or queries I care about — can't say much on any others. Yes here and there there may be an off-topic bot, but that kinda was already the case before too, now just different ones — even if I'd prefer them not being there

and it's not sorted by votes only anymore — as veld said; I just think that votes should continue to have a strong impact on ordering, as that's literally the reason why voting exists

[storm barn]

Search isn't sorted by votes only though, but we use votes as a social proof for the scoring system

[sonic gale]

I get that votes are important — they help users trust bots and filter out spammy ones. That makes sense.

But on the other hand :

• If votes are the main thing that determines ranking, new bots get buried, even if they are exactly what the user is looking for.
• Bots are added to Top.gg so they can grow — but they won’t grow if no one can discover them.

and if you saying that the new filter in sorting option does that : No it doesn't, it still shows the exact same result

[odd creek]

idk my bot grew from 0 to 17k in a year

[sonic gale]

Aside from this, on the topic of relevance that was initially started this

I get it my suggestion was way more optimistic and not much practical.

However, you can still do that, by adding a relevance filter option in sorting, that works like I suggested before

[sonic gale]

well that's certainly good for you, and congratulation for that
but things don't turns out to be same for everyone

[odd creek]

I achieved that with four bots independently without auctions or putting much time inyo SEO, neither do I vote lock stuff

it just comes to what the user needs and wants, and if your bot is of quality

[nova gust]

some unrelated bots are appearing on the "form" and "forms" search results

[sonic gale]

apparently they don't care about that lol

they will just show the bots with most votes

[storm barn]

Please stop talking in this thread if you aren't going to take the conversation seriously @sonic gale the clear result from our conversation was that there's nuance between context and social proof.

It's pretty clear from the search result that if we only cared about votes (as you claim) a bot with 178 votes would never win against a bot with 2.1 million votes

[sonic gale]

i don't see what i said wrong just now,

[surreal tendon]

no one said we don't care about unrelated bots showing up on searches

[odd creek]

what about including a bots supported language vs the user's language in the search ranking

(either use geo IP, their top.gg language, or their Discord locale)

[storm barn]

the new system supports localization support yeah

we have yet to roll that out

[dawn quiver]

whats the point of this thread then

just to seem like they care?

the new search is horrible for some terms

[spark orbit]

because they care, just read Veld's messages above

[storm barn]

could you share the queries?

[dawn quiver]

I know that, it was rhetorical

[dawn quiver]

Afaik, none of these bots has a feature to sync roles between different servers

[storm barn]

[dawn quiver]

I do find them when I just search on Google, funnily enough listed on top.gg

[storm barn]

i think role sync can also be used for when a user leaves and joins back. Many bots do find that

[dawn quiver]

Well I guess all these terms are a bit subjective but I would call those "sticky roles"

And before the search was updated they would show up while searching on top.gg

[storm barn]

fair enough!

I can see what we can do here

[storm barn]

Ah @dawn quiver, your bot has 0 votes, so you have a really hard time showing up in search

generally 0 votes is a something we can't really do anything with in our algorithm, so you're purely at the whim of relevance

[dawn quiver]

oh its not my bot

i would say a bot with the name "role sync" is pretty relevant to someone looking for a bot that does exactly that

[storm barn]

yeah agreed, but the algorithm has two scores "relevancy" and "votes", if one is super high and the other is 0 you'll really need to be super relevant to get high up there

i checked on the backend, it seems to fall on place 60 right now

[dawn quiver]

the algorithm needs to focus way more on relevancy

[odd creek]

same for cricket guru — it doesn't include neither "text" nor "speech" anywhere, therefore also not "Text to Speech"

[surreal tendon]

on their description

"YUBABE - Economy bot system with hunting, giveaways, anti spam, tts support"

[odd creek]

oh I used search in page and I missed that lol ok

but the other

[surreal tendon]

not sure about the other

[royal violet]

s

[opaque citrus]

this ranking is a bit weird

a bot with triple the votes is ranked lower

also same rating, but way more reviews count on the 2nd (which should imply more accuracy - instead of 5 vote on the first)

any way this could be improved/fixed

[storm barn]

need more info, what's the search link?

[opaque citrus]

can I dm you?

or dm me when you read this

[surreal tendon]

you can just dm it to him

[storm barn]

yea just dm

dont even need to ping me about it first

[opaque citrus]

did 🙂