🔒 Ratelimit even with proxies

[normal patio]

@blazing vault

Python help channel opened

Remember to:

• Ask your Python question, not if you can ask or if there's an expert who can help.
• Show a code sample as text (rather than a screenshot) and the error message, if you've got one.
• Explain what you expect to happen and what actually happens.

:warning: Do not pip install anything that isn't related to your question, especially if asked to over DMs.

Closes after a period of inactivity, or when you send !close.

[blazing vault]

def id_to_item_id(session, data, headers):

    global requests_count

    ua = UserAgent()
    user_agent = ua.random

    headers['User-Agent'] = user_agent


    random_proxy = random.choice(proxies)
    try:
        response = session.post(
            f'https://catalog.roblox.com/v1/catalog/items/details',
            json=data,
            headers=headers,
            proxies={
                'http': f'http://{random_proxy}',
                'https': f'http://{random_proxy}'
            },
            timeout=5
        )
    except Exception as e:
        return id_to_item_id(session, data, headers)

    requests_count += 1

    return response.json()```

I still get ratelimit even tho I am using proxies

[misty tapir]

!rule 5

[normal patio]

Rules

5. Do not provide or request help on projects that may violate terms of service, or that may be deemed inappropriate, malicious, or illegal.

[blazing vault]

Its not illegal or innapropriate

Its simple working with an api

Rate limit is there for massive spam im not performing massive spam I just want to perform more than 60 requests per few minutes

[misty tapir]

It is inappropriate to bypass rate limits

<@&831776746206265384>

[vast hamlet]

yeah, this absolutely is not allowed

[misty tapir]

If the API only wants you to do 60 per minute, guess what that means? You only get 60 per minute.

Bypassing that is highly inappropriate

They were kind enough to provide an API. Don't go abusing their kindness

[glacial scaffold]

Rate limit exist for a reason

[blazing vault]

??? they have 0 documentation about the api and the api is being used every second by millions of users

I dont think its a problem if I do 100 requests instead of 60

but alright.

[misty tapir]

The moderator already said no

[blazing vault]

I know and ill take that as an answer its just weird that you say it like they put so much effort into protecting the system against 20 more requests

have a nice day

[cyan zephyr]

Using not-public api is also not appropriate. It's internal for a reason

Just like with discord - there's api the client uses... but using it by users is not permitted. They have separate bot api for public use

[fleet stratus]

The API they were using is in fact publicly documented: https://catalog.roblox.com/docs/index.html

anyway, the main point about not bypassing the ratelimit still stands, if they say you can make 60 requests per second, that's the limit - even if you're not bypassing it by much, if everyone bypassed it by just a little bit, then the additional requests would quickly add up

[cyan zephyr]

Oh. It was them who said "they have 0 documentation" so I assumed private api

[late scaffold]

Depending on what you're trying to do, caching is one of the best ways to reduce the number of API requests you need to perform

[glacial scaffold]

Well, it's more like discovered by someone, these API sites are nowhere to be mentioned in their main website developer documentation and only mentioned in the Roblox forum by some user (and any other third party source including some GitHub repo)

More like no intent to be public but also no intent to be private

God know what they are thinking

lul

[blazing vault]

You can just find them by burpsuite, or the network section from dev tools

By going on their main page

[cyan zephyr]

That's still not public api. Public api for public use is documented.
Many ToS include terms about automating and that one is not permitted to just automate the website, except the official ways (public api)

[blazing vault]

Its not against roblox TOS to automate in general

[fleet stratus]

roblox's terms are surprisingly lax in their rules regarding site automation
or well, the terms don't actually have a clause saying that scraping/site automation are disallowed, despite what you'd think

[blazing vault]

Been automating stuff on there for around 5 years

Yeah

[normal patio]

Python help channel closed

This help channel has been closed and it's no longer possible to send messages here. If your question wasn't answered, feel free to create a new post in #1035199133436354600. To maximize your chances of getting a response, check out this guide on asking good questions.