doubt in collecting data

[indigo lotus]

hello people
Is it possible for a Discord bot to collect data from a public server —just the text I wrote in a server, along with any replies to me? The server has over 50k messages each day, and I’ve been working on some code to capture that, but it keeps getting stuck in an infinite loop. I tried to gather daily messages, but it only gave me a few rows, even though there were tons of messages. I’d appreciate any help or suggestions!
I feel like it’s happening because of discord rate limits. Even when I put into small batches-it still doesn’t work TT
ps:)
don’t worry- i’m collecting chats only for education purposes

[velvet quest]

what do you mean by collecting data? storing all the messages in a database or something?

[velvet quest]

if you are use the library "discord.js" , it has event "messageCreate". You can check if the message is from a user/bot and can store it in a db or just forward them to a log channel. but storing the chats with over 50k msg daily isn't a best way (also not even for educational purpose "

also discord imposes strict rate limits, and trying to collect this volume of messages could result in your bot being rate-limited or even banned if it violates the platform's rules

[indigo lotus]

but it would only store my texts right not the replies I got??
and i won’t be collecting all 50k msg
only my texts and replies
I was stating that it has to read all those to collect mine 🙃

[indigo lotus]

yeahh coz of rate limits I couldn’t collect

[velvet quest]

I think it gets all the messages

By Every user and bot

You can filter out if from a user or a bot

You can check the documentation

But i think you can do something like:

If(message.author.id === bot.users.cache.get(“YOUR_ID”){
// store 
}