Total Scrobble numbers not matching after importation

[hybrid arch]

I imported all of my data last night, and have noticed that it is not matching the totals from a different service. I used the same zip file for both services, but am missing almost 100 thousand scrobbles that I believe should be registering. I have also noticed that after doing .u full, I lost scrobbles on a few artists. I will attach photos of everything below.

This is the all time comparison between fmbot and stats.fm. I have used identical zip files to import data into both services, but the stats are wildly different. I don’t believe that this is an issue of scrobbles not counting in last fm because of the 30 second minimum, as Spotify uses that baseline as well.

These are the screenshots of my scrobbles decreasing after doing .u full

[devout crag]

So for Stats.fm the only requirement they have for something to count as a stream is the 30 second minimum

However, for us its:

• The track must be longer than 30 seconds.
• And the track has been played for at least half its duration, or for 4 minutes (whichever occurs earlier.)

I think however something else went wrong here because I can see in the logs you should have at least 246k valid imports, while there are 151k for you in the database

@hybrid arch can you send me a screenshot of the output of when you ran the import command?

and are you able to run your imports through the command again?

[hybrid arch]

@devout crag

[devout crag]

can you dm me your import files?

[hybrid arch]

sure

[devout crag]

So we use the timestamp of a play to filter out duplicates, and to filter out if we have already stored a play for you before

however in your import there are a lot of plays that have the exact same timestamp for some reason. In some cases 300 plays with the exact same timestamp

I haven't noticed that happening before

[hybrid arch]

hmm

interesting

what is that typically a sign of?

[devout crag]

I don't know. You mentioned you had slow internet, do you use offline mode a lot?

[hybrid arch]

ohhhhhhhhhhhhh

[devout crag]

it could be that spotify groups offline plays together

[hybrid arch]

yes

back from 2016-2018 i played offline

exclusively

because i used an ipod

[devout crag]

I put a fix on the beta bot. Can you try in #commands ?

[hybrid arch]

which command should i use

[devout crag]

just /import spotify again

[hybrid arch]

alright. last time it took about 10 minutes. so just a heads up

[devout crag]

np

[hybrid arch]

@devout crag it just finished. anything else i should do? or should it be workign correctly?

[devout crag]

It should now be working correctly

.stats @hybrid arch

[ornate adder]

Stats for KC731, requested by Frikandel 👑

⭐ .fmbot supporter
Imported: Full Spotify, then Last.fm

Last.fm info

Name: KC731
Username: KC731
Country: None
Registered: <t:1542521343:D> (<t:1542521343:R>)

Playcounts

Scrobbles: 236668
Tracks: 23726
Albums: 12030
Artists: 5847

Stats

Average of 135.6 scrobbles per day
Average of 2.1 albums and 4.1 tracks per artist
Top 10 artists make up 18.9% of scrobbles
Most active day of the week is Friday

Months

August - 2224 plays - 5 days, 1 hours
July - 2847 plays - 6 days, 10 hours
June - 2206 plays - 4 days, 23 hours
May - 2254 plays - 5 days, 7 hours
April - 2693 plays - 6 days, 9 hours
March - 3364 plays - 7 days, 13 hours

Years

All - 236668 plays - 586 days, 17 hours
2023 - 20009 plays - 45 days, 7 hours
2022 - 14236 plays - 32 days, 7 hours
2021 - 13140 plays - 29 days, 6 hours
2020 - 12172 plays - 28 days, 8 hours
2019 - 39237 plays - 92 days, 7 hours
2018 - 39110 plays - 94 days, 14 hours
2017 - 40260 plays - 111 days, 12 hours
2016 - 38316 plays - 102 days, 2 hours
2015 - 16779 plays - 41 days, 16 hours
2014 - 3409 plays - **9 days, 7 hours
**