How to reupload

[fast plank]

I've got a note left over from one of the earlier tests to see if uploading was fixed yet. On my desktop, all the files load show correctly. Going to any other device, they show as attached, and have placeholders, but never load. When I click "reupload" I am prompted to browse for the original on the filesystem, rather than the cached version on the working desktop app.

To reupload these I'd have to download each one individually, then reupload and browse individually - not a great UX. Is there no way to force the note just to upload what it has already?

[surreal sapphire]

Is it happening only on the desktop app or the androud app too?

[fast plank]

Well the files only exist on the desktop app, so can’t really “test” from an android as such. But they’re disappeared on all other devices/platforms

[late rivet]

I am not sure reupoading will solve the issue. If the files are loading on the desktop app then they are probably fine. You can try logging in on an incognito window in Chrome and see if the files are available there or not.

[fast plank]

I have confirmed multiple ways they are not available on any other platform/session/browser

[late rivet]

What happens if you try to download them from the attachment manager?

[fast plank]

9 byte file with content as “Undefined” is downloaded

[late rivet]

But the same attachment can be downloaded just fine from the desktop app?

[fast plank]

Correct

[late rivet]

Okay, so do this:

1. Go to Settings > Attachment manager in your desktop app
2. Select all the attachments and download them
3. Open the zip file and confirm all files are valid (i.e. no 0 byte file)

[fast plank]

I will do this shortly

Just finishing food

[late rivet]

No problem.

[fast plank]

Confirming they all work fine on the desktop when done that wayt

In the incognito window, only the two that originally worked download fine, and the other 13 all have the 9 byte files. But they show double tick uploaded in the desktop version and the web version

And if I hit “recheck” they all check fine

(On both platforms)

[late rivet]

@fast plank okay, that's great news then. However, since the attachments aren't erroring on recheck that means you'll have to manually reupload them.

Not sure how a file containing "undefined" got uploaded instead of the actual file.

When did you upload these files? Do you remember the version?

[fast plank]

It was 3.0.2 or 3.0.3 (9th of May upload)

I’ve mostly stopped using attachments since then

[late rivet]

Okay, we fixed a lot of issues with attachments from then (but the already broken attachments can't be automatically fixed unfortunately).

[fast plank]

Are attachments at a point where they work more often than not, now? Does the desktop app automatically back up attachments yet too?

[late rivet]

Auto backups aren't there yet but exports do include all your attachments. We aren't receiving "attachments gone missing" reports anymore so that's an indication. Of course, you'll have to test it for yourself and see how it goes.

[surreal sapphire]

Have you experienced old attachments not loading up in desktop app. Could you please check this https://discord.com/channels/796015620436787241/1261621303400726581

[fast plank]

I’ll have to give it another go. Can you confirm if attachment servers are also still only in Germany? They were exceedingly slow for me previously

Just curious if you have some more geographically diverse options per region?

[late rivet]

How slow are we talking? We are thinking of migrating to a different service.

[fast plank]

A 1MB file would take 15-30 second s

[late rivet]

Damn that's slow.

[fast plank]

Yeah haha

Obviously once cached it was okay

[late rivet]

Give it a try again and see how it goes. Please do report back if its just as slow.

[fast plank]

Sure, I’ll give it a shot and let you know

[fast plank]

5-6s now

That’s on a 1Gbps connection btw

[late rivet]

Yeah that's still slow.

Which region are you located in?

[fast plank]

Australia, which is normally slower to Europe. I’m hoping to move from Standard Notes at some stage, but attachment speed (and at least previously, reliability) has held me back. They use a number of regions depending where the user is - perhaps something like that could work? Like Europe, America, and Asia Pacific? Just a thought

[late rivet]

Looking into this.

Thanks for the heads up.

[fast plank]

No worries - I’ve worked with backblazes B2, which is good price , S3 compatible, and at least Europe and Americas, so may work out comparably to the current service you use. Wasabi is another fairly decent price service with lots more location options, but not sure what margins you’re running as to whether either would be feasible 🙂

But both significantly cheaper than AWS 😂

[late rivet]

@fast plank can you check the speed with this file?

https://attachments.notesnook.com/DAP-1610_REVA_FIRMWARE_v1.08B01.zip

Testing Cloudflare CDN with Wasabi s3

It's a 6 MB file

[fast plank]

Sure, one sec

[fast plank]

Less than 1s

Too fast to count 😂

[late rivet]

Ah so that may work.

[fast plank]

Yeah definitely seems feasible on a speed front at least

[late rivet]

Let me see how simple all this will be to set up.

[fast plank]

No worries - if you need any beta testing or such, let me know

Want to see notesnook succeed, so happy to help where I can

[late rivet]

Thanks!

[late rivet]

@fast plank just connected cloudflare CDN to the attachments bucket. Can you try again and see if the download speed is better when downloading an attachment from the app?

[fast plank]

@late rivet sure, as in, just in production version?

[late rivet]

yup

Just download the file and see if speed is better.

[fast plank]

absolutely, will give it a shot now

@late rivet same DNS name? i.e. will I need to flush my cache?

[late rivet]

no need to do anything. just go to the attachment manager and download the file as you do normally.

[fast plank]

no worries - wasn't sure if it was a case of (for example) attachments.notesnook.com pointing straight to bucket previously, then same DNS name now pointing to cloudflare cache (and therefore DNS -> IP resolutions might have been cached on my end - just making sure I'm giving you accurate results 🙂

I'll test it now

[late rivet]

no, no, attachments.notesnook.com wasn't pointing anywhere. Previously, I was using Wasabi's domains directly so no CDN/CNAME etc.

[fast plank]

so far looks pretty quick; scroll through of existing images takes no longer than 2s at most

just gonna try a specifically larger file now

@late rivet

can't upload 🙂

(can still upload small things, but this was a 75MB file)

[late rivet]

one sec

[fast plank]

np, 25MB file gives same result btw

[late rivet]

same as in slow? or fast?

[fast plank]

as in the upload error

any file I can test is small, and they are fast

I just wanted to test something ~50MB to see if that's as quick as expected also

but it does seem the 1-2MB images are faster than before (loading in 2s or less)

[late rivet]

Give me a sec, fixing.

[fast plank]

No worries - for an 8MB file at least, it is also just as quick (less than 2s) so looking promising

[late rivet]

Fixed. Try uploading bigger files now. Should work.

[fast plank]

Let me check 🙂

“Lost connection to background transfer service” this time

@/private/var/containers/Bundle/Application/89C07382-4162-44F4-A1B9-8BFCB6F9A71F/Notesnook.app/main.jsbundle:1:1024276
value@/private/var/containers/Bundle/Application/89C07382-4162-44F4-A1B9-8BFCB6F9A71F/Notesnook.app/main.jsbundle:1:2206045
@/private/var/containers/Bundle/Application/89C07382-4162-44F4-A1B9-8BFCB6F9A71F/Notesnook.app/main.jsbundle:1:2202782
value@/private/var/containers/Bundle/Application/89C07382-4162-44F4-A1B9-8BFCB6F9A71F/Notesnook.app/main.jsbundle:1:2204461
value@/private/var/containers/Bundle/Application/89C07382-4162-44F4-A1B9-8BFCB6F9A71F/Notesnook.app/main.jsbundle:1:2202751

That was log output

[fast plank]

Sorry forgot to do tagged reply

[late rivet]

Are you trying from the iOS app?

[fast plank]

This time yes, prior to that every other one was from desktop

[fast plank]

Would you like me to go back to desktop?

[late rivet]

IF possible. Or just try again (there was another small bug that I fixed just now).

[fast plank]

Sure, iOS still broke but I’ll try desktop

On desktop, percentages jump back and forward all over the place, eventually gets to 104%, and fails upload verificaiton

[fast plank]

and then this error is produced

[late rivet]

Fixed for sure now. 😄

[fast plank]

No errors now, but also no uploads 😛

constantly flashes attempts to upload, then stops

[late rivet]

Try deleting that attachment from the attachment manager and then attaching it again.

[fast plank]

I did exactly this 🙂

Was a fresh note and attachment

[late rivet]

Are there any other pending uploads?

[fast plank]

None at all

Deleted them all as a test for this

[late rivet]

Not sure what's happening then. Restarting the app doesn't help either? If you can, send me the logs from Settings > Help and support > Debug logs.

[fast plank]

Sure - once kids are in bed, I’ll test fresh session and send debug logs for desktop too

Be roughly one hour

[late rivet]

No problem.

[fast plank]

Fresh session in incognito window - same upload issue (bouncing percentage around, eventually "completes" - attachment in note shows single tick, attachment in attachment manager shows double tick)

in the desktop app, trying to download it results in "failed to pull"

[late rivet]

percentage bouncing around is a separate bug (fixed now).

[fast plank]

No worries - nevertheless, upload doesn't work at the moment for me 🙂

[late rivet]

That's really strange. I just uploaded 4 files and downloaded them again without any error.

[fast plank]

Bizarre; let me try via desktop app instead of web app

[fast plank]

same issue with desktop app

on 3.0.11

just gone for a 3rd exit + reopen, and it seems like it might have worked this time

[fast plank]

okay so download speed is about 4s for 57MB, which is a totally fine speed 🙂