[Bug] Android SDK Storage would not upload files larger than 5 MB if the fileID is not unique

[sour herald]

I am using the Android SDK version 2.0.0.

Using this modified code snippet from the docs:

String bucketID = "bucketID";
String fileID = "fileID";
File file;
Object upload = storage.createFile(
                  bucketID,
                  fileID,
                  InputFile.Companion.fromFile(file),
                  new Continuation<Object>() {
                      @NotNull
                      @Override
                      public CoroutineContext getContext() {
                          return EmptyCoroutineContext.INSTANCE;
                      }
      
                      @Override
                      public void resumeWith(@NotNull Object o) {
                          String json = "";
                          try {
                              if (o instanceof Result.Failure) {
                                  Result.Failure failure = (Result.Failure) o;
                                  throw failure.exception;
                              } else if (o instanceof io.appwrite.models.File){
                                  io.appwrite.models.File response = (io.appwrite.models.File) o;
                                  if (response.getChunksUploaded() == response.getChunksTotal()){
                                      Log.d("File Upload", "Finish Uploading " + response.getName());
                                  }
                              } else {
                                  Log.d("File Upload", "Unexpected result type");
                              }
                          } catch (Throwable th) {
                              Log.e("ERROR", th.toString());
                              th.printStackTrace();
                          }
                      }
                  }
          )

Note that fileID is using a string and not using unique ID retrieved from ID.Companion.unique().

(cont...)

If the file is larger than 5 MB and fileID is not using ID.Companion.unique(), Appwrite will throw an exception that the file cannot be found:

io.appwrite.exceptions.AppwriteException: The requested file could not be found.
    at io.appwrite.Client$awaitResponse$2$1.onResponse(Client.kt:490)
    at okhttp3.internal.connection.RealCall$AsyncCall.run(RealCall.kt:519)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1137)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:637)
    at java.lang.Thread.run(Thread.java:1012)

However the application has proper permissions and able to read and write the file. This does not happen if the fileID is using a unique ID retrieved from ID.Companion.unique(). This also does not happen on files smaller than 5 MB.

I'm sorry, I just realized that the Android SDK itself has a github page. Should I post an issue over there instead?

[vivid epoch]

Is the file ID a new file that doesn't exist yet?

Also, is there an active session?

[sour herald]

There is an active session, yes. If I loop this code snippet to iterate over files with various sizes, the smaller ones will be uploaded while the ones bigger than 5 MB will result in the SDK throwing the exception above.

[sour herald]

Whether if it's a new file or not does not seem to matter. If the fileID already existed on cloud, the existing file is just overwritten with the new one instead.

[vivid epoch]

Ehhh that shouldn't really be the case...

What are the permissions on the bucket and files?

[sour herald]

Create files only for any user.

[sour herald]

I tested it and it seems to be the case on cloud console so... yeah not sure then

[sour herald]

Btw, I mean "proper permissions" here as in the application have read and write access to the files inside the Android device itself. Which makes the "file not found" exception to be weirder.

[vivid epoch]

So are you using the same file id for a file that already exists on the server already?

[sour herald]

Some additional note: the fileID itself isn't the same for every file actually, but rather it was generated from timestamp in my system. I just put a variable in the code snippet to make it simpler

[sour herald]

I tried doing that and it works fine on files smaller than 5 MB.

It's not my intention to put files with the same ID in the server though

I wanted to generate the fileID string from the timestamp when the file was created

However whenever I insert any strings other than ID.Companion.unique() on any file larger than 5 MB, this happens.

[vivid epoch]

You said there was some loop uploading multiple files...but each file id you're generating is unique and doesn't exist on the server yet, right?

[sour herald]

Yes

This appears to be more of an issue to the Android SDK itself rather than the server though

[vivid epoch]

So what are the permissions on the collection and file that gets generated?

[sour herald]

permissions are what I have expected to, yes.

Bucket: any users can create

[vivid epoch]

What version of the android SDK are you using?

[sour herald]

2.0.0

[vivid epoch]

With file security on?

[sour herald]

yes

only create

[vivid epoch]

Please share the permissions on the created file

[sour herald]

I apologize but I will have to do it later. It's already 5 am here and I have not slept.

[vivid epoch]

Also, make sure you're using https for the endpoint.