When is this coming?
#Object Stores (Globally availiable)
cunning violet
exotic sparrow
In next 1-3 months. It is on our roadmap
eager cloak
This would be very nice to have, any updates @exotic sparrow?
graceful badger
This would be very nice to have, any updates <@658146058018488330>?
Later today 👁️ (June 9th)
I don't have a time or anything, but I'll come mention you soon.
graceful badger
Just my luck this got rescheduled, we might need about a week
graceful badger
I lied - release today 😄
midnight zenith
doesn't work:
same code worked with r2_id and r2_key instead
feral scroll
doesn't work:
same code worked with r2_id and r2_key instead
are you using your user id for auth?
midnight zenith
are you using your user id for auth?
nope, i used id and key from this view:
grim zealot
What if you use your runpod email as your ID?
feral scroll
nope you need use user id
grim zealot
Okay then update the docs primarily the code, for network storage s3 api.
grim zealot
Okay then update the docs primarily the code, for network storage s3 api.
Example code
grim zealot
ClientError: An error occurred (Unknown) when calling the ListObjects operation: signature mismatch for all known keys
why is this? just tried listobjects
using boto3
params = {
"Bucket": bucket_name,
"Prefix": prefix,
"MaxKeys": 1000,
}
if marker:
params["Marker"] = marker
resp = s3_client.list_objects(**params)
v2 also doesnt work, same error
grim zealot
nope, i used id and key from this view:
okay this is weird Why wont it allow us to use access key ID from that
cunning violet
What happens if the disk is full?
grim zealot
well the request fails perhaps, it doesnt automaticaly expand
Storage capacity: Network volumes have a fixed storage capacity, unlike the virtually unlimited storage of standard S3 buckets. The CopyObject and UploadPart actions do not check for available free space beforehand and may fail if the volume runs out of space. This behavior is similar to applying a size quota in S3.
grim zealot
ClientError: An error occurred (Unknown) when calling the ListObjects operation:...
i hope runpod can allow the access_key_id generated instead of using the user id from secrets page
cunning violet
And im curious if
Failed multipart requests are billed
Like in AWS
You hav to remove the parts yourself
grim zealot
requests arent billed from the docs
grim zealot
oh i havent tested multipart yet
cunning violet
Does that eat up your storage
cunning violet
oh i havent tested multipart yet
It should do multipart by default if you copy sth large
grim zealot
yeah i havent even uploaded any files yet using the s3 api hahah
cunning violet
Oof
cunning violet
Wut
cunning violet
Maybe too many ppl are using it
cunning violet
have you tried it?
Finals week here
grim zealot
yeah probably, need to scale up
cunning violet
😢