read only database error - aws lambda | Django | Page 1

forest cliff Apr 30, 2023, 2:25 PM

#

Hey i deployed my project on aws lamda by zappa. it got deployed successfully, but when I try to use a function which have to acces the database I got an error “attempted to use readonly database”

olive ore Apr 30, 2023, 2:29 PM

#

db setup must be in read mode only

forest cliff Apr 30, 2023, 2:30 PM

#

Yeah I know that but where to change it or smth

#

I have tried chmod and deploying it again but don’t works still

olive ore Apr 30, 2023, 2:31 PM

#

I mean it depends

forest cliff Apr 30, 2023, 2:31 PM

#

How to solve it

olive ore Apr 30, 2023, 2:32 PM

#

forest cliff I have tried chmod and deploying it again but don’t works still

aaah

#

Lambada issue thn

#

Lambda function is unable to write to the database

forest cliff Apr 30, 2023, 2:34 PM

#

Yes I know what does it mean

#

But still don’t know how to solve it

olive ore Apr 30, 2023, 2:40 PM

#

I mean it's not my CODE

forest cliff Apr 30, 2023, 3:03 PM

#

What you need to help me?

lost scaffold Apr 30, 2023, 3:03 PM

#

What database are you using and how is it hosted? What have you tried to make it not read only?

forest cliff Apr 30, 2023, 3:05 PM

#

It’s in file, it’s sqlite3

#

In the same folder as the project

#

Locally it works

lost scaffold Apr 30, 2023, 3:09 PM

#

Aws lamda is an ephemeral hosting option. After each execution, the server is scaled down to nothing. Your application is stateless. This means that your database is being created and destroyed on each request. You need to choose a strategy that allows for persistent data storage. For example, AWS RDS. Or you can switch to running your application on a ec2 instance that you never destroy.

#

Does that make sense?

forest cliff Apr 30, 2023, 3:09 PM

#

Yes it’s make sense

#

As it’s my first time using aws

#

Bcs my friend said it’s good solution

lost scaffold Apr 30, 2023, 3:12 PM

#

It is, but there are constraints

forest cliff Apr 30, 2023, 3:12 PM

#

so i dont know how to host it

lost scaffold Apr 30, 2023, 3:13 PM

#

Fly, heroku, render, platform.sh all try to make it easier. If your set on low cost, then aws is a good choice, but you'll need to do some more research.

forest cliff Apr 30, 2023, 3:14 PM

#

and then in settings.py just connection credentials as always

lost scaffold Apr 30, 2023, 3:16 PM

#

Exactly. Your db needs to always be running

olive ore Apr 30, 2023, 3:43 PM

#

https://railway.app/

more clean and straight forward

Railway

Railway is an infrastructure platform where you can provision infrastructure, develop with that infrastructure locally, and then deploy to the cloud.

forest cliff Apr 30, 2023, 3:48 PM

#

https://github.com/FlipperPA/django-s3-sqlite

GitHub

GitHub - FlipperPA/django-s3-sqlite: An AWS S3-hosted SQLite databa...

An AWS S3-hosted SQLite database backend for Django. Originally developed with Zappa-Django-Utils. Not for important use! - GitHub - FlipperPA/django-s3-sqlite: An AWS S3-hosted SQLite database bac...

forest cliff Apr 30, 2023, 3:48 PM

#

lost scaffold Exactly. Your db needs to always be running

i found this

forest cliff Apr 30, 2023, 3:48 PM

#

olive ore https://railway.app/ more clean and straight forward

but theres no anyting for sqlite

olive ore Apr 30, 2023, 3:56 PM

#

What's wrong with using PostgreSQL

forest cliff Apr 30, 2023, 4:03 PM

#

migrating all project

#

that why i want to keep the sqlite3

forest cliff Apr 30, 2023, 4:03 PM

#

forest cliff migrating all project

i mean rewriting

olive ore Apr 30, 2023, 4:06 PM

#

It's not work like that

#

go through railway doc

#

Its really that SIMPLE...... choose db and connect with your project

forest cliff Apr 30, 2023, 5:15 PM

#

lost scaffold Exactly. Your db needs to always be running

but i have a little problem

#

i filled the credentials

#

but its going to global url

#

instead to the eu-center-1

lost scaffold Apr 30, 2023, 6:56 PM

#

I don't understand. You'll need to provide more information for someone to help.

forest cliff May 1, 2023, 9:31 AM

#

olive ore Its really that SIMPLE...... choose db and connect with your project

okay i have deploy it

#

but

#

i dont know what to do now

#

bcs sqlite db is keep destroying when pushing new version

#

how to automate it

#

to dont destroy or whe nthe deployment is closing bcs new one is coming

#

sending the sqlite file to another server

#

but i dont know how to handle this events

lost scaffold May 1, 2023, 9:55 AM

#

You shouldn't be deleting the database on deploy

forest cliff May 1, 2023, 10:29 AM

#

But on railway

#

Its auto deleting them

lost scaffold May 1, 2023, 11:00 AM

#

A quick search makes it seem like railway doesn't support sqlite

#

You'd need to switch to postgres or mysql

#

What's happening is what I described earlier with lambda. The db file exists on an ephemeral server that doesn't always exist. So when that server cycles out, all the files are deleted. As I mentioned earlier, you need a persistent place to run your database.

forest cliff May 1, 2023, 12:48 PM

#

yes i know that now, and thanks again for explanation

#

but as i searched

#

its not possible to host the sqlite in the netowrk like mysql

#

and operate it remotely

#

only way its exchange between the server and the railway the db.sqlite file

#

but fro mthat part i dont know how to exchange it with the server

#

one time

#

when the server starts

#

and then when its got closed

#

you got me now?

lost scaffold May 1, 2023, 1:39 PM

#

No, not really.

#

You're thinking in the wrong paradigm. You're trying to make everything run on one machine. If you're using something like lambda or railway and need to create/update/delete data, you have to run your database (sqlite, mysql, postgres, redis, etc) on a another machine.

forest cliff May 1, 2023, 4:21 PM

#

oh okay, but sqlite is not possible to connect to it like mysql

#

so thats why i dont know how to host if it dont work like a server

lost scaffold May 1, 2023, 4:46 PM

#

Are you using railway to host your app?

forest cliff May 1, 2023, 6:54 PM

#

okay i have figured out

#

its on aws

#

rightn now

#

and i changed db to postgres

#

so it works good

#

but i dont know now how to store static and medias

lost scaffold May 1, 2023, 6:58 PM

#

If you're using AWS, I would recommend using whitenoise for static files and django-storages for the media files.
https://whitenoise.readthedocs.io/en/latest/
https://django-storages.readthedocs.io/en/latest/

forest cliff May 1, 2023, 7:02 PM

#

yes i have configured the storages

#

the second option

#

but it still dont have acces to my images

lost scaffold May 1, 2023, 7:16 PM

#

What do you mean?

forest cliff May 1, 2023, 8:33 PM

#

i am using django storages

#

i have filled the

#

settings in settings.py

#

with access key

#

and secret

#

etc

#

i have to turn off acl to display this image otherwise access i forbideen

lost scaffold May 1, 2023, 8:38 PM

#

Do you want the ACLs turned on?

#

If so, how are you generating the URLs to your images?

forest cliff May 1, 2023, 8:54 PM

#

brother im newbie to aws

#

i dont know how it should be

lost scaffold May 1, 2023, 9:00 PM

#

That's fair, this is difficult. Do you need these images to only be accessible to specific users? For example, are people uploading personal information?

forest cliff May 1, 2023, 9:53 PM

#

nope

#

they are showed to all

#

theres no any specific per user

lost scaffold May 2, 2023, 2:09 AM

#

Then set AWS_DEFAULT_ACL to the public-read

forest cliff May 2, 2023, 7:38 AM

#

lost scaffold Then set AWS_DEFAULT_ACL to the public-read

yes it is

#

and shows on the page

#

but now i dont know how to make an upload to it

lost scaffold May 2, 2023, 11:09 AM

#

What have you tried to learn how?

forest cliff May 2, 2023, 11:21 AM

#

lost scaffold What have you tried to learn how?

i think my bucket is not correctly setted up

#

and also in the django

#

should be smth wrong

lost scaffold May 2, 2023, 11:52 AM

#

I can't help with the given information

forest cliff May 2, 2023, 11:55 AM

#

i can show a images

#

here

#

i cannot*

#

:/

lost scaffold May 2, 2023, 12:06 PM

#

Yes, that's so people don't paste images of code.

forest cliff May 2, 2023, 12:07 PM

#

i dont want to show code

lost scaffold May 2, 2023, 12:09 PM

#

You can take a screenshot and upload it to an image hosting site

forest cliff May 2, 2023, 12:11 PM

#

yes i can

#

but first i want to say

#

its the problem with permissions

#

bcs its generating a link to the

#

files

#

correctyl

#

for static its fine

#

but for uploading it dont work

#

i have created the user

#

with s3 full access policy

#

but still it cannot write into

#

the s3

#

only read

forest cliff May 2, 2023, 12:20 PM

#

lost scaffold You can take a screenshot and upload it to an image hosting site

https://ibb.co/ZS4GkXQ

ImgBB

Zrzut-ekranu-2023-05-2-o-14-18-29 hosted at ImgBB

Image Zrzut-ekranu-2023-05-2-o-14-18-29 hosted in ImgBB

#

here it is

#

i dont know what to check here

lost scaffold May 2, 2023, 1:10 PM

#

but still it cannot write into

What does this mean? You should try to provide what exactly you're doing and what exactly it is that you're seeing.

forest cliff May 2, 2023, 1:17 PM

#

becuase in my poject

#

i need to uplaod a image

#

so i want to upload it to media

#

so this action is called writing

#

and im using django-storages

#

to make it

#

it generates the uri to the media

#

stored

#

and it shows it only when i public manually this files

#

and change all acls for everyone access to read

#

you understand for now?

lost scaffold May 2, 2023, 1:22 PM

#

and it shows it only when i public manually this files
and change all acls for everyone access to read

This part doesn't make sense. Can you elaborate? I feel like your solution is somewhere in this action.

forest cliff May 2, 2023, 1:24 PM

#

for me its clear

#

when i upload manually files to s3

#

i cannot access it from url

#

but when i change the permissions for the file

#

everyone access to read

#

from nothing

#

it works

#

just seeing files

lost scaffold May 2, 2023, 1:27 PM

#

but when i change the permissions for the file
There's your solution. You need to make sure the permissions are set correctly when they are uploaded. So what in django-storages have you configured to allow that?

forest cliff May 2, 2023, 1:29 PM

#

oh i have watched the vid

#

i have not setted the policy

#

lemme try

#

maybe thats it

#

oh now i have a django error

forest cliff May 2, 2023, 1:58 PM

#

can i record a vid

#

to show you?

lost scaffold May 2, 2023, 1:58 PM

#

If you have an error, you shouldn't need to create a video. You have an action and a result.

#

Videos are hard to search, parse and copy/paste stuff from.

forest cliff May 2, 2023, 2:00 PM

#

i mean

#

its not returing any error

#

but not inserting to database

#

and also not sending to s3

#

logo = models.FileField()

#

this is in my models

forest cliff May 2, 2023, 2:02 PM

#

forest cliff logo = models.FileField()

it shoudl looks different if i want to send to s3?

lost scaffold May 2, 2023, 2:18 PM

#

Does any data get inserted? What about on other models, can you create data there?

Does this flow work locally? Probably worth retrying.

forest cliff May 2, 2023, 2:21 PM

#

it works locally

#

before

#

nothing is inserted

#

to database

#

and nothing to s3

#

just refreshign the page

#

when submiting

#

after few seconds thinking

lost scaffold May 2, 2023, 2:23 PM

#

Is your view setup to render invalid form errors?

forest cliff May 2, 2023, 2:23 PM

#

nope

lost scaffold May 2, 2023, 2:23 PM

#

Then that's probably what's happening.

forest cliff May 2, 2023, 2:24 PM

#

Idk

forest cliff May 2, 2023, 4:13 PM

#

so how you can help me?

lost scaffold May 2, 2023, 4:23 PM

#

At this point I think we're at the end of my help. I think you're close to figuring things out, but I'm not sure. I can't see the code or the errors. When coming across a problem you want help with, you should answer the following three questions:
What did I try?
What did I expect to happen?
What actually happened?

And if the answers are:

I submitted a form with an image.
I expected the image to be uploaded.
The image wasn't uploaded.

It's not enough information. It should be closer to:

I submitted a form with an image. I confirmed that the data and image is being sent via the Network Panel in the developer tools. Here's my view, form, model and template. Here the my media file settings.
What I expected was there to be a row inserted into this table with the value "A" for field "B", and a relative path to with the image's filename on the image column.
What actually happened was that there's no row inserted, the page effectively refreshes, and there is no visible error present. The terminal doesn't show an error either.

forest cliff May 2, 2023, 4:29 PM

#

thats correct

#

everything you writed

lost scaffold May 2, 2023, 4:31 PM

#

Here's my view, form, model and template. Here the my media file settings.
When you ask this question elsewhere, be sure to include the above pieces of information.

#

At this point I need to step away from our discussion. It sounds like you're on a time crunch, so it's probably a good idea to post this new problem to the proper channel and ask for help from someone else.

#read only database error - aws lambda