Django not request logging | Railway | Page 1

upbeat geyser Jan 19, 2023, 3:35 AM

#

This screams to me a code issue, yet after an hour of research I am still unsure as to why I can't see anything lower than a warning in the railway logs. The exact same branch, codebase, and env variables work fine, as I am able to see logs locally, but not on Railway. It was working a few months ago, but when I updated from django 3.2 to 4.0 and from heroku to nixpacks, the logging stopped showing up

stiff boughBOT Jan 19, 2023, 3:35 AM

#

Project ID: 9b0e625c-b8d1-4c35-8629-60c32ab222ed

#

You might find these helpful:

upbeat geyser Jan 19, 2023, 3:36 AM

#

9b0e625c-b8d1-4c35-8629-60c32ab222ed

#

nixpacks.toml

#


[start]
cmd = 'python manage.py migrate && gunicorn --max-requests 1000 --workers 5 --threads 2 timeweb.wsgi'```

#

Django Logging config

    'version': 1,
    'disable_existing_loggers': False,
    'formatters': {
        'verbose': {
            'format': '{levelname} {asctime} {module} {process:d} {thread:d}>> {message}',
            'style': '{',
        },
        'simple': {
            'format': '{asctime} <<{levelname}>> {message}',
            'style': '{',
        },
    },
    'handlers': {
        'console': {
            'level': 'INFO',
            'class': 'logging.StreamHandler',
            'formatter': 'simple'
        },
        'mail_admins': {
            'level': 'ERROR',
            'class': 'django.utils.log.AdminEmailHandler',
        }
    },
    'loggers': {
        'django': {
            'handlers': ['console'],
            'propagate': True,
        },
        'django.request': {
            'handlers': ['mail_admins'],
            'level': 'ERROR',
            'propagate': False,
        },
    }
}```

lavish sinew Jan 19, 2023, 3:48 AM

#

make sure your environment variable is set properly in the project, you could also just hard code them to test it

upbeat geyser Jan 19, 2023, 4:03 AM

#

lavish sinew make sure your environment variable is set properly in the project, you could al...

hmmmmm

#

interesting

#

not the environment variables

#

but python 3.8 logs it

#

while python 3.10 doesn't

#

i guess that fixed my error but that is a bit odd

lavish sinew Jan 19, 2023, 4:09 AM

#

interesting

#

3.10 is a bit new iirc

#

3.9 is the recommended for prod last i checked

upbeat geyser Jan 19, 2023, 4:12 AM

#

i can try redeploying with 3.9 just to single out which version is causing the issue

#

3.9 works

#

it does indeed seem to be 3.10

lavish sinew Jan 19, 2023, 4:18 AM

#

figures

upbeat geyser Apr 8, 2023, 7:32 AM

#

hello,

I'm running into a similar problem from my original question for this thread. Info logging works but request logging on the other hand does not.

#

locally this works perfectly

Screenshot_2023-04-08_at_12.32.30_AM.png

#

but on railway it doesn't log requests

#

django's logger api works from views.py which means i can get my own log messages to work if I call it on a view function

#

which is pretty strange since my env variables are the same

#

as i mentioned in the original thread this worked on heroku way back ago but it just stopped working out of no where

#

Django not request logging

#

logging config (copied from django docs)

    'version': 1,
    'disable_existing_loggers': False,
    'formatters': {
        'verbose': {
            'format': '{levelname} {asctime} {module} {process:d} {thread:d}>> {message}',
            'style': '{',
        },
        'simple': {
            'format': '{asctime} <<{levelname}>> {message}',
            'style': '{',
        },
    },
    'handlers': {
        'console': {
            'level': 'INFO',
            'class': 'logging.StreamHandler',
            'formatter': 'simple'
        },
        'mail_admins': {
            'level': 'ERROR',
            'class': 'django.utils.log.AdminEmailHandler',
        }
    },
    'loggers': {
        'django': {
            'handlers': ['console'],
            'propagate': True,
        },
        'django.request': {
            'handlers': ['mail_admins'],
            'level': 'ERROR',
            'propagate': False,
        },
    }
}```

sinful night Apr 8, 2023, 7:42 AM

#

this may be a shot in the dark but try setting PYTHONUNBUFFERED = 1 in the service variables

upbeat geyser Apr 8, 2023, 7:42 AM

#

i already have that

#

i tried that from searcing through other threads

sinful night Apr 8, 2023, 7:43 AM

#

well I did say shot in the dark

upbeat geyser Apr 8, 2023, 7:43 AM

#

true lol

sinful night Apr 8, 2023, 7:43 AM

#

are the info logs somehow going to a file and not stdout?

upbeat geyser Apr 8, 2023, 7:44 AM

#

nope they've only been configured for stdout

#

hm

#

tomorrow i will experiment with https://pypi.org/project/django-request-logging/

PyPI

django-request-logging

Django middleware that logs http request body.

#

to try to pinpoint which end of the issue it is at

sinful night Apr 8, 2023, 7:45 AM

#

maybe Django's logger doesn't respect the python unbuffered variable

upbeat geyser Apr 8, 2023, 7:46 AM

#

i doubt it's a buffer issue

#

there are logs still showing up

#

manual calls to logger still show up in the logs

#

and tail appropriately

sinful night Apr 8, 2023, 7:47 AM

#

so info logs trigger by routes just aren't getting logged

upbeat geyser Apr 8, 2023, 7:47 AM

#

yes

#

everything else is logging

sinful night Apr 8, 2023, 7:47 AM

#

sinful night so info logs trigger by routes just aren't getting logged

but they do print on your computer?

upbeat geyser Apr 8, 2023, 7:47 AM

#

yes

upbeat geyser Apr 8, 2023, 7:47 AM

#

upbeat geyser locally this works perfectly

^

sinful night Apr 8, 2023, 7:47 AM

#

fishy

upbeat geyser Apr 13, 2023, 12:48 AM

#

hello, any update on this?

upbeat geyser Apr 19, 2023, 8:24 AM

#

interestingly enough, it works a few days later

#Django not request logging