Hello, I am learning python for quite some time now and I thought about a project regarding some GitHub analysis. Then I thought why not create a GitHub client as a PyPI package and use that in my CLI app instead of services in form of requests/httpx.
My question is that when I thought about it I realised GitHub is for a lot of endpoints returning paginated results and there might be a huge amount of rows if I were to call the API in a loop and it is not a good idea to save it in a list. Then I found out about generators but I do not know much about it and decided I wanna ask here before I fall in some kind of a rabbit hole.
I would be really glad to hear some thoughts about how this pagination/big amount of API results problems are handled. I would like to achieve to create a package that calls certain GitHub API endpoints and have the ability to somehow utilize async, deal with pagination correctly and fetch and analyze everything without running out of memory . (for the requests I am using httpx)
#๐ GitHub client as a PyPI package.
4 messages ยท Page 1 of 1 (latest)
@wraith silo
Remember to:
- Ask your Python question, not if you can ask or if there's an expert who can help.
- Show a code sample as text (rather than a screenshot) and the error message, if you've got one.
- Explain what you expect to happen and what actually happens.
:warning: Do not pip install anything that isn't related to your question, especially if asked to over DMs.
Closes after a period of inactivity, or when you send !close.
@wraith silo
This help channel has been closed. Feel free to create a new post in #1035199133436354600. To maximize your chances of getting a response, check out this guide on asking good questions.