#extremely fast quote scraper

2 messages · Page 1 of 1 (latest)

eternal lake
#

https://github.com/irvineAlgotrading/quoteripper/blob/master/quoteripper.ipynb

made this for collecting a large amount of text quotes from particular people, then cleaning all the way down until ready for feeding into language models.

still needs some very minor tweaks, but wanted to make it public since it's so fast and helpful as it is.

cheers!!

GitHub

A very clean scraper that pulls individual lines of quotes into a txt file. The txt file can then be used for training language models without further cleaning, direct into pytorch etc. - quoterip...

craggy grotto
#

What are the use cases