TehT - tokenizer

[solar arch]

I don't think any of the settings should prevent tokenizer working - if you hit F12 to get the developer console open, does it give any errors or warnings when you try to open tokenizer?

Basically the directory structure should point to existing folders. There maybe an issue if say your tokenizer frames folder is pointing to the root data directory or a directory containing too many files as it maybe trying to index toooo much