Marked down text file or JSON file

[carmine jacinth]

Hi, in your experience, when dealing with a vector database, which type of these two file types is great for llms: a marked down text file or a json file? Thanks.

[lilac burrow]

Can you provide examples of the two types of files? What sort of content will be in them? That's important to keep in consideration too!

[carmine jacinth]

Thanks, so the content is scraped website pages. in both JSON and Markdown text formats

[lilac burrow]

I would honestly go for markdown, embeddings retain semantic understanding and it might become too loosely connected if you use JSON