I have a large document (D) of 3500 tokens. I want to do things like: "generate 5 questions surrounding D" but I want an infinite scroller so..."generate 5 more questions" it feels like the costs would add up quickly if I resubmit D for every query....SO! can I use embeddings to store D and then execute my plain english prompts against it?
#Can I use embeddings as "memory" for a prompt?
violet dome