#what is the best approach for generating small chunks of text, using several examples as a base ?

1 messages · Page 1 of 1 (latest)

crystal oak
#

If I went to generate paragraphs of text, using several example paragraphs as a source, could anybody help me understand the best approach right now? Let’s use horoscopes as an example: say, I want it to give several (10-20) examples of horoscopes, and then be able ask for “a horoscope for a lonely person”?

Is there something I need to train a model for, or at least a LORA or embedding? Or is that something I can simply pass the examples as context for each time I want to generate a new one?

Thanks for any advice or guidance….

stark shale
# crystal oak If I went to generate paragraphs of text, using several example paragraphs as a ...

Great question! That's known as few-shot prompting, or in-context learning. It's best done in the default mode of the client and I can help you walk through it.

https://en.wikipedia.org/wiki/In-context_learning_(natural_language_processing)

It could be done in theory through training something, but I wouldn't bother. I don't think it'll lead to superior results, either. This is the right approach for your use case. I think you won't even need 20 examples.

In-context learning (natural language processing)

In natural language processing, in-context learning, few-shot learning or few-shot prompting is a prompting technique that allows a model to process examples before attempting a task. The method was popularized after the advent of GPT-3 and is considered to be an emergent property of large language models.A few-shot prompt normally includes n ex...

#

I'll do a quick example for you using horoscopes.

#

I borrowed the New York Post's horoscopes for today. My prompt is:

Aquarius: You could find yourself attracted today to someone who over the next few months brings a great deal of love and laughter into your life. There may be a lot of dark things going on in the world but on a personal level the future is bright.

Pisces: There can be no more false starts and no more half-hearted moves – you have got to get serious about what you are doing in the world. Use your talent for bringing people together to give a boost to a cause or movement that is close to your heart.

Aries: You may want to let someone know that you are less than pleased with their efforts but is that such a good idea? The planets warn they won’t take kindly to criticism and could try to derail your plans. Maybe it’s time to get a new partner.

Taurus:

#

And this is the result.

image.png
crystal oak