How to use sliding window for question generation? | Learn AI Together | Page 1

slender wolf May 3, 2023, 9:52 AM

#

Hi there,

I want to finetune a model (pytorch/transformers) for question generation tasks. However, I want to train it on longer contexts. How can I do this? I read online that sliding windows could be used for use cases similar to this one, but I can't seem to find an example online for question generation.

Question answering can be found, but differs from question generation, since for question generation the model needs to 'understand' the whole text before creating the question while for question answering, it can look per 'chunk' if it can answer the question.

slender wolf May 4, 2023, 2:16 PM

#

Hopefully someone could give me some advice on this. Thanks in advance.

warm copper May 4, 2023, 3:21 PM

#

Actually I'm not able to understand the purpose of generating questions. Could you give an example?

#How to use sliding window for question generation?