Get Around OpenAI GPT-3 Token Limits?

Thanks for the great plugin. Really amazing. I’m trying to use the dataset builder to generate records. I am still testing the “single generate” function. I have found that I am not getting a response for some posts. Then I tried the ‘run bulk generate’ function. I got the error message about token limits. Perhaps the non-responsive generation is also caused by the token limits? Are some posts just too long? Is it possible to automatically split the posts into sections and do the generation to get around the OpenAI token limits or some other method?

• This topic was modified 1 year, 8 months ago by drrichde.