• Resolved benjiswart

    (@benjiswart)


    Hey Jordy,

    Quick question about the content aware option as far as prompt size. Does content aware basically just add the page content to the prompt?

    Just wondering so I use it sparingly on super long content types or else the prompt size will be massive each interaction.

    Keep up the awesome work!

Viewing 2 replies - 1 through 2 (of 2 total)
  • I had to turn this off on our use case, because after we fine-tuned it seemed using content aware was putting more of an emphasis on that vs what we specifically trained it for since the {Content} was in context. But I’m sure that’s case by case, although I’d love to know the weights on each.

    Thread Starter benjiswart

    (@benjiswart)

    Great observation. How are you finding the fine-tuned model?

    My use case is basically just a digital health assistant that offers expanded knowledge on health articles. I’ve been able to get surprisingly great results with just dynamically adding the title and excerpt of the post (along with a custom field for additional context like related products or services) into the context. Keeps the prompt small and the bot still replies with it’s focussed scope of knowledge.

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘How is ‘Content Aware’ context added.’ is closed to new replies.