• Resolved googleman23

    (@googleman23)


    I have two pages with the chat AI. One is limited to 50 tokens and the other is 2000 tokens. What I have noticed is on the 50 token page a user can keep typing continue and they can keep getting feedback from the bot 50 tokens at a time. Is there any way to restrict it so when I user has used 200 tokens they can’t ask anymore questions without accessing the page with the 2000 tokens?

Viewing 4 replies - 1 through 4 (of 4 total)
  • Plugin Author Jordy Meow

    (@tigroumeow)

    Hi,

    Do you mean that you set the max_tokens parameter? If yes, that’s not the way to do it ?? This max_tokens parameter is the maximum number of tokens the AI model is authorized to generate (actually, the number of tokens you send through the prompt is also counted). So yeah, as the discussion goes, it might be way above that.

    That said, to remember the discussion, the entire discussion needs to be sent (same with ChatGPT actually, it does that too). The AI itself just takes one input (the prompt) and gives one output. So every time the user sends a new question in the same discussion, the previous questions/answers are also sent, and are counted as part of this max_tokens parameter.

    I think you needed to know what that parameter really is, as it’s an important concept.

    Now, for your limitations, it’s a bit trickier, and you can’t do it this way. The way to do it is explained here: https://meowapps.com/ai-engine/tutorial/#usage-control

    I’ll make more examples based on the use cases of my users. Don’t hesitate to share yours, and why you would like to have a different page for the chatbot. Is that page behind a paywall? Even though there is a paywall, what happens after, when the tokens are consumed again? Let me know your use cases, I’ll try to provide an example ??

    Thread Starter googleman23

    (@googleman23)

    Once a person gets past the pay wall and let’s say they pay for 10,000 tokens a month. I want to make it for those users who paid for those tokens to get a warning when they are near 10,000 tokens (like 5,000). When they get to 10,000 tokens disable the use until the upgrade and or the next month arrives. I read your wiki about the usage control, but it doesn’t explain how to use it and where it goes. If you could explain this better.

    Plugin Author Jordy Meow

    (@tigroumeow)

    My plan is actually to try to find good solutions and use cases based on what you are using. To allow customers to join, what do you use? WooCommerce? EDD? Some type of membership plugin?

    Thread Starter googleman23

    (@googleman23)

    I use LifterLMS for courses and the plugin I use is Members by Memberpress.

Viewing 4 replies - 1 through 4 (of 4 total)
  • The topic ‘Limit questions’ is closed to new replies.