FriendliAI Playground max token

#8
by dolljong2 - opened

Thank you for providing the opportunity to test for free on FriendliAI.
However, I seem to be encountering an issue where generation stops at 2,000 tokens in the Playground.
Even after adjusting the token limit, the generation still cuts off exactly at 2,000 tokens.

@dolljong2

Thank you very much for your inquiry, and for giving FriendliAI a try.

Regarding the behavior you’re experiencing in the Playground: on the tier 0, generation is limited to 2,000 tokens. As a result, even if the token limit is increased in the settings, the output will stop once this tier limit is reached, which is why it consistently ends at 2,000 tokens.

To enable longer token lengths and higher usage limits, you'll need to register a payment method, which will upgrade your usage tier accordingly. For your reference, detailed information on usage tiers and token limits is available here:
https://friendli.ai/docs/guides/serverless_endpoints/pricing#usage-tiers

Please don’t hesitate to let us know if you have any questions or need any assistance. We're always happy to help.

Sign up or log in to comment