iBoss/bolt-diy
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

Merge pull request #12 from fernsdavid25/patch-1

Browse Source 
Fix for llama 3.1 models
This commit is contained in:
Cole Medin
2024-10-24 07:19:25 -05:00
committed by GitHub
parent 62e5091d1b f7615093dd
commit 69aceeaad4
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
app/lib/.server/llm/constants.ts
View File

@@ -1,5 +1,5 @@
// see https://docs.anthropic.com/en/docs/about-claude/models // see https://docs.anthropic.com/en/docs/about-claude/models
export const MAX_TOKENS = 8192; export const MAX_TOKENS = 8000;
// limits the number of model responses that can be returned in a single request // limits the number of model responses that can be returned in a single request
export const MAX_RESPONSE_SEGMENTS = 2; export const MAX_RESPONSE_SEGMENTS = 2;