Skip to content

Fix model map staleness behavior or fallback #3971

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
timothycarambat merged 4 commits into from
Jun 7, 2025
+47 −14
Merged

Fix model map staleness behavior or fallback #3971

Changes from 1 commit
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
34306e7
Fix model map staleness behavior or fallback
timothycarambat Jun 7, 2025
0c9fc40
patch url
timothycarambat Jun 7, 2025
5c2baab
fix log
timothycarambat Jun 7, 2025
14d427d
dev build
timothycarambat Jun 7, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
fix log
  • Loading branch information
@timothycarambat
timothycarambat committed Jun 7, 2025
commit 5c2baab675f73f6e645bfb1279ea7e3b6eb45b36
19 changes: 9 additions & 10 deletions server/utils/AiProviders/modelMap/index.js
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -37,6 +37,8 @@ class ContextWindowFinder {
ContextWindowFinder.instance = this;
if (!fs.existsSync(this.cacheLocation))
fs.mkdirSync(this.cacheLocation, { recursive: true });

// If the cache is stale or not found at all, pull the model map from remote
if (this.isCacheStale || !fs.existsSync(this.cacheFilePath))
this.#pullRemoteModelMap();
}
Expand Down Expand Up @@ -64,16 +66,13 @@ class ContextWindowFinder {
*/
get cachedModelMap() {
if (!fs.existsSync(this.cacheFilePath)) {
this.log("--------------------------------");
this.log("[WARNING] Model map cache is not found!");
this.log(
"Invalid context windows will be returned leading to inaccurate model responses"
);
this.log("or smaller context windows than expected.");
this.log(
"You can fix this by restarting AnythingLLM so the model map is re-pulled."
);
this.log("--------------------------------");
this.log(`\x1b[33m
--------------------------------
[WARNING] Model map cache is not found!
Invalid context windows will be returned leading to inaccurate model responses
or smaller context windows than expected.
You can fix this by restarting AnythingLLM so the model map is re-pulled.
--------------------------------\x1b[0m`);
return null;
}

Expand Down