What are the recommended parameters to work with Firefox's built-in AI commands?

[TFWol]

Since the implementation of Firefox's built-in AI sort of sucks, I tried pointing it at koboldcpp instead of Mozilla's lamafile format.
Doing that fails to send any text when using Firefox's commands, like Summarize.

What parameters should I run koboldcpp with for it to be compatible?

[jabberjabberjabber]

It is sending the text via url ("?q=text") so it isn't going to work with Koboldcpp.

[LostRuins]

Right now query is hardcoded. It's annoying that firefox only uses q... are you sure that cannot be changed in firefox?

I'm worried that if I add q to koboldcpp as well, it would conflict with other browsers that may use q for something else.

[TFWol]

It's annoying that firefox only uses q... are you sure that cannot be changed in firefox?

Nothing that I could easily find, even when I started going through the source code here and here.
The only mention of the parameter for AI operations is at this line where it mentions a request header, but it's very confusing.

I'm worried that if I add q to koboldcpp as well, it would conflict with other browsers that may use q for something else.

I was thinking you could add like a commandline option or something that lets you type the desired parameter to use.

[TFWol]

I tried a hacky workaround via userscript that automatically replaces the query parameter, but the only way to get it functional is enabling Autosave Session.
This makes it keep prompting me with an annoying You already have an existing persistent story. Do you want to overwrite it? (can I turn this prompt off?) which I will need to also automate "clicking"

If Autosave Session is not on and the userscript runs, it just doesn't work and errors out with:
Error while submitting prompt: TypeError: NetworkError when attempting to fetch resource.

[LostRuins]

okay i'll add q as an alias for query

[LostRuins]

Now available in the latest release!

[TFWol]

Thanks! I've been testing it out.
The core part works so it loads the right url with parameters.

The only issue I see is if I turn off Autosave session.
It will break and always give the error

Error Encountered
Error while submitting prompt: TypeError: NetworkError when attempting to fetch resource.

Looking at the web traffic, it looks like it tries to connect to aihorde.net, which it should not be because I have that disabled and blocked.

This connection attempt does not occur if Autosave session is enabled.

[LostRuins]

Should be fixed, please update.

[TFWol]

That got rid of the external traffic attempts and error encountered message, but the other issues are pretty much the same; if Autosave session is checked, it still works, but then it'll ask me You already have an existing persistent story. Do you want to overwrite it? popup every time I want to summarize text.

If unchecked, there is no indication of anything happening except in the command prompt window and firefox's dev console. Before it would at least have the submitted text to process.

I was able to reproduce the problem on a couple of test machines. No idea about this one. Odd firefox glitch maybe?

Since enabling Autosave at least makes it function, I might just keep it on.
If that's the case, could you please include an option to disable this message so I'm not spammed?:

I'd be content with that 😃

[TFWol]

Maybe another localsettings to compare on line 5138?:

koboldcpp/klite.embd

Lines 5138 to 5144 in 5f8f483

	if (localsettings.persist_session && !safe_to_overwrite()) {
	msgboxYesNo("You already have an existing persistent story. Do you want to overwrite it?","Overwrite Story Warning",()=>{
	localsettings.opmode = 4;
	restart_new_game(false);
	document.getElementById("input_text").value = foundQuery;
	submit_generation();
	},null,false);