Skip to content

Commit eba3aba

Browse files
sestinj5eqnpixelsortrjustinmilner1Justin Milner
authored
Preview (#1393)
* Nate/autocomplete-metrics (#1230) * ⚡️ use context.selectedCompletionInfo, deduplicate logs * ⚡️ don't reject if user keeps typing same as completion * ⚡️ vscode autocomplete edge cases * 🚧 WIP on vscode autocomplete * ⚡️ better bracket handlng * ⚡️ improved multi-line detection * Active file default context (#1231) * 🚸 include currently active file by default * 🚸 warn if non-autocomplete model being used * ✨ try hole filling template for gpt * 💄 ui for no context * ⚡️ leave out bottom of excessively large files * 🎨 finish listDir * 🚧 gui fixes * 🏷️ update IMessenger.on return type * 🐛 fix jetbrains types + IDE detection * 🧑‍💻 set up debugging for binary with TcpMessenger * 👷 fix prepackage.js * 🧑‍💻 turn off debug mode for intellij * 🐛 merge fixes * 🐛 fixes after refactor * 🚧 experimenting with perplexity style streaming * 🐛 fix #1237 * 💚 fix type error * ⚡️ improve LSP usage in autocomplete * 🐛 fix content parsing regression in /edit * add PySide6 docs to preindexed docs (#1236) * CON-232 bring custom docs to top, alphabetize doc results, make scrol… (#1239) * CON-232 bring custom docs to top, alphabetize doc results, make scrollable * CON-232 cleanup --------- Co-authored-by: Justin Milner <[email protected]> * CON-1067 condense some things * 🚚 [Auxiliary -> Continue] Sidebar * 🔊 log completion options in ~/.continue/sessions * CON-1067 wrong ret val fix * CON-1067: fixes from testing * ⚡️ filter out completions that are only punctuation/space * ⚡️ inject intellisense docs, no multi-line on comments * ⚡️ crawl type definitions for autocomplete * ⚡️ truncate function text * ⚡️ cache LSP calls * ⚡️ find recently edited ranges with perfect prefix match * 🐛 fix gif paths * ⚡️ bring back double new line stop words * 📌 add yarn lock files * 🐛 allow language keywords to be generated * 💄 toggle on help button * 🎨 defaultContext option * 🐛 fix lancedb bug by upgrading * 🐛 fix groq stop tokens * 🐛 preventDefault to avoid double paste * 🚸 don't repeatedly override cmd+J * 🧑‍💻 fix npm run test in core * 📝 change description * 🐛 silence Ollama invalid server state warning * ⚡️ more accurate getTerminalContents * ⚡️ make getTerminalContents more accurate * 🧑‍💻 use yarn instead of npm * 👷 fix yarn add --no-save in prepackge * 🐛 correctly read entire notebook file contents * ➕ import handlebars * 🔥 remove unnecessary migrations * ⚡️ improve /comment prompt * Add debug terminal context menu (#1261) * Add --no-dependencies to vsce package (#1255) This is not needed because we bundle first with esbuild, and vsce pack has issues with modern package managers. see: microsoft/vscode-vsce#421 (comment) * ui: change line decoration color to use vscode theme (#1253) * ui: change line decoration color to use vscode theme to give user a more consistent experience by letting the decoration color to user the color defined in the theme. * fix: incorrect color item should be line background not text background because the decoration is for the whole line * 🎨 refactor indexing state into a single object * CON-223 Correct diff streaming abort (#1263) Co-authored-by: Justin Milner <[email protected]> * 📦 switch to pnpm (#1265) * 🎨 use pnpm instead of yarn * ➕ make dependencies explicit for pnpm * 🐛 add powershell to extension mapping, and default to ext * Add stream support for Bedrock Anthropic * 🎨 make llamatokenizer commonjs compatible * ➕ add esbuild optional deps * 🚚 rename vendor/node_modules -> modules * 🔖 update core version * 🐛 fixes for transformers.js compatibility * 🔖 update core version * 🎨 set modelPath in constructor * 🎨 fix transformers.js import * 🎨 eslint enforce import extensions * 🎨 require -> import * 🚸 notify user if not diff in /commit * 💄 Improve colors of the IntelliJ tool window icon (#1273) Without this fix, the continue icon sticks out from the other toolwindow icons, resulting in an inconsistent appearance of the whole IDE and creates a feeling that the continue plugin "doesn't fit, something must be broken". According to https://plugins.jetbrains.com/docs/intellij/icons.html#new-ui-icon-colors specific colors are needed to work nicely with dark and light modes. Bonus is that the active tool window icon color then changes automatically to white. Co-authored-by: Lukas Baron <[email protected]> * ✨ send Bearer token to Ollama if apiKey set * 🐛 fix slash command bug * 🧑‍💻 add onnxruntime (--save-dev) for types * 🐛 don't apply to file when running code block in terminal * 🐛 avoid double paste * ✨ gpt-4o * 🎨 pass uniqueId to constructor * 🚸 focus without scrolling into vie * 🎨 refactoring for continue-proxy LLM (#1277) * 🐛 continue server client fixes * 🎨 refactor OpenAI _getHeaders * 🎨 pass ideSettings to llmFromDescription * ⚡️ improve add docstring command * 💚 ci updates * 🐛 merge fixes * 💄 increase font size in JB * 🐛 fix repeated paste bug * 🐛 fix build script * 🩹 various small improvements * 📌 pin esbuild 0.17.19 * 🧑‍💻 pnpm i gui in prepackage * 🐛 show all diff changes in vscode * 🩹 getMetaKeyName * 🐛 fix reading of unopened ipynb files * ⚡️ gpt-4o system prompt * 💄 make font size configurable in config.json ui.fontSize * 🩹 properly dispose of diff handler * 🐛 fix indexing status display * ⚡️ context pruning * 🎨 update free trial models * fix: remove some backup files generated by pkg if present (#1287) * adjust toCopy (#1305) Co-authored-by: Justin Milner <[email protected]> * Nate/prompt-file (#1308) * ✨ .prompt files * 🧑‍💻 back to npm : ( * 🎨 nicer dropdown icon * 🎨 full switch back to npm * 🧑‍💻 uninstall script for fresh start * 🎨 updated package-locks * 🔥 remove hello from continuerc.json * 🔥 remove example files * 🎨 update test prompt * 🎨 update prompt * 🎨 update test prompt * 👷 create out/node_modules in prepackage.js * Log prompt-tokens to devdb and show in 'My Usage' view (#1309) * Also log the number of prompt tokens to the dev-db * Show prompt tokens in 'My Usage' view * 🔥 remove console logs * add lm studio tab-autocomplete walkthrough (#1298) * 📝 update autocomplete LM Studio docs * 💚 fix prepackage.js * ⬆️ upgrade lancedb version * 🚸 make it easier to continue past trial * 🚸 improve model setup process * 📌 update package-lock.jsons * 🔀 merge changes * 🩹 small fixes * 🐛 fix jetbrains build * 🩹 more jetbrains fixes * 🎨 jetbrains improvements * 🐛 fix lancedb prob in jetbrains build * 👷 update jetbrains build process * ✨ intellij problems context provider * 👷 add script utils file * 💚 fix jetbrains build regression * 🎨 dynamic import transformers.js * 🩹 small jetbrains updates * ✨ folder context provider in jetbrains * 🎨 many more jetbrains improvements * 🐛 fix prompt file loading bug * docs: add setup guide for OpenRouter (#1284) * Update preIndexedDocs.ts (#1292) Add Bootstrap and Alpine.js as pre indexed docs. * add toString (#1324) * add toString * Fix indentation --------- Co-authored-by: Justin Milner <[email protected]> * don't overwrite all models in onboarding * 🔧 override headers with custom headers * ✨ allow overwriting slash command description * feature flag (#1327) * ➕ feature flags dependency * 🎨 make getHeaders awaitable * 🔒️ token count for abuse monitoring * 👷 remove win32-arm64 target * Update build.js (#1330) Fix error: EBUSY: resource busy or locked, rmdir '...\continue\binary\tmp\continue-node_modules-lancedb' * 📌 pin onnxruntime version to match transformers.js * 🎨 transformers cleanup, extensionVersion header * 🔥 remove lingering pnpm * 🎨 update default models * 🎨 update defaults * 👷 fix version in build post-check * 🎨 test.js in dev * 🧑‍💻 cleaning * Add Gemini 1.5 Flash as a model (#1337) * 🎨 log dev data for tokens generated * Expose custom context provider registration through a vscode extension api. (#1288) * 🔀 merge fixes * ⚡️ small improvements * 🎨 tell users transformers.js not supported * 🎨 trial updates * 📝 update jetbrains readmej * ⚡️ Use gptEditPrompt for Mistral * ✨ Codestral FIM * 🔖 update gradle version * Fix typo "Experimantal" (#1353) * 🎨 Refactor core (#1281) * 🎨 refactor out react context * 🎨 refactor local storage * 🎨 refactor IdeMessenger * 🔥 removing unused files * 🚚 move scripts * ✅ setup VSCode integration testing * 🎨 fix test-related stuff * 🚧 testing * 🎨 tweak terminal cmd+L * 🧑‍💻 install biome in core * 🎨 run biome check on core * 🎨 run biome check in vscode * 🎨 run biome check in binary * 🧑‍💻 global biome config * 🎨 run biome check on core * 🎨 run biome check in vscode * 🎨 fix a few biome warnings * 🚧 WIP on protocols * 🚧 progress, organizing, about to remove webviewCore protocol * 🚧 now running * 🚧 move indexing code to core * 🚧 WIP on JetBrains indexing implementation * 🎨 finish listDir * 🚧 gui fixes * 🏷️ update IMessenger.on return type * 🐛 fix jetbrains types + IDE detection * 🧑‍💻 set up debugging for binary with TcpMessenger * 👷 fix prepackage.js * 🧑‍💻 turn off debug mode for intellij * 🐛 merge fixes * 🐛 fixes after refactor * 🐛 merge fixes * 💄 increase font size in JB * 🔀 merge changes * 🩹 small fixes * 🐛 fix jetbrains build * 🩹 more jetbrains fixes * 🎨 jetbrains improvements * 🐛 fix lancedb prob in jetbrains build * 👷 update jetbrains build process * ✨ intellij problems context provider * 👷 add script utils file * 💚 fix jetbrains build regression * 🎨 dynamic import transformers.js * 🩹 small jetbrains updates * ✨ folder context provider in jetbrains * 🎨 many more jetbrains improvements * 🔀 merge fixes * ⚡️ small improvements * 🎨 tell users transformers.js not supported * 🎨 trial updates * 📝 update jetbrains readmej * ⚡️ only use smaller context for local autocomplete models * ⚡️ improve bracket filter * ✨ global .continue/.prompts folder * 💄 improved model setup process * 🥅 display VSCode req errs * ⚡️ improved autocomplete stopping * 🎨 count cmd+I * 🔥 remove duplicate import * 🔥 remove unnecessary headers * ⚡️ limit input history length * ⚡️ limit submenu items until you can use disk-based search, to avoid high memory use * 🔥 remove duplicate function def * Free Trial Auth (#1367) * 🎨 pass gh auth token to free trial * 💄 improved onboarding flow * 🎨 make fewer auth reqs * 🎨 refactor ordering of vscode deps * 🐛 resolve confighandler * ⚡️ autocomplete stopping improvements * 🔥 remove unused auth code * ⚡️ consider previous completion in bracket matching * Build fixes: Remove duplicated code, re-add overwritten commit (#1358) * readd overwritten commit * Remove duplicated code * 📝 update keywords * ✨ /commit slash command * 🎨 make transformers.js esm compatible * ⚡️ fix jetbrains indexing perfomance issue * 💄 autocomplete model onboarding * ✨ mistral free trial autocomplete * ✨ mistral description * 🩹 comment out fireworks.png * 🎨 trial fim model * 🎨 get gh token for autocomplete model trial * ✨ gh auth token jb * 🔧 update config files * 🎨 jetbrains onboarding * 🧑‍💻 create gui/dist if it doesn't exist * Fix sidebar indexing status timing-related bugs (#1368) * readd overwritten commit * Remove duplicated code * Fix status load in and failed state update * Late sidebar open bugs fixed * Change ideMessenger post parameters * debug pause * Don't use global, fix table creation bug * Creating new branch for config-related issues here * cleanup * 🚸 help user avoid login prompt if unwanted * 🚸 update onboarding flow * 📝 codestral as recommended in docs * feat: Add cloudflare as provider * 📝 set up codestral walkthrough * codestral api base * update codestral api link * codestral api link * bearer token * 🐛 fix config loading * cleaner error message * fix codestral templating * 🔥 remove unused kotlin test * 🧑‍💻 ./gradlew build * codestral fim template --------- Co-authored-by: 5eqn <[email protected]> Co-authored-by: Pixel <[email protected]> Co-authored-by: Justin Milner <[email protected]> Co-authored-by: Justin Milner <[email protected]> Co-authored-by: Devin Gould <[email protected]> Co-authored-by: Dipta Mahardhika <[email protected]> Co-authored-by: Ruben Kostandyan <[email protected]> Co-authored-by: tnglemongrass <[email protected]> Co-authored-by: Lukas Baron <[email protected]> Co-authored-by: Fernando <[email protected]> Co-authored-by: Tijs Zwinkels <[email protected]> Co-authored-by: DJ Johnson <[email protected]> Co-authored-by: sam <[email protected]> Co-authored-by: Jose Vega <[email protected]> Co-authored-by: Pratik Parmar <[email protected]> Co-authored-by: Sam El-Husseini <[email protected]> Co-authored-by: Peter Zaback <[email protected]> Co-authored-by: James Delorey <[email protected]>
1 parent 0746bbc commit eba3aba

File tree

15 files changed

+498
-381
lines changed

15 files changed

+498
-381
lines changed

‎CONTRIBUTING.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -97,7 +97,7 @@ Pre-requisite: You should use the Intellij IDE, which can be downloaded [here](h
9797
2. Run `scripts/install-dependencies.sh` or `scripts/install-dependencies.ps1` on Windows. This will install and build all of the necessary dependencies.
9898
3. To test the plugin, select the "Run Plugin" Gradle configuration and click the "Run" or "Debug" button as shown in this screenshot:
9999
![img](./media/IntelliJRunPluginScreenshot.png)
100-
4. To package the extension, choose the "Build Plugin" Gradle configuration. This will generate a .zip file in `extensions/intellij/build/distributions` with the version defined in `extensions/intellij/gradle.properties`.
100+
4. To package the extension, run `./gradlew build` (or `./gradlew.bat build` on Windows) from the `extensions/intellij` directory. This will generate a .zip file in `extensions/intellij/build/distributions` with the version defined in `extensions/intellij/gradle.properties`.
101101
5. If you make changes, you may need to re-build before running the "Build Plugin" configuration
102102

103103
a. If you change code from the `core` or `binary` directories, make sure to run `npm run build` from the `binary` directory to create a new binary.

‎core/autocomplete/templates.ts‎

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -24,6 +24,13 @@ const stableCodeFimTemplate: AutocompleteTemplate = {
2424
},
2525
};
2626

27+
const codestralFimTemplate: AutocompleteTemplate = {
28+
template: "<s>[SUFFIX]{{{suffix}}}[PREFIX]{{{prefix}}}",
29+
completionOptions: {
30+
stop: ["[PREFIX]", "[SUFFIX]"],
31+
},
32+
};
33+
2734
const codegemmaFimTemplate: AutocompleteTemplate = {
2835
template:
2936
"<|fim_prefix|>{{{prefix}}}<|fim_suffix|>{{{suffix}}}<|fim_middle|>",
@@ -227,6 +234,10 @@ export function getTemplateForModel(model: string): AutocompleteTemplate {
227234
return stableCodeFimTemplate;
228235
}
229236

237+
if (lowerCaseModel.includes("codestral")) {
238+
return codestralFimTemplate;
239+
}
240+
230241
if (lowerCaseModel.includes("codegemma")) {
231242
return codegemmaFimTemplate;
232243
}

‎core/index.d.ts‎

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -304,6 +304,9 @@ export interface LLMOptions {
304304

305305
useLegacyCompletionsEndpoint?: boolean;
306306

307+
// Cloudflare options
308+
accountId?: string;
309+
307310
// Azure options
308311
engine?: string;
309312
apiVersion?: string;
@@ -539,7 +542,8 @@ type ModelProvider =
539542
| "groq"
540543
| "continue-proxy"
541544
| "fireworks"
542-
| "custom";
545+
| "custom"
546+
| "cloudflare";
543547

544548
export type ModelName =
545549
| "AUTODETECT"

‎core/llm/index.ts‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -99,6 +99,7 @@ export abstract class BaseLLM implements ILLM {
9999
apiType?: string;
100100
region?: string;
101101
projectId?: string;
102+
accountId?: string;
102103

103104
private _llmOptions: LLMOptions;
104105

@@ -150,6 +151,7 @@ export abstract class BaseLLM implements ILLM {
150151
if (this.apiBase && !this.apiBase.endsWith("/")) {
151152
this.apiBase = `${this.apiBase}/`;
152153
}
154+
this.accountId = options.accountId;
153155

154156
this.engine = options.engine;
155157
this.apiVersion = options.apiVersion;

‎core/llm/llms/Cloudflare.ts‎

Lines changed: 62 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,62 @@
1+
import { BaseLLM } from "../index.js";
2+
import { ChatMessage, CompletionOptions, ModelProvider } from "../../index.js";
3+
import { stripImages } from "../countTokens.js";
4+
import { streamSse } from "../stream.js";
5+
6+
export default class Cloudflare extends BaseLLM {
7+
static providerName: ModelProvider = "cloudflare";
8+
9+
private _convertArgs(options: CompletionOptions) {
10+
const finalOptions = {
11+
max_tokens: options.maxTokens,
12+
};
13+
14+
return finalOptions;
15+
}
16+
17+
protected async *_streamChat(
18+
messages: ChatMessage[],
19+
options: CompletionOptions,
20+
): AsyncGenerator<ChatMessage, any, unknown> {
21+
const headers = {
22+
"Content-Type": "application/json",
23+
Authorization: `Bearer ${this.apiKey}`,
24+
...this.requestOptions?.headers,
25+
};
26+
27+
const resp = await this.fetch(
28+
new URL(
29+
`https://api.cloudflare.com/client/v4/accounts/${this.accountId}/ai/v1/chat/completions`,
30+
),
31+
{
32+
method: "POST",
33+
headers,
34+
body: JSON.stringify({
35+
messages,
36+
stream: true,
37+
model: this.model,
38+
...this._convertArgs(options),
39+
}),
40+
},
41+
);
42+
43+
for await (const value of streamSse(resp)) {
44+
console.log(value);
45+
if (value.choices?.[0]?.delta?.content) {
46+
yield value.choices[0].delta;
47+
}
48+
}
49+
}
50+
51+
protected async *_streamComplete(
52+
prompt: string,
53+
options: CompletionOptions,
54+
): AsyncGenerator<string> {
55+
for await (const chunk of this._streamChat(
56+
[{ role: "user", content: prompt }],
57+
options,
58+
)) {
59+
yield stripImages(chunk.content);
60+
}
61+
}
62+
}

‎core/llm/llms/index.ts‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -29,6 +29,7 @@ import Replicate from "./Replicate.js";
2929
import TextGenWebUI from "./TextGenWebUI.js";
3030
import Together from "./Together.js";
3131
import ContinueProxy from "./stubs/ContinueProxy.js";
32+
import Cloudflare from "./Cloudflare";
3233

3334
function convertToLetter(num: number): string {
3435
let result = "";
@@ -99,6 +100,7 @@ const LLMs = [
99100
Groq,
100101
Fireworks,
101102
ContinueProxy,
103+
Cloudflare,
102104
];
103105

104106
export async function llmFromDescription(

‎docs/docs/reference/Model Providers/cloudflare.md‎

Lines changed: 46 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,46 @@
1+
# Cloudflare Workers AI
2+
3+
Cloudflare Workers AI can be used for both chat and tab autocompletion in Continue. To setup Cloudflare Workers AI, add the following to your `config.json` file:
4+
5+
```json title="~/.continue/config.json"
6+
{
7+
"models": [
8+
{
9+
"accountId": "YOUR CLOUDFLARE ACCOUNT ID",
10+
"apiKey": "YOUR CLOUDFLARE API KEY",
11+
"contextLength": 2400,
12+
"completionOptions": {
13+
"maxTokens": 500
14+
},
15+
"model": "@cf/meta/llama-3-8b-instruct", // This can be the name of any model supported by Workers AI
16+
"provider": "cloudflare",
17+
"title": "Llama 3 8B"
18+
},
19+
{
20+
"accountId": "YOUR CLOUDFLARE ACCOUNT ID",
21+
"apiKey": "YOUR CLOUDFLARE API KEY",
22+
"contextLength": 2400,
23+
"completionOptions": {
24+
"maxTokens": 500
25+
},
26+
"model": "@hf/thebloke/deepseek-coder-6.7b-instruct-awq",
27+
"provider": "cloudflare",
28+
"title": "DeepSeek Coder 6.7b Instruct"
29+
}
30+
...
31+
"tabAutocompleteModel": {
32+
"accountId": "YOUR CLOUDFLARE ACCOUNT ID",
33+
"apiKey": "YOUR CLOUDFLARE API KEY",
34+
"model": "@hf/thebloke/deepseek-coder-6.7b-base-awq",
35+
"provider": "cloudflare",
36+
"title": "DeepSeek 7b"
37+
},
38+
]
39+
}
40+
```
41+
42+
Visit the [Cloudflare dashboard](https://dash.cloudflare.com/) to [create an API key](https://developers.cloudflare.com/fundamentals/api/get-started/create-token/).
43+
44+
Review [available models](https://developers.cloudflare.com/workers-ai/models/) on Workers AI
45+
46+
[View the source](https://github.com/continuedev/continue/blob/main/core/llm/llms/Cloudflare.ts)

‎docs/docs/walkthroughs/set-up-codestral.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -14,7 +14,7 @@ keywords: [codestral, mistral, model setup]
1414

1515
2. Click on the gear icon in the bottom right corner of the Continue window to open `~/.continue/config.json` (MacOS) / `%userprofile%\.continue\config.json` (Windows)
1616

17-
3. Log in and create an API key on Mistral AI's La Plateforme [here](https://console.mistral.ai/codestral)
17+
3. Log in and create an API key on Mistral AI's La Plateforme [here](https://console.mistral.ai/codestral). Make sure you get an API key from the "Codestral" page, as an API key for the normal "api.mistral.ai" API will not work.
1818

1919
4. To use Codestral as your model for both `autocomplete` and `chat`, replace `[API_KEY]` with your Mistral API key below and add it to your `config.json` file:
2020

‎docs/static/schemas/config.json‎

Lines changed: 64 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -150,7 +150,8 @@
150150
"flowise",
151151
"groq",
152152
"fireworks",
153-
"continue-proxy"
153+
"continue-proxy",
154+
"cloudflare"
154155
],
155156
"markdownEnumDescriptions": [
156157
"### OpenAI\nUse gpt-4, gpt-3.5-turbo, or any other OpenAI model. See [here](https://openai.com/product#made-for-developers) to obtain an API key.\n\n> [Reference](https://docs.continue.dev/reference/Model%20Providers/openai)",
@@ -169,7 +170,8 @@
169170
"### Llamafile\nTo get started with llamafiles, find and download a binary on their [GitHub repo](https://github.com/Mozilla-Ocho/llamafile#binary-instructions). Then run it with the following command:\n\n```shell\nchmod +x ./llamafile\n./llamafile\n```\n> [Reference](https://docs.continue.dev/reference/Model%20Providers/llamafile)",
170171
"### Mistral API\n\nTo get access to the Mistral API, obtain your API key from the [Mistral platform](https://docs.mistral.ai/)",
171172
"### DeepInfra\n\n> [Reference](https://docs.continue.dev/reference/Model%20Providers/deepinfra)",
172-
"### Continue Proxy\n\nContinue Enterprise users can use the Continue Proxy as a single point of access to models."
173+
"### Continue Proxy\n\nContinue Enterprise users can use the Continue Proxy as a single point of access to models.",
174+
"### Cloudflare Workers AI\n\n[Reference](https://developers.cloudflare.com/workers-ai/)"
173175
],
174176
"type": "string"
175177
},
@@ -313,7 +315,8 @@
313315
"gemini",
314316
"huggingface-inference-api",
315317
"replicate",
316-
"together"
318+
"together",
319+
"cloudflare"
317320
]
318321
}
319322
},
@@ -359,6 +362,64 @@
359362
}
360363
}
361364
},
365+
{
366+
"if": {
367+
"properties": {
368+
"provider": {
369+
"enum": ["cloudflare"]
370+
}
371+
},
372+
"required": ["provider"]
373+
},
374+
"then": {
375+
"properties": {
376+
"accountId": {
377+
"type": "string"
378+
},
379+
"model": {
380+
"anyOf": [
381+
{
382+
"enum": [
383+
"@cf/meta/llama-3-8b-instruct",
384+
"@hf/thebloke/deepseek-coder-6.7b-instruct-awq",
385+
"@cf/deepseek-ai/deepseek-math-7b-instruct",
386+
"@cf/thebloke/discolm-german-7b-v1-awq",
387+
"@cf/tiiuae/falcon-7b-instruct",
388+
"@cf/google/gemma-2b-it-lora",
389+
"@hf/google/gemma-7b-it",
390+
"@cf/google/gemma-7b-it-lora",
391+
"@hf/nousresearch/hermes-2-pro-mistral-7b",
392+
"@cf/meta/llama-2-7b-chat-fp16",
393+
"@cf/meta/llama-2-7b-chat-int8",
394+
"@cf/meta-llama/llama-2-7b-chat-hf-lora",
395+
"@hf/thebloke/llama-2-13b-chat-awq",
396+
"@hf/thebloke/llamaguard-7b-awq",
397+
"@cf/mistral/mistral-7b-instruct-v0.1",
398+
"@hf/mistral/mistral-7b-instruct-v0.2",
399+
"@cf/mistral/mistral-7b-instruct-v0.2-lora",
400+
"@hf/thebloke/neural-chat-7b-v3-1-awq",
401+
"@cf/openchat/openchat-3.5-0106",
402+
"@hf/thebloke/openhermes-2.5-mistral-7b-awq",
403+
"@cf/microsoft/phi-2",
404+
"@cf/qwen/qwen1.5-0.5b-chat",
405+
"@cf/qwen/qwen1.5-1.8b-chat",
406+
"@cf/qwen/qwen1.5-7b-chat-awq",
407+
"@cf/qwen/qwen1.5-14b-chat-awq",
408+
"@cf/defog/sqlcoder-7b-2",
409+
"@hf/nexusflow/starling-lm-7b-beta",
410+
"@cf/tinyllama/tinyllama-1.1b-chat-v1.0",
411+
"@hf/thebloke/zephyr-7b-beta-awq",
412+
"@hf/thebloke/deepseek-coder-6.7b-base-awq"
413+
]
414+
},
415+
{
416+
"type": "string"
417+
}
418+
]
419+
}
420+
}
421+
}
422+
},
362423
{
363424
"if": {
364425
"properties": {

‎extensions/intellij/src/main/resources/config_schema.json‎

Lines changed: 64 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -150,7 +150,8 @@
150150
"flowise",
151151
"groq",
152152
"fireworks",
153-
"continue-proxy"
153+
"continue-proxy",
154+
"cloudflare"
154155
],
155156
"markdownEnumDescriptions": [
156157
"### OpenAI\nUse gpt-4, gpt-3.5-turbo, or any other OpenAI model. See [here](https://openai.com/product#made-for-developers) to obtain an API key.\n\n> [Reference](https://docs.continue.dev/reference/Model%20Providers/openai)",
@@ -169,7 +170,8 @@
169170
"### Llamafile\nTo get started with llamafiles, find and download a binary on their [GitHub repo](https://github.com/Mozilla-Ocho/llamafile#binary-instructions). Then run it with the following command:\n\n```shell\nchmod +x ./llamafile\n./llamafile\n```\n> [Reference](https://docs.continue.dev/reference/Model%20Providers/llamafile)",
170171
"### Mistral API\n\nTo get access to the Mistral API, obtain your API key from the [Mistral platform](https://docs.mistral.ai/)",
171172
"### DeepInfra\n\n> [Reference](https://docs.continue.dev/reference/Model%20Providers/deepinfra)",
172-
"### Continue Proxy\n\nContinue Enterprise users can use the Continue Proxy as a single point of access to models."
173+
"### Continue Proxy\n\nContinue Enterprise users can use the Continue Proxy as a single point of access to models.",
174+
"### Cloudflare Workers AI\n\n[Reference](https://developers.cloudflare.com/workers-ai/)"
173175
],
174176
"type": "string"
175177
},
@@ -313,7 +315,8 @@
313315
"gemini",
314316
"huggingface-inference-api",
315317
"replicate",
316-
"together"
318+
"together",
319+
"cloudflare"
317320
]
318321
}
319322
},
@@ -359,6 +362,64 @@
359362
}
360363
}
361364
},
365+
{
366+
"if": {
367+
"properties": {
368+
"provider": {
369+
"enum": ["cloudflare"]
370+
}
371+
},
372+
"required": ["provider"]
373+
},
374+
"then": {
375+
"properties": {
376+
"accountId": {
377+
"type": "string"
378+
},
379+
"model": {
380+
"anyOf": [
381+
{
382+
"enum": [
383+
"@cf/meta/llama-3-8b-instruct",
384+
"@hf/thebloke/deepseek-coder-6.7b-instruct-awq",
385+
"@cf/deepseek-ai/deepseek-math-7b-instruct",
386+
"@cf/thebloke/discolm-german-7b-v1-awq",
387+
"@cf/tiiuae/falcon-7b-instruct",
388+
"@cf/google/gemma-2b-it-lora",
389+
"@hf/google/gemma-7b-it",
390+
"@cf/google/gemma-7b-it-lora",
391+
"@hf/nousresearch/hermes-2-pro-mistral-7b",
392+
"@cf/meta/llama-2-7b-chat-fp16",
393+
"@cf/meta/llama-2-7b-chat-int8",
394+
"@cf/meta-llama/llama-2-7b-chat-hf-lora",
395+
"@hf/thebloke/llama-2-13b-chat-awq",
396+
"@hf/thebloke/llamaguard-7b-awq",
397+
"@cf/mistral/mistral-7b-instruct-v0.1",
398+
"@hf/mistral/mistral-7b-instruct-v0.2",
399+
"@cf/mistral/mistral-7b-instruct-v0.2-lora",
400+
"@hf/thebloke/neural-chat-7b-v3-1-awq",
401+
"@cf/openchat/openchat-3.5-0106",
402+
"@hf/thebloke/openhermes-2.5-mistral-7b-awq",
403+
"@cf/microsoft/phi-2",
404+
"@cf/qwen/qwen1.5-0.5b-chat",
405+
"@cf/qwen/qwen1.5-1.8b-chat",
406+
"@cf/qwen/qwen1.5-7b-chat-awq",
407+
"@cf/qwen/qwen1.5-14b-chat-awq",
408+
"@cf/defog/sqlcoder-7b-2",
409+
"@hf/nexusflow/starling-lm-7b-beta",
410+
"@cf/tinyllama/tinyllama-1.1b-chat-v1.0",
411+
"@hf/thebloke/zephyr-7b-beta-awq",
412+
"@hf/thebloke/deepseek-coder-6.7b-base-awq"
413+
]
414+
},
415+
{
416+
"type": "string"
417+
}
418+
]
419+
}
420+
}
421+
}
422+
},
362423
{
363424
"if": {
364425
"properties": {

0 commit comments

Comments
 (0)