Interesting, but why go through all of these steps instead of using something like double bot, which just works out of the box and has all of the right models?
Sadly, autocomplete does not seem to work. I installed the model and successfully tested it from console. I adjusted the config.json file to contain the tabAutocompleteModel property with all shown values (it was not there after plugin installation). I see no errors, continue tells me: "index up to date" in the status row. But nothing happens in my code files.
I even tried it with ollama server to spin up the API (ollama ps is showing the model as loaded). No success and no http request in the developer tools of vsc.
With Claude 3.5 as the Copilot, can it see your entire codebase? If it can, compare it to just embedding your codebase. The other day I sent my codebase to Claude 3 Opus and worked through some issues I was having. The API costs were $64. I'm wondering if the codebase got embedded into the prompt and was sent back and forth with each query. How else would it use up so many tokens?
There's option to add your entire codebase as context in ContinueDev. But, I wouldn't recommend that due to the huge API costs that might come. Instead, you can just add the context you need to work on. Also, The new Claude 3.5 Sonnet is much cheaper than the previous opus model (Previous one was like $15/m token while this is just $3/m token)
@@AICodeKing btw github copilot uses GPT-4 or so they say. Sonnet-3.5 is really good but is it going to be worth it using like that (as in pay as you go model)? Also, github copliot is privacy oriented and secure (or so they say) compared to Sonnet-3.5 which is not private (they will work on the data you provide afaik).
@@AICodeKing could I add files and knowledbase (entire codebase and related similar projects) to an assistant in OpenAi playground and then use that particular assistant. Would that bring down costs since does not need to send codebase back and forth?
@@AICodeKing the problem is that I don't know how many tokens day to day coding will use. Maybe more, maybe less. Maybe even using it for autocomplete works out cheaper, or not much more expensive. Please make a video in a while to let us know what the costs turn out to be.
Yeah I found it won't allow me to paste the API key in this way. Find the .sgptrc file in your C: drive. Navigate to C: > Users > "Whatever your username is" > .config > shell-gpt > .sgptrc Then edit as per his tutorial. Hope this helps!
