My code keeps blank it doesn't return anything please help #201
-
|
Hiii all I am using the code below after executing the file its completely blank as attached in screenshot, please help me solve this issue as I am stuck for more than 3 days now apparently if I run this through CLI it works from this command : npx --no node-llama-cpp chat --model .\models\phi-2-orange.Q2_K.gguf But if I use the code shared below its blank I have given the screenshot for the same if anyone can help would be highly appreciated. |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
|
As I mentioned in my other comment, there aren't enough details here for me to be able to help you, please provide the information I mentioned in that comment so I can help you. If you say that the |
Beta Was this translation helpful? Give feedback.

As I mentioned in my other comment, there aren't enough details here for me to be able to help you, please provide the information I mentioned in that comment so I can help you.
If you say that the
chatcommand worked for you while using your code withgpu: falsedidn't, I suspect that thechatcommand utilized some GPU layer on your computer which made inference be much faster, and using the CPU only (withgpu: falsein your code) made the inference so slow you thought nothing happened and that it's stuck, while it's actually doing the inference but very very slowly