Can we run large language model to generate text using brainJS? #873
|
As I ask in #335 (comment) Hi, I'm writing a electronjs based tiddlywiki app https://github.com/tiddly-gittly/TidGi-Desktop that is offline-first, and I want to make it possible to run a large language model (around 1GB is ok I think?). Can brainJS do text generation now? The size of model is not a problem, because I'm going to use it in an electron app. |
Answered by
robertleeplummerjr
Feb 2, 2023
Replies: 1 comment
Yes. The neural network which does this is the
The same answer as the above. |
0 replies
Answer selected by
linonetwo
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Yes. The neural network which does this is the
brain.recurrent.LSTMclass. It however isn't GPU accelerated, so it can be slow if the network is larger than say a hidden layer of size 500+.The same answer as the above.