Anyone tried installing LLAMA and/or Dalai?

Edge2
#1

Which system do you use? Android, Ubuntu, OOWOW or others?

Ubuntu 22.04.02

Which version of system do you use? Khadas official images, self built images, or others?

Original images from OOWOW

Please describe your issue below:

I have been wanting to install the LAMA and DALAI engine to test this browser based setup with no success.

Post a console log of your issue below:

Need to install the following packages:
dalai
Ok to proceed? (y) y
npm WARN EBADENGINE Unsupported engine {
npm WARN EBADENGINE package: ‘dalai@0.3.1’,
npm WARN EBADENGINE required: { node: ‘>=18.0.0’ },
npm WARN EBADENGINE current: { node: ‘v12.22.9’, npm: ‘8.5.1’ }
npm WARN EBADENGINE }
npm WARN EBADENGINE Unsupported engine {
npm WARN EBADENGINE package: ‘terminal-kit@3.0.0’,
npm WARN EBADENGINE required: { node: ‘>=16.13.0’ },
npm WARN EBADENGINE current: { node: ‘v12.22.9’, npm: ‘8.5.1’ }
npm WARN EBADENGINE }
npm WARN EBADENGINE Unsupported engine {
npm WARN EBADENGINE package: ‘webtorrent@1.9.7’,
npm WARN EBADENGINE required: { node: ‘>=14’ },
npm WARN EBADENGINE current: { node: ‘v12.22.9’, npm: ‘8.5.1’ }
npm WARN EBADENGINE }
npm WARN EBADENGINE Unsupported engine {
npm WARN EBADENGINE package: ‘seventh@0.8.2’,
npm WARN EBADENGINE required: { node: ‘>=16.13.0’ },
npm WARN EBADENGINE current: { node: ‘v12.22.9’, npm: ‘8.5.1’ }
npm WARN EBADENGINE }
npm WARN EBADENGINE Unsupported engine {
npm WARN EBADENGINE package: ‘string-kit@0.17.8’,
npm WARN EBADENGINE required: { node: ‘>=14.15.0’ },
npm WARN EBADENGINE current: { node: ‘v12.22.9’, npm: ‘8.5.1’ }
npm WARN EBADENGINE }

#2

I forgot to update this post to say that I saw the required module versions vs the current versions, so I updated all of them and made progress installing them (still 5 hours to go for the libraries) but I still would like to communicate more with other users that are trying to use the NPU and related processes. Thanks!

#3

Just to add that I was able to get it all running, problem was broken files in download, I have a good set of instructions for getting it working, but still I am surprised there are not more people here using the NPU to do AI modeling and queries. Not enough interest to get a topic setup?

#4

I’m very interested with running LLMs locally on RK3588s. Currently I’m trying online models and frameworks (langchain, whisper, openai). And I want to play with local models as well.