Hacker Newsnew | past | comments | ask | show | jobs | submit | somesun's commentslogin

very good resource

I will read it when it's available


that's great !

I will try it, does it support GPU like cuda?

one question, can I use it as a library in my rust project, or I can only call it through new process with exe file?


GPU/CUDA: Yes, but disabled by default for faster builds. To enable: remove LLAMA_CUDA = "OFF" from config.toml and rebuild with CUDA toolkit installed.

Rust library: Absolutely! Add shimmy = { version = "0.1.0", features = ["llama"] } to Cargo.toml. Use the inference engine directly:

let engine = shimmy::engine::llama::LlamaEngine::new(); let model = engine.load(&spec).await?; let response = model.generate("prompt", opts, None).await?;

No need to spawn processes - just import and use the components directly in your Rust code.


anyone can make a comparation with cursor

too many ides , hard to choose


a similar website https://ffmpeg.app/


i think if use rust , the best is tauri + any frontend (just let ai write frontend)


why not just call it reactTK


I like the name, it’s a fun portmanteau of Tkinter and intergalactic. It’s also more search engine friendly and less likely to hit a name collision with another project.


very good example to learn async , will try it


only rust


is this a AI editor like Cursor?


a very good game to learn css


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: