When I write now, I will sometimes load a page or two into a LLM and ask for an ‘opinion’, and also suggestions for more sub-topics. This is sort-of like bouncing ideas off a human collaborator but also very different.
More to the point of this article, I have a few test prompts that define a bizarre remote planet and culture and ask for a story to be written using this context as a kick-off point. GPT-4 and Claude 2 generally do a good job of ‘creatively’ generating a story. Some smaller LLMs that I run locally on a 32G Mac Mini to a poor job and others are OK. Related: when using smaller local LLMs, I find it important to have many models installed and keep notes on which smaller models are good or bad at specific tasks.
More to the point of this article, I have a few test prompts that define a bizarre remote planet and culture and ask for a story to be written using this context as a kick-off point. GPT-4 and Claude 2 generally do a good job of ‘creatively’ generating a story. Some smaller LLMs that I run locally on a 32G Mac Mini to a poor job and others are OK. Related: when using smaller local LLMs, I find it important to have many models installed and keep notes on which smaller models are good or bad at specific tasks.