1
0
mirror of https://github.com/jbranchaud/til synced 2026-01-02 22:58:01 +00:00

Add Use The llm CLI With Claude Models as an LLM TIL

This commit is contained in:
jbranchaud
2024-04-22 20:54:58 -05:00
parent 2543651ec0
commit 1b229b39f1
2 changed files with 28 additions and 1 deletions

View File

@@ -10,7 +10,7 @@ pairing with smart people at Hashrocket.
For a steady stream of TILs, [sign up for my newsletter](https://crafty-builder-6996.ck.page/e169c61186).
_1415 TILs and counting..._
_1416 TILs and counting..._
---
@@ -558,6 +558,7 @@ _1415 TILs and counting..._
### LLM
- [Send cURL To Claude Text Completion API](llm/send-curl-to-claude-text-completion-api.md)
- [Use The llm CLI With Claude Models](llm/use-the-llm-cli-with-claude-models.md)
### Mac

View File

@@ -0,0 +1,26 @@
# Use The llm CLI With Claude Models
[Simon Willison's `llm`](https://llm.datasette.io/en/stable/index.html) can be
used with a bunch of different models (local and API). The whole thing is
plugin driven. To use a specific model, you'll need to install the plugin for
it. For instance, to use the [Claude 3 family of
models](https://www.anthropic.com/news/claude-3-family) you need to install
`llm-claude-3`.
```bash
$ llm install llm-claude-3
```
Then when prompting `llm`, specify which of the Claude models you want to use —
`claude-3-haiku`, `claude-3-sonnet`, or `claude-3-opus` — with the `-m` flag:
```bash
$ llm \
-m claude-3-haiku \
--key $CLAUDE_API_KEY \
'Show me the SQL query to create a cocktails table.'
```
Note: instead of adding my Claude API key to the key store, I've opted to
include it with the `--key` flag via an environment variable that I've set
ahead of time.