Command-line interface for Tinfoil’s secure AI inference API
/usr/local/bin
.
DeepSeek R1 - deepseek-r1-0528
deepseek
Mistral Small 3.1 24B - mistral-small-3-1-24b
mistral
Llama 3.3 70B - llama3-3-70b
llama
Qwen 2.5 72B - qwen2-5-72b
qwen
Whisper Large V3 Turbo - whisper-large-v3-turbo
whisper
Kokoro - kokoro
tts
Nomic Embed Text - nomic-embed-text
embed
chat
command lets you interact with a model by simply specifying a model name and your prompt. You need to specify the model with the -m
flag.
deepseek
) or the full name (deepseek-r1-0528
).
-s
flag): Tokens are displayed in real-time as they’re generated, providing a more interactive experience-e
and -r
overrides:
-e
or -r
for a model that isn’t in the configuration, a warning will be displayed prompting you to specify these flags.
-m, --model
: The model name to use for chat. Must be specified.-k, --api-key
: The API key for authentication.-s, --stream
: Stream response output (real-time token generation). Optional, defaults to false.-l, --list
: List available chat models.-e, --host
: The hostname of the enclave. Optional if defined in the config file.-r, --repo
: The GitHub repository containing code measurements. Optional if defined in the config file.audio
command allows you to transcribe audio files using Whisper models.
-m, --model
: The model name to use for transcription. Defaults to whisper-large-v3-turbo
.-k, --api-key
: The API key for authentication.-f, --file
: The audio file to transcribe.-e, --host
: The hostname of the enclave. Optional if defined in the config file.-r, --repo
: The GitHub repository containing code measurements. Optional if defined in the config file.tts
command allows you to convert text to speech using TTS models. By default, it uses the kokoro
model.
kokoro
and saves the generated audio to output.mp3
. You can also use the friendly name tts
:
-m, --model
: The model name to use for TTS. Defaults to kokoro
.-k, --api-key
: The API key for authentication.--voice
: Voice to use for synthesis. Defaults to af_sky+af_bella
.-o, --output
: Output file path. Defaults to output.mp3
.-e, --host
: The hostname of the enclave. Optional if defined in the config file.-r, --repo
: The GitHub repository containing code measurements. Optional if defined in the config file.embed
command allows you to generate embeddings for text inputs.
-m, --model
: The model name to use for embeddings. Defaults to nomic-embed-text
.-k, --api-key
: The API key for authentication.-e, --host
: The hostname of the enclave. Optional if defined in the config file.-r, --repo
: The GitHub repository containing code measurements. Optional if defined in the config file.attestation verify
command to manually verify that an enclave is running the expected code. The output will be a series of INFO logs describing each verification step.
Sample successful output:
attestation audit
command for this purpose.
By default the audit record is printed to stdout as JSON. To write it to a file, use the -l/--log-file
flag:
tinfoil proxy
to start a local HTTP proxy that verifies connections and forwards them to the specified enclave:
ghcr.io/tinfoilsh/tinfoil-cli
.
PCR register mismatch
: Running enclave code differs from source repo