Index

_

__call__() (Plugin method) __delitem__() (ChatHistory method) __getitem__() (ChatHistory method) __init__() (ArgParser method) (ChatAgent method) (VideoQuery method) (VideoStream method) (VoiceChat method) (WebChat method) (WebServer method)

__len__() (ChatHistory method) (KVCache method) __new__() (BotFunctions static method) __next__() (StreamingResponse method)

A

add() (Plugin method) add_listener() (WebServer class method) add_message_handler() (WebServer class method) add_parameter() (Plugin method) add_parameters() (Plugin method) add_system_prompt() (ChatHistory method) add_tokens() (StreamingResponse method) add_tool() (Plugin method)

append() (ChatHistory method) apply_substitutions() (Plugin method) ArgParser (class in nano_llm.utils) asr_final() (VoiceChat method) asr_partial() (VoiceChat method) Audio (ArgParser attribute) audio_rms() (in module nano_llm.utils) audio_silent() (in module nano_llm.utils)

B

bot_function() (in module nano_llm)

BotFunctions (class in nano_llm)

C

cached (ChatMessage attribute) chat (ChatAgent attribute) ChatAgent (class in nano_llm.agents.chat) ChatHistory (class in nano_llm) ChatMessage (class in nano_llm) clear_inputs() (Plugin method) config (NanoLLM attribute) config_path (NanoLLM attribute)

connect() (Plugin method) connected (WebServer property) content (ChatMessage attribute) content_type() (ChatMessage static method) convert_audio() (in module nano_llm.utils) convert_dtype() (in module nano_llm.utils) convert_tensor() (in module nano_llm.utils) cuda_image() (in module nano_llm.utils)

D

db (VideoQuery attribute) Defaults (ArgParser attribute) delta (StreamingResponse attribute)

destroy() (Plugin method) detokenize() (NanoLLM method) dispatch() (Plugin method)

E

embed() (ChatMessage method) embed_chat() (ChatHistory method) embed_image() (NanoLLM method) embed_text() (NanoLLM method)

embed_tokens() (NanoLLM method) embedding (ChatMessage attribute) eos (StreamingResponse property) events (VideoQuery attribute)

F

filter() (BotFunctions class method) find() (BotFunctions class method) (Plugin method)

find_wrap_entry() (ChatHistory method) from_pretrained() (NanoLLM static method)

G

generate() (NanoLLM method)

generate_docs() (BotFunctions class method) generate_system_prompt() (WebChat method)

H

has_embed (NanoLLM attribute)

has_vision (NanoLLM attribute) history (ChatMessage attribute)

I

image_size() (in module nano_llm.utils) index (ChatMessage attribute) input (StreamingResponse attribute) input() (Plugin method)

Instance (WebServer attribute) Instances (Plugin attribute) interrupt() (Plugin method) is_image() (in module nano_llm.utils) is_type() (ChatMessage method)

K

kv_cache (ChatHistory attribute) (StreamingResponse attribute)

KVCache (class in nano_llm)

L

len() (BotFunctions class method) list() (BotFunctions class method)

llm (VideoQuery attribute) load() (BotFunctions class method) load_image() (in module nano_llm.utils)

M

MESSAGE_AUDIO (WebServer attribute) MESSAGE_BINARY (WebServer attribute) MESSAGE_FILE (WebServer attribute) MESSAGE_IMAGE (WebServer attribute) MESSAGE_JSON (WebServer attribute)

MESSAGE_TEXT (WebServer attribute) MessageHandlers (WebServer attribute) model (ChatAgent attribute) (StreamingResponse attribute) model_path (NanoLLM attribute)

N

NanoLLM (class in nano_llm) next (ChatMessage attribute) num_clients (WebServer property)

num_outputs (Plugin property) num_tokens (ChatHistory property) (ChatMessage property) (KVCache attribute)

O

on_asr_partial() (WebChat method) on_asr_waiting() (WebChat method) on_image_embedding() (VideoQuery method) on_interrupt() (ChatAgent method) (VoiceChat method) on_llm_reply() (WebChat method) on_message() (WebChat method) (WebServer method)

on_search() (VideoQuery method) on_text() (VideoQuery method) on_tts_samples() (WebChat method) on_video() (VideoQuery method) on_websocket() (VideoQuery method) output() (Plugin method)

P

parse_args() (ArgParser method) parse_prompt_args() (ArgParser static method) pipeline (ChatAgent attribute) Plugin (class in nano_llm)

pop() (ChatHistory method) (KVCache method) prev (ChatMessage attribute) process() (Plugin method) prompt (VoiceChat attribute)

R

register() (BotFunctions class method) reindex() (ChatHistory method) remove() (ChatHistory method) (KVCache method) reorder_parameters() (Plugin method)

reset() (ChatHistory method) Riva (ArgParser attribute) role (ChatMessage attribute) run() (BotFunctions class method) (Plugin method) run_tools() (ChatHistory method)

S

SAVE() (WebChat method) send_alert() (Plugin method) send_chat_history() (WebChat method) send_client_output() (Plugin method) send_message() (WebServer method) send_state() (Plugin method) send_stats() (Plugin method) server (VideoQuery attribute) set_parameters() (Plugin method) start() (Plugin method) (VideoQuery method) (WebChat method) (WebServer method)

start_token (ChatMessage property) state_dict() (Plugin method) stats (NanoLLM attribute) stop() (Plugin method) (StreamingResponse method) stopped (StreamingResponse attribute) stopping (StreamingResponse attribute) StreamingResponse (class in nano_llm) system_prompt (ChatHistory property) (WebChat property)

T

template (ChatMessage attribute) test() (BotFunctions class method) text (StreamingResponse attribute) to_html() (ChatHistory method) to_list() (ChatHistory method) tokenize() (NanoLLM method)

tokenizer (NanoLLM attribute) tokens (ChatMessage attribute) (StreamingResponse attribute) torch_image() (in module nano_llm.utils) turn() (ChatHistory method) type (ChatMessage attribute)

U

use_cache (ChatMessage attribute)

V

Video (ArgParser attribute) video_output (VideoQuery attribute) video_source (VideoQuery attribute)

VideoQuery (class in nano_llm.agents.video_query) VideoStream (class in nano_llm.agents.video_stream) VoiceChat (class in nano_llm.agents.voice_chat)

W

WebChat (class in nano_llm.agents.web_chat)

WebServer (class in nano_llm.web)