Class: HuggingFaceLLM
Unified language model interface
Extends
Constructors
new HuggingFaceLLM()
new HuggingFaceLLM(
init
?):HuggingFaceLLM
Parameters
• init?: HFLLMConfig
Returns
Overrides
Defined in
packages/llamaindex/src/llm/huggingface.ts:208
Properties
contextWindow
contextWindow:
number
Defined in
packages/llamaindex/src/llm/huggingface.ts:203
maxTokens?
optional
maxTokens:number
Defined in
packages/llamaindex/src/llm/huggingface.ts:202
modelName
modelName:
string
Defined in
packages/llamaindex/src/llm/huggingface.ts:198
temperature
temperature:
number
Defined in
packages/llamaindex/src/llm/huggingface.ts:200
tokenizerName
tokenizerName:
string
Defined in
packages/llamaindex/src/llm/huggingface.ts:199
topP
topP:
number
Defined in
packages/llamaindex/src/llm/huggingface.ts:201
Accessors
metadata
get
metadata():LLMMetadata
Returns
Overrides
Defined in
packages/llamaindex/src/llm/huggingface.ts:218
Methods
chat()
chat(params)
chat(
params
):Promise
<AsyncIterable
<ChatResponseChunk
,any
,any
>>
Get a chat response from the LLM
Parameters
• params: LLMChatParamsStreaming
<object
, object
>
Returns
Promise
<AsyncIterable
<ChatResponseChunk
, any
, any
>>
Overrides
Defined in
packages/llamaindex/src/llm/huggingface.ts:261
chat(params)
chat(
params
):Promise
<ChatResponse
<object
>>
Get a chat response from the LLM
Parameters
• params: LLMChatParamsNonStreaming
<object
, object
>
Returns
Promise
<ChatResponse
<object
>>
Overrides
Defined in
packages/llamaindex/src/llm/huggingface.ts:264
complete()
complete(params)
complete(
params
):Promise
<AsyncIterable
<CompletionResponse
,any
,any
>>
Get a prompt completion from the LLM