Розв'язання проблеми з використанням користувацького Langchain з TruEra

Розв’язання проблеми з використанням користувацького Langchain з TruEra

8 Березня 2024 в 17:09 21

Під час спроби оцінити свій користувацький Langchain за допомогою TruEra, виникли наступні помилки:

Unsure what the main input string is for the call to invoke with args [{'question': 'Taylor Swift là ai?'}].
Run of run in <Thread(TP.submit with debug timeout_0, started 123145688014848)> failed with: Could not locate app.first.steps.context.get_relevant_documents.rets in app/record.
exception calling callback for <Future at 0x13a0ac9d0 state=finished raised RuntimeError>
Traceback (most recent call last):
  File "/Users/lanmac/.pyenv/versions/3.11.6/envs/langchain/lib/python3.11/site-packages/trulens_eval/feedback/feedback.py", line 705, in extract_selection
    arg_vals[k] = list(q_within_o.get(o))
                  ^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/lanmac/.pyenv/versions/3.11.6/envs/langchain/lib/python3.11/site-packages/trulens_eval/utils/serial.py", line 939, in get
    for start_selection in start_items:
  File "/Users/lanmac/.pyenv/versions/3.11.6/envs/langchain/lib/python3.11/site-packages/trulens_eval/utils/serial.py", line 940, in get
    for last_selection in last_step.get(start_selection):
  File "/Users/lanmac/.pyenv/versions/3.11.6/envs/langchain/lib/python3.11/site-packages/trulens_eval/utils/serial.py", line 398, in get
    raise KeyError(
KeyError: 'Key not in dictionary: first'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/Users/lanmac/.pyenv/versions/3.11.6/lib/python3.11/concurrent/futures/_base.py", line 340, in _invoke_callbacks
    callback(self)
...
                          ^^^^^
  File "/Users/lanmac/.pyenv/versions/3.11.6/envs/langchain/lib/python3.11/site-packages/trulens_eval/feedback/feedback.py", line 707, in extract_selection
    raise RuntimeError(
RuntimeError: Could not locate app.first.steps.context.get_relevant_documents.rets in app/record.

Unsure what the main input string is for the call to invoke with args [{'question': 'Taylor Swift là ai?'}].

Run of run in <Thread(TP.submit with debug timeout_0, started 123145688014848)> failed with: Could not locate app.first.steps.context.get_relevant_documents.rets in app/record.

exception calling callback for <Future at 0x13a0ac9d0 state=finished raised RuntimeError>

Traceback (most recent call last):

File "/Users/lanmac/.pyenv/versions/3.11.6/envs/langchain/lib/python3.11/site-packages/trulens_eval/feedback/feedback.py", line 705, in extract_selection

arg_vals[k] = list(q_within_o.get(o))

^^^^^^^^^^^^^^^^^^^^^^^

File "/Users/lanmac/.pyenv/versions/3.11.6/envs/langchain/lib/python3.11/site-packages/trulens_eval/utils/serial.py", line 939, in get

for start_selection in start_items:

File "/Users/lanmac/.pyenv/versions/3.11.6/envs/langchain/lib/python3.11/site-packages/trulens_eval/utils/serial.py", line 940, in get

for last_selection in last_step.get(start_selection):

File "/Users/lanmac/.pyenv/versions/3.11.6/envs/langchain/lib/python3.11/site-packages/trulens_eval/utils/serial.py", line 398, in get

raise KeyError(

KeyError: 'Key not in dictionary: first'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):

File "/Users/lanmac/.pyenv/versions/3.11.6/lib/python3.11/concurrent/futures/_base.py", line 340, in _invoke_callbacks

callback(self)

...

^^^^^

File "/Users/lanmac/.pyenv/versions/3.11.6/envs/langchain/lib/python3.11/site-packages/trulens_eval/feedback/feedback.py", line 707, in extract_selection

raise RuntimeError(