■ AIMessage 클래스의 response_metadata 속성을 사용하는 방법을 보여준다. (ChatOpenAI 객체 사용시)
▶ 예제 코드 (PY)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 |
import os from langchain_openai import ChatOpenAI chatOpenAI = ChatOpenAI( base_url = "https://api.together.xyz/v1", api_key = os.environ["TOGETHER_API_KEY"], model = "mistralai/Mixtral-8x7B-Instruct-v0.1" ) aiMessage = chatOpenAI.invoke([("human", "What's the oldest known example of cuneiform")]) print(aiMessage.response_metadata) """ { 'token_usage' : {'completion_tokens' : 208, 'prompt_tokens' : 20, 'total_tokens' : 228}, 'model_name' : 'mistralai/Mixtral-8x7B-Instruct-v0.1', 'system_fingerprint' : None, 'finish_reason' : 'eos', 'logprobs' : None } """ |