[PYTHON/LANGCHAIN] get_openai_callback 함수 : 단일 채팅 모델에서 스트리밍시 토큰 사용량 구하기

■ get_openai_callback 함수 : 단일 채팅 모델에서 스트리밍시 토큰 사용량 구하기

※ 비용을 측정할 수 없다.
※ OPENAI_API_KEY 환경 변수 값은 .env 파일에 정의한다.

▶ main.py


from dotenv                        import load_dotenv
from langchain_openai              import OpenAI
from langchain_community.callbacks import get_openai_callback

load_dotenv()

openAI = OpenAI(model_name = "gpt-3.5-turbo-instruct")

with get_openai_callback() as generatorContextManager:
    for chunkString in openAI.stream("Tell me a joke"):
        print(chunkString, end = "", flush = True)
    print(chunkString)
    print("--------------------------------------------------")
print()

print(f"Total Tokens      : {generatorContextManager.total_tokens}"     )
print(f"Prompt Tokens     : {generatorContextManager.prompt_tokens}"    )
print(f"Completion Tokens : {generatorContextManager.completion_tokens}")
print(f"Total Cost (USD)  : ${generatorContextManager.total_cost}"      )

"""
Why don't scientists trust atoms?

Because they make up everything. they make up everything.
--------------------------------------------------

Total Tokens      : 0
Prompt Tokens     : 0
Completion Tokens : 0
Total Cost (USD)  : $0.0
"""

from dotenv import load_dotenv

from langchain_openai import OpenAI

from langchain_community.callbacks import get_openai_callback

load_dotenv()

openAI = OpenAI(model_name = "gpt-3.5-turbo-instruct")

with get_openai_callback() as generatorContextManager:

for chunkString in openAI.stream("Tell me a joke"):

print(chunkString, end = "", flush = True)

print(chunkString)

print("--------------------------------------------------")

print()

print(f"Total Tokens : {generatorContextManager.total_tokens}" )

print(f"Prompt Tokens : {generatorContextManager.prompt_tokens}" )

print(f"Completion Tokens : {generatorContextManager.completion_tokens}")

print(f"Total Cost (USD) : ${generatorContextManager.total_cost}" )

"""

Why don't scientists trust atoms?

Because they make up everything. they make up everything.

--------------------------------------------------

Total Tokens : 0

Prompt Tokens : 0

Completion Tokens : 0

Total Cost (USD) : $0.0

"""

▶ requirements.txt


aiohttp==3.9.5
aiosignal==1.3.1
annotated-types==0.7.0
anyio==4.4.0
async-timeout==4.0.3
attrs==23.2.0
certifi==2024.6.2
charset-normalizer==3.3.2
dataclasses-json==0.6.7
distro==1.9.0
exceptiongroup==1.2.1
frozenlist==1.4.1
greenlet==3.0.3
h11==0.14.0
httpcore==1.0.5
httpx==0.27.0
idna==3.7
jsonpatch==1.33
jsonpointer==3.0.0
langchain==0.2.5
langchain-community==0.2.5
langchain-core==0.2.9
langchain-openai==0.1.9
langchain-text-splitters==0.2.1
langsmith==0.1.82
marshmallow==3.21.3
multidict==6.0.5
mypy-extensions==1.0.0
numpy==1.26.4
openai==1.35.3
orjson==3.10.5
packaging==24.1
pydantic==2.7.4
pydantic_core==2.18.4
python-dotenv==1.0.1
PyYAML==6.0.1
regex==2024.5.15
requests==2.32.3
sniffio==1.3.1
SQLAlchemy==2.0.31
tenacity==8.4.2
tiktoken==0.7.0
tqdm==4.66.4
typing-inspect==0.9.0
typing_extensions==4.12.2
urllib3==2.2.2
yarl==1.9.4

aiohttp==3.9.5

aiosignal==1.3.1

annotated-types==0.7.0

anyio==4.4.0

async-timeout==4.0.3

attrs==23.2.0

certifi==2024.6.2

charset-normalizer==3.3.2

dataclasses-json==0.6.7

distro==1.9.0

exceptiongroup==1.2.1

frozenlist==1.4.1

greenlet==3.0.3

h11==0.14.0

httpcore==1.0.5

httpx==0.27.0

idna==3.7

jsonpatch==1.33

jsonpointer==3.0.0

langchain==0.2.5

langchain-community==0.2.5

langchain-core==0.2.9

langchain-openai==0.1.9

langchain-text-splitters==0.2.1

langsmith==0.1.82

marshmallow==3.21.3

multidict==6.0.5

mypy-extensions==1.0.0

numpy==1.26.4

openai==1.35.3

orjson==3.10.5

packaging==24.1

pydantic==2.7.4

pydantic_core==2.18.4

python-dotenv==1.0.1

PyYAML==6.0.1

regex==2024.5.15

requests==2.32.3

sniffio==1.3.1

SQLAlchemy==2.0.31

tenacity==8.4.2

tiktoken==0.7.0

tqdm==4.66.4

typing-inspect==0.9.0

typing_extensions==4.12.2

urllib3==2.2.2

yarl==1.9.4

※ pip install python-dotenv langchain-community langchain-openai 명령을 실행했다.