[PYTHON/LANGCHAIN] JsonOutputParser 클래스 : 체인에서 질의 응답시 구조화된 데이터 스트리밍하기

■ JsonOutputParser 클래스를 사용해 체인에서 질의 응답시 구조화된 데이터를 스트리밍하는 방법을 보여준다.

▶ main.py


import os

from langchain_openai              import ChatOpenAI
from langchain_core.output_parsers import JsonOutputParser

os.environ["OPENAI_API_KEY"] = "<OPENAI_API_KEY>"

chatOpenAI = ChatOpenAI(model = "gpt-3.5-turbo-0125")

jsonOutputParser = JsonOutputParser()

runnableSequence = chatOpenAI | jsonOutputParser

requestString = """output a list of the countries france, spain and japan and their populations in JSON format. \
Use a dict with an outer key of "countries" which contains a list of countries. \
Each country should have the key `name` and `population`"""

for responseChunkString in runnableSequence.stream(requestString):
    print(responseChunkString, flush = True)

"""
{}
{'countries': []}
{'countries': [{}]}
{'countries': [{'name': ''}]}
{'countries': [{'name': 'France'}]}
{'countries': [{'name': 'France', 'population': 670}]}
{'countries': [{'name': 'France', 'population': 670760}]}
{'countries': [{'name': 'France', 'population': 67076000}]}
{'countries': [{'name': 'France', 'population': 67076000}, {}]}
{'countries': [{'name': 'France', 'population': 67076000}, {'name': ''}]}
{'countries': [{'name': 'France', 'population': 67076000}, {'name': 'Spain'}]}
{'countries': [{'name': 'France', 'population': 67076000}, {'name': 'Spain', 'population': 473}]}
{'countries': [{'name': 'France', 'population': 67076000}, {'name': 'Spain', 'population': 473299}]}
{'countries': [{'name': 'France', 'population': 67076000}, {'name': 'Spain', 'population': 47329981}]}
{'countries': [{'name': 'France', 'population': 67076000}, {'name': 'Spain', 'population': 47329981}, {}]}
{'countries': [{'name': 'France', 'population': 67076000}, {'name': 'Spain', 'population': 47329981}, {'name': ''}]}
{'countries': [{'name': 'France', 'population': 67076000}, {'name': 'Spain', 'population': 47329981}, {'name': 'Japan'}]}
{'countries': [{'name': 'France', 'population': 67076000}, {'name': 'Spain', 'population': 47329981}, {'name': 'Japan', 'population': 125}]}
{'countries': [{'name': 'France', 'population': 67076000}, {'name': 'Spain', 'population': 47329981}, {'name': 'Japan', 'population': 125960}]}
{'countries': [{'name': 'France', 'population': 67076000}, {'name': 'Spain', 'population': 47329981}, {'name': 'Japan', 'population': 125960000}]}
"""

import os

from langchain_openai import ChatOpenAI

from langchain_core.output_parsers import JsonOutputParser

os.environ["OPENAI_API_KEY"] = "<OPENAI_API_KEY>"

chatOpenAI = ChatOpenAI(model = "gpt-3.5-turbo-0125")

jsonOutputParser = JsonOutputParser()

runnableSequence = chatOpenAI | jsonOutputParser

requestString = """output a list of the countries france, spain and japan and their populations in JSON format. \

Use a dict with an outer key of "countries" which contains a list of countries. \

Each country should have the key `name` and `population`"""

for responseChunkString in runnableSequence.stream(requestString):

print(responseChunkString, flush = True)

"""

{}

{'countries': []}

{'countries': [{}]}

{'countries': [{'name': ''}]}

{'countries': [{'name': 'France'}]}

{'countries': [{'name': 'France', 'population': 670}]}

{'countries': [{'name': 'France', 'population': 670760}]}

{'countries': [{'name': 'France', 'population': 67076000}]}

{'countries': [{'name': 'France', 'population': 67076000}, {}]}

{'countries': [{'name': 'France', 'population': 67076000}, {'name': ''}]}

{'countries': [{'name': 'France', 'population': 67076000}, {'name': 'Spain'}]}

{'countries': [{'name': 'France', 'population': 67076000}, {'name': 'Spain', 'population': 473}]}

{'countries': [{'name': 'France', 'population': 67076000}, {'name': 'Spain', 'population': 473299}]}

{'countries': [{'name': 'France', 'population': 67076000}, {'name': 'Spain', 'population': 47329981}]}

{'countries': [{'name': 'France', 'population': 67076000}, {'name': 'Spain', 'population': 47329981}, {}]}

{'countries': [{'name': 'France', 'population': 67076000}, {'name': 'Spain', 'population': 47329981}, {'name': ''}]}

{'countries': [{'name': 'France', 'population': 67076000}, {'name': 'Spain', 'population': 47329981}, {'name': 'Japan'}]}

{'countries': [{'name': 'France', 'population': 67076000}, {'name': 'Spain', 'population': 47329981}, {'name': 'Japan', 'population': 125}]}

{'countries': [{'name': 'France', 'population': 67076000}, {'name': 'Spain', 'population': 47329981}, {'name': 'Japan', 'population': 125960}]}

{'countries': [{'name': 'France', 'population': 67076000}, {'name': 'Spain', 'population': 47329981}, {'name': 'Japan', 'population': 125960000}]}

"""

▶ requirements.txt


annotated-types==0.7.0
anyio==4.4.0
certifi==2024.6.2
charset-normalizer==3.3.2
distro==1.9.0
exceptiongroup==1.2.1
h11==0.14.0
httpcore==1.0.5
httpx==0.27.0
idna==3.7
jsonpatch==1.33
jsonpointer==3.0.0
langchain-core==0.2.7
langchain-openai==0.1.8
langsmith==0.1.77
openai==1.34.0
orjson==3.10.5
packaging==24.1
pydantic==2.7.4
pydantic_core==2.18.4
PyYAML==6.0.1
regex==2024.5.15
requests==2.32.3
sniffio==1.3.1
tenacity==8.4.1
tiktoken==0.7.0
tqdm==4.66.4
typing_extensions==4.12.2
urllib3==2.2.2

annotated-types==0.7.0

anyio==4.4.0

certifi==2024.6.2

charset-normalizer==3.3.2

distro==1.9.0

exceptiongroup==1.2.1

h11==0.14.0

httpcore==1.0.5

httpx==0.27.0

idna==3.7

jsonpatch==1.33

jsonpointer==3.0.0

langchain-core==0.2.7

langchain-openai==0.1.8

langsmith==0.1.77

openai==1.34.0

orjson==3.10.5

packaging==24.1

pydantic==2.7.4

pydantic_core==2.18.4

PyYAML==6.0.1

regex==2024.5.15

requests==2.32.3

sniffio==1.3.1

tenacity==8.4.1

tiktoken==0.7.0

tqdm==4.66.4

typing_extensions==4.12.2

urllib3==2.2.2

※ pip install langchain-openai 명령을 실행했다.