■ Ollama 클래스의 생성자에서 callback_manager 인자를 사용해 스트리밍 표준 출력 콜백 핸들러를 설정하는 방법을 보여준다.
▶ main.py
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 |
from langchain_community.llms import Ollama from langchain_core.callbacks import StreamingStdOutCallbackHandler from langchain_core.callbacks import CallbackManager ollama = Ollama(model = "llama3", callback_manager = CallbackManager([StreamingStdOutCallbackHandler()])) ollama.invoke("The first man on the moon was ...") """ A classic question! The answer is: Neil Armstrong. On July 20, 1969, NASA's Apollo 11 mission successfully landed two astronauts on the surface of the Moon. The first person to set foot on the Moon was Neil Armstrong, who famously declared: "That's one small step for man, one giant leap for mankind" as he stepped onto the lunar surface. Armstrong was followed by fellow astronaut Edwin "Buzz" Aldrin, who also walked on the Moon during the mission. """ |
▶ requirements.txt
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 |
aiohttp==3.9.5 aiosignal==1.3.1 annotated-types==0.7.0 async-timeout==4.0.3 attrs==23.2.0 certifi==2024.6.2 charset-normalizer==3.3.2 dataclasses-json==0.6.7 frozenlist==1.4.1 greenlet==3.0.3 idna==3.7 jsonpatch==1.33 jsonpointer==3.0.0 langchain==0.2.6 langchain-community==0.2.6 langchain-core==0.2.10 langchain-text-splitters==0.2.2 langsmith==0.1.82 marshmallow==3.21.3 multidict==6.0.5 mypy-extensions==1.0.0 numpy==1.26.4 orjson==3.10.5 packaging==24.1 pydantic==2.7.4 pydantic_core==2.18.4 PyYAML==6.0.1 requests==2.32.3 SQLAlchemy==2.0.31 tenacity==8.4.2 typing-inspect==0.9.0 typing_extensions==4.12.2 urllib3==2.2.2 yarl==1.9.4 |
※ pip install langchain-community 명령을 실행했다.