■ SimpleDirectoryReader 클래스의 생성자에서 input_files/file_extractor 인자를 사용해 SimpleDirectoryReader 객체를 만드는 방법을 보여준다.
※ LLAMA_CLOUD_API_KEY 환경 변수 값은 .env 파일에 정의한다.
▶ main.py
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 |
from dotenv import load_dotenv from llama_parse import LlamaParse from llama_index.core import SimpleDirectoryReader load_dotenv() llamaParse = LlamaParse( result_type = "markdown", # "markdown"과 "text" 사용 가능 num_workers = 8, # 작업 수 (기본값 : 4) verbose = False, language = "ko" ) fileExtractorDictionary = {".pdf" : llamaParse} simpleDirectoryReader = SimpleDirectoryReader( input_files = ["SPRI_AI_Brief_2023년12월호_F.pdf"], file_extractor = fileExtractorDictionary, ) documentList = simpleDirectoryReader.load_data() print(len(documentList)) """ 23 """ |
▶ requirements.txt
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 |
aiohappyeyeballs==2.4.4 aiohttp==3.11.11 aiosignal==1.3.2 annotated-types==0.7.0 anyio==4.8.0 async-timeout==5.0.1 attrs==24.3.0 beautifulsoup4==4.12.3 certifi==2024.12.14 charset-normalizer==3.4.1 click==8.1.8 dataclasses-json==0.6.7 Deprecated==1.2.15 dirtyjson==1.0.8 exceptiongroup==1.2.2 filetype==1.2.0 frozenlist==1.5.0 fsspec==2024.12.0 greenlet==3.1.1 h11==0.14.0 httpcore==1.0.7 httpx==0.28.1 idna==3.10 joblib==1.4.2 llama-index-core==0.12.10.post1 llama-index-readers-file==0.4.3 llama-parse==0.5.19 marshmallow==3.25.1 multidict==6.1.0 mypy-extensions==1.0.0 nest-asyncio==1.6.0 networkx==3.4.2 nltk==3.9.1 numpy==2.2.1 packaging==24.2 pandas==2.2.3 pillow==11.1.0 propcache==0.2.1 pydantic==2.10.5 pydantic_core==2.27.2 pypdf==5.1.0 python-dateutil==2.9.0.post0 python-dotenv==1.0.1 pytz==2024.2 PyYAML==6.0.2 regex==2024.11.6 requests==2.32.3 six==1.17.0 sniffio==1.3.1 soupsieve==2.6 SQLAlchemy==2.0.37 striprtf==0.0.26 tenacity==9.0.0 tiktoken==0.8.0 tqdm==4.67.1 typing-inspect==0.9.0 typing_extensions==4.12.2 tzdata==2024.2 urllib3==2.3.0 wrapt==1.17.1 yarl==1.18.3 |
※ pip install python-dotenv llama-index-core llama-index-readers-file llama-parse 명령을 실행했다.
