Evaluation(RAGAS)

ReRanker RAG

AI Engineering.academy

Setting up the Environment¶

In [3]:

  Copied!     
 
!pip install -U nest-asyncio
!pip install -U llama-index
!pip install -U llama-index-vector-stores-qdrant 
!pip install -U llama-index-readers-file 
!pip install -U llama-index-embeddings-fastembed 
!pip install -U llama-index-llms-openai
!pip install -U llama-index-llms-groq
!pip install -U qdrant_client fastembed
!pip install -U python-dotenv
!pip install -U nest-asyncio !pip install -U llama-index !pip install -U llama-index-vector-stores-qdrant !pip install -U llama-index-readers-file !pip install -U llama-index-embeddings-fastembed !pip install -U llama-index-llms-openai !pip install -U llama-index-llms-groq !pip install -U qdrant_client fastembed !pip install -U python-dotenv

Requirement already satisfied: nest-asyncio in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (1.6.0)
Requirement already satisfied: llama-index in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (0.10.51)
Collecting llama-index
  Using cached llama_index-0.11.10-py3-none-any.whl.metadata (11 kB)
Collecting llama-index-agent-openai<0.4.0,>=0.3.1 (from llama-index)
  Using cached llama_index_agent_openai-0.3.4-py3-none-any.whl.metadata (728 bytes)
Collecting llama-index-cli<0.4.0,>=0.3.1 (from llama-index)
  Using cached llama_index_cli-0.3.1-py3-none-any.whl.metadata (1.5 kB)
Requirement already satisfied: llama-index-core<0.12.0,>=0.11.10 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index) (0.11.10)
Collecting llama-index-embeddings-openai<0.3.0,>=0.2.4 (from llama-index)
  Using cached llama_index_embeddings_openai-0.2.5-py3-none-any.whl.metadata (686 bytes)
Collecting llama-index-indices-managed-llama-cloud>=0.3.0 (from llama-index)
  Using cached llama_index_indices_managed_llama_cloud-0.3.1-py3-none-any.whl.metadata (3.8 kB)
Requirement already satisfied: llama-index-legacy<0.10.0,>=0.9.48 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index) (0.9.48.post3)
Collecting llama-index-llms-openai<0.3.0,>=0.2.3 (from llama-index)
  Using cached llama_index_llms_openai-0.2.9-py3-none-any.whl.metadata (648 bytes)
Collecting llama-index-multi-modal-llms-openai<0.3.0,>=0.2.0 (from llama-index)
  Using cached llama_index_multi_modal_llms_openai-0.2.1-py3-none-any.whl.metadata (728 bytes)
Collecting llama-index-program-openai<0.3.0,>=0.2.0 (from llama-index)
  Using cached llama_index_program_openai-0.2.0-py3-none-any.whl.metadata (766 bytes)
Collecting llama-index-question-gen-openai<0.3.0,>=0.2.0 (from llama-index)
  Using cached llama_index_question_gen_openai-0.2.0-py3-none-any.whl.metadata (785 bytes)
Collecting llama-index-readers-file<0.3.0,>=0.2.0 (from llama-index)
  Using cached llama_index_readers_file-0.2.2-py3-none-any.whl.metadata (5.4 kB)
Collecting llama-index-readers-llama-parse>=0.3.0 (from llama-index)
  Using cached llama_index_readers_llama_parse-0.3.0-py3-none-any.whl.metadata (3.5 kB)
Requirement already satisfied: nltk>3.8.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index) (3.9.1)
Requirement already satisfied: openai>=1.14.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-agent-openai<0.4.0,>=0.3.1->llama-index) (1.44.0)
Requirement already satisfied: PyYAML>=6.0.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.10->llama-index) (6.0.2)
Requirement already satisfied: SQLAlchemy>=1.4.49 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from SQLAlchemy[asyncio]>=1.4.49->llama-index-core<0.12.0,>=0.11.10->llama-index) (2.0.34)
Requirement already satisfied: aiohttp<4.0.0,>=3.8.6 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.10->llama-index) (3.10.5)
Requirement already satisfied: dataclasses-json in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.10->llama-index) (0.5.14)
Requirement already satisfied: deprecated>=1.2.9.3 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.10->llama-index) (1.2.14)
Requirement already satisfied: dirtyjson<2.0.0,>=1.0.8 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.10->llama-index) (1.0.8)
Requirement already satisfied: fsspec>=2023.5.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.10->llama-index) (2024.6.1)
Requirement already satisfied: httpx in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.10->llama-index) (0.27.2)
Requirement already satisfied: nest-asyncio<2.0.0,>=1.5.8 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.10->llama-index) (1.6.0)
Requirement already satisfied: networkx>=3.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.10->llama-index) (3.3)
Requirement already satisfied: numpy<2.0.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.10->llama-index) (1.26.4)
Requirement already satisfied: pillow>=9.0.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.10->llama-index) (10.4.0)
Requirement already satisfied: pydantic<3.0.0,>=2.7.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.10->llama-index) (2.9.1)
Requirement already satisfied: requests>=2.31.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.10->llama-index) (2.32.3)
Requirement already satisfied: tenacity!=8.4.0,<9.0.0,>=8.2.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.10->llama-index) (8.4.2)
Requirement already satisfied: tiktoken>=0.3.3 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.10->llama-index) (0.7.0)
Requirement already satisfied: tqdm<5.0.0,>=4.66.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.10->llama-index) (4.66.5)
Requirement already satisfied: typing-extensions>=4.5.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.10->llama-index) (4.12.2)
Requirement already satisfied: typing-inspect>=0.8.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.10->llama-index) (0.9.0)
Requirement already satisfied: wrapt in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.10->llama-index) (1.16.0)
Collecting llama-cloud>=0.0.11 (from llama-index-indices-managed-llama-cloud>=0.3.0->llama-index)
  Using cached llama_cloud-0.0.17-py3-none-any.whl.metadata (751 bytes)
Requirement already satisfied: pandas in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-legacy<0.10.0,>=0.9.48->llama-index) (2.2.2)
Requirement already satisfied: beautifulsoup4<5.0.0,>=4.12.3 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-readers-file<0.3.0,>=0.2.0->llama-index) (4.12.3)
Requirement already satisfied: pypdf<5.0.0,>=4.0.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-readers-file<0.3.0,>=0.2.0->llama-index) (4.3.1)
Requirement already satisfied: striprtf<0.0.27,>=0.0.26 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-readers-file<0.3.0,>=0.2.0->llama-index) (0.0.26)
Collecting llama-parse>=0.5.0 (from llama-index-readers-llama-parse>=0.3.0->llama-index)
  Using cached llama_parse-0.5.6-py3-none-any.whl.metadata (6.1 kB)
Requirement already satisfied: click in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from nltk>3.8.1->llama-index) (8.1.7)
Requirement already satisfied: joblib in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from nltk>3.8.1->llama-index) (1.4.2)
Requirement already satisfied: regex>=2021.8.3 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from nltk>3.8.1->llama-index) (2024.7.24)
Requirement already satisfied: aiohappyeyeballs>=2.3.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.10->llama-index) (2.4.0)
Requirement already satisfied: aiosignal>=1.1.2 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.10->llama-index) (1.3.1)
Requirement already satisfied: attrs>=17.3.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.10->llama-index) (24.2.0)
Requirement already satisfied: frozenlist>=1.1.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.10->llama-index) (1.4.1)
Requirement already satisfied: multidict<7.0,>=4.5 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.10->llama-index) (6.0.5)
Requirement already satisfied: yarl<2.0,>=1.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.10->llama-index) (1.11.0)
Requirement already satisfied: async-timeout<5.0,>=4.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.10->llama-index) (4.0.3)
Requirement already satisfied: soupsieve>1.2 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from beautifulsoup4<5.0.0,>=4.12.3->llama-index-readers-file<0.3.0,>=0.2.0->llama-index) (2.6)
Requirement already satisfied: anyio in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpx->llama-index-core<0.12.0,>=0.11.10->llama-index) (4.4.0)
Requirement already satisfied: certifi in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpx->llama-index-core<0.12.0,>=0.11.10->llama-index) (2024.8.30)
Requirement already satisfied: httpcore==1.* in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpx->llama-index-core<0.12.0,>=0.11.10->llama-index) (1.0.5)
Requirement already satisfied: idna in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpx->llama-index-core<0.12.0,>=0.11.10->llama-index) (3.8)
Requirement already satisfied: sniffio in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpx->llama-index-core<0.12.0,>=0.11.10->llama-index) (1.3.1)
Requirement already satisfied: h11<0.15,>=0.13 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpcore==1.*->httpx->llama-index-core<0.12.0,>=0.11.10->llama-index) (0.14.0)
Requirement already satisfied: distro<2,>=1.7.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from openai>=1.14.0->llama-index-agent-openai<0.4.0,>=0.3.1->llama-index) (1.9.0)
Requirement already satisfied: jiter<1,>=0.4.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from openai>=1.14.0->llama-index-agent-openai<0.4.0,>=0.3.1->llama-index) (0.5.0)
Requirement already satisfied: annotated-types>=0.6.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from pydantic<3.0.0,>=2.7.0->llama-index-core<0.12.0,>=0.11.10->llama-index) (0.7.0)
Requirement already satisfied: pydantic-core==2.23.3 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from pydantic<3.0.0,>=2.7.0->llama-index-core<0.12.0,>=0.11.10->llama-index) (2.23.3)
Requirement already satisfied: charset-normalizer<4,>=2 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from requests>=2.31.0->llama-index-core<0.12.0,>=0.11.10->llama-index) (3.3.2)
Requirement already satisfied: urllib3<3,>=1.21.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from requests>=2.31.0->llama-index-core<0.12.0,>=0.11.10->llama-index) (2.2.2)
Requirement already satisfied: greenlet!=0.4.17 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from SQLAlchemy>=1.4.49->SQLAlchemy[asyncio]>=1.4.49->llama-index-core<0.12.0,>=0.11.10->llama-index) (3.0.3)
Requirement already satisfied: mypy-extensions>=0.3.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from typing-inspect>=0.8.0->llama-index-core<0.12.0,>=0.11.10->llama-index) (1.0.0)
Requirement already satisfied: marshmallow<4.0.0,>=3.18.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from dataclasses-json->llama-index-core<0.12.0,>=0.11.10->llama-index) (3.22.0)
Requirement already satisfied: python-dateutil>=2.8.2 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from pandas->llama-index-legacy<0.10.0,>=0.9.48->llama-index) (2.9.0)
Requirement already satisfied: pytz>=2020.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from pandas->llama-index-legacy<0.10.0,>=0.9.48->llama-index) (2024.1)
Requirement already satisfied: tzdata>=2022.7 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from pandas->llama-index-legacy<0.10.0,>=0.9.48->llama-index) (2024.1)
Requirement already satisfied: exceptiongroup>=1.0.2 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from anyio->httpx->llama-index-core<0.12.0,>=0.11.10->llama-index) (1.2.2)
Requirement already satisfied: packaging>=17.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from marshmallow<4.0.0,>=3.18.0->dataclasses-json->llama-index-core<0.12.0,>=0.11.10->llama-index) (23.2)
Requirement already satisfied: six>=1.5 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from python-dateutil>=2.8.2->pandas->llama-index-legacy<0.10.0,>=0.9.48->llama-index) (1.16.0)
Using cached llama_index-0.11.10-py3-none-any.whl (6.8 kB)
Using cached llama_index_agent_openai-0.3.4-py3-none-any.whl (13 kB)
Using cached llama_index_cli-0.3.1-py3-none-any.whl (27 kB)
Using cached llama_index_embeddings_openai-0.2.5-py3-none-any.whl (6.1 kB)
Using cached llama_index_indices_managed_llama_cloud-0.3.1-py3-none-any.whl (10 kB)
Using cached llama_index_llms_openai-0.2.9-py3-none-any.whl (12 kB)
Using cached llama_index_multi_modal_llms_openai-0.2.1-py3-none-any.whl (5.9 kB)
Using cached llama_index_program_openai-0.2.0-py3-none-any.whl (5.3 kB)
Using cached llama_index_question_gen_openai-0.2.0-py3-none-any.whl (2.9 kB)
Using cached llama_index_readers_file-0.2.2-py3-none-any.whl (38 kB)
Using cached llama_index_readers_llama_parse-0.3.0-py3-none-any.whl (2.5 kB)
Using cached llama_cloud-0.0.17-py3-none-any.whl (187 kB)
Using cached llama_parse-0.5.6-py3-none-any.whl (10 kB)
Installing collected packages: llama-cloud, llama-parse, llama-index-readers-file, llama-index-llms-openai, llama-index-indices-managed-llama-cloud, llama-index-embeddings-openai, llama-index-readers-llama-parse, llama-index-multi-modal-llms-openai, llama-index-cli, llama-index-agent-openai, llama-index-program-openai, llama-index-question-gen-openai, llama-index
  Attempting uninstall: llama-cloud
    Found existing installation: llama-cloud 0.0.6
    Uninstalling llama-cloud-0.0.6:
      Successfully uninstalled llama-cloud-0.0.6
  Attempting uninstall: llama-parse
    Found existing installation: llama-parse 0.4.9
    Uninstalling llama-parse-0.4.9:
      Successfully uninstalled llama-parse-0.4.9
  Attempting uninstall: llama-index-readers-file
    Found existing installation: llama-index-readers-file 0.1.25
    Uninstalling llama-index-readers-file-0.1.25:
      Successfully uninstalled llama-index-readers-file-0.1.25
  Attempting uninstall: llama-index-llms-openai
    Found existing installation: llama-index-llms-openai 0.1.24
    Uninstalling llama-index-llms-openai-0.1.24:
      Successfully uninstalled llama-index-llms-openai-0.1.24
  Attempting uninstall: llama-index-indices-managed-llama-cloud
    Found existing installation: llama-index-indices-managed-llama-cloud 0.2.4
    Uninstalling llama-index-indices-managed-llama-cloud-0.2.4:
      Successfully uninstalled llama-index-indices-managed-llama-cloud-0.2.4
  Attempting uninstall: llama-index-embeddings-openai
    Found existing installation: llama-index-embeddings-openai 0.1.10
    Uninstalling llama-index-embeddings-openai-0.1.10:
      Successfully uninstalled llama-index-embeddings-openai-0.1.10
  Attempting uninstall: llama-index-readers-llama-parse
    Found existing installation: llama-index-readers-llama-parse 0.1.6
    Uninstalling llama-index-readers-llama-parse-0.1.6:
      Successfully uninstalled llama-index-readers-llama-parse-0.1.6
  Attempting uninstall: llama-index-multi-modal-llms-openai
    Found existing installation: llama-index-multi-modal-llms-openai 0.1.9
    Uninstalling llama-index-multi-modal-llms-openai-0.1.9:
      Successfully uninstalled llama-index-multi-modal-llms-openai-0.1.9
  Attempting uninstall: llama-index-cli
    Found existing installation: llama-index-cli 0.1.13
    Uninstalling llama-index-cli-0.1.13:
      Successfully uninstalled llama-index-cli-0.1.13
  Attempting uninstall: llama-index-agent-openai
    Found existing installation: llama-index-agent-openai 0.2.7
    Uninstalling llama-index-agent-openai-0.2.7:
      Successfully uninstalled llama-index-agent-openai-0.2.7
  Attempting uninstall: llama-index-program-openai
    Found existing installation: llama-index-program-openai 0.1.6
    Uninstalling llama-index-program-openai-0.1.6:
      Successfully uninstalled llama-index-program-openai-0.1.6
  Attempting uninstall: llama-index-question-gen-openai
    Found existing installation: llama-index-question-gen-openai 0.1.3
    Uninstalling llama-index-question-gen-openai-0.1.3:
      Successfully uninstalled llama-index-question-gen-openai-0.1.3
  Attempting uninstall: llama-index
    Found existing installation: llama-index 0.10.51
    Uninstalling llama-index-0.10.51:
      Successfully uninstalled llama-index-0.10.51
Successfully installed llama-cloud-0.0.17 llama-index-0.11.10 llama-index-agent-openai-0.3.4 llama-index-cli-0.3.1 llama-index-embeddings-openai-0.2.5 llama-index-indices-managed-llama-cloud-0.3.1 llama-index-llms-openai-0.2.9 llama-index-multi-modal-llms-openai-0.2.1 llama-index-program-openai-0.2.0 llama-index-question-gen-openai-0.2.0 llama-index-readers-file-0.2.2 llama-index-readers-llama-parse-0.3.0 llama-parse-0.5.6
Requirement already satisfied: llama-index-vector-stores-qdrant in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (0.3.0)
Requirement already satisfied: grpcio<2.0.0,>=1.60.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-vector-stores-qdrant) (1.63.2)
Requirement already satisfied: llama-index-core<0.12.0,>=0.11.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-vector-stores-qdrant) (0.11.10)
Requirement already satisfied: qdrant-client>=1.7.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-vector-stores-qdrant) (1.11.2)
Requirement already satisfied: PyYAML>=6.0.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (6.0.2)
Requirement already satisfied: SQLAlchemy>=1.4.49 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from SQLAlchemy[asyncio]>=1.4.49->llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (2.0.34)
Requirement already satisfied: aiohttp<4.0.0,>=3.8.6 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (3.10.5)
Requirement already satisfied: dataclasses-json in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (0.5.14)
Requirement already satisfied: deprecated>=1.2.9.3 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (1.2.14)
Requirement already satisfied: dirtyjson<2.0.0,>=1.0.8 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (1.0.8)
Requirement already satisfied: fsspec>=2023.5.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (2024.6.1)
Requirement already satisfied: httpx in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (0.27.2)
Requirement already satisfied: nest-asyncio<2.0.0,>=1.5.8 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (1.6.0)
Requirement already satisfied: networkx>=3.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (3.3)
Requirement already satisfied: nltk>3.8.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (3.9.1)
Requirement already satisfied: numpy<2.0.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (1.26.4)
Requirement already satisfied: pillow>=9.0.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (10.4.0)
Requirement already satisfied: pydantic<3.0.0,>=2.7.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (2.9.1)
Requirement already satisfied: requests>=2.31.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (2.32.3)
Requirement already satisfied: tenacity!=8.4.0,<9.0.0,>=8.2.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (8.4.2)
Requirement already satisfied: tiktoken>=0.3.3 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (0.7.0)
Requirement already satisfied: tqdm<5.0.0,>=4.66.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (4.66.5)
Requirement already satisfied: typing-extensions>=4.5.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (4.12.2)
Requirement already satisfied: typing-inspect>=0.8.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (0.9.0)
Requirement already satisfied: wrapt in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (1.16.0)
Requirement already satisfied: grpcio-tools>=1.41.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from qdrant-client>=1.7.1->llama-index-vector-stores-qdrant) (1.62.3)
Requirement already satisfied: portalocker<3.0.0,>=2.7.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from qdrant-client>=1.7.1->llama-index-vector-stores-qdrant) (2.10.1)
Requirement already satisfied: urllib3<3,>=1.26.14 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from qdrant-client>=1.7.1->llama-index-vector-stores-qdrant) (2.2.2)
Requirement already satisfied: aiohappyeyeballs>=2.3.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (2.4.0)
Requirement already satisfied: aiosignal>=1.1.2 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (1.3.1)
Requirement already satisfied: attrs>=17.3.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (24.2.0)
Requirement already satisfied: frozenlist>=1.1.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (1.4.1)
Requirement already satisfied: multidict<7.0,>=4.5 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (6.0.5)
Requirement already satisfied: yarl<2.0,>=1.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (1.11.0)
Requirement already satisfied: async-timeout<5.0,>=4.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (4.0.3)
Requirement already satisfied: protobuf<5.0dev,>=4.21.6 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from grpcio-tools>=1.41.0->qdrant-client>=1.7.1->llama-index-vector-stores-qdrant) (4.25.4)
Requirement already satisfied: setuptools in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from grpcio-tools>=1.41.0->qdrant-client>=1.7.1->llama-index-vector-stores-qdrant) (72.1.0)
Requirement already satisfied: anyio in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpx->llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (4.4.0)
Requirement already satisfied: certifi in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpx->llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (2024.8.30)
Requirement already satisfied: httpcore==1.* in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpx->llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (1.0.5)
Requirement already satisfied: idna in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpx->llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (3.8)
Requirement already satisfied: sniffio in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpx->llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (1.3.1)
Requirement already satisfied: h11<0.15,>=0.13 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpcore==1.*->httpx->llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (0.14.0)
Requirement already satisfied: h2<5,>=3 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpx[http2]>=0.20.0->qdrant-client>=1.7.1->llama-index-vector-stores-qdrant) (4.1.0)
Requirement already satisfied: click in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from nltk>3.8.1->llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (8.1.7)
Requirement already satisfied: joblib in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from nltk>3.8.1->llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (1.4.2)
Requirement already satisfied: regex>=2021.8.3 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from nltk>3.8.1->llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (2024.7.24)
Requirement already satisfied: annotated-types>=0.6.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from pydantic<3.0.0,>=2.7.0->llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (0.7.0)
Requirement already satisfied: pydantic-core==2.23.3 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from pydantic<3.0.0,>=2.7.0->llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (2.23.3)
Requirement already satisfied: charset-normalizer<4,>=2 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from requests>=2.31.0->llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (3.3.2)
Requirement already satisfied: greenlet!=0.4.17 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from SQLAlchemy>=1.4.49->SQLAlchemy[asyncio]>=1.4.49->llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (3.0.3)
Requirement already satisfied: mypy-extensions>=0.3.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from typing-inspect>=0.8.0->llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (1.0.0)
Requirement already satisfied: marshmallow<4.0.0,>=3.18.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from dataclasses-json->llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (3.22.0)
Requirement already satisfied: hyperframe<7,>=6.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from h2<5,>=3->httpx[http2]>=0.20.0->qdrant-client>=1.7.1->llama-index-vector-stores-qdrant) (6.0.1)
Requirement already satisfied: hpack<5,>=4.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from h2<5,>=3->httpx[http2]>=0.20.0->qdrant-client>=1.7.1->llama-index-vector-stores-qdrant) (4.0.0)
Requirement already satisfied: packaging>=17.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from marshmallow<4.0.0,>=3.18.0->dataclasses-json->llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (23.2)
Requirement already satisfied: exceptiongroup>=1.0.2 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from anyio->httpx->llama-index-core<0.12.0,>=0.11.0->llama-index-vector-stores-qdrant) (1.2.2)
Requirement already satisfied: llama-index-readers-file in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (0.2.2)
Requirement already satisfied: beautifulsoup4<5.0.0,>=4.12.3 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-readers-file) (4.12.3)
Requirement already satisfied: llama-index-core<0.12.0,>=0.11.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-readers-file) (0.11.10)
Requirement already satisfied: pandas in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-readers-file) (2.2.2)
Requirement already satisfied: pypdf<5.0.0,>=4.0.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-readers-file) (4.3.1)
Requirement already satisfied: striprtf<0.0.27,>=0.0.26 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-readers-file) (0.0.26)
Requirement already satisfied: soupsieve>1.2 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from beautifulsoup4<5.0.0,>=4.12.3->llama-index-readers-file) (2.6)
Requirement already satisfied: PyYAML>=6.0.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (6.0.2)
Requirement already satisfied: SQLAlchemy>=1.4.49 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from SQLAlchemy[asyncio]>=1.4.49->llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (2.0.34)
Requirement already satisfied: aiohttp<4.0.0,>=3.8.6 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (3.10.5)
Requirement already satisfied: dataclasses-json in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (0.5.14)
Requirement already satisfied: deprecated>=1.2.9.3 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (1.2.14)
Requirement already satisfied: dirtyjson<2.0.0,>=1.0.8 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (1.0.8)
Requirement already satisfied: fsspec>=2023.5.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (2024.6.1)
Requirement already satisfied: httpx in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (0.27.2)
Requirement already satisfied: nest-asyncio<2.0.0,>=1.5.8 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (1.6.0)
Requirement already satisfied: networkx>=3.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (3.3)
Requirement already satisfied: nltk>3.8.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (3.9.1)
Requirement already satisfied: numpy<2.0.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (1.26.4)
Requirement already satisfied: pillow>=9.0.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (10.4.0)
Requirement already satisfied: pydantic<3.0.0,>=2.7.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (2.9.1)
Requirement already satisfied: requests>=2.31.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (2.32.3)
Requirement already satisfied: tenacity!=8.4.0,<9.0.0,>=8.2.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (8.4.2)
Requirement already satisfied: tiktoken>=0.3.3 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (0.7.0)
Requirement already satisfied: tqdm<5.0.0,>=4.66.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (4.66.5)
Requirement already satisfied: typing-extensions>=4.5.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (4.12.2)
Requirement already satisfied: typing-inspect>=0.8.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (0.9.0)
Requirement already satisfied: wrapt in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (1.16.0)
Requirement already satisfied: python-dateutil>=2.8.2 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from pandas->llama-index-readers-file) (2.9.0)
Requirement already satisfied: pytz>=2020.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from pandas->llama-index-readers-file) (2024.1)
Requirement already satisfied: tzdata>=2022.7 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from pandas->llama-index-readers-file) (2024.1)
Requirement already satisfied: aiohappyeyeballs>=2.3.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (2.4.0)
Requirement already satisfied: aiosignal>=1.1.2 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (1.3.1)
Requirement already satisfied: attrs>=17.3.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (24.2.0)
Requirement already satisfied: frozenlist>=1.1.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (1.4.1)
Requirement already satisfied: multidict<7.0,>=4.5 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (6.0.5)
Requirement already satisfied: yarl<2.0,>=1.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (1.11.0)
Requirement already satisfied: async-timeout<5.0,>=4.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (4.0.3)
Requirement already satisfied: click in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from nltk>3.8.1->llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (8.1.7)
Requirement already satisfied: joblib in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from nltk>3.8.1->llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (1.4.2)
Requirement already satisfied: regex>=2021.8.3 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from nltk>3.8.1->llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (2024.7.24)
Requirement already satisfied: annotated-types>=0.6.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from pydantic<3.0.0,>=2.7.0->llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (0.7.0)
Requirement already satisfied: pydantic-core==2.23.3 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from pydantic<3.0.0,>=2.7.0->llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (2.23.3)
Requirement already satisfied: six>=1.5 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from python-dateutil>=2.8.2->pandas->llama-index-readers-file) (1.16.0)
Requirement already satisfied: charset-normalizer<4,>=2 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from requests>=2.31.0->llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (3.3.2)
Requirement already satisfied: idna<4,>=2.5 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from requests>=2.31.0->llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (3.8)
Requirement already satisfied: urllib3<3,>=1.21.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from requests>=2.31.0->llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (2.2.2)
Requirement already satisfied: certifi>=2017.4.17 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from requests>=2.31.0->llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (2024.8.30)
Requirement already satisfied: greenlet!=0.4.17 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from SQLAlchemy>=1.4.49->SQLAlchemy[asyncio]>=1.4.49->llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (3.0.3)
Requirement already satisfied: mypy-extensions>=0.3.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from typing-inspect>=0.8.0->llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (1.0.0)
Requirement already satisfied: marshmallow<4.0.0,>=3.18.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from dataclasses-json->llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (3.22.0)
Requirement already satisfied: anyio in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpx->llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (4.4.0)
Requirement already satisfied: httpcore==1.* in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpx->llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (1.0.5)
Requirement already satisfied: sniffio in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpx->llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (1.3.1)
Requirement already satisfied: h11<0.15,>=0.13 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpcore==1.*->httpx->llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (0.14.0)
Requirement already satisfied: packaging>=17.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from marshmallow<4.0.0,>=3.18.0->dataclasses-json->llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (23.2)
Requirement already satisfied: exceptiongroup>=1.0.2 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from anyio->httpx->llama-index-core<0.12.0,>=0.11.0->llama-index-readers-file) (1.2.2)
Requirement already satisfied: llama-index-embeddings-fastembed in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (0.2.0)
Requirement already satisfied: fastembed>=0.2.2 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-embeddings-fastembed) (0.3.6)
Requirement already satisfied: llama-index-core<0.12.0,>=0.11.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-embeddings-fastembed) (0.11.10)
Requirement already satisfied: PyStemmer<3.0.0,>=2.2.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from fastembed>=0.2.2->llama-index-embeddings-fastembed) (2.2.0.1)
Requirement already satisfied: huggingface-hub<1.0,>=0.20 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from fastembed>=0.2.2->llama-index-embeddings-fastembed) (0.24.6)
Requirement already satisfied: loguru<0.8.0,>=0.7.2 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from fastembed>=0.2.2->llama-index-embeddings-fastembed) (0.7.2)
Requirement already satisfied: mmh3<5.0,>=4.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from fastembed>=0.2.2->llama-index-embeddings-fastembed) (4.1.0)
Requirement already satisfied: numpy<2,>=1.21 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from fastembed>=0.2.2->llama-index-embeddings-fastembed) (1.26.4)
Requirement already satisfied: onnx<2.0.0,>=1.15.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from fastembed>=0.2.2->llama-index-embeddings-fastembed) (1.16.2)
Requirement already satisfied: onnxruntime<2.0.0,>=1.17.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from fastembed>=0.2.2->llama-index-embeddings-fastembed) (1.19.2)
Requirement already satisfied: pillow<11.0.0,>=10.3.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from fastembed>=0.2.2->llama-index-embeddings-fastembed) (10.4.0)
Requirement already satisfied: requests<3.0,>=2.31 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from fastembed>=0.2.2->llama-index-embeddings-fastembed) (2.32.3)
Requirement already satisfied: snowballstemmer<3.0.0,>=2.2.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from fastembed>=0.2.2->llama-index-embeddings-fastembed) (2.2.0)
Requirement already satisfied: tokenizers<1.0,>=0.15 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from fastembed>=0.2.2->llama-index-embeddings-fastembed) (0.19.1)
Requirement already satisfied: tqdm<5.0,>=4.66 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from fastembed>=0.2.2->llama-index-embeddings-fastembed) (4.66.5)
Requirement already satisfied: PyYAML>=6.0.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (6.0.2)
Requirement already satisfied: SQLAlchemy>=1.4.49 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from SQLAlchemy[asyncio]>=1.4.49->llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (2.0.34)
Requirement already satisfied: aiohttp<4.0.0,>=3.8.6 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (3.10.5)
Requirement already satisfied: dataclasses-json in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (0.5.14)
Requirement already satisfied: deprecated>=1.2.9.3 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (1.2.14)
Requirement already satisfied: dirtyjson<2.0.0,>=1.0.8 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (1.0.8)
Requirement already satisfied: fsspec>=2023.5.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (2024.6.1)
Requirement already satisfied: httpx in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (0.27.2)
Requirement already satisfied: nest-asyncio<2.0.0,>=1.5.8 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (1.6.0)
Requirement already satisfied: networkx>=3.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (3.3)
Requirement already satisfied: nltk>3.8.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (3.9.1)
Requirement already satisfied: pydantic<3.0.0,>=2.7.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (2.9.1)
Requirement already satisfied: tenacity!=8.4.0,<9.0.0,>=8.2.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (8.4.2)
Requirement already satisfied: tiktoken>=0.3.3 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (0.7.0)
Requirement already satisfied: typing-extensions>=4.5.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (4.12.2)
Requirement already satisfied: typing-inspect>=0.8.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (0.9.0)
Requirement already satisfied: wrapt in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (1.16.0)
Requirement already satisfied: aiohappyeyeballs>=2.3.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (2.4.0)
Requirement already satisfied: aiosignal>=1.1.2 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (1.3.1)
Requirement already satisfied: attrs>=17.3.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (24.2.0)
Requirement already satisfied: frozenlist>=1.1.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (1.4.1)
Requirement already satisfied: multidict<7.0,>=4.5 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (6.0.5)
Requirement already satisfied: yarl<2.0,>=1.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (1.11.0)
Requirement already satisfied: async-timeout<5.0,>=4.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (4.0.3)
Requirement already satisfied: filelock in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from huggingface-hub<1.0,>=0.20->fastembed>=0.2.2->llama-index-embeddings-fastembed) (3.16.0)
Requirement already satisfied: packaging>=20.9 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from huggingface-hub<1.0,>=0.20->fastembed>=0.2.2->llama-index-embeddings-fastembed) (23.2)
Requirement already satisfied: click in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from nltk>3.8.1->llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (8.1.7)
Requirement already satisfied: joblib in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from nltk>3.8.1->llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (1.4.2)
Requirement already satisfied: regex>=2021.8.3 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from nltk>3.8.1->llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (2024.7.24)
Requirement already satisfied: protobuf>=3.20.2 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from onnx<2.0.0,>=1.15.0->fastembed>=0.2.2->llama-index-embeddings-fastembed) (4.25.4)
Requirement already satisfied: coloredlogs in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from onnxruntime<2.0.0,>=1.17.0->fastembed>=0.2.2->llama-index-embeddings-fastembed) (15.0.1)
Requirement already satisfied: flatbuffers in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from onnxruntime<2.0.0,>=1.17.0->fastembed>=0.2.2->llama-index-embeddings-fastembed) (24.3.25)
Requirement already satisfied: sympy in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from onnxruntime<2.0.0,>=1.17.0->fastembed>=0.2.2->llama-index-embeddings-fastembed) (1.13.2)
Requirement already satisfied: annotated-types>=0.6.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from pydantic<3.0.0,>=2.7.0->llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (0.7.0)
Requirement already satisfied: pydantic-core==2.23.3 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from pydantic<3.0.0,>=2.7.0->llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (2.23.3)
Requirement already satisfied: charset-normalizer<4,>=2 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from requests<3.0,>=2.31->fastembed>=0.2.2->llama-index-embeddings-fastembed) (3.3.2)
Requirement already satisfied: idna<4,>=2.5 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from requests<3.0,>=2.31->fastembed>=0.2.2->llama-index-embeddings-fastembed) (3.8)
Requirement already satisfied: urllib3<3,>=1.21.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from requests<3.0,>=2.31->fastembed>=0.2.2->llama-index-embeddings-fastembed) (2.2.2)
Requirement already satisfied: certifi>=2017.4.17 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from requests<3.0,>=2.31->fastembed>=0.2.2->llama-index-embeddings-fastembed) (2024.8.30)
Requirement already satisfied: greenlet!=0.4.17 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from SQLAlchemy>=1.4.49->SQLAlchemy[asyncio]>=1.4.49->llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (3.0.3)
Requirement already satisfied: mypy-extensions>=0.3.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from typing-inspect>=0.8.0->llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (1.0.0)
Requirement already satisfied: marshmallow<4.0.0,>=3.18.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from dataclasses-json->llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (3.22.0)
Requirement already satisfied: anyio in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpx->llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (4.4.0)
Requirement already satisfied: httpcore==1.* in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpx->llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (1.0.5)
Requirement already satisfied: sniffio in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpx->llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (1.3.1)
Requirement already satisfied: h11<0.15,>=0.13 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpcore==1.*->httpx->llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (0.14.0)
Requirement already satisfied: exceptiongroup>=1.0.2 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from anyio->httpx->llama-index-core<0.12.0,>=0.11.0->llama-index-embeddings-fastembed) (1.2.2)
Requirement already satisfied: humanfriendly>=9.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from coloredlogs->onnxruntime<2.0.0,>=1.17.0->fastembed>=0.2.2->llama-index-embeddings-fastembed) (10.0)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from sympy->onnxruntime<2.0.0,>=1.17.0->fastembed>=0.2.2->llama-index-embeddings-fastembed) (1.3.0)
Requirement already satisfied: llama-index-llms-openai in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (0.2.9)
Requirement already satisfied: llama-index-core<0.12.0,>=0.11.7 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-llms-openai) (0.11.10)
Requirement already satisfied: openai<2.0.0,>=1.40.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-llms-openai) (1.44.0)
Requirement already satisfied: PyYAML>=6.0.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (6.0.2)
Requirement already satisfied: SQLAlchemy>=1.4.49 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from SQLAlchemy[asyncio]>=1.4.49->llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (2.0.34)
Requirement already satisfied: aiohttp<4.0.0,>=3.8.6 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (3.10.5)
Requirement already satisfied: dataclasses-json in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (0.5.14)
Requirement already satisfied: deprecated>=1.2.9.3 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (1.2.14)
Requirement already satisfied: dirtyjson<2.0.0,>=1.0.8 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (1.0.8)
Requirement already satisfied: fsspec>=2023.5.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (2024.6.1)
Requirement already satisfied: httpx in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (0.27.2)
Requirement already satisfied: nest-asyncio<2.0.0,>=1.5.8 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (1.6.0)
Requirement already satisfied: networkx>=3.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (3.3)
Requirement already satisfied: nltk>3.8.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (3.9.1)
Requirement already satisfied: numpy<2.0.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (1.26.4)
Requirement already satisfied: pillow>=9.0.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (10.4.0)
Requirement already satisfied: pydantic<3.0.0,>=2.7.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (2.9.1)
Requirement already satisfied: requests>=2.31.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (2.32.3)
Requirement already satisfied: tenacity!=8.4.0,<9.0.0,>=8.2.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (8.4.2)
Requirement already satisfied: tiktoken>=0.3.3 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (0.7.0)
Requirement already satisfied: tqdm<5.0.0,>=4.66.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (4.66.5)
Requirement already satisfied: typing-extensions>=4.5.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (4.12.2)
Requirement already satisfied: typing-inspect>=0.8.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (0.9.0)
Requirement already satisfied: wrapt in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (1.16.0)
Requirement already satisfied: anyio<5,>=3.5.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from openai<2.0.0,>=1.40.0->llama-index-llms-openai) (4.4.0)
Requirement already satisfied: distro<2,>=1.7.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from openai<2.0.0,>=1.40.0->llama-index-llms-openai) (1.9.0)
Requirement already satisfied: jiter<1,>=0.4.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from openai<2.0.0,>=1.40.0->llama-index-llms-openai) (0.5.0)
Requirement already satisfied: sniffio in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from openai<2.0.0,>=1.40.0->llama-index-llms-openai) (1.3.1)
Requirement already satisfied: aiohappyeyeballs>=2.3.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (2.4.0)
Requirement already satisfied: aiosignal>=1.1.2 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (1.3.1)
Requirement already satisfied: attrs>=17.3.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (24.2.0)
Requirement already satisfied: frozenlist>=1.1.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (1.4.1)
Requirement already satisfied: multidict<7.0,>=4.5 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (6.0.5)
Requirement already satisfied: yarl<2.0,>=1.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (1.11.0)
Requirement already satisfied: async-timeout<5.0,>=4.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (4.0.3)
Requirement already satisfied: idna>=2.8 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from anyio<5,>=3.5.0->openai<2.0.0,>=1.40.0->llama-index-llms-openai) (3.8)
Requirement already satisfied: exceptiongroup>=1.0.2 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from anyio<5,>=3.5.0->openai<2.0.0,>=1.40.0->llama-index-llms-openai) (1.2.2)
Requirement already satisfied: certifi in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpx->llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (2024.8.30)
Requirement already satisfied: httpcore==1.* in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpx->llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (1.0.5)
Requirement already satisfied: h11<0.15,>=0.13 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpcore==1.*->httpx->llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (0.14.0)
Requirement already satisfied: click in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from nltk>3.8.1->llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (8.1.7)
Requirement already satisfied: joblib in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from nltk>3.8.1->llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (1.4.2)
Requirement already satisfied: regex>=2021.8.3 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from nltk>3.8.1->llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (2024.7.24)
Requirement already satisfied: annotated-types>=0.6.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from pydantic<3.0.0,>=2.7.0->llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (0.7.0)
Requirement already satisfied: pydantic-core==2.23.3 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from pydantic<3.0.0,>=2.7.0->llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (2.23.3)
Requirement already satisfied: charset-normalizer<4,>=2 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from requests>=2.31.0->llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (3.3.2)
Requirement already satisfied: urllib3<3,>=1.21.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from requests>=2.31.0->llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (2.2.2)
Requirement already satisfied: greenlet!=0.4.17 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from SQLAlchemy>=1.4.49->SQLAlchemy[asyncio]>=1.4.49->llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (3.0.3)
Requirement already satisfied: mypy-extensions>=0.3.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from typing-inspect>=0.8.0->llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (1.0.0)
Requirement already satisfied: marshmallow<4.0.0,>=3.18.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from dataclasses-json->llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (3.22.0)
Requirement already satisfied: packaging>=17.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from marshmallow<4.0.0,>=3.18.0->dataclasses-json->llama-index-core<0.12.0,>=0.11.7->llama-index-llms-openai) (23.2)
Requirement already satisfied: llama-index-llms-groq in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (0.2.0)
Requirement already satisfied: llama-index-core<0.12.0,>=0.11.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-llms-groq) (0.11.10)
Requirement already satisfied: llama-index-llms-openai-like<0.3.0,>=0.2.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-llms-groq) (0.2.0)
Requirement already satisfied: PyYAML>=6.0.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (6.0.2)
Requirement already satisfied: SQLAlchemy>=1.4.49 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from SQLAlchemy[asyncio]>=1.4.49->llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (2.0.34)
Requirement already satisfied: aiohttp<4.0.0,>=3.8.6 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (3.10.5)
Requirement already satisfied: dataclasses-json in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (0.5.14)
Requirement already satisfied: deprecated>=1.2.9.3 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (1.2.14)
Requirement already satisfied: dirtyjson<2.0.0,>=1.0.8 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (1.0.8)
Requirement already satisfied: fsspec>=2023.5.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (2024.6.1)
Requirement already satisfied: httpx in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (0.27.2)
Requirement already satisfied: nest-asyncio<2.0.0,>=1.5.8 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (1.6.0)
Requirement already satisfied: networkx>=3.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (3.3)
Requirement already satisfied: nltk>3.8.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (3.9.1)
Requirement already satisfied: numpy<2.0.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (1.26.4)
Requirement already satisfied: pillow>=9.0.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (10.4.0)
Requirement already satisfied: pydantic<3.0.0,>=2.7.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (2.9.1)
Requirement already satisfied: requests>=2.31.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (2.32.3)
Requirement already satisfied: tenacity!=8.4.0,<9.0.0,>=8.2.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (8.4.2)
Requirement already satisfied: tiktoken>=0.3.3 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (0.7.0)
Requirement already satisfied: tqdm<5.0.0,>=4.66.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (4.66.5)
Requirement already satisfied: typing-extensions>=4.5.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (4.12.2)
Requirement already satisfied: typing-inspect>=0.8.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (0.9.0)
Requirement already satisfied: wrapt in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (1.16.0)
Requirement already satisfied: llama-index-llms-openai<0.3.0,>=0.2.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-llms-openai-like<0.3.0,>=0.2.0->llama-index-llms-groq) (0.2.9)
Requirement already satisfied: transformers<5.0.0,>=4.37.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-llms-openai-like<0.3.0,>=0.2.0->llama-index-llms-groq) (4.44.2)
Requirement already satisfied: aiohappyeyeballs>=2.3.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (2.4.0)
Requirement already satisfied: aiosignal>=1.1.2 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (1.3.1)
Requirement already satisfied: attrs>=17.3.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (24.2.0)
Requirement already satisfied: frozenlist>=1.1.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (1.4.1)
Requirement already satisfied: multidict<7.0,>=4.5 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (6.0.5)
Requirement already satisfied: yarl<2.0,>=1.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (1.11.0)
Requirement already satisfied: async-timeout<5.0,>=4.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.6->llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (4.0.3)
Requirement already satisfied: openai<2.0.0,>=1.40.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from llama-index-llms-openai<0.3.0,>=0.2.0->llama-index-llms-openai-like<0.3.0,>=0.2.0->llama-index-llms-groq) (1.44.0)
Requirement already satisfied: click in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from nltk>3.8.1->llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (8.1.7)
Requirement already satisfied: joblib in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from nltk>3.8.1->llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (1.4.2)
Requirement already satisfied: regex>=2021.8.3 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from nltk>3.8.1->llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (2024.7.24)
Requirement already satisfied: annotated-types>=0.6.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from pydantic<3.0.0,>=2.7.0->llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (0.7.0)
Requirement already satisfied: pydantic-core==2.23.3 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from pydantic<3.0.0,>=2.7.0->llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (2.23.3)
Requirement already satisfied: charset-normalizer<4,>=2 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from requests>=2.31.0->llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (3.3.2)
Requirement already satisfied: idna<4,>=2.5 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from requests>=2.31.0->llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (3.8)
Requirement already satisfied: urllib3<3,>=1.21.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from requests>=2.31.0->llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (2.2.2)
Requirement already satisfied: certifi>=2017.4.17 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from requests>=2.31.0->llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (2024.8.30)
Requirement already satisfied: greenlet!=0.4.17 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from SQLAlchemy>=1.4.49->SQLAlchemy[asyncio]>=1.4.49->llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (3.0.3)
Requirement already satisfied: filelock in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from transformers<5.0.0,>=4.37.0->llama-index-llms-openai-like<0.3.0,>=0.2.0->llama-index-llms-groq) (3.16.0)
Requirement already satisfied: huggingface-hub<1.0,>=0.23.2 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from transformers<5.0.0,>=4.37.0->llama-index-llms-openai-like<0.3.0,>=0.2.0->llama-index-llms-groq) (0.24.6)
Requirement already satisfied: packaging>=20.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from transformers<5.0.0,>=4.37.0->llama-index-llms-openai-like<0.3.0,>=0.2.0->llama-index-llms-groq) (23.2)
Requirement already satisfied: safetensors>=0.4.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from transformers<5.0.0,>=4.37.0->llama-index-llms-openai-like<0.3.0,>=0.2.0->llama-index-llms-groq) (0.4.5)
Requirement already satisfied: tokenizers<0.20,>=0.19 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from transformers<5.0.0,>=4.37.0->llama-index-llms-openai-like<0.3.0,>=0.2.0->llama-index-llms-groq) (0.19.1)
Requirement already satisfied: mypy-extensions>=0.3.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from typing-inspect>=0.8.0->llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (1.0.0)
Requirement already satisfied: marshmallow<4.0.0,>=3.18.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from dataclasses-json->llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (3.22.0)
Requirement already satisfied: anyio in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpx->llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (4.4.0)
Requirement already satisfied: httpcore==1.* in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpx->llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (1.0.5)
Requirement already satisfied: sniffio in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpx->llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (1.3.1)
Requirement already satisfied: h11<0.15,>=0.13 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpcore==1.*->httpx->llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (0.14.0)
Requirement already satisfied: distro<2,>=1.7.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from openai<2.0.0,>=1.40.0->llama-index-llms-openai<0.3.0,>=0.2.0->llama-index-llms-openai-like<0.3.0,>=0.2.0->llama-index-llms-groq) (1.9.0)
Requirement already satisfied: jiter<1,>=0.4.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from openai<2.0.0,>=1.40.0->llama-index-llms-openai<0.3.0,>=0.2.0->llama-index-llms-openai-like<0.3.0,>=0.2.0->llama-index-llms-groq) (0.5.0)
Requirement already satisfied: exceptiongroup>=1.0.2 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from anyio->httpx->llama-index-core<0.12.0,>=0.11.0->llama-index-llms-groq) (1.2.2)
Requirement already satisfied: qdrant_client in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (1.11.2)
Requirement already satisfied: fastembed in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (0.3.6)
Requirement already satisfied: grpcio>=1.41.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from qdrant_client) (1.63.2)
Requirement already satisfied: grpcio-tools>=1.41.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from qdrant_client) (1.62.3)
Requirement already satisfied: httpx>=0.20.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpx[http2]>=0.20.0->qdrant_client) (0.27.2)
Requirement already satisfied: numpy>=1.21 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from qdrant_client) (1.26.4)
Requirement already satisfied: portalocker<3.0.0,>=2.7.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from qdrant_client) (2.10.1)
Requirement already satisfied: pydantic>=1.10.8 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from qdrant_client) (2.9.1)
Requirement already satisfied: urllib3<3,>=1.26.14 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from qdrant_client) (2.2.2)
Requirement already satisfied: PyStemmer<3.0.0,>=2.2.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from fastembed) (2.2.0.1)
Requirement already satisfied: huggingface-hub<1.0,>=0.20 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from fastembed) (0.24.6)
Requirement already satisfied: loguru<0.8.0,>=0.7.2 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from fastembed) (0.7.2)
Requirement already satisfied: mmh3<5.0,>=4.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from fastembed) (4.1.0)
Requirement already satisfied: onnx<2.0.0,>=1.15.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from fastembed) (1.16.2)
Requirement already satisfied: onnxruntime<2.0.0,>=1.17.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from fastembed) (1.19.2)
Requirement already satisfied: pillow<11.0.0,>=10.3.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from fastembed) (10.4.0)
Requirement already satisfied: requests<3.0,>=2.31 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from fastembed) (2.32.3)
Requirement already satisfied: snowballstemmer<3.0.0,>=2.2.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from fastembed) (2.2.0)
Requirement already satisfied: tokenizers<1.0,>=0.15 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from fastembed) (0.19.1)
Requirement already satisfied: tqdm<5.0,>=4.66 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from fastembed) (4.66.5)
Requirement already satisfied: protobuf<5.0dev,>=4.21.6 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from grpcio-tools>=1.41.0->qdrant_client) (4.25.4)
Requirement already satisfied: setuptools in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from grpcio-tools>=1.41.0->qdrant_client) (72.1.0)
Requirement already satisfied: anyio in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpx>=0.20.0->httpx[http2]>=0.20.0->qdrant_client) (4.4.0)
Requirement already satisfied: certifi in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpx>=0.20.0->httpx[http2]>=0.20.0->qdrant_client) (2024.8.30)
Requirement already satisfied: httpcore==1.* in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpx>=0.20.0->httpx[http2]>=0.20.0->qdrant_client) (1.0.5)
Requirement already satisfied: idna in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpx>=0.20.0->httpx[http2]>=0.20.0->qdrant_client) (3.8)
Requirement already satisfied: sniffio in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpx>=0.20.0->httpx[http2]>=0.20.0->qdrant_client) (1.3.1)
Requirement already satisfied: h11<0.15,>=0.13 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpcore==1.*->httpx>=0.20.0->httpx[http2]>=0.20.0->qdrant_client) (0.14.0)
Requirement already satisfied: h2<5,>=3 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from httpx[http2]>=0.20.0->qdrant_client) (4.1.0)
Requirement already satisfied: filelock in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from huggingface-hub<1.0,>=0.20->fastembed) (3.16.0)
Requirement already satisfied: fsspec>=2023.5.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from huggingface-hub<1.0,>=0.20->fastembed) (2024.6.1)
Requirement already satisfied: packaging>=20.9 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from huggingface-hub<1.0,>=0.20->fastembed) (23.2)
Requirement already satisfied: pyyaml>=5.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from huggingface-hub<1.0,>=0.20->fastembed) (6.0.2)
Requirement already satisfied: typing-extensions>=3.7.4.3 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from huggingface-hub<1.0,>=0.20->fastembed) (4.12.2)
Requirement already satisfied: coloredlogs in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from onnxruntime<2.0.0,>=1.17.0->fastembed) (15.0.1)
Requirement already satisfied: flatbuffers in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from onnxruntime<2.0.0,>=1.17.0->fastembed) (24.3.25)
Requirement already satisfied: sympy in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from onnxruntime<2.0.0,>=1.17.0->fastembed) (1.13.2)
Requirement already satisfied: annotated-types>=0.6.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from pydantic>=1.10.8->qdrant_client) (0.7.0)
Requirement already satisfied: pydantic-core==2.23.3 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from pydantic>=1.10.8->qdrant_client) (2.23.3)
Requirement already satisfied: charset-normalizer<4,>=2 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from requests<3.0,>=2.31->fastembed) (3.3.2)
Requirement already satisfied: hyperframe<7,>=6.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from h2<5,>=3->httpx[http2]>=0.20.0->qdrant_client) (6.0.1)
Requirement already satisfied: hpack<5,>=4.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from h2<5,>=3->httpx[http2]>=0.20.0->qdrant_client) (4.0.0)
Requirement already satisfied: exceptiongroup>=1.0.2 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from anyio->httpx>=0.20.0->httpx[http2]>=0.20.0->qdrant_client) (1.2.2)
Requirement already satisfied: humanfriendly>=9.1 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from coloredlogs->onnxruntime<2.0.0,>=1.17.0->fastembed) (10.0)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (from sympy->onnxruntime<2.0.0,>=1.17.0->fastembed) (1.3.0)
Requirement already satisfied: python-dotenv in /home/adithya/miniconda3/envs/basic-rag/lib/python3.10/site-packages (1.0.1)

In [1]:

  Copied!     
 
import nest_asyncio

nest_asyncio.apply()
import nest_asyncio nest_asyncio.apply()

In [2]:

  Copied!     
 
# Standard library imports
import logging
import sys
import os

# Third-party imports
from dotenv import load_dotenv
from IPython.display import Markdown, display

# Qdrant client import
import qdrant_client

# LlamaIndex core imports
from llama_index.core import VectorStoreIndex, SimpleDirectoryReader
from llama_index.core import Settings

# LlamaIndex vector store import
from llama_index.vector_stores.qdrant import QdrantVectorStore

# Embedding model imports
from llama_index.embeddings.fastembed import FastEmbedEmbedding
from llama_index.embeddings.openai import OpenAIEmbedding

# LLM import
from llama_index.llms.openai import OpenAI
from llama_index.llms.groq import Groq
# Load environment variables
load_dotenv()

# Get OpenAI API key from environment variables
OPENAI_API_KEY = os.getenv("OPENAI_API_KEY")
GROK_API_KEY = os.getenv("GROQ_API_KEY")

# Setting up Base LLM
Settings.llm = OpenAI(
    model="gpt-4o-mini", temperature=0.1, max_tokens=1024, streaming=True
)

# Settings.llm = Groq(model="llama3-70b-8192" , api_key=GROK_API_KEY)

# Set the embedding model
# Option 1: Use FastEmbed with BAAI/bge-base-en-v1.5 model (default)
# Settings.embed_model = FastEmbedEmbedding(model_name="BAAI/bge-base-en-v1.5")

# Option 2: Use OpenAI's embedding model (commented out)
# If you want to use OpenAI's embedding model, uncomment the following line:
Settings.embed_model = OpenAIEmbedding(embed_batch_size=10, api_key=OPENAI_API_KEY)

# Qdrant configuration (commented out)
# If you're using Qdrant, uncomment and set these variables:
# QDRANT_CLOUD_ENDPOINT = os.getenv("QDRANT_CLOUD_ENDPOINT")
# QDRANT_API_KEY = os.getenv("QDRANT_API_KEY")

# Note: Remember to add QDRANT_CLOUD_ENDPOINT and QDRANT_API_KEY to your .env file if using Qdrant Hosted version
# Standard library imports import logging import sys import os # Third-party imports from dotenv import load_dotenv from IPython.display import Markdown, display # Qdrant client import import qdrant_client # LlamaIndex core imports from llama_index.core import VectorStoreIndex, SimpleDirectoryReader from llama_index.core import Settings # LlamaIndex vector store import from llama_index.vector_stores.qdrant import QdrantVectorStore # Embedding model imports from llama_index.embeddings.fastembed import FastEmbedEmbedding from llama_index.embeddings.openai import OpenAIEmbedding # LLM import from llama_index.llms.openai import OpenAI from llama_index.llms.groq import Groq # Load environment variables load_dotenv() # Get OpenAI API key from environment variables OPENAI_API_KEY = os.getenv("OPENAI_API_KEY") GROK_API_KEY = os.getenv("GROQ_API_KEY") # Setting up Base LLM Settings.llm = OpenAI( model="gpt-4o-mini", temperature=0.1, max_tokens=1024, streaming=True ) # Settings.llm = Groq(model="llama3-70b-8192" , api_key=GROK_API_KEY) # Set the embedding model # Option 1: Use FastEmbed with BAAI/bge-base-en-v1.5 model (default) # Settings.embed_model = FastEmbedEmbedding(model_name="BAAI/bge-base-en-v1.5") # Option 2: Use OpenAI's embedding model (commented out) # If you want to use OpenAI's embedding model, uncomment the following line: Settings.embed_model = OpenAIEmbedding(embed_batch_size=10, api_key=OPENAI_API_KEY) # Qdrant configuration (commented out) # If you're using Qdrant, uncomment and set these variables: # QDRANT_CLOUD_ENDPOINT = os.getenv("QDRANT_CLOUD_ENDPOINT") # QDRANT_API_KEY = os.getenv("QDRANT_API_KEY") # Note: Remember to add QDRANT_CLOUD_ENDPOINT and QDRANT_API_KEY to your .env file if using Qdrant Hosted version

Setting Up observability¶

In [ ]:

  Copied!     
 
# !pip install arize-phoenix
# !pip install openinference-instrumentation-llama-index
# !pip install -U llama-index-callbacks-arize-phoenix
# !pip install arize-phoenix # !pip install openinference-instrumentation-llama-index # !pip install -U llama-index-callbacks-arize-phoenix

In [3]:

  Copied!     
 
# from openinference.instrumentation.llama_index import LlamaIndexInstrumentor
# from opentelemetry.exporter.otlp.proto.http.trace_exporter import OTLPSpanExporter
# from opentelemetry.sdk import trace as trace_sdk
# from opentelemetry.sdk.trace.export import SimpleSpanProcessor

# endpoint = "http://127.0.0.1:6006/v1/traces"

# # Set up the Tracer Provider
# tracer_provider = trace_sdk.TracerProvider()

# # Add Span Processor to the Tracer Provider
# tracer_provider.add_span_processor(SimpleSpanProcessor(OTLPSpanExporter(endpoint)))

# # Instrument Llama Index with the Tracer Provider
# LlamaIndexInstrumentor().instrument(tracer_provider=tracer_provider)
# from openinference.instrumentation.llama_index import LlamaIndexInstrumentor # from opentelemetry.exporter.otlp.proto.http.trace_exporter import OTLPSpanExporter # from opentelemetry.sdk import trace as trace_sdk # from opentelemetry.sdk.trace.export import SimpleSpanProcessor # endpoint = "http://127.0.0.1:6006/v1/traces" # # Set up the Tracer Provider # tracer_provider = trace_sdk.TracerProvider() # # Add Span Processor to the Tracer Provider # tracer_provider.add_span_processor(SimpleSpanProcessor(OTLPSpanExporter(endpoint))) # # Instrument Llama Index with the Tracer Provider # LlamaIndexInstrumentor().instrument(tracer_provider=tracer_provider)

In [4]:

  Copied!     
 
# lets loading the documents using SimpleDirectoryReader

print("🔃 Loading Data")

from llama_index.core import Document
reader = SimpleDirectoryReader("../data/md/" , recursive=True)
documents = reader.load_data(show_progress=True)
# lets loading the documents using SimpleDirectoryReader print("🔃 Loading Data") from llama_index.core import Document reader = SimpleDirectoryReader("../data/md/" , recursive=True) documents = reader.load_data(show_progress=True)

🔃 Loading Data

Loading files: 100%|██████████| 13/13 [00:00<00:00, 41.67file/s]

Setting up Vector Database¶

We will be using qDrant as the Vector database There are 4 ways to initialize qdrant

Inmemory

client = qdrant_client.QdrantClient(location=":memory:")

Disk

client = qdrant_client.QdrantClient(path="./data")

Self hosted or Docker

client = qdrant_client.QdrantClient(
    # url="http://<host>:<port>"
    host="localhost",port=6333
)

Qdrant cloud

client = qdrant_client.QdrantClient(
    url=QDRANT_CLOUD_ENDPOINT,
    api_key=QDRANT_API_KEY,
)

for this notebook we will be using qdrant cloud

In [6]:

  Copied!     
 
# creating a qdrant client instance

client = qdrant_client.QdrantClient(
    # you can use :memory: mode for fast and light-weight experiments,
    # it does not require to have Qdrant deployed anywhere
    # but requires qdrant-client >= 1.1.1
    # location=":memory:"
    # otherwise set Qdrant instance address with:
    # url=QDRANT_CLOUD_ENDPOINT,
    # otherwise set Qdrant instance with host and port:
    host="localhost",
    port=6333
    # set API KEY for Qdrant Cloud
    # api_key=QDRANT_API_KEY,
    # path="./db/"
)

vector_store = QdrantVectorStore(client=client, collection_name="02_ReRanker_RAG")
# creating a qdrant client instance client = qdrant_client.QdrantClient( # you can use :memory: mode for fast and light-weight experiments, # it does not require to have Qdrant deployed anywhere # but requires qdrant-client >= 1.1.1 # location=":memory:" # otherwise set Qdrant instance address with: # url=QDRANT_CLOUD_ENDPOINT, # otherwise set Qdrant instance with host and port: host="localhost", port=6333 # set API KEY for Qdrant Cloud # api_key=QDRANT_API_KEY, # path="./db/" ) vector_store = QdrantVectorStore(client=client, collection_name="02_ReRanker_RAG")

Ingest Data into vector DB¶

In [ ]:

  Copied!     
 
## ingesting data into vector database

## lets set up an ingestion pipeline

from llama_index.core.node_parser import TokenTextSplitter
from llama_index.core.node_parser import SentenceSplitter
from llama_index.core.node_parser import MarkdownNodeParser
from llama_index.core.node_parser import SemanticSplitterNodeParser
from llama_index.core.ingestion import IngestionPipeline

pipeline = IngestionPipeline(
    transformations=[
        # MarkdownNodeParser(include_metadata=True),
        # TokenTextSplitter(chunk_size=500, chunk_overlap=20),
        SentenceSplitter(chunk_size=1024, chunk_overlap=20),
        # SemanticSplitterNodeParser(buffer_size=1, breakpoint_percentile_threshold=95 , embed_model=Settings.embed_model),
        Settings.embed_model,
    ],
    vector_store=vector_store,
)

# Ingest directly into a vector db
nodes = pipeline.run(documents=documents , show_progress=True)
print("Number of chunks added to vector DB :",len(nodes))
## ingesting data into vector database ## lets set up an ingestion pipeline from llama_index.core.node_parser import TokenTextSplitter from llama_index.core.node_parser import SentenceSplitter from llama_index.core.node_parser import MarkdownNodeParser from llama_index.core.node_parser import SemanticSplitterNodeParser from llama_index.core.ingestion import IngestionPipeline pipeline = IngestionPipeline( transformations=[ # MarkdownNodeParser(include_metadata=True), # TokenTextSplitter(chunk_size=500, chunk_overlap=20), SentenceSplitter(chunk_size=1024, chunk_overlap=20), # SemanticSplitterNodeParser(buffer_size=1, breakpoint_percentile_threshold=95 , embed_model=Settings.embed_model), Settings.embed_model, ], vector_store=vector_store, ) # Ingest directly into a vector db nodes = pipeline.run(documents=documents , show_progress=True) print("Number of chunks added to vector DB :",len(nodes))

Setting Up Index¶

In [7]:

  Copied!     
 
index = VectorStoreIndex.from_vector_store(vector_store=vector_store)
index = VectorStoreIndex.from_vector_store(vector_store=vector_store)

Retrieval Comparisons¶

In [8]:

  Copied!     
 
from llama_index.core.retrievers import VectorIndexRetriever
from llama_index.core import QueryBundle
import pandas as pd
from IPython.display import display, HTML
from copy import deepcopy
from llama_index.core.postprocessor import LLMRerank


def get_retrieved_nodes(
    query_str, vector_top_k=10, reranker_top_n=3, with_reranker=False
):
    query_bundle = QueryBundle(query_str)
    # configure retriever
    retriever = VectorIndexRetriever(
        index=index,
        similarity_top_k=vector_top_k,
    )
    retrieved_nodes = retriever.retrieve(query_bundle)

    if with_reranker:
        # configure reranker
        reranker = LLMRerank(
            choice_batch_size=5,
            top_n=reranker_top_n,
        )
        retrieved_nodes = reranker.postprocess_nodes(
            retrieved_nodes, query_bundle
        )

    return retrieved_nodes


def pretty_print(df):
    return display(HTML(df.to_html().replace("\\n", "<br>")))


def visualize_retrieved_nodes(nodes) -> None:
    result_dicts = []
    for node in nodes:
        # node = deepcopy(node)
        # node.node.metadata = None
        node_text = node.node.get_text()
        node_text = node_text.replace("\n", " ")

        result_dict = {"Score": node.score, "Text": node_text}
        result_dicts.append(result_dict)

    pretty_print(pd.DataFrame(result_dicts))
from llama_index.core.retrievers import VectorIndexRetriever from llama_index.core import QueryBundle import pandas as pd from IPython.display import display, HTML from copy import deepcopy from llama_index.core.postprocessor import LLMRerank def get_retrieved_nodes( query_str, vector_top_k=10, reranker_top_n=3, with_reranker=False ): query_bundle = QueryBundle(query_str) # configure retriever retriever = VectorIndexRetriever( index=index, similarity_top_k=vector_top_k, ) retrieved_nodes = retriever.retrieve(query_bundle) if with_reranker: # configure reranker reranker = LLMRerank( choice_batch_size=5, top_n=reranker_top_n, ) retrieved_nodes = reranker.postprocess_nodes( retrieved_nodes, query_bundle ) return retrieved_nodes def pretty_print(df): return display(HTML(df.to_html().replace("\\n", "
"))) def visualize_retrieved_nodes(nodes) -> None: result_dicts = [] for node in nodes: # node = deepcopy(node) # node.node.metadata = None node_text = node.node.get_text() node_text = node_text.replace("\n", " ") result_dict = {"Score": node.score, "Text": node_text} result_dicts.append(result_dict) pretty_print(pd.DataFrame(result_dicts))

In [9]:

  Copied!     
 
new_nodes = get_retrieved_nodes(
    "What is Attention", vector_top_k=5, with_reranker=False
)
new_nodes = get_retrieved_nodes( "What is Attention", vector_top_k=5, with_reranker=False )

In [10]:

  Copied!     
 
visualize_retrieved_nodes(new_nodes)
visualize_retrieved_nodes(new_nodes)

	Score	Text
0	0.828242	3.2 Attention An attention function can be described as mapping a query and a set of key-value pairs to an output, where the query, keys, values, and output are all vectors. The output is computed as a weighted sum. ---
1	0.828206	3.2 Attention An attention function can be described as mapping a query and a set of key-value pairs to an output, where the query, keys, values, and output are all vectors. The output is computed as a weighted sum. ---
2	0.825941	Attention Visualizations It is this spirit that a majority of American governments have passed new laws since 2009. Figure 3: An example of the attention mechanism following long-distance dependencies in the encoder self-attention in layer 5 of 6. Many of the attention heads attend to a distant dependency of the verb ‘making’, completing the phrase ‘making...more difficult’. Attentions here shown only for the word ‘making’. Different colors represent different heads. Best viewed in color. Voting process more difficult. ---
3	0.816966	Attention Visualizations It is this spirit that a majority of American governments have passed new laws since 2009. Figure 3: An example of the attention mechanism following long-distance dependencies in the encoder self-attention in layer 5 of 6. Attentions here shown only for the word ‘making’. Different colors represent different heads. Best viewed in color. ---
4	0.808573	Figure 4 Two attention heads, also in layer 5 of 6, apparently involved in anaphora resolution. Top: Full attentions for head 5. Bottom: Isolated attentions from just the word ‘its’ for attention heads 5 and 6. Note that the attentions are very sharp for this word. 14 ---

In [11]:

  Copied!     
 
new_nodes = get_retrieved_nodes(
    "What is Attention",
    vector_top_k=20,
    reranker_top_n=5,
    with_reranker=True,
)
new_nodes = get_retrieved_nodes( "What is Attention", vector_top_k=20, reranker_top_n=5, with_reranker=True, )

In [12]:

  Copied!     
 
visualize_retrieved_nodes(new_nodes)
visualize_retrieved_nodes(new_nodes)

	Score	Text
0	9.0	3.2 Attention An attention function can be described as mapping a query and a set of key-value pairs to an output, where the query, keys, values, and output are all vectors. The output is computed as a weighted sum. ---
1	9.0	3.2 Attention An attention function can be described as mapping a query and a set of key-value pairs to an output, where the query, keys, values, and output are all vectors. The output is computed as a weighted sum. ---
2	9.0	2 Background The goal of reducing sequential computation also forms the foundation of the Extended Neural GPU [16], ByteNet [18] and ConvS2S [9], all of which use convolutional neural networks as basic building block, computing hidden representations in parallel for all input and output positions. In these models, the number of operations required to relate signals from two arbitrary input or output positions grows in the distance between positions, linearly for ConvS2S and logarithmically for ByteNet. This makes it more difficult to learn dependencies between distant positions [12]. In the Transformer this is reduced to a constant number of operations, albeit at the cost of reduced effective resolution due to averaging attention-weighted positions, an effect we counteract with Multi-Head Attention as described in section 3.2. Self-attention, sometimes called intra-attention is an attention mechanism relating different positions of a single sequence in order to compute a representation of the sequence. Self-attention has been used successfully in a variety of tasks including reading comprehension, abstractive summarization, textual entailment and learning task-independent sentence representations [4, 27, 28, 22]. End-to-end memory networks are based on a recurrent attention mechanism instead of sequence-aligned recurrence and have been shown to perform well on simple-language question answering and language modeling tasks [34]. To the best of our knowledge, however, the Transformer is the first transduction model relying entirely on self-attention to compute representations of its input and output without using sequence-aligned RNNs or convolution. In the following sections, we will describe the Transformer, motivate self-attention and discuss its advantages over models such as [17, 18] and [9].
3	9.0	3.2.1 Scaled Dot-Product Attention We call our particular attention "Scaled Dot-Product Attention" (Figure 2). The input consists of queries and keys of dimension dk, and values of dimension dv. We compute the dot products of the query with all keys, divide each by √dk, and apply a softmax function to obtain the weights on the values. In practice, we compute the attention function on a set of queries simultaneously, packed together into a matrix Q. The keys and values are also packed together into matrices K and V. We compute the matrix of outputs as: Attention(Q, K, V) = softmax( √dk Q KT ) V (1) The two most commonly used attention functions are additive attention [2], and dot-product (multiplicative) attention. Dot-product attention is identical to our algorithm, except for the scaling factor √1/dk. Additive attention computes the compatibility function using a feed-forward network with a single hidden layer. While the two are similar in theoretical complexity, dot-product attention is much faster and more space-efficient in practice, since it can be implemented using highly optimized matrix multiplication code. While for small values of dk the two mechanisms perform similarly, additive attention outperforms dot product attention without scaling for larger values of dk [3]. We suspect that for large values of dk, the dot products grow large in magnitude, pushing the softmax function into regions where it has extremely small gradients4. To counteract this effect, we scale the dot products by √1/dk.
4	9.0	1 Introduction Recurrent neural networks, long short-term memory [13] and gated recurrent [7] neural networks in particular, have been firmly established as state of the art approaches in sequence modeling and transduction problems such as language modeling and machine translation [35, 2, 5]. Numerous efforts have since continued to push the boundaries of recurrent language models and encoder-decoder architectures [38, 24, 15]. Recurrent models typically factor computation along the symbol positions of the input and output sequences. Aligning the positions to steps in computation time, they generate a sequence of hidden states ht, as a function of the previous hidden state ht−1 and the input for position t. This inherently sequential nature precludes parallelization within training examples, which becomes critical at longer sequence lengths, as memory constraints limit batching across examples. Recent work has achieved significant improvements in computational efficiency through factorization tricks [21] and conditional computation [32], while also improving model performance in case of the latter. The fundamental constraint of sequential computation, however, remains. Attention mechanisms have become an integral part of compelling sequence modeling and transduction models in various tasks, allowing modeling of dependencies without regard to their distance in the input or output sequences [2, 19]. In all but a few cases [27], however, such attention mechanisms are used in conjunction with a recurrent network. In this work we propose the Transformer, a model architecture eschewing recurrence and instead relying entirely on an attention mechanism to draw global dependencies between input and output. The Transformer allows for significantly more parallelization and can reach a new state of the art in translation quality after being trained for as little as twelve hours on eight P100 GPUs.

LLM ReRanker¶

In [13]:

  Copied!     
 
query_engine = index.as_query_engine(
    similarity_top_k=10,
    node_postprocessors=[
        LLMRerank(
            choice_batch_size=5,
            top_n=2,
        )
    ],
    response_mode="tree_summarize",
)
query_engine = index.as_query_engine( similarity_top_k=10, node_postprocessors=[ LLMRerank( choice_batch_size=5, top_n=2, ) ], response_mode="tree_summarize", )

Cohere ReRanker¶

In [ ]:

  Copied!     
 
# !pip install llama-index-postprocessor-cohere-rerank
# !pip install llama-index-postprocessor-cohere-rerank

In [ ]:

  Copied!     
 
# from llama_index.postprocessor.cohere_rerank import CohereRerank

# cohere_api_key = os.environ["COHERE_API_KEY"]
# cohere_rerank = CohereRerank(api_key=cohere_api_key, top_n=2)

# query_engine = index.as_query_engine(
#     similarity_top_k=10,
#     node_postprocessors=[cohere_rerank],
# )
# from llama_index.postprocessor.cohere_rerank import CohereRerank # cohere_api_key = os.environ["COHERE_API_KEY"] # cohere_rerank = CohereRerank(api_key=cohere_api_key, top_n=2) # query_engine = index.as_query_engine( # similarity_top_k=10, # node_postprocessors=[cohere_rerank], # )

Colber ReRanker¶

In [ ]:

  Copied!     
 
# !pip install -U llama-index-postprocessor-colbert-rerank
# !pip install -U llama-index-postprocessor-colbert-rerank

In [ ]:

  Copied!     
 
# from llama_index.postprocessor.colbert_rerank import ColbertRerank

# colbert_reranker = ColbertRerank(
#     top_n=5,
#     model="colbert-ir/colbertv2.0",
#     tokenizer="colbert-ir/colbertv2.0",
#     keep_retrieval_score=True,
# )

# query_engine = index.as_query_engine(
#     similarity_top_k=10,
#     node_postprocessors=[colbert_reranker],
# )
# from llama_index.postprocessor.colbert_rerank import ColbertRerank # colbert_reranker = ColbertRerank( # top_n=5, # model="colbert-ir/colbertv2.0", # tokenizer="colbert-ir/colbertv2.0", # keep_retrieval_score=True, # ) # query_engine = index.as_query_engine( # similarity_top_k=10, # node_postprocessors=[colbert_reranker], # )

Flag Embedding ReRanker¶

In [ ]:

  Copied!     
 
# !pip install llama-index-postprocessor-flag-embedding-reranker
# !pip install git+https://github.com/FlagOpen/FlagEmbedding.git
# !pip install llama-index-postprocessor-flag-embedding-reranker # !pip install git+https://github.com/FlagOpen/FlagEmbedding.git

In [5]:

  Copied!     
 
# from llama_index.postprocessor.flag_embedding_reranker import (
#     FlagEmbeddingReranker,
# )

# rerank = FlagEmbeddingReranker(model="BAAI/bge-reranker-large", top_n=5)

# query_engine = index.as_query_engine(
#     similarity_top_k=10, node_postprocessors=[rerank]
# )
# from llama_index.postprocessor.flag_embedding_reranker import ( # FlagEmbeddingReranker, # ) # rerank = FlagEmbeddingReranker(model="BAAI/bge-reranker-large", top_n=5) # query_engine = index.as_query_engine( # similarity_top_k=10, node_postprocessors=[rerank] # )

Sentence Transformer ReRanker¶

In [ ]:

  Copied!     
 
# !pip install llama-index-embeddings-huggingface
# !pip install llama-index-embeddings-huggingface

In [ ]:

  Copied!     
 
# from llama_index.core.postprocessor import SentenceTransformerRerank

# rerank = SentenceTransformerRerank(
#     model="cross-encoder/ms-marco-MiniLM-L-2-v2", top_n=3
# )

# query_engine = index.as_query_engine(
#     similarity_top_k=10, node_postprocessors=[rerank]
# )
# from llama_index.core.postprocessor import SentenceTransformerRerank # rerank = SentenceTransformerRerank( # model="cross-encoder/ms-marco-MiniLM-L-2-v2", top_n=3 # ) # query_engine = index.as_query_engine( # similarity_top_k=10, node_postprocessors=[rerank] # ) 

Set Up Query Engine¶

In [14]:

  Copied!     
 
response = query_engine.query(
    "What is Attention"
)

display(Markdown(str(response)))
response = query_engine.query( "What is Attention" ) display(Markdown(str(response)))

Attention is a function that maps a query and a set of key-value pairs to an output. In this process, the query, keys, values, and output are all represented as vectors. The resulting output is calculated as a weighted sum of these vectors.