| Naslov: | Bridging the question–answer gap in retrieval-augmented generation : hypothetical prompt embeddings |
|---|
| Avtorji: | ID Vake, Domen (Avtor)
ID Vičič, Jernej (Avtor)
ID Tošić, Aleksandar (Avtor) |
|---|
| Datoteke: |  RAZ_Vake_Domen_2025.pdf (1,41 MB)
MD5: A642E181DB07BC4D6B4A0B0058B6E8EE
 https://ieeexplore.ieee.org/document/11080443
|
|---|
| Jezik: | Angleški jezik |
|---|
| Vrsta gradiva: | Članek v reviji |
|---|
| Tipologija: | 1.01 - Izvirni znanstveni članek |
|---|
| Organizacija: | FAMNIT - Fakulteta za matematiko, naravoslovje in informacijske tehnologije
|
|---|
| Opis: | Retrieval-Augmented Generation (RAG) systems synergize retrieval mechanisms with generative language models to enhance the accuracy and relevance of responses. However, bridging the style gap between user queries and relevant information in document text remains a persistent challenge in retrieval-augmented systems, often addressed by runtime solutions (e.g., Hypothetical Document Embeddings (HyDE)) that attempt to improve alignment but introduce extra computational overhead at query time. To address these challenges, we propose Hypothetical Prompt Embeddings (HyPE), a framework that shifts the generation of hypothetical content from query time to the indexing phase. By precomputing multiple hypothetical prompts for each data chunk and embedding the chunk in place of the prompt, HyPE transforms retrieval into a question-question matching task, bypassing the need for runtime synthetic answer generation. This approach does not introduce latency but also strengthens the alignment between queries and relevant context. Our experimental results on six common datasets show that HyPE can improve retrieval context precision by up to 42 percentage points and claim recall by up to 45 percentage points, compared to standard approaches, while remaining compatible with re-ranking, multi-vector retrieval, query decomposition, and other RAG advancements. |
|---|
| Ključne besede: | LLM, hypothetical prompt embedding, Retrieval-Augmented Generation (RAG) |
|---|
| Datum objave: | 15.07.2025 |
|---|
| Leto izida: | 2025 |
|---|
| Št. strani: | str. 129952-129961 |
|---|
| Številčenje: | Vol. 13 |
|---|
| PID: | 20.500.12556/RUP-21512  |
|---|
| UDK: | 004.8 |
|---|
| ISSN pri članku: | 2169-3536 |
|---|
| DOI: | 10.1109/ACCESS.2025.3589499 |
|---|
| COBISS.SI-ID: | 244701955 |
|---|
| Datum objave v RUP: | 04.08.2025 |
|---|
| Število ogledov: | 565 |
|---|
| Število prenosov: | 4 |
|---|
| Metapodatki: |    |
|---|
|
:
|
Kopiraj citat |
|---|
| | | | Skupna ocena: | (0 glasov) |
|---|
| Vaša ocena: | Ocenjevanje je dovoljeno samo prijavljenim uporabnikom. |
|---|
| Objavi na: |  |
|---|
Postavite miškin kazalec na naslov za izpis povzetka. Klik na naslov izpiše
podrobnosti ali sproži prenos. |
