육두문자

Blog

RAG, FT 주저리주저리

kevin.lee
2024.07.18
#AI#LLM

RAG - 검색증강생성

pre-retrieval

  • indexing
  • query manipulate
  • query construction
  • query translation

retrieval

  • search ranking
  • hybrid search

post-retrieval

  • re-ranking -long context reorder
  • filtering

generation

  • enhancing

...RAPTOR, Re2G

RAFT - Retrieval Augmented FineTuning

FT - 학습

RAG - 오픈북

RAFT - FT+RAG

  • negative sample dataset tuning

PEFT - Parameter-Efficient Fine-Tuning

LoRA

Prompt Engineering

Copyright © 2024 KTB6 Team Blog