Saved in:
Bibliographic Details
Main Authors: Vyborov, Eugene, Osypenko, Oleksiy, Sotnyk, Serge
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2406.08582
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • There are various methods for adapting LLMs to different domains. The most common methods are prompting, finetuning, and RAG. In this work, we explore the possibility of adapting a model using one of the PEFT methods - QLoRA. The experiment aims to simulate human responses based on their interviews. The simulation quality is assessed by comparing the quality of the style and the quality of the generated facts.