Saved in:
| Main Authors: | , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2401.14019 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913209037881344 |
|---|---|
| author | Bandel, Elron Perlitz, Yotam Venezian, Elad Friedman-Melamed, Roni Arviv, Ofir Orbach, Matan Don-Yehyia, Shachar Sheinwald, Dafna Gera, Ariel Choshen, Leshem Shmueli-Scheuer, Michal Katz, Yoav |
| author_facet | Bandel, Elron Perlitz, Yotam Venezian, Elad Friedman-Melamed, Roni Arviv, Ofir Orbach, Matan Don-Yehyia, Shachar Sheinwald, Dafna Gera, Ariel Choshen, Leshem Shmueli-Scheuer, Michal Katz, Yoav |
| contents | In the dynamic landscape of generative NLP, traditional text processing pipelines limit research flexibility and reproducibility, as they are tailored to specific dataset, task, and model combinations. The escalating complexity, involving system prompts, model-specific formats, instructions, and more, calls for a shift to a structured, modular, and customizable solution. Addressing this need, we present Unitxt, an innovative library for customizable textual data preparation and evaluation tailored to generative language models. Unitxt natively integrates with common libraries like HuggingFace and LM-eval-harness and deconstructs processing flows into modular components, enabling easy customization and sharing between practitioners. These components encompass model-specific formats, task prompts, and many other comprehensive dataset processing definitions. The Unitxt-Catalog centralizes these components, fostering collaboration and exploration in modern textual data workflows. Beyond being a tool, Unitxt is a community-driven platform, empowering users to build, share, and advance their pipelines collaboratively. Join the Unitxt community at https://github.com/IBM/unitxt! |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_14019 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Unitxt: Flexible, Shareable and Reusable Data Preparation and Evaluation for Generative AI Bandel, Elron Perlitz, Yotam Venezian, Elad Friedman-Melamed, Roni Arviv, Ofir Orbach, Matan Don-Yehyia, Shachar Sheinwald, Dafna Gera, Ariel Choshen, Leshem Shmueli-Scheuer, Michal Katz, Yoav Computation and Language Artificial Intelligence In the dynamic landscape of generative NLP, traditional text processing pipelines limit research flexibility and reproducibility, as they are tailored to specific dataset, task, and model combinations. The escalating complexity, involving system prompts, model-specific formats, instructions, and more, calls for a shift to a structured, modular, and customizable solution. Addressing this need, we present Unitxt, an innovative library for customizable textual data preparation and evaluation tailored to generative language models. Unitxt natively integrates with common libraries like HuggingFace and LM-eval-harness and deconstructs processing flows into modular components, enabling easy customization and sharing between practitioners. These components encompass model-specific formats, task prompts, and many other comprehensive dataset processing definitions. The Unitxt-Catalog centralizes these components, fostering collaboration and exploration in modern textual data workflows. Beyond being a tool, Unitxt is a community-driven platform, empowering users to build, share, and advance their pipelines collaboratively. Join the Unitxt community at https://github.com/IBM/unitxt! |
| title | Unitxt: Flexible, Shareable and Reusable Data Preparation and Evaluation for Generative AI |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2401.14019 |