STEFANN: Scene Text Editor using Font Adaptive Neural Network
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2019
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866912234252271616 |
|---|---|
| author | Roy, Prasun Bhattacharya, Saumik Ghosh, Subhankar Pal, Umapada |
| author_facet | Roy, Prasun Bhattacharya, Saumik Ghosh, Subhankar Pal, Umapada |
| contents | Textual information in a captured scene plays an important role in scene interpretation and decision making. Though there exist methods that can successfully detect and interpret complex text regions present in a scene, to the best of our knowledge, there is no significant prior work that aims to modify the textual information in an image. The ability to edit text directly on images has several advantages including error correction, text restoration and image reusability. In this paper, we propose a method to modify text in an image at character-level. We approach the problem in two stages. At first, the unobserved character (target) is generated from an observed character (source) being modified. We propose two different neural network architectures - (a) FANnet to achieve structural consistency with source font and (b) Colornet to preserve source color. Next, we replace the source character with the generated character maintaining both geometric and visual consistency with neighboring characters. Our method works as a unified platform for modifying text in images. We present the effectiveness of our method on COCO-Text and ICDAR datasets both qualitatively and quantitatively. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_1903_01192 |
| institution | arXiv |
| publishDate | 2019 |
| record_format | arxiv |
| spellingShingle | STEFANN: Scene Text Editor using Font Adaptive Neural Network Roy, Prasun Bhattacharya, Saumik Ghosh, Subhankar Pal, Umapada Computer Vision and Pattern Recognition Multimedia Textual information in a captured scene plays an important role in scene interpretation and decision making. Though there exist methods that can successfully detect and interpret complex text regions present in a scene, to the best of our knowledge, there is no significant prior work that aims to modify the textual information in an image. The ability to edit text directly on images has several advantages including error correction, text restoration and image reusability. In this paper, we propose a method to modify text in an image at character-level. We approach the problem in two stages. At first, the unobserved character (target) is generated from an observed character (source) being modified. We propose two different neural network architectures - (a) FANnet to achieve structural consistency with source font and (b) Colornet to preserve source color. Next, we replace the source character with the generated character maintaining both geometric and visual consistency with neighboring characters. Our method works as a unified platform for modifying text in images. We present the effectiveness of our method on COCO-Text and ICDAR datasets both qualitatively and quantitatively. |
| title | STEFANN: Scene Text Editor using Font Adaptive Neural Network |
| topic | Computer Vision and Pattern Recognition Multimedia |
| url | https://arxiv.org/abs/1903.01192 |