williamyang1991 / awesome-artistic-typography

Awesome Artistic Typography

Welcome to Awesome-Artistic-Typography! This is a comprehensive list of artistic typography, including methods and datasets introduced for text stylization and semantic typography tasks. Further information are available in paper: Intelligent Artistic Typography: A Comprehensive Review of Artistic Text Design and Generation.

(Source: Shape-Matching GAN, Zou et al., Anything to Glyph, Typography With Decor , Wordart Designer and DS-Fusion)

Table of Contents

• Artistic Text Stylization
  • Static Artistic Text Stylization
    • Text effect transfer
    • Arbitrary style transfer on text
    • Joint artistic style and font style transfer
  • Dynamic Artistic Text Stylization
    • Dynamic text effect transfer
    • Arbitrary dynamic style transfer on text
• Semantic Typography
  • Static Semantic Typography
    • Character-level semantic typography
    • Word-level semantic typography
  • Kinetic Typography
• Datasets

Artistic Text Stylization

Static Artistic Text Stylization

Text effect transfer

(Source: TET-GAN)

Title	Method	Feature	Code	Pub. & Date
Artistic Text Effect Transfer with Conditonal Generative Adversarial Network	GAN-based	simplified TET-GAN	-	CACML, 2022
Text Style Transfer With Decorative Elements	GAN-based	decor transfer on Chinese characters	-	MIPR, 2021
Typography with decor: Intelligent text style transfer	GAN-based	decorative element (decor) transfer	code	CVPR, 2019
TET-GAN: Text effects transfer via stylization and destylization	GAN-based	style-glyph disentanglement	code	AAAI, 2019
A Common Framework for Interactive Texture Transfer	GAN-based	versatile interactive texture transfer	code	CVPR, 2018
Awesome typography: StatisticsBased Text Effects Transfer	patch-based	distribution-aware text effect prior	code	CVPR, 2017
Texture transfer based on continuous structure of texture patches for design of artistic Shodo fonts	stroke-based	Ink texture synthesis along strokes	-	SIGGRAPH Asia, 2010

Arbitrary style transfer on text

(Source: UT-Effect)

Title	Method	Feature	Code	Pub. & Date
Anything to glyph: Artistic font synthesis via text-to-image diffusion model	diffusion-based	place objects according to the glyph	-	SIGGRAPH Asia, 2023
Intelligent Typography: Artistic Text Style Transfer for Complex Texture and Structure	GAN-based	coarse-to-fine complex style transfer	code	TMM, 2023
An Art Font Generation Technique using Pix2Pix-based Networks	GAN-based	train a network to generate data	-	BNCSS, 2023
Style transfer network for complex multi-stroke text	GAN-based	clean edges by erosion and dilation	-	MS, 2023
Improving Font Effect Generation based on Pyramid Style Feature	GAN-based	clean edges by erosion and dilation	-	IJPE, 2020
Controllable Artistic Text Style Transfer via Shape-Matching GAN	GAN-based	one-shot learning; style degree control	code	ICCV, 2019
Context-Aware Unsupervised Text Stylization	patch-based	structure transfer & texture transfer	-	ACM MM, 2018

Joint artistic style and font style transfer

(Source: FET-GAN)

Title	Method	Feature	Code	Pub. & Date
Text style transfer based on multi-factor disentanglement and mixture	GAN-based	effect-font-glyph disentanglement	-	ACM MM, 2022
Gentext: Unsupervised artistic text generation via decoupled font and texture manipulation	GAN-based	multi-task end-to-end training	-	July, 2022
Dse-net: Artistic font image synthesis via disentangled style encoding	GAN-based	effect-font-glyph disentanglement	code	ICME, 2022
Few-Shot Text Style Transfer via Deep Feature Similarity	GAN-based	weighted style representation	-	TIP, 2020
FET-GAN: Font and Effect Transfer via K-shot Adaptive Instance Normalization	GAN-based	AdaIN-based text style modelling	code	AAAI, 2020
Art Font Image Generation with Conditional Generative Adversarial Networks	GAN-based	text edge and skeleton as auxiliary input	-	CACNDRW, 2020
Artistic glyph image synthesis via one-stage few-shot learning	GAN-based	two parallel encoder-decoder branches	code	ACM TOG, 2019
Neural Style Transfer for Characters Synthesis via Stack Network	GAN-based	coarse-to-fine cascaded stack network	-	ICONIP, 2019
Multi-content gan for few-shot font style transfer	GAN-based	end-to-end stack network	code	CVPR, 2018

Dynamic Artistic Text Stylization

(Source: DynTypo)

Dynamic text effect transfer

Title	Method	Feature	Code	Pub. & Date
Dynamic Texture Transfer using PatchMatch and Transformers	patch & transformer-based	long-distance dependency modeling	-	Feb, 2024
DynTypo: Example-based Dynamic Text Effects Transfer	patch-based	global NNF search across frames	code	CVPR, 2019

Arbitrary dynamic style transfer on text

Title	Method	Feature	Code	Pub. & Date
Shape-Matching GAN++: Scale Controllable Dynamic Artistic Text Style Transfer	GAN-based	spatial-temporal structural mappings	-	TPAMI, 2021

Semantic Typography

Static Semantic Typography

Character-level semantic typography

(Source: Zhang et al.，Trick or treat，Iluz et al., and DS-Fusion)

Title	Method	Feature	Code	Pub. & Date
WordArt Designer: User-Driven Artistic Typography Synthesis using Large Language Models	LLM and diffusion-based	user-controllable artistic design	-	Nov, 2023
Ds-fusion: Artistic typography via discriminated and stylized diffusion	diffusion-based	raster semantic feature enhancement	code	ICCV, 2023
Word-as-image for semantic typography	diffusion-based	vector glyph shape deformation	code	ACM TOG, 2023
Trick or treat: Thematic reinforcement for artistic typography	retrieval-based	unsupervised autoencoder matching	code	Mar, 2019
Synthesizing Ornamental Typefaces	retrieval-based	joint semantic and shape matching	-	CGF, 2017

Word-level semantic typography

(Source: Xu et al.，Zou et al., and Zhang et al.)

Title	Method	Feature	Code	Pub. & Date
Creating Word Paintings Jointly Considering Semantics, Attention, and Aesthetics	vector field & SVM-based	visual saliency for aesthetic optimization	-	ACM TAP, 2022
Legible compact calligrams	warp-based	legibility enhanced calligram	-	ACM TOG, 2016
PicWords: Render a picture by packing keywords	warp-based	keyword semantic priority ranking	code	TMM, 2014
Digital Micrography	vector field-based	adaptive text layout synthesis	-	ACM TOG, 2011
Structure-based ASCII Art	structure-based	structural ASCII art generation	-	ACM SIGGRAPH, 2010
Calligraphic packing	warp-based	shape adaptive text warping	-	GL, 2007

Kinetic Typography

(Source: Dynamic Typography)

Title	Method	Feature	Code	Pub. & Date
Dynamic Typography: Bringing Text to Life via Video Diffusion Prior	diffusion-based	character deformation and animation	code	Apr, 2024
Creating emordle: Animating word cloud for emotion expression	frame-based	emotional word cloud animation	-	TVCG, 2023

Datasets

Name	Type	Images	Feature	Download	Pub. & Date
AnyWord-3M	visual text	3,034,486	text images from several datasets 1.6 million in Chinese, 1.39 million in English, and 10k images in other languages.	ModelScope	2024
LAION-Glyph	visual text	∼10,000,000	mages with rich visual text content	Github	2023
MARIO-10M	visual text	10,061,720	9,194,613, 343,423 and 523,684 text images from natural images, posters, and book covers, respectively.	Github	2023
TextLogo3K	text logo	3,470	text logo images extracted from poster/covers of movies, TV series and comics.	Google Drive	2022
SSAF-CN SSAF-EN	text effects	97,200 2,600	00 text effects rendered on 972 Chinese characters. 100 text effects rendered on 26 English letters.	Google Drive Baidu Pan (code: 4jom)	2022
Imgur5K	handwriting	135,375	135,375 handwritten English words from 5,305 images	Github	2021
TE141K-E TE141K-C TE141K-S	text effects	66,196 54,405 20,480	64 text effects on 52 English letters of 19 fonts. 65 text effects rendered on 775 Chinese characters, 52 English letters and 10 Arabic numerals. 20 text effects rendered on 56 special symbols, and 968 letters in Japanese, Russian, etc.	Google Drive Baidu Pan (code: knzy)	2020
TextEffects-Decor	text effects	59,280	64 text effects with decorative elements rendered on 52 English letters of 19 fonts.	Google Drive	2019
TET-GAN	text effects	53,568	64 text effects rendered on 775 Chinese characters, 52 English letters and 10 Arabic numerals.	Google Drive Baidu Pan	2019
AGIS-Net-C AGIS-Net-P	joint font & text effects	1,571,940 256,410	synthetic artistic Chinese characters professional-designed artistic Chinese characters.	Dropbox MEGA	2019
MC-GAN-Gray MC-GAN-Color	joint font & text effects	260,000 520,000	gray-scale english letter colorful english letter	Github	2018