AI for Manga & Anime
15 Jul 2018At Anime Expo 2018 in Los Angeles, we gave the keynote AI for Manga & Anime (AIMA_AX)!
The main goal of this keynote was to showcase amazing applications of AI to mangas & anime series.
Here are some pictures and slides.
Create Anime Characters using AI
Crypko and MakeGirls.Moe were presented by Jingtao Tian (3rd on the image), Yanghua Jin (2nd) and Minjun Li (1st).
- Get the slides (PDF)
- MakeGirlsMoe – Technical Report (NIPS Workshop for Creativity & Design)
- Crypko – White paper
Make.Girls.Moe got 1 million views the first 10 days. Our research proceedings were quickly sold out at the Comic Market #92 (Tokyo) in Summer 2017.
Here is an example of what can be achieved using GANs to generate anime characters.
About the authors
- Yanghua Jin (Fudan University & Crypko, China)
- Yingtao Tian (Stony Brook University & Crypko)
- Minjun Li (Fudan University & Crypko)
Using Posters to recommend anime and mangas
Mangaki, a anime/manga recommender system presented by Jill-Jênn Vie from RIKEN AIP, Tokyo.
Everyone regularly ask themselves what movie, series or book they should watch next, according to their taste. Mangaki is a award-winning website that innovates access to Japanese culture through a recommender system. When a user shows up, our algorithm asks them to rate a few works. Based on their answers, they receive a personalized to-watch list of anime & manga, by geometrically positioning their ratings within those collected from other users, and using deep learning to extract information from manga covers or anime posters.
Mangaki gathered 330k ratings from 2,000 people over 11,000 anime & manga works. In Summer 2017, we released them for a data challenge organized by Kyoto University that attracted 31 submissions from 11 countries. Mangaki was awarded the first prize by the Japan Foundation (Paris branch), and an open source award by Microsoft Ventures.
- Get the slides (PDF)
- Tool: Illustration2Vec by Yusuke Matsui
- Mangaki
- Press release
- Article accepted at the MANPU workshop: the BALSE algorithm
理研AIPはどこに向かっているんだ…… https://t.co/kZcuL8IGih pic.twitter.com/0i1d0FlQ0o
— Yosuke Shinya (@shinya7y) 11 novembre 2017
About the author
- Jill-Jênn Vie (RIKEN AIP, Japan & Mangaki, France)
Automatic Manga Colorization
PaintsChainer
The first part, PaintsChainer, was introduced by Taizan Yonetsuji from Preferred Networks, Japan.
Here is the kind of work that can be achieved using PaintsChainer.
style2paints
The second part, style2paints, was presented by LvMing Zhang from Soochow University, China.
Here is the kind of work that can be achieved using style2paints.
About the authors
- LvMing Zhang (Soochow University, China)
- Taizan Yonetsuji (Preferred Networks, Japan)
Manga Style Transfer
Cross-Domain Translation of Human Portraits.
Here is another example of what can be achieved using TwinGAN.
About the authors
- Jerry Li (Google)
Don’t hesitate to contact the authors to know more! And you can browse the photos of the keynote.