TODO

TODO

We optimized the brush and stroke parameters and learned the brush styles of existing illustrations.

We automatically extracted cracks in the rock by combining image features and Gaussian process regression.

TODO

In this paper, we fine-tuned an encoder of Transformer and used Transformer's self-attention architecture for landmark detection.

We proposed an evaluation approach for Line art colorization that focuses on hints and is standardized by utilizing deterministically generated hints.

We did experiments about probabilistic chart generation using previous study and our proposed tricks: Test-time Dropout and Reparameterization-trick.

We improve the learning method of a reinforcement learning agent playing NetHack from three perspectives: inventory, in-game string, and the use of expert data.

We propose a new Tubelet Action Detection model utilizing object queries.

We present a new multi-domain adversarial transformer for ISO domain transformation to improve the quality of low-light photographs.

We propose a new approach for pixel-wise image enhancement non-locally and a new metric for examining RGB color image quality.

In this thesis, I applied a Variational Autoencoder (VAE), a deep generative model, to automatically generate more realistic and diverse dances from music.

A type of SSGI was implemented on WebGL.

We propose a new model that is able to handle permutation-invariant input data with low computational power, which shows better performance in playing Danmaku games compared to the SOTA methods. We also created a Gym environment for Danmaku games that eases further researches.

We proposed four improvement methods for vintage video degradation that is difficult to restore, and verified their effectiveness.

TODO

We propose two methods for controllable generation of complex graphic layouts. The first method uses a pre-trained deep generative model to generate layouts that satisfy given constraints. The second method represents visual containment as a tree structure and generates web page layouts. Finally, we summarize design guidelines for controllable generation methods and discuss future directions.

We propose to generate brand new Super Mario Bros(SMB) levels using PixelCNN++ model. With the input of the original SMB maps data, we can predict the arrangement of different tiles for a brand new SMB level.

I introduced a novel multi-agent competition-based framework to train reinforcement learning agents to play Pokemon. Experiments showed that agents trained with out method outperformed those trained with self-play, even without reward shaping.

We proposed and experimented on multiple conditional Generative Adversarial Networks models for colorizing line art based on the given color hints by the user.

We defined an interface (gyms environment) to SUMO so that modeling of automated driving can be done using inter-vehicle communication and reinforcement learning, and verified that the interface works by conducting reinforcement learning experiments.

WaveNet has achieved high accuracy in the Text-To-Speech task. We hypothesized and experimented that it may perform well in chart-generation task.

I applied reinforcement learning to NetHack in order to learn strategies. I proposed the model for this purpose and confirmed its effectiveness.

We introduced LoL-V2T: a large video-to-text dataset and generated captions for esports footage with deep learning.

We propose a combination of 3 deep learning models to estimate the key which you want to press based on the hand poses which is taken with one RGB camera.

We proposed a method for learning efficiently when studying mathematics. Focusing on the dependency of the problem, we measured the efficiency of problem selection.

I worked on the experiment that creators can easily complete incomplete coloring which occurs while painting by deep learning.

I worked on the experiment that the model would be able to generate line image of characters from its illustration automatically using deep learning. Adding to typical loss function, I used 'perceptual loss' to raise accuracy of the model.

I developed Neural Networks for airfoil estimation, and the NN performed 1000x faster than conventional analysis. In addition, I developed web interface of the NN for airplane novices.