Publications

International Journal & Conference

2024

Taiga Kashima, Ikki Kishida, Ayako Amma, Hideki Nakayama,
"FedFit: Server Aggregation Through Linear Regression in Federated Learning",
IEEE Access, Vol. 12, pp. 22803-22812, 2024.

Kai Katsumata, Duc Minh Vo, Tatsuya Harada, Hideki Nakayama,
"Soft Curriculum for Learning Conditional GANs with Noisy-Labeled and Uncurated Unlabeled Data",
In Proceedings of the IEEE Winter Conference on Applications of Computer Vision (WACV), 2024.

Kai Katsumata, Duc Minh Vo, Bei Liu, Hideki Nakayama,
"Revisiting Latent Space of GAN Inversion for Robust Real Image Editing",
In Proceedings of the IEEE Winter Conference on Applications of Computer Vision (WACV), 2024.

Kai Katsumata, Duc Minh Vo, Hideki Nakayama,
"Label Augmentation as Inter-class Data Augmentation for Conditional Image Synthesis with Imbalanced Data",
In Proceedings of the IEEE Winter Conference on Applications of Computer Vision (WACV), 2024.

2023

Jiaxuan Li, Duc Minh Vo, Hideki Nakayama,
"Partition-and-Debias: Agnostic Biases Mitigation via a Mixture of Biases-Specific Experts",
In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2023.

Jan Zdenek, Hideki Nakayama,
"Handwritten Text Generation with Character-specific Encoding for Style Imitation",
In Proceedings of the 17th International Conference on Document Analysis and Recognition (ICDAR), 2023.

Erica Kido Shimomoto, Edison Marrese-Taylor, Hiroya Takamura, Ichiro Kobayashi, Hideki Nakayama, Yusuke Miyao,
"Towards Parameter-Efficient Integration of Pre-Trained Language Models In Temporal Video Grounding",
Findings of the Association for Computational Linguistics: ACL 2023, 2023.
pdf

KuanChao Chu, Hideki Nakayama,
"Two-Path Object Knowledge Injection For Detecting Novel Objects With Single-Stage Dense Detector",
IEICE Transactions on Information and Systems, Vol.E106-D, No.11, pp.-, 2023. (in press)

Duc Minh Vo, Quoc-An Luong, Akihiro Sugimoto, Hideki Nakayama,
"A-CAP: Anticipation Captioning with Commonsense Knowledge",
In Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), pp.10824-10833, 2023.
pdf

Yi-Pei Chen, An-Zi Yen, Hen-Hsen Huang, Hideki Nakayama, Hsin-Hsi Chen,
"LED: A Dataset for Life Event Extraction from Dialogs",
Findings of the Association for Computational Linguistics: EACL 2023, pp.384-398, 2023.
pdf

Rui Yang, Duc Minh Vo, Hideki Nakayama,
"Indirect Adversarial Losses via an Intermediate Distribution for Training GANs",
In Proceedings of the IEEE Winter Conference on Applications of Computer Vision (WACV), pp.4641-4650, 2023.
pdf

2022

Hong Chen, Rujun Han, Te-Lin Wu, Hideki Nakayama and Nanyun Peng,
“Character-Centric Story Visualization via Visual Planning and Token Alignment”,
In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pp.8259-8272, 2022.
pdf

Hong Chen, Duc Minh Vo, Hiroya Takamura, Yusuke Miyao, Hideki Nakayama,
“StoryER: Automatic Story Evaluation via Ranking, Rating and Reasoning”,
In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pp.1739-1753, 2022.
pdf

Yuxuan Wu, Hideki Nakayama,
“Weakly Supervised Formula Learner for Solving Mathematical Problems”,
In Proceedings of the International Conference on Computational Linguistics (COLING), pp.1743–1752, 2022.
pdf

Rui Yang, Duc Minh Vo, Hideki Nakayama,
"Stochastically Flipping Labels of Discriminator’s Outputs for Training Generative Adversarial Networks",
IEEE Access, Vol.10, pp.103644-103654, 2022. pdf

Yi-Pei Chen, Nobuyuki Shimizu, Takashi Miyazaki, Hideki Nakayama,
“How do people talk about images? A study on open-domain conversations with images”,
In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics (NAACL) Student Research Workshop, pp.156-162, 2022.
pdf

Jun Takeuchi, Noriki Nishida, Hideki Nakayama,
“Neural Networks in a Product of Hyperbolic Spaces”,
In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics (NAACL) Student Research Workshop, pp.211-221, 2022.
pdf

Rui Yang, Raphael Shu, Hideki Nakayama,
"Improving Noised Gradient Penalty with Synchronized Activation Function for Generative Adversarial Networks",
IEICE Transactions on Information and Systems, Vol.E105-D, No.9, pp.1537-1545, 2022. pdf

Ryuichiro Hataya, and Hideki Nakayama,
"DJMix: Unsupervised Task-agnostic Image Augmentation for Improving Robustness of Convolutional Neural Networks",
In Proceedings of the International Joint Conference on Neural Networks (IJCNN), 2022.

Ikki Kishida, Hideki Nakayama,
“Pixel to Binary Embedding Towards Robustness for CNNs”,
In Proceedings of the International Conference on Pattern Recognition (ICPR), 2022.

Duc Minh Vo, Hong Chen, Akihiro Sugimoto, Hideki Nakayama,
“NOC-REK: Novel Object Captioning with Retrieved Vocabulary from External Knowledge”,
In Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), pp.17979-17987, 2022.
pdf

Kai Katsumata, Duc Minh Vo, and Hideki Nakayama,
“OSSGAN: Open-Set Semi-Supervised Image Generation”,
In Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), pp.11175-11183, 2022.
pdf

Hisashi Kamezawa, Noriki Nishida, Nobuyuki Shimizu, Takashi Miyazaki, Hideki Nakayama,
“RNSum: A Large-Scale Dataset for Automatic Release Note Generation via Commit Logs Summarization”,
In Proceedings of the Association for Computational Linguistics (ACL), pp.8718–8735, 2022.
pdf

Duc Minh Vo, Akihiro Sugimoto, Hideki Nakayama,
“PPCD-GAN: Progressive Pruning and Class-Aware Distillation for Large-Scale Conditional GANs Compression”,
In Proceedings of the IEEE Winter Conference on Applications of Computer Vision (WACV), pp.2436-2444, 2022.
pdf

Ryuichiro Hataya, Jan Zdenek, Kazuki Yoshizoe, and Hideki Nakayama
“Meta Approach to Data Augmentation Optimization”,
In Proceedings of the IEEE Winter Conference on Applications of Computer Vision (WACV), pp.2574-2583, 2022.
pdf

2021

Hong Chen, Hiroya Takamura, Hideki Nakayama
“SciXGen: A Scientific Paper Dataset for Context-Aware Text Generation”,
Findings of the Association for Computational Linguistics: EMNLP 2021, pp.1483-1492, 2021.
pdf

Jan Zdenek and Hideki Nakayama,
“JokerGAN: Memory-Efficient Model for Handwritten Text Generation with Text Line Awareness”,
Proceedings of the 29th ACM International Conference on Multimedia (ACMMM), pp.5655-5663, 2021.
pdf

Hong Chen, Raphael Shu, Hiroya Takamura, Hideki Nakayama
“GraphPlan: Story Generation by Planning with Event Graph”,
Proceedings of the 14th International Conference on Natural Language Generation (INLG), pp.377-386, 2021.
pdf

Kai Katsumata, Ikki Kishida, Ayako Anma, and Hideki Nakayama,
"Open-Set Domain Generalization via Metric Learning",
Proceedings of the IEEE International Conference on Image Processing (ICIP), pp.459-463, 2021.

Shisheng Wang, Hideki Nakayama,
“Stochastic Observation Prediction for Efficient Reinforcement Learning in Robotics”,
Proceedings of the 4th IEEE International Conference on Multimedia Information Processing and Retrieval (MIPR), pp.131-137, 2021.

Yuhao Xu and Hideki Nakayama,
“DCT-based Fast Spectral Convolution for Deep Convolutional Neural Networks”,
Proceedings of the International Joint Conference on Neural Networks (IJCNN), 2021.

Kai Katsumata and Hideki Nakayama,
"Semantic Image Synthesis from Inaccurate and Coarse Masks",
Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), pp.2285-2289, 2021.

Taiga Kashima, Ryuichiro Hataya, and Hideki Nakayama,
"Visualizing Association in Exemplar-based Classification",
Proceedings of the 46th IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), pp.1780-1784, 2021.

Changhee Han, Leonardo Rundo, Kohei Murao, Tomoyuki Noguchi, Yuki Shimahara, Zoltán, Ádám Milacski, Saori Koshino, Evis Sala, Hideki Nakayama, Shin'ichi Satoh
"MADGAN: unsupervised Medical Anomaly Detection GAN using multiple adjacent brain MRI slice reconstruction",
BMC Bioinformatics, Vol.22, No.31, 2021. pdf

Hong Chen, Yifei Huang, Hiroya Takamura, and Hideki Nakayama,
"Commonsense Knowledge Aware Concept Selection for Diverse and Informative Visual Storytelling",
Proceedings of the 35th AAAI Conference on Artificial Intelligence (AAAI), pp.999-1008, 2021.
pdf

Ikki Kishida, Hong Chen, Masaki Baba, Jiren Jin, Ayako Amma, and Hideki Nakayama,
"Object Recognition with Continual Open Set Domain Adaptation for Home Robot",
Proceedings of the IEEE Winter Conference on Applications of Computer Vision (WACV), pp.1517-1526, 2021.
pdf

2020

Tetsuro Nishihara, Akihiro Tamura, Takashi Ninomiya, Yutaro Omote, and Hideki Nakayama,
"Supervised Visual Attention for Multimodal Neural Machine Translation",
Proceedings of the International Conference on Computational Linguistics (COLING), pp.4304-4314, 2020. pdf

Yuxuan Wu and Hideki Nakayama,
"Graph-based Heuristic Search for Module Selection Procedure in Neural Module Network",
Proceedings of the Asian Conference on Computer Vision (ACCV), pp.560-575, 2020. pdf

Hisashi Kamezawa, Noriki Nishida, Nobuyuki Shimizu, Takashi Miyazaki, and Hideki Nakayama,
"A Visually-grounded First-person Dialogue Dataset with Verbal and Non-verbal Responses",
Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pp.3299-3310, 2020. pdf

Taiga Kashima, Kento Masui, and Hideki Nakayama,
"Unsupervised Visual Relationship Inference",
Proceedings of the IEEE International Conference on Image Processing (ICIP), pp.1476-1480, 2020.

Ryuichiro Hataya, Zdenek Jan, Kazuki Yoshizoe, and Hideki Nakayama,
"Faster AutoAugment: Learning Augmentation Strategies using Backpropagation",
Proceedings of the 16th European Conference on Computer Vision (ECCV), 2020. pdf

Ryosuke Kuwabara, Jun Suzuki, Hideki Nakayama,
"Single Model Ensemble using Pseudo-Tags and Distinct Vectors",
Proceedings of the 58th annual meeting of the Association for Computational Linguistics (ACL), pp.3006-3013, 2020. pdf

Takumi Ohkuma, Hideki Nakayama,
"Efficient Base Class Selection Algorithms for Few-shot Classification",
Proceedings of the ACM International Conference on Multimedia Retrieval (ICMR), pp.271-275, 2020. pdf

Hideki Nakayama, Akihiro Tamura, Takashi Ninomiya,
"A Visually-Grounded Parallel Corpus with Phrase-to-Region Linking",
Proceedings of the 25th International Conference on Language Resources and Evaluation (LREC), pp.4204-4210, 2020. pdf

Raphael Shu, Jason Lee, Hideki Nakayama, Kyunghyun Cho,
"Latent-Variable Non-Autoregressive Neural Machine Translation with Deterministic Inference using a Delta Posterior",
Proceedings of the 24th AAAI Conference on Artificial Intelligence (AAAI), pp.8846-8853, 2020. pdf
(Acceptance rate 20.6%.)

Jan Zdenek and Hideki Nakayama
"Erasing Scene Text with Weak Supervision",
Proceedings of the 2020 IEEE Winter Conference on Applications of Computer Vision (WACV), pp.2238-2246, 2020. pdf

Noriki Nishida and Hideki Nakayama
"Unsupervised Discourse Constituency Parsing Using Viterbi EM",
Transactions of the Association for Computational Linguistics, Vol.8, pp.215-230, 2020. pdf

2019

Yuhao Xu and Hideki Nakayama
"Shifted Spatial-Spectral Convolution for Deep Neural Networks",
Proceedings of the 1st ACM International Conference on Multimedia in Asia (MM Asia), 2019.
(Acceptance rate 27.5%.)

Ikki Kishida and Hideki Nakayama
"Empirical Study of Easy and Hard Examples in CNN Training",
Proceedings of the 26th International Conference on Neural Information Processing (ICONIP), 2019. pdf

Changhee Han, Kohei Murao, Tomoyuki Noguchi, Yusuke Kawata, Fumiya Uchiyama, Leonardo Rundo, Hideki Nakayama, Shin'Ichi Satoh
"Learning More with Less: Conditional PGGAN-based Data Augmentation for Brain Metastases Detection Using Highly-Rough Annotation on MR Images",
Proceedings of the 28th ACM International Conference on Information and Knowledge Management (CIKM), 2019. pdf
(Acceptance rate 19.4%.)

Leonardo Rundo, Changhee Han, Yudai Nagano, Jin Zhang, Ryuichiro Hataya, Carmelo Militello, Andrea Tangherloni, Marco S. Nobile, Claudio Ferretti, Daniela Besozzi, Maria Carla Gilardi, Salvatore Vitabile, Giancarlo Mauri, Hideki Nakayama, Paolo Cazzaniga
"USE-Net: incorporating Squeeze-and-Excitation blocks into U-Net for prostate zonal segmentation of multi-institutional MRI datasets",
Neurocomputing, Volume 365, Pages 31-43, 2019. pdf

Changhee Han, Leonardo Rundo, Ryosuke Araki, Yudai Nagano, Yujiro Furukawa, Giancarlo Mauri, Hideki Nakayama, Hideaki Hayashi
"Combining Noise-to-Image and Image-to-Image GANs: Brain MR Image Augmentation for Tumor Detection",
IEEE Access, Vol.7, pp.156966-156977, 2019.
pdf

Changhee Han, Yoshiro Kitamura, Akira Kudo, Akimichi Ichinose, Leonardo Rundo, Yujiro Furukawa, Kazuki Umemoto, Yuanzhong Li, Hideki Nakayama
"Synthesizing Diverse Lung Nodules Wherever Massively: 3D Multi-Conditional GAN-based CT Image Augmentation for Object Detection",
The International Conference on 3D Vision (3DV), 2019. pdf

Changhee Han, Leonardo Rundo, Kohei Murao, Zoltán Ádám Milacski, Kazuki Umemoto, Hideki Nakayama, Shin'Ichi Satoh
"GAN-based Multiple Adjacent Brain MRI Slice Reconstruction for Unsupervised Alzheimer's Disease Diagnosis",
The 16th International Conference on Computational Intelligence methods for Bioinformatics and Biostatistic (CIBB), 2019. pdf

Raphael Shu, Hideki Nakayama, Kyunghyun Cho
"Generating Diverse Translations with Sentence Codes",
The 56th Annual Meeting of the Association for Computational Linguistics (ACL), 2019. pdf
(Acceptance rate 22.7%.)

Ryuichiro Hataya, Hideki Nakayama,
"LOL: Learning to Optimize Loss Switching Under Label Noise",
Proceedings of the 26th IEEE International Conference on Image Processing (ICIP), 2019.

Yuhao Xu, Hideki Nakayama,
"DCT Based Information-Preserving Pooling for Deep Neural Networks",
Proceedings of the 26th IEEE International Conference on Image Processing (ICIP), 2019.

Rui Yang, Hideki Nakayama,
"Bipolar GAN: Double Check the Solution Space and Lighten False Positive Errors in Generative Adversarial Nets",
Proceedings of the 26th IEEE International Conference on Image Processing (ICIP), 2019.

Ryuichiro Hataya, Hideki Nakayama,
"Unifying Semi-Supervised and Robust Learning by Mixup",
2nd Learning from Limited Labeled Data (LLD) Workshop, ICLR, 2019. pdf

Jiali Yao, Raphael Shu, Xinjian Li, Katsutoshi Ohtsuki, Hideki Nakayama,
"Enabling Real-time Neural IME with Incremental Vocabulary Selection",
Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT) (industry track), 2019. pdf

Hiroki Takushima, Akihiro Tamura, Takashi Ninomiya, Hideki Nakayama,
"Multimodal Neural Machine Translation Using CNN and Transformer Encoder",
Proceedings of the 20th International Conference on Computational Linguistics and Intelligent Text Processing (CICLing), 2019. pdf

2018

Hong Chen, Yifei Huang, Hideki Nakayama,
"Semantic Aware Attention Based Deep Object Co-segmentation",
Proceedings of the 14th Asian Conference on Computer Vision (ACCV), 2018. pdf

Diep Thi Ngoc Nguyen,Hideki Nakayama,Naoaki Okazaki,Tatsuya Sakaeda,
"PoB: Toward Reasoning Patterns of Beauty in Image Data",
Proceedings of the ACM Multimedia Conference on Multimedia Conference (MM), 2018. pdf
(Acceptance rate 27.6%.)

Raphael Shu and Hideki Nakayama,
"Improving Beam Search by Removing Monotonic Constraint for Neural Machine Translation",
The 56th Annual Meeting of the Association for Computational Linguistics (ACL), 2018. pdf
(Acceptance rate 24.0%.)

Noriki Nishida and Hideki Nakayama,
"Coherence Modeling Improves Implicit Discourse Relation Recognition",
The 19th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL), 2018. pdf

Masaya Abe and Hideki Nakayama,
"Deep Learning for Forecasting Stock Returns in the Cross-Section",
Pacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD), 2018. pdf
(Acceptance rate 27.7%.)

Raphael Shu and Hideki Nakayama,
"Compressing Word Embeddings via Deep Compositional Code Learning",
International Conference on Learning Representations (ICLR), 2018. pdf

Changhee Han, Hideaki Hayashi, Leonardo Rundo, Ryosuke Araki, Wataru Shimoda,Shinichi Muramatsu, Yujiro Furukawa, Giancarlo Mauri, and Hideki Nakayama,
"GAN-based Synthetic Brain MR Image Generation",
IEEE International Symposium on Biomedical Imaging (ISBI), 2018. pdf

Masashi Yokota and Hideki Nakayama,
"Augmenting Image Question Answering Dataset by Exploiting Image Captions",
International Conference on Language Resources and Evaluation (LREC), 2018. pdf

Natsuda Laokulrat, Naoaki Okazaki, and Hideki Nakayama,
"Incorporating Semantic Attention in Video Description Generation",
International Conference on Language Resources and Evaluation (LREC), 2018. pdf

2017

Kento Masui, Akiyoshi Ochiai, Shintaro Yoshizawa, Hideki Nakayama,
"Recurrent Visual Relationship Recognition with Triplet Unit",
IEEE International Symposium on Multimedia (ISM), 2017. pdf

Noriki Nishida, Hideki Nakayama,
"Word Ordering as Unsupervised Learning Towards Syntactically Plausible Word Representations",
International Joint Conference on Natural Language Processing (IJCNLP), 2017.  pdf

Jan Zdenek, Hideki Nakayama
"Bag of Local Convolutional Triplets for Script Identification in Scene Text",
International Conference on Document Analysis and Recognition (ICDAR), 2017. pdf

Hideki Nakayama, Noriki Nishida
"Zero-resource machine translation by multimodal encoder-decoder network with multimedia pivot",
Machine Translation Journal, 2017. link

Raphael Shu, Hideki Nakayama
"An Empirical Study of Adequate Vision Span for Attention-Based Neural Machine Translation",
ACL Workshop on Neural Machine Translation, 2017. pdf
(Outstanding paper award)

2016

Natsuda Laokulrat(AIST-AIRC), Sang Phan(NII), Noriki Nishida, Raphael Shu, Yo Ehara(AIST-AIRC), Naoaki Okazaki(Tohoku Univ,AIST-AIRC), Yusuke Miyao(NII,AIST-AIRC), Shin'ichi Satoh(NII), Hideki Nakayama,
"Generating Video Description using Sequence-to-sequence Model with Temporal Attention",
International Conference on Computational Linguistics (COLING), 2016. pdf
(Acceptance rate 32.4%.)

Jiren Jin, Hideki Nakayama,
"Annotation Order Matters: Recurrent Image Annotator for Arbitrary Length Image Tagging",
International Conference on Pattern Recognition (ICPR), 2016. pdf Demo

Hideki Nakayama, Tomoya Tsuda,
"Efficient two-step middle-level part feature extraction for fine-grained visual categorization",
IEICE Transactions on Information and Systems,Vol.E99-D, pp.1626-1634, 2016. pdf

Kohei Yamamoto, Hayato Kobayashi(Yahoo!JAPAN), Yukihiro Tagami(Yahoo!JAPAN), Hideki Nakayama,
"Multimodal content-aware image thumbnaling",
ACM International Conference on World Wide Web (WWW) (Companion Volume), pp.129-130, 2016.  pdf

2015

Noriki Nishida, Hideki Nakayama,
"Multimodal gesture recognition using multi-stream recurrent neural network",
Pacific-Rim Symposium on Image and Video Technology (PSIVT), 2015.  pdf

Ruka Funaki, Hideki Nakayama,
"Image-mediated learning for zero-shot cross-lingual document retrieval",
Empirical Methods in Natural Language Processing (EMNLP), 2015.  pdf
(Short paper, acceptance rate 23.7%.)

Takanori Tamanaha, Hideki Nakayama,
"Unsupervised cosegmentation based on global graph matching",
ACM International Conference on Multimedia, 2015.  pdf
(Short paper, acceptance rate 30.3%.)

2014

Masaya Okamoto, Hideki Nakayama,
"Unsupervised visual domain adaptation using auxiliary information in target domain",
IEEE International Symposium on Multimedia (ISM), 2014. pdf

Kohei Yamamoto, Riku Togashi, Hideki Nakayama,
"Content-based viewer estimation using image features for recommendation of video clips",
ACM RecSys 2014 Workshop on RecSysTV, 2014. pdf

2013

Hideki Nakayama,
"Efficient discriminative convolution using Fisher weight map",
British Machine Vision Conference (BMVC), 2013. pdf abstract
(Acceptance rate 30%.)

Hideki Nakayama,
"Augmenting descriptors for fine-grained visual categorization using polynomial embedding",
IEEE International Conference on Multimedia & Expo (ICME), 2013. pdf
(Oral, 12.7%.) 

2012

Hideki Nakayama,
"Aggregating descriptors with local Gaussian metrics",
NIPS 2012 Workshop on Large Scale Visual Recognition and Retrieval, 2012. pdf

Reviewed Domestic Conference

Hideki Nakayama,
"Stacked local autocorrelation features",
Meeting on Image Recognition and Understanding (MIRU), 2014. pdf

Others (Reports, Preprints)

Noriki Nishida, Jan Zdenek, Hideki Nakayama,
"Object Detection from Video with Nested Recurrent Neural Networks",
ImageNet Large-Scale Visual Recognition Challenge (ILSVRC) Video Object Detection Task, 2015. poster

Hideki Nakayama,
"NLab-UTokyo at ImageCLEF 2013 Plant Identifitication Task",
CLEF 2013 Working Notes, 2013. pdf
Got the 1st place in NaturalBackground Task

Hideki Nakayama, Masaya Okamoto, Tomoya Tsuda, Hiroki Miyatani, and Kohei Yamamoto,
Fine-grained challenge 2013 (in conjunction with ImageNet large-scale visual recognition challenge).
Classification results of testing images.