PUBLICATIONS
_________________________
Under Review
Analyzing Visible Articulatory Movements in Speech Production for Speech-Driven 3D Facial Animation
Hyung Kyu Kim, Sangmin Lee (UIUC), and Hak Gu Kim
2024
[C33] Causal Mode Multiplexer: A Novel Framework for Unbiased Multispectral Pedestrian Detection
Taeheon Kim, Sebin Shin, Youngjoon Yu, Hak Gu Kim, and Yong Man Ro
IEEE Conf. Computer Vision and Pattern Recognition (CVPR) 2024 [Accepted]
Top-tier AI Conference
[J17] Super-Resolution Neural Radiance Field via Learning High Frequency Details for High-Fidelity Novel View Synthesis
Han-nyoung Lee and Hak Gu Kim
IEEE Signal Processing Letters (SPL), vol. 31, pp. 466 - 470, Jan. 2024 [PDF]
[J16] Photometric Stereo Super Resolution via Complex Surface Structure Estimation
Han-nyoung Lee and Hak Gu Kim
IEEE Access, vol. 12, pp. 14314 - 14323, Jan. 2024 [PDF]
2022
[J15] Assessing Individual VR Sickness through Deep Feature Fusion of VR Video and Physiological Response
Sangmin Lee, Seongyeop Kim, Hak Gu Kim and Yong Man Ro
IEEE Trans. Circuits and Systems for Video Technology (TCSVT), vol. 32, no. 5, pp. 2895 - 2907, May 2022 [PDF]
JCR Top 15.7% [Impact Factor: 4.685]
[C32] Natural-Looking Adversarial Examples from Freehand Sketches
Hak Gu Kim*, Davide Nanni (EPFL)*, and Sabine Süsstrunk (EPFL) (*equal contribution)
IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) May 2022 [PDF]
2021
[J14] Robust Video Frame Interpolation with Exceptional Motion Map
Minho Park, Hak Gu Kim and Yong Man Ro
IEEE Trans. Circuits and Systems for Video Technology (TCSVT), vol. 31, no. 2, pp. 754 - 764, Feb. 2021 [PDF]
JCR Top 15.7% [Impact Factor: 4.685]
[C31] Video Prediction Recalling Long-term Motion Context via Memory Alignment Learning
Sangmin Lee, Hak Gu Kim, Dae Hwi Choi, Hyung-Il Kim (ETRI) and Yong Man Ro
IEEE Conf. Computer Vision and Pattern Recognition (CVPR) 2021 (Oral) [PDF]
Top-tier AI Conference [Acceptance rate: 23.7%]
[C30] Visual Comfort Aware-Reinforcement Learning for Depth Adjustment of Stereoscopic 3D Images
Hak Gu Kim, Minho Park, Sangmin Lee, Seongyeop Kim and Yong Man Ro
Association for the Advancement of Artificial Intelligence (AAAI) 2021 [PDF]
Top-tier AI Conference [Acceptance rate: 21%]
[C29] Towards a Better Understanding of VR Sickness: Physical Symptom Prediction for VR Contents
Hak Gu Kim, Sangmin Lee, Seongyeop Kim, Heoun-taek Lim and Yong Man Ro
Association for the Advancement of Artificial Intelligence (AAAI) 2021 [PDF]
Top-tier AI Conference [Acceptance rate: 21%]
2020
[C28] SACA Net: Cybersickness Assessment of Individual Viewers for VR Content via Graph-based Symptom Relation
Embedding
Sangmin Lee, Jung Uk Kim, Hak Gu Kim and Yong Man Ro
European Conference on Computer Vision (ECCV) 2020 [PDF]
Top-tier AI Conference [Acceptance rate: 26%]
[C27] Structure Boundary Preserving Segmentation for Medical Image with Ambiguous Boundary
Hong Joo Lee, Jung Uk Kim, Sangmin Lee, Hak Gu Kim and Yong Man Ro
IEEE Conf. Computer Vision and Pattern Recognition (CVPR) 2020 [PDF]
Top-tier AI Conference [Acceptance rate: 22%]
[J13] Deep Virtual Reality Image Quality Assessment with Human Perception Guider for Omnidirectional Image
Hak Gu Kim*, Heoun-taek Lim* and Yong Man Ro (*equal contribution)
IEEE Trans. Circuits and Systems for Video Technology (TCSVT), vol. 30, no. 4, pp. 917 - 928, Apr. 2020 [PDF]
JCR Top 15.7% [Impact Factor: 4.685]
[J12] BBC Net: Bounding-Box Critic Network for Occlusion-Robust Object Detection
Jung Uk Kim, Jungsu Kwon, Hak Gu Kim and Yong Man Ro
IEEE Trans. Circuits and Systems for Video Technology (TCSVT), vol. 30, no. 4, pp. 1037 - 1050, Apr. 2020 [PDF]
JCR Top 15.7% [Impact Factor: 4.685]
[J11] MCSIP Net: Multichannel Satellite Image Prediction via Deep Neural Network
Jae-Hyeok Lee, Sangmin S. Lee, Hak Gu Kim, Sa-Kwang Song (KISTI), Seongchan Kim (KISTI) and Yong Man Ro
IEEE Trans. Geoscience and Remote Sensing (TGRS), vol. 58, no. 3, pp. 2212 - 2224, Mar. 2020 [PDF]
JCR Top 12.8% [Impact Factor: 5.600]
[J10] BMAN: Bidirectional Multi-scale Aggregation Networks for Abnormal Event Detection
Sangmin Lee, Hak Gu Kim and Yong Man Ro
IEEE Trans. Image Processing (TIP), vol. 29, no. 1, pp. 2395 - 2408, Jan. 2020 [PDF]
JCR Top 3.2% [Impact Factor: 10.856]
2019
[J09] Endometrium Segmentation on Transvaginal Ultrasound Image Using Key‐point Discriminator
Hyenok Park, Hong Joo Lee, Hak Gu Kim, Yong Man Ro, Dongkuk Shin (Samsung Medison), Sa Ra Lee (Ehwa Univ.), Sung Hoon Kim (Asan Medical Center) and Mikyung Kong (Yonsei Univ.)
Medical Physics (MP), vol. 46, no. 9, pp. 3974 - 3984, Sept. 2019 [PDF]
JCR Top 24.1% [Impact Factor: 3.317]
[J08] VRSA Net: VR Sickness Assessment Considering Exceptional Motion for 360° VR Video
Hak Gu Kim, Heoun-taek Lim, Sangmin Lee and Yong Man Ro
IEEE Trans. Image Processing (TIP), vol. 28, no. 4, pp. 1646 - 1660, Apr. 2019 [PDF]
JCR Top 4.1% [Impact Factor: 9.340]
[J07] Binocular Fusion Net: Deep Learning Visual Comfort Assessment for Stereoscopic 3D
Hak Gu Kim*, Hyunwook Jeong*, Heoun-taek Lim and Yong Man Ro (*equal contribution)
IEEE Trans. Circuits and Systems for Video Technology (TCSVT), vol. 29, no. 4, pp. 956 - 967, Apr. 2019 [PDF]
JCR Top 18.7% [Impact Factor: 4.133]
[C26] Generative Guiding Block: Synthesizing Realistic Looking Variants Capable of Even Large Change Demands
Minho Park, Hak Gu Kim and Yong Man Ro
IEEE International Conference on Image Processing (ICIP) 2019 (Oral) [PDF]
[C25] Deep Objective Assessment Model based on Spatio-temporal Perception of 360-degree Video
for VR Sickness Prediction
Kihyun Kim*, Sangmin Lee*, Hak Gu Kim, Minho Park and Yong Man Ro (*equal contribution)
IEEE International Conference on Image Processing (ICIP) 2019 (Oral) [PDF]
[Best Paper Finalists: Top 2.1% of the accepted papers]
[C24] Physiological Fusion Net: Quantifying Individual VR Sickness with Content Stimulus and Physiological Response
Sangmin Lee, Seongyeop Kim, Hak Gu Kim, Min Seob Kim, Seokho Yun, Bumseok Jeong and Yong Man Ro
IEEE International Conference on Image Processing (ICIP) 2019 [PDF]
[C23] Region-guided Adversarial Learning for Anatomical Landmark Detection in Uterus Ultrasound Image
Hong Joo Lee, Hak Gu Kim, Hyenok Park, Dongkuk Shin (Samsung Medison) and Yong Man Ro
SPIE Medical Imaging (MI) 2019 [PDF]
[C22] Photo-Realistic Facial Emotion Synthesis Using Multi-level Critic Networks with Multi-level Generative Model
Minho Park, Hak Gu Kim and Yong Man Ro
International Conference on Multimedia Modeling (MMM) 2019 (Oral) [PDF]
2018
[C21] Adversarial Spatial Frequency Domain Critic Learning for Age and Gender Classification
Sangmin S. Lee, Hak Gu Kim, Kihyun Kim and Yong Man Ro
IEEE International Conference on Image Processing (ICIP) 2018 [PDF]
[C20] Object Bounding Box-Critic Networks for Occlusion-Robust Object Detection in Road Scene
Jung Uk Kim*, Jungsu Kwon*, Hak Gu Kim and Yong Man Ro (*equal contribution)
IEEE International Conference on Image Processing (ICIP) 2018 [PDF]
[C19] FSF-C Net: Face Spatial Frequency-Critic Network for Face Super Resolution
Kihyun Kim, Hak Gu Kim and Yong Man Ro
IEEE/IEIE International Conference on Consumer Electronics-Asia (ICCE-Asia) 2018 (Oral) [PDF]
[Best Student Paper Award: Silver Prize]
[C18] VR IQA NET: Deep Virtual Reality Image Quality Assessment Using Adversarial Learning
Heoun-taek Lim, Hak Gu Kim and Yong Man Ro
IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2018 (Oral) [PDF]
[C17] STAN: Spatio-Temporal Adversarial Networks for Abnormal Event Detection
Sangmin Lee, Hak Gu Kim and Yong Man Ro
IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2018 (Oral) [PDF]
[C16] ICADx: Interpretable Computer Aided Diagnosis of Breast Masses
Seong Tae Kim, Hakmin Lee, Hak Gu Kim and Yong Man Ro
SPIE Medical Imaging (MI) 2018 (Oral) [PDF]
[Robert F. Wagner All Conference Best Student Paper Final Lists Award]
[C15] Teacher and Student Joint Learning for Compact Facial Landmark Detection Network
Hong Joo Lee, Wissam J. Baddar, Hak Gu Kim, Seong Tae Kim and Yong Man Ro
International Conference on Multimedia Modeling (MMM) 2018 (Oral) [PDF]
2017
[J06] Ultrafast Layer based Computer-Generated Hologram Calculation with Sparse Template Holographic Fringe Pattern
for 3-D Object
Hak Gu Kim and Yong Man Ro
Optics Express (OE), vol. 25, no. 24, pp. 30418 - 30427, Nov. 2017 [PDF]
JCR Top 20.2% [Impact Factor: 3.356]
[J05] Multiview Stereoscopic Video Hole Filling Considering Spatiotemporal Consistency and Binocular Symmetry
for Synthesized 3D Video
Hak Gu Kim and Yong Man Ro
IEEE Trans. Circuits and Systems for Video Technology (TCSVT), vol. 27, no. 7, pp. 1435 - 1449, July 2017 [PDF]
JCR Top 18.1% [Impact Factor: 3.558]
[C14] Measurement of Exceptional Motion in VR Video Contents for VR Sickness Assessment
Using Deep Convolutional Autoencoder
Hak Gu Kim, Wissam J. Baddar, Heoun-taek Lim, Hyunwook Jeong and Yong Man Ro
ACM Symposium on Virtual Reality Software and Technology (VRST) 2017 (Oral) [PDF]
Top-tier AI Conference [Acceptance rate: 21%]
[C13] Modality-bridge Transfer Learning for Medical Image Classification
Hak Gu Kim*, Yeoreum Choi* and Yong Man Ro (*equal contribution)
IEEE International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CIPS-BMEI) 2017 [PDF]
[C12] Robust and Real-Time Visual Tracking with Triplet Convolutional Neural Network
Jung Uk Kim, Hak Gu Kim and Yong Man Ro
ACM Multimedia Workshop (MMW) 2017 [PDF]
[C11] Visual Comfort Assessment of Stereoscopic Images Using Deep Visual and Disparity Features
based on Human Attention
Hyunwook Jeong, Hak Gu Kim and Yong Man Ro
IEEE International Conference on Image Processing (ICIP) 2017 (Oral) [PDF]
[C10] Iterative Deep Convolutional Encoder-Decoder Network for Medical Image Segmentation
Jung Uk Kim, Hak Gu Kim and Yong Man Ro
IEEE Engineering in Medicine and Biology Society (EMBC) 2017 [PDF]
[C09] Sparsity-based Fast CGH Generation Using Layer-based Approach for 3D Point Cloud Model
Hak Gu Kim, Hyunwook Jeong and Yong Man Ro
SPIE Photonics West (PW) 2017 (Oral) [PDF]
[C08] Investigating Numerical Reconstruction Quality and Sparsity Constraints on the Holographic Fringe Pattern
in Digital Holography
Hyunwook Jeong, Hak Gu Kim and Yong Man Ro
SPIE Photonics West (PW) 2017 (Oral) [PDF]
2016
[J04] Acceleration of the Calculation Speed of Computer-Generated Holograms Using the Sparsity of the Holographic
Fringe Pattern for a 3D Object
Hak Gu Kim, Hyunwook Jeong and Yong Man Ro
Optics Express (OE), vol. 24, no. 22, pp. 25317 - 25328, Oct. 2016 [PDF]
JCR Top 18.5% [Impact Factor: 3.307]
[J03] Experimental Investigation of the Effect of Binocular Disparity on the Visibility Threshold of Asymmetric Noise
in Stereoscopic Viewing
Hak Gu Kim*, Seong-il Lee* and Yong Man Ro (*equal contribution)
Optics Express (OE), vol. 24, no. 17, pp. 19607 - 19615, Aug. 2016 [PDF]
JCR Top 18.5% [Impact Factor: 3.307]
[J02] Critical Binocular Asymmetry Measure for the Perceptual Quality Assessment of Synthesized Stereo 3D Images
in View Synthesis
Yong Ju Jung, Hak Gu Kim and Yong Man Ro
IEEE Trans. Circuits and Systems for Video Technology (TCSVT), vol. 26, no. 7, pp. 1201 - 1214, July 2016 [PDF]
JCR Top 17.2% [Impact Factor: 3.599]
[C07] Measurement of Critical Temporal Inconsistency for Quality Assessment of Synthesized Video
Hak Gu Kim and Yong Man Ro
IEEE International Conference on Image Processing (ICIP) 2016 (Oral) [PDF]
[C06] A New Hole Filling Method based on 3D Geometric Transformation for Synthesized Image
Hak Gu Kim, Heoun-taek Lim and Yong Man Ro
Electronic Imaging (EI) [PDF]
[C05] Learning based Hole Filling Method Using Deep Convolutional Neural Network for View Synthesis
Heoun-taek Lim, Hak Gu Kim and Yong Man Ro
Electronic Imaging (EI) [PDF]
2015
[J01] Multi-frame De-raining Algorithm Using a Motion-compensated Non-local Mean Filter for Rainy Video Sequences
Hak Gu Kim, Hyunwook Jeong and Yong Man Ro
Journal of Visual Communication and Image Representation (JVCIR), vol. 26, pp. 317 - 328, Jan. 2015 [PDF]
[C04] A Sparse Representation-Based Label Pruning for Image Inpainting Using Global Optimization
Hak Gu Kim and Yong Man Ro
Pacific Rim Conference on Multimedia (PCM) 2015 (Oral) [PDF]
[Best Student Paper Award]
[C03] Temporally Consistent Hole Filling Method based on Global Optimization with Label Propagation for 3D Video
Hak Gu Kim, Soo Sung Yoon and Yong Man Ro
IEEE International Conference on Image Processing (ICIP) 2015 (Oral) [PDF]
[C02] Multi-view Stereo Image Synthesis Using Binocular Symmetry-based Global Optimization
Hak Gu Kim, Yong Ju Jung, Soo Sung Yoon and Yong Man Ro
SPIE/IS&T Electronic Imaging (EI) 2015 (Oral) [PDF]
2014
[C01] Investigating Experienced Quality Factors in Synthesized Multi-view Stereo Images
Hak Gu Kim, Yong Ju Jung, Soo Sung Yoon and Yong Man Ro
IEEE International Conference on Digital Signal Processing (DSP) 2014 (Oral) [PDF]