• Students
  • Faculty & Staff
  • Visitor
  • 中文
  • search
  • Home
  • About
  • Admission
  • Research
  • News & Events
  • Schools
Home About Admission Research News & Events Schools Students Faculty & Staff Visitor 中文
search
New Framework Solves Mode Collapse in Generative Adversarial Network
Date:2024-04-17 

Generative Adversarial Network (GAN) is widely used to synthesize intricate and realistic data by learning the distribution of authentic real samples. However, a significant challenge that GAN faces is mode collapse, where the diversity of generated samples is notably lower than that of real samples. The complexity of GANs and their training process has made it difficult to reveal the underlying mechanism of mode collapse.

A research team led by Prof. YANG Zhouwang from the University of Science and Technology of China (USTC) of the Chinese Academy of Sciences (CAS) conducted a thorough investigation into the root cause of mode collapse and proposed a new framework, Dynamic GAN (DynGAN), to quantitatively detect and resolve mode collapse in GAN. Their work was published in IEEE Transactions on Pattern Analysis and Machine Intelligence on February 20th.

Through theoretical analysis, the team found that the generator loss function is non-convex with respect to its parameters when multiple modes exist in the real data. Specifically, the parameters that result in the generated distribution covering only part of the real distribution's modes is the local minima of the generator loss function.

To tackle the issue of mode collapse, the team proposed a unified framework, DynGAN. This framework can establish thresholds on observable discriminator outputs to detect samples that the generator fails to generate, known as collapsed samples. The training sets are divided based on the collapsed samples, and then dynamic conditional generative models are trained on the partitions. The theoretical results ensured the progressive mode coverage of DynGAN. Experimental results on both synthetic and real-world data sets showed that DynGAN surpasses existing GANs and their variants in resolving address mode collapse.

   

The performance of DynGAN and previous GAN on synthetic data sets. (Image by Prof. YANG’s team)

This research not only advanced the theoretical understanding of GAN, but also provides a crucial implementation strategy for improving the mode coverage of generative models.

Paper link: https://doi.org/10.1109/TPAMI.2024.3367532

(Written by ZHANG Min, edited by ZHANG Yihang, USTC News Center)

Quick Links
Hotline
Campus View
Dictionary
Video Course
Library
Services
Campus Areas Maps
On Campus Societies
Dining Centers
Sports Center
Hospital
Join Us
Join Us
Teacher Recruitment

Address: University of Science and Technology of China,
No.96, JinZhai Road Baohe District, Hefei, Anhui, 230026, P.R.China.

E-mail: OIC@ustc.edu.cn

Copyright © 2013 University of Science and Technology of China.