Authors
Jianyi Zhou, Feng Li, Jinhao Dong, Hongyu Zhang, Dan Hao
Publication date
2020/10/12
Conference
2020 IEEE 31st International Symposium on Software Reliability Engineering (ISSRE)
Pages
289-300
Publisher
IEEE
Description
With the increasing adoption of Deep Learning (DL) models in various applications, testing DL models is vitally important. However, testing DL models is costly and expensive, e.g., manual labelling is widely-recognized to be costly. To reduce testing cost, we propose to select only a subset of testing data, which is small but representative enough for a quick estimation of the performance of DL models. Our approach, DeepReduce, adopts a two-phase strategy. At first, our approach selects testing data for the purpose of satisfying testing adequacy. Then, it selects more testing data to approximate the distribution between the whole testing data and the selected data by leveraging relative entropy minimization. We evaluate DeepReduce on four widely-used datasets (with 15 models in total). We find that DeepReduce reduces the whole testing data to 7.5% on average and can reliably estimate the performance of DL …
Total citations
202120222023202425511
Scholar articles
J Zhou, F Li, J Dong, H Zhang, D Hao - 2020 IEEE 31st International Symposium on Software …, 2020