doi: 10.17706/jsw.17.6.269-281
AIADA: Accuracy Impact Assessment of Deprecated Python API Usages on Deep Learning Models
Abstract—TensorFlow is an end-to-end open-source machine learning platform including various tools, libraries, and community resources. It supports users to use many mainstream programming languages including Python. TensorFlow contains multiple abstraction layers, with APIs play significant roles in every layers. In the version iteration of TensorFlow platform development, with the release of new TensorFlow versions, because of functionality evolution, or security and performance-related changes, some APIs eventually become unnecessary. These issues cause APIs to deprecate and influence the accuracy of deep learning models results. Prior studies have investigated API evolution and its potential impact on projects. However, their studies mainly focus on API evolution instead of API deprecation, and they do not find out how the evolution affects results of deep learning models in TensorFlow. Therefore, we present a research-based prototype tool called AIADA and apply it to different revisions of the TensorFlow platform projects code for characterizing deprecated APIs. Based on the data mined by AIADA, we develop a quantitative assessment of deprecated Python APIs usages on deep learning models accuracy. We first count the amount of TensorFlow Python APIs that are deprecated, finding out that with the development of TensorFlow version, the number of deprecated APIs increases constantly. Second, we discuss the reason behind TensorFlow Python APIs become deprecated, discover that name change, weed out, and compatibility issue lead to the main cause of deprecation. Finally, we construct a deep learning project as the comparative experiment. After comparing the results between deep learning model with TensorFlow deprecated APIs and without deprecated APIs, we conclude that using deprecated APIs will cause a 10% loss on efficiency and accuracy of deep learning model.
Index Terms—Machine learning, deep learning, deprecated API, TensorFlow.
Cite: Haochen Zou, "AIADA: Accuracy Impact Assessment of Deprecated Python API Usages on Deep Learning Models," Journal of Software vol. 17, no. 6, pp. 269-281, 2022.
Copyright © 2022 by the authors. This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0)
General Information
-
Apr 26, 2021 News!
Vol 14, No 4- Vol 14, No 12 has been indexed by IET-(Inspec) [Click]
-
Nov 18, 2021 News!
Papers published in JSW Vol 16, No 1- Vol 16, No 6 have been indexed by DBLP [Click]
-
Dec 24, 2021 News!
Vol 15, No 1- Vol 15, No 6 has been indexed by IET-(Inspec) [Click]
-
Nov 18, 2021 News!
[CFP] 2022 the annual meeting of JSW Editorial Board, ICCSM 2022, will be held in Rome, Italy, July 21-23, 2022 [Click]
-
Aug 01, 2023 News!