Quantitative assessment of the conformity level of officially assigned keywords to the standard content

Keywords are currently used in scientific literature as one of the identifying features that helps determine the field of scientific research. Furthermore, keywords can be considered classification features for searching the required scientific information source.

Keywords are essential components of any scientific source, therefore, the formulation of keywords, as well as the choice of their number, are an important aspect in developing the structure of a scientific work. The "Keywords" section has been Obligatory in the standards being developed since 1992. The search for the necessary regulatory document in existing search engines can be carried out by keywords. The aim of the research is to analyse the degree to which the formulations of keywords correspond to the content of the standards.

The authors consider standards of three different classification groups from three sections of the All-Russian Classifier of Standards OK 001–2021. Moreover, the authors propose a system of indicators to quantify the effectiveness of using keywords in the title and text of the standard; conduct statistical processing of data on the keywords usage in the title and text of the standard; calculate coefficients that allow numerically assessing the situation based on the parameter whether all officially keywords are used at least once in the title or text of the standard. The research also calculates a coefficient showing the frequency of the officially assigned keywords usage in the text of the standard.

The results indicate that officially assigned keywords poorly identify the standard, as a result of which the search for the necessary regulatory document is ineffective.

1. Popova L. А. Keywords of modern times: the issue of the term. Proceedings of Petrozavodsk State University. 2017;5(166):93–97. EDN: ZEHLBB. (In Russ.).

2. Krasteva R. D. Standardization and Standards in Bulgarian Libraries: Current State. Journal of Librarianship and Information Science. 2019;52(3):726–737. https://doi.org/10.1177/0961000619871603.

3. Celardo L., Everett M. G. Network text analysis: A two-way classification approach. International Journal of Information Management. 2020;51:102009. https://doi.org/10.1016/j.ijinfomgt.2019.09.005. EDN: YQRNDY.

4. Zazhigalkin A. V. Analiz zarubezhnogo opyta organizatsionnykh struktur standartizatsii. Informatsionno-Ekonomicheskie Aspekty Standartizatsii i Tekhnicheskogo Regulirovaniya. 2020;5(57):34–46. EDN: TDTEUM. (In Russ.).

5. Isaev I. V. Sovremennye instrumenty podderzhki NIOKR (R&D) dlya innovatsionnogo razvitiya transportnykh kompanij. Ekonomika i Finansy. 2024;3(112):3–7. (In Russ.).

6. Gandomi A., Haider M. Beyond the hype: Big data concepts, methods, and analytics. International Journal of Information Management. 2015;35(2):137–144. https://doi.org/10.1016/j.ijinfomgt.2014.10.007.

7. Tulloch B. J., Kaczmarek M., Shankar S., Nathan L. When words are key: negotiating meaning in information research. Journal of Documentation. 2024;80(7):187–205. https://doi.org/10.1108/JD-05-2023-0103. EDN: TODPRF.

8. Wang R., Liu W., Mcdonald C. Using Word Embeddings to Enhance Keyword Identification for Scientific Publications. Proceedings of the Australasian Database Conference. 2015:257–268.

9. Wei L., Zhifeng L., Yong H. et al. How do authors select keywords? A preliminary study of author keyword selection behavior. Journal of Informetrics. 2020;14(4):101066. https://doi.org/10.1016/j.joi.2020.101066.

10. Verma G., Kanrar S. Secure Keyword Search over Encrypted Cloud Data Using Blockchain in Digital Document Sharing. Wireless Personal Communications. 2024;134:975–996. https://doi.org/10.1007/s11277-024-10947-1.

11. Pobedinskiy V. V., Polyakova M. A., Kazantseva T. V. [et al.]. An intelligent system based on main approaches of fuzzy logic for searching for regulatory documents. Vestnik of Nosov Magnitogorsk State Technical University. 2024;22(1):107–113. https://doi.org/10.18503/1995-2732-2024-22-1-107-113. EDN: XJGJSV. (In Russ.).

12. Salamatov V. Yu., Vatolkina N. Sh., Drobyshev D. A. [et al.]. Digital transformation of standardization: obstacles and challenges. Standards and Quality. 2023;4:34–39. EDN: ISBXDQ. (In Russ.).

13. Golovash А. N., Kurmanova N. B., Polevaev V. V. Terminology in standards and product quality: causal relationships. Standards and Quality. 2024;10:40–43. https://doi.org/10.35400/0038-9692-2024-10-102-24. EDN: ZBMENY. (In Russ.).

14. Glushchenko О. А., Khabibullin R. R., Makeeva A. Yu. Techexpert: a smart approach to the regulatory and technical documents management. Standards and Quality. 2024;2:42–45. EDN: GTBEUV. (In Russ.).

15. Kazantseva T. V., Polyakova M. A. Napravleniya rabot po tsifrovizatsii v oblasti standartizatsii. Technologies of Metallurgy, Mechanical Engineering and Material Processing. 2021;20:246–249. (In Russ.).

16. Polyakova M. A., Kazantseva T. V., Kazantseva N. K., Pidzhakova E. N. Kolichestvennaya otsenka informatsii kak osnova postroeniya bazy dannykh. Chernaya metallurgiya. 2022;78(4):338-344. https://doi.org/10.32339/0135-5910-2022-4-338-344 . EDN: QVVFBB. (In Russ.).

17. Kazantseva T. V., Polyakova M. A., Kazantseva N. K. [et al.]. Kompleks zadach pri sozdanii elektronnoj biblioteki standartov. Quality and Life. 2021;4:42-46. https://doi.org/10.34214/2312-5209-2021-32-4-42-46. EDN: DDKHIB. (In Russ.).

18. James G., Witten D., Hastie T., Tibshirani R. An introduction to statistical learning. New York, NY, USA: Springer, 2013.