Peculiarities of justification of a representative set of requirements for intelligent vehicles

Introduction (problem statement and relevance). The key task of ensuring confidence in motor vehicles with elements of artificial intelligence (AI vehicles) is forming of a representative set of requirements compliance with which ensures the necessary guarantees of AI vehicle functionality and safety.

Absence of generally accepted and statutory approaches to justification of the requirements content constrains application of artificial intelligence technologies in motor vehicles and, respectively, impedes creation and improvement of highly automated vehicles. The purpose of the study is to analyze the principles of forming of a representative set of requirements for AI vehicles. Methodology and research methods. The paper uses the principles of qualimetry adapted for the information systems based on machine learning algorithms, it also uses the methods of system analysis, mathematical statistics, combinatorics, set theory and propositional calculus principles. Scientific novelty and results. The approach is formulated to justify the statistically representative set of requirements for AI vehicles, and that allows adequate and accurate assessment of compliance of these systems with the expectations of the customers, developers, suppliers, regulatory authorities and other stakeholders. The structure of such expectations and priorities has been considered taking into account creation and application of AI systems. It is shown that stakeholder requirements apply to both the AI vehicle life cycle processes and the systems per se taking into account particular (given) conditions of their operation. Different significant factors, which variability sets the intended operating conditions, have been considered and conditions of representativeness of test data sets used for AI vehicle trials have been formulated. It is shown that, in order to reduce the dimensionality of space of the intended operating conditions, AI vehicles can be decomposed into separate functional subsystems and then into individual AI algorithms. The ways to perform such functional decomposition have been suggested. Practical significance.

The principles of justification of the requirements content offered in the paper can be used in certification testing of artificial intelligence algorithms that are used in highly automated vehicles.

1. [Technical Regulations of the Customs Union “On the safety of wheeled vehicles” (TR CU 018/2011)]. Available at: https://www.gost.ru/documentManager/rest/file/load/1515751932581 (accessed 12.08.2023). (In Russian)

2. Kisulenko B.V. [Rating the safety of vechicles with artificial intellegence]. Standarty i kachestvo, 2020, no. 5, pp. 92–95. (In Russian)

3. [Order of the Government of the Russian Federation dated March 29, 2018 No. 535-r “On the plan of measures (the “roadmap”) for improving legislation and eliminating administrative barriers in order to ensure the implementation of the National Technology Initiative in the “Avtonet” direction]. (In Russian)

4. [Decree of the Government of the Russian Federation of November 26, 2018 No. 1415 “On conducting an experiment on operation on road highly automated vehicles”]. (In Russian) 5. ISO 26262-1. Road vehicles. Functional safety. Part 1: Vocabulary.

5. [GOST R 26262-1-2014. Road vehicles. Functional safety. Part 1: Vocabulary]. Moscow, Standartinform Publ., 2015. 20 p. (In Russian)

6. ISO/TC 22/SC 32 Electrical and electronic components and general system aspects. ISO/CD 21448:2019 Road vehicles. Safety of the Intended Functionality. Committee Draft.

7. [Report of the Working Group on Automated/Autonomous and Connected Vehicles on its ninth session]. Available at: https://unece.org/sites/default/files/2021-12/ECE-TRANS-WP29-GRVA-09r.pdf (accessed 10 August 2023). (In Russian)

8. Artificial intelligence definition and specifics of its application for automated road vehicles. Informal document GRVA-09-23 9th GRVA, 1–5 February 2021. Russia.

9. [GOST R 34.603-92. Information technology. Types tests automated systems]. Moscow, Standartinform Publ., 2009. 6 p. (In Russian)

10. Garbuk S.V. Intellimetry as a way to ensure AI trustworthiness. The Proceedings of the 2018 International Conference on Artificial Intelligence Applications and Innovations (IC-AIAI). Limassol, Cyprus, 6–10.10.2018, pp. 27–30.

11. Gendron C. Penser l’acceptabilité sociale: audelà de l’intérêt, les valeurs. Éthique et relations publiques: pratiques, tensions et perspectives, 2014, no. 11, 01.02.2014, pp. 117–129. 13. ISO/IEC 12207:2017. System and software engineering. Software lifecycle processes.

12. Vorob’ev G.B., Belikov R.P., Lesin V.S. [Vehicle cybersecurity. Should the GOST R ISO 11898-1-2015 standard be reconsidered?]. Standarty i kachestvo, 2021, no. 8, pp. 60–63. (In Russian)

13. Kisulenko B.V., Evgrafov V.V., Bocharov A.V., Burykina D.S., Makarov A.V. [Criteria for ensuring the cyber-security of vehicles in international agreements under the auspices of the UN and their prospects in Russia]. Trudy NAMI, 2022, no. 2 (289), pp. 41–50. DOI: 10.51187/0135-3152-2022-2-41-50. (In Russian)

14. Garbuk S.V. [Tasks of technical regulation of intelligent information security systems]. Voprosy kiberbezopasnosti, 2021, no. 3, pp. 68–83. (In Russian)

15. SAE J3016. Surface vehicle recommended practice. Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles. June, 2018.

16. Cummings M.L. Adaptation of Human Licensing Examinations to the Certification of Autonomous System. Safe, Autonomous and Intelligent Vehicles. Eds. Yu H., Li X., Murray R.M., Ramesh S., Tomlin C.J. Springer International Publishing, 2019, рр. 145–162. Available at: https://doi.org/10.1007/978-3-319-97301-2 (accessed 10 June 2023).

17. Kotlyarenko V.I. [On the issue of testing highly automated and unmanned vehicles]. Trudy NAMI, 2020, no. 1 (280), pp. 94–102. (In Russian)

18. Ivanov A.M., Kristal’nyy S.R., Popov N.V. [Automatic emergency braking systems]. Moscow, MADI Publ., 2018, 180 p. (In Russian)

19. SAE J3018. Surface vehicle recommended practice. Safety-Relevant Guidance for On-Road Testing of Prototype Automated Driving System (ADS)-Operated Vehicles. December, 2020.

20. IEEE Standard for Assumptions in Safety‐Related Models for Automated Driving Systems. IEEE 2846-2022.

21. Pollard E., Morignot Ph., Nashashibi F. An Ontology-based Model to Determine the Automation Level of an Automated Vehicle for Co-Driving. Fusion’13, Istanbul, July 10, 2013.

22. Garbuk S.V., Shalayev A.P. [Prospective structure of national standards in the field of artificial intelligence]. Standarty i kachestvo, 2021, no. 10, pp. 26–33. (In Russian)

23. Kisulenko B.V. [Safety assessment of highly automated and unmanned vehicles]. Trudy NAMI, 2020, no. 2 (281), pp. 6–13. (In Russian)

24. Informal Working Group on Functional Requirements for Automated Vehicles (FRAV) Progress Report to GRVA. Informal document GRVA-09-28. 9th GRVA, 1–5 February 2021.

25. Kuutti S., Fallah S., Bowden R., Barber Ph. Deep Learning for Autonomous Vehicle Control Algorithms, State-of-the-Art, and Future Prospects. Synthesis Lectures on Advances in Automotive Technology, January, 2019.

26. ISO 26262-9:2018. Road vehicles. Functional safety. Part 9: Automotive safety integrity level (ASIL)- oriented and safety-oriented analyses.

27. Waldmeir P. Driverless cars must navigate human foibles. Financial Times, 2 January 2019.

28. [GOST R 70251-2022. Artificial intelligence systems in road transport. Vehicle traffic control systems. Requirements for testing detection and detection algorithms]. Moscow, Russian Institute of Standardization Publ., 2022. 12 p. (In Russian)

29. [GOST R 70252-2022. Artificial intelligence systems in road transport. Vehicle traffic control systems. Requirements for testing low-level data fusion algorithms]. Moscow, Russian Institute of Standardization Publ., 2022. 12 p. (In Russian)

30. [GOST R 70253-2022. Artificial intelligence systems in road transport. Vehicle traffic control systems. Requirements for testing algorithms for detecting and reconstructing the structure of intersections]. Moscow, Russian Institute of Standardization Publ., 2022. 12 p. (In Russian)

31. [GOST R 70254-2022. Artificial intelligence systems in road transport. Vehicle traffic control systems. Requirements for testing algorithms for predicting the behavior of road users]. Moscow, Russian Institute of Standardization Publ., 2022. 12 p. (In Russian)

32. [GOST R 70255-2022. Artificial intelligence systems in road transport. Vehicle traffic control systems. Requirements for testing of algorithms for detection and recognition of road signs]. Moscow, Russian Institute of Standardization Publ., 2022. 12 p. (In Russian)

33. [GOST R 70256-2022. Artificial intelligence systems in road transport. Vehicle traffic control systems. Requirements for testing curb and lane control algorithms]. Moscow, Russian Institute of Standardization Publ., 2022. 12 p. (In Russian)