Experience - Software System Quality Measurement

35 years experience applying measurement techniques to characterize the capabilities and quality of complex software systems including large-scale information system architectures, advanced service-oriented architectures for C2, distributed simulation systems, shipboard C2 systems, C2 systems to support littoral warfare, soldier information systems, automated support of chemical, biological and nuclear weapons defense operations, paperless processing for veteran benefits, autonomous robots, large-scale multi-resolution simulation systems, theater-level warfare simulation, simulation of airborne logistics operations, simulations of the releases of hazardous aerosols through accident or attack, distributed platform-level warfare simulations, semi-automated forces, and human behavior representations

Developed objective and repeatable techniques for evaluating the quality of models and simulations, information systems, intelligent systems, distributed simulation interoperability, simulation validation processes, information system security, application source code and software development processes and applied these techniques to 30 different projects.

Developed and applied techniques for developing acceptability criteria, formulating verification and validation (V&V) test plans based upon design of experiments techniques, evaluating the impacts of interoperability upon the simulation representation fidelity, validating simulation systems and general information systems, deriving acceptability recommendations, tailoring V&V approaches for particular systems based upon the risk that the users of those systems incur, formally characterizing the representational fidelity of simulation systems, and analyzing techniques and systems for information warfare

Contributed to the US DoD Verification, Validation and Accreditation (VV&A) Recommended Practices Guide (RPG), Simulation Interoperability Standards Organization (SISO) Fidelity Glossary, US DoD Essentials of Modeling and Simulation online course and IEEE Std. 1516.4-2007, IEEE Recommended Practice for Verification, Validation, and Accreditation of a Federation – An Overlay to the High Level Architecture Federation Development and Execution Process

Acquired and exercised expertise in measuring the quality of models and simulations, information systems, intelligent systems, simulation validation processes, and software development processes

This experience in complex system modeling and simulation can be organized into the following technical areas:

The following sections provide more detailed information about the experience in these areas along with citations for the technical publications produced.

Model & Simulation Quality

Information System Quality

Intelligent System Quality

Simulation Validation Process Quality

Software Development Process Quality