Evaluating the effectiveness of modeling principles for data models.

We evaluated the effectiveness of modeling principles intended to harmonize the information representation between terminology-ontology models and information models. Our study utilized dental clinical statements and sample dental record questions. We asked experts to define the equivalency (mapping) of these elements and measured their agreement. We modified the data elements and asked the experts to conduct subsequent mappings. We measured the agreement and compared the levels of agreement before and after changes, expecting that agreement would increase. The level of agreement (Kappa) before modeling was 0.3 to 0.4 and after was 0.5 (p<0.05). The difference was small but statistically significant. Our results suggest that the modeling principles improve information representation since agreement increased.