| Literature DB >> 33228161 |
Trinidad Luque-Vara1, Marta Linares-Manrique1, Elisabet Fernández-Gómez1, Adelina Martín-Salvador1, María Angustias Sánchez-Ojeda1, Carmen Enrique-Mirón2.
Abstract
The objective of this study was to describe the content validation, through expert judgment, of a questionnaire for determining the level of knowledge that school teachers have of diabetes in order to design relevant educational interventions to improve the health of school-aged children. This psychometric study involved 15 experts who assessed each of the items in the instrument. The results revealed that the strength of agreement shown by the questionnaire ranged from substantial to almost perfect in its four dimensions, with the characteristics of "sufficiency" and "relevance" having the highest scores (0.982 and 0.903, respectively) based on the judgments made by the participating experts. Regarding statistical significance, the characteristics "sufficiency", with p < 0.001, and "relevance", with p = 0.001, were particularly relevant. The overall degree of understandability for the new version of the instrument was high (91.54%). The psychometric results obtained from validation of the "grado de conocimientos sobre diabetes en docentes del ámbito escolar" (Spanish for "level of knowledge of diabetes in school teachers")-GCDDaE questionnaire through expert judgment and the pre-test indicate that it is recommended for use as it is both relevant and quick and easy to administer.Entities:
Keywords: Fleiss’ κ; content validity; expert judgment; questionnaire; schools; type 1 diabetes
Year: 2020 PMID: 33228161 PMCID: PMC7699577 DOI: 10.3390/ijerph17228605
Source DB: PubMed Journal: Int J Environ Res Public Health ISSN: 1660-4601 Impact factor: 3.390
Judges, areas of knowledge, and work experience.
| Judge | Field of Expertise/Academic Training | Years of Work Experience |
|---|---|---|
| 1 | Language and Literature Didactics | 29 |
| 2 | Language and Literature Didactics | 35 |
| 3 | Health Sciences | 5 |
| 4 | Health Sciences | 33 |
| 5 | Health Sciences | 23 |
| 6 | Health Sciences | 21 |
| 7 | Health Sciences | 6 |
| 8 | Health Sciences | 7 |
| 9 | Research and Diagnosis Methods in Education | 21 |
| 10 | Research and Diagnosis Methods in Education | 18 |
| 11 | Personality, Evaluation, and Psychological Treatment | 34 |
| 12 | Personality, Evaluation, and Psychological Treatment | 30 |
| 13 | Didactics and School Organization | 14 |
| 14 | Nutrition and Food Science | 6 |
| 15 | Biochemistry and Molecular Biology II and Immunology | 10 |
Categories and indicators used by the judges to validate the tool.
| Categories | Indicators |
|---|---|
| The items are sufficient to measure the dimension | |
| The items measure some aspects of the dimension, but do not represent the full dimension | |
| A few items must be added in order to fully assess the dimension | |
| The items are insufficient | |
| The item is unclear | |
| The wording of the item requires several modifications or a very large modification in terms of meaning or word order | |
| Some of the terms in the item require very precise modifications | |
| The item is clear, with appropriate semantics and syntax | |
| The item bears no logical relationship to the dimension | |
| The item has a tangential relationship to the dimension | |
| The item has a moderate relationship to the dimension | |
| The item is completely related to the dimension | |
| The removal of the item would not affect the measurement of the dimension | |
| The item is somewhat relevant, but another item may be covering what this item is measuring | |
| The item is rather important | |
| The item is very relevant and should be included |
Source: adapted from Escobar-Pérez and Cuervo-Martínez (2008, p. 37).
Fleiss’ κ values and strength of agreement (Landis and Koch, 1977).
| Fleiss’ | Strength of Agreement |
|---|---|
| 0 | Poor |
| 0.1–0.20 | Slight |
| 0.21–0.40 | Fair |
| 0.41–0.60 | Moderate |
| 0.61–0.80 | Substantial |
| 0.81–1.00 | Almost perfect |
Strength of agreement among judges for the dimensions of the original instrument.
| Dimensions | Fleiss’ | Strength of Agreement (Landis & Koch, 1977) |
|---|---|---|
| General knowledge of the disease (D1) | 0.902 | Almost perfect |
| Knowledge of symptoms (D2) | 0.898 | Almost perfect |
| Knowledge of complications (D3) | 0.873 | Almost perfect |
| Knowledge of diabetic patient care (D4) | 0.791 | Substantial |
Agreement by pairs of experts.
| Dimensions | Fleiss’ | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1–15 | 2–14 | 3–13 | 4–12 | 5–11 | 6–10 | 7–9 | 8–7 | 9–6 | 10–5 | 11–4 | 12–3 | 13–2 | 14–1 | 15–8 | |
| D1 | 0.929 | 0.868 | 0.763 | 0.885 | 0.717 | 0.920 | 1 | 0.830 | 0.811 | 0.785 | 0.900 | 0.735 | 0.889 | 1 | 1 |
| D2 | 1 | 0.984 | 0.711 | 0.700 | 0.732 | 0.833 | 0.931 | 0.846 | 0.744 | 0.714 | 0.706 | 0.708 | 0.949 | 1 | 1 |
| D3 | 1 | 0.844 | 0.811 | 0.790 | 0.832 | 0.893 | 0.931 | 0.746 | 0.944 | 0.814 | 0.906 | 0.850 | 0.849 | 1 | 1 |
| D4 | 0.812 | 0.784 | 0.811 | 0.732 | 0.712 | 0.633 | 0.753 | 0.646 | 0.674 | 0.814 | 0.656 | 0.718 | 0.749 | 1 | 0.892 |
Fleiss’ κ coefficient and statistical significance of the characteristics of the original instrument.
| Characteristics | Fleiss’ |
|
|---|---|---|
| Sufficiency | 0.982 | 0 |
| Clarity | 0.792 | 0.024 |
| Coherence | 0.812 | 0.016 |
| Relevance | 0.903 | 0.001 |
Percentages of comprehensibility of the dimensions and their items in the final version of the validated instrument.
| Dimension | Item | Degree of Comprehensibility (%) | |
|---|---|---|---|
| Yes | No | ||
| General knowledge of the disease (D1) | Insulin | 95.5 | 3.5 |
| Types of diabetes | 97.3 | 2.7 | |
| Relationship between food intake and insulin | 93.8 | 6.2 | |
| Medication versus diet | 92.9 | 7.1 | |
| Insulin production | 91.2 | 8.8 | |
| Heredity and diabetes | 96.5 | 3.5 | |
| Glycemia and treatment | 94.7 | 5.3 | |
| Cure for diabetes | 93.8 | 5.2 | |
| Blood sugar levels | 86.7 | 13.3 | |
| Diabetes control | 96.5 | 3.5 | |
| Physical activity and diabetes | 88.5 | 10.5 | |
| Cause of diabetes: kidney filtering failure | 95.6 | 4.4 | |
| Cause of diabetes: insulin | 96.5 | 3.5 | |
| Cause of diabetes: intake of sugar and sweets | 94.7 | 5.3 | |
| Knowledge of symptoms (D2) | Frequent urination and thirst | 93.8 | 6.2 |
| Trembling and sweating | 93.8 | 6.2 | |
| Hypoglycemia | 87.6 | 12.4 | |
| Hyperglycemia | 85.0 | 15.0 | |
| Diabetes in children | 85.0 | 15.0 | |
| Knowledge of complications (D3) | Kidney damage | 96.5 | 3.5 |
| Blood circulation | 97.3 | 2.7 | |
| Loss of sensation in extremities | 94.7 | 5.3 | |
| Wound healing | 93.8 | 6.2 | |
| Cuts | 89.4 | 10.6 | |
| Knowledge of diabetic patient care (D4) | Food preparation | 85.0 | 15.0 |
| Special foods | 90.3 | 9.7 | |
| Cleaning of wounds | 92.9 | 7.1 | |
| Capillary blood glucose monitoring | 87.6 | 12.4 | |
| Insulin injection site | 91.2 | 8.8 | |
| Insulin temperature | 88.5 | 11.5 | |
| Inclination of the needle | 87.6 | 12.4 | |
Level of Knowledge of Diabetes.
| True | False | I Don’t Know | ||
|---|---|---|---|---|
| 1 | Diabetes is caused by having a sufficient amount of a hormone called insulin. | |||
| 2 | There are two main types of diabetes: type 1 (insulin-dependent) and type 2 (non-insulin-dependent). | |||
| 3 | Increases in blood insulin are caused by the intake of large amounts of food. | |||
| 4 | Pharmacological treatment is more important in controlling diabetes than diet and exercise. | |||
| 5 | Insulin is produced in the kidneys. | |||
| 6 | A person with diabetes is more likely to have children with diabetes. | |||
| 7 | In untreated diabetes, the level of blood glucose usually increases. | |||
| 8 | Diabetes can be cured. | |||
| 9 | A fasting blood glucose level of 210 (mg/dL) is very high. | |||
| 10 | The best way to control diabetes is through urine tests. | |||
| 11 | Regular exercise will increase the need for insulin or other diabetes medication. | |||
| 12 | Diabetes often causes poor blood circulation. | |||
| 13 | How food is prepared (fried, roasted, etc.) is as important as the food that is consumed. | |||
| 14 | Diabetes can cause damage to the kidneys. | |||
| 15 | A diet for people with diabetes consists mainly of special foods. | |||
| 16 | Eating too much sugar and other sweet foods is one of the causes of diabetes. | |||
| 17 | The common cause of diabetes is a lack of effective insulin in the body. | |||
| 18 | Diabetes is caused because the kidneys cannot filter the sugar from the blood. | |||
| 19 | Frequent urination and thirst are signs of low blood glucose. | |||
| 20 | Trembling and sweating are signs of low blood glucose. | |||
| 21 | Wounds and scratches heal more slowly in people with diabetes. | |||
| 22 | People with diabetes have to be extra careful when clipping their toenails. | |||
| 23 | An individual with diabetes should clean the wound first with povidone-iodine and then with alcohol. | |||
| 24 | Diabetes can cause a loss of sensation in the hands, fingers, and feet. | |||
| 25 | The main symptoms that children with diabetes may have are polydipsia, polyphagia, polyuria, and anorexia, among others. | |||
| 26 | In the case of hypoglycemia with loss of consciousness, juice, sweets, sugar, etc. should be administered. | |||
| 27 | Capillary blood glucose monitoring is done with a finger prick, on the fingertip if possible, which is the least pain-sensitive area of the finger. | |||
| 28 | The area and the injection site of the insulin must be changed weekly. | |||
| 29 | Cold insulin hurts less and is better absorbed. | |||
| 30 | The inclination of the needle on the skin when punctured should always be 90°. | |||
| 31 | Odd behavior and slurred speech are symptoms of hyperglycemia. |