| Literature DB >> 35485280 |
Daniel Kantor1,2, Martin Farlow3, Albert Ludolph4,5, Joan Montaner6, Raman Sankar7, Robert N Sawyer8, Fabrizio Stocchi9,10, Agnès Lara11, Sarah Clark12, Karine Deschet12, Loucif Ouyahia12, Yacine Hadjiat12.
Abstract
BACKGROUND: Digital communication has emerged as a major source of scientific and medical information for health care professionals. There is a need to set up an effective and reliable methodology to assess and monitor the quality of content that is published on the internet.Entities:
Keywords: Neurodiem; assessment; brain; communication; content quality; development; digital health; eHealth; guideline; health care professional; health information; implementation; methodology; monitoring; neurology; neuroscience; platform; quality
Year: 2022 PMID: 35485280 PMCID: PMC9227648 DOI: 10.2196/35698
Source DB: PubMed Journal: Interact J Med Res ISSN: 1929-073X
Reliability and relevance criteria.
| Item | Criterion description |
| Journal | Papers curated for generating summaries should be originally published in high-impact factor or renowned peer-reviewed journals in neurology or neuroscience, to target scientific information primarily validated by a board of editors and reviewers. The journal quality assessment is based on H-index classification used in the field of Clinical Neurology, which was recommended by the scientific steering committee. The score reflects a neurologist’s quality assessment of the journal: 1 for a paper not curated from a peer-reviewed scientific journal; 2 for a journal not classified in the SCImago Journal Rank; 3 for H-index values <30, 4 for H-index values 30-69, and 5 for H-index values ≥70. |
| Topic | Selected papers should be representative of current and major and scientific news at the forefront of information in each neurology subspecialty. According to the needs and interests of Neurodiem audience, selected topics should preferentially have direct impact on clinical practice or translate into major changes of the research and development landscape in neurology. The topic is scored on a scale from 1 to 5, based on the contribution in the neurology field or direct or the immediate impact in the clinical practice based on the author’s conclusion. |
Structure criteria.
| Item and subitems | Description | ||
| Title and teaser text | The title and teaser text are the entry points to the paper summary on the home page and, thus, require particular attention. These 2 elements were evaluated on the basis of accuracy of the information, attractivity, clarity, and conciseness. The title should reflect the actual and main findings of the original paper. The teaser text should be distinct from the title text and provide more information while leaving the readers curiosity opened to explore the paper. | ||
| Take away | This section should contain 1 to 2 sentences to summarize the main findings of the source paper. Considered to be independent from the rest of the summary, this section is evaluated according to the clarity and relevance of the main results supporting the authors’ conclusions. | ||
| Why this matters | In the format of 2 bullet points, this section is evaluated based on whether or not the structure and information on the clinical practice included in the original paper are respected. This section should (1) provide contextual information about the state of the art prior to the study and why it was interesting to explore the subject and (2) highlight study results’ critical clinical implications or impact, in terms of disease mechanisms or pathophysiological paradigm changes, candidate molecule development, anticipated switch of clinical practices and content quality guidelines, in neuroscience. | ||
|
| This section is evaluated based on whether the main material and methods used in the study, focused on the key elements in relation to the study results, are summarized, complete and accurate. Layout features for this paragraph should imperatively include | ||
|
| Study objective |
The primary endpoint; when relevant, the secondary endpoints The characteristics and size of the analyzed population, subpopulations, if applicable; animal model of pathologies will also be defined if needed The study design, in particular, groups being compared The follow-up duration and critical time points of analysis The description of the procedures, clinical scales, or parameters being measured as well as the rationale of these measurements (ie, the expected outcomes. Synthetic background information on investigations performed may be provided when dealing with cutting-edge technologies not obviously known by any subspecialists in neurology) | |
|
| Key results | The | |
|
| Limitations | The | |
Scientific and didactic value criteria.
| Item | Description |
| Accuracy | The paper summary must represent the original curated content with (1) accurate scientific glossary, abbreviations, and the numerical and statistical data described in the original full-text paper; (2) the accurate and relevant summary of the methodology, results, interpretation, conclusion, and impact in the clinical setting of the original full-text paper. |
| Didactic dimension | The didactic dimension is evaluated based on whether or not the Summary is clear, succinct, and comprehensible at first reading. It is important to provide enough background information, including context and scientific and medical definitions that are not common or shared among the neurologist community (eg, gene and protein functions, mode of action of new molecules, expected outcomes from emerging technologies). Understandability and readability of the Summary should be also supported by critical data that are presented logically and coherently. |
Credibility and relevance criteria.
| Item | Description |
| Authors or speakers | Authors or speakers who have been selected to share their expert point of view should be key medical experts in neurology subspecialties (neurologist or neuroscientist). Presenters should meet quality standards in terms of academic seniority (Assistant Professor degree or equivalent), reputation among their peers and long experience (score out of 5; on a scale from 1, strongly disagree, to 5, strongly agree). |
| Topic | The topic should be related to recent advances or debated issues in the neurology or neuroscience. The subject should be of interest to the neurologist community; hence, content should have a valuable and original contribution to the field and a significant clinical impact (scored out of 5; 1, not related to neurology; 5, relevant and is a major contribution to the field). |
Scientific and didactic value.
| Item | Description |
| Structure | Structure for expert points of view and talks presentations were evaluated with a score from 1 to 5 based on the inclusion, accuracy, and the chronology order of An introduction that includes (1) scientific background information, (2) a rationale for topic selection based the current state of scientific and clinical knowledge, and (3) a presentation overview Scientific and clinical evidence supporting the topic including numerical key data An overview of why these results have a scientific and medical impact in the neuroscience/neurology landscape A summary of take-home messages and conclusions relating to anticipated milestones in neuroscience research, direct implications for clinical practice and/or updates to this content quality guidelines |
| Accuracy and didactic dimension |
Accurate and concise background information and research or clinical context Relevant selection of specific arguments, scientific evidence, and illustrations for supporting expert demonstration |
| Writing or speech quality |
Authors or speakers should display the ability to synthesize ideas and provide simplified explanations of cutting-edge techniques or complex concepts Writing or speech style: a neutral, factual, and formal tone should be used Clarity and coherence: logical links between arguments and sections supporting scientific discussion The quality of English or local language and grammar should be appropriate |
Reliability and format.
| Item | Description |
| References | References cited in expert point of view or talks should be focused, and source of references should be reliable and consequently selected exclusively from (1) high-impact factor or recognized peer-reviewed journals in the neurology or neuroscience field (2) validated and up-to-date clinical guidelines. |
| Format | Owing to the summarized format targeted for expert point of view, core content of the paper should not exceed 1500 words. Likewise, informal talks should not exceed 5 minutes (to respect technical feasibility because big files cannot be uploaded to the platform), audience expectations (scientific community has short time to watch presentations and videos)) while more academic presentations should be between 5 and 10 minutes. |
Figure 1Analysis and monitoring of scientific quality applied to Summaries published on Neurodiem over a 12-month period.
Figure 2Analysis and monitoring of scientific and didactical quality applied to article Summaries published on Neurodiem over a 12-month period.
Figure 3Analysis and monitoring of scientific and didactical quality applied to Expert points of view published on Neurodiem over a 12-month period.