Accuracy and Cost-effectiveness of Technology-Assisted Dietary Assessment Comparing the Automated Self-administered Dietary Assessment Tool, Intake24, and an Image-Assisted Mobile Food Record 24-Hour Recall Relative to Observed Intake: Protocol for a Randomized Crossover Feeding Study.

BACKGROUND: The assessment of dietary intake underpins population nutrition surveillance and nutritional epidemiology and is essential to inform effective public health policies and programs. Technological advances in dietary assessment that use images and automated methods have the potential to improve accuracy, respondent burden, and cost; however, they need to be evaluated to inform large-scale use.
OBJECTIVE: The aim of this study is to compare the accuracy, acceptability, and cost-effectiveness of 3 technology-assisted 24-hour dietary recall (24HR) methods relative to observed intake across 3 meals.
METHODS: Using a controlled feeding study design, 24HR data collected using 3 methods will be obtained for comparison with observed intake. A total of 150 healthy adults, aged 18 to 70 years, will be recruited and will complete web-based demographic and psychosocial questionnaires and cognitive tests. Participants will attend a university study center on 3 separate days to consume breakfast, lunch, and dinner, with unobtrusive documentation of the foods and beverages consumed and their amounts. Following each feeding day, participants will complete a 24HR process using 1 of 3 methods: the Automated Self-Administered Dietary Assessment Tool, Intake24, or the Image-Assisted mobile Food Record 24-Hour Recall. The sequence of the 3 methods will be randomized, with each participant exposed to each method approximately 1 week apart. Acceptability and the preferred 24HR method will be assessed using a questionnaire. Estimates of energy, nutrient, and food group intake and portion sizes from each 24HR method will be compared with the observed intake for each day. Linear mixed models will be used, with 24HR method and method order as fixed effects, to assess differences in the 24HR methods. Reporting bias will be assessed by examining the ratios of reported 24HR intake to observed intake. Food and beverage omission and intrusion rates will be calculated, and differences by 24HR method will be assessed using chi-square tests. Psychosocial, demographic, and cognitive factors associated with energy misestimation will be evaluated using chi-square tests and multivariable logistic regression. The financial costs, time costs, and cost-effectiveness of each 24HR method will be assessed and compared using repeated measures analysis of variance tests.
RESULTS: Participant recruitment commenced in March 2021 and is planned to be completed by the end of 2021.
CONCLUSIONS: This protocol outlines the methodology of a study that will evaluate the accuracy, acceptability, and cost-effectiveness of 3 technology-enabled dietary assessment methods. This will inform the selection of dietary assessment methods in future studies on nutrition surveillance and epidemiology. TRIAL REGISTRATION: Australian New Zealand Clinical Trials Registry ACTRN12621000209897; https://tinyurl.com/2p9fpf2s. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/32891. ©Clare Whitton, Janelle D Healy, Clare E Collins, Barbara Mullan, Megan E Rollo, Satvinder S Dhaliwal, Richard Norman, Carol J Boushey, Edward J Delp, Fengqing Zhu, Tracy A McCaffrey, Sharon I Kirkpatrick, Paul Atyeo, Syed Aqif Mukhtar, Janine L Wright, César Ramos-García, Christina M Pollard, Deborah A Kerr. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 16.12.2021.

Introduction

Background

Dietary intake surveillance enables monitoring of diet-related health and nutritional status of populations and provides vital data to inform public health nutrition policies and programs [1]. Therefore, accurate assessment of dietary intake is important to assist effective government decision-making on dietary advice and programs by defining the extent of the problem and possible solutions. The 24-hour dietary recall (24HR) is the current standard and preferred method for large-scale population surveillance to assess absolute dietary intakes [2-6]. Technology-assisted 24HR offers the potential to improve accuracy and reduce participant and researcher burden. However, the relative accuracy, acceptability, and cost of various technology-assisted methods are unclear. Population dietary surveillance studies typically include thousands of participants. As such, cost and personnel requirements are major determinants of the feasibility of a dietary assessment method. However, information on the cost of method administration has rarely been collected or published. This information would contribute to the feasibility assessment by researchers and decision makers.

A 24HR method is designed to capture detailed information on foods and beverages consumed on the previous day or during the previous 24 hours and is traditionally conducted as a structured face-to-face interview [7]. The 24HR method is a complex process involving numeracy, perception, memory, and the conceptualization of that memory [8]. The benefits of 24HR methods over less burdensome methods, such as food frequency questionnaires, include the detailed accounting of all foods and beverages consumed and information on context (eg, meal timing). This information allows the examination of questions related to different dietary components, dietary patterns, and meal patterning [9].

Various methods have been developed to enhance recall and reduce errors in reported intake. For example, the National Health and Nutrition Examination Survey in the United States includes an interviewer-administered Automated Multiple-Pass Method (AMPM) 24HR [3] as does the Australian Health Survey [2]. AMPM is a web-based interface designed for surveillance, typically implemented in-person by a trained interviewer, which adds to the cost of undertaking large-scale surveys. The AMPM provides a structured interview format with specific probes in 5 structured sets or passes: a quick list, forgotten foods pass, time and occasion pass, detail pass, and final review [10]. Portion size estimation is addressed using a food model booklet. More recently, web-based interfaces have been developed to enable self-administration of the 24HR method by participants, removing the need for trained interviewers and reducing study costs.

Automated web-based, self-administered 24HR methods begin with a quick list. Details are collected using a sequence of probes, and standard images of foods or models are used to help participants estimate portion sizes. The format and number of images are informed by user testing [11,12]. These methods include the US-developed Automated Self-Administered Dietary Assessment Tool (ASA24) and the UK-developed Intake24. ASA24 is an adaptation of AMPM and was developed by the United States National Cancer Institute based on input from stakeholders in an external working group, along with cognitive and usability testing [13]. Intake24 was developed by Newcastle University, United Kingdom, using 4 cycles of user testing, with modification after each cycle, in adolescents and young adults [12,14]. Similar levels of measurement error have been observed in web-based self-administered 24HR methods (Intake24 and ASA24) and in interviewer-administered methods as determined by objective measures of energy intake using doubly labeled water [15,16]. This suggests that the additional costs associated with interviewer-administered methods in the form of trained interviewers and coders may not translate to improved accuracy. However, to date, no study has evaluated the differences in accuracy between Intake24 and ASA24.

Using image-assisted methods to supplement the 24HR method has the potential to reduce recall bias, with images used to assist food identification and portion size estimation. In recent reviews, image-assisted approaches, including 24HR methods, resulted in greater accuracy of self-reported dietary intake when compared with the accuracy of methods without images supplied by participants [17-19]. The Image-Assisted mobile Food Record 24-Hour Recall (mFR24) is a mobile app developed by Purdue University. Participants are instructed to take before and after images of all food and beverages consumed and to include a fiducial marker (an object of known shape, size, and color) [20] in each image to aid in portion size verification. The content of the images is confirmed either by a human trained analyst or by automated methods using computer vision and machine learning (eg, deep learning) techniques [21-23]. In contrast to other image-assisted 24HR methods in which the image review occurs toward or at the end of the interview [24-28], the image review in mFR24 begins at the start of the interview based on participant feedback from pilot testing. This novel approach has yet to be evaluated for its accuracy and acceptability. Furthermore, the accuracy and acceptability of the mFR24 has not been compared with either the web-based self-administered ASA24 or Intake24 in the same study population.

To continue to improve upon dietary assessment, there is an urgent need for studies that enable the understanding and mitigation of measurement errors [29]. The error in dietary intake estimation can be identified by comparing reported intake with recovery biomarkers, such as doubly labeled water as a measure of true energy intake [30]. However, such methods are limited to energy or single nutrients and do not identify specific foods and beverages that are omitted or inaccurately reported. Controlled feeding studies allow for the examination of measurement errors at the level of foods and beverages. Studies with measures of known food and beverage intake enable the understanding of factors contributing to misreporting, such as omission of particular types of foods, intrusions, inaccurate portion size estimation, and incorrect food descriptions [31-35]. For example, Kirkpatrick et al [33] found that more intrusions (items not consumed) were present with the use of a web-based self-administered 24HR method than in an interviewer-administered 24HR method. Widaman et al [35] found no statistically significant differences between estimated and observed intake of grain foods using web-based self-administered 24HR methods, although all other food groups were overestimated. These findings illustrate how controlled feeding studies can provide insights into the mechanisms of dietary intake measurement errors that would otherwise remain unknown.

Various psychosocial factors have been associated with misreporting, including social desirability traits, restraint, disinhibition, fear of negative evaluation, and body weight and body image perceptions [36-38]. In a study conducted in the United States, measuring an array of psychosocial and demographic factors, Tooze et al [37] found that although these factors cumulatively accounted for 20% of the variability in misreporting in interviewer-administered 24HR methods, 80% remained unaccounted for. Clearly, other constructs associated with misreporting, psychosocial or otherwise, need to be identified, and it has been recommended that future research focuses on this [37,39]. For example, it is frequently stated that visual perception and conceptualization of memory are involved in reporting of intake [8], but these factors are not typically assessed in studies evaluating participant reporting accuracy. Furthermore, a better understanding of how psychosocial and cognitive factors map to various sources of error (eg, omissions and intrusion) could potentially help to minimize measurement error. To the best of our knowledge, no controlled feeding studies have evaluated the associations of psychosocial or cognitive factors in food and beverage reporting accuracy.

Social factors may also contribute to misreporting. Individual work patterns and lifestyles have rapidly changed with the increased use of screen-based work and leisure activities [40,41]. In a survey of over 12,000 households in Australia, 75% people reported that they always, often, or sometimes felt rushed or pressed for time [42]. With these rapid shifts in day-to-day life, the demands for traditional dietary assessment methods may be misaligned with people’s daily lives and expectations and may be viewed as inconvenient. Technology-based self-report dietary assessment methods enable remote completion using laptops or mobile devices and have been indicated as more acceptable to participants than traditional face-to-face methods [43-45]. For example, research conducted in the United States demonstrated that 70% preferred the ASA24 over the AMPM [46]. The acceptability of dietary assessment methods has important implications, especially in large-scale population studies, as it can impact response rates and therefore the representativeness and generalizability of the study sample [47,48]. Image-assisted 24HR methods, such as the mFR24, are yet to be fully evaluated for consumer acceptability and comparison with other technology 24HR methods such as Intake24 and ASA24.

Objectives

This research protocol will compare 3 leading technology-assisted dietary assessment methods. Using a controlled feeding study design with healthy adults aged 18 to 70 years, this study will (1) compare the accuracy, acceptability, and cost-effectiveness of 3 technology-assisted 24HR methods (ASA24, Intake24, and mFR24) relative to observed intake for 3 meals on 1 day; (2) test the accuracy of automated methods for determining food and beverage intake using food images and image analysis, computer vision, and machine learning techniques; and (3) assess associations between reporting errors and demographic, psychosocial, and cognitive factors.

Methods

Sample and Recruitment

The sample will be selected from adults aged 18-70 years residing in Perth, the capital city of Western Australia, Australia, and recruited via the electoral roll by selecting postcodes that provide representation across socioeconomic status. Other recruitment methods will include advertising on the Curtin University website and a snowball methodology (eg, email newsletter and referrals from friends or colleagues). A final sample of 150 randomized participants (allowing for a 20% dropout) will allow for 90% power at a 5% significance level when the true difference between any 2 mean differences between estimated and observed dietary energy intake is 0. Quota sampling will be used to ensure that equal numbers of men and women are recruited. To be included in the study, participants must be able to attend in-person feeding sessions on 3 separate days and have access to a computer and a smartphone (running iPhone operating system or Android operating system) with a data plan. Exclusion criteria include serious illnesses or medical conditions, pregnancy, special dietary requirements, or dietary restrictions because of food allergies or intolerances or dieting to lose weight.

Study Design

A controlled feeding study with a crossover design will compare the accuracy of 3 technology-assisted methods of assessing 1 day of dietary intake: ASA24, Intake24, and mFR24. The sequence of the 3 dietary assessment periods will be randomized for each participant, with a 1-week washout period between each feeding session (Figure 1). Therefore, each participant will be exposed to each of the 3 methods at different periods. The crossover design, a repeated measurement design, will allow both between-group and within-group method comparisons. This design yields a more efficient comparison of treatments than a parallel design because fewer participants are required in the crossover design to attain the same level of statistical power or precision as a parallel design.

Figure 1

Accuracy, acceptability, and cost-effectiveness of technology-assisted dietary assessment study flowchart on enrollment, randomization, and study design. ASA24: Automated Self-Administered Dietary Assessment Tool; mFR24: Image-Assisted mobile Food Record 24-Hour Recall.

Ethics approval from the Curtin University Human Research Ethics Office has been obtained (approval number: HRE2019-0222). Reciprocal ethics approval from the Department of Health Western Australia Human Research Ethics Committee has also been obtained (approval number: 201909.06), and the trial is registered with the Australian New Zealand Clinical Trials Registry (ACTRN12621000209897). All research design, practices, and reporting of studies conducted in Australia will be aligned with the Australian Code for the Responsible Conduct of Research. Participants will receive a maximum of Aus $60 (US $42) as a token of appreciation for their involvement in the study.

Research Study Database

A purpose-built research study database will be developed using a database platform (Microsoft Office Professional Plus 2016, Microsoft Pty. Ltd) to manage, contact, and track the progress of the study participants throughout the study. The database will send autogenerated emails containing study information and personalized links to remind participants of upcoming appointments and complete applicable surveys beforehand. Email and SMS text messaging prompts will be sent directly from the study database using Email to SMS technology. The study database will automatically update the participant status with respect to their study compliance. The system will prompt reminders via email and SMS text messaging for participants who have not yet completed their tasks.

Randomization

At the first face-to-face session, eligible participants will be randomized using a random number generator and stratified by gender. The order in which the participant completes the three 24HR methods will be randomly allocated to ensure no order effect. Allocation will be concealed using sealed opaque envelopes. A statistician, not involved in data collection, will generate the randomization sequence. This will ensure adequate allocation concealment from the research team involved in recruitment and data collection.

Procedures

Each participant will complete a web-based screening and provide informed consent. If eligible, they will be directed to complete web-based baseline demographic and psychosocial surveys (taking approximately 30 minutes) and cognitive tests (taking approximately 20 minutes) before attending 3 feeding days at the Curtin University School of Population Health food laboratory. Demographic characteristics, including age, gender, and highest education attainment will be recorded. Physical activity levels will be assessed using the International Physical Activity Questionnaire, short form 7-day self-administered format [49]. Table 1 presents a brief description of the questionnaires and the tests. Figure 2 shows a conceptual framework of the role of demographic, psychosocial, cognitive, and dietary factors in misreporting, synthesized from previous literature and adapted from existing frameworks [8,36,37,39,50-52].

Table 1

Baseline study questionnaire and test descriptions in Accuracy and Cost-effectiveness in Technology-Assisted Dietary Assessment.

Questionnaires and tests			Description of content		Study
Demographic and personal characteristics			11 items: gender, age, educational level, employment, country of birth, ethnicity, smoking, alcohol use, and socioeconomic and financial status		—a
Physical activity			8 items: International Physical Activity Questionnaire (short form)		[49]
Psychosocial measures
	Three-factor eating	51 items measuring factors associated with eating behavior: cognitive restraint of eating, disinhibition, and hunger		[53,54]
	Social desirability	13 items: true-false statements measuring social approval and acceptance		[55]
	Fear of negative evaluation	12 items: 5-point scales to assess concern about being perceived unfavorably by others		[56]
	Time pressure	7 items: assesses the competing perceived time pressure		[57]
	Perceived Stress Scale	5 items: assesses perception of external environmental stressors; short version of the original Perceived Stress Scale-14		[58]
	Weight loss history	2 items: assesses frequency and magnitude of previous weight loss.		[59]
Cognitive measures
	Visual digit span (forward and backward)	Assesses working memory by asking participants to recall spans of digits in 14 trials. Participants will see digit sequences on a computer or mobile phone screen and must recall them by selecting the recalled digits from a circle of digits with the mouse or their finger.		[60]
	Vividness of visual imagery questionnaire	16 items: 5-point scale administered twice to assess conceptualization of visual memory. Participants imagine people and scenes and rate the vividness of these mental images (first with eyes open and then with eyes closed).		[61]
	Trail making test	Assesses visual attention and task switching. Participants are asked to draw lines in specific, predetermined sequences from node to node on a screen as quickly and as accurately as possible.		[62]
	Wisconsin card sorting test	Assesses cognitive flexibility and executive function. Participants are asked to sort cards into 4 different “categories.” No instructions are given regarding the categorization rules. Participants are informed whether each selection was correct or incorrect. The cards to sort into these piles have similar designs and vary in color (4 variants), shape (4 variants), and number of shapes (4 variants). Categorization rules change midtask without warning.		[63]

aQuestion items devised by authors.

Figure 2

Conceptual framework for assessment of factors that may be associated with 24-hour dietary recall reporting accuracy. 24HR: 24-hour dietary recall.

Feeding Days

The participants will attend the food laboratory on 3 separate days. On day 1, they will receive a brief introduction to the study (with the objective described as finding better ways to assess what people eat) and be randomized. They will have their height and weight measured using standard protocols [64]. At the food laboratory, participants will consume 3 meals ad libitum (breakfast, lunch, and dinner) on the same day and will leave the laboratory between meals. No restrictions will be placed on consuming food and beverages outside of the laboratory meals. The participants will select from a menu and will not have access to the weight of their food and beverage selections. Menu items will be selected based on a combination of the top 100 most commonly consumed meals and snacks in Australia (Australian Bureau of Statistics, personal communication, 2020).

Each participant will enter the food laboratory one at a time to consume their meal. In accordance with the COVID-19 protocols issued by the Western Australia Government Department of Health, participants will be separated by screens and physically distanced from each other, with a maximum of 8 participants at any one time. This may change if restrictions are eased. All food and beverage items will be inconspicuously weighed using Kelba KHX-3 bench scales (Kelba) with a 0.1-gram resolution in a separate laboratory space before being served on the participant tray. Before delivering the tray to each participant, the researcher will inconspicuously take an image of the tray using a researcher version of the mFR24 app that allows insertion of a unique user ID for each image. When finished eating, each participant’s tray will be collected and an after image with the researcher mFR app will be taken. Plate waste will then be weighed to determine the amount of each item consumed. The amount consumed will be determined by subtracting the weight of the food plate waste from the weight of the served amount. Weighing will be conducted in duplicate, and a third measure will be taken if the first 2 measures differ by >0.5 grams. The average of the 2 closest measures will be recorded.

24-Hour Dietary Recall Interview Methods

Each day subsequent to the feeding day, the participants will complete a 24HR interview remotely, each time via a different technology-assisted dietary assessment method (ASA24, Intake24, or mFR24), the order of which will be randomized.

Automated Self-Administered Dietary Assessment Tool (2016)

Participants will be emailed a weblink and a username and password to access the ASA24 interface. A consortium of Australian Universities adapted the ASA24 by incorporating Australian food composition tables [65]. Participants will be asked to (1) report everything they had to eat and drink the previous day from midnight to midnight by selecting an eating occasion and time, then searching for matching food and beverage items, and reviewing any gaps in consumption of more hours; the database contains >4800 foods and beverages from Australian food composition tables (AUSNUT 2011-2013); (2) provide additional details of each food and beverage item (eg, form, preparation method, additions, and amount consumed); food images in ASA24 will assist in portion size estimation; (3) review and edit all the foods and beverages they selected; (4) add any commonly forgotten foods and beverages that they consumed after being prompted and directed back to the food list; and (5) confirm that they have recorded all of the food and beverages from the previous day [13]. Participants can add food and beverages that are not in the database via a missing foods tool incorporated in a bespoke spelling correction system to address misspelled food names. In previous studies, participants completed the ASA24 in 17 to 34 minutes [66].

Intake24

Participants will be emailed a weblink to access the Intake24 interface. A short instructional video is provided for the participants to watch before commencing the 24HR interview. Participants will be asked to (1) key in all the foods and beverages consumed the previous day between waking up and going to sleep as free text; (2) select items from a database and match each item consumed; the database contains >2800 foods and beverages by incorporating Australian food composition tables (AUSNUT 2011-2013) [67]; participants will be able to add food and beverages not included in the database via a missing foods tool incorporated in a bespoke spelling correction system to address misspelled food names; participants can add their own personal recipes, sandwiches, and salads; (3) estimate the portion sizes of the items consumed using images and standard serving sizes; (4) review all the foods and beverages they have selected and edit if necessary; and (5) add any missing items associated with the foods they have already selected after being prompted to do so [12]. Previous studies indicate an average completion time of 20 minutes.

Overview

The mFR24 app, an image-based dietary assessment system [20,22,23,68], will be adapted as an image-assisted 24HR method for this study. The system consists of a mobile food record app (mFR24), which runs on a mobile device (iPhone or Android smartphone) and a dedicated cloud-based server for the storage of images, metadata, and food image processing and analysis. Using the mFR24, participants will take pictures of their food and beverages before and after eating. The images will be automatically uploaded to the cloud-based server via Wi-Fi or the 4G or 5G network. The content of the images will then be confirmed by the participant in a process known as user confirmation. A researcher version and a participant version of the app will be used in this study. The researcher version will be installed on various devices and used to take before and after images of each participant tray. These images will be uploaded to a researcher folder on the server. The participant version of the app will include additional features.

When allocated to the mFR24, the participants will install the mFR24 (participant version) on their smartphones and be shown how to use the mFR24 app on the feeding day by a research assistant. They will be instructed to take a before and after image of all meals, beverages, and snacks consumed from the first meal served at the study center until midnight and include a fiducial marker (a colorful checked object of known size, color, and shape that assists in food and beverage recognition and quantification) in each image. mFR24 has an automated feature to detect the presence of the fiducial marker and alert participants if the fiducial marker is missing from the image. An angle-detection algorithm assists participants in taking the image at the correct angle (between 45° and 60° from the horizontal plane). Once captured and confirmed by the participant, the images will no longer be accessible to the participant until the user confirmation step (Figure 3). At the dinner session, participants will receive training on how to label their images for user confirmation the following day.

Figure 3

Screenshots of the mFR24 application interface showing the steps in the review process and viewing an eating occasion. (a) image list with time and date stamp displayed (b) viewing a labeled eating occasion with colored pins and labels identifying the food and beverages. The image also shows the inclusion of the fiducial marker.

User Confirmation

The mFR24 app includes a feature known as the user confirmation step, where once midnight has lapsed, the images are returned to the participant for labeling with food and beverage names. On the day following the feeding day, participants will select and label each image from the review function in the mFR24 app (Figure 3). To label a food or beverage, the participant will tap on the item, and a pin will appear with tap to edit. Tapping the pin again will take the participant to the food list search function. When the participant starts typing the word, a list of foods will appear where they can select from the list. The food list consists of 372 food and beverage items. The food list has been adapted so that a mini label and short description are displayed to the participant. These labels link to a food composition database (not visible to the participant) with the food code, detailed description, and energy and nutrient composition (AUSNUT 2011-2013 nutrient database). If the participant cannot locate their food item in the list, typing food not listed will allow a free text entry. Once confirmed, the image with the confirmed pins is automatically sent to the server and disappears from the app. Participants will be asked to complete this task before the mFR24 interview. Researchers will be able to view the participant’s annotated images on a secure server.

mFR24 Interview

A trained researcher will conduct a 24HR interview following an adapted multiple-pass approach [69] outlined in Table 2. This 24HR process will enable the estimation of the total intake of food and beverages consumed during a 24-hour period. The recall process will be assisted by the labeled food and beverage images taken by the participant using the mFR24 app. The interview will be conducted via a video call on the day following the controlled feeding day. The interview structure is based on the AMPM developed by the United States Department of Agriculture [10]. Briefly, the original 5 steps include the collection of a quick list of foods and beverages consumed, a check for commonly forgotten foods, time and occasion, details and review, and a final probe. In the adapted version used in this study, the quick list and time pass will be completed by researchers before the interview using the participant labeled images, which will be viewed on a secure server.

Table 2

Adaptations of the United States Department of Agriculture Automated Multiple-Pass Method in the interview structure for the Image-Assisted mobile Food Record 24-Hour Recall interview.

Automated Multiple-Pass Method steps	Aim	Image-Assisted mobile Food Record 24-Hour Recall steps
		When image is taken	When image is not taken
Step 1: quick list	The purpose of the quick list pass is to obtain a quick report of foods and beverages consumed in the past 24 hours without interrupting the respondent and to introduce the respondent to the concept of 24-hour recall.	Taken from the mini label and image provided by the participant; participant is asked to list any foods and beverages consumed that are not shown in images.	Participant is asked to list all foods and beverages consumed that are not shown in images.
Step 2: forgotten foods list and additions	The forgotten foods list prompts the respondent’s memory and collects other foods or beverages that are not reported in the quick list.	Participants are asked if they consumed items from a list of commonly forgotten foods.	Participants are asked if they consumed items from a list of commonly forgotten foods.
Step 3: time and occasion	The time and occasion of food or beverages consumed are recorded.	This does not require a separate pass. Time of eating is taken from the image metadata.	Ask participant to recall time and occasion of forgotten foods when item is reported.
Step 4: detail cycle	The aim of this step is to collect specific descriptive information about each food item and beverage reported and record quantities and any additions made to the food.	Clarify only nonidentifiable food and beverage items; follow the Australian Health Survey food model booklet to confirm amounts consumed; and check the after image for leftovers.	Use food-specific probes to obtain details; follow the Australian Health Survey food model booklet to confirm amounts consumed; and probe leftovers.
Step 5: final probe	This is the last opportunity for the respondent to remember any new foods and beverages.	Read out the list of food and beverage items.	Read out the list of food and beverage items.

The video call interview will consist of a quick list of any foods or beverages for which an image was not taken, a probe for commonly forgotten foods, a detail cycle, and a final probe. The researcher will use a screen-sharing function to enable both the researcher and participant to view each image simultaneously. During the detail cycle, participants will be asked to provide food and beverage details when these are unclear from the images. The participants will also be asked to describe the amount of each item consumed, using the standard food model booklet used in the Australian Health Survey [70]. Household measures such as metric teaspoons or pieces will also be used to describe amounts not available in the booklet and may, in some instances, be the preferred method of portion size description by the participants. During the final probe, the researcher will confirm all foods and beverages, descriptions, and portion sizes reported by the participant. The researcher conducting the 24HR interviews will not have access to the observed intake data and will not be present on the feeding day. Following the interview, data will be entered into a nutrition analysis software (FoodWorks 10, Xyris Software) linked to the AUSNUT 2011-2013 nutrient database to estimate food, energy, and nutrient intake for the 24-hour recall period.

Automated Image Analysis

Automated methods using computer vision and machine learning (eg, deep learning) techniques will also be undertaken [21-23] using the images collected with the mFR24. The study will test the accuracy of automated methods using computer vision and machine learning techniques to estimate true intake. These methods include food identification [71], food segmentation [72], and volume estimation (for food portion size estimation) [73]. In recent years, there has been rapid proliferation in the use of artificial intelligence and machine learning techniques in image analysis, particularly the use of deep learning methods based on neural networks [74]. The authors (EJD and FZ) from Purdue University have recently developed several deep neural network approaches for food image analysis and will modify these methods for use in this study. This will include generating ground truth images to train the deep neural networks using a series of standard images of the food and beverage items to be served at each meal with known food weights. As deep learning methods require a large amount of training data, we will investigate the use of data augmentation methods, particularly using generative adversarial networks [75], to aid in training. Trained models will then be used to recognize the food types, estimate the food portions, and compare the automated methods with the true intake. Standard metrics of precision and recall will be used in the computer vision and machine learning fields to determine the performance of the automated techniques.

Poststudy Acceptability Questionnaire

The participant’s perceptions of the acceptability of the 24HR method will be asked at the end of the study via a web-based survey using both open and closed questions. Their perceptions of each method will be asked about one at a time in a randomized order. Participants will be asked what device they used to complete each method and then be asked questions using a 5-point Likert scale to rate their agreement with statements including how easy it was to find and remember foods and remember amounts and whether they would be willing to use the method again. Open-ended questions will explore the participant’s likes and dislikes about each method. Finally, participants will be asked which of the methods, if any, they preferred and why.

Exit Interviews

A qualitative methodological approach using in-depth interviews and reflexive thematic analysis [76] will explore and describe perceptions and beliefs regarding each of the dietary assessment methods. Approximately 10% (20/150) of the recruited sample (participants stratified by age and gender) will be invited to participate in a semistructured in-depth interview. The script will include questions regarding what would motivate participants to take part in studies assessing dietary intake, barriers and enablers to participation, retention, and most-favored incentives to diet research participation (eg, dietary feedback and financial incentives). Questions will also be asked about the acceptability of the mFR24 method and features (eg, labeling of images). Interviews will be audio-recorded, transcribed verbatim, and reviewed for accuracy by the participant and researcher before analysis. Transcripts will be managed using transcription software (NVivo 12.6, QSR International). Sampling and analysis will continue until pragmatic saturation is reached [76].

Cost and Cost-effectiveness of Measures

Both financial and time costs for participants to use each of the methods will be assessed. The time spent by researchers and participants in the administration of each 24HR method will be recorded for each participant. This includes time spent training individuals to take the mFR24 images, time spent completing the 24HR interview, and any time spent supporting individuals to complete their 24HR interviews. The time spent by researchers coding the mFR24 data will also be recorded. Both ASA24 and Intake24 have the capability to collect time stamp data to identify how much time the participants spend inputting data. All other time data, including time spent cleaning the data, will be manually collected by researchers.

Financial costs, such as server space for digital data storage, will be recorded. After converting the time data to a financial cost, the total cost data will be considered in parallel with the measures of accuracy derived for the 3 methods. The primary accuracy measure for cost-effectiveness is the absolute percentage error in energy intake. Comparing costs with accuracy will identify whether any of the 3 methods are dominated by another (ie, is more expensive and less accurate). If not, the cost per person to reduce absolute misreporting by 1% point will be estimated.

Data Analyses

Energy Intake Estimation Accuracy

The participant feeding days with at least two meals eaten at the food laboratory will be included in the analyses. Daily energy intake from each 24HR method and the controlled feeding sessions will be calculated, excluding any items reportedly consumed outside of the food laboratory. Outlier checks will be conducted to identify any obvious keying errors or food composition data anomalies, which will be corrected before proceeding. Bland-Altman plots will be used to test for agreement between the 24HR values and controlled feeding measures at the individual and group levels. Repeated measurements will be analyzed using the linear mixed models procedure using SPSS version 25, accounting for age, gender, and BMI, with 24HR method and method order as fixed effects, to assess whether there are statistically significant differences by 24HR method. Misreporting will be assessed by examining the ratio of reported 24HR intake to observed intake, with the lowest tertile considered to indicate underreporting. The proportion of underreporters in each 24HR method will be compared using chi-square tests and logistic regression. Among underreporters, the total energy misestimation will also be compared using regression models adjusted for age, gender, and BMI.

Food Groups and Misreporting

Foods and beverages consumed during the controlled feeding sessions will be matched to the food codes from Australian food composition tables (AUSNUT 2011-2013) using a nutrition analysis software (FoodWorks 10, Xyris Software). The measured quantities of the foods and drinks consumed in the food laboratory will be coded. The observed intake of the provided food groups will be calculated. In ASA24, Intake24, and mFR24 data sets, foods and drinks that were reportedly consumed outside of the food laboratory (eg, snacks) will be removed before analysis based on the reported eating occasions and time.

The 24HR data on food and beverage intake from each method will be compared with the observed weight and daily intake of food and beverages to identify 4 types of misreporting, that is, omissions, intrusions, misclassifications, and portion misestimations. The following 5 steps will be used:

Matches between reported and observed intake will be identified by comparing the assigned food codes. Food codes correspond to a food grouping hierarchy in which the first 2 digits indicate the major food groups (eg, dairy, meat, and vegetables), the first 3 digits indicate the submajor food groups (eg, milk products and dishes), and the first 5 digits indicate the minor food groups (eg, dairy milk, yogurt, and cheese) [77]. Food codes of reported and observed intake data will be considered an exact match if they belong to the same minor food group. Foods codes from the same submajor food group will be considered a close match, whereas foods from the same major food group will be considered a far match.

Omissions, which are items that were consumed but are not reported, will be identified, and omission rates at each food group level will be calculated using the formula:

sum of omissions / (sum of omissions + sum of all matches) × 100%.

Omission rates of mixed meals, single items, and condiments will be calculated. Differences in omission rates by 24HR method will be assessed using chi-square tests.

The proportion of misclassifications, which are incorrect descriptions of consumed items, will be defined as close or far matches. Differences in the proportion of misclassifications within food groups by the 24HR method will be assessed using chi-square tests.

Intrusions, which are items that are reported but were not consumed, will be identified, counted by food group, and expressed in kilojoules.

Misestimation of portion size will be assessed by comparing the intake of food item matches in grams for each 24HR method with observed intake using a paired samples statistical test.

Correlates of Energy Misestimation

Psychosocial, demographic, and cognitive factors associated with omission and intrusion rates and with energy misestimation on each 24HR method will be evaluated using chi-square tests and multivariate logistic regression. The effects of factors will be reported as odds ratios and associated 95% CIs. Some dietary factors in the Accuracy and Cost-effectiveness of Technology-Assisted Dietary Assessment study are standardized because of the controlled feeding methodology (meal frequency and eating location), but it is hypothesized that food and meal complexity and physical form will affect reporting accuracy via an interaction with cognitive factors. P<.05 will be considered statistically significant in all analyses.

Acceptability

Differences in acceptability among methods indicated by the rating and proportions of participants agreeing with each of the ease-of-use statements will be assessed using chi-square tests. Demographic correlates of a preference for a particular method will be explored using multivariable logistic regression, adjusting for method order.

Cost-effectiveness

Both participant and researcher time costs will be multiplied by standard staff costs (including on-costs) to estimate the financial cost of using each method on a per-person basis. Differences in time cost and total financial cost will be compared across methods using a repeated measures analysis of variance test. P<.05 will be considered statistically significant. If statistically significant differences exist, differences in cost-effectiveness will be assessed using the same procedure. Cost-effectiveness will be defined as the cost per person to reduce the absolute misestimation of energy intake by 1% point.

Results

Participant recruitment commenced in March 2021 and will end in December 2021. Ethics approval for this study was granted by the Institutional Review Board in April 2019. Participant recruitment commenced in March 2021. As of August 2021, 68 participants had enrolled in the study. Data collection will conclude at the end of December 2021. Data analysis will commence in 2022, and results are expected to be published in late 2022.

Discussion

Overview

This study will provide outcome results in 3 main areas. It will evaluate (1) the accuracy, user acceptability, and administration cost of 3 technology-assisted dietary assessment tools, which have never been compared in a single study; (2) the accuracy of novel automated image analysis technology; and (3) the association of reporting accuracy of participants with a range of cognitive and psychosocial factors.

The results of this research will provide additional information on the feasibility, accuracy, and cost to aid the selection and further development of 3 technology-assisted 24-hour recall methods for application in large-scale dietary assessment. The use of a controlled feeding study design for comparing multiple technology-based dietary assessment methods is novel and will allow comparison among methods relative to observed intake. The results will also elucidate the correlates of dietary intake misreporting, which will be useful in developing error mitigation strategies.

Comparison With Previous Work

Measuring the cost of the 3 technology-assisted dietary assessment methods is a unique feature of this study. The costs of interviewer-administered pen and paper–based 24HR in 2013 ranged from US $178 per participant in South Asia to US $774 per participant in the Middle East and North Africa [78]. However, there is little published information on the operational costs of technology-assisted dietary assessment [79], although researchers have noted that staff costs persist despite substantial savings on data collection and entry [80]. Quantifying and comparing the costs of technology-assisted dietary assessment will provide essential information to aid decisions in planning population surveillance and large-scale epidemiological studies that aim to enroll thousands of individuals.

Elucidating the correlates of and developing methods for addressing misreporting in dietary data collection and analyses is relevant to the global research community involved in studies that assess dietary intake. It has been claimed that the measurement errors in dietary assessment are so great that the data hold no value [81,82]. A comprehensive refutation of this assertion argued that besides further developing and evaluating assessment methods, studies should be conducted to understand and manage measurement errors [29].

To date, studies evaluating the role of psychosocial factors in dietary reporting accuracy have focused on dietary energy misestimation, with energy expenditure as a reference measure [37,51,83-86]. Studies with measures of known food and beverage intake aid the understanding of how misreporting occurs, that is, the distributions of omissions, intrusions, incorrect portion sizes, and incorrect food descriptions [87-89]. However, to our knowledge, no such study has measured psychosocial and cognitive factors, and thus the associations with various food and beverage error types; this study aims to address this gap.

Strengths and Limitations

This study has several strengths and limitations. A strength of this study is the collection of observed food and beverage intake using a controlled feeding study design. Many criterion validation studies use biomarkers of energy expenditure, which indicate the magnitude of misreporting, but do not help to understand differential misreporting of food and beverage items nor the underlying mechanisms. For example, certain food types may be more frequently omitted from reporting, or certain food portion sizes may be frequently misestimated. Another strength is the crossover design of the study, which allows for between- and within-group comparisons. Few studies have compared 24-hour recall methods with reference methods using a within-group comparison, and those studies did not use technology-based methods [90,91]. Studies assessing multiple technology-based 24HR methods have included different participants completing each method [33,46]. In such studies, between-person differences in dietary intake and recall biases may have contributed to the observed differences. The within-group comparison of the 3 dietary assessment methods in our study will enable a comparison not subject to confounding by between-person variation. This is an important strength of this study, as it will also allow the evaluation of consumer acceptability of these methods. The uniqueness of this study is the evaluation of the cost-effectiveness of the 24HR methods. This will provide valuable data for policy makers and researchers planning large-scale surveys.

A limitation of this protocol study is that the limited number of foods offered may facilitate a better chance of a match between reported and observed intakes than if the study was conducted in a free feeding environment. Another limitation of this study is the self-selecting sample, meaning that the findings may not be fully generalizable to the wider population, as study participants who volunteered may be more motivated to complete dietary assessment methods because of their own interest in dietary intake. Recruitment through the electoral roll is an important aspect of the study design that facilitates a wide and diverse recruitment. In addition, randomization by gender aims to recruit equal proportions of men and women across the groups so that gender differences can be assessed.

Conclusions

The 24HR dietary assessment is a widely used method for population-wide nutrition surveillance and epidemiology globally [92]. By assessing the accuracy of dietary intakes, acceptability, and cost-effectiveness, this study will comprehensively evaluate 3 technology-assisted dietary assessment methods, which are administered remotely. The study will also determine if such methods can provide a cost-effective, efficient, and timely approach to large-scale data collection, which may translate to lower costs and improvements in scale, frequency of dietary intake surveillance, and better precision regarding food consumption.