| Literature DB >> 35774947 |
Tinggui Chen1,2, Chu Zhang1, Jianjun Yang3, Guodong Cong4.
Abstract
Software development is an iterative process from designing to implementation, and to testing, in which product development staff should be closely integrated with users. Satisfying user needs effectively is often the pain point for developers. In order to alleviate this, this paper manages to establish the quantitative connection between users' online reviews and APP (Application Program) downloads. By analyzing user online comments, companies can dig out user needs and preferences. This could benefit them by making accurate market positioning of their APP products, and therefore iteratively innovating products based on user needs, which hopefully will increase the volume of APP downloads. This paper regards WeChat APP during 47 updates periods as the research object. Based on Grounded Theory, user needs are extracted after data cleaning. Next, by using semantic analysis and word frequency analysis, we are able to obtain the implicit feedbacks such as emotion tendency, satisfaction and requirements lie under online reviews. Then, we construct a quantile regression model to study the impact of users' online reviews on downloads based on the influencing factors we extracted so as to provide a decision basis for enterprises to iteratively update their products. Results show that: (1) Generally speaking, needs of WeChat users mainly focus on performance, reliability, usability, functional deficiency, functional insufficiency, and system adaptability; (2) For those APP versions with relatively fewer downloads, user needs are mostly about functional deficiency, followed by functional insufficiency, performance, usability, and system adaptability. At this stage, it is found out that users' emotion tendency and user satisfaction significantly affect the volume of downloads; (3) When the volume of APP downloads is moderate, the user needs are functional deficiency, functional insufficiency, and system adaptability. While under this circumstances, users' star ratings have a significant impact on downloads; (4) In addition, when the volume of App downloads is high, user needs are performance, usability, and system adaptability. Our methods effectively extract users' requirements from online reviews and then successfully build up the quantitative connection between the implicit feedbacks from those requirements and APP downloads.Entities:
Keywords: APP downloads; Grounded Theory; online reviews; quantile regression; user demand mining
Year: 2022 PMID: 35774947 PMCID: PMC9237435 DOI: 10.3389/fpsyg.2022.875310
Source DB: PubMed Journal: Front Psychol ISSN: 1664-1078
Prior works and findings.
|
|
|
|
|
|---|---|---|---|
| Comments contain a lot of content about user needs | (Boyd et al., | Semantic analysis of online comments. | Comments generated by online users are very helpful for product development. |
| (Martin et al., | Literature review method. | Development engineers extract bug reports and feature requests from reviews. | |
| (Palomba et al., | A study on how developers addressed user reviews to increase their APP's success in terms of ratings. | Developers implementing user needs in user reviews are rewarded in terms of APP ratings. | |
| (Pagano and Maalej, | They analyzed over one million reviews from the Apple APP Store. | Reviews typically contain multiple topics, such as user experience, bug reports, and feature requests. | |
| (Vasa et al., | They analyzed 8.7 million reviews from 17,330 APPs. | Ratings and reviews add value to both the developer and potential new users. | |
| (Lukyanenko et al., | They analyzed the challenges and opportunities associated with Participatory Design in User-Generated Content. | This feedback in online reviews can represent the “voice of the user” and be used to drive the development of the APP to improve the upcoming version. | |
| (Lee, | They used machine learning to automatically identify user needs from online comments. | They visualized the competitive landscape by mapping existing products in terms of the user needs that they address. | |
| (Palomba et al., | They analyzed the structure, semantics, sentiments of sentences contained in user reviews. | Extract useful (user) feedback from maintenance perspectives and recommend to developers changes to software artifacts. | |
| Online reviews can influence consumer behavior. | (Hao, | They studied the impact of the emotional polarity of online reviews on consumers' purchase behavior. | Reveal the realistic relationship between online comments and consumers' overall purchase behavior and its general law over time. |
| (Zhang and Xu, | They investigated the impact of microblog reviews on consumers' purchase behavior. | Microblog positive comments have a significant impact on consumers' perceived economic value and functional value. | |
| (Ma, | Through text analysis and empirical analysis to verify the impact of online comments on consumers' car purchase behavior. | Online comments on appearance, performance and comfort have a positive impact on consumers' purchase behavior, and the influence of appearance and performance is higher than that of comfort | |
| (Lu and Hu, | A regression model was established to analyze the effects of user reviews on the APP downloads. | Online comments have an impact on users' download behavior. | |
| (Xiong, | They studied the impact of online comment interpretation types on online consumers' purchase intention. | The type of positive interpretation has a positive impact on the perceived usefulness of online comments, while the type of negative interpretation has no significant impact. | |
| (Chatterjee, | They examined the effect of negative reviews on retailer evaluation and patronage intention. | Retail consumers will be less willing to buy when they see negative WOM (word-of-mouth). | |
| (Vermeulen and Seegers, | This research applied consideration set theory to model the impact of online hotel reviews on consumer choice. | Exposure to online reviews enhances hotel consideration in consumers. | |
| (Ju, | The data of online reviews and downloads of mobile applications were collected, calculated, analyzed. | The number and score of online comments have a significant positive impact on the download of mobile applications. |
Figure 1Research framework.
Review of methods for mining user needs based on online comments.
|
|
|
|
|
|---|---|---|---|
| User needs mining based on online reviews | (Wang et al., | - | Users make comments on products in the application market from different dimensions, which contain their needs for improving APP software. |
| (Jang et al., | Latent Dirichlet Allocation Model | They used Latent Dirichlet Allocation Model to mine users' opinions from their online comments and provided a basis for management decision-making. | |
| (Xia et al., | K-means Clustering | A topic mining algorithm based on K-means clustering is applied to news comments. | |
| (Zhao et al., | Word Frequency Analysis and Manual Definition Methods | They selected candidate words according to the ranking of word frequency statistics. At the same time, he combined manual definition methods to determine the required keywords, and further mined user needs based on the keywords. | |
| (Liu et al., | Cluster Analysis and Multidimensional Scale Analysis | They used Chinese word segmentation and data analysis tools to realize word frequency statistics based on online comments and used statistical software to conduct cluster analysis and multidimensional scale analysis to classify product features and dig out potential user needs. | |
| (Adomavicius and Kwon, | Product Attribute Rating | They believed that users' scores for multiple attributes of a product contained more information about user needs than users' scores for a single product. | |
| (Kumar and Sebastian, | A Theory of Retrieving Vast Amounts of Information and Mining User Opinions | They proposed a theory to mine user needs from online reviews by retrieving relevant data from the vast amount of available comment information and then mining user opinions. | |
| (Han and Moghaddam, | Deep Language Model (BERT) and Machine Translation Algorithm | They proposed an efficient and extensible method for automatically and massively capturing attribute-level user requirements. This method was based on deep Language Model (BERT) to extract attribute, description and emotion words from online comment corpus. Also, machine translation algorithm was used to extract user needs expression of predefined part-of-speech combinations. Finally, the performance and feasibility of the method were proved by the empirical analysis of clothing and footwear. | |
| (Wang et al., | Convolutional Neural Network | They proposed a solution based on convolutional neural network to map product reviews to product specifications. This method could well adapt to the mapping of customer requirements to product specifications in natural language. | |
| (Na and Zhong, | Natural Language Motion Analysis Technology and Constructing Fuzzy Inference Rules Based on Product Attributes | They developed a system to mine the display attributes and implicit attributes of products from online reviews, and established that the system could identify the emotions of consumer evaluations by using natural language emotion analysis technology and constructing fuzzy inference rules based on product attributes. | |
| (Semsar and Shirehjini, | Constructed a Web-based Intelligent 3D Simulator Experience Environment | Based on network experiments, they collected data from a large number of online participants and constructed a web-based intelligent 3D simulator experience environment to detect and respond to user needs, actions, behaviors and feelings. | |
| (Xu et al., | Long and Short-term Memory (LSTM) | They used long and short-term memory (LSTM) as hidden layer neuron and introduced attention mechanism to obtain information from text sequence and understood user comment text, so as to mine user needs. | |
| (Xu et al., | Text Mining to Connect Users' Online Comment Texts with User Experience | They used methods such as text mining to connect users' online comment texts with user experience, helping developers better understand customers' needs through user-created content. | |
| (Wang et al., | Sentiment Analysis and Regression Analysis | They conducted sentiment analysis and regression analysis on users' online comments to study how product attributes affected customer satisfaction, thus helping enterprises analyze user needs. | |
| (Austin et al., | Grounded Theory | Use Grounded Theory to iteratively encode the text of these reviews, identifying specific themes for urgent care, and thus providing a new strategy for assessing patient-centered quality in emergency care. | |
| (Ling and Gang, | Grounded Theory | in China tried to apply Grounded Theory method to tourism research and explore tourist behavior characteristics. | |
| (Lu et al., | Grounded Theory | analyzed the tourism reviews of three famous budget hotels (such as HOME INN, hanting Express, JINJIANGINN). Ctrip, a major online travel agency in China, tried to construct the dimension of tourists' online attention to budget hotels by applying Grounded Theory. |
Partial open coding process.
|
|
|
|
|---|---|---|
| Occupies too much memory and the start-up speed is slower and worse than before; | Large occupies | Memory optimization |
| Update quickly please; | Update is not timely | Update timeliness |
| Contacted customer service many times, directly through one | Failure to contact with after-sales | Response timeliness |
| Can't deal with the problem in time, no human customer service; | No customer service | |
| Want to see moments' visitors; | Add Group visitors function | Functional insufficiency |
| Hope to add the function that allows to modify sent moments; | Add Group edit function | |
| Beauty function of moments please; | Add Beauty function | |
| It would be nice if I could change my WeChat ID | Modify WeChat ID | |
| Bad; | Bad experience | Subject experience |
| Good; | Good experience | |
| I personally feel QQ is good | Better user experience of competitive products | |
| Emoji icon is too big; | Large emoji | Functional insufficiency |
| There's a handling charge for cash withdrawals. It's rubbish | Fee for withdrawal | |
| Chat text background color cannot be modified; | Change word color | |
| Please cancel the rule that a bank card is required for real-name authentication; | cancel the rule that a bank card is required for real-name authentication | |
| Please save images over seven days | Prolong the duration of the chat history | |
| More beautiful after the update; | Better interface | Interface beauty |
| Simple, better and more useful; | Simple and good-looking interface | |
| Can you update some nice interface skin | Simple interface | |
| Suggest concise version | Function is not concise | |
| No dark mode | Dark mode | Interface friendliness |
| Chat history cannot be backed up automatically; | Back up chat history automatically | Functionality friendliness |
| Change the WeChat IDonce a month | Add ID modification frequency | |
| Repeated sound during video chat; | Unstable video chat | Functionality stability |
| Voice chat always interrupted; | Interrupted voice chat | |
| Cannot open the pushed information; | Unable to receive information | |
| Failure to restart video chat | Caton video chat | |
| Crash | Serious Crash | System stability |
| Annoying advertisement in moments | Too many advertisements | Advertising interruption |
| Cannot use card when forget password if not binding bank card; | Bank card binding | Account safety |
| Good for convenient communication and privacy protection; | Privacy protection | |
| Real-name authentication is required to receive red envelopes | Real-name authentication | |
| Good IOS system | Fluent operation of IOS system | Different requirements of different operating systems |
| Android memory is not large enough | Small Android memory | |
| When to update WeChat APP in Android system | Android update is not timely |
Axial coding process.
|
|
|
|
|---|---|---|
| Performance | Memory optimization | User feedbacks on WeChat memory usage and installation package size |
| Update timeliness | Timely push, internal testing, update cycle duration of WeChat version | |
| Feedback timeliness | Work efficiency of WeChat customer service, resolution of user complaints, etc. | |
| Reliability | Subjective experience | The user's most direct experience of using WeChat |
| Account safety | Involving WeChat payment, user privacy, account safety, etc. | |
| Advertising interruption | There are many advertisements on the chat interface and Moments of friends | |
| Interface friendliness | Dark mode, eye protection mode, etc. | |
| Interface aesthetics | Theme style diversity, background, question color settings | |
| Clear and concise functionality | The interface is clear, concise and not cumbersome | |
| Availability | Functionality stability | The stability of the various functionalities of WeChat, such as flashbacks, caton, repeated voices, and echoes, etc. |
| System stability | the overall system experience of the WeChat, the specific performance is whether the operation and interface are smooth | |
| System adaptability | Different requirements in different operating systems | Due to the difference of operating system, the user experience is different, which in turn causes the user needs to be different |
| Functional deficiency | Functionalities completeness | Functionalities that users want to add |
| Functional insufficiency | Functionality friendliness | More user-friendly and easy-to-use functionalities for users |
| Functionality optimization | Functions that users want to improve |
Variables description.
|
|
|
|
|
|---|---|---|---|
| LN (downloads) | LNY | The logarithm of WeChat's downloads in each cycle | LN (Number of APP downloads) |
| Percentage of negative emotions | neg | The snownlp package in python is used to analyze the emotion of users' online comments, and the positive and negative emotion express users' emotion tendency toward WeChat. Since neutral emotion has little effect on user downloading behavior, the proportion of positive emotion and negative emotion is selected as two explanatory variables. Among them, the sum of the three proportions (positive, negative, neutral) is 1. | Positive (negative) comments for each version/total comments for each version |
| Percentage of positive emotions | pos | ||
| Proportion of general satisfaction |
| The user's satisfaction with the use of the WeChat APP is divided into 6 based on Likert's score: Highly satisfied>moderately satisfied>generally satisfied>generally dissatisfied>moderately dissatisfied>highly dissatisfied, and | ROSTCM6 was used to conduct Likert rating on user comments periodically. Likert rating divided the emotion of each comment into six sections, and the score obtained was regarded as user satisfaction. They were highly satisfied (20 points and above 20 points), moderately satisfied (10–20 points), generally satisfied (0–10 points), highly dissatisfied (−20 points and below 20 points), moderately dissatisfied (−20~ (−10 points) and generally dissatisfied (−10~0 points). The indicator is calculated as follows: number of comments in each category/Total number of comments |
| Proportion of middle satisfaction |
| ||
| Proportion of high satisfaction |
| ||
| Proportion of general dissatisfaction |
| ||
| Proportion of middle is satisfaction |
| ||
| Proportion of highdissatisfaction |
| ||
| One-star ratio |
| The user's rating of the WeChat APP experience is divided into 1~5 stars. The higher the star rating is, the better the user experience will be, and it satisfies | number of reviews per star/total reviews |
| Two-star ratio |
| ||
| Three-star ratio |
| ||
| Four-star ratio |
| ||
| Five-star ratio |
| ||
| Functional deficiency |
| User needs to add new functionalities | Word segmentation and word frequency analysis were carried out on all comment data. Keywords with top 100 frequency were selected to form the representative lexicon of each need. Regular expressions are built in Python software to classify comments into the corresponding requirements based on keywords. We take the proportion of the number of user reviews for each requirement category in the total effective reviews of the cycle as the user attention for each requirement in the cycle. |
| Functional insufficiency |
| User needs to improve WeChat's existing functionalities | |
| Performance needs |
| Compliance with timeliness and resource economy requirements | |
| Availability needs |
| Probability of operation without failure in a certain period of time | |
| Reliability needs |
| The degree to which users are less mistaken and satisfactory, that is, the user's subjective perception of the software | |
| Different requirements of different operating systems |
| Due to different operating systems, users have different experience in using WeChat, which in turn leads to different user needs |
Quantile regression coefficient significance table for each quantile (quantile 0.1 ~ 0.35).
|
|
| |||||
|---|---|---|---|---|---|---|
|
|
|
|
|
|
| |
|
| - | - | 1.21E-9 | 0.003 | 0.015 | - |
|
| - | - | - | - | 0.012 | 0.040 |
|
| - | - | - | - | - | - |
|
| - | - | 0.000023 | - | - | - |
|
| - | - | 0.000015 | - | - | - |
|
| - | - | 0.000010 | - | - | - |
|
| - | - | 0.02 | 0.03 | 0.01 | - |
|
| - | - | 0.000005 | - | - | - |
|
| - | - | 1.058E-8 | 0.000385 | 0.000253 | 0.002 |
|
| - | - | 6.09E-8 | 6.48E-7 | 2.01E-8 | 0.000006 |
|
| - | - | 0.000062 | 0.006 | 0.001 | 0.011 |
|
| - | - | - | - | - | - |
|
| - | - | 7.23E-7 | - | - | - |
|
| - | - | - | - | - | - |
|
| - | - | 0.001 | - | - | - |
|
| - | - | 0.000005 | 0.011 | 0.012 | - |
|
| - | - | 0.000010 | - | - | - |
|
| - | - | - | - | 0.007 | - |
|
| - | - | - | - | - | - |
|
| - | - | 0.000246 | - | - | - |
Quantile regression coefficient significance Table for each quantile (quantile 0.70 ~ 0.95).
|
|
| |||||
|---|---|---|---|---|---|---|
|
|
|
|
|
|
| |
|
| - | - | - | - | - | - |
|
| 0.002 | 0.000046 | - | - | - | - |
|
| - | 0.047 | - | - | - | - |
|
| 0.047 | 0.010 | - | - | - | - |
|
| 0.046 | 0.007 | 0.000 | - | - | - |
|
| 0.002 | 0.000182 | - | - | - | - |
|
| - | - | - | - | - | - |
|
| - | 0.009 | - | - | - | - |
|
| 8.371E-7 | 1.92E-9 | - | - | - | - |
|
| 0.000118 | 1.56E-7 | - | - | - | - |
|
| - | 0.040 | - | - | - | - |
|
| - | - | - | - | - | - |
|
| 0.000033 | 0.00003 | - | - | - | - |
|
| - | - | - | - | - | - |
|
| 0.031 | - | - | - | - | - |
|
| 0.047 | 0.001 | - | - | - | - |
|
| - | 0.022 | - | - | - | - |
|
| - | - | 0.001 | - | - | - |
|
| - | - | - | - | - | - |
|
| 0.000032 | 2.37E-7 | 0.00002 | - | - | - |
The values in the Table are the significant variables under the quantile, and the blank value indicates that the variable is not significant under the quantile.
Figure 2Functions deficiency on WeChat.
Figure 3Functional insufficiency in WeChat.
Figure 4Function needs of WeChat.
Figure 5Availability of WeChat.
Figure 6Different requirements of WeChat on different operating system.
Quantile regression coefficient significance Table for each quantile (quantile 0.40 ~ 0.65).
|
|
| |||||
|---|---|---|---|---|---|---|
|
|
|
|
|
|
| |
|
| - | - | - | - | - | - |
|
| - | - | - | - | 0.018 | 0.004 |
|
| - | - | - | - | - | - |
|
| - | - | - | - | - | - |
|
| - | - | - | - | - | - |
|
| - | - | 0.049 | 0.026 | 0.025 | 0.009 |
|
| - | - | - | - | - | - |
|
| - | - | - | - | - | - |
|
| 0.009 | 0.046 | 0.010 | 0.025 | 0.000006 | 9.376E-7 |
|
| 0.000072 | 0.002 | 0.008 | 0.005 | 0.000441 | 0.000071 |
|
| - | - | - | - | - | - |
|
| - | - | - | - | - | - |
|
| - | - | - | 0.043 | 0.014 | 0.002 |
|
| - | - | - | - | - | - |
|
| - | - | 0.047 | 0.017 | - | - |
|
| - | - | - | - | - | 0.021 |
|
| - | - | - | - | - | - |
|
| - | - | - | - | - | - |
|
| - | - | - | - | - | - |
|
| - | - | 0.008 | 0.003 | 0.014 | 0.005 |