Evaluating the Accuracy of Data Collection on Mobile Phones: A Study of Forms, SMS, and Voice

Posted by VivianOnano on Jul 06, 2011
Author: 
Patnaik, Somani; Brunskill, Emma, Thies, William.
Publication Date: 
Apr 2009
Publication Type: 
Report/White paper
Publication language: 
English
Abstract: 

While mobile phones have found broad application in reporting health, financial, and environmental data, there has been little study of the possible errors incurred during mobile data collection. This paper provides the first (to our knowledge) quantitative evaluation of data entry accuracy on mobile phones in a resource-poor setting.

Via a study of 13 users in Gujarat, India, we evaluated three user interfaces: 1) electronic forms, containing numeric fields and multiple-choice menus, 2) SMS, where users enter delimited text messages according to printed cue cards, and 3) voice, where users call an operator and dictate the data in real-time. Our results indicate error rates (per datum entered) of 4.2% for electronic forms, 4.5% for SMS, and 0.45% for voice.

These results caused us to migrate our own initiative (a tuberculosis treatment program in rural India) from electronic forms to voice, in order to avoid errors on critical health data. While our study has some limitations, including varied backgrounds and training of participants, it suggests that some care is needed in deploying electronic interfaces in resource-poor settings. Further, it raises the possibility of using voice as a low-tech, high-accuracy, and cost-effective interface for mobile data collection.

Countries: 
Upload Paper: 
Citation: 
Patnaik,Somani, Emma Brunskill, William Thies."Evaluating the Accuracy of Data Collection on Mobile Phones: A Study of Forms, SMS, and Voice." (2009)
Evaluating the Accuracy of Data Collection on Mobile Phones: A Study of Forms, SMS, and Voice data sheet 1403 Views
Author: 
Patnaik, Somani; Brunskill, Emma, Thies, William.
Publication Date: 
Apr 2009
Publication Type: 
Report/White paper
Publication language: 
English
Abstract: 

While mobile phones have found broad application in reporting health, financial, and environmental data, there has been little study of the possible errors incurred during mobile data collection. This paper provides the first (to our knowledge) quantitative evaluation of data entry accuracy on mobile phones in a resource-poor setting.

Via a study of 13 users in Gujarat, India, we evaluated three user interfaces: 1) electronic forms, containing numeric fields and multiple-choice menus, 2) SMS, where users enter delimited text messages according to printed cue cards, and 3) voice, where users call an operator and dictate the data in real-time. Our results indicate error rates (per datum entered) of 4.2% for electronic forms, 4.5% for SMS, and 0.45% for voice.

These results caused us to migrate our own initiative (a tuberculosis treatment program in rural India) from electronic forms to voice, in order to avoid errors on critical health data. While our study has some limitations, including varied backgrounds and training of participants, it suggests that some care is needed in deploying electronic interfaces in resource-poor settings. Further, it raises the possibility of using voice as a low-tech, high-accuracy, and cost-effective interface for mobile data collection.

Countries: 
Upload Paper: 
Citation: 
Patnaik,Somani, Emma Brunskill, William Thies."Evaluating the Accuracy of Data Collection on Mobile Phones: A Study of Forms, SMS, and Voice." (2009)

About this evaluation

The evaluation is very interesting but I think a "lot of water has flown under the bridge" from the date of its publication (1 Apr 2009)....... and its findings can not be apply today

Post new comment

The content of this field is kept private and will not be shown publicly.
  • Allowed HTML tags: <a> <em> <strong> <cite> <code> <ul> <ol> <li> <dl> <dt> <dd><p><br> <b><i><blockquote>
  • Lines and paragraphs break automatically.

More information about formatting options