program evaluation

Design and Usability Testing of an mHealth Application for Midwives in Rural Ghana

Posted by EKStallings on Dec 20, 2011
Design and Usability Testing of an mHealth Application for Midwives in Rural Ghana data sheet 681 Views
Author: 
Vélez, Olivia
Publication Date: 
Jan 2011
Publication Type: 
Report/White paper
Abstract: 

Midwives in Ghana provide the majority of rural primary and maternal healthcare services, but have limited access to data for decision making and knowledge work. Few mobile health (mHealth) applications have been designed for midwives. The study's purpose was to design and test an mHealth application (mClinic) that can improve data access and reduce the reporting burden for midwives at the Millennium Villages Project site in Ghana.

From the design science field, the Information Systems Research Framework guided this study through two research cycles: 1) Relevance, and 2) Design. The first phase of the Relevance Cycle took a user-centered approach to assess the people, organizations, and technology of the midwives’ environment through participant observation, contextual inquiry, and interviews. In the second phase, structured requirements specification was used to categorize the data into goals, system qualities, and constraints. From the categorized data, use cases were developed for patient registration, antenatal care, malaria, family planning, and referrals. Use cases then informed the development of functional requirements. In the Design Cycle, we first used functional requirements for patient registration and malaria to develop the mClinic prototype as part of a coded-in-country initiative. Next, we examined usability of the mClinic prototype by conducting field testing, heuristic evaluation, and usability surveys. Additionally, low-fidelity prototyping was used to determine applicability of the other use cases to the midwives’ environment.

Midwives reported inability to access critical data, high patient loads, and extensive reporting requirements. Low technical self-efficacy and inadequate infrastructure were identified as barriers to implementation. Heuristic evaluation noted issues related to hardware selection, workflow, and security. Midwives ranked the tool as useful in the usability survey; however, ease-of-use rankings were neutral. Interviews indicated this was related to low technical self-efficacy. Applicability checks found support for touch-entry prototypes over those that included lengthy forms or text-entry.

Featured?: 
No

Zap It To Me: The Short-Term Impacts of Mobile Cash Transfer Program

Posted by EKStallings on Nov 11, 2011
Zap It To Me: The Short-Term Impacts of Mobile Cash Transfer Program data sheet 717 Views
Author: 
Aker, Jenny C., Rachid Boumnijel, Amanda McClelland, Niall Tierney
Publication Date: 
Sep 2011
Publication Type: 
Report/White paper
Abstract: 

Conditional and unconditional cash transfers have been effective in improving development outcomes in a variety of contexts, yet the costs of these programs to program recipients and implementing agencies are rarely discussed. The introduction of mobile money transfer systems in many developing countries offers new opportunities for a more cost-effective means of implementing cash transfer programs.

 

This paper reports on the first randomized evaluation of a cash transfer program delivered via the mobile phone. In response to a devastating drought in Niger, households in targeted villages received monthly cash transfers as part of a social protection program. One-third of targeted villages received a monthly cash transfer via a mobile money transfer system (called zap), whereas one-third received manual cash transfers and the remaining one-third received manual cash transfers plus a mobile phone. We show that the zap delivery mechanism strongly reduced the variable distribution costs for the implementing agency, as well as program recipients’ costs of obtaining the cash transfer. The zap approach also resulted in additional benefits: households in zap villages used their cash transfer to purchase a more diverse set of goods, had higher diet diversity, depleted fewer assets and grew more types of crops, especially marginal cash crops grown by women.

 

We posit that the potential mechanisms underlying these results are the lower costs and greater privacy of the receiving the cash transfer via the zap mechanism, as well as changes in intra-household decision-making. This suggests that m-transfers could be a cost-effective means of providing cash transfers for remote rural populations, especially those with limited road and financial infrastructure. However, research on the broader welfare effects in the short- and long-term is still needed.

Featured?: 
No

A Doctor in Your Pocket: Health Hotlines in Developing Countries

Posted by EKStallings on Nov 04, 2011
A Doctor in Your Pocket: Health Hotlines in Developing Countries data sheet 1094 Views
Author: 
Ivatury, Gautam, Jesse Moore, Alison Bloch
Publication Date: 
Jan 2009
Publication Type: 
Report/White paper
Abstract: 

The GSM Association—the global trade association for mobile network operators—and its Development Fund believe that health hotlines can transform healthcare for poor people just as mobile phones are revolutionizing financial services (‘mobile money’). Health hotlines are simple to understand (“call a doctor”), provide immediate assistance, and are available to anyone with a mobile phone. The reach and branding of a mobile network operator (MNO), and the scalability of call center technology may mean that health hotlines serve vast numbers of people in the coming years.

 

As a first scan of the approach, this report tracks hotlines operating in developing countries, assesses their social and commercial success to date, and offers suggestions for governments, industry bodies and development agencies to advance this approach.

 

In the first section we define the health hotline model and present a brief landscape of health hotlines in operation today. Section 3 spotlights four of the most prominent health hotlines in developing countries, and compares their business approaches. In Section 4 we assess their commercial viability and potential for growth, and in Section 5 we evaluate their potential for social impact. Finally, Section 6 offers thoughts on how development agencies and governments can support the health hotline phenomenon.

Featured?: 
No

Cell-Life, Case Study 11

Posted by EKStallings on Nov 04, 2011
Cell-Life, Case Study 11 data sheet 992 Views
Author: 
Willmers, Michelle, Cheryl Hodgkinson-Williams
Publication Date: 
Feb 2009
Publication Type: 
Report/White paper
Abstract: 

This case study analyses the ways in which the Cell-Life initiative, a collaboration between UCT‘s (University of Cape Town) departments of Civil and Electrical Engineering and the Cape Peninsula University of Technology (CPUT), utilises technology-based solutions (in particular, cellphone technology) for the life management of patients living with HIV/AIDS.
 

Cell-Life is a model example of a socially responsive endeavor which utilizes technology to overcome limitations and constraints. The use of cellphones to save lives by aiding adherence to the ARV medication regime and gather data is a remarkable contribution to the fight against the HIV/AIDS pandemic and signifies an intersection between the academic endeavour, innovation and the lives of ordinary people on the ground. The open approach taken by the organisation in sharing its work also illustrates how research is able to contribute to the 'undead count' (i.e. the number of lives saved) of academic research, which must surely be considered the greatest achievement of any endeavor.

Featured?: 
Yes

Improving Standards of Care with Mobile Applications in Tanzania

Posted by EKStallings on Nov 01, 2011
Improving Standards of Care with Mobile Applications in Tanzania data sheet 965 Views
Author: 
Bogan, Molly, Jan van Esch, Gayo Mhila, Brian DeRenzi, Caroline Mushi, Timothy Wakabi, Neal Lesh, Marc Mitchell
Publication Date: 
Apr 2009
Publication Type: 
Report/White paper
Abstract: 

In this paper, we present D-tree International’s work with medical algorithms and mobile applications to improve the standards of care in clinical and community settings. In particular, we present a mobile phone-based application called CommCare which helps community health workers (CHWs) to provide home-based care and social support to HIV, tuberculosis and other chronic patients. The application guides the CHWs through a series of questions which they answer using the phone’s number pad. The data then can be submitted directly to a central database over a cellular GPRS network.

We report on our experience developing and testing the application in Tanzania, including the iterative development process with the CHWs and training them to use the program. We include an account of some of the hardware and software issues encountered and resolved during the process, and some initial reactions from the first CHWs and clients to use the program. While the formal evaluation of the program is still in progress, initial findings show that the phonebased system is generally viewed positively by the users and by the clients as more discreet and better for privacy than the paper-based system.

Featured?: 
No

Mobile Phone-based Infectious Disease Surveillance System, Sri Lanka

Posted by EKStallings on Oct 26, 2011
Mobile Phone-based Infectious Disease Surveillance System, Sri Lanka data sheet 755 Views
Author: 
Robertson, Colin, Kate Sawford, Samson L.A. Daniel, Trisalyn A. Nelson, Craig Stephen
Publication Date: 
Oct 2010
Publication Type: 
Report/White paper
Abstract: 

Because many infectious diseases are emerging in animals in low-income and middle-income countries, surveillance of animal health in these areas may be needed for forecasting disease risks to humans.


We present an overview of a mobile phone–based frontline surveillance system developed and implemented in Sri Lanka. Field veterinarians reported animal health information by using mobile phones. Submissions increased steadily over 9 months, with ≈4,000 interactions between field veterinarians and reports on the animal population received by the system.


Development of human resources and increased communication between local stakeholders (groups and persons whose actions are affected by emerging infectious diseases and animal health) were instrumental for successful implementation.


The primary lesson learned was that mobile phone–based surveillance of animal populations is acceptable and feasible in lower-resource settings. However, any system implementation plan must consider the time needed to garner support for novel surveillance methods among users and stakeholders.

Featured?: 
No

Scaling Up Without Falling Short: Leveraging Mobile Tech for the Base of the Pyramid

Posted by EKStallings on Oct 19, 2011

Despite possibilities of scaling projects with technology, many technology-based initiatives in social and economic development have failed to make it past early pilot stages or grow to scale. This study by Hystra, in collaboration with Ashoka and TNO, examines what successful ventures within four sectors can teach us about models for scaling Information and Communications Technology (ICT) -based applications and projects aimed at reaching bottom-of-the-pyramid customers (referred to as Base of the Pyramid in the report). The researchers focused specifically on these sectors: education, health, agricultural services, and financial services.

What Did the Study Review?

Initially considering 280 projects as promising models, researchers found that over half were not worth researching because projects lacked sustainability or replicatibility. Many of the projects were dead pilot projects or were small with no sign of the possibility or intent of scaling in size or reach.

From there, researchers homed in on 16 groundbreaking cases. These projects had reached scale (defined as having 10,000 clients or more) or had the potential to do so. All projects were assessed against three criteria: Is the solution solving the (specified) problem? Is the project economically viable? Is the project scalable and replicable? The researchers grouped projects into specific clusters based on business model type. All projects researched were value-added or market-based, because of the researchers’ belief that such models increase project sustainability and client investment in the project.

The models that the researchers looked at varied. For instance, researchers asked whether end-users accessed the technology themselves as opposed to being delivered trough an intermediary.

Leveraging Information and Communication Technology for the Base of the Pyramid

Posted by EKStallings on Oct 14, 2011
Leveraging Information and Communication Technology for the Base of the Pyramid data sheet 1161 Views
Author: 
Carvalho, Alexandre de, Lucie Klarsfeld, Francois Lepicard
Publication Date: 
Sep 2011
Publication Type: 
Report/White paper
Abstract: 

This document presents the conclusions of the study “Leveraging ICT for the BoP” sponsored by AFD-Proparco, Ericsson, ICCO, France Telecom-Orange, and TNO and conducted by Hystra and Ashoka from October 2010 to June 2011.



This study aimed to learn from “what works” in terms of full projects (as opposed to technologies) combining both an economically viable model and socio-economic impacts on their end-users, in the field of ICT for development (ICT4D). This work is thus based on the screening of existing projects led by various types of actors (social entrepreneurs, NGOs, private companies…), in 4 sectors of “development” where ICT has already shown it could play a key role: healthcare, education, agriculture, and financial services. 15 of the most ground breaking market-based business models, with a proven scale and results on the ground showing that ICT can be a lever improving the living standards of the BoP, are analysed in depth in the report to support the main conclusions.

 

Featured?: 
No

Sowing Seeds with SMS: Assessing Mobile Phones' Role in Agricultural Extension

Posted by EKStallings on Oct 06, 2011

Mobile phones may be one mechanism to increase effectiveness and efficiency for agricultural extension in low-income countries. Agricultural extension, broadly defined as the delivery of information to small-scale farmers, was developed to counteract information asymmetries suffered by farmers with limited access to information sources like landline phones, newspapers, radios and TV programming.  This has meant that farmers have not been able to take advantage of innovations in agricultural production (from seed types to information about pest control or crop rotations) and have been largely unable to increase their yields and hence incomes. 

While agricultural extension programs have tried to counteract this lack of information, they have also been long plagued by lack of scale, sustainability, relevance and responsiveness. Mobile phones, with their low-cost and capability for quick communication, may resolve many of these obstacles.

Dial “A” for Agriculture: A Review of Information and Communication Technologies for Agricultural Extension in Developing Countries, by Jenny C. Aker, a well-known researcher in the field, provides a broad overview of the shift toward using mobile phones in extension services and offers critical guides for assessing the effectiveness of such programs.

Half a century ago, extension programs were conceived to fill the glaring gap between agricultural innovation and crop yields. Despite great advances in agricultural innovations in the latter part of the twentieth century, farmers in Latin America and especially Sub-Saharan Africa have only seen slight increases in yields. Extension programs,which have largely taken the form of in-person visits and training, have consistently suffered from questions of cost-effectiveness.

Dial "A" for Agriculture: A Review of Information and Communication Technologies for Agricultural Extension in Developing Countries

Posted by EKStallings on Oct 04, 2011
Dial "A" for Agriculture: A Review of Information and Communication Technologies for Agricultural Extension in Developing Countries data sheet 1530 Views
Author: 
Jenny C. Aker
Publication Date: 
Mar 2011
Publication Type: 
Report/White paper
Abstract: 

Agriculture can serve as an important engine for economic growth in developing countries, yet yields in low-income countries have lagged far behind those in developed countries for decades. One potential mechanism for increasing yields is the use of improved agricultural technologies, such as fertilizers, seeds and cropping techniques. Public-sector programs have attempted to overcome information- related barriers to technological adoption by providing agricultural extension services.

 

While such programs have been widely criticized for their limited scale, sustainability and impact, the rapid spread of mobile phone coverage in developing countries provides a unique opportunity to facilitate technological adoption via information and communication technology (ICT)-based extension programs.

 

This article outlines the potential mechanisms through which ICT could facilitate agricultural adoption and the provision of extension services in developing countries. It then reviews existing programs using ICT for agriculture, categorized by the mechanism (voice, text, internet and mobile money transfers) and the type of services provided. Finally, we identify potential constraints to such programs in terms of design and implementation, and concludes with some recommendations for implementing field-based research on the impact of these programs on farmers’ knowledge, technological adoption and welfare.