We can now dynamically map and visualize real-time SMS messages in Managing News using the new SlingshotSMS feature. All the code is available on github.
This release is particularly exciting for us because it ties together two of our core projects in such a way that each is made better. SlingshotSMS is a lightweight SMS gateway that can be run off of a USB drive, needing only a GSM modem and an internet connection to act as a bridge between mobile phones and the web. Managing News is a powerful data aggregator and visualization tool that lets distributed teams work together to make large amounts of information useful. Together, they provide an extensible framework for teams conducting mobile data collection projects in the field.
Extensibility is key here because we need this to meet a wide variety of use cases in order for it to be useful. We have been particularly focused on use cases related to election monitoring, but this is just one of many possible applications. Here's a graphic that Saman made illustrating how the system works:
This technology is meant to accompany your existing processes of data collection. You have people in the field, they have cellphones, you have a phone back in headquarters, and they can text in messages to you that are then relayed to a visualization space, which helps keep you and your team on the same page.
Since SlingshotSMS runs on a USB drive, you just plug it in, plug in your phone, and set up what website you want to have the SMS messages sent to. The SMS messages are turned into RSS 2.0 and PUSHed, like as a fat ping. You computer just needs internet to send these messages.
Going back to this election monitoring example, here you see the election monitor is texting in that the polling station is closed. You'll notice that the text message contains a few things: a polling station ID, the word "closed", and the word "security." These are key terms we are going to want to look for on the Managing News side to flag.
SlingshotSMS just pushes the data up to Managing News. The Managing News site will have a custom parser that will break up this text message, pulling out key words and numbers.
Customizing SMS parsing for each project
Out of the box, the Managing News/SlingshotSMS bridge simply accepts the SMS and incorporates it into the default Managing News workflow, ignoring important information in this example like the fact the polling station is closed and there is a security issue. This is where the pluggable nature of Managing News proves its worth. It is simple to write a custom parser that replaces the default parser that ships with Managing News. With some creative use of the Drupal taxonomy system to filter incoming results into Managing News channels and some very basic regex, you can quickly have a system that is able to capture this data and let Managing News users react to it. We'll publish a blog post soon explaining exactly how to do this.
Authentication
Authentication of incoming SMS messages is vital in these situations, and we took extra care to make sure the Managing News Slingshot feature will only receive data from authorized sources. The framework is dependent on the Drupal KeyAuth module which allows signed messages to pass between a SlingshotSMS installation and Managing News. When setting up the Managing News Slingshot feature, users are given public and private keys that they then copy into the SlingshotSMS configuration file. In the future we are considering switching to an OAuth based solution.
To get set up, you'll need the following:
Editors Note: We will test-run Managing News and Slingshot in an upcoming software review but meanwhile congratulate Development Seed on the ongoing efforts in building better open source tools for mobile data collection and analysis.
