Regional Field Tests
Field employees tested the SPOT device in the Northern, Intermountain, Pacific Southwest, and Alaska regions. These tests evaluated how well the device performed in field conditions. Volunteers were asked to use the SPOT while recording the frequency and type of transmissions they made and to offer any observations they had about their experiences using the device.
We received limited data from the field testers on the success and failure of different types of transmissions. The problem was that users did not download or compare the data from the Web site before the data were purged. The Web site only allows users to download the past 30 days of data. The results in this section are from the comments users provided of their experiences with the device.
Field employees provided written evaluations of their experiences using the SPOT device. These comments were analyzed to determine major concerns users had and to better understand users' evaluation of the usefulness of the device for their location.
Users' comments focused on four major topics: the effectiveness of emergency communication, the reliability of transmission and reception of messages, the usefulness of the Web tracking service, and overall impressions of the usefulness of the device for field applications.
Field employees reported that the SPOT device seemed to be useful as a backup for emergency communication.
"I have fairly good confidence that it would be possible to send a message out if needed even if the person had to find an opening in the canopy. It should not be used as the primary communication device, but could be an effective alternative."
Reliability of Transmission and Reception
The issue of reliable transmission and reception of messages in a variety of conditions was a primary focus of the comments we received from field employees. They discussed how the SPOT device functioned under a forest canopy and in a variety of = other conditions. Some evaluators compared their experiences using the device to their experiences using a satellite phone.
Users reported that a forest canopy reduced the reliability of transmission and reception.
"The SPOT device was limited greatly by canopy cover, especially in the tracking mode. Seemed to work a little better for check-ins."
"Initial SPOT test. Activated from deck of my residence. With a clear view of the sky on a relatively clear day, SPOT HELP and check-in features appeared to be very successful."
"SPOT placed near forest road to test HELP/checkin feature. When activated in HELP/check-in mode, SPOT was successful in sending out the alert message the majority of the time from what I could tell. Delays in receiving the message were detected at times."
Comments also addressed how well the SPOT device functioned when placed in different locations.
"Seemed to transmit as well through a pack as on the outside of a pack."
"SPOT attached to ballistic vest carrier in tracking mode while hiking. Tracking was initiated with SPOT in this position on my vest and while in the top of my pack. Results appeared to be better from inside my pack, possibly due to better positioning of GPS antenna."
"SPOT messenger placed in front window and or passenger seat of patrol SUV to test tracking function. Tracking did not appear to be very successful with the test conditions. Tracking was successful at times, but appeared to require a very clear view of the sky and/or a slower moving platform to get a steady breadcrumb type trail established."
The field users reported dissatisfaction with the SPOT tracking Web site.
"SPOT messenger Web page leaves room for improvement. On this attempt to view the Web page, it was down for improvement. Hopefully, they are improving on the overall ease of use and layout. I found it difficult to navigate the pages to find the information I was seeking. I resorted to using the help/instructions page, which turned out to be only somewhat helpful. Additionally, I was very disappointed to find that results of SPOT messenger use were only available for the past 30-day period. On multiple occasions, I wished to see tracking histories from prior use and was unable to do so because of the 30-day max history."
"Definitely are limitations on the Web-based tracking part of it. The e-mail and text messaging seemed to work well."
The evaluators also criticized the usability of the SPOT Web site.
Overall, field employees are interested in the SPOT's potential as a backup device for emergency communications, but feel usability needs to be improved. There was a sense that some of the features duplicated current communication and GPS capabilities.
"All and all, I think it will be a useful tool, but as we have talked, it definitely has limitations. For the price though, not a bad deal."
"Forest Inventory and Analysis (FIA) crews currently have a cell phone, satellite phone, GPS, aerial photos, and maps. Is a SPOT also needed? Possibly have a few SPOTS available for crewmembers, if they desire?"
"Overall opinion, I would say SPOT messenger has some real potential to fill a void left between the use of USFS radios, SAT phone, cell phone, and emergency location transmitters (ELT)/emergency position indicating response beacons (EPIRBs). While conducting patrols I depend on a USFS radio (communications with USFS dispatch), a police department radio (police communications), my work cell phone (communications to all), my personal cell phone (it gets better service in places than the work cell), a SAT phone at times when I request it (for patrols in areas/times where there isn't USFS or police radio coverage and ELT (emergency situations only)."
