Have we accomplished what we set out to do?
Does our network make a difference?
Why Assessing Impact is Important. Taking a good look at what has been done is an important part of building a broadband network. Looking at what a network has accomplished relative to what the network was intended to do can help communities to understand how to improve their networks.
How Assessment Works. Assessment is a measure of how a network operates in practice, relative to what the network set out to accomplish in the first place. This means that when you set out assess the impact of your network, your network goals are a good place to start. What kind of network did you want to build? Who was the network to serve? How much time and money did you anticipate you would spend? Have you accomplished these goals? Did you encounter any surprises or challenges along the way? What can other communities learn from your experience? How could you make your network better?
Many tools and methods can be used to answer these questions. Which ones you should choose depend on what you want to know, and how much time and money you have available. Assessment of community broadband networks can include things like: using technical testing methods to measure network availability and quality; conducting user surveys and interviews; and looking closely at network costs and revenues.
Evaluation Methods and Tools. Because city and community broadband networks are a relatively new type of infrastructure, standard evaluation methods for these networks don’t exist. But, there are tools that communities can use to tackle the task of evaluating their networks. Some of these tools, such as technical testing methods, proof-of-concept, and service level agreements, are being developed for and applied to broadband projects. For example ….
-Companies like Novarum (www.novarum.com) and VeriWave (www.veriwave.com) have developed technical testing methods for wireless networks. This Veriwave paper gives an overview of many types of wireless network testing: Master Test Plan: Wireless Lan & Muni-Wireless Testing. (http://www.veriwave.com/gurus/white_papers.asp).
-Some cities have negotiated service level agreements (SLAs) and proof-of-concept agreements with their private sector partners. Philadelphia is an example. These agreements can help communities make sure that they get a network that works.
Communities can also use assessment methods designed for other types of infrastructure, or community programs. For example ….
Resources
Wireless Philadelphia. (2005). Wireless Philadelphia Request for Proposals for a Citywide Network: Section 2.3, Proof of Concept.
www.phila.gov/rfp/pdfs/WP%20RFP%204-5-05%20rev%20v4-CLEAN.pdf
Wireless Philadelphia. (2007). Proof of Concept Acceptance.
http://www.wirelessphiladelphia.org/blog_detail.cfm/blog/19
BelAir Networks. (2007). BelAir Networks First to Guarantee Performance and Coverage in Municipal Wireless Networks.
http://www.belairnetworks.com/about_belair/press_releases_view.cfm?p_id=...
Wireless Philadelphia (2007). Request for Proposal of Evaluation Services for Wireless Philadelphia. www.wirelessphiladelphia.org/documents/Evaluation%20RFP-FINAL.pdf