Workpackages Overview

WP1 Conceptual Framework
WP2 Policy & Implementation
WP3 Monitoring & Evaluation
WP4 Dissemination

WP Contact


Jan-Coen Van Elburg

Analyse the Effects! Show the Results!

The Process for Monitoring and Evaluation

Evaluating the results of a Mobility Management project is a very important, but often challenging undertaking. Those responsible often lack the time, resources, or expertise to measure the impact of their scheme. As a result, the MOST Monitoring and Evaluation Toolkit (MOST MET) was developed as a step-by-step guide to assessing the impact and success of Mobility Management services (see figure to the right). The number of motorised vehicle kilometres that were reduced as a result of their work is valuable to know. The MOST MET helps the user to define the objectives of his or her Mobility Management approach, to chose instruments and services, and to make a decision on the groups being targeted. Following that, the MOST MET provides a step-by-step assessment strategy on different levels (see figure) and offers examples of indicators for the assessment. It gives sample surveys for monitoring and shows how to evaluate the collected data in order to calculate project’s impact.

The MOST MONITORING AND EVALUATION TOOLKIT

Results

The process measures the results of the MOST activities. There are several definitions of success. Firstly, did the project achieve its objectives? This might be broadening awareness of Mobility Management, or broadening the availability of new travel options. Most partners achieved this. Another important question is what impact did this have on people’s travel choices or on the transportation system? This can be answered by measuring increases in the use of sustainable modes of transport, in the reduction of car use, or in overall decreases in travel or air pollution. About half of the MOST partners provided information that helped document increases in the use of public transport, car-pooling, bicycle use and, among some partners, car-sharing. A reduction in car use, ranging from 7% to 15%, was measured for parents and students at schools in Limburg, Camden council staff, and employees at a business park in Málaga. Car-use reductions for special events were shown to range up to 22 % and 38 % in the cases of Athens and Rotterdam. A reduction in car use among travellers can translate to reductions in traffic and improvements in air quality, albeit on a relatively small scale for these pilot efforts. City-wide impacts are often harder to measure.

Recommendations

After measuring results among some of the MOST partners using the MET, the following suggestions can be made for those interested in evaluating future Mobility Management efforts:

• Embrace evaluation! Do not fear the outcome of evaluation – rather, use it as a powerful tool to measure progress against objectives, improve your programme, compare expected and actual results, track results over time, and report back to policy-makers.
• Set measurable objectives. The majority of MOST partners set objectives. As a result, it was easy to show whether general objectives had been fulfilled. However, in some cases it was difficult to obtain hard data. Measurable objectives allow for more focused monitoring, for programme adjustment, and for the reporting of tangible results.
• Build monitoring and evaluation into planning. To ensure that adequate attention, resources, and expertise are brought to bear on monitoring and evaluation, they should be built into the earliest planning activities and made a priority.
• Monitor and evaluate continuously. The impact of Mobility Management approaches can only be judged over time. The situations before and after implementation of Mobility Management activities need to be compared, and any long-term changes need to be examined.
• Maintain objectivity. Evaluation should be undertaken or reviewed by someone without a stake in the outcome.
• Monitor users and their activities. Programme activities (such as the number of inquiries) and user behaviour (such as the number and type of new bus users) should be documented. This includes surveying the intended target group before, during and after introduction of Mobility Management strategies.
• Evaluate and report results. Soft (achievements) and hard (travel impacts) results should be analysed and reported in an understandable and accessible manner, and made available to policy makers and the public, in addition to planners and programme managers

WP3 Deliverable
Download the MOST MET, the monitoring and evaluation toolkit, is meant to support practitioners in their efforts to monitor and evaluate the impacts of Mobility Management.