Seattle-Lake Washington Corridor Urban Partnership Agreement National Evaluation Plan4.0 Seattle/LWC National UPA Evaluation PlanThis chapter presents the Seattle/LWC UPA Evaluation Plan. This material is presented in major subsections. The first of these sections, 4.1, Evaluation Analyses, discusses the potential benefits, costs, and impacts of the UPA projects; the Evaluation team's planned approach to measuring those effects; the kinds of data needed to perform this work; and the planned analytic approach. The second section, 4.2, Preliminary Evaluation Test Plans, summarizes in somewhat more detail data sources and analysis methods. Once this evaluation plan has been finalized, the full detail on data collection and analyses will be presented through a set of separate test plan documents. 4.1 Evaluation AnalysesThe proposed approach to eleven evaluation analyses is presented in this section. These analyses address:
The Seattle/LWC UPA evaluation excludes two of the 12 analyses included in the National Evaluation Framework, "Goods Movement" and "Business Impacts," because the local partners do not expect significant impacts in those areas and wish to focus limited evaluation resources on other, more critical, evaluation areas. For each of the 10 Seattle/LWC UPA evaluation analyses, key hypotheses and questions to be addressed are presented. The hypotheses describe the results that the UPA projects are expected to produce, including benefits such as throughput improvements, congestion reduction, expanded traveler choices, improved mobility, and related outcomes. In a few cases, unwanted side-effects of the UPA investments are hypothesized. For each hypothesis and question, measures of effectiveness (MOEs) are presented. These are measurable aspects of the Seattle/LWC deployment effects that speak to the evaluation hypotheses and questions. Each analysis discussion includes a table which summarizes the hypotheses/questions being asked, relevant MOEs, and the data required to compute those MOEs. Accompanying text discusses key aspects of the planned analytic approach and related matters. The latest Term Sheet between the local partners and U.S. DOT (September 30, 2009), shows that vehicles with 3 or more passengers will pay discounted tolls or no tolls on SR 520. However, that issue in general as well as any specific approaches to high occupancy vehicles are still being considered by the local partners and U.S. DOT. Although this evaluation plan includes vehicle occupancy and other data collection relevant to HOV-related inquiries, it does not necessarily contain all of the HOV-related evaluation activities that may be needed, depending on the final approach taken by the local partners. When the local partners and U.S. DOT have resolved this issue the evaluation approach will be adjusted as necessary and reflected in the test plans. 4.1.1 Congestion AnalysisThe Seattle/LWC local partners and the U.S. DOT are currently negotiating revisions in the UPA agreement ("term sheet") related to the specific congestion reduction targets of the UPA deployment. The development of this Congestion Analysis has been informed by the September 30, 2009 version of the Term Sheet that includes the following congestion reduction objective: implement variable pricing (based on the level of demand) on SR 520 between I-5 and I-405 to the extent necessary to maintain free flow traffic in the through-lanes, on all collectors and distributors for SR 520 between I-5 and I-405. The purpose of the congestion analysis is to assess the extent to which the UPA projects collectively were able to achieve this objective or whatever similar final congestion reduction objectives may be identified. Following the evaluation principles outlined in NCHRP Guide to Effective Freeway Performance Measurement, the congestion analysis is designed to assess the following impacts of the Seattle/LWC UPA deployment on SR 520 and alternate routes:
Travel Time and Travel SpeedThe congestion analysis will specifically evaluate the cumulative effect of all the UPA projects on travel time and travel speed on SR 520 and other parallel facilities. Table 4-1 summarizes the hypotheses, measures of effectiveness and data associated with this portion of the congestion analysis. For the purposes of the Seattle/LWC UPA evaluation, both travel time and travel speed will be used in the congestion analysis—travel time permits comparisons across all the UPA deployment sites, whereas travel speed is the local performance objective. Travel time and travel speed are closely related and will be derived from WSDOT traffic detector data. Travel time is the average time consumed by vehicles traversing a fixed distance, defined by a specific origin and destination. On their website,10 WSDOT provides real-time travel time on typical commuter routes in the Seattle region. These same origin-destination pairs will be used in this analysis.
1 Travel time delay is not among the standard set of congestion measures used in the national evaluation at the various UPA and CRD sites but has been included here at the request of WSDOT, for whom this is a standard performance measure. Delay is defined as the extra time it takes a driver to traverse a desired travel segment or complete a desired trip. WSDOT calculates and reports delay in two different ways: 1) Actual travel time versus travel times at posted speeds, and 2) Actual travel time versus travel time at maximum flow speeds. WSDOT expresses both measures as the sum of vehicle delay (in hours) across an average twenty-four hour day. Because travel time is highly dependent on the distance being traversed by travelers and to facilitate comparisons across multiple UPA sites, the evaluation team will also use change in the Travel Time Index to compare the effectiveness of the improvements. The Travel Time Index is the ratio of the average peak travel time to an off-peak (or free-flow) travel time. Free-flow travel time for each roadway section will be determined from the WSDOT detector data. It will be the 15th percentile travel time during traditional off-peak times (i.e., incident free weekdays between 9 a.m. and 4 p.m. and between 7 p.m. and 10 p.m.). The Travel Time Index can be used to assess how much more time a trip takes during the peak period compared to the same trip if it occurred during non-peak travel times. As an example, a Travel Time Index of 1.20 means that a trip during the peak period takes 20 percent longer than the same trip during off-peak times. Travel Time Index is a ratio of travel times and therefore it eliminates the effects of different corridor lengths. Travel Time ReliabilityAnother possible effect of the Seattle/LWC projects will be to improve the travel time reliability of SR 520 travelers. Travelers often adjust their travel behaviors and expectation to accommodate expected levels of congestion. When unexpected congestion or changes in service are encountered, travelers are frustrated and their satisfaction with the performance of the transportation system decreases. Therefore, in evaluation of transportation systems, reliability is commonly used to describe the level of consistency in transportation service for mode, trip, route, or corridor and to describe the quality of service from the traveler's perspective.11 NCHRP's Guide to Effective Freeway Performance Measurement12 recommends the following as measures of travel time reliability:
Buffer Time is the amount of extra time that travelers in a corridor need to leave to ensure that they arrive on-time at their destination for most trips. For the purposes of the UPA Evaluation, the buffer time will be defined as the difference between the 95th percentile travel time and the average travel time, normalized by the average travel time. Therefore, if the buffer index is 40 percent, this means that in order to arrive on-time 95 percent of the time, a traveler should budget an additional 8 minutes of buffer time for a trip that, on average, takes 20-minutes. Like Buffer Time, the Planning Time Index is a measure of the extra amount of time that most travelers need to allot for a trip during a specific period. However, unlike Buffer Time, the Planning Time Index compares trips that occur in the peak period to trips under off-peak (or free flow) conditions. The Planning Time Index is the 95th percentile of the Travel Time Index. As an example, a Planning Time Index of 1.60 for the a.m. peak would mean that, to ensure an on-time arrival 95 percent of the time, a traveler would need to allocate an additional 60 percent more time to make that trip in the a.m. peak compared to making that same trip during off-peak conditions. Table 4-2 shows the hypotheses and related measures of effectiveness that will be used to evaluate travel time reliability impacts.
In addition to examining travel time reliability measures, the congestion analysis will also examine how different events caused travel time to vary in the corridor. Potential sources of travel time variability include the following:
Facility and corridor level travel time measures will be examined to determine if the variability in travel time during these events was improved as a result of deploying the UPA improvements. ThroughputChanges in vehicular and person throughput will be examined to assess the extent to which congestion was reduced. According to NCHRP's Guide to Effective Freeway Performance Measurement, throughput is a fundamental measure of freeway performance. Throughput is a measure of the number of users "served" by transportation system. The congestion analysis focuses on how deploying the UPA projects in the SR 520 corridor changed the throughput in the systems (roadways and transit) serving commuters over Lake Washington. The basic premise for using throughput as a performance measure is that the UPA projects reduced congestion in the corridor because more vehicles and/or persons were "serviced" after the improvements, even if the travel time or travel time reliability performance measures show no change. Table 4-3 shows the hypotheses, measures and performance and data needed for investigating the effects of the Seattle/LWC UPA projects on throughput. Vehicle throughput (VT) will be determined by counting the number of vehicles using SR 520 and other alternate routes around Lake Washington. Vehicle throughput will be derived from WSDOT's Traffic System Management detector station data. The roadway segments on which vehicle throughput will be assessed include the following:
Person throughput (PT) will also be used to assess the degree to which the UPA projects impacted congestion on the SR 520 corridor. Person throughput is the total number of persons "served" by the different modes of travel that utilize the SR 520 corridor. For the Seattle/LWC UPA projects, the total person throughput can be estimated by summing the following:
PT will be estimated by multiplying the VT for different vehicle classes by the average number of occupants per vehicles per class. Vehicle-miles traveled (VMT) and Person-miles traveled (PMT) will also be computed. VMT is the product of the number of vehicles traveling over a length of facility (VT) by the length of the facility, while PMT is the product of the number of persons using a facility (PT) by the length of that facility.
Spatial and Temporal Extent of CongestionThe congestion analysis will examine both the spatial and temporal aspects of congestion impacts. From a temporal perspective, the analysis will examine the total number of hours per day and hours during the peak period during which SR 520 and the adjacent facilities operate at or below a specific speed threshold to be determined by the local partners and U.S. DOT. Speed on a facility can also vary through the length of the facility and, therefore, the congestion analysis will also look at the number of lane-miles on SR 520 and alternate routes where speeds are below a to-be-determined performance threshold. Table 4-4 lists hypothesis, performance measures and data requirements associated with the spatial and temporal analysis of congestion impacts.
Users' PerceptionsTable 4-5 lists the hypotheses, measures of effectiveness and data requirements associated the assessment of SR 520 corridor travelers' perceptions of congestion and the impact of the UPA projects.
4.1.2 Tolling AnalysisThis analysis focuses on the affect of tolling SR 520 on travel behavior, vehicular and person throughput, and traffic congestion on SR 520. Table 4-6 presents the hypotheses/questions, measures of effectiveness, and data for the tolling analysis. The tolling analysis is closely related to the congestion and transit analyses, which include examining changes in traffic congestion and travel mode. The first hypothesis is that variable tolling on SR 520 will regulate vehicular access so as to improve the operation of SR 520. The measures of effectiveness related to this hypothesis focus on increasing vehicle and person throughput, improving level-of-service and trip-time reliability, and traffic density. The second hypothesis relates to maintaining these gains from pricing over time. The measures of effectiveness for this hypothesis focus on trip-time reliability and other performance measures. Data needed to assess these measures of effectiveness include toll payment methods, toll transactions by time-of-day, and traffic volumes by time-of-day, location/segment, and lane type.
4.1.3 Transit AnalysisThis analysis examines the impact of the UPA transit projects: increased bus service on SR 520, new or enhanced stops/stations/terminals, the Redmond P&R/TOD, and real-time information signs at transit stations. Generally, the UPA transit projects focus on making transit services better able to accommodate travelers who may switch from driving to transit in order to avoid the new SR 520 tolls (e.g., through the additional transit service being added), or on facilitating such mode shifts by making transit a more attractive alternative. In the case of the Redmond P&R/TOD, locating apartments and business in convenient proximity to the transit station in conjunction with a new transit center featuring new passenger amenities and loading facilities is intended to shift travel to transit, contributing to congestion reduction in the UPA corridor and manifested by a higher transit mode share than found in similar traditional (non-TOD) developments. Table 4-7 presents hypotheses, measures of effectiveness (MOE), and data needs for the transit analysis.
The first hypothesis relates to changes in transit service performance resulting from transit or other UPA projects. Measures of effectiveness include travel speeds, travel times, reliability (schedule adherence/on-time performance) and changes to service capacity. The second hypothesis relates to the impact of the UPA projects on ridership and transit mode share, for both the UPA corridor overall as well at the Redmond P&R/TOD in particular. Transit mode share on the UPA corridors will be measured in terms of the proportion of person throughput carried by transit services. Transit mode share in the UPA corridor overall may increase through people switching to transit who previously travelled by private auto, by increased transit usage among existing transit users, or by a reduction in non-transit person throughout. Survey data will play a key role in assessing the ridership and mode share hypotheses, both in revealing the role of the UPA projects in any observed changes in ridership but also as the primary means for determining the mode share of the residents and business patrons of the Redmond TOD. The third hypothesis relates to whether any observed changes in transit mode share impacts traffic congestion within the corridor, which will require coordination with other aspects of the evaluation. Other secondary impacts due to changes in transit mode share will also be assessed including potential vehicle overcrowding and impacts on public perceptions. The last hypothesis relates to the relative contribution of each of the UPA project elements to transit mode shift and subsequent congestion reduction. There are a number of UPA-related factors contributing to possible mode shift, including increased vehicle travel cost (the SR 520 toll), decreased transit travel time, increased transit reliability, improved transit infrastructure, increased service quantity, as well as exogenous factors such as high gasoline prices. If mode shift to transit does occur, it is important to be able to understand why and, to the extent possible, to relate the resultant mode shift to specific project elements. This will require consideration of transit data sources including park-and-ride lot utilization and traveler survey data, supplemented by information from other evaluation analyses. The local partners have not yet identified the specific plans, including locations, for the "enhanced stops/stations/terminals" or real-time information signs at stations. Analysis details related to these projects will be added once the specific plans are identified by the local partners. It is expected that, like the Redmond P&R/TOD, a focused analysis of stop-specific ridership data will be performed. Transit routes of interest to this analysis consist of all corridor routes impacted by the UPA projects. This includes routes operated by King County Metro, Sound Transit, Community Transit, and Microsoft. As explained in the Transit System Data Test Plan, ridership data and transit service characteristics data will be needed for every route in the corridor in order to support the comprehensive, corridor-wide study of person throughput and mode share described in the Congestion Analysis. It will not be necessary, however, to collect transit performance data (travel times, reliability, and rider perceptions) from every single bus route in the corridor. Rather, data from a representative sample of routes will be sufficient. 4.1.4 Telecommuting/TDM AnalysisThe telecommuting/TDM element of the Seattle Area/LWC UPA focuses on outreach and supportive TDM measures in the SR 520 corridor. The local partners have not yet identified their specific projects in this area. It is expected that the local partners will work with large employers within the corridor area, local Transportation Management Associations, downtown associations, State and local governments, and residential neighborhoods to increase the use of telecommuting, flexible scheduling, and employer-based alternative commute programs. The main thrust of the Telecommuting/TDM activities is expected to focus primarily on enhancing existing programs within the UPA corridor in order to increase their effectiveness in addressing congestion in concert with the other UPA strategies. This might involve coordinated efforts within the corridor to promote telecommuting and alternative work scheduling, target marketing to partners in the corridor and enhanced employer-based incentives for inducing more commuting via transit, carpool, vanpool, bicycling and walking. The local partners expect to identify their specific UPA corridor telecommuting/TDM strategies as well as a set of measures of effectiveness by approximately November 2009. Those details are being established in part through the local partners' "Travel Demand Target Setting" study now underway and expected to be completed in October 2009. The analysis approach summarized in Table 4-8 is a general, placeholder approach that is based on general expectations for telecommuting/TDM strategies. The final approach will be identified in the Telecommuting/TDM Test Plan document to be produced in November or December 2009.
The final evaluation approach will also take into account a flexible carpooling project that the local partners are currently developing. If that project is considered to be part of the broader package of UPA or UPA-supporting telecommute/TDM projects, it will be fully included in the evaluation. If that project is considered a separate project, an exogenous influence, it will be monitored to aid in the isolation of UPA project impacts. 4.1.5 Technology AnalysisThis analysis focuses on the impacts of two types of Seattle/LWC technology projects: 1) Three new dynamic message signs displaying travel times into Seattle for SR 520 and alternate routes and 2) Active Traffic Management Systems on SR 520 and I-90 consisting of lane control, mini-variable message, and advisory speed limit signs. Each technology project will be assessed individually; however, as these different projects are intended to work as a system, especially during incident conditions, it may be extremely difficult to separate the degree to which each technology deployment contributed to an overall reduction in congestion. The variable messages signs will be used to provide travelers with comparative travel times between SR 520 and alternate routes in the Lake Washington Corridor. These signs will be placed upstream of decision points in the corridor and provide travelers with travel time information on alternate routes so that drivers can make informed route-choice decisions. The national evaluation will investigate whether providing comparative travel times significantly alters the distribution of traffic across SR 520 and alternate routes under both incident and non-incident conditions. The Active Traffic Management (ATM) system to be installed on SR 520 and I-90 is designed to promote smoother traffic flow and better balance traffic demand on these two facilities. WSDOT's expects the ATM to reduce the number of congestion-causing incidents on these roadways. When incidents do occur in the corridor, WSDOT also expects the ATM systems to allow them to better manage traffic demands and capacities on these roadways, thereby, reducing the congestion impacts of incidents and reducing incident duration. The technology analysis will consider ATM impacts during incidents as well as during non-incident conditions. Table 4-9 shows the hypotheses, measures of effectiveness, and data requirements that will be used in the technology analysis. As in the congestion analysis, the technology analysis will compare baseline and post-deployment conditions. It is anticipated that all of the data needed to support this evaluation will come from the WSDOT Traffic Systems Management Center. Speed and volume information used to compute travel time and throughput will come from WSDOT archived detector station data. Dynamic message sign logs will be used to determine the content of the messages on the travel time and ATM message signs as well as the circumstances in which these messages were displayed. WSDOT operator incident and dispatching logs will be used to determine incident frequencies, durations, and severity.
*= For the purposes of this study, "link length" is defined as the distance between detector stations. It is typically used to reflect the "zone of influence" of a traffic sensor and is generally the length that is one-half the distance to the nearest upstream and downstream sensor. A "segment" is defined to be a collection of contiguous links. Therefore, the length of a segment is sum total of the link lengths for the links included in a segment. 4.1.6 Safety AnalysisTwo general types of safety implications are associated with the Seattle/LWC UPA projects. First, the Active Traffic Management elements to be deployed on SR 520 and I-90 are intended to reduce the number of crashes on those facilities. The intent is to reduce crashes by posting variable speed limits on the ATM gantry-mounted signs that will warn drivers of backups ahead and smooth out traffic as it approaches a lane block incident. WSDOT also intends to use the ATM signs to quickly close entire lanes and provide warning information to drivers before they reach slower traffic13. The second safety implication is that the introduction of the new signage related to tolling, ATM and travel times may impact safety in the first few weeks after deployment as drivers become accustomed to the new information and react to it by changing lanes and/or speeds. Table 4-10 presents the safety hypotheses, MOEs and data for the safety analysis. MOEs focus on the percent change in crash rate by type and severity, the percent change in the average duration of incidents (ATM is expected to reduce the amount of incident-related congestion, thus speeding recovery to pre-incident traffic flow conditions), and the change in the perception of safety by enforcement, WSDOT Incident Response Team (IRT), and first response personnel, as well as bus operators. Data needed to assess these MOEs include the number of crashes by type and severity and the number and duration of incidents. Information on changes in the perception of safety will be obtained through surveys and interviews with IRT members, state patrol officers, medical first responders, and bus operators. The safety test plan summary presents additional information on the data sources and analysis techniques. A number of issues may need consideration in assessing the safety impacts of the Seattle/LWC UPA projects. First is the possible influence of other factors such as the introduction of new non-UPA projects, construction, and major weather events. Second, it may be difficult to detect significant changes in safety impacts in the one-year post-deployment period, especially since the a multi-month lag in crash data availability means that the post-deployment period will include only about 10 months of data. Finally, it may not be possible to link the cause of a crash to a specific UPA project element. To the extent that these challenges compromise the ability to draw conclusions based strictly on quantitative data, the qualitative input from IRT members, state patrol officers, medical first responders, bus operators, and possible input from travelers themselves, may enhance the understanding of safety impacts of the Seattle UPA projects.
4.1.7 Equity AnalysisThis analysis will examine potential equity issues associated with the various Seattle/LWC UPA projects. Experience with the SR 167 HOT lanes in the Seattle region and with other HOT and toll facilities throughout the country indicate that perceptions of fairness, or equity, may be a factor in the acceptance of proposed pricing projects. Equity may also be a concern in the spatial distribution of services and infrastructure. Equity issues are important to assess because the impacts – both positive and negative – may contribute to public opinion and the effects upon various population groups. The Seattle/LWC UPA partner agencies are taking a number of actions to mitigate any potential equity concerns. For example, although many travelers are expected to use the SR 520 Good to Go! pre-paid, transponder-based account, several other payment options are being offered. These options include pre- or post-payment for each toll transaction by mail, over the Internet, by telephone, and in person at a customer service store. Outreach efforts, including those focused on limited-English-speaking populations, are also planned. As presented in Table 4-11, equity will be examined in four ways. First, the direct social effects from the Seattle/LWC UPA projects, including tolling SR 520, on various user groups will be examined. These social effects may include tolls paid, travel-time savings, and adaptation costs. The second hypothesis addresses the spatial distribution of aggregate out-of-pocket and inconvenience costs, and travel time and mobility benefits. Third, possible differential environmental impacts on certain socio-economic groups will be examined. This question addresses possible environmental justice issues. Finally, the reinvestment of revenues from tolling the SR 520 Bridge and how this reinvestment impacts various user groups will be examined.
4.1.8 Environmental AnalysisThis analysis will assess the impacts of mode shift, vehicle and person throughput, increased speeds, reductions in idling, increases in transit ridership, and new telecommuters on the environment. The environmental analysis addresses air quality and energy (fuel consumption). Table 4-12 lists the hypotheses and questions for the environmental analysis. The focus will be on air quality as it relates to changes in travel behavior. Air quality benefits are often cited as a positive impact from pricing, transit, telecommuting, and some technology projects. The second hypothesis refers to perceptions of the public and stakeholders as to the overall environmental impacts of the projects. The third hypothesis involves the potential for energy savings from mode shifts, changes in freeway operating conditions, and the use of alternative fuels. The details of the air quality analysis are still being developed. At a high level, the approach will be to calculate emissions before and after the UPA deployment by multiplying observed, roadway link VMT (at specific speeds) by appropriate emission rates. U.S. DOT has requested that the evaluation utilize the EPA MOVES (Motor Vehicle Emission Simulator) model, which is capable of both producing emission factors and, when supplied with observed VMT, speed and other data, calculating emissions. The details of the air quality analysis approach will be worked out in partnership between U.S. DOT, the local partners, and the national evaluation team as the Environmental Test Plan is developed over the next few months. The impacts of the UPA projects on energy consumption will be examined using VMT data from the congestion analysis. The energy savings from reductions in VMT will be estimated. The energy savings from the use of alternative fueled transit buses will also be estimated based on a comparison of fuel use by route mileage and VMT for the various types of buses.
4.1.9 Non-Technical Success Factors AnalysisThis analysis will collect lessons learned about non-technical success factors from the Seattle/LWC UPA. These non-technical success factors include outreach, political and community support, and the institutional arrangements used to manage and guide implementation of the UPA projects. Information on the non-technical success factors is of benefit to the U.S. DOT, state departments of transportation, MPOs, transit agencies, and local communities interested in planning and deploying similar projects. Table 4-13 presents the questions, measures of effectiveness and data sources associated with the analysis of the non-technical success factors. The first hypothesis/question focuses on understanding how a wide range of variables influence the success of the Seattle/LWC UPA project deployments. The variables have been grouped into five major categories: (1) people, (2) process, (3) structures, (4) media, and (5) competencies. The categorization scheme emerged from the Hubert H. Humphrey Institute of Public Affairs' recent study of the Minnesota UPA process, which resulted in the successful award of the U.S. DOT UPA grant. The second question guiding this analysis focuses on examining public support for the Seattle/LWC UPA projects as effective and appropriate ways to reduce congestion. As indicated in Table 4-13, this analysis relies heavily on information provided by the local partners. Input from the Seattle/LWC UPA partners will be collected using the formal mechanisms shown in Table 4-13, which includes rounds of interviews followed by a group workshop addressing the non-technical success factors. Additionally, information will be gleaned informally through observation and interaction with the Seattle/LWC UPA partners over the course of the demonstration. 4.1.10 Cost Benefit AnalysisThe purpose of the cost benefit analysis (CBA) is to quantify and monetize the potential costs and benefits that may be incurred from implementing the Seattle/LWC UPA projects. The net benefit from the UPA projects, which is the difference between the total benefits and the total costs, will indicate the potential returns from the public investment. The cost benefit analysis plays an important role in determining the feasibility of transportation projects because the results from the analysis are easily understood and acknowledged. The cost benefit analysis will be performed using a 10-year time frame. Within this evaluation time frame, the cost benefit analysis will estimate and compare annual benefits and costs between two scenarios—before and after implementation of the Seattle/LWC UPA projects. Expected UPA project benefits include travel-time savings, vehicle operating cost savings, safety cost savings, and savings associated with improved travel time reliability. The increase in transit-related travel costs paid by those people who switch to riding transit may offset certain proportions of the benefits realized by vehicle usage on SR 520. On the cost side, the capital costs of the UPA projects will be included, as well as operating and maintenance costs, and replacement and reinvestment costs for technology components, such as toll facilities. For communities, the potential benefits include reduction in emissions.
The cost benefit analysis utilizes several types of data. These data sources include forecasts of future travel, which are expected to come from the PSRC regional travel demand model, survey data, and the project investment or the expenditures from the U.S. DOT and the state and local government agencies. To examine the impacts of certain parameters on the net benefits calculated in the cost benefits analysis, a sensitivity analysis will be conducted. Vehicle operating cost savings, for instance, are one of the major benefits that will be experienced by individual drivers and freight carriers. The calculation of the vehicle operating cost savings depends on fuel price, which has been volatile in recent years. Because forecasting the future movement of fuel price is out of scope of the Seattle/LWC UPA national evaluation, a sensitivity analysis will be utilized to examine the impacts of fuel price on vehicle operating cost savings and the net benefit generated from the cost benefits analysis. Table 4-14 summarizes the key hypotheses/questions that will be addressed by the cost benefit analysis and the main data that will be used. Some of the important benefits realized from the project, such as improved comfort, reliability, simplicity, and other attributes related to improvements to transit services, will not be included in the cost benefit analysis because it will be impossible to monetize those benefits. However, those benefits will be summarized and reported as non-monetized benefits in the final evaluation report.
4.2 Preliminary Evaluation Test PlansIndividual test plans will be developed and conducted to collect and analyze the data needed to assess the hypothesis in the 10 evaluation analyses presented in Section 4.1. The 10 test plans for the Seattle/LWC UPA are:
Table 4-15 illustrates the relationship among the 10 test plans and the 11 evaluation analyses. The use of data from the various test plans in assessing the evaluation analyses – both as major input and as supporting input – is highlighted. Table 4-16 presents the more specific data need for each of the 11 evaluation analyses that will be included in the test plans. Figure 4-1 summarizes the schedule for data collection. The local partners have indicated that these major projects may be operational anytime between November 1, 2010 and June 30, 2011. The specific schedule for the projects is expected to be determined in late 2009 and will be reflected in the full test plan documents to be developed by the national evaluation team. The remainder of this section summarizes the key elements of each of the 10 test plans. Preliminary information on the data sources, data availability, data analysis, and the data collection schedule and responsibilities is presented. The more detailed test plans will be developed as the next step in the evaluation process. The latest Term Sheet between the local partners and U.S. DOT (September 30, 2009) shows that vehicles with 3 or more passengers will pay discounted tolls or no tolls. However, that issue in general as well as any specific approaches to high occupancy vehicles are still being considered by the local partners and U.S. DOT. Although this evaluation plan includes vehicle occupancy and other data collection relevant to HOV-related inquiries, it does not necessarily contain all of the HOV-related evaluation activities that may be needed, depending on the final approach taken by the local partners. When the local partners and U.S. DOT have resolved this issue the evaluation approach will be adjusted as necessary.
Figure 4-1. Seattle/LWC UPA Project Deployment Timeline and Evaluation Data Collection Timeline 4.2.1 Traffic System Data Test PlanTraffic signal system data will be used to support a number of analyses, including the congestion, technology, transit, telecommuting, safety, environmental, equity, goods movement, and cost benefit analyses. The primary data elements that will be obtained from using traffic system data include the following:
For the purposes of this study, a "link" is defined as the section of roadway between detector stations and typically reflects the "zone of influence" of a traffic sensor. As such, a link is generally one-half the distance to the nearest upstream and downstream sensor. A “segment” is defined to be a collection of contiguous links. Therefore, the length of a segment is sum total of the link lengths for the links included in a segment. Some of the measures of effectiveness developed in this test plan and used in the various analyses will require combining various discrete traffic data elements and, in some cases, adjusting for exogenous factors. For example, the congestion analysis requires average or typical VMT which will be derived using link volumes and lengths and adjusting as necessary for any exogenous factors such as weather or special events. This test plan focuses on the primary traffic system data elements; exogenous factors are addressed in a separate test plan. Traffic system data are needed for the roadways listed in Table 4-17.
It is envisioned that the traffic system data required to complete the analyses planned in the national evaluation will come from two general sources: (1) Automated sources, where the evaluation will take advantage of data that are already being collected and archived and which is continuous in nature (data will be available for each day) and, (2) Special studies, where data are, or will need to be, collected especially for the UPA evaluation and probably for only a sample time period, e.g., for a week. The automated data sources consist primarily of the technology systems and programs that WSDOT uses to manage and operate the freeway system. Each of the sources of data is discussed below. Data Sources – AutomatedWSDOT Traffic Sensor Data. WSDOT has installed a network of traffic sensors on the freeways in the evaluation corridor. WSDOT uses two configurations for their freeway loop detectors: single loop detector and speed trap detectors. Single loop detectors allow volume and lane occupancy to be measured in each lane at each location. The speed trap configuration also collects volume and lane occupancy as well as measuring the average speed of traffic and limited vehicle type classifications. At a minimum, these traffic sensors record volume, lane occupancy, and speed (depending upon the detector configuration) every 20 seconds on a lane-by-lane basis. These traffic sensors are generally located in each lane, the HOV lanes, and entrance and exit ramps of measured facilities. The data from these sensors are communicated to the WSDOT's Northwest Region Traffic Systems Management Center, where it is used to generate travel time information for dissemination to the public and for use in making command and control decisions for traffic management purposes. WSDOT archives the traffic sensor data for research and evaluation purposes. These archives contain 5-min aggregation of the raw traffic sensor data. WSDOT calculates travel times for common commuting origin-destination routes. Each route is divided into a number of sections (or links), with a traffic sensor station on each end. Using the traffic sensor data, speed is calculated for each link. That speed is then used to determine the travel time in that section (or link). The segment travel time is determined by summing the link travel times for all sections that define a route. It appears that travel time information may be retained by WSDOT to support historical comparison of segment travel times on the common commuter routes. If so, this information could potentially be used to support many of the UPA evaluation analyses. As part of the UPA deployment effort, WSDOT plans to install vehicle license plate readers to collect travel time information on SR 522 (an arterial state highway) in the westbound direction only (i.e., toward downtown Seattle). The travel time information will be displayed on the travel time signs that are part of the UPA deployment. These sensors are scheduled to be installed summer of 2010 and could provide between about 3 and 10 months of baseline data depending on the local partners' final schedule for deploying the SR 520 tolling and other major UPA projects. Dynamic Message Signs. WSDOT has deployed numerous dynamic message signs throughout the Puget Sound area. These signs are used to disseminate information about travel times, incident conditions, Amber Alerts, etc. in real time to motorists traveling on major freeways. The locations of DMS in the SR 520 corridor are shown in Figure 4-2. Additional DMS will be installed as part of this deployment effort for use in providing comparative travel times on SR 520 and I-90 between Seattle and Bellevue. www.dot.wa.gov/traffic/seattle/ Figure 4-2. Location of SR 520 DMS As part of the technology evaluation, it will be important to know what information is being disseminated on theses signs. It is anticipated that WSDOT maintains logs showing how what messages are posted to which signs. These logs will be used to determine the percentage of time that signs are utilized performing different traffic management functions (e.g., disseminating travel time information, incident information, Amber Alerts, etc.). Data Sources – Special StudiesSR 522 Eastbound Travel Times. WSDOT currently operates no traffic sensor stations on SR 522, a state-operated arterial roadway that is one of the alternate routes to SR 520 that will be important to this analysis. WSDOT has plans in place to implement license plate readers that will provide westbound SR 522 data only. Discussions are under way with WSDOT on the need to collect data in the eastbound direction and WSDOT has taken the action item to examine alternative data collection techniques. At this point, it is expected that the data will be available although the details are as yet unknown. Those details will be specified in the full Traffic System Data Test Plan document. There are a wide range of options for collection this data, including "floating car" runs or installing temporary or permanent traffic sensors. If floating car runs are used, an adequate number of sample runs would need to be performed to ensure that the data are statistically valid. Specially instrumented vehicles that utilize GPS could be employed to facilitate the collection of detailed travel time data. If found to be critical to the evaluation, such travel time studies would need to be performed quarterly or after the opening of each project phase or major deployment. Arterial Street Volume Counts. Traffic volumes on several arterials that serve as or provide access to SR 520 alternate routes are needed to assess changes in vehicle and person throughput. These counts can be performed using either temporary or permanent traffic count installation. It is recommended that these volume counts be conducted at least quarterly and after the completion of any major deployment phase. It is recommended that WSDOT wait at least one month after the opening of a deployment phase before collecting volume counts to allow traffic patterns to stabilize. Vehicle-Occupant Counts. Vehicle-occupant rates for various vehicle classes are needed to measure changes in person throughput in the corridor. Vehicle occupant rate is the average number of persons that occupy vehicles in each vehicle class of interest (e.g., transit, carpools, automobiles, etc.). While it is expected that vehicle occupancy for transit vehicles can be determined from passenger counts on transit vehicles—that is, transit vehicle occupancy is the same as ridership—it is expected that a special study will be needed to determine average number of occupants in non-transit SR 520 corridor travelers' vehicles. The Washington State Transportation Research Center (TRAC) is responsible for collecting and maintaining data on the HOV system in the Seattle system. As part of this effort, TRAC periodically samples average vehicle occupancy information from both the general purpose lanes and HOV lanes from many of the roadways within the study area. These data are stored in a database maintained by TRAC and located at http://trac29.trac.washington.edu/hov/index.jsp. The data collected by TRAC include counts of the number of vehicles in the sampling period that contain one, two, three, and four or more occupants, as well as the number of public buses, other buses, and trucks with 2 and 3+ axles, and motorcycles. These volume counts are then used to compute the average vehicle occupancy during the sampling period. The national evaluation is working with WSDOT to determine whether the frequency (biennial) and coverage of the existing TRAC data collection effort will be satisfactory or whether supplemental data collection will be needed. The resolution of this issue will be captured in the full Traffic System Data Test Plan document. Data AvailabilityIt is anticipated that all the sources of traffic system data that existed in the corridor before the deployment of the UPA improvements will be available after the deployment. This includes lane-by-lane coverage of the automated traffic sensor equipment and the WSDOT RTSMC data logs. It is also anticipated that these systems will be maintained throughout the evaluation period and that no major gaps in the data will exist. The evaluation team will download and archive traffic sensor and incident data from WSDOT every month. Downloaded data will go through a series of quality control checks to identify suspect or invalid data. WSDOT may be asked to perform periodic checks or to replace any traffic sensors that appear to have failed or that routinely provide faulty or erroneous data. Checked data will be processed at least quarterly and quarterly progress reports will be produced. At a minimum, data needed from special studies should be collected quarterly or after the opening of a significant improvement in the quarter. Data AnalysesMost of the traffic system data will be used to support before and after comparison of traffic conditions. Various UPA improvements will become operational at different times and therefore traffic sensor data will be analyzed as each deployment comes on line to attempt to isolate the impacts of each project or element. Most of the evaluation analyses require peak period traffic system data. Peak period analyses will be performed as this is the time period when the UPA improvements are most likely to have a significant impact on congestion. For the purposes of this study, the a.m. peak period will be defined as 6:00 a.m. to 9:00 p.m. while p.m. peak period will be defined as 3:00 p.m. to 7:00 p.m. Table 4-18 lists the traffic system data elements and analysis periods used in calculating the primary evaluation performance measures used in these analyses.
Data Collection Schedule and ResponsibilitiesThe high-level data and analysis periods for each data source are summarized in Table 4-19. For the freeway performance data, historical, baseline and post-deployment will be collected. Information dissemination logs will be collected only in the post-deployment period because these devices will be operational only in the post-deployment effort. The details of the data collection report period (the intervals at which data will be transmitted from the local partners to the Battelle evaluation team) will be identified in the detailed test plan document.
4.2.2 Tolling Test PlanData SourcesThe tolling data test plan focuses on data from the WSDOT Toll Collection System (TCS) on the SR 520 bridge. Data will be utilized in the tolling, environmental, equity, goods movement, and cost benefit analyses. Key data elements that will be collected from the TCS database include the number of transponders purchased and activated, the home zip code of transponder purchasers, transaction data, revenue data, violation data, and other related system and user data. More detail on the TCS data is presented below. Data from the Washington State Patrol on violations of the TCS and the SR 520 Bridge tolling operating requirements will also be obtained and analyzed. Additional information needed for the tolling analysis will be obtained from the traffic system data test plan. TCS Database. WSDOT is in the process of procuring a vendor to supply, install, and maintain an all-electric tolling lane solution to support the tolling needs on the SR 520 bridge. As outlined in the Request for Proposal (RFP), the TCS will utilize the following technologies:
WSDOT currently owns and operates two toll facilities in the Puget Sound Region; SR 16 at the Tacoma Narrows Bridge in Pierce County and the SR 167 HOT lanes in South King County. As part of the UPA, WSDOT will own and operate a cashless toll facility on the SR 520 Bridge and a statewide Customer Service Center (CSC). The RFP outlines the specific requirements and functionality of the TCS. A two-way, single-point, variable priced open road TCS will be provided. Motorists will be able to pay the toll through establishing a pre-paid, transponder based account. They will also be able to pre-or post-pay for each toll transaction through a number of methods, including by mail, on the Internet, by telephone, and in person at a customer service store. The TCS includes two major elements – the Roadside Toll Collection System (RTCS) and the Facility Management and Administration System (FMAS). The RTCS includes the toll collection lane hardware and the Digital Video Audit System (DVAS). The FMAS consists of the central control systems and applications that facilitate operations, administration, reporting, and maintenance of the TCS. The FMAS will be located at WSDOT's existing Traffic Management Center (TMC). The TCS will be able to provide data on the date, time, toll charge, and transponder identification numbers, as well as image-based toll transactions. The following provide examples of the type of information that will be obtained from the TCS on a monthly basis for use in the tolling and other analyses:
Washington State Patrol. Information from the Washington State Patrol on the number of citations issued for violating the toll payment and operating requirements will also be obtained and evaluated. Data AnalysisThe data obtained from the SR 520 TCS database will be used to examine measures of effectiveness contained in the tolling, environmental, equity, goods movement, and cost benefit analyses. Examples of the information needs include:
Examples of measures of effectiveness include:
Data Collection Schedule and ResponsibilitiesIt is recommended that monthly data collection begin after opening of the SR 520 toll system, currently expected to be sometime between November 1, 2010 and June 30, 2011. Data collection would continue for one full year of post-deployment data. Battelle team members will work the WSDOT personnel to establish the data collection and analysis protocol. WSDOT will be responsible for provide the tolling data to Battelle in electronic formats on a monthly basis. The national evaluation team will be responsible for working with the local partners to specify data formats and collection protocols and analyzing the data for the various measures of effectiveness for the national evaluation. 4.2.3 Transit System Data Test PlanThe transit system data test plan will collect data to be used in many analyses, including transit, technology, cost benefit analyses, congestion, tolling, telecommuting, safety, environmental, and equity analyses. The local partners have not yet identified the specific plans, including locations, for the "enhanced stops/stations/terminals" or real-time information signs at stations. Data collection and analysis details related to these projects will be added once the specific plans are identified by the local partners. It is expected that, like the Redmond P&R/TOD, a focused analysis of stop-specific ridership data will be performed. Data SourcesA wide range of transit data will be collected from a variety of sources as summarized below. Survey data—which indeed plays a very important role in the Transit Analysis—is not discussed here, but rather is included in the Surveys, Interviews and Workshops Test Plan. Ridership Data. Ridership data is required for all UPA corridor transit routes in order to track ridership changes (overall and for specific routes especially impacted by certain UPA projects, such as routes serving the Redmond P&R/TOD and routes using the SR 520 bridge) and also to provide the person trip data needed for corridor wide total person throughput and mode share accounting included in the Congestion Analysis. King County Metro collects ridership data using automatic passenger counters (APCs) installed on approximately 12 percent of its fleet (including the services operated on behalf of Sound Transit) and circulated through the system to provide samples of ridership data for each route. The APC data will be supplemented by baseline and post-deployment ridership data from the other transit services operated in the UPA corridor: Community Transit, Sound Transit, and Microsoft. In addition, system-wide ridership data will be obtained to track regional ridership trends. Transit Service Characteristics Data. Basic descriptive information for all UPA corridor transit routes is required, such as service span and frequency, fare structure, and revenue hours/miles so that temporal changes in service quantity on the UPA corridors can be monitored. Park-and-Ride Lot Utilization. King County Metro collects park-and-ride lot utilization data on a monthly basis, which is then compiled into quarterly reports. We will use these data to aid in the interpretation of any changes in corridor transit ridership and mode share that may be observed. Utilization at the park-and-ride at the Redmond P&R/TOD will also be used as part of the assessment of specific impacts of the Redmond P&R/TOD project. We are aware that many of these lots are already operating at capacity and therefore utilization levels may not change. Redmond TOD Residential and Business Occupancy Data. This data will be used in the analysis Redmond P&R/TOD analysis to aid in the interpretation of ridership, parking utilization and survey findings and to coordinate the timing of survey data collection (discussed in the Surveys, Interviews and Workshops Test plan). This data will be provided by the TOD developer and/or King County. Transit Travel Time Data. These data will be utilized as part of the corridor-level analysis but will not be required for the Redmond P&R/TOD-specific aspects of the transit analysis. These data will be used to determine whether SR 520-tolling related congestion reduction or the new transit service result in reduced transit travel times. These data does not need to be collected for every UPA corridor transit route. Rather, a sample of data should be sufficient to gauge impacts. Because most UPA corridor routes are operated by King County Metro and because Metro is best equipped to provide large quantities of accurate data, these data will be sampled from Metro routes. Travel time data will be extracted from Metro's automatic vehicle location (AVL) system, which collects information from AVL units installed on 100 percent of its fleet. Where necessary existing data points will be interpolated to match specific UPA corridor boundaries. Baseline and post-deployment published schedule information will be used to cross-reference any observed changes in travel times. Transit Reliability Data. These data will be utilized as part of the corridor-level analysis but will not be required for the Redmond P&R/TOD-specific aspects of the transit analysis. These data will be used to determine whether SR 520-tolling related congestion reduction or the new transit service result in improved transit reliability. Like the transit travel time data, reliability data—also known as on-time performance or schedule adherence data—will be collected from a sample of UPA corridor routes and, given that most routes are operated by Metro and Metro is able to provide the most extensive data, all of this data will come from Metro. The data will be extracted for the baseline and post-deployment periods from Metro's AVL system. An ‘on time’ service is defined as being between 1 minute early and 5 minutes late. Where necessary existing data points will be interpolated to match specific UPA corridor boundaries. Data AvailabilityTable 4-20 summarizes, for each data source, the current understanding of baseline and post deployment data availability.
*KCM = King County Metro; ST = Sound Transit; CT = Community Transit; MS = Microsoft Data AnalysisIt is envisioned that data will be delivered by local transit agencies to the Battelle Team via email, typically in MS Excel spreadsheet format. The data will be quality-checked for outliers, missing information, or other irregularities, and any issues will be resolved with the agency providing the data. The national evaluation team will utilize these data to develop the various required MOEs. Ideally, the MOEs will be based on weekday average values that are computed on a monthly basis, though four-month (third of a year) averages may need be utilized in some cases due to sample size constraints. Table 4-21 shows the MOEs that will be developed from each data source. The transit analysis will consider both cumulative, corridor-level impacts such as corridor mode share changes and total ridership gains, as well as more localized impacts influenced by specific UPA projects. For example, the Redmond P&R/TOD analysis will also consider ridership data, but it will focus on ridership at the Redmond station and the influence of the TOD on ridership.
* ST = Sound Transit; CT = Community Transit; MS = Microsoft Data Collection Schedule and ResponsibilitiesThe specific timing of transit data collection will be identified in the full test plan document and will reflect the local partners' final deployment timeline. Currently, the local partners have indicated that, with the exception of the Redmond P&R/TOD which has already been implemented, the transit projects to be considered in the national evaluation will be implemented no later than June 30, 2011 and as early as November 1, 2010. Ridership, transit service characteristic, transit travel time and transit reliability data will be collected for one year prior to deployment and continuing through one year after deployment, a timeline that could start as early as November 2009 and run through as late as June 30, 2012 depending on the local partners' final deployment schedule. Data pertaining to the Redmond P&R/TOD, including ridership for routes serving the Redmond station, park-and-ride lot utilization, and TOD occupancy data will be collected for as far back as 2005, to reflect the much earlier implementation of this project. All of the transit data with the exception of park-and-ride utilization is expected to be collected continuously. The park-and-ride utilization data will be collected monthly. The local partners will be responsible for data collection and the national evaluation team will be responsible for analysis and reporting. For the "continuous" data sets, which includes APC ridership data, service characteristics data, travel time data, and reliability data, data will be sought from King County Metro at regular intervals, ideally providing a monthly average in each case, though four-month (third of a year) averages may be used in some cases due to sample size constraints. In addition, ridership data and service characteristics data will be sought from the other transit agencies operating in the defined study corridors (Community Transit, Sound Transit, and Microsoft). 4.2.4 Telecommuting/TDM Data Test PlanThe telecommuting/TDM data test plan will generate data to be used in the telecommuting/TDM, congestion, environmental, equity, and cost benefit analyses. It is not possible to summarize the Telecommuting/TDM Data Test Plan at this time because the local partners have not yet identified their specific UPA/UPA-supporting strategies in this area. Those strategies, as well as proposed measures of effectiveness, are expected to be indentified in November 2009. At that time, the specific evaluation approach will be developed and documented in the Telecommuting/TDM Test Plan. The local partners are currently conducting a study which is expected to significantly shape their approach to telecommuting/TDM in the UPA corridor and, therefore, the evaluation approach. One thrust of the local partners' on-going is to develop measures of effectiveness for the UPA 520 corridor telecommuting/TDM strategies. The draft scope of work called for: "…a performance measurement plan that could be deployed to monitor progress toward TDM targets on major highway corridors, using the draft TDM targets for the 520 corridor as a case study. The performance measurement plan should consider existing data collection activities, such as the Commute Trip Reduction survey and WSDOT traffic data. The plan must include a description of proposed data collection tools, frequencies of measurement, analysis methods, and reporting techniques that can produce statistically valid information at a level of accuracy to be determined by WSDOT. The plan outcomes must be directly measurable against the trip reduction targets and the plan must be applicable regardless of TDM strategy. The plan must estimate the costs of implementing the performance measurement plan. The plan must also propose an approach for creating a warehouse of TDM impacts as measured through the plan."14 The remainder of this section summarizes a generic, illustrative Telecommuting/TDM Test Plan based on general expectations for what sorts of strategies the local partners will implement, the sorts of performance measures they identify, and what data sources may be available. The specific evaluation approach is expected to be articulated in the full Test Plan document in November or December 2009. Data SourcesData sources may include:
Responsibilities for the collection, compilation and distribution of the final data to be collected from various sources is will be determined pending resolution of the local partners' plans. Data AvailabilityIt is anticipated that the data needed to assess the impacts of the telecommuting and other TDM strategies on travel in the SR 520 corridor will be available from the Seattle/LWC local partners. Data AnalysisIt is anticipated that much and perhaps all of the analysis may be completed by the local partners as part of their own study of the effectiveness of the UPA corridor telecommuting/TDM strategies and that these results would be reported through the UPA evaluation. Needs for supplemental analysis for the national evaluation will be determined after the local partners present their specific strategies and performance measures. The national evaluation is most interested in changes in travel behavior and net person trip and VMT reduction on SR 520 and the main alternate routes (SR 522, I-90 and the portions of I-5 and I-405 between SR 522 and I-90). The national evaluation will attempt to assess the relative contribution of telecommuting and TDM strategies on overall evaluation questions, such as congestion relief, other impacts, and non-technical success factors. Data Collection Schedule and ResponsibilitiesThe local partners will be responsible for data collection. The national evaluation team is available to help guide data collection and will be responsible for any analysis above and beyond that performed by the local partners that may appear necessary to address national evaluation questions. The national evaluation team will report the results of the local partner and any national analyses. The detailed schedule for data collection will be identified in the full Test Plan document that will be prepared after the local partners have specified their telecommuting/TDM approach. Generally, and in keeping with the overall evaluation approach, one year of baseline and one year of post-deployment data will be collected. 4.2.5 Safety Test PlanData SourcesThe safety test plan will be used primarily in the safety analysis and the cost benefit analysis. The safety test plan focuses on obtaining and analyzing crash data and incident response data for the roadway segments where the new travel time signs, ATM gantries and toll signs will be deployed. Table 4-22 lists those locations. This test plan also includes obtaining and examining information from the transit providers that operate bus service along these locations, which consists primarily of King County Metro but may also include Sound Transit, Community Transit, Pierce Transit, and Microsoft. Finalization of transit data sources will occur with the development of the full, detailed Safety Test Plan document.
The safety test plan will use three sources of data. Crash data will come from the WSDOT Collision Data and Analysis Branch reports that utilize data from the WSDOT Transportation Information Planning Support System (TRIPS). Incident data will come from the WSDOT Traffic Office's Washington Incident Response Tracking System. Transit safety information will come each of the transit agencies that operate bus routes along the roadway locations shown in Table 4-22. The data available from these sources is described next, along with the advantages and limitations of each database. WSDOT Collision Data and Analysis Branch Reports ("TRIPS System"). The data available from the Collision Data and Analysis Branch is derived from collision reports completed by law enforcement personnel and from citizen reports. Collision data for all locations of interest (all of which are state highways) are available from January 1, 1993 through the present, with a two-month lag (that is, an analysis done on July 1, 2009 could include data through April 30, 2009). Records for the years 1997 and 1998 are considered as "partial records" "Partial records" has a two-fold meaning; 1) not all the records are available, and 2) the information available within the existing records is very limited.15 A variety of standard and custom data reports are available. Available information for each collision includes:
The WSDOT Collision Data and Analysis Branch represents an excellent data source in that data is expected to be available for all locations, can be provided in a variety of formats and levels of granularity based on specific analysis needs, and includes data that can support a historic rather than merely one-year pre-deployment analysis. There are a few limitations associated with this data, the first being that the two-month data lag time will limit the post-deployment analysis to a ten month period rather than a full year. The second limitation is a function of the raw data, the accident reports, which feed the TRIPS database. Specifically, variations among individual personnel in specifying collision type and contributing circumstance may make it difficult to clearly discern changes in the specific types of collisions one may expect as a result of the new UPA signage, e.g., side swipes from drivers changing lanes or rear-end collisions from drivers slowing to read the signs or change lanes. A similar limitation is that the locations noted on the collision report are not always accurate enough to pinpoint locations and associate them with possible driver reactions to new UPA signage. WSDOT Incident Databases. WSDOT compiles a variety of incident related information that will be examined for use in the evaluation. WSDOT compiles data from a variety of sources, including the WSDOT Incident Response Tracking System (WITS), the WSDOT Northwest Region Traffic Systems Management Center (TSMC) blocking incident log, and the Washington State Patrol's computer aided dispatch (CAD) system. Data from various sources are utilized to compile reports such as those included in WSDOT's "Gray Notebook" (the quarterly "Measures, Markers and Mileposts" performance and accountability report). Incident data from WSDOT sources that will be utilized for this evaluation include number of incidents by type, response times, and clearance times. One of the major primary sources that WSDOT utilizes in compiling incident data is the Incident Report forms completed by WSDOT Incident Response vehicle operators. Those reports, which feed the Incident Response Tracking System, include a variety of detailed information including:
The apparent advantage of the WSDOT incident data sources is that they are expected to provide information needed to better understand the impact of any change in crashes that may occur as a result of the UPA projects. That is, while the crash data can show changes in the number of crashes, the incident data can help show the impact of those changes. To date, no specific disadvantages of the incident data have been identified. As the data is examined in greater detail as part of the development of the full, detailed Safety Test Plan document, disadvantages such as the lag time for these data sources will be specified and their impact on the evaluation identified. King County Metro and Other Transit Agency Logs. Transit agencies maintained data related to incidents represents another source of information that may help expand the understanding of the impact of UPA projects on crashes. Transit agency data is expected to include logs maintained by bus operators and/or information maintained by transit agency dispatch staff. It is not likely that transit data sources will reveal crashes or incidents not included in the WSDOT data sources described above, but if a transit vehicle is involved in any crashes that appear related to UPA signage, the transit data sources provide a means to more thoroughly explore the specifics of the incident. Data AvailabilityWith the exception of the aforementioned lag times (e.g., two months for crash data), the availability of required safety data is expected to be very good and sufficient to support an effective analysis. Table 4-23 presents the data sources and availability of before deployment data and after deployment safety data.
1Historic data, that is, data extending much farther than one year prior to UPA project deployment is available and is planned to be utilized in the evaluation. Data AnalysisThe safety test plan will focus on comparing before-deployment crash and incident data with after-deployment crash and incident data. The data will be used to assess the measures of effectiveness outlined in the safety analysis and other analyses. Examples of the measures include:
Appropriate statistical tests will be utilized to determine whether pre- and post-deployments differences exist. Judgments about the causal relationship between crashes and incidents will be made based on a detailed understanding of the UPA deployments and operational strategies coupled with all available data on crash and incident cause/contributing factors. Although the specific number of crashes will be considered most conclusions related to UPA causality will be based on crash rates so that the impact of varying traffic volumes are controlled. One of the major challenges related to safety data is that given the year-over-year variability in collisions and incidents, one year is a very short period of time upon which to base judgments about post-deployment safety impacts. Collection and analysis of historic collision and incident data in order to determine long-term trends is one method that will be used to control for short-term variability on the pre-deployment side of the before-after safety impacts assessment. Also, if, as expected, less than a full year of post-deployment data is available, that data will be adjusted for seasonality. Data Collection Schedule and ResponsibilitiesThe high-level data and analysis periods for each data source are summarized in Table 4-24. For the collision and incident data, historical, pre-deployment (the twelve months immediately preceding deployment), and post-deployment (the twelve months immediately following deployment) will be collected. Transit agency logs will be collected only in the post-deployment period because they will be used only to better understand the circumstances associated with collisions and incidents that may be related to the UPA deployment. The specific data collection time frames will be identified in the full Safety Test Plan document to be produced in November or December 2009.
4.2.6 Surveys, Interviews and Workshops Test PlanData Sources and AvailabilitySurveys, interviews and workshops are critical for obtaining information needed to assess the influence of the Seattle/LWC UPA projects on changes in travel behavior and perceptions. Possible behavior changes include shifting travel modes, paying to use the tolled SR 520 bridge, changing time-of-travel, and eliminating trips due to telecommuting. While traffic counts and bus ridership data are important, the only way to ascertain if people have changed their travel mode or made other changes as a result of the UPA projects (as opposed to other factors) is to ask them. Surveys, interviews and workshops also provide information about individuals' perceptions of different strategies and projects, the ease or difficulty of using technologies and services, and concerns over safety or equity. This test plan outlines the survey, interview and workshop-related UPA evaluation data needs. Planning and conducting special surveys can be costly and so the national evaluation team has, aided by the Seattle/LWC partners, inventoried existing data sets and planned surveys, focus groups, and interviews for possible use in the UPA evaluation. The recommended approach includes identification of existing and planned local partner data and data collection that may be used in the UPA evaluation. It also identifies the additional UPA-specific surveys, interviews and workshops needed to fully evaluate the Seattle/LWC UPA deployment. "Planned surveys and focus groups" is a moving target in so much as the local partners' plans in this area are becoming clear by degrees. The information presented here reflects the latest information available to the national evaluation team. The national evaluation team is, and will continue, to work closely with the local partners to identify planned surveys and interviews and assess opportunities for the evaluation. The full Surveys, Interviews and Workshops Test Plan document to be produced in November and December 2009 will include updated information. Table 4-25 identifies the information needed from various populations and summarizes the recommended approach. A total of 13 population groups and the associated information needed for the evaluation are identified.
The sections that follow briefly discuss each survey/interview to be used, first presenting the existing or planned local partner data to be utilized and then identifying the UPA surveys/interviews that are recommended. Details on questions and survey protocols (recruitment, sampling method, etc.) will be resolved in the full test plan documents and will include consultation with the local partners. Use of Seattle/LWC Partners' Existing and Planned SurveysThe information presented here on existing surveys is fairly comprehensive, although it may be further elaborated in the full Surveys, Interviews, and Workshops Test Plan document. The information presented here on planned surveys is incomplete because the local partners have not made and/or communicated all of their plans yet. The national evaluation team is working with the local partners now to identify survey and related plans and assess opportunities for the evaluation. Updated information on planned surveys will be included in the full test plan document. WSDOT SR 520 Environmental Justice Survey (Regular & Transit) WSDOT conducted two surveys of SR 520 bridge users in 2008 that will contribute very useful baseline (pre-deployment) traveler perception data for the UPA evaluation. Both surveys included both environmental justice (e.g., low income) and non-environmental justice stakeholders. The first survey, conducted by telephone, was fielded in October 2008 and assessed the likely impact of the SR 520 bridge toll and attitudes toward various tolling options. The second survey, a paper handout survey, assessed the same issues among transit users who cross the SR 520 bridge. These surveys are not ideal for UPA evaluation purposes, e.g., only SR 520 bridge travelers were surveyed whereas the UPA interest is in all corridor travelers' perceptions, but the value of conducting an additional baseline survey for the UPA national evaluation does not warrant the cost. Baseline data from these surveys that will be used in the UPA evaluation consist of the following:
WSDOT Environmental Justice and Regional Pricing Focus Groups Two sets of focus groups were conducted in the 2007-2008 timeframe that will contribute useful baseline perception data to the UPA evaluation. One focus group was conducted by WSDOT and gauged the attitudes and perceptions of environmental justice (EJ) stakeholders regarding SR 520 tolling issues. That focus group was a precursor to the WS SR 520 environmental justice telephone and paper surveying described above. The second focus group included a general stakeholder population and considered attitudes about tolling in general. Data from these focus groups that will be used in the UPA evaluation consist of the following:
WSDOT August 2009 Communications and Marketing Survey This survey collects similar information as in the aforementioned WSDOT surveys, namely information on usage of the SR 520 bridge, reactions to various toll payment strategies, and various supporting rationales for tolling. This survey targeted current users of the SR 520 bridge and collected information from 800 respondents using a random sample phone survey. WSDOT Fall 2009 SR 520 Traffic and Revenue Study Surveys Two surveys are being conducted in the fall of 2009 in support of a WSDOT SR 520 traffic and revenue study that will yield a variety of information of interest to the evaluation. The first survey, the "O-D Pairs" survey collects travel pattern information (origin-destination and time of day) for a specific eastbound SR 520 bridge trip. This information will be used to calibrate a traffic model being used for the traffic and revenue study. The sample was collected via license plate readers on the SR 520 bridge, with a survey sent to every vehicle captured by the readers over a specific time frame. Surveys will be sent out to 40,000 people and WSDOT hopes to collect responses from 10,000 people. The other survey being conducted in support of the traffic and revenue study is referred to be WSDOT as the "stated preference" survey. The primary objective is to collect information on travelers' valuation of time. The sample is being drawn using the same license plate reader data collection as for the "O-D pairs" survey. WSDOT reports that they will solicit participation via an on-line request and then conduct surveys in person at “community survey stations. For this survey, WSDOT is aiming for 2,000 responses. WSDOT provided a draft of the survey questionnaire to the national evaluation team and is considering adding one of the additional questions requested by the national evaluation team. King County 2007 Tolling Surveys Much of the information from these two surveys is also available from the more recent WSDOT Environmental Justice Surveys described earlier, but the results from these surveys has been obtained and will be considered in the national evaluation. These surveys focused on perceptions of transportation problems, options for replacing the SR 520 bridge, and reactions to various tolling scenarios. The samples consisted of the general public (residents of King, Snohomish and Pierce Counties), with one survey including 501 interviews and the other 1,194 interviews. Both surveys were conducted by telephone. Tolling Implementation Study Committee Telephone Survey The Tolling Implementation Study Committee—the group named by the Washington State Legislature to study tolling options for the SR 520 corridor (including I-90) conducted a telephone survey of SR 520 and I-90 bridge users in November of 2008 that will contribute useful baseline data to the UPA evaluation. Information of use consists of the following:
Needed Surveys and InterviewsGeneral Public Survey (Post-Deployment) This survey will gather input from travelers throughout the region—inside and outside the SR 520 corridor—on their perceptions of the SR 520 tolling and other UPA projects after they have been operational for some time. Telephone is a likely method for this survey. Data collection should be conducted near the end of the one-year post-deployment period. Transit Riders Survey (Baseline & Post-Deployment) Transit rider survey data will provide information both on transit rider perceptions as well as report travel behaviors before and after UPA deployment. The surveys are critical to understanding how and why transit riders' attitudes and/or travel behavior have been impacted and by which specific UPA projects. Survey data should be collected only from Metro bus routes because most of the service that will most impacted by the UPA is operated by Metro and because it is simply impractical to conduct surveys on the several other transit services in the corridor. Data from King County Metro's 2006 and 2007 region-wide rider surveys has been reviewed for possible use in the UPA evaluation but is expected to prove inadequate due to the small number of SR 520 corridor riders and other concerns. For these reasons, the national evaluation team has preliminarily identified a need to conduct UPA specific baseline and post-deployment transit rider surveys. Corridor Drivers Survey (Baseline & Post Deployment) These surveys will provide details on travel behavior in response to the UPA strategies as well as travelers' perception of the impact and value of the UPA project for addressing congestion issues. Surveys will reveal the perceived personal advantages and disadvantages of the UPA strategies to the traveler, such as improved travel time reliability, and the perceptions of the broader societal implications (e.g., equity, safety, and environment). Collecting information on travel behavior, including changes in travel patterns (e.g., different origins and or destinations, time of travel or route) and the reason for the change is essential for several reasons. This data will be very useful in differentiating the impact of the UPA from the influence of various exogenous factors and understanding traveler responses to specific UPA strategies. There are several options for conducting a survey of corridor drivers, including cross-sectional and panel studies. Other methodological options pertain to the method of recruiting participants (e.g., license plate readers on corridor roads) and conducting the survey (e.g., telephone versus mail out/mail back). These methodological details will be addressed in the development of the full test plan document and in consultation with the local partners and U.S. DOT. The use of PSRC's 2006 region-wide Household Activity Survey—which collected detailed trip-level information through travel diaries—was reviewed for potential use as the baseline data source for the UPA evaluation. As is the case with the Metro transit survey data, it appears that there are two few SR 520 corridor trips (about 300 round-trips as estimated by PSRC) to be of use in the UPA evaluation. The age of this data set and the potential that it may not reflect today's conditions is also a concern. Surveys of Workers Changing to Telecommuting, Ridesharing or Flexible Work Arrangements (Post Deployment) The objective of this survey is to assess the response to the UPA projects that promote car and van pooling and that encourage telecommuting and other flexible work arrangements. Due to the low incidence of the population of employees who are candidates for this survey, a broad-based sample like the survey of corridor drivers will not suffice. Special sources will need to be tapped, such as regional registration lists for vanpools and other potential sources such as large employers' lists of employees using car and van pools and telecommuting and other alternate work arrangements. Information sought would include number of days using flexible work arrangements, prior mode of travel, trip length, O-D, VMT, change in travel time, as well as satisfaction with the change in travel behavior and perceived advantages and disadvantages of the UPA projects on them and the region in general. Interviews with Washington State Patrol, Freeway WSDOT Incident Response Team Members, First Responders and Bus Operators (Post-Deployment) These interviews will collect information from public agency personnel who are in a position to observe firsthand the potential safety impacts of the Seattle/LWC UPA projects and the implication of safety changes on traffic congestion. Specifically, these personnel will be questioned regarding any perceived changes in crash frequency, crash severity and the time required to clear incidents and the relationship between any such changes and the new UPA roadway signage (travel times, ATM variable speed and lane controls). These interviews will be needed in the post-deployment period only. Interviews with Major Employers (Post-Deployment) Interviews with major employers will document perceptions of the impact of Seattle/LWC strategies on employee satisfaction, productivity, retention/hiring, the cost of doing business, and their business volume/success. These interviews will also collect information on the number of employees opting to participate in employer-based, UPA-related TDM programs. Employers representing various classes of organizations will be interviewed, including private, public and non-profit organizations. Employers will be selected that, based on their proximity and hours of operation, would likely have employees that commute in the SR 520 corridor. Selection of employers for interviewing will also take into account participation in UPA-related TDM programs. These interviews will be needed only in the post-deployment period. Surveys of Redmond TOD Users (Post-Deployment) Users of the Redmond transit oriented development, including residents of the apartments and patrons of the businesses that constitute the TOD, will be surveyed to assess the impact of the TOD on UPA corridor travel. Questions will fully explore prior (before moving to the apartments or before patronizing the businesses) and current (post-TOD deployment) travel behavior, including origins and destinations, trip types and frequencies, travel modes, perceptions of traffic congestion and mobility in general, and perceptions of the TOD, including its effectiveness in facilitating transit use. Questions will also be asked pertaining to auto ownership. Interviews with Commercial Vehicle Operators (Post-Deployment) Commercial vehicle operators will be interviewed, probably by phone, in the post-deployment period regarding the impact of the SR 520 tolling on goods movement, including route selection, travel time, and timing of their trips. Direct observation of traffic flows or use of existing traffic cameras or leveraging existing commercial vehicle stakeholder contact lists or relationships with industry associations are all possibilities for selecting interviewees. Partnership Agency Representatives and Other Key Stakeholders (Baseline & Post Deployment) Members of the national evaluation team will conduct one-on-one interviews with representatives of organizations that play an important role in planning, deploying and/or operating the UPA projects. This will include those organizations instrumental in the institutional, technical or public outreach aspects of the UPA, such as the SR 520 Tolling Implementation Committee. As the full test plan is developed the national evaluation team will work with the local partners to further specify interviewees. Two rounds of interviews will be conducted, one each near the end of the baseline and post-deployment periods. Each round of interviews will include a group workshop to discuss lessons learned. Data AnalysisA variety of data analysis techniques will be used to analyze the wide range of survey and interview data, with techniques varying according to the type of data and the intended use of the resulting measure of effectiveness in various evaluation analyses. In the case of interviews, key points from each interview will be compiled, summarized and discussed and areas of agreement, disagreement and recurring themes cutting across multiple interviews will also be identified. Survey analysis will begin with checking the data for anomalies, outliers, or other data peculiarities and to prepare the data, including applying any necessary weighting to adjust for selection bias, unequal response rates in various strata, etc. Descriptive statistics will be prepared to characterize outcomes of interest such as the percentage of respondents reporting that they switched from driving on SR 520 to transit as a result of the UPA deployment, as well as potential predictor variables such as the length of commute. Data Collection Schedule and ResponsibilitiesThe Seattle/LWC local partners will be responsible for conducting surveys and interviews with the exception of interviews with the partnership agencies and other key stakeholders, which will be conducted by the national evaluation team. The national evaluation team will, through the full Survey, Interviews, and Workshops Test Plan document, provide the local partners specific guidance and recommendations on the key aspects of the survey methodology, including specific information to be collected. Baseline surveys should be conducted shortly before the bulk of the UPA strategies (e.g., tolling, enhanced transit, etc.) become operational although the surveys can be done earlier if necessary to avoid the influence of UPA or other construction that may distort the baseline data. Post-deployment surveying should occur near the end of the one-year, post-deployment operational period. 4.2.7 Environmental Test PlanData SourcesThe environmental test plan will generate data to be used primarily in the environmental and the cost benefit analyses. It also supports the congestion and equity analyses. As noted in the Environmental Analysis portion of this document, the environmental analysis for the national UPA evaluation will utilize observed traffic data (e.g., volumes and speeds) in conjunction with emission rates to estimate the change in emissions associated with the UPA project. No monitoring of air pollutants is planned as part of the Seattle/LWC UPA evaluation. The specific air quality analysis approach has not yet been determined. The national evaluation team is in the midst of discussions with USDOT regarding those specifics. U.S. DOT has requested that the EPA MOVES model be utilized. The MOVES model can be used both to generate emission rates (as formerly done in the EPA MOBILE model) and apply those emission rates to user-supplied traffic data to yield emissions. The specific data required for emission calculations will be determined through the on-going discussions with U.S. DOT and the local partners and reflected in the Environmental Test Plan document to be produced in November or December 2009. The analysis of energy impacts will utilize many of the same sorts of data as utilized in the air quality analysis and will follow the same general approach of multiplying observed VMT by fuel consumption factors to estimate the change in fuel consumption. For the energy analysis, it will be important to take into consideration what kinds of fuel will be used by the new transit buses being added as a UPA project. Likely environmental data needs—considering both the air quality and energy analyses—include the following:
Data AvailabilityMost of the key data will be collected through the other national evaluation analyses and test plans. For example, VMT and vehicle speeds will be developed through the Traffic System Data Test Plan. Data availability issues will be resolved in the full Environmental Test Plan document that will be produced once on-going discussions with U.S. DOT and the local partners are concluded. Data AnalysisEnergy consumption and emissions will be calculated and compared between the pre- and post-deployment scenarios to determine the impact of the UPA project. The specific analysis approach will be resolved in the full Environmental Test Plan document that will be produced once on-going discussions with U.S. DOT and the local partners are concluded. Data Collection Schedule and ResponsibilitiesOn-going discussions will impact final decisions about the role to be played by the national evaluation team, U.S. DOT and the local partners in collecting necessary data and carrying out the analyses. The final approach will be specified in the full Environmental Test Plan document. 4.2.8 Content Analysis Test PlanData SourcesThe content analysis test plan focuses on collecting and analyzing information on the Seattle/LWC UPA outreach activities, including comments from the public, policy makers and other groups in response to outreach, and UPA-related media coverage. The information collected and analyzed in this test plan will be used primarily in the non-technical success factors analysis. Information from this test plan also plays a supporting role in all the other analyses except the cost benefit analysis. Two primary data sources will be used in this test plan. The first data source is the on-line search engines Google Alerts and Vocus. Information from the local UPA partners represents the second data source. Google Alerts and Vocus. Google Alerts is a free on-line search engine that tracks news articles, web-based information, blogs, videos, and other media information based on search terms. Members of the Battelle team, including the Seattle/Lake Washington UPA site leader, have signed up with Google Alerts and have entered key terms based on each of the UPA sites. Examples of key terms for the Seattle/LWC UPA projects include SR 520 bridge, tolling, park-and-ride lots, and Seattle/Lake Washington UPA. Vocus is a private company providing a range of web-based products and services. The Texas Transportation Institute's (TTI) Media Relations Group contracts with Vocus for a variety of services, including tracking media and on-line coverage based on search terms. The key words noted above for the Seattle/Lake Washington UPA have been added to TTI's search terms at no cost to the national UPA evaluation. Seattle/LWC UPA Partnership Agency Information. Press releases and outreach, public education, public and policy maker comment and other communications, and marketing materials issued by the Seattle/LWC UPA agencies represent the second source of information for the content analysis test plan. WSDOT, PSRC, King County, and other partners use these methods to communicate with the public, travelers in the targeted corridors, policy makers, and other groups whose understanding and, to vary degrees, support, will impact the success of the UPA deployment. The national evaluation team requests that the local partners maintain archives of this information and to include the Battelle evaluation team Seattle site leader on distributions lists for these materials. Data AvailabilityThe availability of most data is assumed to be good in so much as the local partners will be maintaining archives. The exception is television and radio coverage where the local partners have indicated that they do not maintain archives. Data AnalysisThe information obtained in this test plan will be used in the non-technical success factors analysis and will provide context for interpreting results in the other analyses. The following questions provide examples of how the qualitative information obtained in the test plan will be applied in the evaluation.
Members of the Battelle team will document the results of the Google Alerts and Vocus on-line search tools and information obtained from the partnership agencies. Table 4-26 illustrates how the information will be tracked, categorized, and analyzed.
Data Collection Schedule and ResponsibilitiesThe Seattle/LWC UPA local partners are responsible for providing the national evaluation team with data for the content analysis. To supplement the local partners' collection of media coverage, the Battelle team has registered with Google Alerts and Seattle/LWC UPA search terms have been entered into Vocus. Members of the Battelle team will continue to monitor Google Alerts and Vocus over the course of the baseline and post-deployment periods. Team members will also request being added to agency lists for press releases and information relating to the Seattle/LWC UPA projects. 4.2.9 Cost Benefit Analysis Test PlanData SourcesThis test plan focuses on obtaining and analyzing data related to the costs of the various Seattle/LWC UPA projects and the intended resulting benefits, including improvements in travel conditions on highways, transit services, and the environment. Data sources include many of the other evaluation analyses (e.g., congestion, environment, etc.) and the PSRC regional travel demand forecasting model. The cost benefit analysis test plan will use two major sources of data. The first source is the detailed costs associated with the UPA project. These data will be provided by WSDOT, the PSRC, King County and any other agencies expending funds on UPA activities. The second source is data collected through other Seattle evaluation analyses. These data will be analyzed using PSRC's regional travel forecast model and associated cost benefits module. Cost Data from Participating Agencies. Cost data will be obtained from WSDOT, the PSRC, King County and any other agencies making UPA project expenditures. Data include the capital costs associated with various projects, the operating and maintenance costs, and the replacement and re-investment costs. The following are examples of the cost categories needed for this test plan.
Travel Demand Forecasting Model. The PSRC regional traffic model will be used to generate 10-year forecasts of travel patterns in the region resulting from the UPA strategies. The model is well suited to application in this evaluation. In 2008, PSRC in consultation with WSDOT staff revised the model to better respond to how people make travel choices when a facility is tolled for use in the SR 520 Bridge tolling analysis. A peer review of the revised model found it to be in accordance with the best state-of-the-practice, and made short-term and mid-term recommendations for enhancements. In addition, significant changes are being made in the model as part of the overall Integrated Modeling Framework. Improvements have also been made in the model to provide the capability to model additional strategies and alternatives in the development of the Transportation 2040 long-range plan. These strategies include tolling/pricing options, freight analyses, modal choice analyses, speed and reliability impacts, and assessing greenhouse gas emissions. Most relevant to this test plan, the PSRC Integrated Modeling Framework also includes a new cost benefit analysis tool. The model will be used in two capacities in the cost benefit analysis. First, it will provide the needed long range travel estimates (the cost benefits analysis considers a 10-year post-deployment timeframe) and second, using the special cost benefit module, it will be used by PSRC to calculate the benefits associated with the UPA travel impacts. Other Seattle/LWC UPA Test Plans. Another important source of data for the cost benefit analysis is other test plans. The data from various test plans, including the following data, will be used to compare the scenarios before and after the UPA projects are implemented:
Data AvailabilityAt this point, it is expected that all necessary data will be available, either, as in the case of public cost data, from the UPA local partners, or from other test plans, or from the PSRC regional model and associated cost benefit module. Data AnalysisThe PSRC regional travel demand model will be used to estimate the benefits related to congestion reduction resulting from the UPA projects. WSDOT and PSRC have used the traffic forecasts produced from the regional model to conduct cost benefit analysis for other transportation improvement projects. Data Collection Schedule and ResponsibilitiesThe cost benefit analysis will be initiated prior to deployment of the Seattle/LWC UPA projects. The analysis will be completed after all the UPA projects are in operation. The local partners will be responsible for providing public agency cost information and, via other test plans, a range of other data that will be used in the cost benefit analysis. The national evaluation team will work with the local partners and U.S. DOT to agree upon specific data elements, formats and collection procedures as the full test plan document is developed. Staff from PSRC will run the regional travel forecast model to generate the travel forecasts for the 10-year post-deployment time frame. They will also run cost benefit analysis software developed by ECONorthwest, a consulting firm, to compute the net benefit of the UPA projects. Members of the Battelle team will examine the methodologies implemented in the cost-benefit analysis software to ensure that the methods will be consistent with those to be implemented in other UPA sites. The Battelle team will also perform the analysis to crosscheck the results obtained from the software to ensure correctness. 4.2.10 Exogenous Factors Test PlanData SourcesThe exogenous factors test plan will be used to monitor elements un-related to the Seattle/LWC UPA projects that may influence travel in the SR 520 corridor, use of the various project elements, and changes in travel modes and telecommuting. The data obtained in the exogenous factor test plan supports all of the analysis areas. As outlined in this section, elements included in the test plan are unemployment rates, gasoline prices, non-UPA roadway construction, and non-typical weather conditions, traffic incidents, and special events. Regional, and if possible, control corridor changes in VMT, transit ridership, and other factors will be monitored as described in other test plans. The details related to exogenous factors data will be determined through the development of the full test plan document. The following describe data sources under consideration. PSRC and U.S. Department of Labor Unemployment Rates. Data will be examined from 2000 to the conclusion of the UPA evaluation. U.S. Department of Energy (DOE) Gasoline Prices. The U.S. DOE monitors gasoline prices. Historical data on the weekly price of retail gasoline for various grades has been available on-line since 2000. Data will be monitored over the course of the UPA evaluation. Various commercial Internet sites that provide Seattle region gas prices will also be consulted. Non-UPA Roadway Construction. A weekly updated WSDOT website (http://www.wsdot.wa.gov/Northwest/King/Construction) will be used to identify road construction that may influence travel patterns, bus routes, and other factors. This information will be monitored over the course of the evaluation. Figure 4-3 shows an example of the type of data contained in the WSDOT database. Non-typical Weather Conditions. A number of sources will be used to determine when weather conditions impact traffic operations. Control center operator logs will be reviewed to determine if traffic management center operators have identified weather as causing or contributing to incidents or capacity breakdowns. Archived daily and hourly weather information will be obtained from the National Weather Climate Data website (http://cdo.ncdc.noaa.gov/ulcd/ULCD). Weather data from the weather reporting station at Boeing Field/King County International Airport (BFI) will be correlated with traffic sensor data. Examples of the types of weather events that will be examined for possible traffic impacts include limited visibility (less than 1 mile), heavy snow or rain events, or icing events. Figure 4-3. Sample Log of Construction and Maintenance Activities Ongoing in the Puget Sound Area Incident Conditions. Incidents can be a major source of variation in travel time and other MOEs of interest to the evaluation. For the UPA evaluation, it will be important to determine when and where MOEs have been impacted by traffic incidents. Data on incident conditions is expected to come from WSDOT TSMC Operator logs and, if possible, from WSDOT logs of their incident-related travel information dissemination to the public, including through their website (http://www.wsdot.wa.gov/traffic/seattle/incidents/). Another source of potential data are the dispatch logs associated with WSDOT IRT that respond to traffic incidents on state roadways and the reports prepared by these teams. Special Events. Some special events (such as professional sporting events, major festivals, etc.) can significantly impact travel. Data on special events impacting the SR 520 corridor will be collected from the same WSDOT website that contains construction activities. Figure 4-4 shows a sample of the types of special events contained in this log. These records appear to be updated monthly. Figure 4-4. Example of Information Contained in Special Events Log Control Corridors. Monitoring various travel and traffic MOEs of interest on one or more control corridors provides another method for assessing how much of any observed SR 520 changes could have been expected without the UPA. In discussions to date, the Seattle local partners have indicated that there are few, if any, good control corridor candidates, "good" candidates being those without corridor-specific major construction or other corridor-specific influences that make them poor indicators of the influence of more general exogenous factors (like economic conditions) on travel. As the full test plan is developed the issue of control corridors will be revisited and finalized. Data AvailabilityHistorical, pre-deployment, and post-deployment data is available for unemployment rates and gasoline prices. Historical and pre-deployment data on other exogenous factors are limited, but post-deployment data will be available on all of the elements in the test plan. Data AnalysisThe factors included in this test plan will be used as comparison checks in all of the analysis areas. The information on the exogenous factors will assist in identifying elements that may influence and explain changes in travel patterns, traffic conditions, mode changes, and use of telecommuting in the SR 520 corridor. Data Collection Schedule and ResponsibilitiesTable 4-27 presents the anticipated data collection schedule for the exogenous factors test plan. As noted, historical data and pre-deployment data are available for some factors, while post-deployment data are available for all factors. The responsibility for collecting data will reside with the local partners. In most cases, the evaluation will adjust to utilize whatever data is normally collected, although in a few cases—such as construction, weather/incidents/events, and/or transportation program/policy/project record keeping—if the standard archived information is very incomplete it is hoped that the local partners can find low-cost ways to preserve more detailed and comprehensive data for the evaluation.
10Seattle Area Travel Times. Washington State Department of Transportation. Available at http://www.wsdot.wa.gov/traffic/seattle/traveltimes. Accessed May 26, 2009. |
US DOT Home | FHWA Home | Operations Home | Privacy Policy |