1. Introduction
1.1 Transport Focus is the independent consumer watchdog representing the interests of rail users throughout Great Britain; bus, coach and tram users across England, outside London; and users of the Strategic Road Network in England. We have a Welsh Board Member appointed by the Cabinet Secretary for Economy and Infrastructure.
1.2 We have been engaged in discussions with Welsh Government (WG) and Transport for Wales (TfW) about the future operation of, and the procurement process for, the next Wales and Borders franchise. We are pleased to make a contribution to this consultation undertaken by the Economy, Infrastructure and Skills Committee of the National Assembly for Wales.
2. What standard of performance has been experienced under the current franchise?
2.1 Transport Focus consults over 54,000 passengers a year for the National Rail Passenger Survey (NRPS) - a network-wide picture of passengers’ satisfaction with rail travel. In Autumn 2016 we spoke to 1086 Arriva Trains Wales (ATW) passengers.
NRPS is a comprehensive source of information about current and historic passenger perceptions of the ATW franchise. It can also be broken down to show variations across five ‘building block’ groupings of rail services in the Wales and Borders operation.
Using analysis we can identify those factors that correlate most highly with overall satisfaction and dissatisfaction.
Full details of the Autumn 2016 wave are on our website[1]. For ease of reference we have included key results for ATW as Appendix 1.
2.2 Currently the cleanliness of the inside of the train is the key driver of satisfaction for ATW passengers at 32 per cent overall. The next most important factor is punctuality and reliability at 16 per cent.
2.3 How the train company deals with delays is the most significant driver of dissatisfaction at 34 per cent.
2.4 Between 2012 and 2013 ATW had slightly higher overall satisfaction than the Regional sector average[2]. However, in recent years it has tended to perform less well; the most recent score for ATW is 82 per cent compared to a Regional average of 84 per cent.
2.5 ATW is lagging behind the Regional sector on many elements that are important to passengers. ATW scores somewhat lower than the Regional sector average on 15 out of 16 station factors and is also below on 13 out of 20 train factors.
2.6 Passenger satisfaction with punctuality and reliability on ATW has declined significantly in recent years. Consistently 85 per cent and above between 2011 and 2013, satisfaction has now dropped to 80 per cent. This compares to the Regional sector average of 82 per cent. Industry measures of performance also show drops. Between periods 11 of 2010/11 and 2016/17 the Moving Annual Average for PPM has fallen from 94.1 to 91.6 per cent, whilst for Right Time it has fallen from 87.9 per cent to 80 per cent[3].
2.7 Satisfaction with the upkeep and repair of the train has also declined significantly over the last few years, from 76 per cent in Spring 2012 to 64 per cent in Autumn 2016. This compares to the Regional sector average of 70 per cent.
3. What lessons can be learnt from the current franchise?
3.1 The principal lessons to be learnt from the current franchise hinge on responsiveness. Since the operation commenced in October 2003 there has been unanticipated growth in passenger demand and, within the contractual terms, there has been little ability to address this.
3.2 A new franchise contract must be based on well-evidenced projections of passenger demand and ensure there are mechanisms within it to respond to changes.
3.3 The key elements that must be at the heart of a new contract are sufficient trains to provide the services required to meet demand, a timetable that provides the frequency needed and is aligned to passenger requirements, including for services earlier and later in the day and at the weekend, especially on Sundays. There is also a need to plan for, and effectively manage, the peaks of demand when special events take place on the network.
3.4 The new franchise must also address rolling stock – the current train fleet is largely ageing and much is in need of refurbishment or renewal. One particular challenge concerns the implications of the deadline for PRM-TSI (Persons of Reduced Mobility Technical Specification for Interoperability) compliance[4].
4. What improvements to rail passenger services should be expected under the next franchise?
4.1 In 2014 we asked 3,500 passengers across the Great Britain to rank a series of train and station categories in order of their perceived priority for improvement[5]. A breakdown of results for Wales is in Appendix 3; the sample size is 750 and the vast majority of these are ATW passengers. The online database contains a wealth of information which can be analysed in many ways to explore how priorities vary by demographic and journey purpose, amongst other things[6].
The two top priorities, by some considerable margin, are ‘passengers always able to get a seat on the train’ and ‘price of train tickets offers better value for money’.
Summarising the findings, it is clear that passengers’ top priorities for improvement largely focus on the basic elements of the rail service – value for money, getting a seat, frequency, punctuality, managing delays and provision of information.
4.4 Assessment of NRPS scores should also drive decisions on improvements under the next franchise. These should focus on the elements which drive passenger satisfaction and dissatisfaction and also include those factors where the absolute scores are low, those where there are high levels of dissatisfaction and those where the franchise scores below the average for the Regional sector as a whole. (See section 2 and Appendix 1 for further details of NRPS on the current franchise).
4.5 In 2014 Transport Focus undertook a study to explore passengers’ relationship with the rail industry[7]. The main finding is that to improve passengers’ trust in the rail industry, train companies not only need to get the basic service right day-to-day, they need to put effort into building long-term relationships with their passengers. For the next Wales and Borders franchise to build greater trust with passengers it is important to get the basic service right ahead of everything else. Then, building on closer relationships with their passengers is important. One way is through high quality communication. Passengers should feel that train companies are ‘on their side’.
4.6 Analysis of the passenger priorities for improvement, drivers of satisfaction /dissatisfaction and NRPS scores highlights a number of factors that should be top level priorities for the next Wales and Borders franchise to address. The primary requirements should be for an absolute focus on the fundamentals to deliver improvements to:
· Capacity and frequency – considering service frequencies and train layouts, optimising the availability of carriages appropriate to demand, as well as how fares incentives might make a contribution to alleviating pressures.
· Value for money – encompassing the important service elements which drive this as well as the ticket price.
· Punctuality and reliability - specifically as this affects passengers at all stages of the train journey, not simply the timing of the train at its destination.
· Minimise and effectively manage disruptions – with planning and contingency arrangements placing passenger interests to the fore. Four of the top ten priorities for ATW passengers relate to avoiding and managing disruption, including accurate and timely information at stations[8]. ATW passengers’ satisfaction for how well disruption is dealt with is 42 per cent, the same as the regional train companies average, which is itself low. In terms of the usefulness of information, there is a gap, with ATW at 50 per cent against the regional average at 53 per cent.
· Provision of accurate and timely information – for all stages of the journey but especially during delays and disruption. Following significant disruption on the Valleys lines in July 2014, ATW asked Transport Focus to review the quality of information provided to passengers. Following discussions, we provided our conclusions and recommendations, now published together with the report from ATW on actions taken for improvement[9]. We continue to work with ATW as measures are implemented. This area of key concern for passengers will need to be a priority for the new franchise.
Alongside this, there must also be improvements to other elements of the journey experience including:
· Improvements on-board – with particular emphasis on the cleanliness and maintenance of the inside of the train and on-board toilets, layouts that facilitate luggage storage and passenger comfort and with high quality connectivity to facilitate access to information and enable a range of activities during the journey.
· Enhanced station environments – that create easily navigable spaces providing the facilities and comfort that passengers value.
· Proactive and helpful staff available to provide information, reassurance and assistance to passengers. Passengers consistently identify the presence of staff as important to providing reassurance to those travelling on the railway. Research carried out in 2011 found satisfaction with security at unstaffed stations was 9 per cent lower than the average for staffed stations in Wales[10]. Better lighting and CCTV were seen as key; passengers also placed a high value on being able to access real-time information via Customer Information Screens, particularly at times of disruption. In terms of improving on-train security, 75 per cent of passengers believe that staff walking through the train would be effective. On board staff are also crucial for passengers buying tickets and are seen as a main part of the solution to fare evasion.
· Seamless ticketing – which allows passengers to select and easily obtain the best and most appropriate fare for their journey delivered through the medium of their choice.
· Building trust with passengers, with clear and open communication.
The next franchise operator also needs to embed a genuinely customer-service focused culture at all levels and provide a personalised, rewarding passenger experience.
4.7 Transport Focus has long advocated more use of quality-focused targets within a franchise. Our strong preference is for targets based on what passengers think, the best judge of quality being those who have used the services in question. The NRPS is ideally suited to capture information that directly reflects the customer perspective. A financial penalty regime should apply, with resources ring-fenced for additional investment into service quality measures that are most likely to improve passenger satisfaction.
4.8 Central to improving the passenger experience of rail services are effective mechanisms for passenger and stakeholder engagement, particularly for gathering intelligence on local aspirations and developments, and for consulting on future proposals. Our research shows that passengers have unanswered desires to contribute their thoughts, both about priorities for franchise specifications and the performance of incumbents. There is also a desire for greater two-way communication about what each franchise promises – and what is actually achieved[11]. The next franchise should provide an engagement strategy that accommodates the needs of different passengers.
4.9 There is an increasing demand for technology that drives both functional and relationship improvements. Intelligent use of technology should facilitate easier, more intuitive ticket purchase options and provide the accurate, timely information that empowers passengers to make informed travel choices. Provision of free, reliable internet connectivity, better mobile phone reception and power sockets help passengers to get the most of their door-to-door journey. The next franchise must be able to respond flexibly to the needs of a rapidly changing world.
5. The Welsh Government’s approach to the rail franchise and South Wales Metro
5.1 The Welsh Government has established a clear policy position regarding their expectations for the future franchise and has established Transprt for Wales (TfW) to run the procurement on its behalf.
5.2 The approach adopted is innovative and it will be some time before the success of this method can be assessed. Four bidders have been shortlisted and are now engaged in competitive dialogue. There will be a welcome further consultation and some passenger research undertaken before the bidders are invited to submit their final solution. It appears that TfW have taken steps to strengthen the team, ensuring increased rail franchise experience and additional staff resource to support the procurement activity.
5.3 Transport Focus is pleased to be engaging with TfW on matters of policy and passenger experience. They are also looking to draw on the experience of the established devolved authorities in Scotland and London.
5.4 It is important that principles of engagement and transparency are followed so that passengers and funders of the railway can be informed about and understand the decisions that are being made about the future of these vital services.
6. How do the Welsh and UK Governments cooperate in deciding how services are provided?
6.1 The fundamental principle that should guide decisions on how services in Wales are run must be what is best for the passenger.
6.2 Passengers are focused on the outputs that matter to them – how punctual their service is, how many seats are available and whether they are kept informed of delays – rather than the structures adopted by Government and the industry to deliver these.
6.3 We believe that the decisions on rail passenger services in Wales should be determined against the ‘passenger test’ which incorporates three core questions:
· What benefits will this bring to passengers and how will these improve services?
· Will it create any disbenefits and what effect will this have on passengers?
· Will it inhibit/prevent development of future benefits?
A number of issues merit consideration against these criteria, not least maintaining a coherent and integrated network and ensuring appropriate funding and accountability is available on both sides of the border.
6.4 The Wales & Borders services need to retain smooth interaction with the remainder of the rail network. Passengers value the concept of a national rail network and the seamless delivery of service. Rail is also plays an important role in promoting access and economic opportunity between regions. There is, for example, an increasing emphasis on the linkages between Wales and the ‘Northern Powerhouse’. Decisions should ensure that no artificial barriers impact on passenger journeys and the seamless concept does not develop rough edges.
6.5 In this context the shape of the Wales & Borders network is particularly important. Important services run between destinations within and beyond both England and Wales, providing linkages in many directions. Were the franchise routes to be remapped then it would be hard to see how a coherent network could be retained.
6.6 Remapping would inevitably require resources to implement and may well create additional costs in future operation.
6.7 However, there are some challenges around access to funding, determining priorities and ensuring decisions reflect the priorities of relevant stakeholders. What structures can ensure that Welsh and English communities and stakeholders have a voice in decisions and dialogue on the issues that matter to them? How will future investment be secured and expenditure choices agreed with those who are affected?
6.8 Clearly, mechanisms will be required to ensure that the Welsh and English Governments maintain ongoing liaison and both bodies have a say, and a stake, in the decision making processes as they affect cross-border matters. Funding streams must also be available for stations and services on both sides of the border.
6.9 There may also be scope for developing the existing Cross Border Forum which brings together a range of parties, including Transport Focus and Transport for the North, to address issues relating to the rail service and estate. It is possible to conceive of a strengthening of this functioning and a remit to manage or mandate potentially ring-fenced budgets to ensure that investment and operational decisions reflect the wishes of relevant stakeholders.
6.10 All parties involved in decisions about the operation of Welsh services must commit to placing passenger priorities at the heart of their approach and ensure they adopt the highest standards in engagement and transparency. This will allow passengers who use, and also fund a substantial element of the rail costs, to have a voice in the future of their rail services.
Transport Focus, 3rd Floor, Fleetbank House, 2-6 Salisbury Square, London EC4Y 8JX
0300 123 0860
February 2017
Appendix 1: ATW passenger satisfaction scores
A1.1 Passenger satisfaction at a glance: NRPS Autumn 2016, ATW and building blocks
![]() |
Small sample size- use with caution
A1.2 NRPS Autumn 2016: percentage satisfied, ATW compared to Regional sector[12] |
|
|||
|
Arriva Trains Wales |
Regional |
TOC index |
|
Overall |
||||
Overall satisfaction with the journey |
82 |
84 |
98 |
|
Train factors |
||||
Overall satisfaction with the train |
75 |
80 |
94 |
|
The frequency of the trains on that route |
69 |
79 |
88 |
|
Punctuality/reliability (i.e. the train arriving/departing on time) |
80 |
82 |
97 |
|
The length of time the journey was scheduled to take (speed) |
82 |
87 |
94 |
|
Connections with other train services |
75 |
78 |
96 |
|
The value for money for the price of your ticket |
61 |
60 |
101 |
|
Cleanliness of the train |
70 |
74 |
95 |
|
Upkeep and repair of the train |
64 |
70 |
92 |
|
The provision of information during the journey |
63 |
71 |
89 |
|
The helpfulness and attitude of staff on train |
84 |
79 |
108 |
|
The space for luggage |
63 |
61 |
102 |
|
The toilet facilities |
47 |
43 |
109 |
|
Sufficient room for all passengers to sit/stand |
70 |
72 |
97 |
|
The comfort of the seating area |
72 |
72 |
99 |
|
The ease of being able to get on and off |
78 |
83 |
93 |
|
Your personal security whilst on board |
80 |
81 |
98 |
|
The cleanliness of the inside |
70 |
75 |
94 |
|
The cleanliness of the outside |
66 |
71 |
92 |
|
The availability of staff on the train |
73 |
64 |
113 |
|
How well train company dealt with delays |
42 |
42 |
99 |
|
Usefulnes of information during delays |
50 |
53 |
95 |
|
Station factors |
||||
Overall satisfaction with the station |
75 |
81 |
93 |
|
Ticket buying facilities |
71 |
78 |
91 |
|
Provision of information about train times/platforms |
78 |
84 |
93 |
|
The upkeep/repair of the station buildings/platforms |
66 |
78 |
85 |
|
Cleanliness of the station |
69 |
80 |
86 |
|
The facilities and services at the station |
49 |
55 |
89 |
|
The attitudes and helpfulness of station staff |
75 |
80 |
94 |
|
Connections with other forms of public transport |
62 |
72 |
87 |
|
Facilities for car parking at the station |
60 |
54 |
111 |
|
The overall station environment |
67 |
76 |
88 |
|
Your personal security whilst using the station |
69 |
76 |
90 |
|
The availability of staff at the station |
58 |
70 |
83 |
|
The provision of shelter facilities |
70 |
77 |
91 |
|
Availability of seating |
56 |
61 |
92 |
|
How request to station staff was handled |
84 |
87 |
96 |
|
The choice of shops/eating/drinking facilities available |
38 |
45 |
85 |
|
Facilities for bicycle parking at the station |
58 |
63 |
92 |
|
A1.3 Drivers of satisfaction and dissatisfaction, NRPS Autumn 2016/Spring 2016: ATW and building blocks
![]() |
![]() |
![]() |
What impacts on satisfaction and dissatisfaction? Not all factors will have equal importance - some things will have a much bigger influence on whether a passenger is satisfied with the overall journey than others.
The charts below show which station and train factors are statistically most important in determining overall passenger satisfaction and dissatisfaction for Arriva Trains Wales.
The analysis looks at which factors correlate most highly with overall journey satisfaction. For example, if those satisfied with punctuality are much more likely to be satisfied overall, then punctuality is likely to have a bigger impact on overall satisfaction. The higher the percentage figure below, the greater the influence on overall journey satisfaction.
|
|
What has the biggest impact on overall satisfaction? ATW |
What has the biggest impact on overall dissatisfaction? ATW |
What has the biggest impact on overall satisfaction? ATW and Cardiff and Valleys building block
Please note that due to changes to the building blocks in 2016, drivers of satisfaction are only available for Cardiff and Valleys for Spring 2016/Autumn 2016 combined.
Autumn 2015/Spring 2016 drivers of satisfaction by building block are included below for reference.
Drivers of satisfaction and dissatisfaction, NRPS Autumn 2015/Spring 2016: ATW and building blocks
Appendix 2: Rail passengers’ priorities for improvement
The table below shows the relative scores for the top 14 priorities (out of a list of 31) for Wales as a whole alongside those for commuters, business and leisure passengers. To achieve a representative sample for Wales the returned questionnaires are weighted in relation to journey purpose: commuter 32%, business 12% and Leisure 56%. ATW passengers make up nearly 700 of the 750 returns for Wales.
|
ATW (697) |
Total Wales (750) |
Commuter (400) |
Business (62) |
Leisure (288) |
|||||
Rank |
Index |
Rank |
Index |
Rank |
Index |
Rank |
Index |
Rank |
Index |
|
Price of train tickets offers better value for money |
2 |
473 |
1 |
458 |
1 |
491 |
2 |
485 |
2 |
434 |
Passengers always able to get a seat on the train |
1 |
482 |
2 |
402 |
3 |
277 |
1 |
526 |
1 |
448 |
Trains sufficiently frequent at the times I wish to travel |
3 |
231 |
3 |
238 |
2 |
279 |
3 |
220 |
3 |
219 |
Train company keeps passengers informed about delays |
4 |
161 |
4 |
168 |
6 |
181 |
5 |
135 |
4 |
167 |
More trains arrive on time than happens now |
5 |
140 |
5 |
150 |
4 |
202 |
9 |
109 |
6 |
128 |
Accurate and timely information available at stations |
6 |
135 |
6 |
140 |
8 |
143 |
8 |
115 |
5 |
143 |
Less frequent major unplanned disruptions to your journey |
7 |
123 |
7 |
133 |
5 |
186 |
11 |
95 |
9 |
111 |
Fewer trains cancelled than happens now |
8 |
108 |
8 |
116 |
7 |
158 |
14 |
83 |
11 |
99 |
Well-maintained, clean toilet facilities on every train |
9 |
107 |
9 |
106 |
15 |
75 |
6 |
117 |
7 |
122 |
Inside of train is maintained and cleaned to a high standard |
10 |
106 |
10 |
106 |
13 |
83 |
7 |
115 |
8 |
117 |
Free Wi-Fi available on the train |
13 |
90 |
11 |
97 |
12 |
99 |
4 |
161 |
13 |
82 |
Accurate and timely information provided on trains |
12 |
91 |
12 |
97 |
10 |
101 |
15 |
80 |
12 |
98 |
Connections with other train services are always good |
11 |
98 |
13 |
95 |
14 |
82 |
12 |
89 |
10 |
103 |
Journey time is reduced |
14 |
77 |
14 |
84 |
9 |
101 |
10 |
105 |
16 |
70 |
![]() |
[1] NRPS Autumn 2016 main report. Transport Focus. 2016
[2] Regional operators include ATW, Merseyrail, Northern and ScotRail
[3] http://dataportal.orr.gov.uk/displayreport/report/html/35d7377b-ab0f-40b2-bb98-f9bf582d82f8
PPM (public performance measure) means trains arriving at their terminating station within five
minutes for commuter services and within 10 minutes for long distance services. Right Time
performance measures trains arriving at their terminating station early or within 59 seconds of
schedule.
[4] http://orr.gov.uk/what-and-how-we-regulate/health-and-safety/regulation-and-certification/rail-vehicle-accessibility - An outline of the The Rail Vehicle Accessibility (Non-Interoperable Rail System) Regulations 2010 (RVAR 2010) enforced by the Office of Rail and Road (ORR).
[5] Rail passengers’ priorities for improvement. Transport Focus. 2014
[6] Rail passengers’ priorities for improvement – simulator. Transport Focus. 2014. Please contact us directly to discuss the data specific to Wales.
[7] Passengers’ relationship with the rail industry. Transport Focus. 2014
[8] Rail passengers priorities for improvement Transport Focus. 2014
[9] Valley lines July 2014 disruption Transport Focus. 2015
[10] The passenger experience at unstaffed stations Transport Focus. 2011
[11] Giving passengers a voice in rail services. Transport Focus. 2013
[12] TOC Index shows performance of TOC against the sector as a percentage (e.g. if TOC score is equal to sector score the TOC Index would be 100%. If it is 102% the performance is better).
- five points or more above sector average
- five points or more below sector average