Meetings

ARAC (24-01) Paper 12 – effectiveness survey and timetable

13.1  The Chair requested that Committee members consider this out of committee and share any comments with the Clerking team.

ARAC (22-06) Paper 11 – Report on ARAC Effectiveness Survey 2022

15.1 The Chair thanked the Clerking team for producing the detailed report on their analysis of the survey results. He was pleased with the scores which reinforced his views on the ongoing effectiveness of the Committee. He thanked everyone for completing the survey and in particular for the helpful comments provided.

ARAC (22-03) Paper 9 – cover paper - survey

ARAC (22-03) Paper 9 – revised survey with additional questions

10.1 The Committee praised Kathryn Hughes for her analysis of a new National Audit Office effectiveness tool and the extraction of usable material to build into the forthcoming survey, as presented in the paper. The content and timetable were agreed. The Clerking team would issue the updated survey in July 2022, with a view to presenting the results to the Committee in November. The Chair emphasised the importance of sufficient responses to provide meaningful information. Kathryn also emphasised the importance of backing up the scores with comments which would help inform evaluation of the results.

ARAC (03-20) Paper 9 – Summary of results from the 2020 effectiveness survey

9.1     The Chair introduced the paper, which provided a summary and analysis of the latest Audit and Risk Assurance Committee Effectiveness Survey.

9.2     The Committee heard that results were positive across each of the five areas measured, namely: Composition, Establishment and Duties; Administrative Arrangements; Internal Control and Risk Management; The Role of Audit; and Annual Accounts.

9.3     Following discussion, the following comments were raised for the Chair to address with the clerking team:

•        improving ARAC’s awareness of Commission work, including sharing the Commission’s work programme with ARAC;

•        incorporating flexible feedback into future effectiveness surveys; and

•        a review of work from the current Senedd term to inform the Committee’s work programme for the next Senedd. The Chair would arrange a separate meeting with members to review the work of the Committee before the Autumn meeting.

9.4     The Committee thanked the officials for the thorough analysis of the results.

Action

•        (9.4) The Chair to discuss feedback from survey results with the clerking team.

•        (9.4) Share Commission’s work programme with ARAC members.

ACARAC (01-18) Paper 7 – Committee Effectiveness Survey

6         

7         

7.1        Kathryn Hughes presented a favourable set of survey results to the Committee. This survey provided data that was broadly comparable with the 2015 survey, despite some revisions and additional questions. 

7.2        Kathryn had highlighted some areas of improvement based on the comments provided by respondents. The only formal action which the Committee identified was to consider making better use of the July meeting, which was currently used to consider finalisation of the accounts. This could include considering the outcomes of annual end of term strategic planning meetings which were being introduced by the Commission or a deeper analysis of risk or performance information.

7.3        Overall, the Chair was pleased with the positive results and congratulated ACARAC members and officials.  A revised forward work programme taking on board these suggestions would be circulated during the summer recess.     

Actions

-      Secretariat to work with officials and Chair to determine what items could be presented for discussion at the July meeting. 

ACARAC (05-17) Paper 13 – Committee’s Effectiveness Survey

ACARAC (05-17) Paper 13 – Annex A - Effectiveness Survey Questionnaire

3      

4      

5      

6      

7      

8      

9      

10      

10.1     The Committee agreed to the questions contained within the survey which would be circulated in December.  After some internal analysis, the results would be presented to the Committee in February. 

Actions

-      Committee members and attendees to complete the ACARAC effectiveness survey by 5 January 2018.

ACARAC (03-17) Paper 17 – Previous survey questions (2015) 

8      

9      

10      

11      

12      

13      

14      

15      

16      

16.1     The Committee agreed the timetable for the next survey, which would be issued in November 2017 and report in February 2018.  Committee members agreed to send any suggested revisions to the survey questions to the Clerking team by August.

Action

-         ACARAC members to send suggestions for changes to the survey questions to the Clerking team.

ACARAC (32) Paper 10 – survey results 2016 action plan

8.1        The Chair thanked the team for this update on progress against the action plan and noted the on-going work to review the key performance indicators.    

Dave Tosh presented a review of the approach to capturing, monitoring and tracking the efficiency and effectiveness of the organisation, following a request from the Chief Executive and ACARAC. The outcome would be presented to ACARAC at its June meeting.

It was agreed to include a section on the work on performance management.

ACARAC (31) Paper 10 - ACARAC Effectiveness Survey – cover paper

ACARAC (31) Paper 11 - Effectiveness Survey 2015 - Report

8.1        The Chair congratulated the clerking team on administering and analysing the effectiveness survey internally, resulting in a saving of approximately £3,000. 

8.2        The discussion on the results concentrated on the following areas identified for further strengthening:

·                the Committee’s interaction with the Assembly Commission and Commissioners;

·                consideration of how ACARAC work integrates with the Commission's wider performance management;

·                monitoring the risk profile and progress of change programmes and projects; and

·                clarity on the role of ACARAC in relation to the approval of the accounts and learning lessons from the 2014-15 audit.

8.3        It was agreed that the regular updates on the work of the Commission would continue to be circulated to committee members.  Depending on the make-up of the new Commission (post the election in May) an introductory meeting could be arranged with the new committee member.  Members also suggested a structured induction programme be established for the new member and for reference to be made to the role of ACARAC in induction for all new Commissioners.  The Clerking team would liaise with the Members' Professional Development team. 

8.4        The Committee also welcomed the suggestion that they should review the Key Performance Indicators (KPI) report.  The refreshed KPI report would include a summary of the status of change programmes and projects.   

8.5        Overall, the Chair was extremely pleased with the process and the very positive results, and congratulated his fellow ACARAC members.  An action plan would be circulated shortly. 

Action

-        Clerking team to draft and circulate an action plan.

9.1        The Chair led a discussion on the future effectiveness survey which was a requirement of the HMT handbook.  The last survey was completed in May 2014, with the results presented to the Committee in June 2014.  An action plan captured the areas of concern for the Chair, and all actions were now complete. 

9.2        The Committee agreed to follow the same process and complete the survey by mid-December with results being presented to the Committee in February.

Action

-        Clerking team to liaise with EAG/WAO to ensure survey is completed and results analysed by the next meeting.

9.1        The Chair updated the Committee on the action plan.  He had attended a Commission meeting in July and would discuss with Claire future engagement opportunities.      

9.2        Eric and Gareth agreed to look into WAO training options for Audit Committee and circulate any relevant information to members.

Actions

-                   Gareth Watts and Eric Gregory to discuss the Committee’s collective consideration of the new NAO/HM Treasury guidance.

-                   Eric Gregory and Claire Clancy to discuss opportunities for ACARAC members to liaise with Commission teams.