PDF Independent evaluation of the Frontline pilot

Independent evaluation of the Frontline pilot

Research report March 2016

Nina Maxwell, Jonathan Scourfield, Meng Le Zhang, Teresa de Villiers, Mark Hadfield, Paul Kinnersley, Liz Metcalf, Andy Pithouse and Sadia Tayyaba

Cardiff University

Contents

List of figures

4

List of tables

5

List of abbreviations

6

Acknowledgements

7

Executive Summary

8

Background

8

Evaluation objectives

8

Methods

8

Results

9

Conclusion

10

1.0 Introduction

12

1.1 Entry requirements

12

1.2 Course curricula

14

1.3 Readiness to practice

15

1.4 Step Up to Social Work

16

1.5 Frontline

17

1.6 Programme evaluation

19

2.0 Method

24

2.1 The backgrounds of Frontline participants

24

2.2 The quality of Frontline delivery

24

2.3 The quality of Frontline participants on completion of the programme

28

3.0 Is Frontline successful in attracting high quality graduates?

35

3.1 Comparison of Frontline and students on mainstream programmes (HESA)

36

3.2 Evaluation questionnaire results

44

3.3 Summary of findings

50

4.0 Are the key elements of the Frontline programme being delivered to a high

standard?

52

2

4.1 Inputs and participants' reactions

53

4.2 Mediating factors

75

4.3 Moderating factors

78

4.4 Participants' learning

83

4.5 Outcomes

90

4.6 Summary of findings from case studies

98

5.0 How well does Frontline prepare participants to be outstanding social workers? 102

5.1 Agreeing criteria for assessing practice skills

103

5.2 Simulated practice results for Frontline participants and students on mainstream

programmes

105

5.3 Discussion

117

6.0 Overall discussion and conclusion

119

6.1 Summary of findings

119

6.2 Limitations of the evaluation

121

6.3 Conclusion

122

7.0 References

125

Appendix One: Family interview information sheet

134

Appendix Two: Mapping of Bogo et al. criteria for assessing practice quality against

English frameworks for social work education

135

Appendix Three: Criteria used for simulated practice exercise

136

Appendix Four: Simulated practice information sheet

142

Appendix Five: Reasons for declining participation in simulated practice

145

Appendix Six: Simulated practice case scenarios

147

Appendix Seven: Simulated practice written reflection proforma

151

Appendix Eight: Simulated practice questionnaire

154

Appendix Nine: Recall Days

158

Appendix Ten: Piloting the simulated practice test

159

3

List of figures

Figure 1.1: Evaluation framework ....................................................................................23 Figure 4.1: Main inputs ....................................................................................................52 Figure 4.2: Confidence ratings.........................................................................................95 Figure 4.3: Novice-expert scale - Frontline cohorts one and two in the first few months of placement ........................................................................................................................97 Figure 4.4: Participant novice-expert ratings for Cohort One - T1, T2 and T3 .................98 Figure 4.5: CSW novice-expert rating..............................................................................98

4

List of tables

Table 1.1: Phases of the evaluation.................................................................................22 Table 2.1: Case study respondents .................................................................................28 Table 2.2: Simulated practice assessment criteria, as agreed by Delphi process ...........31 Table 2.3: Recruitment of simulated practice participants ...............................................32 Table 3.1: Demographics of Frontline and HESA students..............................................38 Table 3.2: Socio-economic factors...................................................................................40 Table 3.3: Secondary school attended and UCAS points ................................................44 Table 3.4: HESA entry qualifications ...............................................................................45 Table 3.5: Results from evaluation questionanaire ..........................................................48 Table 3.6: Awareness of Frontline publicity .....................................................................50 Table 4.1: Novice-expert respondents .............................................................................96 Table 5.1: Delphi participants' rating of Bogo et al. criteria for use in UK ......................104 Table 5.2: Characteristics of simulated practice participants .........................................106 Table 5.3: Overall mean scores by participant group.....................................................109 Table 5.4: Rating of practice skills for Scenario 1 (Mother ? `Lisa') ? individual items by participant group ............................................................................................................110 Table 5.5: Rating of practice skills for Scenario 2 (Teenager ? `Jakub') ? individual items by participant group .......................................................................................................111 Table 5.6: Rating of written reflection for Scenario 1 (Mother ? `Lisa') ? individual items by participant group ............................................................................................................112 Table 5.7: Rating of written reflection for Scenario 2 (Teenager ? `Jakub') ? individual items by participant group..............................................................................................113 Table 5.8: Self-efficacy ratings ? individual items by participant group..........................114 Table 5.9: Simulated practice results: Matched samples...............................................116 Table 8.1: Comparison of first and second year students in pilot exercise ....................159

5

 ................
................

In order to avoid copyright disputes, this page is only a partial summary.

Google Online Preview   Download