Research article
Open Access

Development of an individual assessment instrument for critical care nursing students

Janet Mattsson[1], Lena Stevens[2]

Institution: 1. Red Cross University College, 2. Red Cross University College,
Corresponding Author: Dr Janet Mattsson [email protected] [email protected]
Categories: Assessment, Students/Trainees, Postgraduate

Abstract

Critical care nurses need to possess theoretical knowledge, advanced skills as well as competencies and capabilities to care for critically ill patients in the challenging and fast changing environment of intensive care. In order to assess performance and learning of the critical care nursing students in the clinical arena, a structured process enabling college faculty, clinical educators and students to work towards the same goals and learning outcomes is of outmost importance. In this study an action research method was used to develop an assessment instrument in a collaborative effort between faculty, clinical educators and students. An instrument was developed and tested at several clinical sites during a 1 ½ year period. Interviews were then conducted with expert focus groups and students about the ease and feasibility of the instrument. Four themes emerged during the analysis of the interviews; clarity, helping me, arranging and timeliness. The analysis further revealed positive opinions about the structure, content and usability of the instrument. We conclude the instrument helps in both assessing student performance and in revealing knowledge-gaps for students in the critical care nursing program.

Keywords: , Post-graduate, Clinical learning, Assessment

Introduction

The World Health Organization (WHO, 2004) has stated that “stronger emphasis should be placed on translating knowledge into action to improve public health by bridging the gap of what is known and what is actually done” (WHO, 2004, p. V). Reports also show that 30% to 40 % of all patients do not receive health care based on current relevant knowledge, and as many as 20% to 25% of all patients receive direct harmful or unnecessary care (Grol & Grimshaw, 2003). These statements high-lights the needs of a rigorous and evidence-based clinical assessment process which connects theory with practice and supports transition of knowledge from one context to another to ensure that health care professionals, including critical care specialist nursing students, upon graduation have reached a satisfactory level of proficiency and possess the competencies necessary to function as independent practitioners.

Critical care education in Sweden

The preparation to become a critical care registered nurse in Sweden involves post-graduate studies, where in most institutions, the student receives both a professional degree (critical care specialty nurse) and an academic degree (one-year masters’ degree in nursing). Subsequently the programs build both on theoretical as well as practical learning opportunities. Programs offered can involve full-time studies or part-time studies depending on the school and the choice of the student. Completion of the program renders a total of 60 credits out of which 15 credits is comprised of a masters’ thesis within the subject critical care nursing. All programs, as mentioned above, include theoretical education integrated with clinical rotations, differing in length depending on the specific program curriculum. The combination of theoretical learning and clinical learning provides a specific opportunity for enhanced learning and renders the students possibilities to apply their new knowledge in its’ natural socio-cultural context.

In Sweden, faculty is not present on-site during the clinical rotations due to legal restrictions and subsequently are not directly able to observe and evaluate the transition of knowledge expected to occur during the students’ clinical rotation. Close collaboration and clear communication between faculty and clinical educators is in other words of outmost importance to ensure high quality student learning.

During the clinical rotations at the particular site in this study, students are followed by a clinical educator and a personal preceptor, both employed by the hospital.

The concept of learning in this study is viewed as proposed by Illeris (2009) as being constructivist in nature, which can be understood as learning taking place in a collaboration between one self, others and the surrounding context. In this way the learning can be viewed as constructed in dynamic interaction with the physical as well as the social learning environment. Learning is, as highlighted by Stalhem-Smith (1998) and Schunk (2012), not something objective that is only transmitted from teacher to student. This is an important aspect to consider when designing learning opportunities and learning outcomes for students in a practical as well as theoretical education. As described by Illeris (2009), several conditions are involved in learning and will actively influence the students´ learning process. For instance, the students´ learning is dependent on the application of his´ or hers own external and internal conditions. From these influences the learner builds actively, or constructs, learning as mental structures (Illeris, 2003). But need to have learned the competencies necessary to function as independent practitioners upon graduation.   

Competency in the critical care field

Competence is a complex concept and there are a number of definitions available. Illeris (2013) argues that the concept of competence often is broad and open as well as weekly defined. Epstein and Hundert (2002), propose a broad definition viewing competence as “the habitual and judicious use of communication, knowledge, technical skills, clinical reasoning, emotions, values and reflection in daily practice for the benefit of the individual and community being served”.  Cowan, Norman and Coopamah (2007) argue for a holistic definition of competence for the nursing profession as a combination of knowledge, performance, skills and attitude required for becoming successful. Miller, Hoggan and Pringle (1988) on the other hand suggested competence to be divided into two different significances: the first is competence as performance e.g. how well we perform and function, and the second is competence as a psychological construct which refers to the ability to integrate cognitive, affective and psychomotor skills. The Canadian Nurses’ Association integrate both these latter aspects when defining competency as “the ongoing ability of a nurse to integrate and apply knowledge, skills, judgement and personal attributes required to practice safely and ethically in a designed role or setting” (CNA 2000). This definition implies a constant dynamic environment where the nurse needs to interpret and adapt to unique situations. Roberts (2011) even compares assessment of nursing practice to assessment of performing arts, as it is fluid, never the same twice and the nurse should be able to adapt to the specific patients’ unique situation. Describing a similar view, Fraser and Greenhalgh (2001) adds the concept capability as an extension of competency when they define competency as “what individuals know or are able to do in terms of knowledge, skills and attitude” and capability as “the extent to which individuals can adapt to change, generate new knowledge and continue to improve performance.” Using Fraser and Greenhalg´s definition as point of departure, it appears the critical care student-nurse should possess both competencies and capabilities as well as be able to transfer knowledge between contexts in order to be successful in the ever-changing environment of critical care.

Competencies for critical care nurses as described by the European Federation of Critical Care Nursing Associations (EfCCNa) and the Swedish Association for Critical Care and Anesthesia Nurses (AnIva), is a reflection of an acceptable level of knowledge and clinical skills the entry-level critical care nurse is expected to possess in order to deliver safe and high-quality care to the critical care patient.  In addition to these specific competencies for critical care nurses, the Higher Education Ordinance in Sweden (Högskoleförordningen SFS 1993:100) has developed requirements and goals for post-graduate specialty nursing programs in general which also need to be met for successful graduation. Despite the differences in the definitions of competence it appears assessment of many of the competencies and the capabilities we strive for can only be carried out and assessed in the real setting, and subsequently a thorough and structured assessment with ensuing feed-back on performance during clinical rotations, becomes a very important factor for outcome and the students’ learning.

Assessment of competence and capability

The aim of the critical care nursing program is to facilitate the students development of professional competence, which comprises the abilities and capabilities of the person in relation to situation and context in practice (Camelo, Henriques, & Angerami, 2013).

All critical care nursing programs in Sweden integrate theoretical didactic education with clinical rotations. The final grade received for each course encompasses a summary of grades on all written and verbal exams, as well as the grade based on the assessment of performance during the clinical rotation.

The clinical rotation grade requires, in other words, just as a secure and fair evaluation-process as the theoretical evaluations and exams.

Zasadny and Bull (2015) describe the assessment of competence as an interpretive act at the same time as they state the importance of accurate assessment.  Although learning objectives are stated in the syllabus, clinical educators, preceptors and students all bring different prior experiences and personalities along, which can cause confusion and discrepancies when interpreting the learning objectives. The preceptors’ role become very important, since they can enhance or hinder learning to take place in the clinical rotation (Mattsson, Forsner & Bolander-Laksov, 2014). The preceptors´ approach to the student can be viewed as key to enable the student´s ability to integrate and apply theoretical knowledge into the practice setting. It is imperative that all involved are clear about goals and expectations and work together to reach a fair assessment.
In order to facilitate interpretation of the learning objectives, to clarify expected outcomes and related criteria , to strengthen the quality of the clinical assessment-process and to guide the preceptors´ understanding of the outcomes,  it is suggested that an instrument or a tool is used (Kapborg & Berertö, 2002).  An additional concept to include in the assessment of clinical performance is its’ implication for future learning for the student. The document or form used should according to Epstein and Humbert (2009) “provide guidance and support to address learning needs”. The aim of this study was to develop and evaluate a new individualized instrument that helps to uncover individual knowledge-gaps at the same time as it reflects the general learning objectives, competencies and capabilities for critical care nursing. The instrument also needs to serve as a reliable guide when determining final grades for the course. 

Method

This study is based on the constructivistisc assumption that the findings is co-created by the researcher and the participants in the study and the sociocultural perspective, meaning knowledge is seen as a creation in interaction with the subjects and the context. This research, which involves both the researchers and the participants in close collaboration, is a central feature in action research (Hart & Bond, 1995). Using this research strategy we aimed to disclose the gap between the real and ideal and uncover the area of improvement and develop a new assessment instrument within the specialist nursing education

Permission to conduct the study has been requested and received by the program director of the critical care nursing program where the students were enrolled and by the head nurses at the intensive care wards were the clinical educational leaders and the preceptors worked. According to Swedish law and the Act on Ethical Review of Research Involving Humans (SFS 2003: 460) and the Personal Data Act (SFS 1998: 204) an ethical review were not needed, as the informants were all 18 years of age and able to accept or decline participation in the study. Informed consent was obtained from all informants after they had received information about the study both orally and in writing. The informants were also informed that participation was voluntary and that they at any time could terminate participation in the study without any questions being asked. 

Design

The design of this study builds on the cyclical process of action described by Susman and Evered (1978). It is a five step process that encompasses diagnosing, action planning, action taking, evaluating and specifying learning. What is more, in this study the authors added a sixth step, a final evaluation one year after the implementation of the new instrument. Before moving into the diagnostic phase a client-system interface was established. In this study it meant establishing interaction with those we, the authors and college faculty, intended to collaborate with. This approach is described by O´Brien (1991) and involves meetings and introductions with key persons involved in the project. For the authors this was of particular interest since a change in the curriculum at the Red Cross University College critical care program had recently occurred. This change aimed to strengthen the student-centered learning (SCL) and self-directed learning (SDL) and required clarification of the learning objectives and a move towards supporting the students to uncover their own learning needs in relation to learning outcomes and to a future professional role. This change called for an improved assessment process and a new instrument for the clinical rotations in the critical care program. The instrument needed to reflect competencies and learning objectives as well as progression of learning throughout the program. The students’ expected deepening of knowledge from beginner to advanced as described by the Bologna process (European Comission) also needed to be visible. The Bologna process is a collective effort of public authorities, universities, teachers, and students, together with international organizations, including the European Commission, to strengthen quality assurance through higher education in the European Union. It further describes a need for clear evidence of progression throughout the curricula of higher education.

In the first step diagnosing, we aimed to uncover the gap between the “ideal and the real”. This can be done in various ways and the choice of data collection is dependent on the feasibility of the method to address the problem as well as consideration of access to the field of interest. In this study two of the faculty members from the critical care program met with three key persons (clinical educational leaders) and established an agreement to form an expert focus group and to engage in collaborative interactions in developing a new instrument for assessment during clinical rotations. All clinical educators were previously familiar with the lay-out of the critical care program and the learning objectives for the courses. All had extensive background in critical care nursing and several years´ experience as clinical educators. The discussions with the expert focus group revolved around content, feasibility of use and lay-out of the instrument. After two conducted focus group interviews it became clear through analysis of the discussions that the new instrument would serve both as a formative and summative assessment and it would also form as a base for developing a plan for further learning. This was important as student-centered learning (SCL) and self-directed learning (SDL) had been implemented as a part of a pedagogical framework in the program. The instrument needed to clearly uncover any individual knowledge-gaps and guide the student and the preceptor towards necessary means for the unique student to lessen his or hers knowledge-gap and to meet the learning objectives. The student, in accordance with SDL, is expected to have owner-ship of both the assessment processes and the actual instrument. The instrument also needed to serve as a reliable guide when determining final grades for the course.  The assessment process and the instrument used in the past required completion at two times during the students’ clinical rotation; around half-time of the rotation and at the completion.  The authors felt this was a concept well in accordance with using both formative and summative evaluation and as it had worked to everyone’s satisfaction in the past we decided to continue with the two-step process of clinical assessment.

In the second step, action planning, two faculty members from the Red Cross University College conducted a search for instruments currently used specifically in critical care specialty nursing programs, both nationally and internationally. This yielded the SPECT instrument developed by Gill et al in Australia (2014). SPECT uses domains of knowledge and skill competencies reflecting many of the competencies described by EfCCNa and AnIva. Another strength of the SPECT instrument is its’ comprehensive content reflecting components such as socio-emotional and communication skills developed on the basis of interviews with healthcare consumers (Gill et al., 2013). The importance of communication skills with patients and families, echoed the findings of the CoBaTrICE collaboration (2007). Face and content validity was also tested of the SPECT instrument and it appears, according to the authors, to have clinical feasibility.  After contact with Gill et al. an agreement was reached where the SPECT instrument would form a basis for the development of our new assessment instrument.  The domains were revised to fit the learning objectives and the requirements of the Swedish system and specific socio-cultural context.

The two faculty members from the critical care program developed a pilot of an assessment instrument according to the requirements and objectives described above and with the SPECT instrument as a base. Collaboration with the expert focus group played a significant role in this development especially as the group represented different critical care units covering different ages and critical care specialties. The expert group was invited to evaluate and discuss the developed pilot and revisions were made after the expert focus group meeting.

Since the critical care program at the Red Cross University College is divided in to two clinical courses, each with a six week long clinical rotation, the learning objectives need to reflect a deepening of knowledge and a progression of skills during these two rotations. The assessment instrument needed to make this progression visible. Blooms taxonomy was used to distinguish clinical rotation 1 and clinical rotation 2 although domains and competencies remained the same. For example the competency pertaining to evaluation of blood-gases and other laboratory data reads for clinical rotation 1: …with support from the preceptor discusses blood-gas results….. The same competency for clinical rotation 2 reads …. Independently analyzes blood-gas results….

During the third step, action taking, the instrument was trialed at four different critical care units during the first clinical rotation of seven students.. The units that were chosen included both specialty critical care units (i.e. pediatric and neurosurgery) as well as two regular ICUs where both surgical and medical adult critical care patients were cared for. In order to facilitate use of the instrument and to evaluate preceptors’ and students’ responses in using the new instrument, faculty was present during the half-time meetings.

This led in to the fourth step, evaluation, Preceptors and students were asked semi-structured, open-ended questions relating to how easy the instrument was to understand and its’ clinical feasibility and content. Comments were documented by faculty and presented at the next expert focus group meeting with the clinical educators. After discussions at the meeting and after analysis of the data collected during this phase, additional revisions were made. This revision resulted in a final version of the instrument which was presented at a meeting attended by all faculty, nurse-managers and clinical educators involved with the program. 
During the following step, specifying learning in the clinical rotation, all students (n= 18) and preceptors within the current critical care course used the instrument.  The students received a brief explanation on how to use the instrument before leaving the institution for their clinical rotation, and the clinical educators instructed all preceptors on the use of the instrument.  Faculty were again present at the half-time meetings, to answer any questions preceptors and students might have and to receive verbal feed-back from students and preceptors. As in the previous semester, open-ended semi-structured questions were used pertaining to the instruments’ face validity and clinical feasibility. Some minor revisions were made as a conclusion of the views and opinions relayed by students, preceptors and the expert-group. For example: The wording of the competency item reflecting teaching in the clinical setting was broadened to encompass not only patients but next of kin and/or co-workers.  On the final page of the instrument a line was also added where student and preceptor after the midterm discussion, in writing, clarify the goals to work towards during the remainder of the clinical rotation and to develop and document a plan on how to achieve these goals.

After having trialed the instrument both preceptors and the two student groups expressed satisfaction with the ease of use of the instrument. They felt the domains and competencies were easy to understand and they also felt the domains clearly reflected course objectives as well as current clinical practice.

As a final evaluation and a sixth step in the action research process, an evaluation one year after the implementation of the new instrument were conducted. The three clinical educators who had formed the expert focus group and had provided feed-back throughout the development and implementation of the instrument were gathered for a group-interview. The questions asked were:  What are your thoughts after using the new instrument as an assessment tool?   Was the instrument helpful in identifying the students’ knowledge gaps?   Was the instrument helpful in identifying a plan to fill those knowledge gaps and reaching the goals?  Did the instrument reflect a reasonable knowledge and performance level?

During this step a new group of students (n 13) were introduced to the new instrument before starting their first clinical rotation. The students were also interviewed in four smaller groups about their experiences of being a student and using the instrument. The following questions were asked: What are your thoughts after using the new instrument as a learning tool?   Was the instrument helpful in identifying your knowledge gaps?   Was the instrument helpful in supporting ways to fill those knowledge gaps and reach the goals?  Was the instrument useful in identifying a reasonable knowledge- and performance level for your clinical rotation?  All the focus group interviews were taped, transcribed verbatim and then analyzed thematically together as a whole. This analyze did not lead to any new changes of the instrument.

Results

During the final analyze where the collected data from the expert focus-group as well as from the four student groups were analyzed the following themes emerged: Clarity, Helping me, Arranging and Timeliness. 

Clarity

After having trialed the instrument both preceptors and the student groups expressed satisfaction with the ease of use of the instrument. They felt the domains and competencies were easy to understand and also expressed the domains clearly reflected course objectives as well as current clinical practice. The following excerpts highlights this theme: 

“Using it helped our preceptors to understand the learning goals the schools has for the clinical rotation.”

Both groups also expressed a consensus regarding the meaning of the words used to clarify learning goals in the instrument.

Furthermore the groups conveyed a cohesive opinion that all essential context of a critical care nurse’s practice was evident in the instrument; assessment and management of critically ill patients, communication, patient safety, team work and ethical considerations

Helping me

This theme conveyed how the instrument was helpful in identifying knowledge gaps and prioritizing learning needs as well as aiding the students when formulating their thoughts on how they would like their preceptor to support their learning. The following excerpts highlights this theme:

”When we talked about policies and guidelines the instrument clearly helped in finding and defining this specific students´ knowledge gaps.”

“The structure helped to define the knowledge-gaps and then summarize them at the end and form a plan for how to fill those gaps.”

Arranging

The expert-group and the student groups as well as the preceptors’ expressed a positive view on the lay-out of the instrument. The expert-group felt it reflected both a formative and a summative assessment where progression towards proficiency, or lack thereof, was clearly visible. The student group conveyed a visible strong emphasis on being responsible for and owning their own knowledge development when actively using the instrument during the clinical rotation. The preceptors conveyed a feeling of relief as they found the instrument helpful in continuously motivating and challenging the student to learn even though the student had reached the learning goals. The previous assessment-instrument used a Likert scale to depict progression and this became, according to the clinical educators, often biased and interpreted differently by different preceptors. The following excerpts highlights this theme:

“The instruments gives everyone a minimum level to aspire to- it sets the bar at the same time as it reflects our national competencies for critical care nurses

The students are clearly motivated to see what else they need to learn. For example this one student who was very good; after the half-time meeting we were able to identify other areas where he could bea challenged and continue to grow.

Timeliness

In this theme the time frame emerged. The instrument was viewed as helpful for the preceptors and students when keeping track of the time they had at their disposal to learn during the clinical rotation, and how to prioritize learning goals during the given time.  The instrument became a time saver and was easy to understand even if there often is limited time during the clinical rotation to sit down and discuss learning goals in a structured way. The following excerpts highlights this:

“Even when more than one preceptor was involved, it seemed the instrument helped to keep assessments uniform.”

“The time allotted was perfect. Having a limited time for the discussion helps everyone to prioritize.”  

Discussion

The learning process during clinical rotations for critical care nursing students need guidance and opportunity for reflection together with experienced mentors.  The situation at our program-location do not allow faculty access to the clinical setting and the assessment of knowledge-transfer and progression towards stated learning outcomes, is instead supervised by clinical educators and preceptors. It is therefore of outmost importance all involved have a coherent view of competencies and learning-outcomes.  This coherence was explicit in the interviews with the expert-group, with the preceptors and with the students. It became evident they all feel they have a common language, understanding and interpretation of the domains and competencies. With that in mind it is our expectation that the assessments can be carried out independently, without faculty presence, with the help of the instrument.

There is, however, always possibilities for personal interpretations which can impact assessment and discussions.

The dependent relationship to the program and to faculty of, in particular the students, also needs to be taken into consideration. The positive opinions could reflect a desire for agreement in order to obtain a favourable assessment and a passing grade.

This study was carried out with 18 students at a smaller college in one geographical location. Although EfCCNa and AnIva competencies have been developed for the european, and AnIVA especially for the swedish, critical care nurse, other programs might use the competencies differently and formulate competencies according to their specific learning objectives.  Subsequently the results from this particular study can only be applied in the setting where it was performed.

The instructions for using the instrument suggest completion of two separate documents prior to the meeting. One document is completed by the student and the other by the preceptor. The two documents are then compared and discussed during the meeting. This process reflects the pedagogical view of the program, self-directed learning, as it engages the students and promotes their involvement and responsibility for their own learning. Deeper discussions between students and preceptor are also encouraged when the two documents are compared and discussed. The instrument document was, however, in some instances completed by the student and the preceptor together during the meeting. This could lead to a cohesiveness and agreement between student and preceptor of views that not necessarily was the fact from the beginning.

 In our study faculty was present at the meetings with students and preceptors. This was due to the instrument being new and never previously used and to explain and answer any questions that would arise. The presence of faculty also has a possibility to impact answers and the results of this study. Faculty presence is not planned for the future and the next step will be for students and preceptors to use this instrument on their own during the students’ clinical rotations. This change can have an impact on the use of the document and the assessment process as a whole, if misinterpretations or disagreements on content occur. An additional evaluation of the document should be carried out after its´ use without faculty presence to evaluate if further specifications and clarification of the competencies and language are needed.

It would further be of interest to test and evaluate the instrument in other critical-care clinical settings that are connected to other college-programs. This would enable testing of the competencies and domains where the programs specific learning objectives and the specific socio-cultural variations would be reflected.

Clinical implications

The critical care clinical arena is becoming increasingly complex. It is of outmost importance to educate nurses caring for the most critically ill patients to practice, not only safely, but with a solid and deep understanding of all processes and behaviors that will surround them. During critical care nursing students’ clinical rotations transfer of knowledge from theory to clinical practice is expected. For this to occur the student will need support from faculty as well as fromclinical educators and preceptors. The need for a comprehensive and structured, yet clinically feasible assessment is vital to support critical care nursing students in their journey towards professional competency. An assessment instrument can play a vital role in this process and help to develop a safe and knowledgeable practitioner. The instrument can guide preceptors and students through different domains and competencies specific for critical care, as well as assist them in finding the students’ individual knowledge-gaps and encourage a discussion between preceptor and student on how to overcome these gaps.

The guided discussions and reflections between preceptor and students which support the student in his or hers self-assessment, is key in self-directed learning. The skills of self-directed learning is furthermore an asset for the student in their future professional role. In our high-tech society information and knowledge-sharing happens fast and individuals need to take personal responsibility for keeping abreast of new developments and having a structured and efficient way of bridging knowledge-gaps.

Finally, the instrument could also serve as a guide in developing a clinical final examination for critical care nursing students. The domains and the competencies in the above described instruments reflect much of what can be expected knowledge and skill level for the graduating student.  The question of a final clinical examination is discussed by many schools and also by the Swedish Association of Anesthesia and Critical care nurses, AnIVA. The advantages of a final clinical examination are many, and if used as a national standard would help to benchmark the knowledge and skill level of an entry-level critical care nurse. This instrument could form a base for a development of a final clinical exam.

Take Home Messages

Notes On Contributors

Janet Mattsson RN, PhD. Programme director specialist nursing education in critical care. Has a special interest in reserching clinical learning, mostly within the pediatric intensive care unit. 

Lena Stevens RN, MSn. Has longtime experience from the intensive care context at different positions. 

Acknowledgements

Bibliography/References

AnIva (2014) Kompetensbeskrivning (Description of Competencis) Riksföreningen för Anestesi & Intensivvård and SSF, Sweden, http://www.aniva.se/wp-content/uploads/2014/12/kompetensbeskrivning_intensivvard.pdf Retrieved December 2015

Canadian Nursing Association (2004) Position statement https://www.cna-aiic.ca/~/media/cna/page-content/pdf-fr/ps77_promoting_competence_e.pdf?la=en Retrieved December 2015   

Camelo, S., Henriques, H., & Angerami, E., L,S. (2013). Professional Competence: The building of concepts and strategies developed by health services and implications for nursing. Text Context Nursing, 22(2), 552-560.

http://dx.doi.org/10.1590/S0104-07072013000200034  

Cowan D.T.,Norman I.,Coopamah V.P. (2007). Competence in nursing practice: a controversial concept- A focused review of literature Accident and Emergency Nursing 15, 20-26

http://dx.doi.org/10.1016/j.aaen.2006.11.002  

Epstein R.M. Hundert E.M. (2002). Defining and Assessing Professional Competence. JAMA, 287(2). 226-235

http://dx.doi.org/10.1001/jama.287.2.226  

European Commission on Education and Training. The Bologna Process and the European Higher Education Area http://ec.europa.eu/education/policy/higher-education/bologna-process_en.htm Retrieved December 2015

European Federation of Critical Care Nursing Associations (2013). EfCCNa Competencies for European Critical Care Nurses. Retrieved from http://www.efccna.org/ images/stories/ publication/competencies_cc.pdf Retrieved December 2015  

Fraser S.W, Greenhalgh T. (2001). Coping with complexity: educating for capability. BMJ Vol.323, 799-803

http://dx.doi.org/10.1136/bmj.323.7316.799

Gill, F., Gavin L., Grech C., Boldy D. Latour J.(2014). Developing and Testing the Standard of Practice and Evaluation of Critical Care Nursing Tool (SPECT) for Critical Care Nursing Practice. J Cont Ed in Nsg. 45, (7)

http://dx.doi.org/10.3928/00220124-20140620-02

Gill, F., Leslie, G.,Grech, C, Latour, J. (2013). Health consumers' experiences in Australian critical care units postgraduate nurse education implications. Nursing in critical care, 18, 93-102

http://dx.doi.org/10.1111/j.1478-5153.2012.00543.x

Grol, R., and Grimshaw, J., (2003). From best evidence to best practice: effective implementation of change in patients' care. The Lancet 362 (11), 1225–1230

http://dx.doi.org/10.1016/S0140-6736(03)14546-1

Hart, E., and Bond, M. (1995). Action research for health and social care: A guide to practice. Buckingham: Open University Press.   

European Commision on Education and Training. The Bologna Process and the European Higher Education Area http://ec.europa.eu/education/policy/higher-education/bologna-process_en.htm Retrieved December 2015  

Illeris, K. (2003). Towards a contemporary and comprehensive theory of learning. International Journal of Lifelong Education, 22(4), 396-406

http://dx.doi.org/10.1080/02601370304837   

Illeris, K. (2009) (Ed.) Contemporary theories of learning theorists-In their own words. Oxon: Routledge  

Illeris, K. (2013). Kompetens: [vad, varför, hur]. Competence (what, why, how) (1:st Ed) Lund: Studentlitteratur AB

Mattson, J, Forsner, M.Bolander-Laksov, K (2014). Facilitation of learning in specialist nursing training in the PICU: the supervisors' concerns in the learning environment. J of Nursing Education and Practice 4. No 12

http://dx.doi.org/10.5430/jnep.v4n12p34   

Kapborg, I., & Berterö, C. (2002). Critiquing Bachelor Candidates' theses: are the criteria useful? International Nursing Review, 49,122-128

http://dx.doi.org/10.1046/j.1466-7657.2002.00123.x   

Miller, C, Hoggan, J, Pringle, S, West, G. (1993). Credit where credit's due. in: Report of the Accreditation of Work-based Learning Project. Scottish Vocational Education Council (SCOTVEC), Glasgow; 1988 (As cited in Girot EA 1993).   

O´Brien, B.B. (1991). Nursing Praxis: An exploration of changing nursing practice in the evolution of an embryonic nursing unit. Melbourne: Deakin University.

http://dx.doi.org/10.1097/00152193-199101000-00022

Roberts D. (2011). Grading the performance of clinical skills: Lessons to be learned from the performing arts. Nurse Education Today 31 (2011), 607-610

http://dx.doi.org/10.1016/j.nedt.2010.10.017

SFS 1998: 204. Personal Data Act. Stockholm: Ministry of Justice. Retrieved November 13 from http://www.riksdagen.se/sv/Dokument- Legislation / Laws / Svenskforfattningssamling / Personal Data Act-1998204_sfs-1998-204 / Retrieved December 2015  

SFS 2003: 460. Act on ethical review of research involving humans. Stockholm: Ministry of Education. Retrieved November 13 from http://www.riksdagen.se/sv/Dokument- Legislation / Laws / Svenskforfattningssamling / Law-2003460-of-etikprovning_sfs-2003-460 / Retrieved December 2015  

SFS 1993.100 Higher Education Ordinance in Sweden, Ministry of Education http://www.riksdagen.se/sv/dokument-lagar/dokument/svensk-forfattningssamling/hogskoleforordning-1993100_sfs-1993-100 Retrieved December 2015

Schunk D. (2012) Learning Theories: an educational perspective Boston: Pierson  

Stalheim-Smith, A. (1998). Focusing on active, meaningful learning IDEA paper No.34 Kansas State University Retrieved January 2016 from ERIC eric.ed.gov   

Susman, G.I., & Evered, R.D. (1978). An Assessment of the Scientific Merits of Action Research. Administrative Science Quarterly 23(4): 582-603

http://dx.doi.org/10.2307/2392581  

The CoBaTrICE collaboration (2007). The views of patients and relatives of what makes a good intensivist: a European survey. Intensive care medicine,33: 1913-1920.

http://dx.doi.org/10.1007/s00134-007-0799-4  

World Health Organization, (2004). World Report on Knowledge for Better Health http://www.who.int/rpc/meetings/wr2004/en/index2.html Retrieved December 2015   

Zasadny, M.F.,Bull R.M. (2015). Assessing competence in undergraduate nursing students: the amalgamated Students assessment in Practice model. Nurse Education in Practice Nurse Education in Practice 15, 126-133

http://dx.doi.org/10.1016/j.nepr.2015.01.003

Appendices

There are no conflicts of interest.

Please Login or Register an Account before submitting a Review

Reviews

Richard Hays - (04/08/2016) Panel Member Icon
/
This is a difficult paper to review because it is not clear what was done, why it was done, or what the outcome was. The title is sounds interesting but is not matched by the rest of the paper, much of which describes the importance of critical care nursing, an assertion that few would argue with. The assessment form used appears rather simple, with just four categories (independently analyse patient data, independently analyses patient according to a plan, reports findings appropriately and documents appropriately). The first two appear to overlap substantially and may include several competencies lumped together. Any rating requires high level, rather global judgments by experienced critical care nurses. The mid-term/end or placement design is appropriate. However, the findings of the research are that assessments need clarity, to be helpful, to be arranged correctly (Layout?) and to be timely. These are all process issues that again are difficult to argue with,and may well be important aspects of an evaluation form, but they are then not related back to the instrument design and nothing is said about the specific topic content for what is said to be a highly technically competent position. This is either an unusual evaluation or a poorly written report. .As a result it is rather difficult to work out what this paper contributes. I am not sure if the issue is related to not writing in one's first language, but my reading of this paper strengthens the view that papers should be read for clarity by several people fluent in (in this case, English) before submission.