Adventures in Technology Enhanced Learning @ UoP

Category: Digital Success Plan

WiseFlow – Looking in the mirror with reflective portfolios in WiseFlow

Hey there, fellow exhausted souls!

Can you believe it? We’re finally coming towards the end of the academic year, and boy, has it been a fun ride!  Our WiseFlow pilot has gone from strength to strength as we support academics through a new assessment process.  More importantly, we have successfully run two separate assessments using our innovative approach of using WiseFlow as a reflective portfolio – the first use case of this we know about!  We’ve grown, learned, and potentially discovered an exciting prospect for the future of reflective portfolios at Portsmouth University, so let’s take a moment to reflect on the journey we’ve been on. 

You may have read our previous blog post on “Unlocking the power of WiseFlow: Transforming ePortfolio assessments” where we discussed the possibilities of using WiseFlow as a viable reflective portfolio platform and the benefits a reflective portfolio approach brings.  For students, this helps develop their metacognitive skills and self-awareness as learners over a period of time.  Academics, on the other hand, can use reflective portfolios to assess students’ learning outcomes in a more comprehensive and authentic manner.  This is all part of our wider WiseFlow pilot to provide one integrated assessment platform that serves our current (and future) assessment needs within Portsmouth University, which Mike Wilson spoke to us about recently on our podcast – you can listen here

Teach Well and Research-Informed Teaching

This year we ran two reflective portfolios within WiseFlow as part of our pilot project – to test the water and find out if this was even possible. The first was within our Researched Informed Teaching module, which supports early career academics to apply their learning in educational enhancements into their own contexts, through reflection and innovation.  Students will draw together higher education policy, research methods and educational developments to build students knowledge for their future work.  Secondly, we ran a reflective portfolio in our new level seven Teach Well: Principles to Practice module, which is a professional development route for those in roles related to supporting student learning. Students in this module embark on a pedagogical journey through three pillars of practice for teaching well in higher education, gaining the confidence to critically evaluate learning and design approaches and reflecting on what it means to teach well across different modes of study.  We recently caught up with Maria Hutchinson who runs this module in our podcast series, if you missed this one, you can listen here

We’ve worked closely with these academics and our support teams to develop reflective portfolios for these modules that can be used as a summative assessment vehicle which is both intuitive for learners and versatile enough to encompass a broad range of tools which enable the course learning outcomes to be demonstrated in an engaging and meaningful way.

What the students said…

Following the submission of reflective portfolios into WiseFlow, we sent out a survey to participants to gain their feedback and views.  Some of the headline figures are detailed below…

  • 90% of students found the WiseFlow reflective portfolio easy to navigate
  • 90% of students agreed that a reflective portfolio suited this type of assessment (compared with traditional essay-based assessment methods)
  • 82% of students felt their own students would enjoy using a reflective portfolio in WiseFlow
  • 71% of students enjoyed the interactive assessment methods, such as histograms, voice recorders etc. 
  • We received multiple comments about the clear instructions that were given on how to access and use Wiseflow as well as its reliability and stability as a platform.  Many users also commented positively on the functionality that WiseFlow offered compared to previously used portfolio solutions. 

Students also commented on…

  • If there was a need to add another system to Portsmouth University’s available assessment platforms – “There are too many platforms for submitting the work, Moodle, ePortfolio, WiseFlow, it is really confusing and frustrating that is necessary to learn how to use different platforms for different modules.”
  • The lack of formatting transfer from applications such as Word, when copying and pasting into WiseFlow – “Transfer of formatted MS Word document to WiseFlow could be improved. Currently, the document format is lost during the cut & paste process which then requires more effort to re-format within the WiseFlow portal.”
  • Better integration with Moodle and WiseFlow – “I’d like to see direct access from Moodle”. 

The data presented highlights the positive reception of WiseFlow as a reflective portfolio solution by students. The high percentage of students that recognized the suitability of a reflective portfolio as an assessment method, in comparison to traditional essay-based approaches and praised its usability is a really positive sign. The positive feedback on the interactive assessment methods further emphasizes the adaptability of the question bank in a traditional FlowMulti assessment to be used in an innovative way. 

However, some concerns were raised by students, such as the frustration of managing multiple assessment platforms at the university, indicating a need for better integration. This all links to our Digital Success Plan to (re)design robust assessments to meet the needs of the diverse student population within a blended and connected setting and incorporate a robust specialist end-to-end assessment platform. Our aims in the project were to make it easier for academics to design assessments, easier for students to find their assessments and feedback, and support staff by reducing the manual workaround assessments for academics.  During the next stage of the pilot project, integration into our current systems is a top priority and will alleviate these challenges.  Furthermore, the lack of formatting transfer from applications like Word to WiseFlow was highlighted as an area for improvement. These critical comments provide valuable insights for further refining and optimizing the WiseFlow system.

The evidence is clear to see – WiseFlow has the ability to provide a viable solution to reflective portfolios, with a bit of refinement – it could be excellent. 

What the staff said…

It was also vital to us that we gathered feedback from our academic staff.  

  • 100% of staff agreed that WiseFlow allowed them to develop their assessment in ways that were not previously possible
  • All staff agreed the WiseFlow reflective portfolio allowed them to fully cover learning objectives and meet the needs of their students
  • We received multiple comments about the speed of the platform, intuitive nature and search functionality which made the verification/moderation process seamless.  Staff also commended the accuracy of the rubrics for grading and how new interactive elements made them rethink how they could better use this type of functionality in the future.

Staff also commented on…

  • Comparisons to previously used portfolio platforms – “Historically the module used [another portfolio system] which was really clunky and didn’t work well at all. I really liked that Wiseflow could be scrolled across (as opposed to clicking through each page) and the layout was great”
  • Design elements within the marking interface – “It would have been useful to have had the comment box movable (I work with two screens and being able to drag the box to another screen to write on would have been a nice touch – several times I had to keep opening and closing the box as I wasn’t able to see the text underneath it)”
  • Having more time to explore the platform – “I did not feel I had enough time to play before it went live for students, but this was not WISEflow’s fault – it was just timing”. 

As an honest answer, we’ve been blown away by our staff feedback.   The unanimous agreement that WiseFlow enables new possibilities for assessment development speaks very highly of this solution and its potential in enhancing the teaching and learning experience for students at Portsmouth University.  The potential to create authentic assessments through the use of reflective portfolios is exciting.  The accuracy of the grading rubrics was also very highly commended – allowing students to have a greater chance of achieving a clear and defined target and making academic decision-making easier, fairer and more accurate.  In terms of developmental areas, the movement of the comment box is a fair point – we’ve heard from other academics about the size of the comment box before – hopefully, something that WiseFlow’s New Marker Journey will alleviate. 

Where do we go from here?

As we raised in our first blog post – the reflective portfolio solution in WiseFlow is far from perfect, with a few simple tweaks the solution could become very appealing. Sadly, some of these are out of our hands and lie within the code of the platform.  We’ve learnt a lot during the duration of this assessment as a project team, including developmental areas we have highlighted for the future.  

The single biggest limiting factor when using a reflective portfolio is when using a file upload question type.  This is limited to twelve files that are no more than 10Mb each – multiple file upload questions can be used, but will still have limits on them.  We have approached WiseFlow about this for development purposes, however, we have yet to have any significant movement on removing this limit.  The removal of this limit puts WiseFlow in an incredibly powerful position to offer another “string to their bow” in terms of assessment choice and would truly open up the use of reflective portfolios within the platform.  Sadly, with this limit in place, using reflective portfolios with some faculties such as our Creative and Cultural Industry, where students would regularly upload large .psd, CAD files, HD video, and high-quality audio etc) is just not a viable option.  Creative students will often build a “portfolio career” and we would love to be able to work with them on developing reflective portfolios, but this limit stops us.  Until this is removed, careful consideration must be taken at the planning stage of an assessment as to whether the reflective portfolio is the correct solution.  Further to this, other limitations must be considered – for example, once the reflective portfolio is live for students to complete, it cannot be altered, changed or adapted.  During the pilot, we’ve worked extensively with academics and our support teams to iron out any issues prior to release. Careful planning and consideration must take place in the authoring phase of an assignment, which will then be rigorously checked prior to release – in the same way an exam would.  This has worked at a small scale but we would need to ensure appropriate support mechanisms are in place at a larger scale.  

Our student feedback gave us valuable insight into the process of using WiseFlow.  Although reflective portfolios save every 10 seconds, if a student deletes a file or a piece of text and exits the platform, this cannot be recovered.  Over the duration of the assessments that took place, we encountered one reported instance of this. We also had some reports of formatting that will not copy from Word documents.  Again, we approached WiseFlow regarding this and it is recommended to copy/paste plain text from Word and finish the styling in the text editor of WiseFlow.  Although this solution works, having formatting that copies across would make students’ work translate much easier – particularly for those who write on external documents before copying into the platform at the last minute (like myself). In terms of progression beyond WiseFlow, we’d love for students to be able to take their work from the platform and have the ability to store it themselves or share it beyond the WiseFlow platform.  Currently, there is no solution to this.  A “zip folder” that contained all exports and uploaded files of any inputted answers into WiseFlow would be a great starting point.  Again, we’ve put forward the idea to WiseFlow, but have yet to have any movement on this.  

Where do we take our pilot now?

Although these are risks with using a reflective portfolio solution in WiseFlow, the prospect and the potential gain of this authentic assessment are exciting.  We’ve taken the plunge and proven the concept works, highlighting potential development areas which we really hope get some traction and we’d like to think WiseFlow will be open to listening to these developmental ideas.  As for our pilot project as a whole, we move into a second phase of the pilot with a continued focus on reflective portfolios but also some other areas of assessment we have struggled with in the past, such as large file submissions.  We have a plethora of training and support we are actively developing and working with local teams to ensure staff feel confident using the systems.  

We continue to have a waiting list for academics who are wanting to work with us to develop reflective portfolios in WiseFlow. I find myself meeting with academics on a weekly basis to discuss potential projects and reflective portfolio solutions in their disciplines.   So far, we’ve done no real advertising, and this interest has been created from word of mouth and from those who have used it as students. We are keen to share our experiences with other Universities in WiseFlow user groups, who are actively keen to explore this and want to learn about our innovative approach. However, we need to be open and honest about the limitations that this solution has at the moment. Collectively, we might hold enough power to make change happen but until that point, caution must be taken before embarking on a reflective portfolio to ensure this is the correct fit for assessment.

The potential of this solution is game-changing, not just for us, but for a lot of other Higher Education institutions across the world.

The future of reflective portfolios in WiseFlow is exciting – keep watching this space.  

Chris

Credit Image: Photo by MidJourney 

WiseFlow ePortfolio – Unlocking the power of WiseFlow: Transforming ePortfolio assessments

In the digital age, traditional paper-based portfolios have given way to ePortfolios, harnessing a powerful way to showcase a student’s work that demonstrates their learning, progress, reflections and achievements, over a period of time. ePortfolios are increasingly becoming popular in education as they offer several benefits to both students and academics.

For students, ePortfolios provide an adaptable platform to showcase their learning journey, including their best work and reflections on when it didn’t go quite to plan, and draw on evidence from a range of sources whether that be PDFs, images, videos, audio snippets or written text. This process helps students develop their metacognitive skills and self-awareness as learners over a period of time.  Academics, on the other hand, can use ePortfolios to assess students’ learning outcomes in a more comprehensive and authentic manner. In turn, this allows academics to gain insights into students’ thought processes, identify their strengths and weaknesses, and provide targeted feedback. Additionally, ePortfolios allow academics to track students’ progress and provide evidence of their achievements.

Using ePortfolios also builds several skills, including digital literacy, communication and critical thinking – all of which are vital in the modern workplace. Students have to select, curate, and present their work in a clear and engaging manner. They also have to reflect on their learning process and map this to learning outcomes. These skills are crucial for success in the modern workplace, where digital communication and collaboration are essential. With a background in teaching vocational courses for 12 years at Further Education level, I’ve seen first-hand the impact and outcomes of effective ePortfolio use for both students and academics. 

At Portsmouth University, we have struggled to find a solid ePortfolio solution. We currently use a popular open-source ePortfolio platform that allows students to create and share their digital portfolios. While the platform has several benefits, including flexibility, customizability, and integration with other systems, it also faces some challenges. One major issue is its user interface, which can be overwhelming and confusing for some users – particularly in the setup stage of having to import the portfolio into your own profile. This process often leads to a lot of technical issues and puts up an immediate barrier to entry for those not tech-savvy. Additionally, the learning curve for using the platform can be steep, and it may take some time for users to become familiar with all the features and functionalities. However, despite these challenges, academics and students value the use of the ePortfolio system on offer and the benefits this provides.  

We are currently coming towards the end of our first stage of a pilot with a new system: WiseFlow. This is a cloud-based digital end-to-end exam and assessment platform that supports the assessment and feedback lifecycle for students, assessors and administrators. It’s fair to say that staff feedback about the WiseFlow pilot has been overwhelmingly positive. As a core project team, we’ve had the pleasure of working with academic teams to support students with innovative assessments in Wiseflow, across a range of disciplines. This all links to our Digital Success Plan to (re)design robust assessments to meet the needs of the diverse student population within a blended and connected setting and incorporate a robust specialist end-to-end assessment platform. Our aims in the project were to make it easier for academics to design assessments, easier for students to find their assessments and feedback, and reduce the manual workaround assessments for academics and support staff.  All of which, WiseFlow seems to have been able to deliver. 

Within the pilot, we wanted to really push the boundaries of WiseFlow – utilising a wide range of assessment types to really test if WiseFlow can become the go-to platform for assessments at Portsmouth University.  One of the big challenges for us was to find an ePortfolio solution that is user-friendly, and adaptable across a range of disciplines as well as providing a versatile feedback loop where students could receive formative feedback on their work from assessors and develop ideas, prior to final submission. After challenging the team at WiseFlow to this – they came back with a solution. Block arrows showing the timeline of a flow ePortfolio for Online Course Developers, eLearn Team, Students and Academics

Traditionally, a FlowMulti (just one of the many ‘flow types’ WiseFlow offers for assessment) would be used for open/closed book multiple-choice exams, where the participants fill out a provided multiple-choice test.  However, the team at WiseFlow suggested we could utilise this functionality to use as a bespoke ePortfolio solution.

Using a FlowMulti allowed us to replicate the layout and design of current ePortfolios as well as allow us to adapt the setup to truly take ePortfolios to the next level. To create the feedback loop, we allowed assessors early access to the work, early release of feedback to students, and students to submit unlimited times before the deadline.  The portfolios could be easily updated year-on-year, were inviting for students to engage with, and could be authored by multiple academics at the same time. This seemed like the perfect solution.  

After testing, adapting and re-testing, we felt this solution offered a totally new level of ePortfolio to our current offering. The ability to re-purpose traditional multiple-choice questions allowed us to push the boundaries of assessment further, like never before. The only limitation is our own creativity to adapt and repurpose these. We put together a showcase of a PGCert portfolio to show our academics the findings, who immediately fell in love with the platform and we started working together to develop a portfolio to run within the pilot.

“As a course team, we are incredibly excited about the flexibility that the Wiseflow ePortfolio has to offer. Working with the project team we have been able to design a summative assessment vehicle which is both intuitive for learners and versatile enough to encompass a broad range of tools which enable the course Learning Outcomes to be demonstrated in an engaging and meaningful way.”  Dr Joanne Brindley, Academic Practice Lead & Senior Lecturer in Higher Education.

A screenshot of an image taken from a computer of the page that the participant will see asking them to reflect on their skills. A screenshot of an image taken from a computer of the page that the participant will see. The image is of empty drop box for the participant to upload their activity into it. A screenshot of an image taken from a computer of the page that the participant will see asking them to type up a reflective statement on the using of Technology to support learning.

We are now in the “participation” phase of two ePortfolios – one for the Research Informed Teaching module and one for the new Level 7 Teach Well: Principles to Practice professional development module.  We have had great experiences re-designing pre-existing portfolios to really push the boundaries of what is possible in WiseFlow. We’ve added interactive elements, by turning traditional questions and approaches on their head – such as using a histogram for reflection, allowing students to visually reflect on skillsets pre- and post-observation. We’ve provided students freedom of choice with assessment by integrating a voice recorder into the portfolio and also utilising existing platforms to integrate into the WiseFlow portfolio. Really, the only limitation is our own imagination.  

“We teach the PG Cert Higher Education so our students are staff. The platform is incredibly user-friendly for both staff and students. We used it for ePortfolio as the last platform created lots of complaints, whereas this platform has led to lots of compliments.  The staff members spoke highly of the platform and I believe, many have asked to be part of the pilot next year due to their positive experience.”  Tom Lowe, Senior Lecturer in Higher Education

There has been overwhelmingly positive feedback from academics and students regarding the usability and functionality of using WiseFlow as an ePortfolio solution.  Through word of mouth and firsthand experiences from early career academics, particularly those who are studying on the Research Informed Teaching module, the platform’s potential in enhancing their own teaching has become widely recognized.  I remember being invited to one of Tom’s lectures to showcase the platform to his students who would be using it and the response was overwhelming. Staff were excited to use this as students and saw the immediate potential for their own teaching. It is always a good sign of a new innovation when there is an immediate benefit to both staff and students that can be applied instantly in the classroom. Essentially, we now have a waiting list for academics who are wanting to work with us to develop ePortfolios in WiseFlow – with no advertising at all and purely from those who have used it as students. We believe that when this is advertised, we will see a huge influx of academics wanting to use this. We have also spoken to other Universities in WiseFlow user groups, who are actively keen to explore this and want to learn about our innovative approach. The potential of this solution is game-changing, not just for us, but for other Higher Education institutions. 

However, using an innovative approach and essentially turning a quiz assignment on its head does not come without some drawbacks that need to be considered before academics embark on an ePortfolio solution within WiseFlow.  There is currently a 12-file limit, set at 10Mb per file when students upload files into the portfolio. Although it is great that students can do this, it does not lend itself to modern file sizes or some of our subject areas (for example, our Creative and Cultural Industry Faculty, where students would regularly upload large .psd, CAD files, HD video, and high-quality audio etc). In our initial pilot, we haven’t encountered this issue – but it’s worth considering if this is the correct way to proceed with an assessment. The limit on the number of files is also a concern. For example, some students in our pilot have reached the 12-file upload limit. While there are workarounds, such as storing files in a Google Drive folder and sharing the link or combining multiple files into one, however, it defeats the purpose of an ePortfolio as an all-encompassing system. Perhaps, a better approach would be to have an upload limit as a whole, with a defined combined file size.  The final consideration to make is that once the ePortfolio is live, we cannot make changes.  We’ve worked extensively with academics and our support teams to iron out any issues prior to release, but again, this is important for academics to understand. Careful planning and consideration must take place in the authoring phase of an assignment, which will then be rigorously checked prior to release – in the same way an exam would. Despite these setbacks, we’re actively in discussions with WiseFlow regarding developing this and hope to make progress on these in the near future. 

The future of ePortfolios in WiseFlow is exciting, and we can’t wait to see how they will continue to be developed across the University. The ability to adapt and transform ePortfolios will open up new doors for our students and academics to really develop the ways in which students can showcase their knowledge and understanding. We’re hoping for a successful run of ePortfolio use within our pilot and looking forward to developing new ideas as we move into the future.  

Until next time. Watch this space.

Chris.

Digital Learning Plan (Tom and Aron chit chat)

As you may be aware, Professor Ale Armellini is creating a Digital Success Plan for the University. Rather than create the Plan and seek comment after the fact (and after any substantive changes could be made), Professor Armellini formed a cross-University group to help shape his ideas as well as provide valuable input into the Plan.

Aron Truss from BAL and I were both asked to participate in the group and have been working on elements of the Plan together.

With the Plan progressing and nearing completion, the idea of shining a light on where we are up to felt appropriate as there may still be people unaware of the project, that would like to offer some suggestions or find out more about what the Plan hopes to achieve. 

This piece is partly promotional and partly reflective of our experiences of working on a project to substantially impact how we approach our digital teaching and learning experiences. 

How did you get involved?

TL: 

I heard about the Digital Learning Plan while talking to colleagues in another meeting. I asked if I could put myself forward to represent the team and feedback on our ideas. I sent my request in and was asked to join. It was an honour to be asked along and felt really good to actually be aware of the ideas that were going forward. I think more that I was actually able to feed into the process and get the team’s voice heard within such an interesting part of the University’s future. 

AT: 

During summer 2020, I worked as part of a team, contributing to my Faculty’s (BaL) plans for the 2020-2021 academic year. I was subsequently asked to be part of one of the University workstrands which led to my inclusion on the Digital Success Plan working group. My current role involves supporting and promoting the digital agenda in the Faculty of Business and Law, so I was really pleased to be involved in this, as I’m keen to see how we can continue to enhance digital learning and teaching for both staff and students.

What have you found most interesting about the project?

TL:

I think one of the biggest revelations for me was how unified everyone seemed to be. Of course, there were differences, but generally, everyone had the same idea for where we would like to see this go. I think one key point was while we can offer something that will help guide everyone with the implementation of a more “digital” curriculum, it endeavours to allow the flexibility for people to be innovative and develop their materials to fit their needs. 

AT: 

The Digital Success Plan is going to work in partnership with the new Education Plan, and its purpose is to facilitate the implementation of the University vision/strategy, so the themes covered are directly applicable to learning and teaching practice. This is what I find really interesting, as I’m excited to see how we can support people, and facilitate the development of digital education in a meaningful and useful way for staff and students. I think the ambition around creating a risk-friendly culture that supports pedagogic innovation is really exciting and important to enable the development of new digital learning opportunities. The promotion of learning design and the use of a clear methodology to achieve this also has the capacity to significantly impact our practice.

What do you think 2020 (lockdowns) have done to shape the Plan?

TL: 

For me it was the speed at which the change had to take place. It forced people to look into an uncomfortable situation that helped them realise “I can actually do this”. Obviously, people weren’t experts overnight and they still needed help, but I hope they say that it was not as bad as they had first thought. It did increase stress and workloads and that is something no one wanted, but again, I hope people can reflect on this and see that they can adapt what they have made this year and see that these new resources can be developed and implemented in the future. 

AT: 

There has been some brilliant practice demonstrated by colleagues this year, including a massive shift in the baseline delivery of things like video resources (Panopto), synchronous online sessions (Zoom) and effective use of the VLE (Moodle templates). The Plan looks to build on this, but it’s clear that the trajectory will be away from “emergency remote teaching” to a more considered and sustainable model that includes learning design planning and enhancements to tools and systems as well.

What does the Plan offer going forward?

TL:

For me the Plan offers those still unsure about digital learning the chance to find a “security” blanket in what they can do. It helps shape ideas and lay a foundation for whatever they want to try next.

AT: 

The Plan has been built on a foundation of strong pedagogy and positive student experience, facilitated by a series of aims, which include supporting staff and students to develop their digital fluency, fostering multidisciplinarity, encouraging pedagogic innovation and flexibility (including around assessment), and further cementing the principles, and best practice, of blended and connected learning.

What is the next step?

TL:

Well, the next step is to consider the final suggestions that may have come in and see how they can be incorporated into the Plan as it stands. I don’t want that to sound like it’s already written and set in stone, it really isn’t, but it does have some element of the structure that we are now working within. There are a few meetings yet to happen where the ideas are polished and finalised, and that is the exciting part. We can see what the vision of this was and where it is now going.  

AT: 

The aim is to launch the Plan later this summer. Ale is still keen to hear feedback from staff if people have questions or comments. As practitioners, I think it might be worth us beginning a discussion about what the implementation of the Plan might look like.

Final thoughts:

TL:

The most important thing for me is that we maintain a good line of communication with the end-users. It is our chance to be real innovators in HE and find ways to engage and develop our digital provision. It is a chance to engage the students in the conversation about what they want but also what we expect from them too. It is exciting to be able to have taken part in this. I think this alongside the new Explore tool is a great starting point for where the University can go next with digital learning and teaching.  

AT: 

As a practitioner, the area of most interest to me is the embedding of a methodology for learning design, and the fostering of a culture that enables partnership in design between OCDs/learning designers and academics. I’m keen to see this aim realised, as I think it has the capacity to make the student and staff experience better all round. I’d be interested to hear what our colleagues feel about this too, and how they think this could be facilitated.

 

Credit Image: Photo by Kaleidico on Unsplash 

© 2024 Tel Tales

Theme by Anders NorénUp ↑