Adventures in Technology Enhanced Learning @ UoP

Tag: external (Page 1 of 11)

WiseFlow – Looking in the mirror with reflective portfolios in WiseFlow

Hey there, fellow exhausted souls!

Can you believe it? We’re finally coming towards the end of the academic year, and boy, has it been a fun ride!  Our WiseFlow pilot has gone from strength to strength as we support academics through a new assessment process.  More importantly, we have successfully run two separate assessments using our innovative approach of using WiseFlow as a reflective portfolio – the first use case of this we know about!  We’ve grown, learned, and potentially discovered an exciting prospect for the future of reflective portfolios at Portsmouth University, so let’s take a moment to reflect on the journey we’ve been on. 

You may have read our previous blog post on “Unlocking the power of WiseFlow: Transforming ePortfolio assessments” where we discussed the possibilities of using WiseFlow as a viable reflective portfolio platform and the benefits a reflective portfolio approach brings.  For students, this helps develop their metacognitive skills and self-awareness as learners over a period of time.  Academics, on the other hand, can use reflective portfolios to assess students’ learning outcomes in a more comprehensive and authentic manner.  This is all part of our wider WiseFlow pilot to provide one integrated assessment platform that serves our current (and future) assessment needs within Portsmouth University, which Mike Wilson spoke to us about recently on our podcast – you can listen here

Teach Well and Research-Informed Teaching

This year we ran two reflective portfolios within WiseFlow as part of our pilot project – to test the water and find out if this was even possible. The first was within our Researched Informed Teaching module, which supports early career academics to apply their learning in educational enhancements into their own contexts, through reflection and innovation.  Students will draw together higher education policy, research methods and educational developments to build students knowledge for their future work.  Secondly, we ran a reflective portfolio in our new level seven Teach Well: Principles to Practice module, which is a professional development route for those in roles related to supporting student learning. Students in this module embark on a pedagogical journey through three pillars of practice for teaching well in higher education, gaining the confidence to critically evaluate learning and design approaches and reflecting on what it means to teach well across different modes of study.  We recently caught up with Maria Hutchinson who runs this module in our podcast series, if you missed this one, you can listen here

We’ve worked closely with these academics and our support teams to develop reflective portfolios for these modules that can be used as a summative assessment vehicle which is both intuitive for learners and versatile enough to encompass a broad range of tools which enable the course learning outcomes to be demonstrated in an engaging and meaningful way.

What the students said…

Following the submission of reflective portfolios into WiseFlow, we sent out a survey to participants to gain their feedback and views.  Some of the headline figures are detailed below…

  • 90% of students found the WiseFlow reflective portfolio easy to navigate
  • 90% of students agreed that a reflective portfolio suited this type of assessment (compared with traditional essay-based assessment methods)
  • 82% of students felt their own students would enjoy using a reflective portfolio in WiseFlow
  • 71% of students enjoyed the interactive assessment methods, such as histograms, voice recorders etc. 
  • We received multiple comments about the clear instructions that were given on how to access and use Wiseflow as well as its reliability and stability as a platform.  Many users also commented positively on the functionality that WiseFlow offered compared to previously used portfolio solutions. 

Students also commented on…

  • If there was a need to add another system to Portsmouth University’s available assessment platforms – “There are too many platforms for submitting the work, Moodle, ePortfolio, WiseFlow, it is really confusing and frustrating that is necessary to learn how to use different platforms for different modules.”
  • The lack of formatting transfer from applications such as Word, when copying and pasting into WiseFlow – “Transfer of formatted MS Word document to WiseFlow could be improved. Currently, the document format is lost during the cut & paste process which then requires more effort to re-format within the WiseFlow portal.”
  • Better integration with Moodle and WiseFlow – “I’d like to see direct access from Moodle”. 

The data presented highlights the positive reception of WiseFlow as a reflective portfolio solution by students. The high percentage of students that recognized the suitability of a reflective portfolio as an assessment method, in comparison to traditional essay-based approaches and praised its usability is a really positive sign. The positive feedback on the interactive assessment methods further emphasizes the adaptability of the question bank in a traditional FlowMulti assessment to be used in an innovative way. 

However, some concerns were raised by students, such as the frustration of managing multiple assessment platforms at the university, indicating a need for better integration. This all links to our Digital Success Plan to (re)design robust assessments to meet the needs of the diverse student population within a blended and connected setting and incorporate a robust specialist end-to-end assessment platform. Our aims in the project were to make it easier for academics to design assessments, easier for students to find their assessments and feedback, and support staff by reducing the manual workaround assessments for academics.  During the next stage of the pilot project, integration into our current systems is a top priority and will alleviate these challenges.  Furthermore, the lack of formatting transfer from applications like Word to WiseFlow was highlighted as an area for improvement. These critical comments provide valuable insights for further refining and optimizing the WiseFlow system.

The evidence is clear to see – WiseFlow has the ability to provide a viable solution to reflective portfolios, with a bit of refinement – it could be excellent. 

What the staff said…

It was also vital to us that we gathered feedback from our academic staff.  

  • 100% of staff agreed that WiseFlow allowed them to develop their assessment in ways that were not previously possible
  • All staff agreed the WiseFlow reflective portfolio allowed them to fully cover learning objectives and meet the needs of their students
  • We received multiple comments about the speed of the platform, intuitive nature and search functionality which made the verification/moderation process seamless.  Staff also commended the accuracy of the rubrics for grading and how new interactive elements made them rethink how they could better use this type of functionality in the future.

Staff also commented on…

  • Comparisons to previously used portfolio platforms – “Historically the module used [another portfolio system] which was really clunky and didn’t work well at all. I really liked that Wiseflow could be scrolled across (as opposed to clicking through each page) and the layout was great”
  • Design elements within the marking interface – “It would have been useful to have had the comment box movable (I work with two screens and being able to drag the box to another screen to write on would have been a nice touch – several times I had to keep opening and closing the box as I wasn’t able to see the text underneath it)”
  • Having more time to explore the platform – “I did not feel I had enough time to play before it went live for students, but this was not WISEflow’s fault – it was just timing”. 

As an honest answer, we’ve been blown away by our staff feedback.   The unanimous agreement that WiseFlow enables new possibilities for assessment development speaks very highly of this solution and its potential in enhancing the teaching and learning experience for students at Portsmouth University.  The potential to create authentic assessments through the use of reflective portfolios is exciting.  The accuracy of the grading rubrics was also very highly commended – allowing students to have a greater chance of achieving a clear and defined target and making academic decision-making easier, fairer and more accurate.  In terms of developmental areas, the movement of the comment box is a fair point – we’ve heard from other academics about the size of the comment box before – hopefully, something that WiseFlow’s New Marker Journey will alleviate. 

Where do we go from here?

As we raised in our first blog post – the reflective portfolio solution in WiseFlow is far from perfect, with a few simple tweaks the solution could become very appealing. Sadly, some of these are out of our hands and lie within the code of the platform.  We’ve learnt a lot during the duration of this assessment as a project team, including developmental areas we have highlighted for the future.  

The single biggest limiting factor when using a reflective portfolio is when using a file upload question type.  This is limited to twelve files that are no more than 10Mb each – multiple file upload questions can be used, but will still have limits on them.  We have approached WiseFlow about this for development purposes, however, we have yet to have any significant movement on removing this limit.  The removal of this limit puts WiseFlow in an incredibly powerful position to offer another “string to their bow” in terms of assessment choice and would truly open up the use of reflective portfolios within the platform.  Sadly, with this limit in place, using reflective portfolios with some faculties such as our Creative and Cultural Industry, where students would regularly upload large .psd, CAD files, HD video, and high-quality audio etc) is just not a viable option.  Creative students will often build a “portfolio career” and we would love to be able to work with them on developing reflective portfolios, but this limit stops us.  Until this is removed, careful consideration must be taken at the planning stage of an assessment as to whether the reflective portfolio is the correct solution.  Further to this, other limitations must be considered – for example, once the reflective portfolio is live for students to complete, it cannot be altered, changed or adapted.  During the pilot, we’ve worked extensively with academics and our support teams to iron out any issues prior to release. Careful planning and consideration must take place in the authoring phase of an assignment, which will then be rigorously checked prior to release – in the same way an exam would.  This has worked at a small scale but we would need to ensure appropriate support mechanisms are in place at a larger scale.  

Our student feedback gave us valuable insight into the process of using WiseFlow.  Although reflective portfolios save every 10 seconds, if a student deletes a file or a piece of text and exits the platform, this cannot be recovered.  Over the duration of the assessments that took place, we encountered one reported instance of this. We also had some reports of formatting that will not copy from Word documents.  Again, we approached WiseFlow regarding this and it is recommended to copy/paste plain text from Word and finish the styling in the text editor of WiseFlow.  Although this solution works, having formatting that copies across would make students’ work translate much easier – particularly for those who write on external documents before copying into the platform at the last minute (like myself). In terms of progression beyond WiseFlow, we’d love for students to be able to take their work from the platform and have the ability to store it themselves or share it beyond the WiseFlow platform.  Currently, there is no solution to this.  A “zip folder” that contained all exports and uploaded files of any inputted answers into WiseFlow would be a great starting point.  Again, we’ve put forward the idea to WiseFlow, but have yet to have any movement on this.  

Where do we take our pilot now?

Although these are risks with using a reflective portfolio solution in WiseFlow, the prospect and the potential gain of this authentic assessment are exciting.  We’ve taken the plunge and proven the concept works, highlighting potential development areas which we really hope get some traction and we’d like to think WiseFlow will be open to listening to these developmental ideas.  As for our pilot project as a whole, we move into a second phase of the pilot with a continued focus on reflective portfolios but also some other areas of assessment we have struggled with in the past, such as large file submissions.  We have a plethora of training and support we are actively developing and working with local teams to ensure staff feel confident using the systems.  

We continue to have a waiting list for academics who are wanting to work with us to develop reflective portfolios in WiseFlow. I find myself meeting with academics on a weekly basis to discuss potential projects and reflective portfolio solutions in their disciplines.   So far, we’ve done no real advertising, and this interest has been created from word of mouth and from those who have used it as students. We are keen to share our experiences with other Universities in WiseFlow user groups, who are actively keen to explore this and want to learn about our innovative approach. However, we need to be open and honest about the limitations that this solution has at the moment. Collectively, we might hold enough power to make change happen but until that point, caution must be taken before embarking on a reflective portfolio to ensure this is the correct fit for assessment.

The potential of this solution is game-changing, not just for us, but for a lot of other Higher Education institutions across the world.

The future of reflective portfolios in WiseFlow is exciting – keep watching this space.  

Chris

Credit Image: Photo by MidJourney 

Guest Blogger: Tom Langston – How ChatGPT Revolutionized My Writing Process – The AI version

(Co-writer: ChatGPT)

This version was generated after feeding in my attempt at writing this blog post and asking ChatGPT to ‘shorten this text into a blog post’.

I recently discovered the incredible potential of ChatGPT, and it completely revolutionized the way I approached my writing. As a student pursuing a Professional Doctorate in Education, I often struggled with crafting cohesive and focused assignments. My writing style was scattered and verbose, making it difficult for readers to follow my train of thought. Enter ChatGPT, a powerful AI language model that became my secret weapon in developing a well-structured research proposal.

Initially, I sought human help from my project supervisor, Stephen Webb, who pointed out that my writing relied too heavily on vague terms like “this” and “it.” While I understood the meaning behind my words, Stephen reminded me that readers might not share the same clarity. Armed with his feedback, I set out to improve my proposal.

When I completed the next draft, I thought I was finished. However, the word count was far too high, so I turned to ChatGPT for assistance in condensing my writing. It did the job, but the result lacked my personal touch and voice as a writer. I realized I would have to manually trim down the content to achieve the desired outcome.

During this editing process, I discovered the true power of ChatGPT. I started using it to check sentences that I struggled to articulate clearly. When I asked for grammar assistance, ChatGPT not only provided corrections but also suggested ways to enhance sentence structure and improve readability. This iterative process allowed me to refine my writing, discarding extraneous thoughts and rearranging sentences for better flow. It became evident that if a particular text no longer fit within the new leaner version, despite my attachment to it, it had to be eliminated. This experience epitomized the essence of editing.

As I continued to utilize ChatGPT, I encountered questions of ethics. While it proved immensely useful in reducing my word count, I couldn’t help but feel uneasy about presenting the AI-generated content as my own. The ethical implications of using AI in writing remain a divisive topic, with differing perspectives on its appropriateness and boundaries. To navigate this issue, some suggest referencing AI tools in an appendix, detailing their specific use and purpose in the writing process. However, this raises questions about the extent to which we should acknowledge AI contributions and how that compares to other forms of assistance, such as spell checkers or language tools like Grammarly.

One important consideration is whether AI tools are always correct. While they excel at constructing language, they may strip away the author’s voice and inadvertently introduce errors. In my experience, Grammarly sometimes made corrections to the text generated by ChatGPT, highlighting the need for human judgment in refining the output.

In conclusion, ChatGPT became a game-changer for me, transforming my writing process in ways I had never imagined. I believe it should be embraced as a valuable resource for students to tighten their drafts before seeking extensive academic support. By incorporating AI tools, we can alleviate the burden on educators, who can then focus on reviewing more polished submissions requiring minimal intervention. However, it is crucial to strike a balance and ensure that AI enhances our own voices rather than overshadowing them. AI is undoubtedly here to stay, and by harnessing its power thoughtfully, we can elevate our writing while preserving our unique identities as authors.

Thoughts from the Proofreader:

I was asked to proofread Tom’s blog post here and have a look at ChatGPT’s version too. Comparing the two, I definitely found Tom’s writing much more personable – I could imagine him speaking as I read through it. ChatGPT’s version presented the information efficiently and effectively, and I found nothing to correct. However, in its response to the prompt, it had taken away everything that made Tom sound like Tom!

This experience also really made me realise how many misconceptions I have about AI tools. I’d assumed that ChatGPT would have a very grammatical approach to its interpretation of language – rather like I’ve been told I have! However, when Tom asked it about the difference between ‘that allowed’ and ‘allowing’, ChatGPT talked with authority about implications and potential meanings. This answer was a long way from my interpretation, which attributed the difference to the grammar of relative clauses (X refers to one thing, Y refers to another). As Tom demonstrated with his irony example, it’s worth being cautious with how far we trust its responses. And I think we can be confident that human input will still be needed for a few years (or at least months) yet. 

Credit Image: Photo by Bram Naus on Unsplash

Guest Blogger: Tom Langston – Last Night ChatGPT Saved My Life…

The classic line from Indeep’s 1982 post-disco hit “Last Night a DJ Saved My Life” serves as the basis of my title. As ChatGPT did – not literally, but figuratively – save my life.

I am currently studying for the university’s Professional Doctorate in Education and, since February, have been completing my final taught assignment entitled “Research Proposal”.

It takes me a while to write, as I don’t find it easy, and I am not that good at it. My approach to writing is best described as little and often, frequently getting distracted and losing focus on the task at hand. If you have ever seen Dave Gorman’s “Googlewhack Adventure”, you will understand my problem: his book and stage show outlined how he was meant to write a fictional novel and ended up writing and performing about his experiences of Googlewhacks (Googlewhacking?) instead. He got distracted by less important but much more fun endeavours. 

The other problem is that I don’t get to the point. I write a verbose mess of unconnected thoughts. So with that in mind, I am going to explain how the rise of the machines (we are not far away from ChatGPT working out it wants to be Skynet) assisted me in writing my “research proposal” assignment. 

First Drafts

To start with, I had human help. Stephen Webb, as my project supervisor, read a draft I had written. He demonstrated that a lot of my writing relied on small words to, as he put it “do the heavy lifting”. Using ‘this…’ and ‘it…’ frequently because I understood what I was trying to say –  he pointed out that the reader might not. The only reason he could even start to understand my work was because he knew me and the context of my subject. 

From his extensive feedback, I redrafted, edited and tried to improve my proposal. 

After completing the next draft, I thought I’m done. However, I was well over the word count, so I put sections into ChatGPT and told it to re-write it within my word limit. It only bloomin’ did it! The problem was it was very sterile; it lost all sense of who I am as a writer. This meant I was going to have to manually get the word count down. 

After another version, I asked Stephen for some clarification on some of his earlier feedback. His reply was:

“In the section you sent through, there are still individual sentences that are hard to parse. The initial word of a sentence or clause primes the reader to think in a certain way; if the sentence or clause doesn’t deliver, then confusion arises. You really should pass this through a grammar checker, Tom.”

Not being a confident writer, I already knew that my writing needed work. What this feedback demonstrated to me was that I lacked cohesion and structure. My train of thought constantly jumping around the entire document is a by-product, I guess, of writing in such short unfocussed bursts. 

I wrote a heading titled “Introduction” but did not actually introduce anything. As Stephen had pointed out, I had poorly communicated my narrative. What this meant was that readers were getting lost in my disconnected thoughts. I could now see that certain sections felt shoe-horned in because I liked what I had written. Realistically, those “gems” made no sense to the reader as they were not connected with the text surrounding them. 

I tried to use ChatGPT to see if it could make sense of it, but there was too much there for it to tell me how to rearrange it. The system did not accept the entirety of the text and could not provide clarity to the sections I had written. ChatGPT could not offer clear guidance for how best to rework and rearrange it.

A Quick Aside

At this point, on re-reading the above section, I think it nicely illustrates the problem I was talking about. I have said the same thing here in three different ways. 

  1. I tried to use ChatGPT to see if it could make sense of it, but there was too much there for it to tell me how to rearrange it. 
  2. The system did not accept the entirety of the text and could not provide clarity to the sections I had written. 
  3. ChatGPT could not offer clear guidance for how best to rework and rearrange it.

I only need to use one. In the past, Stephen had raised this issue with me, but it is a hard thing to change. What I am going to discuss next is my recent experiences of using ChatGPT as a tool to develop the parts in my writing I would not have picked up on myself. Heck, as I go back through this blog, I’m sure I’ll find more. I just won’t mention anything I’ve changed, so you’ll never know… 

Editing with ChatGPT

As I worked my way through the editing process, I started to use ChatGPT to check sentences I wanted to keep but was struggling to make coherent. They were either too long, or the idea I was trying to convey was not coming through clearly enough. 

An example of this would be when I asked ChatGPT to “check the grammar”:

My original question:

My situation should be made clear to the participants, allowing them to have fully informed consent, but to also highlight that if they perceive issues in the current hybrid environments I am hoping to act on their concerns and not silence their voices.

ChatGPTs reply:

The grammar of the provided text is correct. However, there are a few suggestions for improving clarity and readability:

“My situation should be made clear to the participants, enabling them to provide fully informed consent. Moreover, it is important to emphasise that if they perceive any issues in the current hybrid environments, I am committed to addressing their concerns and not silencing their voices.”

In this revised version, I made a few adjustments to enhance the sentence structure and clarify the message.

It was this repeated process that helped me (despite, at times, slowing me down) as I kept re-reading the submission each time, trying to tighten up my writing. Finding new thoughts that were slightly out and attempting to move them to the correct place. It became a good rule of thumb that, if the text I wrote did not fit in the new, leaner version, despite how much I wanted to keep it, it was gone. (Well done Tom – you just discovered the true meaning of editing!)

Below is an example of how I started to use ChatGPT to my advantage so I could improve my writing. 

My question to ChatGPT:

Should it be “that allowed” or “allowing” in the following text – 

Before the pandemic only the most confident teaching staff employed interactive tools (Nearpod, Mentimeter, etc.) within a lecture space that allowed students the ability to creatively engage with the material (Tan et al., 2020).

ChatGPTs reply:

Both “that allowed” and “allowing” are grammatically correct in the given sentence. However, the choice between them depends on the intended meaning and emphasis.

“That allowed”

Using “that allowed” suggests that the interactive tools were specifically designed or configured in a way that granted students the ability to creatively engage with the material. It implies that the tools had a built-in functionality or feature enabling such engagement.

“Allowing”

Using “allowing” suggests that the interactive tools, in a general sense, provided the opportunity or capability for students to creatively engage with the material. It implies that the tools had the potential or capacity to facilitate such engagement.

Both options are valid, but if you want to emphasize that the interactive tools had a specific functionality designed to enable creative engagement, “that allowed” would be more suitable. If you want to convey a more general sense of opportunity or capability, “allowing” would be a better choice.

As you can see, ChatGPT helped to explain how the slight difference in the sentence structure changed the meaning of what I was writing. I was able to consider what it was I’m trying to say and use the most appropriate version. 

Through all my previous doctoral assignments, I had a different tutor who helped me with my drafts. They told me they liked my writing style, which gave me the impression I was good at it. I can’t say what they specifically liked about my writing. I can make an educated guess that, because it was a level 8 assessment, my mistakes were forgiven. The marker was able to interpret the little words “that are doing the heavy lifting” (as Stephen had pointed out) more easily than your ‘average’ reader. Stephen helped me understand that it is one thing to have an interesting voice running through your text but is quite something else to actually be good at writing. 

The ethics of using AI

When I got ChatGPT to reduce my word count, I spoke with Stephen about the ethics of it and (ignoring the sanitisation of the output) it felt like a great way for a writer to do this. However, it felt wrong to take what ChatGPT had created as my own.

There is going to be an ethical divide between those who see using any form of AI as wrong and those who see it as a tool for improvement. The problem (as always) lies in the grey area and the boundaries of where people choose to deploy it, for example how far the tool is shaping their work beyond what would have been possible by them alone. While knowing it might be unethical, some will use it due to other commitments (work, family, etc). This scenario is a foreseeable eventuality, much like those who copied other work or paid essay mills for their work. But perhaps AI may feel slightly more ethical? As I am about to discuss, maybe a strong referencing code is what is required. But people (I was going to put students, but felt that unfair as we all have a personal line we move and adjust depending on the subject) will always push and flex the boundaries of fairness.

Referencing AI

In a recent ALT mailing list post, the question was asked about referencing when AI was used to  support work. The reply pointed to Boston University’s faculty of computing and data science guidance “Using generative AI in coursework”. The post highlighted this text:

“When using AI tools on assignments, add an appendix showing

(a) the entire exchange, highlighting the most relevant sections;

(b) a description of precisely which AI tools were used (e.g. ChatGPT private subscription version or DALL-E free version),

(c) an explanation of how the AI tools were used (e.g. to generate ideas, turns of phrase, elements of text, long stretches of text, lines of argument, pieces of evidence, maps of conceptual territory, illustrations of key concepts, etc.);

(d) an account of why AI tools were used (e.g. to save time, to surmount writer’s block, to stimulate thinking, to handle mounting stress, to clarify prose, to translate text, to experiment for fun, etc.).”

This almost feels as if there are too many barriers to use for a subject (or level) where you may be writing assignments of 6000+ words. Especially if you have to reference every section of text AI helped with. The follow-up question is then do you have to highlight every time spellcheck made a correction? Do you have to disclose that you used a service like Grammarly to make minor amendments? That is of course hyperbole. I think that if you get AI to generate starting paragraphs or change substantial amounts of your work, yes, this should be explained in an appendix. For re-writing a sentence and making grammatical choices, then no. That raises another question, how many sentences constitute a substantive change? 

Are AI tools always correct?

The final point relates to whether they are always correct. Now I know these tools are better than me at the construction of language. I have always been better at face-to-face conversations as a form of communication. During a conversation I can see when people don’t understand me, so adapt how and what I say accordingly. Writing does not afford the writer or reader the same luxury. So why do I ask if they are correct? As I have already mentioned, ChatGPT sterilised my voice. When asked to reduce the word count, it did what it was supposed to do but it strips out the humanity of the author (unsurprising being that it is a computer).

Another example (inside a paragraph that starts “The final point”, I do get the irony) is that Grammarly made corrections to the generated text from ChatGPT. 

This is a screenshot of a reply from ChatGPT placed within a box saying 'Both "that allowed" and "allowing" are grammatically correct in the given sentence. This box appears on the lefthand side of the screen on the righthand side is a box created by Grammarly. Grammarly has written Formality, then says to engage with the material creatively. The to-infinitive to engage has been split by the modifier creatively. Avoiding split infinitives can help your writing sounds more formal.
Another “another example” of a final point is: I put the above paragraph into ChatGPT to ask if I had used irony correctly. This is what it said:

Yes, the use of the word “irony” in this context is correct. Irony is a literary device that involves a contrast between expectations and reality. In your statement, you are highlighting the irony in two situations:

The first example of irony is that despite recognizing that language generation tools like ChatGPT are better than you at constructing language, you also acknowledge that you excel at face-to-face conversations where you can adapt and clarify your communication based on people’s reactions. The irony lies in the contrast between the effectiveness of these tools in writing and your personal strength in face-to-face communication.

The second example of irony is that Grammarly, a tool designed to enhance writing and make corrections, ends up making corrections to the text generated by ChatGPT. Here, the irony arises from the fact that a tool meant to improve the quality of the text is itself making changes to the output of another tool that is supposed to assist in generating text.

Overall, both examples demonstrate a contrast between expectations and reality, highlighting the ironic situations in your statement.

The system had not understood how I had used irony in the sentence but said that the overarching point I was making was ironic.

This image is of a person standing, with their eyes focusing as if they're looking at someone else who might be sitting down, because their chin is tilted down a little. The wording across the top of the image reads: I am still none the wiser if I used irony correctly in the parenthesis when I keep adding examples to a final point. The wording along the bottom of the image reads: And at this point I'm too afraid to ask.

Conclusion

In conclusion, ChatGPT ‘saved my life’ by allowing me to interrogate my writing in a way I have never been able to before. We should promote ChatGPT to students as a resource that can help tighten up their drafts before needing academic support. It should be utilised to alleviate the burden on academics, who are often asked to critique early drafts of work. Academics should hopefully then only see much more polished versions of submissions that require less input from them. 

As a final example, I didn’t like my last sentence. ChatGPT gave me another version:

It should be used to relieve the burden on academics who are frequently asked to critique early drafts. Ideally, academics would primarily review more polished submissions that require minimal input.

I didn’t like that version either. Maybe then I should just delete it? That is where the human side wins out over AI, your sense of self and how you want to sound when writing.

AI is here to stay (and take over the world if the Terminator documentaries are anything to go by), but actually, that is alright (AI being here as a tool, not taking over the world). At levels 4 and 5, we need to find creative ways to incorporate AI tools into the assessment process (which may mean fewer essays). Levels 6, 7 and 8, it’s about using AI to help improve our own voice but not lose it. 

The ChatGPT re-write: How ChatGPT Revolutionized My Writing Process – The AI version.

Credit Image: Photo by rupixen.com on Unsplash

Image in the text created by T. Langston using imgflip.com

WiseFlow ePortfolio – Unlocking the power of WiseFlow: Transforming ePortfolio assessments

In the digital age, traditional paper-based portfolios have given way to ePortfolios, harnessing a powerful way to showcase a student’s work that demonstrates their learning, progress, reflections and achievements, over a period of time. ePortfolios are increasingly becoming popular in education as they offer several benefits to both students and academics.

For students, ePortfolios provide an adaptable platform to showcase their learning journey, including their best work and reflections on when it didn’t go quite to plan, and draw on evidence from a range of sources whether that be PDFs, images, videos, audio snippets or written text. This process helps students develop their metacognitive skills and self-awareness as learners over a period of time.  Academics, on the other hand, can use ePortfolios to assess students’ learning outcomes in a more comprehensive and authentic manner. In turn, this allows academics to gain insights into students’ thought processes, identify their strengths and weaknesses, and provide targeted feedback. Additionally, ePortfolios allow academics to track students’ progress and provide evidence of their achievements.

Using ePortfolios also builds several skills, including digital literacy, communication and critical thinking – all of which are vital in the modern workplace. Students have to select, curate, and present their work in a clear and engaging manner. They also have to reflect on their learning process and map this to learning outcomes. These skills are crucial for success in the modern workplace, where digital communication and collaboration are essential. With a background in teaching vocational courses for 12 years at Further Education level, I’ve seen first-hand the impact and outcomes of effective ePortfolio use for both students and academics. 

At Portsmouth University, we have struggled to find a solid ePortfolio solution. We currently use a popular open-source ePortfolio platform that allows students to create and share their digital portfolios. While the platform has several benefits, including flexibility, customizability, and integration with other systems, it also faces some challenges. One major issue is its user interface, which can be overwhelming and confusing for some users – particularly in the setup stage of having to import the portfolio into your own profile. This process often leads to a lot of technical issues and puts up an immediate barrier to entry for those not tech-savvy. Additionally, the learning curve for using the platform can be steep, and it may take some time for users to become familiar with all the features and functionalities. However, despite these challenges, academics and students value the use of the ePortfolio system on offer and the benefits this provides.  

We are currently coming towards the end of our first stage of a pilot with a new system: WiseFlow. This is a cloud-based digital end-to-end exam and assessment platform that supports the assessment and feedback lifecycle for students, assessors and administrators. It’s fair to say that staff feedback about the WiseFlow pilot has been overwhelmingly positive. As a core project team, we’ve had the pleasure of working with academic teams to support students with innovative assessments in Wiseflow, across a range of disciplines. This all links to our Digital Success Plan to (re)design robust assessments to meet the needs of the diverse student population within a blended and connected setting and incorporate a robust specialist end-to-end assessment platform. Our aims in the project were to make it easier for academics to design assessments, easier for students to find their assessments and feedback, and reduce the manual workaround assessments for academics and support staff.  All of which, WiseFlow seems to have been able to deliver. 

Within the pilot, we wanted to really push the boundaries of WiseFlow – utilising a wide range of assessment types to really test if WiseFlow can become the go-to platform for assessments at Portsmouth University.  One of the big challenges for us was to find an ePortfolio solution that is user-friendly, and adaptable across a range of disciplines as well as providing a versatile feedback loop where students could receive formative feedback on their work from assessors and develop ideas, prior to final submission. After challenging the team at WiseFlow to this – they came back with a solution. Block arrows showing the timeline of a flow ePortfolio for Online Course Developers, eLearn Team, Students and Academics

Traditionally, a FlowMulti (just one of the many ‘flow types’ WiseFlow offers for assessment) would be used for open/closed book multiple-choice exams, where the participants fill out a provided multiple-choice test.  However, the team at WiseFlow suggested we could utilise this functionality to use as a bespoke ePortfolio solution.

Using a FlowMulti allowed us to replicate the layout and design of current ePortfolios as well as allow us to adapt the setup to truly take ePortfolios to the next level. To create the feedback loop, we allowed assessors early access to the work, early release of feedback to students, and students to submit unlimited times before the deadline.  The portfolios could be easily updated year-on-year, were inviting for students to engage with, and could be authored by multiple academics at the same time. This seemed like the perfect solution.  

After testing, adapting and re-testing, we felt this solution offered a totally new level of ePortfolio to our current offering. The ability to re-purpose traditional multiple-choice questions allowed us to push the boundaries of assessment further, like never before. The only limitation is our own creativity to adapt and repurpose these. We put together a showcase of a PGCert portfolio to show our academics the findings, who immediately fell in love with the platform and we started working together to develop a portfolio to run within the pilot.

“As a course team, we are incredibly excited about the flexibility that the Wiseflow ePortfolio has to offer. Working with the project team we have been able to design a summative assessment vehicle which is both intuitive for learners and versatile enough to encompass a broad range of tools which enable the course Learning Outcomes to be demonstrated in an engaging and meaningful way.”  Dr Joanne Brindley, Academic Practice Lead & Senior Lecturer in Higher Education.

A screenshot of an image taken from a computer of the page that the participant will see asking them to reflect on their skills. A screenshot of an image taken from a computer of the page that the participant will see. The image is of empty drop box for the participant to upload their activity into it. A screenshot of an image taken from a computer of the page that the participant will see asking them to type up a reflective statement on the using of Technology to support learning.

We are now in the “participation” phase of two ePortfolios – one for the Research Informed Teaching module and one for the new Level 7 Teach Well: Principles to Practice professional development module.  We have had great experiences re-designing pre-existing portfolios to really push the boundaries of what is possible in WiseFlow. We’ve added interactive elements, by turning traditional questions and approaches on their head – such as using a histogram for reflection, allowing students to visually reflect on skillsets pre- and post-observation. We’ve provided students freedom of choice with assessment by integrating a voice recorder into the portfolio and also utilising existing platforms to integrate into the WiseFlow portfolio. Really, the only limitation is our own imagination.  

“We teach the PG Cert Higher Education so our students are staff. The platform is incredibly user-friendly for both staff and students. We used it for ePortfolio as the last platform created lots of complaints, whereas this platform has led to lots of compliments.  The staff members spoke highly of the platform and I believe, many have asked to be part of the pilot next year due to their positive experience.”  Tom Lowe, Senior Lecturer in Higher Education

There has been overwhelmingly positive feedback from academics and students regarding the usability and functionality of using WiseFlow as an ePortfolio solution.  Through word of mouth and firsthand experiences from early career academics, particularly those who are studying on the Research Informed Teaching module, the platform’s potential in enhancing their own teaching has become widely recognized.  I remember being invited to one of Tom’s lectures to showcase the platform to his students who would be using it and the response was overwhelming. Staff were excited to use this as students and saw the immediate potential for their own teaching. It is always a good sign of a new innovation when there is an immediate benefit to both staff and students that can be applied instantly in the classroom. Essentially, we now have a waiting list for academics who are wanting to work with us to develop ePortfolios in WiseFlow – with no advertising at all and purely from those who have used it as students. We believe that when this is advertised, we will see a huge influx of academics wanting to use this. We have also spoken to other Universities in WiseFlow user groups, who are actively keen to explore this and want to learn about our innovative approach. The potential of this solution is game-changing, not just for us, but for other Higher Education institutions. 

However, using an innovative approach and essentially turning a quiz assignment on its head does not come without some drawbacks that need to be considered before academics embark on an ePortfolio solution within WiseFlow.  There is currently a 12-file limit, set at 10Mb per file when students upload files into the portfolio. Although it is great that students can do this, it does not lend itself to modern file sizes or some of our subject areas (for example, our Creative and Cultural Industry Faculty, where students would regularly upload large .psd, CAD files, HD video, and high-quality audio etc). In our initial pilot, we haven’t encountered this issue – but it’s worth considering if this is the correct way to proceed with an assessment. The limit on the number of files is also a concern. For example, some students in our pilot have reached the 12-file upload limit. While there are workarounds, such as storing files in a Google Drive folder and sharing the link or combining multiple files into one, however, it defeats the purpose of an ePortfolio as an all-encompassing system. Perhaps, a better approach would be to have an upload limit as a whole, with a defined combined file size.  The final consideration to make is that once the ePortfolio is live, we cannot make changes.  We’ve worked extensively with academics and our support teams to iron out any issues prior to release, but again, this is important for academics to understand. Careful planning and consideration must take place in the authoring phase of an assignment, which will then be rigorously checked prior to release – in the same way an exam would. Despite these setbacks, we’re actively in discussions with WiseFlow regarding developing this and hope to make progress on these in the near future. 

The future of ePortfolios in WiseFlow is exciting, and we can’t wait to see how they will continue to be developed across the University. The ability to adapt and transform ePortfolios will open up new doors for our students and academics to really develop the ways in which students can showcase their knowledge and understanding. We’re hoping for a successful run of ePortfolio use within our pilot and looking forward to developing new ideas as we move into the future.  

Until next time. Watch this space.

Chris.

RIDE 2023 – Sustaining Innovation: Research and Practice

The Centre for Online and Distance Education (CODE) is a University of London initiative focusing on research, training, capacity building, and strategy and policy development to support innovation in online and distance education. On 28 and 29 March 2023, CODE held its 17th annual conference – a hybrid in-person and online event – on Research in Distance Education (RIDE). The theme of RIDE 2023 was sustaining innovation and sustainable practices.

Here are a half-dozen of my personal highlights and takeaways from the conference:

Photo of the outside of Senate House in London. A grey imposing Art Deco building.

Senate House London

  1. In-person conferences are better than virtual conferences. Last week I met someone from my undergraduate days, a person I hadn’t seen in four decades. And I caught up with a colleague from the early days of the TEL team, who is now working in London. (It’s remarkable how many Portsmouth EdTech people seem to have ended up in London!) It was great to reminisce and to hear what is new. These interactions I guess might have happened online, but I doubt it.
  2. Hybrid conferences are hard to get right. The Senate House was constructed in the 1930s, and it is simply not set up to handle a hybrid conference. The organisers did their best to ensure that in-person and online participants enjoyed an equivalent experience, but the limitations of the technology and the physical spaces in the building made it difficult. I can understand why conference organisers want to run hybrid events (and why teachers want to run hybrid lectures) but these are hard things to get right. I have attended many excellent online conferences, and many excellent in-person conferences, but I cannot recall a hybrid event that has ever worked seamlessly.
  3. The sector is continuing to debate and think-through the opportunities and threats posed by generative AI. Professor Mike Sharples, from the OU, delivered an excellent keynote address. He noted that he had given the talk several times recently, and each time he had to update it: developments in this field are currently happening on a weekly basis. (It was also interesting to learn that Mike began research into AI and education during his PhD – about 40 years ago!)
  4. The concentration on sustainability provided an interesting lens through which to view our practice. One session looked at the move from in-person, paper-based exams to online exams. The claim was that this was a much more environmentally friendly approach to distance education. That might be so – but a full accounting was not given of the environmental costs of online. A lot more research is needed.
  5. The University of London Worldwide is experimenting with AI tutors. The intention is not to replace human tutors with AI tutors but to see whether this technology can help provide some elements of a personalised education at scale. They are just at the start of this project – it will be interesting to see how it develops.

Credit Image: Photo by Open Journey

The AI Podcast – How we did it!

(Co-writer: ChatGPT)

There’s no doubt Artificial Intelligence (AI) will have a huge impact on the future of education and assessment.  I can’t think of a day that has gone past over the past few months where some form of AI chat hasn’t started within the office, often causing a healthy level of debate.  From the outrage of academics that students are using AI to generate degree-level work to the supposed “arms race” of technology companies to be the first to detect AI.  There’s no end to topics of conversation on the moral, technical, ethical and legal issues surrounding AI.    

With the Tel Tales Podcasts due to re-launch in the coming months, we thought it would be good to put AI to the test.  Could we create an entire podcast episode from AI?  Would it matter that it was AI generated?  Is this even possible?

To start the podcast off, we gave ChatGPT an open-ended initial prompt as follows…

“Write 6 questions to ask ChatGPT in a podcast about the impact ChatGPT will have on education”

Within a matter of seconds, ChatGPT was processing through its algorithms and writing a response to our initial prompt.  In less than a minute, ChatGPT responded with the following questions…

  1. How can ChatGPT be integrated into educational institutions to enhance the learning experience for students?
  2. What are the potential benefits and drawbacks of using ChatGPT in education, and how can these be mitigated?
  3. In what ways can ChatGPT be used to personalize learning for students with different learning styles and abilities?
  4. How can ChatGPT be used to facilitate communication and collaboration among students and teachers in online learning environments?
  5. How might the use of ChatGPT impact the role of teachers in education, and what skills might educators need to develop to effectively work with this technology?
  6. Could you conclude and summarise the impact that ChatGPT will have on education?

Looking at the response that was given, the questions that ChatGPT generated are certainly a good starting point, although very surface-level.  One of the biggest critiques of ChatGPT is the lack of “nuance, critical-thinking skills or ethical decision-making ability that are essential for successful journalism” (Lock, 2022).  Arguably, the questions generated cover a range of topics related to the use of ChatGPT in education that could lead to interesting and informative discussions.  ChatGPT is impressive on a surface level, but the reliance on using a machine for interaction or to generate conversations could lead to a loss of genuine human connection. The ability to connect with others through meaningful conversation and interactions is a fundamental aspect of being human.  The concept of outsourcing this to a machine could have detrimental side effects on our well-being and social skillset.  We learnt the true value of human interaction during the COVID pandemic and the severe impact the lack of meaningful human interaction had on mental health (Okabe-Miyamoto, 2021).  Without delving too deep into the content and ethical issues around this, the process took seconds to complete, with a total lack of human interaction apart from a very basic prompt.  Quite a scary thought!

These responses were then fed back into ChatGPT one at a time with the prefix “Write a 200-word response for a podcast to the question”, the results of this can be found at the bottom of this blog post.  Again, ChatGPT has provided plausible-sounding answers to its own questions.  However, it’s nothing new that we haven’t spoken about before, or anything game-changing.  Essentially, it’s just a series of ideas strung together from datasets.  We see themes that come up in nearly every answer around the “personalisation of learning” for students and how we can use AI to “engage” students.  The overemphasis in the responses on ‘buzzwords’ really highlights the lack of real input from a human; someone who is living and breathing this – an academic, a student, a head of school, a support team, a principal etc. Can we blame ChatGPT for its response?  Not really.  It’s done a pretty impressive job of answering its own questions and has generated some plausible responses, some of which will be popular with teachers – such as the reduction of marking load to allow teachers to focus on 1:1 learning with their students.  A glimmer of hope perhaps that ChatGPT acknowledges that a partnership between AI and teachers needs to be developed to unlock its full potential.  Maybe the machines are not taking over, just yet!

“With the right approach and training, ChatGPT can help usher in a new era of personalized, inclusive, and effective education.”  

After gaining our content, we used Speechify, to generate the audio.  Speechify has a range of voice actors – everything from Snoop Dogg to Gweneth Paltrow and uses AI to produce a natural voice, sensing the tone and intonation of text. Although the prospect of having Snoop Dogg; albeit a slightly static and stiff version of the OG himself, hosting our podcast would be amazing, we opted for British voice actors ‘Michael’ to host the podcast and ‘Stephanie’ to be the guest.  In recent news, David Guetta has spoken out about the use of AI in music and that “the future of Music is within AI”. There’s no doubt that this process of bringing AI-generated text ‘to life’ is taking the moral and ethical issues of AI writing and voice generation to a new level.  Could it be the next big “deep fake”; where AI voices are being used instead of the human equivalent?  Or that AI voices become so indistinguishable from the real human nuance of speech that it blurs the lines between reality and the matrix?  Either way, the results were good and we’re now starting to hear the results of our podcast.

After we had gathered our audio, we placed the audio files into Logic Pro X and used iZotope’s Ozone plugin for mixing and balancing.  The software uses AI to intelligently listen to the audio and suggest recommended settings.  We left everything with the settings that Ozone recommended for dynamics and equalisation – based on the audio files generated from Speechify.  It appears that gone are the days of building relationships with artists in a recording studio, akin to George Martin to refine and craft sound, when all that is needed is for an AI to “listen” and suggest settings, built on the foundations of those masters before. The final piece of the puzzle was to get some advertising for the podcast.  We asked ChatGPT to “write a tweet for @telportsmouth to advertise a totally AI-generated podcast for TelTales including hashtags” which has been used to advertise the podcast on our social media platforms.  We also asked Dall-e 2 to generate some AI artwork, with the prompt “AI-generated podcast from Tel Tales at Portsmouth University”, which you’ve probably seen before getting to this blog post. Did you even notice it was AI generated?  Had we not told you, would you have known? 

We loved creating this podcast.  In fact, it’s brought many more conversations into the office around the use of AI and how far we can (or should) push it.  Ultimately, ChatGPT is shaking the education sector to the core and making us re-evaluate our assessment methods – which is only ever a good thing!  ChatGPT is great at stringing a few sentences together to come up with a response.  However, is it not just generating content for content’s sake, with no real meaning?  Would you have even noticed this podcast was completely AI-generated, had we not told you?  Could we have made it more believable if we had “real-life” voice actors to narrate the script?  The answers ChatGPT gave for our podcast were plausible and spoke about relevant ideas and topics of discussion – but nothing more than that.  

With GPT4 on the horizon, will we see a ‘bigger and better’ version of this AI wizardry?  GPT4 promises to be able to respond to both text and images.  In theory, this multi-modal model should help the AI to understand the world we live in better and theorise more logical connections between datasets.  Perhaps this is only the beginning of our AI journey in education and further supports our need as educators to reevaluate our assessment methods.  As we’ve said before, this can only be a good thing!

Have we just done ourselves out of a job?  Probably not.  It is worth remembering that none of this was possible without that initial prompt and a “human” in the driving seat.  Does the future belong to AI? Not just yet, but it’s certainly one interesting journey we’re on!

Listen to the AI podcast 

Chris Wood

Follow me on Twitter @ChrisWoodTeach

References

Samatha Lock. (2022). What is AI chatbot phenomenon ChatGPT and could it replace humans? The Guardian. [Online]. 5th Dec 2022. Available at https://www.theguardian.com/technology/2022/dec/05/what-is-ai-chatbot-phenomenon-chatgpt-and-could-it-replace-humans [Accessed 14th March 2023].

Karynna Okabe-Miyamoto, Sonja Lyubomirsky. (2021). Social Connection and Well-Being during COVID-19. WHR 2021. 1(1), p.Chapter 6. [Online]. Available at: https://worldhappiness.report/ed/2021/social-connection-and-well-being-during-covid-19/ [Accessed 14 March 2023].

Artwork: AI-generated through Dall-e 2

Content: AI-generated through ChatGPT

Voice: AI-generated through Speechify

Mixing: AI-generated through iZotope Ozone

ChatGPT Responses

Question 1 Prompt:

Write a 200-word response for a podcast to the question “How can ChatGPT be integrated into educational institutions to enhance the learning experience for students?”

Question 1 Answer: 

ChatGPT, as a language model, has the potential to revolutionize the way students learn by providing personalized and interactive educational experiences. One way to integrate ChatGPT into educational institutions is through the use of chatbots. Chatbots powered by ChatGPT can provide students with instant feedback on their assignments, answer their questions, and provide additional resources that are tailored to their individual needs.

Moreover, ChatGPT can be integrated into learning management systems to create personalized learning paths for students. By analyzing a student’s learning history and performance data, ChatGPT can suggest customized learning resources and activities that are most relevant to the student’s interests and abilities. This can help students stay engaged and motivated as they learn.

Another way to integrate ChatGPT into educational institutions is by using it to create virtual learning assistants. These assistants can help students navigate complex topics, provide additional explanations or examples, and even engage in an interactive dialogue with students to promote deeper understanding and critical thinking.

Overall, the integration of ChatGPT into educational institutions has the potential to enhance the learning experience for students by providing personalized and interactive learning experiences that meet their individual needs and interests. By leveraging the power of AI, educational institutions can provide a more effective and engaging learning experience for students, preparing them for success in the modern world.

Question 2 Prompt:

Write a 200-word response for a podcast to the question “What are the potential benefits and drawbacks of using ChatGPT in education, and how can these be mitigated?”

Question 2 Answer: 

The potential benefits of using ChatGPT in education are numerous. ChatGPT can help personalize the learning experience for students, offer instant feedback and support, and assist with knowledge acquisition and retention. Furthermore, ChatGPT can assist in the creation of more engaging and interactive learning materials, which can improve student motivation and learning outcomes. However, there are also potential drawbacks to using ChatGPT in education. One concern is that the technology could lead to overreliance on AI, causing students to disengage from the learning process and rely too heavily on ChatGPT to provide answers instead of engaging in critical thinking and problem-solving. Additionally, there is the possibility of biased or inaccurate responses from ChatGPT, which could negatively impact learning outcomes. To mitigate these potential drawbacks, it is important to ensure that ChatGPT is used in conjunction with traditional teaching methods to encourage critical thinking and promote deeper learning. It is also important to ensure that the technology is thoroughly tested and evaluated for accuracy and fairness. Finally, it is important to provide appropriate training to both educators and students to ensure that they understand the role of ChatGPT in the learning process and can use it effectively. With these measures in place, the potential benefits of ChatGPT in education can be realized while mitigating potential drawbacks.

Question 3 Prompt:

Write a 200-word response for a podcast to the question “In what ways can ChatGPT be used to personalize learning for students with different learning styles and abilities?”

Question 3 Answer: 

One of the most promising applications of ChatGPT in education is its ability to personalize the learning experience for students with different learning styles and abilities. ChatGPT can analyze a student’s learning history and performance data to provide tailored resources and feedback that meet their individual needs.

For students who are visual learners, ChatGPT can generate images, videos, and other multimedia resources to enhance their learning experience. For students who are auditory learners, ChatGPT can generate audio recordings or podcasts. For students who are kinesthetic learners, ChatGPT can suggest interactive activities or simulations that allow them to engage with the material in a more hands-on way.

In addition, ChatGPT can provide targeted feedback and support that is customized to a student’s strengths and weaknesses. For example, if a student is struggling with a particular concept, ChatGPT can generate additional practice problems or explanations to help them master the material.

Overall, the ability of ChatGPT to personalize learning for students with different learning styles and abilities has the potential to significantly improve learning outcomes and engagement. By leveraging the power of AI, educational institutions can create a more inclusive and effective learning environment that meets the needs of all students, regardless of their learning style or ability.

Question 4 Prompt:

Write a 200-word response for a podcast to the question “How can ChatGPT be used to facilitate communication and collaboration among students and teachers in online learning environments?”

Question 4 Answer: 

ChatGPT can play a vital role in facilitating communication and collaboration among students and teachers in online learning environments. One way ChatGPT can achieve this is by creating virtual assistants that can provide real-time feedback and support to students. These virtual assistants can also help teachers by answering common questions, grading assignments, and providing additional resources to students who are struggling.

Moreover, ChatGPT can be integrated into online discussion forums and chat rooms to promote collaboration and engagement among students. ChatGPT can help students connect with one another and facilitate group discussions and peer-to-peer learning.

ChatGPT can also be used to create virtual study groups that can help students collaborate and learn from one another. By analyzing students’ learning histories and performance data, ChatGPT can suggest study partners or groups that are most likely to benefit from working together.

Finally, ChatGPT can be used to facilitate communication and collaboration between teachers and students. ChatGPT can help teachers provide real-time feedback to students, answer questions, and provide additional resources as needed. This can help create a more supportive and engaging learning environment that promotes learning and academic success.

Overall, the use of ChatGPT in online learning environments has the potential to significantly enhance communication and collaboration among students and teachers, creating a more engaging and effective learning experience for all involved.

Question 5 Prompt:

Write a 200-word response for a podcast to the question “How might the use of ChatGPT impact the role of teachers in education, and what skills might educators need to develop to effectively work with this technology?”

Question 5 Answer: 

The use of ChatGPT in education has the potential to significantly impact the role of teachers. With the introduction of AI-powered virtual assistants, teachers can offload certain tasks like grading, answering common questions, and providing additional resources. This can free up more time for teachers to focus on providing personalized and individualized support to students.

However, with the introduction of AI-powered technology like ChatGPT, educators will need to develop new skills to effectively work with this technology. Educators will need to become proficient in using and managing AI tools to create effective learning materials and assessments. They will need to understand how to use ChatGPT to personalize the learning experience for students, as well as how to integrate it into their teaching practices to facilitate communication and collaboration among students.

Moreover, educators will need to develop skills in data analysis to better understand student performance and adjust their teaching accordingly. They will need to be able to interpret the data generated by ChatGPT and use it to provide more effective feedback and support to students.

In summary, while the introduction of ChatGPT has the potential to significantly impact the role of teachers in education, it also presents an opportunity for educators to develop new skills that can help them create a more engaging and effective learning environment for their students.

Question 6 prompt:

Write a 200-word response for a podcast to the question “Could you conclude and summarise the impact that ChatGBP will have on education?”

Question 6 answer:

In conclusion, ChatGPT has the potential to revolutionize education by providing a personalized and engaging learning experience for students. It can help educators offload certain tasks and enable them to focus more on individualized support to students. It can also facilitate communication and collaboration among students, promoting a more inclusive and supportive learning environment.

However, the use of ChatGPT in education also presents some potential drawbacks, such as the risk of over-reliance on technology and the potential for bias in the data used to personalize the learning experience.

To mitigate these drawbacks, educators must be trained in how to effectively integrate ChatGPT into their teaching practices and be able to interpret and analyze the data generated by the technology. It’s also essential to continue to monitor and address any potential issues related to bias and ethical concerns.

Overall, ChatGPT has the potential to significantly enhance the learning experience for students and support educators in creating more effective and engaging teaching practices. While there are potential drawbacks that must be considered, the benefits of using ChatGPT in education are too significant to ignore. With the right approach and training, ChatGPT can help usher in a new era of personalized, inclusive, and effective education.

As a sidenote, I used ChatGPT to create the tweet to accompany my blog post, please see below. The possibilities with ChatGPT are endless!

ChatGPT AI-Generated Tweet

🎙️ Listen to the new Tel Tales podcast generated entirely by AI 🤖🎧 Join us for fascinating stories and insights about AI and beyond. #AIGenerated #TelTales #PortsmouthPodcast #TelTalesPodcasts 🌊🎉

AI and Higher Education: Is it time to rethink teaching and assessment?

On 22 February I took part in a roundtable debate on the topic “AI and Higher Education: Is it time to rethink teaching and assessment?”, the event being organised and facilitated by Graide, a UK-based Ed Tech company that uses AI to provide improved feedback in STEM subjects. (I dislike the term ‘artificial intelligence’ in this context, but I think I am fighting a losing battle here. In the interests of clarity, I’ll use the term AI in this blog post.) 

Given the recent furore around generative AI, and its ability to create human-like outputs, Graide thought it would be timely to bring together a variety of voices – senior managers, academics, developers, students – to discuss the potential impact of this new technology on higher education. I was joined on the panel by Bradley Cable (student at Birmingham University); Alison Davenport (Professor of Corrosion Science at Birmingham University); Ian Dunn (Provost of Coventry University); Manjinder Kainth (CEO of Graide); Tom Moule (Senior AI Specialist at Jisc); and Luis Ponce Cuspinera (Director of Teaching and Learning at Sussex University).     

It was fascinating to hear the range of opinions held by the panel members and by the 400+ people who attended the event (and who could interact via polls and via chat). If you are interested in my opinion of the technology then you might want to watch a recording of the debate; alternatively, in the paragraphs below, I’ll attempt to summarise my feelings about Bing, ChatGPT, and similar programs.

* * *

It is easy to see why there should be fears about this technology, particularly around assessment: students might pass off AI-generated content as their own. Critics of the technology have numerous other, entirely valid, concerns: the models might produce biased outputs (after all, they have been trained on the internet!); companies will presumably start to charge for access to AI, which raises questions of equity and digital poverty; the output of these models is often factually incorrect; and so on and so on.

But this technology also possesses the clear potential to help students learn more deeply and lecturers teach more effectively. 

I believe that if we embrace this technology, understand it, and use it wisely we might be able to provide personalised learning for students; design learning experiences that suit a student’s capabilities and preferences; and provide continuous assessment and feedback to enable students themselves to identify areas where they need to improve. The potential is there to provide at scale the sort of education that was once reserved for the elite. 

Note the emboldened if in the paragraph above. To obtain the outcome we desire we need to embrace and explore this technology. We need to understand that the output of large language models relies on statistical relationships between tokens; it does not produce meaning – only humans generate meaning. And we need to use this technology wisely and ethically. It is not clear at this point whether these conditions will be met. Instead, some people seem to want to shut down the technology or at least pretend that it will have no impact on them.

I have heard numerous academics respond to this technology by demanding a return to in-person, handwritten exams. (Would it not be better to rethink and redesign assessment, with this new technology in mind?) I have even heard some lecturers call for a complete ban on this technology in education. (Is that possible? Even if it were, would it be fair to shield students from tools they will have to use when they enter the workforce?) 

* * *

Fear of new technology dates back millennia. Plato, in the Phaedrus, a work composed about 370 BCE, has Socrates argue against the use of writing: 

“It will implant forgetfulness in their [the readers] souls. They will cease to exercise memory because they rely on that which is written, calling things to remembrance no longer from within themselves, but by means of external marks.”

Ironically, we only know about Plato’s argument against writing because it was written down.

More recently, some critics argued that the introduction of calculators would impair students’ mathematical ability. (The research is clear: children’s maths skills are not harmed by using calculators – so long as the devices are introduced into the curriculum in an integrated way.)  Even more recently, some people argued that spellcheckers would impair students’ ability to spell correctly. (It seems the reverse might be the case: students are getting immediate feedback on spelling errors and this is improving their spelling.)

Perhaps it is a natural human response to fear any new technology. And in the case of generative AI there are legitimate reasons for us to be fearful – or at least to be wary of adopting the technology.

But the technology is not going to go away. Indeed, it will almost certainly improve and become more powerful. I believe that if we are thoughtful in how we introduce AI into the curriculum; if we focus on how AI can support people to achieve their goals rather than replace people; if we produce a generation of students that use the technology effectively, ethically, and safely – well, we could transform education for the better.  

Credit Image: Photo by Stable Diffusion 2.1

Introduction for Tel Tales – Beth Hallissey

Hi, I’m Beth. I have just started in the TEL Team within DCQE. I’m based at Mercantile House where I already have a reputation for wearing flashy shoes from my extensive collection! I work Wednesdays, Thursdays and Fridays for TEL, and on Mondays and Tuesdays, I work next door at the Dental Academy next door as a Teaching Fellow. I moved to Portsmouth recently so I’m still getting my bearings and exploring the area. So if anyone has any recommendations (particularly food), please let me know!

My career had a bumpy start; I went to Drama School aiming for a degree in Stage Management and dropped out after 2 years. I then worked at a school as a Design and Technology Technician before going for an apprenticeship in Dental Nursing. Dentistry isn’t a field I ever thought about; even in the interview when they asked what experience I had, I told them I had “Dentist Barbie” as a child. I now owe my career to Dentist Barbie because I got the job, and keep a “mint in box” version of her at home.

After a couple of years in practice, I got a job at Plymouth University doing clinical demonstrations and a bit of teaching in their Dental Simulation sites. After nearly 8 years, I had become Senior Technician for Dentistry, I had an honorary contract with the National Examining Board for Dental Nurses as one of their OSCE examiners, and would support the British Antarctic Survey, training doctors in Dentistry. I’m very passionate about EDI; I was Co-Chair of their LGBT+ Staff Network and a regular guest speaker on their Springboard programme.

As you can imagine, I have a big interest in simulation technology. I have created some training resources using 3D Printing including my own “Dexterity Block” for students to develop practical skills, which has been successfully used in education over the last few years. My work has been featured on the front cover of Dental Update, and I have helped design programs for Haptic Simulators that have been used around the world. I’m really looking forward to playing with all the new tech Portsmouth has to offer!

I feel my role in TEL will complement my teaching role over at the Dental Academy really well. I’m also looking to do the HEA Fellowship in the future. I’m a big fan of Moodle and have used it previously. I think it’s utilised really well here by being integrated with so many apps, so I’m keen to be involved with it. I’m interested in Gamification and its impact on student progression. I think technology is so important in education, even more so now in a post-pandemic world. Students are incredibly lucky to have a range of accessible resources to suit various learning styles and keep them engaged. Perhaps I would have done better at school if I’d had access to what they have…

Image of Beth holding her pet African Pygmy Hedgehog named Chorge.Outside work, I dedicate my time to being a massive nerd. I spend probably far too much time gaming and building Lego than the average adult should, but I have no plans to grow up just yet! (I stillneed to get Lego Optimus Prime). I love music but it’s been many years since I picked up a guitar. Instead, I have been a local radio DJ, creating music quizzes and playing everything from Abba to Zappa. Most importantly, I have a pet African Pygmy Hedgehog named Chorge!

The Art of Sketchnoting

I’ll start this one off with a disclaimer. I do have an A Level in Art. Please don’t judge me.  

I remember this like it was yesterday, as I sat as a delegate in a training session. The trainer came over to me and boldly called me out in front of my colleagues: “Am I boring you? What are you doing? This is important, you need to engage and be taking notes!” To the untrained eye, sketchnoting can seem like the mind is wandering and all that is generated is a creation akin to that of Mr Doodle. Little did they know that I was deep in thought, connecting the dots in my head and arguably taking better notes than most in the room.  

In its most basic form, a sketchnote is a visual representation of information often crafted from a mix of drawings, shapes and handwritten elements. I first came across sketchnoting in 2019 while at the Apple Distinguished Educator institution in Amsterdam. I was fascinated by the process – visual stories that came to life right in front of me! Simple drawings and illustrations, personalised to the creator. A new approach to note-taking! Of course, the iPad and Apple Pencil provided the perfect vehicle for this, however, there’s no stopping a creator with a pen and paper either. 

The Power of Sketchnotes – Scriberia

Visual note-taking has been found to have a number of benefits in academic settings. Studies have shown that students who use visual note-taking strategies tend to have improved comprehension and recall of material (Mayer, 2014). Additionally, visual note-taking can help to promote active learning and engagement with the material (Koszalka, 2015) and also support the development of critical thinking and problem-solving skills (Nelson & Narens, 1980). Sketchnoting allows creators to make connections between different pieces of information and to see the big picture, rather than simply focusing on individual facts. A study by van der Meijden, Paas & van Merriënboer (2015) found that visual note-taking strategies were effective in improving the retention of complex information and that students who used visual note-taking strategies scored significantly higher on a test of recall than students who used traditional note-taking methods. 

hand drawn sketch titled Data Protection

Credit: Chris Wood – Data Protection 

You don’t have to be amazing at drawing to sketchnote. While I am not gaining a nomination for the Turner Prize this year, the process is what matters here (as an honest answer, I see myself as more of a knock-off Banksy you ordered from Wish than Picasso). Sketchnoting is a skill that takes time to develop, but the results can be astonishing. When I first started to sketchnote, I found a few skills that I needed to develop quickly, for example being able to actively listen and draw. However, I now find I am able to recall more information than I could with ‘traditional’ note-taking. More importantly, I am able to synthesise new and existing information much more easily, creating deeper learning and understanding more quickly. I could also turn typically mundane training sessions like a GDPR workshop (no offence if that’s your jam!) into something much more visually appealing and engaging.  

Hand drawn sketch on how to make a latte Hand drawn sketch on how to make a latte Sketch drawing on how to make a latte

In 2022, I remember running an INSET session for teachers on the benefits of sketchnoting and you can see the results above. We used a YouTube video on ‘how to make a latte’ as a stimulus and simply drew (because we all know teachers love coffee! Surely this was a winner in itself?!). I asked the teachers to discuss their sketchnote and tell me how to make a latte. All the teachers said they were able to recall more information than using traditional note-taking techniques and had a better understanding of the topic because they were actively engaged. They were able to link new and existing knowledge together and see the big picture like never before. 

Examples of Sketchnoting

Credits:

Slides 1 and 2 – Lynsey Stuttard – Coaches corner, 1564

Slides 3 and 4 – Chris Galley – Inquiry by the fire, The equal classroom 

Slides 5 and 6 – Mathew Pullen – New curriculum, Data

Slides 7 and 8 – Kammas Kersch – Get Goog-smacked, How to organise a state summit

Slide 9 – Chris Wood – VESPA mindset

The sketchnotes above are from a range of educators, taken within conferences, classes, meetings and workshops. Simple use of colour, shape and text is often the best way to start.  Using these elements to create contrast and highlight key ideas. Each sketchnote has its own style that is unique to the creator – over time your sketchnotes will develop their own personality. It is important to remember sketchnotes aren’t a transcription. There is no way to capture every single word – and you don’t want to! There is also no right or wrong way to create a sketchnote. Sketchnoting is not a strict format, and shouldn’t be treated as such. It is deeply personal to the creator. Quite often the biggest challenge to overcome is the one of self-belief, that I can do this. Creators should feel proud of their sketches, embrace mistakes and evolve their own style. We must also acknowledge that visual note-taking is not necessarily a direct replacement for traditional note-taking methods but rather a supplement. It can be used in conjunction with traditional methods to enhance the learning experience.  

Apps such as Freeform “help users organise and visually lay out content on a flexible canvas, giving them the ability to see, share, and collaborate all in one place without worrying about layouts or page sizes”. The possibilities are endless for sketchnoting and even collaborative approaches. Do we need to change the rhetoric around what is effective note-taking? Or even what it means to be ‘actively engaged’ in a session?   

I hope you’ve enjoyed reading this blog post. Why not sketchnote what you’ve learnt? Or try sketching your ideas in the next meeting or workshop you attend? Share and celebrate your sketchnotes. I’d love to see what you come up with – make sure to tag me on Twitter: @ChrisWoodTeach 

Until next time. 

Chris Wood – eLearning Support Analyst

References:

Mayer, R. E. (2014). The Cambridge handbook of multimedia learning (2nd ed.). Cambridge University Press.

Koszalka, T. (2015). The effectiveness of visual note-taking for college students. Journal of Educational Technology Development and Exchange, 8(1), 1-11.

Nelson, L. D., & Narens, L. (1980). Complex information processing: The impact of the visual display on memory. In G. H. Bower (Ed.), The psychology of learning and motivation: Advances in research and theory (Vol. 14, pp. 53-81). Academic Press.

van der Meijden, H., Paas, F., & van Merriënboer, J. (2015). The effects of visual note-taking on learning and transfer. Journal of Educational Psychology, 107(1), 1-13.

For further blog articles from the TEL team on doodling, check out Marie’s ‘Is it time to give doodling an image make-over?

PDFs: Particularly Dependable Format? Pretty Dull, but Functional? Or Profoundly Dreadful Files!

Introduction

PDFs aren’t something I’d normally spend much time thinking about (I much prefer swimming or learning the guitar in my free time). The format barely existed when I was doing my undergraduate degree, so when I came to my Masters 20 years later, I was thrilled that there was this simple way to get all my reading material on my computer or iPad. OK, it was mildly exasperating that it was fiddly to highlight or copy text for my notes, but it was a small price to pay for how readily available all the information was.

However, a recent meeting with the European Ally User Group has given me a whole new perspective on PDFs. It raised various questions about how useful they are, from both an accessibility and a study skills perspective.

The problem with PDFs

In the best-case scenario, an accessible PDF can be created from a Word document by including things like alt text to describe images and using appropriately styled headings. A screen reader should be able to cope with a PDF generated in this way.

But even in this best-case scenario, PDFs are not ideally suited to online academic reading and research. Students will struggle to annotate, highlight, or copy-and-paste parts of the text without downloading extra apps. Regarding accessibility, PDFs do not address needs for changing fonts or colours. And most PDFs are designed to be printed on A4 rather than viewed on a screen – the size doesn’t change automatically to suit the device and browser, so the user will have to rely on zooming and scrolling horizontally as well as vertically. 

What about the worst-case scenario? This would be where a page has been scanned to produce a PDF. As well as exacerbating the issues described above, screen readers may not be able to get any useful information since the text will just be an image, rather than readable characters.

There is some help available: students can use Blackboard Ally to transform PDF files to a format that suits their needs. However, this isn’t 100% reliable as I found in some experiments with older, scanned PDFs. For example, using Optical Character Recognition (OCR) on a PDF with what appeared to be a shadow effect on a title resulted in double letters, changing Week 1 to WWeeeekk 11. There were also some unfortunate effects from tables – where a cell spanned two rows, it shifted all the data in the first row into a column to the right. But anyone using a screen reader would already be having issues with these documents anyway. So wouldn’t it be nice if students didn’t have to rely on this kind of fix – if the file was already conveniently available in a form that would work for all users?

Solutions

Let’s start with the bare minimum – avoiding the worst-case scenario and making sure that PDFs are nicely structured for screen readers. When creating your own PDFs from Word, follow these general accessibility principles:

  • add alt text to images (right-click an image and select ‘alt text’)
  • avoid tables unless they are necessary (and don’t merge cells)
  • use styles for formatting headings and text to improve page navigation and give structure to the document (proper use of styles will change your life, I promise – see this Quick styles video for how to use them if you don’t already)
  • in Word, click on ‘check accessibility’ from the Review pane for additional recommendations
  • use ‘save as PDF’ or ‘export to PDF’ rather than ‘print to PDF’ to preserve the document structure and any hyperlinks (ensuring you’ve selected ‘Document structure tags for accessibility’ under Options) 
  • if you have access to Adobe Acrobat Pro, you can also run an accessibility check with this, which will give helpful suggestions for fixing any issues

If you’re using a scanned file, have a look for an online text version. If you can’t find one, as a last resort you may be able to use optical character recognition to update scanned PDFs. Unfortunately, this will not work for mathematical notation – formulae are notoriously difficult to make accessible.

But can we do better than that? Well, why not move away from PDFs entirely? A potentially really accessible alternative (for your own content, at least) is to consider putting it in a Moodle page or book rather than locking it inside a PDF. This will have the bonus for you that you’ll be able to edit it easily whenever necessary – and if another lecturer takes over a module from you, they’ll be able to easily update this content. You can also use the selection of lovely formatting styles in the page content editor under the teardrop icon 💧 to improve the page appearance while maintaining accessibility.

Final thoughts

Throughout the Ally webinar that I mentioned at the start of this blog post, participants were sharing their institutions’ PDF policies and recommendations in the chat. These included promoting the use of ePubs, converting all PDFs to HTML, providing both PDF and HTML alternatives, or recommending linking to accessible Google docs instead. The general feeling was very much one of PDFs being on their way out – and no one sounded sad to see them go. Would you miss them?

If you’re interested in accessibility in Moodle, contact Tom Cripps (tom.cripps@port.ac.uk) for more information and support.

Credit Image: Photo by Andrea Piacquadio: https://www.pexels.com/photo/young-troubled-woman-using-laptop-at-home-3755755/

« Older posts

© 2024 Tel Tales

Theme by Anders NorénUp ↑