Tel Tales

Adventures in Technology Enhanced Learning @ UoP

Tag: student experience (Page 3 of 4)

A side photo pf a person speaking into a microphone

Guest Blogger: Simon Brookes – A content capture policy for the University

January 13, 2020 / / 0 Comments

For several years, the University has provided staff with the technology to record video and/or audio for the purpose of extending teaching and learning activity beyond the confines of the classroom. This has included the provision of limited lecture capture technology in some large lecture theatres, as well as providing access to software that allows staff to produce learning materials on their computers.

The content captured in these ways is of particular use for revision purposes, for scrutinising difficult concepts, for students with caring responsibilities, and for students for whom English is not their first language.

In response to growing demand from our student body, the University has been investigating the possibility of expanding the availability of content-captured materials. This investigation was co-ordinated by the Content Capture Working Group, and included a full consultation with all University staff and students, via online surveys, as well as in-depth discussions at a series of “town hall” meetings, which were attended by staff and students from across the University.

This consultation informed the development of a Content Capture Policy, which is now available here, in draft format, for further scrutiny. This Policy aims to promote inclusivity and increase the accessibility of our teaching whilst reducing any potential barriers to learning. By implementing these adjustments, which would benefit all students, it should reduce the need for individual adjustments, promote good practice and maximise learning opportunities. If you would like to provide feedback please email it to Harriet Dunbar-Morris, Dean of Learning and Teaching, at DeanLandT@port.ac.uk.

The Policy will go to the University’s Student Experience Committee, before making its way, via the University Education and Student Experience Committee, to Academic Council for final approval. It will then be published in time for the start of the next academic year.

We will be introducing staff development sessions prior to implementation. Please look out for these.

Image Credits: Photo by Forja2 Mx on Unsplash

Three female students kicking at laid snow, so that it covers the image

Moodle – Teaching Block 2 Modules

December 9, 2019 / / 0 Comments

One query which we often receive from students here in TEL (Technology Enhanced Learning), is a concern that one or more modules are missing from their Moodle homepage. This is usually because the modules they are enquiring about, are for Teaching Block 2.  Teaching Block 2 modules are normally hidden from student view until students return from the Christmas vacation. 

Teaching Block 2 starts this year on Monday 20th January 2020. However, this is not always the case as some modules have two different cohorts of students attached to them. These modules may have a short name that looks similar to this: UXXXXX-19SEP & UXXXXX-19JAN.  Depending how the module has been set up, both cohorts may have access to the unit in September, or maybe the January cohort have been put into a group and won’t be able to see the module until the lecturer releases it to them at a later date.

Lecturers decide when to release their Teaching Block 2 module(s). Some prefer to release them when the students leave for the winter vacation so that they can start looking at them, while others wait until the first day back or when the first session starts. Some students may be able to see their Teaching Block 2 modules now.  It really is up to the individual lecturer.

We’re often asked; ‘Why does the January code not reflect the new year?’ – for example, ‘Why does the code say 19JAN and not 20JAN, as the year would now be 2020? This is because the code is taken from the academic year in which the course started, so as this academic year started in 2019, the code you’ll see is 19JAN. However if your course starts in the new year, it will have the 20JAN code.

It can be confusing, but as long as you can see your module(s) when the lecturer says you should be able to see them,then there is no need to worry. If you can’t see your module(s), please email us at servicedesk@port.ac.uk and we can investigate this further for you

In the meantime, the TEL Team would like to wish everyone season’s greetings and a healthy and happy New Year!

Image Credit: Photo by Naitian（Tony） Wang  and Aaron Burden on Unsplash

 

boy singing on microphone with pop filter

Accessibility: Investigating Automatic Media Transcription

November 4, 2019 / / 0 Comments

Background

Accessibility is now an important aspect of digital learning. We need to take accessibility seriously both to satisfy the needs of an increasingly diverse student body and the requirements recently brought into law. Of course, digital learning often encompasses a wide variety of resources in a range of media. The challenge of bringing all these resources in line with regulations is considerable, both on a technical and organisational level. Fortunately technology can help to ease the burden, with a number of integrations available to help examine and fix content-related accessibility issues.

One particularly large challenge, and one that is particularly helped by the use of technology, is video. While it is possible to watch and transcribe a video manually, when faced with a library of nearly 8000 hours of video, the challenge becomes insurmountable! This is where technology can step in: it can automate the process and reduce the number of person-hours required.

For quite some time, YouTube has been able to automatically caption videos. In the past, however, the transcriptions produced by the algorithms have often been the subject of ridicule for the sometimes bizarre and hilarious interpretations. Thankfully things have moved on considerably, with increasingly advanced AI and machine learning helping to increase the reliability of computer transcription.

For the majority of our video content, we rely upon a home-spun system composed of a Wowza Streaming Media server and a custom-built front-end to manage content and metadata. While this system has the facility to allow subtitles to be added, it does not feature any way to automate the process of creating transcriptions. For this reason, we are currently investigating our options, with a view to either hosting our video content elsewhere or improving our current provision by implementing auto-transcription facilities.

The contenders

We have been investigating a few services to judge the accuracy of the transcription. We have tried each service with the same videos to see how accurately they can transcribe a variety of media content. Below are some details of three services we are currently examining.

Mozilla Deepspeech

An open-source option that can be run on-premises, Deepspeech requires a certain amount of technical skill in deploying and managing Linux servers. Being open-source and community driven, the more effort you put in, the better the output will be. It allows you to train your own neural network to increase the accuracy of transcriptions, so theoretically it would be possible to improve your transcription accuracy, although it may require a large investment of time and effort. As we are simply testing the out-of-box abilities, we have used the default models provided by the developers.

Google Speech to Text Engine

This is an API made available through the Google Cloud Platform. The service itself is used by YouTube to provide auto-transcriptions of uploaded videos. While using it through YouTube is free at the point of upload, utilising the API in your own projects can cause costs to rack up quickly (and remember that we have 8000 hours of video sitting on our servers, waiting to be transcribed). The pricing options are transparent, however, so we can easily calculate the cost of transcribing all of our existing content.

Amazon Transcribe

This cloud service is utilized by Amazon’s virtual assistant “Alexa” and works in a similar way to Google’s offering, with transcription charged based upon the number of seconds of content transcribed. The service is used by the content capture service Echo 360 to transcribe material. By our rough calculations, transcribing our 8000 hours of content through Amazon would be a little cheaper than through Google. 

The results

Here are some example transcriptions of one short piece of video content. 

Mozilla Deepspeech

so wee al seend apisode of the dragon tf dend where the ontroprenel holks in with a really great idea good looking numbers the dragons e recing out their hands and then one of the dragons pipes up let see your contract and os soddenly ontrepenelox exposed because they thought they had a contra they don’t what they have iser some verbal understanding your colercial contracts are really important to you business mey should be kept clear concise so the point to add value when seeking in bestment wor in ed if you come to sellin a business also commercial contracts areningportant to the void conslote because both sides of the contract should now wot their obligations are a more their rights are

Google Speech to Text (through youtube)

so we’ve all seen episodes of the Dragons Den where the entrepreneur walks in with a really great idea good-looking numbers the Dragons are eating out their hands and then one of the Dragons pipes up let’s see your contract and all the sudden the entrepreneur looks exposed because they thought they had a contract they don’t what they have is a some verbal understanding your commercial contracts are really important to your business they should be kept clear concise to the point to add value when seeking investment or indeed if you come to sell the business also commercial contracts are really important to avoid conflict because both sides of the contract should know what their obligations are and what their rights are

Amazon Transcribe

So we’ve all seen episodes of the Dragon’s Den, where the entrepreneur walks in with a really great idea, good looking numbers that dragons reaching out their hands. And then one of the dragons pipes up. Let’s see your contract over something. The entrepreneur let’s exposed because they thought they had a contract. They don’t. What they have is a some verbal understanding your commercial contracts of really important to your business. They should be kept clear, concise to the point. Add value when seeking investment, or indeed, if you come to sell the business. Also, commercial contracts are really important to avoid conflict because both sides of the contract should know what their obligations are, what their rights on.

Conclusion

As you can see from the output above, while the Mozilla software makes a good guess at a lot of the content, it also gets confused in other parts, inventing new words along the way and joining others together to form a rather useless text that does not represent what has been said at all well. I’m sure its abilities will improve as more time is spent by the community training the neural network. However, Google and Amazon clearly have the upper hand – which is not surprising, given their extensive user base and resources. 

While Amazon Transcribe makes a very good attempt, even adding punctuation where it predicts it should appear, it is not 100% accurate in this case. Some words are mis-interpreted and others are missing. However, in the main, the words that are confused are not essential to the understanding of the video.

Google Speech to Text makes the best attempt at transcribing the video, getting all words 100% correct, and even adding capital letters for proper nouns that it clearly recognises. There are options to insert punctuation when using the API, but this feature is not available in the YouTube conversion process.

From this (preliminary and admittedly small) test, it seems you get what you pay for: the most expensive service is the most accurate and the cheapest is the least accurate. Also, the headline cost of using Google Speech to Text on 8000 hours of video is not necessarily accurate. We need to remember that not all of this content is actively used: this is an accumulation of 8 years of content, and it’s possible that only a small fraction of it is still actually being watched. We now need to spend some time interrogating our video statistics to determine how much of the old content really needs to be transcribed. 

The best value compromise, if we choose to continue to host video ourselves, may be to transcribe all future videos and any that have been watched at some point in the last year. In addition, it should be possible to provide an ‘on-demand’ service, whereby videos are flagged by users as requiring a transcription at the click of a button. Once flagged, the video is queued for transcription and a few minutes later a transcription is made available and the user alerted.

Video title: Warner Goodman Commercial Contracts.
Copyright: Lynda Povey ( Enterprise Adviser) nest, The University of Portsmouth.

Image Credit: Photo by Jason Rosewell on Unsplash

An image with elements of assessments and feedback - edword, openess, assessment, flexible, api, 360, feedback

Great feedback is essential

October 3, 2019 / / 0 Comments

Wouldn’t it be great if students could read the feedback they’ve received for their assignment, write a short reflection on what they could do to improve (perhaps also identifying what they’d like to receive feedback on next time round) and then see their grade? 

Our current online assessment tools (Turnitin and Moodle Assignment) don’t allow us to do this. Luckily we know an assignment tool that does – and it has many other modern assessment feedback mechanisms too.

I’m passionate about helping improve assessment feedback for students. It’s one of the things I’ll be working on in my new secondment as a Senior Lecturer in Digital Learning & Innovation. On Mondays, Tuesdays and Wednesdays I’ll be working between the TEL and AcDev teams to help coordinate projects to better support academics, Online Course Developers and students with a focus on digital education. In particular, I’ll be working to help get a small pilot off the ground for EdWord – a fantastic new assessment tool that promises to address many of the requirements of modern assessment and feedback. If you’re interested in taking part in this pilot please let me know.

In addition, I’ll also be helping to establish an online staff community alongside the APEX programme featuring special interest groups. This will be a great place to make contact with like-minded staff from other faculties and exchange ideas.

Tom Langston and I will be creating a support mechanism for Online Course Developers who are interested in completing their CMALT portfolio and who might be interested in taking part in future elearning projects with TEL.

I’ll also be doing a bit of lecturing on the Research Informed Teaching programme, which I’m looking forward to. So this will be a busy year for me!

Please get in touch if you’ve got any ideas or projects we can help you with. Both the TEL and AcDev teams would appreciate  your feedback as we work to ensure we’re offering the services that will provide value to you and your students (you can reach me on ext. 3194).

Image credit: https://commons.m.wikimedia.org/wiki/File:Paper_Plane_Vector.svg

 

Episode 10 – Bartolomeo Meletti from Learning on Screen – Copyright

TelTaleBanner
TelTales Podcast
Episode 10 - Bartolomeo Meletti from Learning on Screen - Copyright
Loading
/

Copyright Resources:

copyrightuser.org

learningonscreen.ac.uk

The Game is On

BoB National

IPKat

1709 Blog

Nowhere Land – Kevin MacLeod (incompetech.com)
Licensed under Creative Commons: By Attribution 3.0 License
http://creativecommons.org/licenses/by/3.0/

Image of Goddess Minerva

Minerva – the university rethought?

August 12, 2019 / / 0 Comments

On 25 June I attended an Adobe/Times Higher forum called “Making digital literacy a pillar of education”, along with representatives from 40 or so other HE institutions.

There was no disagreement at the forum about the recent recommendation from the DCMS Select Committee that digital literacy should sit alongside the “3R’s” as a fourth pillar of education. Everyone agreed that, as the pace of technological change quickens, employers are less interested in a student’s knowledge than in their personal qualities – and in particular their ability to engage in lifelong learning. But there was no consensus on how universities can best prepare their students for life in a world in which digital technology will play an increasingly important role.

Of the institutions present at the forum, undoubtedly the most innovative approach to Education 4.0  was that adopted by the Minerva Schools. Minerva built a first-year undergraduate curriculum from scratch, but rather than base the curriculum on subject-specific knowledge they built it around 81 “habits of mind” and “foundational concepts”. Students engage in cross-contextual learning activities in small-seminar format, all of which require or exercise the use of those foundational concepts. Through these activities students pick up subject knowledge, but they are assessed on how well they satisfy the foundational concepts. 

In the first year of study the Minerva School’s students are based in San Francisco. Subsequently they spend time in Seoul, Berlin, London, Hyderabad, Bangladesh, Buenos Aires and Taipei. Sounds terrific! (And expensive…) And all of this is made possible using digital technology – it’s a fundamental enabling technology for Minerva.

Minerva Schools were able to take this approach because they were small, well resourced – and also because they were starting from scratch. It would be a huge task (probably an impossible task) for an existing university with thousands of students to change its curriculum in this way. But there might be elements of the approach that universities can adopt. It’s interesting that the Minerva project have recently opened its bespoke educational technology platform, called Forum, to partners: they claim that the platform, which was designed for use in a small-seminar format, can scale to support up to 400 students. It will be worth keeping an eye on this development. 

Image Credit: Commons Wikimedia: The Greek Goddess Minerva

All New Grackle accessibility extension for Google Docs & Slides

Grackle for accessible Google Docs and Slides

July 8, 2019 / / 0 Comments

I was chatting to an academic the other day. We were talking about the new tool in Moodle for automatically checking the accessibility of documents and providing alternative formats on-the-fly. It’s called Blackboard Ally and it’ll even give you step-by-step guidance on how to fix any accessibility issues (hint: click the meter icon for advice and guidance).

A screenshot of a Moodle site displaying the Blackboard Ally plugin and the accessibility icon next to a resource. The accessibility score is high

But wait they said, that’s fine for documents, Powerpoints and PDFs but I use Google Docs all the time, how can I improve those?

Ah, I said, you’ll need to use a bit of Grackle on that. It’s not for grouting your bathroom, it’s for fixing your Google Docs, so everyone can read them more easily.

Grackle comes in two flavours Grackle for Google Docs and Grackle for Google Slides. You just add the extensions to your Google Chrome browser and then launch Grackle from the add-ons menu as you’re creating your Google Slides or Documents.

A screenshot from Google Docs showing how to launch Grackle from the Add-ons, Grackle Slides, Launch menu item

Grackle produces a checklist of common accessibility problems and highlights any of these issues in your documents. It’s usually very straight-forward to fix them.

The most common issues are images without alternative text (descriptive titles of the images), poor contrast between text and background colours and lack of document structure / headings. These are easily fixed and Grackle will show you exactly where these problems appear in your documents.

A screenshot from Google Slides showing the Grackle accessibility advice panel.

Take a look at this website to find out more about the handy features of Grackle.

Disclaimer: Parts of this conversation may have been embellished for entertainment value…

Image Credits: Photo by Jason Leung on Unsplash

Jason Leung 

School chairs set into row as if people were going to take an exam

Assessment online – Are we past the “hand-in” date?

July 1, 2019 / / 0 Comments

Introduction

In eLearn, we have just reached the end of the exam period with our faculties intact (excuse the pun) and with very little drama (which is not normally the case). The sight of nervous students queuing up outside of Spinnaker for an exam inside a gym hall bought all those memories of dread I had experienced nearly 20 years ago flooding back.

When I think about how much has changed in the teaching landscape in terms of the integration of technology into teaching, as well as the diverse ways in which people attend university, I can’t help but feel this method of summative assessment is rather antiquated.

This could very easily turn into a blog about the nature of summative assessment, which I wrote far too many assignments about in 2004 as part of my teaching degree. I don’t want this to turn into a virtual trip down memory lane for myself but a means to highlight what is different and future possibilities.

The wonder of Turnitin

With my teacher hat firmly still on my head, I can’t be more positive about this technology when it comes to marking, having lived the late nights devoted to marking never ending piles of papers. True, it has its faults and the late nights may have merely been transferred from pen and paper to in front of a screen but it has so many facets designed to make the experience easier for both marker and student. You can’t help but feel its implementation has been a large forward step in the progression of assessment. Being able to customise and apply quickmarks across assignments prevents the numerous occasions “RTQ” would have to be written. The possibility of copy and pasting comments or highlighting text to directly link to aspects of a rubric are all seemingly small things that actually take hours when going through the work of 90 students and that is before you give personalised feedback that moves learning on.

The student gets a rich visual experience that can be accessed on any device and feedback is so easily obtainable/downloadable that it could only promote reflective practise. The hand-in process has changed dramatically with the long line outside of the faculty admin office with bound assignment in hand is a thing of the past and it can now be submitted in bed with a cuppa. Don’t get me wrong, you will still get students who will leave it till the last minute and those who perhaps have been a little too influenced by other sources within their writing but nevertheless a snapshot of this process in 2019 vastly differs from 2009 and is a world away from 1999. The same of which can’t be said for the end of year exam.

Quizzes – More than just for daytime tv

Perhaps it is slightly unfair to portray examinations at university to be solely desk based due to the increase in exams being carried out online using Moodle Quiz. The Quiz tool is far more powerful and robust than perhaps people realise. Yes you can use it to create multiple choice “pop quizzes” for the end of topic or to elicit prior conceptions at the start of something new but it can also be used to make 100 questioned essay-based behemoths which include a variety of different question types. Safe Exam Browser allows for it to be taken under true exam restrictions and the ease in which times and restrictions can be customised makes them far more accessible than its paper-based counterpart. Claro Reader software can be used to overlay colours and intuitively applies text-to-speech (dependant on how the exam has been written of course!). The possibility of including image or video within an exam assessment not only opens up a wealth of ways to question but leads me on to my next point.

The Audiovisual Essay

I was very fortunate to have witnessed a presentation from the inspiring Dr Catherine Grant who spoke about the concept The Audiovisual Essay in Film & Moving Image Studies. I would certainly recommend visiting the website, which explores the concept in great detail. There are some amazing examples and relevant research that has been undertaken about the subject. For those who are unfamiliar with this form it is essentially the expression of critical, analytical and theoretical work using the resources of audiovisuality (images/sound/video in montage) I begrudge trying to pigeon hole the genre further but it truly flies in the wind against sitting in a hall for 3 hours writing an English Literature exam. While it lends itself to creative, historical, visually rich courses and cannot be applied across the board, the premise of it being a “different” way to demonstrate understanding is valid.

Final Thoughts

This brings us back to assessment types and again perhaps explains the shift towards the greater emphasis on coursework-based assessment models. That in my eyes is a different debate, this blog is exploring whether sitting in hall to carry out an end of year assessment still has a place in modern university life. You have to question over their time in Higher Education, how many opportunities students get to sit at a desk for a considerable time and demonstrate their understanding in that way. Are we providing students with a rather unnatural medium by which to demonstrate their understanding? Does that in turn affect their ability to reach their true potential? Particularly as the end of year summative assessment the culmination of the blood, sweat and tears of their learning journey, do we not owe it to the learner to reassess the way we make this final assessment. The flip side of this is to give students more exam practice and opportunities but is this a direction where we want to go? To me that seems to be a practice that would be looking in the rear view mirror where I would argue we should have our eyes on the road ahead.

 

Featured Image:

Image by PublicDomainPictures from Pixabay

Exam Analytics Dashboard

Online Exams in Moodle

April 5, 2019 / / 0 Comments

We’ll start to see a lot of online Moodle exams from Monday 29th April.

At this time of year a lot of time is dedicated to preparing for the formal exam weeks to begin. Academics and Online Course Developers are creating questions and testing exam quizzes. The TEL team are testing the Moodle infrastructure and exam reporting, and working with IS to ensure we have enough server resources at key times during the exam period. This year the formal examination weeks will run from Monday 13th May 2019 through to Friday 7th June 2019. It’s worth making a note in your diary about these dates but as I’ll highlight in this blog post, you’ll probably want to set these dates to start from Monday 29th April.

What constitutes an online Moodle exam?

We encourage staff to tag Moodle-based exams with the ‘exam-official’ tag and set appropriate dates. This information, along with data provided by Online Courses Developers, helps us build a picture of the when exams are happening. It means we can spot ‘pinch points’, times where we expect a lot of concurrent exam attempts, which could represent a need for more server resources to be made available. In short if you don’t tag your assessments we’ll find it difficult to guarantee a seamless exam experience for your students.

Tagging also means you can run your online exams in one of our supported secure exam browser environments (Safe Exam Browser, FAQs available here or Chromebooks in secure exam mode). This means students can’t easily access other websites during their exam and makes invigilation a lot easier.

How many online exam attempts were there last year?

During the official exam period last year (13.05.2018–07.06.2018) there were 5426 exams attempts that we all helped support. However, this figure isn’t the full picture. In the two week preceding the exam period 2737 official online exam attempts took place. That’s quite a staggering number of exam attempts happening outside of the time-frame that staff are focussed on supporting and something we should all be mindful of this year. Monday April 29th is the start date for your diaries.

Exams change freeze

IS and TEL enforce a number of Moodle change freezes throughout the academic year. These are periods when no updates can be made to Moodle. We have one in place during the exam period to ensure changes don’t inadvertently interrupt exams. The exam change freeze this year will run from Monday 29th April through to Friday 7th June (inclusive).

How do we monitor exams are going well?

The TEL team gather data from a number of sources to help monitor what’s happening through the exam period. We combine it into a real-time dashboard of where exams are happening and how Moodle is performing. You can see a picture below from last year.

Exam Analytics Dashboard

We rely on support from a number of sources to produce this dashboard. Lead Online Course Developers have their finger on the pulse of when exams will happen and any last minute amendments. In the very near future we’ll be asking again for your help to populate a spreadsheet with the exams you know about. We combine this information with data from student records, which is thorough but lacks local knowledge. We also use Google Analytics, Moodle database and server infrastructure reporting to keep an eye on how our systems our performing. This combined data is extremely useful at spotting pinch points and monitoring how things are running but it’s not as effective as people in faculties such as exam invigilators and online course developers ensuring all is running well and reporting to elearn@port.ac.uk any issues that are encountered.

A new exam theme for Moodle

It’s worth mentioning at this point that we’re close to final testing of an updated version of the Moodle exam theme. This is a stripped down version of our theme intended for use in exams. We’ll provide more information on this in the next few weeks. It will look very similar to the existing exam theme but will be a bit closer to our regular theme in terms of question layout and styles.

Thank You

We just wanted to say a big thank you to everyone involved in making sure the exam period goes well. It’s very much a big team effort and all the work we put in ensures students get as stress-free an experience as possible. I’m sure they appreciate it, I know that the team in TEL certainly do.

If you have any questions about online exams, please get in touch at elearn@port.ac.uk

 

Thank You Image

Image credits: Photo by Lip on Unsplash

« Older posts Newer posts »

About This Site

We are a talented bunch of individuals that specialise in providing support, development and design to staff around the University. We help to support staff in using technology to enhance their students' learning. Follow our blog to see what the TEL team are doing!

University of Portsmouth

A grey background with the University of Portsmouth written in white capitals
Accessibility Statement

© 2024 Tel Tales

Theme by Anders Norén — Up ↑