Adventures in Technology Enhanced Learning @ UoP

Tag: feedback (Page 2 of 3)

Peermark – a tool for group feedback.

Recently Coventry University released a new plugin for Moodle around the idea of group and peer feedback. A colleague highlighted the new tool to me and at first glance I thought it looked like a promising solution to one of the requirements many academics have while running group work: the ability for students to score the contribution of individuals within the group and provide either public or anonymous feedback to group members.

Currently Moodle provides various options to support group work and peer learning, because Moodle HQ realises that these approaches hold an important place in the arsenal of many academics. Firstly, Moodle provides a generic framework for creating groups – these can then be allocated to an activity (such as discussion boards, wikis or group assignment submissions).

Secondly, and with a greater focus on the use of peer learning, Moodle provides the Workshop tool.

While groups can be Moodle Workshop screenshotadded and used within the Workshop, the idea is predominantly that students add a submission. The submission is then allocated to a specified number of their peers, who then grade and provide feedback on it.

If you haven’t used the Workshop tool in anger, here is a quick overview of how to use it as a peer-assessment tool:

  1. All students submit their work (traditionally this will be an essay, but it could be work in some other format).
  2. The work is allocated to the other students. This can be scheduled and automated if required.
  3. Every student marks the assessments they have been given (academics can also provide feedback, although this is not a requirement).
  4. Each student receives a final grade for the submission and a grade for their ability to assess the work (academics can overwrite grades should they feel the process has proven unfair).

This tool provides students a fantastic opportunity to reflect on their own writing and work while comparing it to that of their peers. However, it does not allow for a group to provide anonymous feedback to their peers on projects. To do this academics currently have to find solutions outside of Moodle. The most notable option for this is TeamMates. TeamMates allows groups to feedback on the overall project work and then score the engagement of the rest of the team throughout the project.

We now have a new Moodle-based solution! Peerwork, created by Coventry University, is an integration with Moodle that provides a peer feedback option for group work. You can learn more about this approach from the video they have produced:

While working through Peermark, I was really impressed with its simplicity of set-up and use. I created the framework as an academic, but also completed the process as a student. Using multiple test accounts, I was able to understand how the process would work from both sides and see how you can adjust the overall grade given to a group though the peer reviews on the work.

The only criticism was really just my understanding of what the tool did (so not really a criticism of the system). When I uploaded a document as a student it cascaded it to each other members of the group. Each student does not need to upload a file, it is targeting the students for feedback on their peers and how the group worked throughout a project. The upload was almost a secondary consideration to the process.

Peermark is not the Workshop reimagined. They are two very different tools that serve a specific purpose.

The Workshop facilitates a student writing a piece of work, submitting it and other students provide feedback and evaluation of that work.

Peermark allows groups to discuss, rank and analyse how the entire team worked together over the course of the project. The work is created by the team for evaluation by the academic but the feedback given by the group on each other member will directly affect the shared grade of the team.

Peermark is currently on a test installation of Moodle.

If you would like a demonstration to see whether it would fit your need, please contact tom.langston@port.ac.uk

Image taken from Unsplash :John Schnobrich
John Schnobrich

Engaging students with online assessment feedback

An Exploration Project

Technology Enhanced Learning and Academic Development are leading an exploration project centered around engaging students with online assessment feedback. We’re specifically exploring an assessment platform called Edword.

It’s worth mentioning that we’re taking a more scientific approach to this project, you could almost imagine it as an education lab experiment. 

Academics and educational technologists within our team have evaluated the functionality and advanced workflows that Edword offers. We think that it offers some real tangible benefits to students and staff. The platform has been designed based on some pedagogically sound principles, that’s really what’s most exciting about it. I’ll demonstrate some examples of these in action later in this post.

It’s not enough that we’re excited about a new assessment tool though. We need to explore and test whether our students and staff actually do experience a benefit from using Edword when compared to one of our existing assessment platforms such as Turnitin or the Moodle assignment.

In order for me to explain what Edword allows us to do, I need to explain what’s missing from our existing assessment systems. 

Current feedback workflow

Turnitin / Moodle assignment

Assessment graded, student sees grade, end of workflow

When an online assignment is handed back to a student via Moodle or Turnitin students see their grade immediately, before they’ve had a chance to read any inline or summary  feedback added by their lecturer. The grade is often seen by students as the end point within their assessment, their grade is a students entry point to the next stage of their course. What we actually want students to engage with is the meaningful and constructive feedback their academics have produced for them. This will help students improve their next piece of work. Unfortunately many students don’t read their assessment feedback and miss out on the benefits to them.

Edword has a ‘lock grade’ feature which means students can’t see their grade until after they’ve read their feedback and potentially also submitted a reflection on how they will put their feedback into practise. In this way, Edword supports the feed forward model of good academic practise.

The Edword workflow looks more like this:

Edword workflow

Assignment is graded, student reads feedback, student writes reflection on feedback, student sees grade, student improves on next assignment

We also hope the feedback provided within Edword will be more engaging. Academics can enrich inline feedback with learning objects such as videos or H5P interactive learning objects. Rather than the flat text based feedback comments within Turnitin and Moodle, feedback in Edword helps students understand the mistakes they are making along with an immediate way to re-test their knowledge. The platform supports assessment for learning concepts.

 

A h5p learning activity embedded into assessment feedback for a student

A H5P interactive learning object within feedback in Edword

Edword records how long a student spends engaging with their feedback and allows students to rate the usefulness of the feedback they receive. These metrics are presented to staff as a way to evaluate how engaged students are and which feedback comments could be improved from a student perspective. 

We will make Edword available to staff and students during teaching block two with an on-boarding event for staff happening in early February. If you would like to take part in the project or ask some questions, please get in contact:

Mike Wilson

Ext. 3194

michael.wilson@port.ac.uk

A video introduction to Edword can be found here

Great feedback is essential

Wouldn’t it be great if students could read the feedback they’ve received for their assignment, write a short reflection on what they could do to improve (perhaps also identifying what they’d like to receive feedback on next time round) and then see their grade? 

Our current online assessment tools (Turnitin and Moodle Assignment) don’t allow us to do this. Luckily we know an assignment tool that does – and it has many other modern assessment feedback mechanisms too.

I’m passionate about helping improve assessment feedback for students. It’s one of the things I’ll be working on in my new secondment as a Senior Lecturer in Digital Learning & Innovation. On Mondays, Tuesdays and Wednesdays I’ll be working between the TEL and AcDev teams to help coordinate projects to better support academics, Online Course Developers and students with a focus on digital education. In particular, I’ll be working to help get a small pilot off the ground for EdWord – a fantastic new assessment tool that promises to address many of the requirements of modern assessment and feedback. If you’re interested in taking part in this pilot please let me know.

In addition, I’ll also be helping to establish an online staff community alongside the APEX programme featuring special interest groups. This will be a great place to make contact with like-minded staff from other faculties and exchange ideas.

Tom Langston and I will be creating a support mechanism for Online Course Developers who are interested in completing their CMALT portfolio and who might be interested in taking part in future elearning projects with TEL.

I’ll also be doing a bit of lecturing on the Research Informed Teaching programme, which I’m looking forward to. So this will be a busy year for me!

Please get in touch if you’ve got any ideas or projects we can help you with. Both the TEL and AcDev teams would appreciate  your feedback as we work to ensure we’re offering the services that will provide value to you and your students (you can reach me on ext. 3194).

Image credit: https://commons.m.wikimedia.org/wiki/File:Paper_Plane_Vector.svg

 

Achieving Mastery – How Important is Practice in Learning?

Learning a new skill can often feel daunting, especially if it’s one that doesn’t particularly spark interest or enthusiasm – we’ve all been there right? You can feel bombarded by information and overwhelmed with the task of learning and feel like giving up before you’ve even begun! 

So, how can we overcome this? How can we find the opportunity to put our learning into practice and how can practice lead to success?

Knowledge Vs Practice

When we think of learning we think of gaining knowledge:

Learning /ˈləːnɪŋ/ - the acquisition of knowledge through study, experience, or being taught.

Learning /ˈləːnɪŋ/ – the acquisition of knowledge through study, experience, or being taught.

However, as Anton Chekhov once said: ‘knowledge is of no value unless you put it into practice’. This is true, we can study and gain years of knowledge, however if we don’t put the information we’ve acquired into practice then it’s meaningless and often forgotten over time. I’m sure we’ve all attended a workshop or studied a course that we later haven’t put into practice and our learning has been lost. I studied French and Spanish at GCSE and A-level, however without speaking the languages on a daily basis, I wouldn’t say I was particularly fluent in them now – I expect, if we all think back to our school subjects, how many of us can remember and are actually using those skills now? I doubt many of us are.

Gaining knowledge in learning is only half the battle won, the other half comes from practice and of course feedback – as otherwise how do you know if you are doing something right? And most importantly how can you improve if you don’t know where to begin? So how can we improve practice in our students’ learning?

Can deliberate practice aid learning?

Deliberate practice involves attention, interest and motivation, this is the important bit and how we, as educators, can help our students understand the benefit of practice in the long run by making our learning materials fun and interesting!

It’s important because practice can help improve skills. If you practice a new skill on a regular basis then you will get good at it, learning to ride a bike, drive a car, play a musical instrument, these are all skills that take time, commitment and practice and this is exactly the same for studying too. Practice helps you implement what you have learnt and get better at it.

Practice can also boost self-confidence. When you practice something and see results, it makes you feel happy and confident; when you’ve finally learnt to ride your bike, passed your driving test, play a music instrument – you’ve done it! You feel a sense of achievement as all that hard work has paid off! 

As instructional design expert Barbara Seels (1997) says: 

“Practice is the most important ingredient of effective instruction; it speeds up learning, aids long-term retention, and facilitates recall.  Instruction is less effective when there is no opportunity to perform the task or when practice is delayed . . . . Unfortunately, much of the instruction in our classrooms provides little or no opportunity for practice.”  

Learning will most likely occur with the opportunity for practice and feedback. Creating an environment or providing opportunity for our students to practice what they’ve learnt is paramount in the learning process. Whether this be on an online platform i.e taking part in a chatroom or taking a quiz. Giving feedback is also crucial. Providing students with feedback or vice versa, students giving their course leaders feedback on their learning experience, helps to confirm their knowledge and also provides ways in which future students’ experiences can be improved.

Retrieval Practice

One way we can help our students put their knowledge into practice is through retrieval practice. Retrieval practice focuses on bringing information to the mind, retrieving knowledge and then putting it into practice, by doing this students can strengthen their learning.

https://www.youtube.com/watch?v=ZO8abw3DHxs

Are there any ways you can use retrieval practice in your learning materials?

The Mastery Approach – how can we achieve this?

There are lots of ways deliberate practice can lead to mastering a skill, which is primarily what the mastery approach to learning is. 

The next time you learn a new skill, whether it be learning a musical instrument or a work-related task, think about the following things:

  1. Establish specific goals – Firstly, what do you want to achieve? How will you know when you’ve achieved it?
  2. Practice plan – break your tasks down into parts – Break your task down into different areas, then make a specific plan of how long you will spend on a specific part and when you will do it.
  3. Give your full attention to each part – You won’t become a master by multi-tasking. You need to be focusing on each part, practice slowly until you have mastered each section then put it all together. This is why breaking down our learning material into bite-size sections is so important, rather than text heavy documents!
  4. Get feedback from a master – No one masters a skill by themselves. An expert outsider can help provide you with feedback and direction. Surely it’s better to have feedback to correct or improve and help aid perfecting the skill.
  5. Move out of the comfort zone – No one becomes a master by doing what they already knew. Stretch your expertise by stepping away from your current ability.
  6. Maintain your motivation – You’ll need to have three things for this, emotional, logical and logistical reasons to continue:
    1. Logistical – finding the most convenient time and place to practice.
    2. Emotion and logic – what drives you? Maybe you want to succeed due to a negative experience you’ve had or maybe it was something positive, someone’s praise and this drives you to work hard – only you will know this.

Here’s the science bit!

https://www.youtube.com/watch?v=f2O6mQkFiiw

To summarise, knowledge is important in learning. However, unless knowledge is put into practice then it will lack value and in time will be lost. Knowledge, deliberate practice and feedback lead to acquiring and mastering a skill. Practice does make perfect!

Thank you for taking the time to read my post, I hope you’ve found it interesting! I would love to hear your experiences on putting new skills into practice, have they been successful – if so how did they become successful and if not, why?

References:

Anton Chekhov: http://www.simplybetterenglish.com/knowledge-no-value-unless-put-practice-anton-chekhov/

Barbara Seels (1997): ps://ctl.byu.edu/tip/effective-learning-through-practice-skill-building-and-feedback)

 

 

Happy 2 years to us!

It’s Tel Tales birthday today and we’re celebrating 2 years of blogging. 2 years – that’s a big achievement for us, in the past blogging was never our forte as a team – but this time, with Tel Tales, we’ve stuck to it – so what have we learnt in the last 2 years as a group of novice bloggers and how has this time been different from our previous attempt?

Raising our profile

In early 2016, we were thinking of ways to raise our profile within the University. We are a long standing central service, but we offer much more than Moodle support, as a bunch of talented individuals with an array of experience and expertise, we felt this was often unknown and we also weren’t too good at voicing our achievements.

Building a blog site seemed like the perfect platform where as a team, we could all contribute and write posts journalling our adventures in technology and education.

Reservations

As a team we had reservations, we had quite a few failed blog attempts in the past and this had knocked our confidence, which I talked about in my first blog post Why Blog? For some members of the team, blogging came naturally and were able to write posts with ease. For others writing a post for all to read was quite a scary concept and putting pen to paper was difficult. As this was a team blog and we wanted everyone to feel comfortable and happy to post, we knew that the project would need planning, organisation, ongoing management and time to be a success.

Tips for setting up a team blog

Here are some of our tips for starting a team blog:

  • Communicate the goals and focus of the team blog – from the offset, as a team, we discussed what we would like to include in our blog site, things such as events we’d attended, projects that we were working on, useful information about the technologies people in the University were using, and topical news that had interested us.
  • Develop a team blog style guide and author guidelines – we put together some guidelines as to the style of the posts i.e. sizing of headers, images, copyright, referencing etc so that the posts were consistent although written by multiple people.
  • Choose an appropriate team blog tool – we choose WordPress as our blogging tool and created each member of the team their own user account so they had ownership of their own posts.
  • Have team editors/proofreaders – we delegated the proofreading and editing of the posts to 3 members of the team – so all posts after written in draft were checked by them before going live.
  • Create an editorial/blog post calendar – we created a calendar so that we could organise and schedule when posts were going live and keep an ongoing spreadsheet of all posts to keep track of what stage they were at.
  • Offer collaboration and communication tools to contributors – all members of the team have access to Slack where we can discuss the blog posts and Google Drive where we structure and manage all the posts. Everything is clearly structured in folders and everyone has access to everything.
  • Provide feedback to contributors – feedback regarding the blog site as a whole and feedback regarding posts are either discussed on Slack or directly to the contributor.
  • Recruit guest bloggers – we have had several members of staff from other departments contribute to the site which has been great in networking with other departments.
  • Repurpose content without losing quality – when times have been a little quiet we have been able to repurpose content that is topical – so we are never short of finding content for our site.
  • Remain flexible – I think flexibility is key to running a team blog site, nothing is set in stone, so we are able to accommodate for any obstacles that we’ve come up against over the last 2 years.

Build it and they will come

We did build it and they did come, but slowly. It’s easy to assume with blogging that once you’ve built the site then that’s it, ta-dah job done. We’ve learnt however that this isn’t the case and we’ve had to be patient and continue to be, building an audience doesn’t happen overnight.

What’s in store for the next 2 years

It’s uncertain where Tel Tales will reside in the future, we may become part of the University of Portsmouth website, however we still hope to have a presence in one shape or form. We continue to raise our profile in other forms of media, Tom L has created some Podcasts on Tel Tales, so if you haven’t listened to those yet then check them out. Tom is also looking at our YouTube channel and will be providing some new videos on there. Shaun is working on our Instagram account, so make sure to follow us if you’re a keen Instagrammer.

I’m immensely proud of the team and everyone that has contributed to the site, especially those that have found it difficult to write for an online environment but have still given it a go! Big thanks to Mandy who’s our team organiser and keeps us informed of who’s doing what and to Stephen, Alana and Tom C for being our team proofreaders, Tom L and Shaun our social media bods and for Will and Mike for all their help behind the scenes with the ‘techy stuff’ and thank you to everyone in the team that has contributed to Tel Tales. Thanks to all our followers too – we hope you enjoy reading our posts!! Cheers everyone!

Wishing you all a very ‘Happy Easter’ from the TEL team.

Happy Easter

If you would like to feature as a guest blogger on Tel Tales then please get in touch and we can discuss ideas with you 🙂

Image credits:
https://pixabay.com/images/id-72160/
http://www.quotesvalley.com/quotes/failure/page/443/
https://pixabay.com/images/id-2406452/

Moodle Baseline – A new standardised template for all Moodle modules

In recent student surveys it’s become clear that students want more consistency to the layout of their Moodle modules. Students want it to be easier to find key information such as what the module is about, what they will learn and how they will be assessed.

It’s increasingly important that we present content for students in an accessible way so everyone can engage with content easily.

TEL and AcDev have led a feedback exercise with staff from all University faculties, along with a pilot with academics and students on Nursing Degrees delivered by Science. These exercises have helped us establish what the key requirements would be for a standardised approach to the layout of Moodle modules and the development of the Moodle Baseline template.

The Moodle Baseline represents the basic building blocks for starting to build a Moodle module. Here’s a summary of main tabs available within the template.

The Welcome tab allows staff to add a welcome message to students in html format (this could include a welcome video or perhaps link to a discussion forum).

Welcome tab of Moodle Baseline

The Module Overview tab allows a plain text description of the module to be added.

Module Overview of Moodle Baseline

A list of Learning Outcomes can be added to the third tab.

Learning Outcomes tab of Moodle Baseline

The Assessment Summary tab allows for a description of the assessments that a student will be required to complete. There is also a table to keep track of submissions. Students will be able to see the status of their assessment submissions and upcoming important dates. Staff will see progress bars representing how many submissions have been made along with an indicator of how many assignments require marking.

Assessment Summary tab in Moodle Baseline

All new and rolled-over Moodle modules will have the Moodle Baseline template added automatically from March 1st 2019, giving staff time to add content in advance of September 2019.

When the Moodle Baseline launches on March 1st we will also release a web-based resource for guidance on how to complete the template along with useful best practise advice for populating your Moodle module including topics such as marking online and giving effective feedback.

We hope you find the Moodle Baseline a useful tool for creating rich and engaging Moodle modules. If you have any questions please get in contact at elearn@port.ac.uk

New Moodle theme

Over the past academic year members of TEL have been talking to people across the University about what Moodle should look like and what it should do.

We’ve conducted focus groups and had meetings with students, academics, support staff, “powers users”, IS, Marketing and Department of Student and Academic Administration (DSAA). This has allowed us to produce a requirements list of what Moodle users need in terms of the interface.

Drum roll please… we’re very pleased to announce that early adopters can now switch to the new theme for their Moodle units. This will enable academics and Online Course Developers to start developing content in time for September. Units will be automatically switched to the new theme when they are rolled over this summer.

(click image to enlarge)

To switch to the new theme manually press Course administration > Editing Settings > Appearance > UoP Boost

You can also view a demo course featuring the new theme by visiting this link.

We’d very much welcome your feedback on the new theme. Please complete this form if you have any ideas for us.

Student digital experience 2018 – results from the JISC tracker

For the past three years the University of Portsmouth has run the JISC student digital experience tracker – a survey that aims to capture students’ experiences of and attitudes towards the digital environment in HE. I’ve just made a preliminary analysis of the results from this year’s tracker, which ended on 20 April 2018.

One of the useful aspects of the tracker is that it enables us to benchmark our results against the sector. A total of 15,746 students at other English HEIs responded to the tracker, and it’s interesting to compare their experience with the 310 Portsmouth students who responded. (Note: the student profiles of those taking the tracker are slightly different, so the comparison isn’t perfect. We deliberately choose to avoid involving students at L5 and L6, in order to minimise any interference with the NSS. At English HEIs the distribution is ‘flat’: students at all levels take the tracker.)

The good news is that, for almost all the questions posed, Portsmouth students give more positive responses than their counterparts elsewhere! For most questions the difference is only a matter of a couple of percentage points, so it would be wrong to claim there is a statistically significant difference, but in some cases there really is a notable difference. For example:

  • 93% of Portsmouth students rate the quality of UoP’s digital provision as good or above, vs 88% for the sector
  • 85% of Portsmouth students rely on Moodle to do their coursework, vs 74% for the institutional VLE at other institutions
  • 77% of Portsmouth students say that digital tech allows them to fit learning into their life more easily, vs 70% for the sector
  • 76% of Portsmouth students use digital tech to manage references, vs 65% for the sector
  • 71% of Portsmouth students say when digital tech is used on their course they enjoy learning more, vs 62% for the sector
  • 67% of Portsmouth students regularly access Moodle on a mobile device, vs 62% for the institutional VLE at other institutions
  • 67% of Portsmouth students regard Moodle as well designed, vs 56% for the institutional VLE at other institutions
  • 64% of Portsmouth students say online assessments are delivered and managed well, vs 59% for the sector

Even more interesting than the percentages, however, are the students’ free text comments. Students were asked what one thing we could do to improve their experience of digital teaching and learning. From their responses, four clear themes emerged:  

  • Students want lecture capture and/or more use of video
  • Students want a more consistent approach to Moodle use, and a less ‘cluttered’ interface
  • Students want better training/help/support for themselves when it comes to using digital tech
  • Students want staff to make better use of existing technology  

Over the coming months we’ll be considering how best to address these challenges.

 

Lynda online learning – user survey

User survey

Since August 2017 all students and staff at University of Portsmouth have had access to Lynda.com, an online, on-demand learning resource designed to help users gain new technical, business and creative skills.

Lynda.com can be used in numerous ways. A student, for example, might use it as part of their course, or to learn additional skills such as Excel. A member of staff might use it for personal development, or to embed its resources into Moodle, create playlists and support students. We’d really like to learn about your experience of using Lynda since it was launched – so please take a couple of minutes to complete our user survey. Results from the survey will go towards improving and tailoring our provision of digital resources.

University of Portsmouth Lynda.com User Survey

Never heard of Lynda.com?

If you still haven’t used Lynda.com you’ve been missing out! Nearly 3,500 staff and students have used it since we launched, accumulating over 4,000 hours of instructional time. Lynda.com is available anytime, on any device, and as well as supporting your own learning it is possible to share courses, create playlists, and embed courses into Moodle – all helping to support the learning of students and staff.

With Lynda.com you get:

  • Unlimited access –  Choose from more than 5,000 video tutorials covering business, creative and technology topics.
  • Relevant recommendations –  Explore the most in-demand skills based on your interests.
  • Expert instructors –  Learn from industry leaders, all in one place.
  • Convenient learning –  Access courses on your schedule, from any desktop or mobile device.
  • Helpful resources –  Reinforce new knowledge with quizzes, exercise files and coding practice windows.
  • Relevant content – Map content to support the learning of your students and staff.

For further information:

www.port.ac.uk/lynda

Online Training for everyone – Lynda.com

adrian.sharkey@port.ac.uk

@adrianjsharkey

« Older posts Newer posts »

© 2024 Tel Tales

Theme by Anders NorénUp ↑