Search this site

Thought for the day

Each day a randomly-selected "law", observation or suggestion will appear here.

Last 100 articles
Free subscriptions

 Subscribe to our free newsletter, Digital Education!

 It's free. Signing up entitles you to various freebies. We use a double opt-in system, and we won't spam you.

Click the image above for a free sample edition.

Sign-up page.


The DfE Assessment Innovations series collated. This booklet is free to subscribers of Digital Education.

Be notified by email if you prefer:


Preview | Powered by FeedBlitz

The Amazing Computer Education Project Book

Remember this?

Amazing Web 2.0 Projects

It’s been downloaded over 35,000 times. I’m hoping to create a similar Computer Education Projects book, which will also be free. Find out how you can help by reading this article:

The Amazing Computer Education Projects Book


Digital Education

News, views and reviews. In-depth articles. Guest contributors. Competitions. Discount codes.

(Not necessarily all in the same issue, but each issue is full of good stuff nonetheless!)

Sign up for our free newsletter now!


Oh No!!If you can't find what you're looking for...

Assuming you’ve tried variations of your search term and checked the spelling without any luck, you may find the article Finding stuff on the ICT in Education website helpful.

Alternatively, if it’s not an article you’re looking for, try looking through the menus at the top of the screen.

E-Books for Sale

Want to make your ICT lessons more interesting?

Then Go on, bore ‘em: How to make your ICT lessons excruciatingly dull is just right for you.

Clustr Map
Terry Freedman's Social Profile
Powered by Squarespace

« The trials and tribulations of blogging as a SWOT analysis | Main | 5 Assessment for Learning techniques for ICT or Computing »
Wednesday
Apr022014

5 principles of assessing computing and ICT

There are lots of assessment grids and approaches being developed for the new Computing curriculum, which is wonderful. But how do you know which one is right for you? In this article I provide a few principles of assessment which I hope will provide some food for thought. These come partly from a course I’ve been teaching on the subject.

These are general  principles which I have applied to the context of computing and ICT.

The Questioning Roboto, by Matthew Hutchinson https://www.flickr.com/photos/hiddenloop/

Know why you are assessing

There are many possible purposes of assessing, but the three with which you are most likely to be concerned are:

Diagnostic

What do your pupils already know or understand about, say, programming in Scratch? You can’t just ask them (see the “How” point below). What are their misconceptions, if any?

Formative

Often known these days as “assessment for learning”, formative assessment is used to check pupils’ understanding of what you are currently teaching them, or enabling them to learn. If you subscribe to Digital Education, our free newsletter, you will be able to download a pdf document entitled “31 Assessment for Learning Techniques”. This looks at, erm, 31 assessment for learning techniques that can readily be applied to computing or ICT.

Summative

This is finding out whether pupils have learnt what it was intended for them to learn by the end of a block of time like a term or a year.

So far so ordinary, but the challenge arises from the fact that it is not the assessment method that determines  whether it is diagnostic, formative or summative. For example, a test may be summative, but it could be formative if used in a different context for a different purpose. And it’s also worth bearing in mind that setting a test every week, say, to see what the pupils have learnt in the past week doesn’t make it formative assessment: it just makes it a lot of summative assessments.

Know what you are assessing

This is key. Let’s suppose you want to assess whether your pupils understand what a conditional statement is. Do you set them a task that involves writing a snippet of code in a real programming language, or will you be happy with pseudocode?  The reason this is important is that if I write a statement like:

If button is pressed, show message “OK”, otherwise show message “Please press button”

then that shows I understand what a conditional statement is. However, if you ask me to write it in proper code, and I can’t, you will need to do some further probing, ie some diagnostic assessment. Why? because my inability may stem from either of two reasons:

One, I may simply have forgotten the syntax to use.

Two, I may not understand the programming language sufficiently to be able to make an educated guess.

When I used to do a lot of programming in Visual Basic and Visual Basic for Applications, half the time I couldn’t remember the syntax, but I was usually able to work it out because I understood how the programming language was structured.

Once you have determined why I cannot write the conditional statement in code you, as the teacher, will be able to take appropriate steps to deal with the matter.

Know how you will assess

The assessment grids I referred to earlier are very helpful – up to a point. The trouble is, a statement like “Pupil understands conditional statements” tells you nothing about how you will know whether or not he or she does. Until scientists discover a way of checking people’s understanding and knowledge directly by looking at their brains, we will have to make do with inferring such things from their behaviour. In other words, what would you expect someone who understands conditional statements to do to demonstrate that?

I’m sorry if this is obvious, but it does mean that even if you download an assessment grid and decide to use it as it is, you will still have to do some work to decide what evidence you will look for.

But this, and the preceding point, raises another issue….

How will you know you’re assessing what you think you’re assessing?

This is known as the ‘validity’' problem’. If we go back to the ‘what’ point earlier, you may think you’re assessing my understanding of conditional statements by asking me to write one in Python, but you may actually be testing my memory instead. In a spreadsheet-based question, you may be testing my numeracy skills rather than my ICT understanding. In other kinds of task you may be inadvertently assessing my language skills. Examination boards spend a fortune, and employ an army of statisticians, to avoid the validation problem, so don’t think that you will do so completely! But it is something to be aware of in order to avoid making a simple but avoidable mistake. For example, the numeracy issue can be avoided if you give pupils the mathematical formula for doing the calculation, so that in the spreadsheet they just have to focus on how and where to use it.

Assessment should be reliable

I mention this for the sake of completeness. An assessment procedure is said to be reliable if it produces the same sort of results with different groups of similar pupils or, more simply, produces consistent results. This is another major issue that examination boards and others throw loads of money and brain power at. Given that your class is not only different from the one next door, but even different from itself when it’s windy outside, you’re not going to solve this one either.

Nevertheless, I think it’s worth knowing about so that you can avoid some pitfalls. Reliability is going to be very difficult to achieve if, for example, you give each teacher in your team (if you have one) a set of criteria by which to assign different grades or levels to work, and then leave them to it. Even setting out something as seemingly black and white as a rubric cannot be guaranteed to produce reliable results, because teachers interpret the criteria differently from each other – and even differently from themselves at different times. You would need to ensure there are plenty of opportunities for training, moderation, and seeing examples of pupils’ work at various levels or grades.

So, a lot to think about!

Don’t forget to subscribe to Digital Education and obtain your copy of 31 Assessment for Learning Techniques.

Enhanced by Zemanta

Paperless office?

Your newsletter editor is hard at work sifting through the submissions for Digital Education, the free newsletter for education professionals. Have you subscribed yet?

Read more about it, and subscribe, on the Newsletter page of the ICT in Education website.

We use a double opt-in system, and you won’t get spammed.


PrintView Printer Friendly Version

EmailEmail Article to Friend

Reader Comments

There are no comments for this journal entry. To create a new comment, use the form below.

PostPost a New Comment

Enter your information below to add a new comment.
Author Email (optional):
Author URL (optional):
Post:
 
Some HTML allowed: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <code> <em> <i> <strike> <strong>