Search this site

Thought for the day

Each day a randomly-selected "law", observation or suggestion will appear here.

Last 100 articles
Free subscriptions

Free guide to using interactive whiteboards

IWB Guide Cover26+ suggestions and tips. Free to subscribers of Digital Education (please see the link below)


 Subscribe to our free newsletter, Digital Education!

 It's free. Signing up entitles you to various freebies. We use a double opt-in system, and we won't spam you.

Click the image above for a free sample edition.

Sign-up page.


The DfE Assessment Innovations series collated. This booklet is free to subscribers of Digital Education.

Be notified by email if you prefer:


Preview | Powered by FeedBlitz

The Amazing Computer Education Project Book

Remember this?

Amazing Web 2.0 Projects

It’s been downloaded over 35,000 times. I’m hoping to create a similar Computer Education Projects book, which will also be free. Find out how you can help by reading this article:

The Amazing Computer Education Projects Book


Digital Education

News, views and reviews. In-depth articles. Guest contributors. Competitions. Discount codes.

(Not necessarily all in the same issue, but each issue is full of good stuff nonetheless!)

Sign up for our free newsletter now!


Oh No!!If you can't find what you're looking for...

Assuming you’ve tried variations of your search term and checked the spelling without any luck, you may find the article Finding stuff on the ICT in Education website helpful.

Alternatively, if it’s not an article you’re looking for, try looking through the menus at the top of the screen.

E-Books for Sale

Want to make your ICT lessons more interesting?

Then Go on, bore ‘em: How to make your ICT lessons excruciatingly dull is just right for you.

Clustr Map
Terry Freedman's Social Profile
Powered by Squarespace

« We don’t need no official scheme of work for Computing | Main | 9 Challenges of Project-Based Learning »
Thursday
Oct102013

Good riddance to levels in ICT and Computing

Who’s afraid of life without Levels? Quite a few people if the number of schemes of work and assessment grids being developed that incorporate levels are anything to go by. Working without levels is clearly very hard: it is almost impossible to think, much less talk, about pupils’ progress without mentioning levels at some stage.

Yet this is precisely what the government expects. In the article “Assessing without Levels”, the Department for Education states:

As part of our reforms to the national curriculum , the current system of ‘levels’ used to report children’s attainment and progress will be removed.  It will not be replaced.

But levels insist on proliferating. Could it be that levels are to us what God was to Voltaire?

If God did not exist, it would be necessary to invent him.

I believe that while the use of levels may seem to be a good shorthand solution to describing what pupils know, understand and can do, in reality they carry at least eight potential problems.

What's in a number? Photo by Terry Freedman http://www.flickr.com/photos/terryfreedman/

 

Triviality

Is work that ticks all the boxes but is actually trivial a Level 6 say? In the now defunct ICT Attainment Targets, Level 6 included these statements:

They develop, try out and refine sequences of instructions and show efficiency in framing these instructions, using sub-routines where appropriate.

So, if a pupil designs a computer program to guess the user’s age, through a process of iteration, using very efficient code, with a few lines thrown in to catch incorrectly entered data, would we really say that that was a Level 6? And if so, what Level would you give a program that was more complex, but still basically involved doing the things listed in the statement quoted above? In other words, shouldn’t the nature of the problem itself have a bearing on what sort of Level we assign to its solution? And if so, doesn’t that make the whole notion of Levels, as expressed in the form of a number, meaningless?

Accuracy of progression

The new Computing Programme of Study at Key Stage 2 contains:

use sequence, selection, and repetition in programs

A number of schemes of work and assessment grids, both for the old ICT Programme of Study and this new one, place single instructions at a lower level than sets of instructions (what we might call “procedures”. But is that objectively accurate? Is a procedure like “Square”, for example, conceptually more difficult to grasp than the individual instructions that make it up? Surely there is a sense in which the higher level command is easier to understand? I am thinking of what works for me when I am planning a route to an unfamiliar destination. I don’t start off working out the route in minute detail; I start by working out whether I m going east or west, where the nearest station is, or the nearest ‘A’ Road. Once I’ve got my bearings in that sense, I can then focus on the nitty gritty. But if I did it the other way round I wouldn’t be able to see the wood for the trees.

Even if I am wrong about this, and that a procedure is a harder concept to grasp than a single instruction, does it follow that working out a sequence of instructions for a complicated route for a robot to get across a room is easier than stringing together a few procedures to make it create some nice patterns? I would suggest it’s more difficult.

But whether I’m right or wrong wouldn’t matter if you didn’t bother with Levels. If a pupil can work with single instructions but not procedures, or vice versa, then you know what needs to be addressed. Fretting about what ‘Level’ they are on is an unnecessary distraction.

Does reporting Levels make sense?

This follows on directly from my last point. If you say to a pupil, or a parent, or yourself, or an inspector, “Fred is at Level 5”, what exactly does that mean? Not a lot, I would say. You would still have to expand on it in the form, “That means that Fred can do X, but cannot do Y, and needs to do Z in order to bridge that gap.” And if you’re going to write all that, why bother with stating the Level in the first place?

In any case, as everyone is busy inventing their own schemes of work, your Level 6 may not be the same as my Level 6, so you can’t even make comparisons between schools. So where does that put parents wishing to compare different schools on the basis of their reported percentages of pupils attaining a particular Level (because that will go on even if it isn’t supposed to: as far as I can tell, schools still have to report attainment in ICT/Computing at the end of Key Stage 3)?

Does finer granularity make sense?

For example, phrases like “Working towards a Level 5”, “Borderline Level 5/6”, “Level 5c” in reports. What do they mean? In my opinion they make an already difficult challenge even more difficult. While I was working at the then Qualifications and Curriculum Authority, the curriculum ICT team resisted occasional pressure to provide guidance on levels within levels, ie how to distinguish between Level 3a and Level 3b. We thought it was hard enough to distinguish between, say, Levels 3 and 4, let alone within a particular Level.

Does reporting a Level help anybody?

The research shows that if pupils are given a grade, they will focus on the grade, ie the number. If they are given a comment, if it is a useful comment, that will be much better for ensuring progression. If they are given both a grade and a comment, they won’t read the comment, or it least won’t take much notice of it. Giving a pupil a Level encourages them and their parents to focus on getting to the next Level up, whereas what they should be concentrating on is consolidating and expanding their knowledge, understanding and skills.

Isn’t everybody a Level 1 at the start?

What do I mean by this? I downloaded and played around with a program called Scrivener a few weeks ago. I didn’t have a clue what I was doing. If I had to give myself a Level, I’d say a Level 1, in terms of the old Statements, and Level 0 in terms of the new Programme of Study. Why? Because the old Level 1 was all about exploring. In the new PoS, at Key Stage 1 pupils should be taught to “use technology purposefully”. I had not attained such dizzy heights when I started work with Scrivener.

On the other hand, I am probably a Level 8 in other areas. So how should I describe myself? Perhaps as a Level 4, ie the mid point? If so, what does that mean?

Does evidence of work at Level x mean the pupil is at a Level x?

The proposition in my previous point, namely stating that I am, on average, a Level 4, is ridiculous because it equates the level of the work I do with my level of knowledge and understanding. It would be much more useful to state that some of my work is at Level 1, while some is at Level 8. If you’re going to do that, nothing is actually gained by assigning an overall Level to me. Again, it would be much more useful all round to just say what I am able to do. Otherwise, what you are doing is reporting a “best fit”. Is that good enough do you think?

Does lots of work at Level x mean you have achieved the overall goal?

The problem with any competency-based approach, by which I mean atomising the work into finer and finer gradations, is that the whole may be less than the sum of its parts. I remember a girl who was able to do everything required of her in a word-processing module, part of a vocational course we were running. But when I arrived 10 minutes late to the lesson once due to some crisis I had to sort out, she was sitting doing nothing because she didn’t know how to turn the computer on. Considering that the point of the course was to enable successful students to start applying for office jobs, I took the view that it would be meaningless and wrong for her to be awarded a pass. If she could only do things if they were listed, or that she had already practised, how would she cope in a typical office job, where new things are being thrown at you all the time? It was clear that although she had reached a high level in the word-processing, she hadn’t really become an expert in using it in a real-life situation.

All in all, I think Levels create more problems than they solve. We're better off without them.

Enhanced by Zemanta

Paperless office?

Your newsletter editor is hard at work sifting through the submissions for Digital Education, the free newsletter for education professionals. Have you subscribed yet?

Read more about it, and subscribe, on the Newsletter page of the ICT in Education website.

We use a double opt-in system, and you won’t get spammed.


PrintView Printer Friendly Version

EmailEmail Article to Friend

Reader Comments (4)

I so agree with Terry regarding levels. As a former LA person I held moderation of levels meeting in schools trying to get teachers to be comfortable with ICT levels not just giving a level 5 to a student who had word processed a perfectly punctuated well written article with a picture and a colourful border. I then said that this would give us a school level the next step would be an authority level which may differ from the school but would be moderated and once there was an awareness of an LA level we could then look at the regional and then national picture to try and gain consensus in a terrifically difficult area. This of course never happened as there was no impetus to make it happen if we are honest looking back. The levels were really a form filling exercise to tick boxes especially in terms of KS2/3 transition because the next school would invariably ignore the levels or as I remember around the KS3 pilot secondary schools receiving primary pupils in year 7 with level 4/5 ICT and then because they had to show improvement Year 8 giving level 5/6 and in year 9 level 7/8.
Those schools who took the hit and reduced the levels to something more appropriate to the actual knowledge of the students were sometimes criticised for not maintaining progress. A lot of work goes into level processing to identify an accurate level but as Terry points out to what end.
October 11, 2013 | Unregistered CommenterMike Carter
Thanks, Mike. Your experience chimes with mine too. But I was also criticised once because my (painstaking-arrived at) assessment came out lower than that in other schools were a much less robust approach had been taken. Perhaps I'll write about that.

Cheers,Terry
Great provocative post Terry, will be using as a stimulus with a group of undergraduate Computing teachers alongside the NFERs "Where have all the levels gone?" report.
October 17, 2013 | Unregistered CommenterCarl Simmons
Thanks, Carl. I'd be interested to hear what your group makes of it. Thanks also for the NFER link: I hadn't come across that. Have now printed it off to read later. Hope it doesn't complete demolish my arguments!

Cheers
T

PostPost a New Comment

Enter your information below to add a new comment.
Author Email (optional):
Author URL (optional):
Post:
 
Some HTML allowed: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <code> <em> <i> <strike> <strong>