Dystopian Visions: Flowers for Algernon

In this series I am looking at some classic science fiction stories and suggesting how they might be used as the basis for discussions in Computing (and related subjects) classes. The Computing Programme of Study in England gives plenty of scope for discussing the ramifications of developments in technology. The aims, in particular, include the following broad statements:

The national curriculum for computing aims to ensure that all pupils:

...

  • can evaluate and apply information technology, including new or unfamiliar technologies, analytically to solve problems
  • are responsible, competent, confident and creative users of information and communication technology

Spoiler alert: in order to discuss these stories, I have had to reveal the plot and the outcome. However, in each case I’ve provided a link to a book in which you can find the story, should you wish to read it first.

Click the pic to see the book on Amazon (affiliate link)

Click the pic to see the book on Amazon (affiliate link)

One of the well-known tropes in science fiction — especially the sort of sci-fi you see in comics and superhero films — is the mad scientist. The person who fancies himself (it’s usually a him) as ruler of the world and invents some dastardly device to aid in his devilish designs.

But in sensible science fiction, the scientists are often not so much mad or intentioned, but driven. Or, simply, their inventions and breakthroughs lead to unintended consequences.

Flowers for Algernon comes into that last category. Someone makes a biological breakthrough and finds a way to increase IQ. As always, it’s tried out on animals first, and seems to be a miracle cure. It’s a long time since I read the story, so the specific details of how this comes about are somewhat hazy, but a person of low intelligence takes the drug and it improves his intelligence. The story is written in the first person in the form of a diary, and as the protagonist’s IQ improves so does his spelling, thinking and writing.

progris riport 1 martch 3

Dr Strauss says I shoud rite down what I think and remember and evrey thing that happins to me from now on. I dont no why but he says its importint so they will see if they can use me. I hope they use me becaus Miss Kinnian says mabye they can make me smart. 1 I want to be smart. My name is Charlie Gordon I werk in Donners bakery where Mr Donner gives me 11 dollars a week and bred or cake if I want. I am 32 yeres old and next munth is my brithday. I tolld dr Strauss and perfesser Nemur I cant rite good but he says it dont matter he says I shud rite just like I talk and like I rite compushishens in Miss Kinnians class at the beekmin collidge center for retarted adults where I go to lem 3 times a week on my time off. Dr Strauss says to rite a lot evrything I think and evrything that happins to me but I cant think anymor because I have nothing to rite so I will close for today... yrs truly Charlie Gordon.

progris riport 2-martch 4

I had a test today. I think I faled it and I think mabye now th wont use me. What happind is I went to Prof Nemurs office my lunch time like they said and his secertery took me to a pla that said psych dept on the door with a long hall and alot of li rooms with onley a desk and chares. And a nice man was in of the rooms and he had some wite cards with ink spilld all c them. He sed sit down Charlie and make yourself cunfor and rilax. He had a wite coat like a docter but I dont think he no docter because he dint tell me to opin my mouth and sa All he had was those wite cards. His name is Burt. I fergot hi name because I dont remembir so good.
— Flowers for Algernon

He falls in love with his special school teacher, and she with him, and they become research colleagues. But then he notices that the effects of the drug on the animals is only temporary. They revert to their original state, and he realises that that is going to happen to him. It does, and that’s reflected in the worsening of his writing and his memory.

I realise that this has more to do with science than computing, but the common thread I think is the ethical one. Should there be some sort of ethical oversight committee to evaluate new developments, in much the same way as new drugs have to undergo extensive trials? And even if that were to happen, who would be qualified to sit on such a committee? Why would its members have any more insight into the possible consequences than anyone else?

We’re in an undesirable situation already, with artificial intelligence. AI comes up with a solution for something, and nobody knows how it did so. So you have what is, in effect, a black box making decisions that affect people’s lives.

Under the GDPR regulations, companies are supposed to provide transparency into how their algorithms work. Well, good luck with forcing companies like Google to do that. But even if they wanted to comply, would the companies always even know?

I don’t have the answers to such questions, but I think they might be interesting to discuss with students. In my opinion computing should involve wider considerations than just coding.