Posts tonen met het label Alan Turing. Alle posts tonen
Posts tonen met het label Alan Turing. Alle posts tonen

donderdag 19 april 2018

Turing's Razor


Robot ethics should be an extension of human ethics; and why that means we should urge programmers to simply neglect implementing trade-offs inspired by the trolley dilemma thought experiments.

Some months ago I wrote about robot vs. human ethics:

  • Turing’s Mirror: How robots make us look into the mirror. To realize that ethical robot questions are really centered around our own morals. Reflecting our own continued failure to lead by example in a landscape shaped by power imbalance.
  • Turing’s Duck: How the essence of the imitation game equally applies to ourselves. How we too just learn to pretend and to conform to expectations. Leaving ample ground for our infamous hubris.

Since then I've been struggling with this third one.  Pondering around what emerges like some guiding principle in these topics. Such "decision guides" deserve being formulated as ‘razors’, like the infamous ones from Occam or Hanlon.  And being the origin of my inspiration, the obvious choice is to name this one after hero Alan. All while happily giving in to the stylish fit of making a sequence of three 'Turing' blog titles :)
Image credits : Jeff Osier-Mixon. CC BY-SA 4.0

Here is what I’m calling “Turing’s Razor” :

Do not ask robots to achieve ethical norms no human needs to adhere to.

Some derived versions spontaneously sound like:

Do not blame on technology what humanity has successfully mismanaged for ages.
Don't attribute to technology those moral failures we humans couldn't resolve (without it).

And it leads to this obligatory corollary:

Stop it already with endlessly letting those meat-brains get off the hook when artificial brains show a path to doing it better.

With one eye on this shiny new compass, we should be able to navigate this modern age landscape, avoiding the steep cliffs of false ethical questions.

-oOo-

No way back

Before getting deeper though, it should be clear that there is simply no way to avoid thinking about these issues.

Take for instance the discussion on DNA Databases.  Obviously this gets condemned as too strong a violation on our public rights, freedom and privacy. Still, there should be room for the careful progressive approach: if current state of legislation, practice and lack of transparency urges us to strongly oppose, than do so, but also start thinking about the right way to do it. You want to be ready for that time when this does become allowed practice: did you spend all your energy strictly at opposing, or did you, in the meantime, also craft up the process to correctly supervise the usage? Principles are useful, less so: being blindly principled about them. Finding a good set of regulations to control possible but avoidable mistakes really is due.

The cry to return to happier times when these questions played no role is a false one: There is simply no ‘undo’ to progress. Once escaped from pandora’s box we just have to reckon with every possible fringe abuse of even the most benign invention.
The other extreme is equally untenable: “To abandon all regulation so not to inhibit 'Future' itself along its disruptive path.” No, we can do better than just hoping for the best. Guard the balanced outcome for all involved.

Both extreme visions will accuse the other side of being overly naive, while neglecting that both are entangled in a race in naivety. The useful cases are born in the same nest as their evil twins, the fruitful trees seeded amid the tares: careful weeding is a balancing act requiring attention. Controlling the usage must be separated from prohibiting the technology. The boundary between the beneficial and the dangerous is too thin to use anything else than the sharpest lancet. So, lay aside your sledgehammers.

We have been here before, at least if you can believe Ash Carter in "What I Learned from the People who Built the Atom Bomb"

I'll give you a topic...

Checking how well this new razor actually shaves requires searching for a suitable beard: What about lethal accidents of self driving cars?

This topic has been covered more than just a bit. Quite a challenge to find anything to add to what is already in the mix. Some references to get up to speed:




Some of those reference the trolley dilemmas; some take that down to the grim boundaries of "counting lives" (which made me think of this old Chernobyl documentary); some succeed in considering this as non-harmful practice, even beneficial and necessary, as it resembles (almost) the practice of medical triage; some strongly aim for the pragmatic "don't let the perfect be the enemy of the good"; some call upon society to "at least ask the right questions?'; some just have the Frankenstein Reflex written all over (term coined by Isaac Asimov); some arrive at the conclusion that "robot ethics should be a natural extension of human ethics". But none of them listened to grandma.

Best effort

Grandma assured us over and over: "It never hurts to do your very best." Applying Turing's razor we should investigate first what our reaction is to failing human drivers. Particularly those who pass grandma's test with flying colors (i.e. didn't do drinks nor drugs, slept enough, kept themselves and their car in shape, adapted speed to circumstances, kept attention on the road, not on media device, etc... ) If we can allow some of those to actually get off the hook, and be pardoned by admitting there was no possible better outcome; that whatever horrific turnout can be mildly covered under the cloak of "just bad luck", … if so, then why would we not be able to come to the same conclusion for robots? Or their programmers?

I admit that pulling in the trolley dilemmas starts from a defensible position: after all: good prevention, like good robust programming is all about considering "what if" scenarios to a large extend.  Passed that initial outlook of logic it took me quite some time to see how this line of thought unwittingly opens the door for something else to sneak in. Two things in fact.

  1. for the robot: We silently extend the check-sheet for evaluating his 'very best' driving skills.
  2. for the coder: We ignore that doing his 'very best' plays in a different realm.

Doing your best driving around safely does not overlap at all with being the best moral judge in split-second valuation of fellow human beings.  If it would, getting a driver's license would include obligatory passing university classes in advanced ethics, moral judgement and human potential assessment. Why do we now add this in the mix? Is this just because we (think the robots) can? Are we so satisfied with predicted safety levels of self-driving cars that we think it is (ever) good enough? So good at least that doing your best at pure safety and avoidance will reach some limit, after which it gets redefined to finding the best trade-off? Or is that giving in to mediocrity? Let me tell you this: Judge "grandma" will be less than pleased with a robot explaining it dedicated part of its processing power to evaluating and counting lives rather than strictly avoiding all possible harm to the fullest of its ability.

But where to shift blame? Since we don't know yet how to prosecute and sentence robots themselves, the programmers suddenly show up in the crosshairs. They can make judgments, right? They can negotiate trade-offs. They can agree on a set of moral rules. They too have to do their best. I agree, but we should notice that they play on a different level.  They're not the ones driving, they are coding. Coding is policy making: defining the rules of engagement that will eventually be executed. We have a different set of standards for those.
The trolley-equivalent of their role is that of the railway-security-engineering team, and it is simply not present in the trolley dilemmas. The questions they are solving would be: How could any person ever end up on a track where trolleys pass? How do we avoid that unsupervised bystanders are operating our switches? How to design security fences on all bridges to keep (even fat) men to drop down from them? Admittedly, the execution of this job does involve trade-offs, balancing and what-if scenarios. But doing your 'very best' in this realm assumes neutrality, removing all possible personal bias, extracting generic strategies out of specific cases, aiming for statistical overall best performance. It too refrains from valuing individuals and counting lives. Acceptable policies are as blind as Lady Justice. Good performing policies are designed to do equally well regardless of the person involved.

Thus programmers are relieved from coding in trolley-like (case-based) ethical decisions, and the robots are relieved from negotiating which people get to live. Their common guiding principle becomes the one we've known for ages: "do your very best to do no harm". Zero tolerance on making any victims.  Such principle becomes a clear instruction towards programmers, one that should get them to feel proud about any invention they add towards that goal. More beer and pizza to them!

-oOo-

Bad luck

If we all keep doing our best the failure count will go down. Nevertheless, remaining cases will exist. And so returns the notion of "bad luck".

Most likely this will hit hard with the paradox of "totally unacceptable improbability". The lower the chance that something bad happens to me, the more unacceptable that becomes. Why me? This must be intentional! Who is behind this?  The better these robotic drivers become, the less prepared we will be to accept the remaining fatalities as ill-fated.
Consolation (probably less so for those directly involved) comes from knowing that these versions of "bad luck" no longer should be "in vain".  Each specific failure will end up being analysed and turned into fixing the policy - I meant the code -  when ready: instantly deployed, not to happen again.

We know how to do this, since we have such procedures in place for dealing with accidents in air traffic.  Whatever the reasoning behind it: We seem to apply these analyse-to-remediate procedures to larger extend as the transportation mode is more automated or mechanic. Considering Turing's razor we should question this strange, unmotivated privilege towards those ape descendants.

One more thought, in a desperate attempt to avoid receiving the label of devout dataïst or naive futuroptimist.

Maybe, just maybe, the only way for us humans to really trust these robots, is for them to be as failure-prone as we are?

-oOo-

This article is part of a series: Turing's mirror - Turing's Duck - Turing's Razor


update: I came across this quote attributed to Arthur C. Clarke. It says it all.
One cannot have superior science, and inferior morals.
The combination is unstable and self-destroying.
– Arthur C. Clarke
update: Found this project "The Moral Machine" at MIT for measuring what humans generally think should be done in certain traffic-dilemma cases.  While this is a great idea for measuring how humans think about these cases, it remains totally unclear why that corpus of facts would be a good/reliable source or guiding design principle for actually engineering "automated" safety.  We should aim higher then opt for that variant of failure that will be mostly acceptable by humans. We should stop thinking like lawyers about the blame shifting, and more (like engineers?) about doing things better. I still think Arthur's quote is right on, just make sure your morals team understands the science.

maandag 18 september 2017

Turing’s Duck

In reply to those convinced that “Robots will Never…”

24/7 life-like performance of waggle and quack

In 1950 Alan Turing wrote his paper “The Imitation Game”. The paper is still relevant and keeps providing food for thought, well beyond the popular Turing Test(1) it proposes.

In this paper Alan addresses the question “Can machines think?” and defends his own position ("Kind of Yes") well against the many counter-arguments of the time. So much so that even modern day nay-say-article-authors often fail to show they used the advantage of the past 65+ years to come up with new or stronger arguments.

Before entering this arena or contemplating your own strategy for attack I would recommend adversaries to fully appreciate the triple-F characteristics of the elegant weapon of choice Turing crafted to defend his case: it is Falsifiable, Factors in the observer and is ultimately Fair.

Falsifiable

Whatever your position is, you don't control the future. So avoid being the next guy topping the charts of "worst tech prediction" by simply not declaring absolute knowledge about anything in absolute time (like 'never').

Being a stated absolute take-it-or-leave-it fact, there is just no more conversation to be had(2). When the prophets get caught up by the facts there is the classical two-way option to reduce the cognitive dissonance: admit to the new facts and learn, or stubbornly ignore: i.e. say people didn't understand what you meant, focus on whatever remaining gap, invent new thresholds and rules, etc.

In fact there is the third option: being about the unreachable eternal "ever", there is a fair chance you don't live long enough to experience the confrontation. Or claim your prize. So what?

Staying relevant well after your expiry date requires a more subtle approach. Turing shows what correct scientific 'falsifiable' argumentation looks like: Do not just claim (that never...), instead provide a practical test (how would we know?).

What follows is an interesting dialogue, a negotiation about how high the bar should be set, honest reflections on what we currently do ourselves not being all that perfect either. It spawns an industry and future research questions. A field populated by those searching to close the gap, committed to ever do better.

In short: it lights a path to progress. A smart angle to sail up against the wind of "never possible" defeatism. Honestly, you 're only baiting us.

Factors in the observer

The Turing Test is not (only) about the robot. And it is most striking how much people ignore that fact. The imitation game surely puts a challenge to the imitator (the robot) to wash away any differences that blow their cover. Finally though it is the 3rd party in the game (the judge) who is calling the shots: whenever he can't see the difference the imitation actually is the real thing.

This "cannot see" comes in many forms: running out of smart questions to ask, or simply failing to care any further. These are all versions of "accepting it is good enough". Turing might have been a trained mathematician, he surely has all the looks of an engineer as well.

There is a special brand of "not in my domain it will not ever" peeps. To them, there is this version. Yo, Ivory Tower Expert with the exquisite emolument for exceptional services: "Thou might know best thou areth the smartest amongst thou peers." But the humble man in dire need of your wisdom doesn't. And that might be both your (current) strength and your (future) weakness. For that customer "good enough at the right price" will nicely do, thank you. They decide who your competition really is.

If you fail to see this simple truth, you will not even see it coming.

Fair

Fitting like the blindfold on Lady Justice, there is this "Veil of Ignorance" separating the judge from the players in the Imitation Game. Each side gets an equal chance in this game. And it makes Turing's approach rather provocative. By design it leaves the possibility open.

Unlike the nay-say-author that benefits from his upfront knowledge to label us humans versus them bots in his article to eagerly protect the "Carbon Privilege"; the Judge does not have the luxury of escaping into the semantic tricks we are so used to that we even don't notice we are doing it. Upfront the word "thinking" is one we have reserved for that activity only we humans do. No matter how fast the submarine, it may dive deeper or float better, it will never "swim". The fact that airplanes actually do "fly" only reveals we don't have wings ourselves.

But Alan's setup makes it impossible to cheat.

Imitating is not cheating

I've come to believe the "The Imitation Game" is a metaphor for the life we lead. Honestly. Biologically life’s essence is reproduction (copy with variation) but socially it isn’t that much different: We grow up copying each other. The game of ‘fitting in’ requires this growing perfection of mimicking our peers. Through formal education we believe we ‘become’ a lawyer, surgeon, engineer, while in reality we are merely training our ability to convincingly role-play that part in society.

To be, as far as we know, is to imitate. Desperately. Since it isn't cheating, you may even take pride.

-oOo-

Closing remark

The Loebner Prize is an annual actual "Turing Test" competition measuring up the state of affairs of AI progress in this imitation game. Interestingly enough, there is a side-bet going on for the human players in the game as well. The price for the most human human. The person that was most easily spotted as that (faulty, messy, emotional, needlessly repetitive, whimsical, clumsy, … never dull) actual person.

See this account(3) of the interesting 2009 winner (The video takes only 4')



So gradually, trying to convince the judges, even as a human, becomes an art in itself.

As robots become the new normal, I see lots of humans eagerly lifting themselves over some magical threshold into this new privileged pack of ‘exceptional beings’. It makes me wonder which of the two groups will eventually match the semantics of the word “artificial” best.

-oOo-

This article is part of a series: Turing's mirror - Turing's Duck - Turing's Razor

-oOo-


footnotes

(1) Note that, similar to his 'machine' it was only after time that this 'game' was named after its inventor and became known as 'the test'.

(2) This "take it or leave it" approach is the same for your religion, other elements of your identity, or sadly almost any arguable position in contemporary social issues. Somehow we forgot how to state 'negotiable' positions and are thus closing the door to any compromises, balanced solutions or win-wins. We need to learn how to recognize this kind of tactics upfront and simply refuse being fooled into negotiations with people entering the discussion like this. If reasonable people are to prevail they have to learn to be absolutely unreasonable to people showing lack of (willingness to) reason. Hell, maybe bots could help out!

(3) If you have more time to spend, I can warmly recommend this more elaborate Radiolab Podcast: Talking to machines.