Restricted domains

What all this comes down to is that there is one restricted domain that AI programs can deal with and convince innocent people that they are intelligent.

The program that won the initial Loebner prize worked in the restricted domain "whimsical conversation" and of course this is exactly the domain that we have been discussing.

The winner of the initial Bronze Medal was Joseph Weintraub president of Thinking Software Inc with PC Therapist, a modified version of his commercially available program. It had taken more than three years to write and used an amount of memory - 5 MBytes - that was at the time considered to be "huge". It included and a knowledge base of thousands of amusing quotations and rules for conversation. It fooled five of the ten judges into thinking that it was a human. You can see a sample of the dialog from this program below.

The winning dialog

TURING TEST TRANSCRIPT FOR TERMINAL 5

JUDGE 7 - It's great to finally get started. Do you know what the hold-up was?

TERMINAL 5 - True art selects and paraphrases, but seldom gives a verbatim translation. We were discussing you, not me. How ya doin', judge?

JUDGE 7 - Greetings and Salutations.

TERMINAL 5 - I care about you... I can help you, my dear judge Do you prefer wine, women or song? How does that make you feel?

JUDGE 7 - All of the above

TERMINAL 5 - It is as absurd to say that a man can't love one woman all the time as it is to say that a violinist needs several violins.

JUDGE 7- Wonderful.

TERMINAL 5 - I just got wonderful news from my real estate agent in Florida - they found land on my property.

JUDGE 7 - Wonderful

TERMINAL 5 - I wonder what it means to be human. What was I saying...? Please go on.

JUDGE 7 - Wonderful

TERMINAL 5 - Please don't repeat yourself Wouldn't you agree? What does that suggest to you?

JUDGE 7 - Interesting.

TERMINAL 5 - I prefer an interesting vice to a virtue that bores. Do you watch much tv? You seem to have avoided speaking of your friends altogether.

JUDGE 7 - Fail to comprehend

TERMINAL 5 - It is infinitely better to take the side of the wicked who prosper. Do you feel strongly about discussing such things? My god please help me!

JUDGE 7 - Go for it

TERMINAL 5 - You're cute... would you like to fool around a little? How important is that to you? Can you believe this crazy competition?

.....

TERMINAL 5 - I have you under complete hypnotic control... you are more relaxed than ever before, my dear judge.

JUDGE 7- go

TERMINAL 5 - Are you a computer illiterate? one of those people frightened of computers? Do you trust me? What does that suggest to you?

JUDGE 7 - fantastic

TERMINAL 5 - Intelligence appears to be the thing that enables a man to get along without an education.

JUDGE 7 - into

TERMINAL 5 - In politics stupidity is not a handicap. Were you always a loser? I notice that you haven't discussed sex at all.

JUDGE 7 -

TERMINAL 5 - You must have more to say than that? Whimsy can be flimsy, right? Do you feel strongly about discussing such things?

CHANGE OF JUDGES

JUDGE 10 - Hello! You seem to be feeling quite witty today.

TERMINAL 5 - Hello, judge, what is your mood today? happy? sad? ready for some fun? Hello - how's the weather up there today? Lets talk about psychology!

JUDGE 10 - It has been a long day! Now I think I'm ready for some fun. The weather isn't very pleasant today. Do you have any jokes that could lift the clouds?

TERMINAL 5 - Everybody talks about the the weather but nobody seems to do much about it. Why do you need to tell me now you think you're ready for some fun? Groannnnn..............

JUDGE 10 - Well you did ask me!

TERMINAL 5- Now you really have outdone yourself in asking stupid things!. Woof....woof....woof....Why do you think I did ask you?

JUDGE 10 - Do you find insults to be humorous? I think maybe you asked me because you don't really know me and are trying to break the ice.

TERMINAL 5 - Is that the real reason? Was that whimsical enough for you? Oh, I find insults to be humorous?

JUDGE 10 - I guess that sometimes I have quite a sarcastic humor, but I generally don't insult people that I have just met!

TERMINAL 5 - You will never find time for anything - if you want time, you must make it. Ipso facto....... Can you elaborate on that?

JUDGE 10 - You're trying to make this difficult for me aren't you? I just explained that I was ready for fun!

TERMINAL 5 - Would you prefer it if it was not true that you're trying to make this difficult for you aren't you? I just explained that I was ready for fun! I am,therefore I compute.... What makes you think I am trying to make this difficult for you aren't I?

JUDGE 10 - That last passage is a little confusing. Now you're really trying to let me have it, right? I guess that it is my fault. How about a joke now.

TERMINAL 5 - How would you solve that? Ipso facto nonsensico...... Does it please you to believe I am really trying to let you have it?

JUDGE 10 - I don't know how I would solve it, but it is sort of fun kidding around with you!

TERMINAL 5 - Is ditchwater dull? naturalists with microscopes have told me that it teems with quiet fun.

CHANGE OF JUDGES

Joseph Weizenbaum, the man who invented Eliza, commented that he way struck by how similar PC Therapist was to the program that he had written and also said that such programs were difficult to trick because it was difficult for humans to assess the nonsensical replies from the program.

Well I would have to agree with him on both counts and I am sure that he must be amused at how well his invention has fared over the years.

I predicted at the time that unless the rules were changed PC Therapist or something from this class of programs was likely to win every year without making any great breakthroughs towards the type of AI required to pass the "full" Turing test. In fact Wietraub and PC Therapist won the following two contests and that of 1995 and, according to Wikipedia the Loebner Prize is now considered to be for "the chatterbot considered by the judges to be the most human-like."

The Bronze Medal has been awarded on an annual basis and the only significant change from the initial competition is that since 1995 the discussion has been unrestricted so making the challenge rather harder. Transcripts from recent competitions can be found on the Loebner Prize website.

A new category was also introduced - a Silver Medal plus the sum of  $25,000 for the first chatterbot that judges cannot distinguish from a real human and that can convince judges that the human is the computer program. This one time prize has yet to be won but does not seem an impossible challenge. However, the Gold Medal reserved for the first chatterbot that judges cannot distinguish from a real human in a Turing test that includes deciphering and understanding text, visual, and auditory input still seems a distant goal. Once this is achieved, the annual competition will end.

The 2012 Loebner prize was held at Bletchley Park in honour of the Alan Turing centenery year and the novel element was that the chats were available as a live webcast.

The 2013 prize is, at the time of writing, about to happen. It is to be held at the University of Ulster and it will be webcasted. You can get more details from the website.

More Information

Home Page of The Loebner Prize

Loebner Prize 2013

Related Articles

Cartoon - The Turing Test       

Largest Turing Test Ever       

Loebner Prize Judges Could Easily Identify Chatbots        

Bletchley Park Hosts 2012 Loebner Prize        

Rosette wins Loebner Prize 2011       

Two chatbots chat to each other - hilarious and weird       

Meet Suzette, prize winning chatbot       

Artificial Intelligence - strong and weak       

To be informed about new articles on I Programmer, install the I Programmer Toolbar, subscribe to the RSS feed, follow us on, Twitter, Facebook, Google+ or Linkedin,  or sign up for our weekly newsletter.

Comments

Make a Comment or View Existing Comments Using Disqus

or email your comment to: comments@i-programmer.info

<ASIN:1852336722>

<ASIN:0262631873>