[alicebot-developer] Re: Program verification standards?

Josip Almasi alicebot-developer@list.alicebot.org
Tue, 02 Nov 2004 22:23:59 +0100


David Sienkiewicz wrote:
> 
> Josip: what I was hoping for was a concise set of points with which I 
> could benchmark the programs various functions. I thought it might take 
> too long to just allow a random conversation although I could see some 
> merit in doing so. I also didn't want to step through each and every 
> template and pattern in the triple-A set if I didn't have to.

Yep, I guessed that much - you're looking for some kind of 'unit tests', 
right?
Well, tough luck... I don't even understand how such a thing could be 
done with AIML.
Eventually some kind of brute force, i.e. random strings or random word 
combinations based on some grammar...

> What would be of interest is some sort of a modified ALICE program that 
> has the sole purpose of evaluating and rating other ALICE programs, 
> perhaps not only for content but maybe response time as well.

Again, I don't see how you can evaluate the content, in general.
How can you evaluate english, russian, turkish bots with one program?
But this _is_ an interesting idea... if the Foundation had such a 
'conformance test', it would make interpreter implementation much easier.

> To answer your question, not Russian (although close), Polish. 
> ...unconfirmed distant relation. The folks that knew for sure died 
> before passing on the information in a way that made sense. We do have 
> one tantalizing first edition book in the family.

Well then, FYI: I've met writer's direct descedant. The familly ran away 
from russians to belgrade.

Regards...