lexer.m change (was: Re: diff for review and inclusion in the build tonight)

[Fergus Henderson]

Zoltan Somogyi wrote:

> lexer.m:
> 	Change the representation of token lists to be a fat list
> 	instead of a list of pairs, since this reduces memory
> 	consumption, the number of calls to the memory allocator,
> 	and the amount of indirection required to access tokens.

Hmm, lexer.m is part of the Mercury standard library,
and this is an interface change...

--
Fergus Henderson <fjh at cs.mu.oz.au>   |  "I have always known that the pursuit
WWW: <http://www.cs.mu.oz.au/~fjh>   |  of excellence is a lethal habit"
PGP: finger fjh at 128.250.37.3         |     -- the last words of T. S. Garp.