[m-dev.] 8-bit chars

[Thomas Charles CONWAY]

> Hi Tom,
> 
> Can you please review this one?
> 

The diff looks fine.

> library/lexer.m:
> 	Rewrite io__get_token_[12] in the original (less efficient) way
> 	that they were written before conway's change in revision 1.17,
> 	to avoid assuming anything about the range of character codes.
> 	(Once this change has bootstrapped, it might be worth going back
> 	to the efficient version, modified of course to assume that
> 	character codes range from 0..255 rather than 1..127.
> 	However, at least for bootstrapping we need to use the less
> 	efficient version.)

<sigh>
:-)

Thomas
ps Another big diff, but definitely lower information content - all those
char_to_int tables.... :-)
-- 
Thomas Conway               				      conway at cs.mu.oz.au
AD DEUM ET VINUM	  			      Every sword has two edges.