[Python-checkins] python/dist/src/Parser tokenizer.c,2.74,2.75

[anthonybaxter at users.sourceforge.net]

Update of /cvsroot/python/python/dist/src/Parser
In directory sc8-pr-cvs1.sourceforge.net:/tmp/cvs-serv6086/Parser

Modified Files:
	tokenizer.c 
Log Message:
PEP-0318, @decorator-style. In Guido's words:
"@ seems the syntax that everybody can hate equally"
Implementation by Mark Russell, from SF #979728.


Index: tokenizer.c
===================================================================
RCS file: /cvsroot/python/python/dist/src/Parser/tokenizer.c,v
retrieving revision 2.74
retrieving revision 2.75
diff -C2 -d -r2.74 -r2.75
*** tokenizer.c	20 Nov 2003 01:44:58 -0000	2.74
--- tokenizer.c	2 Aug 2004 06:09:55 -0000	2.75
***************
*** 93,96 ****
--- 93,97 ----
  	"DOUBLESLASH",
  	"DOUBLESLASHEQUAL",
+ 	"AT",
  	/* This table must match the #defines in token.h! */
  	"OP",
***************
*** 848,851 ****
--- 849,853 ----
  	case '^':	return CIRCUMFLEX;
  	case '~':	return TILDE;
+ 	case '@':       return AT;
  	default:	return OP;
  	}