[Python-checkins] CVS: python/dist/src/Lib tokenize.py,1.27,1.28

[Tim Peters]

Update of /cvsroot/python/python/dist/src/Lib
In directory usw-pr-cvs1:/tmp/cvs-serv10452/python/Lib

Modified Files:
	tokenize.py 
Log Message:
SF patch #455966:  Allow leading 0 in float/imag literals.
Consequences for Jython still unknown (but raised on Jython-Dev).


Index: tokenize.py
===================================================================
RCS file: /cvsroot/python/python/dist/src/Lib/tokenize.py,v
retrieving revision 1.27
retrieving revision 1.28
diff -C2 -d -r1.27 -r1.28
*** tokenize.py	2001/08/08 05:04:07	1.27
--- tokenize.py	2001/08/30 20:51:58	1.28
***************
*** 57,63 ****
  Exponent = r'[eE][-+]?\d+'
  Pointfloat = group(r'\d+\.\d*', r'\.\d+') + maybe(Exponent)
! Expfloat = r'[1-9]\d*' + Exponent
  Floatnumber = group(Pointfloat, Expfloat)
! Imagnumber = group(r'0[jJ]', r'[1-9]\d*[jJ]', Floatnumber + r'[jJ]')
  Number = group(Imagnumber, Floatnumber, Intnumber)
  
--- 57,63 ----
  Exponent = r'[eE][-+]?\d+'
  Pointfloat = group(r'\d+\.\d*', r'\.\d+') + maybe(Exponent)
! Expfloat = r'\d+' + Exponent
  Floatnumber = group(Pointfloat, Expfloat)
! Imagnumber = group(r'\d+[jJ]', Floatnumber + r'[jJ]')
  Number = group(Imagnumber, Floatnumber, Intnumber)