[Python-checkins] python/dist/src/Objects dictobject.c,2.144,2.145

[rhettinger@users.sourceforge.net]

Update of /cvsroot/python/python/dist/src/Objects
In directory sc8-pr-cvs1:/tmp/cvs-serv30762

Modified Files:
	dictobject.c 
Log Message:
SF patch #729395: Dictionary tuning

* Increase dictionary growth rate resulting in more sparse dictionaries, 
  fewer lookup collisions, increased memory use, and better cache 
  performance.  For dicts with over 50k entries, keep the current
  growth rate in case an application is suffering from tight memory
  constraints.

* Set the most common case (no resize) to fall-through the test.



Index: dictobject.c
===================================================================
RCS file: /cvsroot/python/python/dist/src/Objects/dictobject.c,v
retrieving revision 2.144
retrieving revision 2.145
diff -C2 -d -r2.144 -r2.145
*** dictobject.c	3 May 2003 06:51:59 -0000	2.144
--- dictobject.c	5 May 2003 22:22:10 -0000	2.145
***************
*** 532,546 ****
  	Py_INCREF(key);
  	insertdict(mp, key, hash, value);
! 	/* If we added a key, we can safely resize.  Otherwise skip this!
! 	 * If fill >= 2/3 size, adjust size.  Normally, this doubles the
! 	 * size, but it's also possible for the dict to shrink (if ma_fill is
! 	 * much larger than ma_used, meaning a lot of dict keys have been
! 	 * deleted).
  	 */
! 	if (mp->ma_used > n_used && mp->ma_fill*3 >= (mp->ma_mask+1)*2) {
! 		if (dictresize(mp, mp->ma_used*2) != 0)
! 			return -1;
! 	}
! 	return 0;
  }
  
--- 532,552 ----
  	Py_INCREF(key);
  	insertdict(mp, key, hash, value);
! 	/* If we added a key, we can safely resize.  Otherwise just return!
! 	 * If fill >= 2/3 size, adjust size.  Normally, this doubles or
! 	 * quaduples the size, but it's also possible for the dict to shrink
! 	 * (if ma_fill is much larger than ma_used, meaning a lot of dict 
! 	 * keys have been * deleted).
! 	 * 
! 	 * Quadrupling the size improves average dictionary sparseness
! 	 * (reducing collisions) at the cost of some memory and iteration
! 	 * speed (which loops over every possible entry).  It also halves
! 	 * the number of expensive resize operations in a growing dictionary.
! 	 * 
! 	 * Very large dictionaries (over 50K items) use doubling instead.  
! 	 * This may help applications with severe memory constraints.
  	 */
! 	if (!(mp->ma_used > n_used && mp->ma_fill*3 >= (mp->ma_mask+1)*2))
! 		return 0;
! 	return dictresize(mp, mp->ma_used*(mp->ma_used>50000 ? 2 : 4));
  }