[python-ldap] LDIFParser seems to only parse 200 out of 9K odd records

[Ritesh Nadhani]

Hello

I have code like (taken from official docs):

[riteshn at niara4 ldap]$ more myldif.py
import sys
from ldif import LDIFParser,LDIFWriter

class MyLDIF(LDIFParser):
   def __init__(self,input,output):
      LDIFParser.__init__(self,input)
      self.writer = LDIFWriter(output)
      self.count = 0

   def handle(self,dn,entry):
      # self.writer.unparse(dn,entry)
      self.count = self.count + 1


parser = MyLDIF(open(sys.argv[1], 'rb'), sys.stdout)
parser.parse()
sys.stdout.write("Parsed: {} records".format(parser.count))

..

I have a file generated by ldapsearch using -LLL format and pagedresult:

ldasearch .... -E pr=200/noprompt  ...

When I parse the above file, it seems it only parses 200 records and
stops. Is there something about the paged result comment that breaks
the parsing?

Since the file contains confidential PII, I cannot attach the file but
here are some statistics:

[riteshn at niara4 ldap]$ python myldif.py log_win_ad_user.7
Parsed: 200 records[riteshn at niara4 ldap]$ grep "dn: " log_win_ad_user.7 | wc -l
9043

...

To me it seems this line is the culprit:

# pagedresults:
cookie=AQAAADQCAAD/////hiZDEOF1HmHDzgiafe+UPajr0z0XvrN8Nrs4JYyW
 TBX86O5bP1QQQ65fZxTI5IAhAAAAAAEAAAAAAAAAbjoAAAUAAAAFAAAAAgAAAAAAAAAAAAAABQAAAE
 MACgCYBwAAlwcAAJgHAAAAAAAALA3SQhI2IEmzx0Fkiqk54QAAAAACAAAAAQAAAAAAAAAAAAAA////
 /8kAAADIAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAEAAAD/////oZEJStHOUUMCUHAQiI
 cFT2u5R8OYP4qRkojEgkWk8+IAAAAAf7AAAAB/gAA6bgAAAAAAAAAAAAD//////////wAAAAAuAQkA
 DgAAAAUAAAAAAQAASU5ERVhfMDAwOTAxMkV/sAAAAH+wAAAA//////////////////////////////
 //////////////////////////////////////////////////////////////////////////////
 //////////////////////////////////////////////////////////////////////////////
 //////////////////////////////////////////////////////////////////////////////
 /////////////////////////////////////////////////////////////////////wAA

...

Any ideas?
-- 
Ritesh