I got the following error when rebuilding archives for a list (OpenBSD Mailman 2.1.5 installed from OpenBSD ports. It turned out the actual problem was a permissions problem on /var/spool/mailman/lists/[listname] (it was owned by root:_mailman instead of _mailman:_mailman). Should I file a bug about this (that the error isn't more specific)? It would be much more helpful if this said "Cannot write to /var/spool/mailman/lists/nord-modular" or something rather than "MemoryError".
[as user mailman, ./bin/arch [listname]] [...] Updating index files for archive [2002-November] Traceback (most recent call last): File "/usr/local/lib/mailman/bin/arch", line 187, in ? main()
[...]
File "/usr/ports/mail/mailman/w-mailman-2.1.5-postfix/fake-sparc64-postfix/usr/local/lib/mailman/Mailman/Archiver/HyperDatabase.py", line 265, in __closeIndices index.close() File "/usr/ports/mail/mailman/w-mailman-2.1.5-postfix/fake-sparc64-postfix/usr/local/lib/mailman/Mailman/Archiver/HyperDatabase.py", line 187, in close fp.write(marshal.dumps(self.dict)) MemoryError
(side note - I don't know why it was referencing in /usr/ports in the work directory for the port - this is Mailman installed from OpenBSD ports; removing that whole directory in ports doesn't break anything. I checked and I think the inode number was different for stuff in that directory and the installed stuff in /usr/local/lib/mailman - so I don't think it was a hard link).
-- "Since when is skepticism un-American? Dissent's not treason but they talk like it's the same..." (Sleater-Kinney - "Combat Rock")
On Wed, Sep 29, 2004 at 10:25:37AM -0700, Will Yardley wrote:
Should I file a bug about this (that the error isn't more specific)? It would be much more helpful if this said "Cannot write to /var/spool/mailman/lists/nord-modular" or something rather than "MemoryError".
Eep. I take that back. Even after correcting the permissions, I still get this error...
Very odd that it's referencing the file of the build directory not the actual file in /usr/local/lib/mailman/Mailman -- however, I can rebuild the archives of another list without running into this problem, so I don't /think/ the problem is with the Mailman install itself.
Anything further I can do to debug this? Any idea what the "MemoryError" refers to?
[...] Updating HTML for article 1185 Updating index files for archive [2002-November] Traceback (most recent call last): File "./bin/arch", line 187, in ? main() File "./bin/arch", line 177, in main archiver.close() File "/usr/ports/mail/mailman/w-mailman-2.1.5-postfix/fake-sparc64-postfix/usr/local/lib/mailman/Mailman/Archiver/pipermail.py", line 311, in close File "/usr/ports/mail/mailman/w-mailman-2.1.5-postfix/fake-sparc64-postfix/usr/local/lib/mailman/Mailman/Archiver/pipermail.py", line 527, in update_dirty_archives File "/usr/ports/mail/mailman/w-mailman-2.1.5-postfix/fake-sparc64-postfix/usr/local/lib/mailman/Mailman/Archiver/HyperArch.py", line 1075, in update_archive File "/usr/ports/mail/mailman/w-mailman-2.1.5-postfix/fake-sparc64-postfix/usr/local/lib/mailman/Mailman/Archiver/pipermail.py", line 428, in update_archive File "/usr/ports/mail/mailman/w-mailman-2.1.5-postfix/fake-sparc64-postfix/usr/local/lib/mailman/Mailman/Archiver/pipermail.py", line 343, in __set_parameters File "/usr/ports/mail/mailman/w-mailman-2.1.5-postfix/fake-sparc64-postfix/usr/local/lib/mailman/Mailman/Archiver/HyperDatabase.py", line 209, in firstdate File "/usr/ports/mail/mailman/w-mailman-2.1.5-postfix/fake-sparc64-postfix/usr/local/lib/mailman/Mailman/Archiver/HyperDatabase.py", line 240, in __openIndices File "/usr/ports/mail/mailman/w-mailman-2.1.5-postfix/fake-sparc64-postfix/usr/local/lib/mailman/Mailman/Archiver/HyperDatabase.py", line 265, in __closeIndices File "/usr/ports/mail/mailman/w-mailman-2.1.5-postfix/fake-sparc64-postfix/usr/local/lib/mailman/Mailman/Archiver/HyperDatabase.py", line 187, in close MemoryError
-- "Since when is skepticism un-American? Dissent's not treason but they talk like it's the same..." (Sleater-Kinney - "Combat Rock")
On Sep 30, 2004, at 03:16, Will Yardley wrote:
Anything further I can do to debug this? Any idea what the "MemoryError" refers to?
How large are your archives?
I think Pipermail still tries to slurp the entire archive into memory when arch regenerates the archives. That is why arch accepts the --start=N and --end=M options. You can run arch multiple times (only the first with --wipe), specifying different blocks of messages to process in each execution.
-- Jim Tittsler http://www.OnJapan.net/ GPG: 0x01159DB6 Python Starship http://Starship.Python.net/ Ringo MUG Tokyo http://www.ringo.net/rss.html
On Thu, Sep 30, 2004 at 02:41:16PM +0900, Jim Tittsler wrote:
On Sep 30, 2004, at 03:16, Will Yardley wrote:
Anything further I can do to debug this? Any idea what the "MemoryError" refers to?
How large are your archives?
The mbox file is about 55M The whole indexed archive directory is currently about 194M
The box does only have 256 M of RAM. So what you're saying make sense.
I think Pipermail still tries to slurp the entire archive into memory when arch regenerates the archives. That is why arch accepts the --start=N and --end=M options. You can run arch multiple times (only the first with --wipe), specifying different blocks of messages to process in each execution.
Thanks. I'm try that. Are the archives ever rebuilt in their entirety automatically (i.e., do I need to worry about this process failing on its own)? In this case it doesn't really matter since the list has moved elsewhere anyway.
-- "Since when is skepticism un-American? Dissent's not treason but they talk like it's the same..." (Sleater-Kinney - "Combat Rock")
At 3:53 PM -0700 2004-09-30, Will Yardley wrote:
How large are your archives?
The mbox file is about 55M The whole indexed archive directory is currently about 194M
The box does only have 256 M of RAM. So what you're saying make sense.
Ahh. In this case, you might want to see <http://www.python.org/cgi-bin/faqw-mm.py?req=show&file=faq04.041.htp>. A different error message, but I believe that this solution is likely to be helpful.
-- Brad Knowles, <brad@stop.mail-abuse.org>
"Those who would give up essential Liberty, to purchase a little temporary Safety, deserve neither Liberty nor Safety."
-- Benjamin Franklin (1706-1790), reply of the Pennsylvania
Assembly to the Governor, November 11, 1755SAGE member since 1995. See <http://www.sage.org/> for more info.
participants (3)
-
Brad Knowles -
Jim Tittsler -
Will Yardley