Re: [Mailman-Developers] Grackle archive framework
On Feb 16, 2012, at 11:40 PM, Aamir Khan wrote:
I talked to people on #launchpad-dev, as suggested by barry to investigate about the possibility of using grackle as new archive framework for mailman. The project isn't functional yet. There are two parts, client and back-end service to store the messages. Client will hopefully be completed by end of next week.
For backend-service implementation, i am also thinking to get involved during its development. They are planning to have cassandra based store for storing the messages. Any thoughts about which backend service would be ideal to store messages for mailman installations ?
On IRC, we talked about a storm + Python mailbox library based backend, with a REST+JSON wsgi based application vending the data. This would allow us to integrate fairly easily with MM3 I think, and would possibly better enable some of the archiver work being done by Terri and others.
-Barry
On Fri, Feb 17, 2012 at 12:55 AM, Barry Warsaw <barry@list.org> wrote:
On Feb 16, 2012, at 11:40 PM, Aamir Khan wrote:
I talked to people on #launchpad-dev, as suggested by barry to investigate about the possibility of using grackle as new archive framework for mailman. The project isn't functional yet. There are two parts, client and back-end service to store the messages. Client will hopefully be completed by end of next week.
For backend-service implementation, i am also thinking to get involved during its development. They are planning to have cassandra based store for storing the messages. Any thoughts about which backend service would be ideal to store messages for mailman installations ?
On IRC, we talked about a storm + Python mailbox library based backend, with a REST+JSON wsgi based application vending the data. This would allow us to integrate fairly easily with MM3 I think, and would possibly better enable some of the archiver work being done by Terri and others.
I understand that we will store the messages in .mbox format. But I don't understand why do we need to use storm for the archiving purpose.
-Barry
Mailman-Developers mailing list Mailman-Developers@python.org http://mail.python.org/mailman/listinfo/mailman-developers Mailman FAQ: http://wiki.list.org/x/AgA3 Searchable Archives: http://www.mail-archive.com/mailman-developers%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-developers/syst3m.w0rm%40gmai...
Security Policy: http://wiki.list.org/x/QIA9
-- Aamir Khan | 3rd Year | Computer Science & Engineering | IIT Roorkee
participants (2)
-
Aamir Khan -
Barry Warsaw