Serialization format of gdb trace data between many different machines.

[joshbaptiste]

On Apr 15, 2:21 pm, MRAB <goo... at mrabarnett.plus.com> wrote:
> joshbaptiste wrote:
> > I have a corewatch.py program on ~400+ Linux machines that collect
> > core file gdb output and sends the output traces via email to
> > developers. I what to convert the script for all output to be sent to
> > a centralized server also written in python and displayed via
> > webpage.  My first thought was a simple HTTP POST to server from all
> > nodes but since the gdb output can be very large, multiplied my the #
> > of servers, worries me as network traffic of 400+ nodes sending to 1
> > server may cause saturation.
>
> > What would be the most efficient/small serialization format to use to
> > send this trace data from nodes to server over network.. would
> > Pickling be ok?
>
> I'd probably compress the data first using the zipfile module.

ok.. zipfile,  sounds good thanks..