Mailman-Developers March 2014

mailman-developers@python.org

27 participants
69 discussions

Re: [Mailman-Developers] URLs in notification messages

by Barry Warsaw

On Mar 11, 2014, at 11:28 AM, Aurelien Bompard wrote: >I wonder where this link is supposed to lead. I did not find such an >endpoint in Postorius, and the Mailman REST API is not public anyway. >Am I missing something? Not really - you've noticed a holdover from Mailman 2.1 that hasn't been completely ported to the new architecture. I have an unfinished branch that tries to fix this. The basic problem is this: with the separation of web ui and core, the core can't actually know a priori what those links will be, or even if there *are* links. So in my branch I actually remove all those links from the default templates and rewrite as necessary to describe the email workflow. Then, I add some configuration variables so that a system admin can specify urls at which to download the appropriate templates. This arrangement is similar to the welcome message configurations, which allow you to specify how the core will retrieve the appropriate message based on the mailing list *and* language (this location supports a number of url schemes, including the obvious http/https, but also file: and internal reference schemes for finding templates in-tree). Once a template is downloaded, it's cached. This allows the site admin to design whatever template they want, for any list or language, and the core will use it as needed. A set of interpolation variables are defined so you can fill in various placeholders. Postorius ultimately should ship with a number of default templates and we can provide an example configuration file for using those default Postorius templates. As I mentioned, this branch isn't yet complete, but I am still working on it. Cheers, -Barry

7 years, 10 months

Re: [Mailman-Developers] Moderation rules priority

by Barry Warsaw

On Mar 11, 2014, at 06:25 PM, Aurelien Bompard wrote: >What do you think about all that? Do you agree there's actually an >issue there? Any idea how to solve it? For example, make the NonMember >rule exit if a member is found amongst the senders (which would simply >be equivalent to making it yield to the Member rule). Bad idea? Ah, an interesting case! My immediate reaction is that nonmember-moderation should do exactly what you suggest: test for both membership and nonmembership. If it's both, then return False as if the action were Action.defer. This should allow the member-moderation rule to take precedence. Can you think of a reason *not* to do this? -Barry

7 years, 10 months

Moderation rules priority

by Aurelien Bompard

Hey! I'd like to discuss what happens when an email is sent by both a member and a nonmember in Mailman3. How is that possible? Very easy, here's my use case : I have my own domain, say example.com, and for convenience and portability I choose to use Gmail as a server/storage/interface. My main adress is alice(a)example.com and I redirect it to alice(a)gmail.com, while I set a default identity in gmail to alice(a)example.com which will set the proper From header. However, for spam detection and spoofing reasons, gmail adds a Sender header with alice(a)gmail.com. My outgoing emails thus have both a From and a Sender header, and in this case email clients only display the >From header (except Outlook, but eh...) Mailman now: when I subscribe to a list, I use my regular address, alice(a)example.com. But the message.senders property will contain both addresses because of the Sender header. The email goes through the MemberModeration rule, which finds my subscribed address and, by default, associates the "defer" action. The email then goes through the NonMemberModeration rule, which finds my Gmail address and sets the action to "hold" (it ignores my main address because it's a member already). What do you think about all that? Do you agree there's actually an issue there? Any idea how to solve it? For example, make the NonMember rule exit if a member is found amongst the senders (which would simply be equivalent to making it yield to the Member rule). Bad idea? Aurélien

7 years, 10 months

URLs in notification messages

by Aurelien Bompard

Hey there! I have a question about emails generated by Mailman3. This is an example of a "message held" notification ("your message awaits moderator approval"). According to the template, Mailman inserts a cancel link at the end of the email: If you would like to cancel this posting, please visit the following URL: https://example.com/confirm/test@example.com/longhash I wonder where this link is supposed to lead. I did not find such an endpoint in Postorius, and the Mailman REST API is not public anyway. Am I missing something? Thanks! Aurélien

7 years, 10 months

Re: [Mailman-Developers] [GSoC 2014] Cordova/Android App for GNU Mailman Admin Interface

by Bhargav Golla

Hello I have gone through the Admin interface and all functions that can be achieved with the REST API. I intend to have a login screen where a user can enter URL for the REST API endpoint, REST Username and password. We will use this to subsequent authenticate all requests made to fetch subscribers list, domains list, etc. I was wondering if I could get some feedback on this. I will start writing my proposal based on this starting point and list out what all I would features I would be implementing during the period of GSoC. Regards On Wed, Mar 5, 2014 at 10:32 AM, Bhargav Golla <bgolla(a)g.clemson.edu> wrote: > Thanks. I would have probably missed it out the first time. I will go > through the web UI and also the documentation of REST API to understand > what all functions need to be implemented in the admin interface for a user. > > Regards > > > On Wed, Mar 5, 2014 at 10:25 AM, Rajeev S <rajeevs1992(a)gmail.com> wrote: > >> Hi, >> >> You will be asked for the create user prompt only the first time you run >> syncdb.That's why you don't see it now. >> >> Once the DB is created, only new tables, specified via django models, get >> added to DB during the syncdb. >> >> >> *Regards,Rajeev S* >> *Government Engineering College,Thrissur* >> *http://rajeevs.tk <http://rajeevs.tk>* >> >> >> On Wed, Mar 5, 2014 at 8:47 PM, Bhargav Golla <bgolla(a)g.clemson.edu>wrote: >> >>> Hi Rajeev >>> >>> I wasn't asked if I wanted to create a super user when I executed python >>> manage.py syncdb. This was the output I got with syncdb: >>> Creating tables... >>> Installing Custome SQL... >>> Installing indexes... >>> Installed 0 object(s) from 0 fixture(s) >>> >>> I tried python manage.py createsuperuser and was able to login with >>> details I provided there. >>> >>> Thanks for your help. >>> >>> Regards >>> >>> >>> On Wed, Mar 5, 2014 at 10:00 AM, Rajeev S <rajeevs1992(a)gmail.com> wrote: >>> >>>> Hi Bhargav, >>>> >>>> You will be asked whether to *add a superuser* during *syncdb*. If you >>>> answered no to that, do *python manage.py createsuperuser * and use >>>> that username and password to login. >>>> >>>> >>>> *Regards,Rajeev S* >>>> *Government Engineering College,Thrissur* >>>> *http://rajeevs.tk <http://rajeevs.tk>* >>>> >>>> >>>> On Wed, Mar 5, 2014 at 8:05 PM, Bhargav Golla <bgolla(a)g.clemson.edu>wrote: >>>> >>>>> Hi Abhilash >>>>> >>>>> If you mean the last step of installation where we do cd >>>>> postorius_standalone;python manage.py syncdb, I wasn't asked for any >>>>> username/password. I checked the settings.py and it doesn't have any >>>>> specific default username/password. >>>>> >>>>> And the http://localhost:8001/3.0 worked for me. >>>>> >>>>> >>>>> On Wed, Mar 5, 2014 at 9:22 AM, Abhilash Raj <raj.abhilash1(a)gmail.com >>>>> >wrote: >>>>> >>>>> > Hi Bhargav, >>>>> > >>>>> > On Wednesday 05 March 2014 07:36 PM, Bhargav Golla wrote: >>>>> > > Thanks for that change Rajeev. I was able to get the Web UI up and >>>>> > running. >>>>> > > I was trying to find out the default Username and password for >>>>> this but >>>>> > was >>>>> > > unable to. When I was exploring docs in mailman.client and some >>>>> config >>>>> > > files in mailman, I found that the default username and password >>>>> for >>>>> > admin >>>>> > > is restadmin and restpass. Tried that and was out of luck there >>>>> too. >>>>> > Could >>>>> > > you help me with the default username and password details? >>>>> > >>>>> > While setting up Postorius(the web UI) when you do 'python manage.py >>>>> > syncdb' for the first time, it asks you to create admin. You can log >>>>> in >>>>> > using those credentials. 'restadmin' and 'restpass' are the >>>>> credentials >>>>> > for the mailman rest server. >>>>> > >>>>> > > Also, there is a using.txt doc in mailman.client which says we can >>>>> make >>>>> > the >>>>> > > REST requests by connecting to http://localhost:9001/3.0 using >>>>> username >>>>> > and >>>>> > > password. Should the URL be http://localhost:9000/3.0 for this >>>>> example >>>>> > or >>>>> > > would it be any different? >>>>> > >>>>> > AFAIK it is 'http://localhost:8001/3.0'. (Try it once. If I am wrong >>>>> > please someone correct me) >>>>> > >>>>> > > >>>>> > > Thanks >>>>> > > >>>>> > > >>>>> > > On Mon, Mar 3, 2014 at 1:38 PM, Rajeev S <rajeevs1992(a)gmail.com> >>>>> wrote: >>>>> > > >>>>> > >> Hi Bhargav, >>>>> > >> >>>>> > >> Just do *mailman start*, without the bin. >>>>> > >> >>>>> > >> I have edited the wiki. >>>>> > >> >>>>> > >> >>>>> > >> *Regards, Rajeev S* >>>>> > >> *Government Engineering College,Thrissur* >>>>> > >> *http://rajeevs.tk <http://rajeevs.tk>* >>>>> > >> >>>>> > >> >>>>> > >> On Mon, Mar 3, 2014 at 10:37 PM, Bhargav Golla < >>>>> bgolla(a)g.clemson.edu >>>>> > >wrote: >>>>> > >> >>>>> > >>> Thanks Barry and Terri for your feedback. >>>>> > >>> I was trying to install Postorius locally and analyze what all >>>>> would be >>>>> > >>> required in a mobile app for Admin. Doing the same, I have hit a >>>>> > >>> roadblock. >>>>> > >>> I am using the wiki provided here[1]. I tried to install mailman >>>>> using >>>>> > >>> "set >>>>> > >>> up sources" part of the wiki. Though python setup.py install >>>>> executes >>>>> > >>> without any errors, I am unable to see the folder bin/ in the >>>>> same >>>>> > >>> directory. So, even though I proceed with further setup, I am >>>>> getting a >>>>> > >>> "Mailman REST API not available. Please start mailman core" on my >>>>> > >>> localhost:8000 webpage. Could anyone help me here? >>>>> > >>> >>>>> > >>> [1] >>>>> > >>> >>>>> > >>> >>>>> > >>>>> http://wiki.list.org/display/DEV/A+5+minute+guide+to+get+the+Mailman+web+UI… >>>>> > >>> >>>>> > >>> Thanks >>>>> > >>> >>>>> > >>> >>>>> > >>> On Sun, Mar 2, 2014 at 1:18 AM, Terri Oda <terri(a)toybox.ca> >>>>> wrote: >>>>> > >>> >>>>> > >>>> >>>>> > >>>> On 2014-02-28, 7:36 AM, Bhargav Golla wrote: >>>>> > >>>> >>>>> > >>>>> I have a few questions regarding this idea. >>>>> > >>>>> 1. I intend to develop it on Cordova since it will help in >>>>> porting >>>>> > the >>>>> > >>> app >>>>> > >>>>> easily to multiple platforms. Were there any ideas in this >>>>> directions >>>>> > >>>>> regarding going native or hybrid? >>>>> > >>>>> >>>>> > >>>> >>>>> > >>>> Personally, I'd prefer if we went hybrid and had an html5 >>>>> webapp that >>>>> > >>>> could be used straight over the web for mobile users who don't >>>>> want to >>>>> > >>>> install an app, with Cordova used to build the individual >>>>> platform >>>>> > >>> apps. I >>>>> > >>>> may not be the mentor on this one, though, so I'm happy to >>>>> defer to >>>>> > >>> whoever >>>>> > >>>> the final mentor is on this front. >>>>> > >>>> >>>>> > >>>> Incidentally, I've been using Intel's XDK for building Cordova >>>>> apps >>>>> > >>> lately >>>>> > >>>> and highly recommend it for quick testing on various platforms >>>>> and >>>>> > >>> screen >>>>> > >>>> sizes. I've found it a very useful tool, and not just because >>>>> I work >>>>> > >>> for >>>>> > >>>> Intel now! >>>>> > >>>> >>>>> > >>>> 2. Can I assume that all mailing lists built by Mailman >>>>> support the >>>>> > >>> REST >>>>> > >>>>> interface? Also, I have tried to see if I can get JSON >>>>> responses and >>>>> > I >>>>> > >>> am >>>>> > >>>>> unable to by adding a HTTP Accept Header to take >>>>> "application/json". >>>>> > >>> Am I >>>>> > >>>>> doing anything wrong or is JSON not implemented? >>>>> > >>>>> >>>>> > >>>> >>>>> > >>>> I don't know the answer to this off the top of my head: Barry? >>>>> > >>>> >>>>> > >>>> >>>>> > >>>> 3. As a starter, could I ignore internationalization for GSoC, >>>>> but >>>>> > >>>>> implement interface in such a way as to be able to >>>>> internationalize >>>>> > it >>>>> > >>>>> easily? >>>>> > >>>>> >>>>> > >>>> >>>>> > >>>> We don't expect you to actually translate anything, don't >>>>> worry. :) >>>>> > But >>>>> > >>>> you should definitely build as much as possible so that >>>>> > >>>> internationalization will be easy: make sure there's a quick >>>>> way to >>>>> > get >>>>> > >>> a >>>>> > >>>> list of strings that need translation, at least. Some of the >>>>> strings >>>>> > >>> may >>>>> > >>>> be already translated in other components of Mailman, so you >>>>> may be >>>>> > >>> able to >>>>> > >>>> get some translations to use to test if you have time at the >>>>> end of >>>>> > the >>>>> > >>>> summer for internationalization. >>>>> > >>>> >>>>> > >>>> Terri >>>>> > >>>> >>>>> > >>>> >>>>> > >>> >>>>> > >>> >>>>> > >>> -- >>>>> > >>> Bhargav Golla >>>>> > >>> M.S Computer Science >>>>> > >>> Github <http://www.github.com/bhargavgolla> | >>>>> > >>> LinkedIN<http://www.linkedin.com/in/bhargavgolla> >>>>> > >>> | Website <http://www.bhargavgolla.com/> >>>>> > >>> _______________________________________________ >>>>> > >>> Mailman-Developers mailing list >>>>> > >>> Mailman-Developers(a)python.org >>>>> > >>> https://mail.python.org/mailman/listinfo/mailman-developers >>>>> > >>> Mailman FAQ: http://wiki.list.org/x/AgA3 >>>>> > >>> Searchable Archives: >>>>> > >>> http://www.mail-archive.com/mailman-developers%40python.org/ >>>>> > >>> Unsubscribe: >>>>> > >>> >>>>> > >>>>> https://mail.python.org/mailman/options/mailman-developers/rajeevs1992%40gm… >>>>> > >>> >>>>> > >>> Security Policy: http://wiki.list.org/x/QIA9 >>>>> > >>> >>>>> > >> >>>>> > >> >>>>> > > >>>>> > > >>>>> > >>>>> > -- >>>>> > Abhilash Raj >>>>> > >>>>> > >>>>> >>>>> >>>>> -- >>>>> Bhargav Golla >>>>> M.S Computer Science >>>>> Github <http://www.github.com/bhargavgolla> | >>>>> LinkedIN<http://www.linkedin.com/in/bhargavgolla> >>>>> | Website <http://www.bhargavgolla.com/> >>>>> _______________________________________________ >>>>> Mailman-Developers mailing list >>>>> Mailman-Developers(a)python.org >>>>> https://mail.python.org/mailman/listinfo/mailman-developers >>>>> Mailman FAQ: http://wiki.list.org/x/AgA3 >>>>> Searchable Archives: >>>>> http://www.mail-archive.com/mailman-developers%40python.org/ >>>>> Unsubscribe: >>>>> https://mail.python.org/mailman/options/mailman-developers/rajeevs1992%40gm… >>>>> >>>>> Security Policy: http://wiki.list.org/x/QIA9 >>>>> >>>> >>>> >>> >>> >>> -- >>> Bhargav Golla >>> M.S Computer Science >>> Github <http://www.github.com/bhargavgolla> | LinkedIN<http://www.linkedin.com/in/bhargavgolla> >>> | Website <http://www.bhargavgolla.com/> >>> >> >> > > > -- > Bhargav Golla > M.S Computer Science > Github <http://www.github.com/bhargavgolla> | LinkedIN<http://www.linkedin.com/in/bhargavgolla> > | Website <http://www.bhargavgolla.com/> > -- Bhargav Golla M.S Computer Science Github <http://www.github.com/bhargavgolla> | LinkedIN<http://www.linkedin.com/in/bhargavgolla> | Website <http://www.bhargavgolla.com/>

7 years, 10 months

Re: [Mailman-Developers] Gsoc idea discussions : Continuous integration tool

by Stephen J. Turnbull

varun sharma writes: > Actually my idea is to import all the unit tests from the projects > involved in the suite and write new tests as well if required, so > that we can check both "integration of new code" and "integration > of components with each other". Selectively combining unit tests of > different projects will do the job of workflow manager ? No. "Workflow" is the process by which the project develops new code, and includes handling user requests, assembling requirements and specifications, designing features and fixes, implementing them in code, testing, reviewing, approving, pushing to the mainline repository, and releasing. The order above, when implemented over the whole release cycle, corresponds pretty closely to the infamous "waterfall" workflow, but most open source projects don't follow that. "Integration" generally refers to some subset of the testing, reviewing, approving, and pushing steps. It pretty much always includes the testing and pushing steps, because those are the sore point. Even when a developer is conscientious about testing before pushing, there is a big problem because in the time that you're testing, somebody else will push, and you have to pull and retest. Note that "more test failures" is not an issue, *somebody* will have a test failure if it's going to happen. It's the time spent testing if there *isn't* going to be a failure -- most of the time -- that we'd like to avoid. So "continuous integration" is a process that automatically queues merge requests, tests them, and pushes to mainline until a merge fails tests. At that point, the requested merge is rejected and the responsible developer needs to deal with it, but the integration process goes on to the next changeset in hopes that that one won't fail. That doesn't mean you have to *do* what I've defined as "continuous integration", just that continuous integration is a bigger job than just "buildbot for three projects at once". Just the buildbot project would be very useful. One warning: Google is very serious about *code*. Simply configuring a buildbot or three isn't going to qualify, you need to write substantial additional code. > > Do you have a blog? > > > > Yes, i do :) (http://www.sharmalabs.com).Right now i don't post actively > on it but I'll be posting weekly gsoc summaries there if i got selected. > :) Up to you, but starting now is helpful to your chances....

7 years, 10 months

Re: [Mailman-Developers] Gsoc idea discussions : Continuous integration tool

by Stephen J. Turnbull

varun sharma writes: > On Fri, Mar 7, 2014 at 7:14 AM, Stephen J. Turnbull <stephen(a)xemacs.org>wrote: [ long irrelevant quote snipped -- please trim! If you really can't trim because you're using a handheld in a crowded bus on a very bumpy road, please *top* post, but make sure your text includes enough context -- readers should not have to dig through a long quote to find the exact text you are responding to. ] > Sorry, if i wasn't clear enough but from frontend suite i meant the command > line interface that is going to check for the integrity before the commit > (i.e mm_gatekeeper on developer's machine). OK. Why is this a CLI (command line interface)? Does it need to be controlled by hand? Isn't this going to be some sort of daemon triggered by commits to the trunk (or other "watched" branch)? Below you write "python module" -- if that's what you mean, it's a better way to express it. > I was trying to say that: Is it possible if i write the command > line interface myself by adding all the unit tests for all the > projects to be involved in the integration suite and let buildbot > handle the build testing part ? Yes. This is not only permissible, it's good design, and very desirable. > The work that i am expecting to do in this project is: > 1. Write a python module mm_gatekeeper that will handle all the integration > tests for all the projects involved in the mailman suite on the developer > machine before commit. OK. I'm not sure what you mean by "integration tests". Also, as I understand it, usually "continuous integration" does not refer to "integration of components with each other", but instead it means "integration of new code into the public repository". Ie, although testing is part of it, it's really a workflow manager, not a test framework. If you're interested in integration testing of the components, that is not a problem, we can use that. But we should straighten out our terminology so everybody is expecting the same project. > 2. Forking buildbot for adding build testing from the repository and > tweaking the buildbot code to meet our requirements. Do this only if necessary, I think. We can discuss when you get to actual coding, of course. But 1. buildbot should be pretty flexible, enough to handle this task. 2. If you only need a little bit more, it might be better to "wrap" buildbot with extra capability rather than "change" it. 3. If you do need to change it, we will definitely ask that you try to get upstream to add the additional capabilities. > I deployed buildbot with aws ec2 on postorius independently by adding repo > of postorius_standalone at http://dev.sharmalabs.com:8010 and > added the commands that are required to run the unit tests. OK, that looks pretty cool. I suggest you add the URL for your code repo to http://dev.sharmalabs.com:8010/about. All of your Internet facing sites should have an "about" or "home" page with links to all of the others. Do you have a blog? Sorry if you have already posted all that information. Remember that we have a lot of students, most of us participate in multiple lists which are currently swamped with GSoC students, and some of us mentor for more than one org (or are org admins, which also takes up a lot of time and energy -- thank you Terri!). Please humor us if we ask for your information more than once.

7 years, 10 months

Re: [Mailman-Developers] [GSoC]Some questions about `Mailman command line client`

by Xiongzhi Gao

Thanks for your reply. I just installed the Mailman3 on my PC and checked list archives. I found there is a discuss of `layout`, I think there are two kinds of `layout` available for this CLI tools. One of `layout` is like shell, the other just like git, the tools can make multi-methods and have multi-options can save config in some place, just like: mailman-CLI passwd -c 'sample(a)sample.com` mailman-CLI list -a 'sample(a)sample.com' and there can be some config in '~/.mailman-CLI/config', such as Email address and other preference. What do you mean by 'not safe'? I don't think it is the requirement of > the project to sync backups to any 3rd party services. Backing up the > backups should be the user's problem. For the third question I ask, I have a new idea, I think maybe a hook for each operation is more flexible for user and make CLI tools more extensibility. And is it necessary to make some code to prove I can do this project :) ? Regards, Xiongzhi Gao, Computer School of Wuhan University Github: https://github.com/brickgao Blog: http://blog.brickgao.com

7 years, 10 months

Re: [Mailman-Developers] Git mirror for mailman

by Barry Warsaw

On Mar 08, 2014, at 03:01 PM, Paul Wise wrote: >https://bugs.debian.org/714038 Subscribed! -Barry

7 years, 10 months

GSoC 2014 - Porting hyperkitty to Python 3.x info

by Ravi Kumar

Hello everyone, I'm Ravi Kumar, an undergrad Computer Science and Engineering student based in Bangalore. I'm familiar with Source code management with git and comfortable with Python, Ruby and C. I'm familiar with django and the MVC approach, although I haven't made any real contributions to open-source projects. So this is all the more exciting to me. I see GSoC as a very good opportunity to learn and also give something back to the community. I was going through the Ideas page and was interested in porting Hyperkitty and Postorius on to python 3.x and I had a bunch of questions. 1. Are there any constraints the community places on the strategy that is to be adopted to port the apps or is are the strategies up to the person submitting the proposal? 2. What versions of django should the ports be compatible across? 3. How reliable and thorough are the unit tests that are in place? 4. Should the ports be polyglots supporting Python 2.6-3.x or just support python 3.3? Since mailman plans to support only Python 3.x in the future? Thanks, Ravi Kumar

7 years, 10 months

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

Mailman-Developers March 2014