Comments on moving issues to GitHub
Hi,
I failed to get the microphone after Mariatta's secret talk about moving Python issues from bugs.python.org (Roundup) to GitHub.
I just wanted to add that it's common (at least once per month) that someone comes to #python-dev to report that they cannot connect to bugs.python.org (the authentication is broken). Usually, I tried to point them to the meta-bug tracker, but I hate doing that... The concept of a meta-bug tracker blows my mind :-)
Right now, I tied to add a comment on an issue and I got the error:
""" Proxy Error
The proxy server received an invalid response from an upstream server. The proxy server could not handle the request POST /issue32534.
Reason: Error reading from remote server
Apache/2.2.16 (Debian) Server at bugs.python.org Port 443 """
Sometimes, I get a SSL error. I reported the issue 7 months ago, and sometimes I still get the error:
https://github.com/python/psf-infra-meta/issues/4
It's a random error, but using a loop, it's easy to reproduce it.
I don't have a strong opinion about moving issues to GitHub. I just wanted to point out that if we keep bugs.python.org, we need more volunteers to maintain it. I would prefer to not have to redirect new comers, who want to report a simple bug, to a "meta bug tracker"...
I don't plan to report the proxy error, since my previous bug report (SSL error) is still not fixed and it's the first time that I got this error.
Victor
Le 19/05/2018 à 02:10, Victor Stinner a écrit :
Hi,
I failed to get the microphone after Mariatta's secret talk about moving Python issues from bugs.python.org (Roundup) to GitHub.
A "secret talk"? What is that?
I don't have a strong opinion about moving issues to GitHub.
If that's on the table, it seems to me that categorization, sorting and filtering on GitHub issues is rather poor, while the basic UI experience (editing messages, etc.) is better. Also, I think customization (e.g. of the default view) is basically inexistent.
Regards
Antoine.
On Sun, May 20, 2018 at 10:56:21AM +0200, Antoine Pitrou wrote:
If that's on the table, it seems to me that categorization, sorting and filtering on GitHub issues is rather poor, while the basic UI experience (editing messages, etc.) is better. Also, I think customization (e.g. of the default view) is basically inexistent.
Also search via Google "site:bugs.python.org <term>" usually gives quite nice results, while the same for GitHub issues usually does not work at all (far too many unrelated results).
Then there's the original promise of the GitHub migration that in the case of GH bankruptcy or a sudden lockdown the tracker would still be available.
Stefan Krah
On Sun, May 20, 2018, 03:18 Antoine Pitrou <antoine@python.org> wrote:
Le 19/05/2018 à 02:10, Victor Stinner a écrit :
Hi,
I failed to get the microphone after Mariatta's secret talk about moving Python issues from bugs.python.org (Roundup) to GitHub.
A "secret talk"? What is that?
She gave a talk at the language summit to discuss what people thought of the idea, and she had some fun making the topic a surprise so she could see people's reactions. I don't think there's any secret beyond that.
IIRC, the general reaction was that it was definitely worth exploring, but that it would be a lot of work and require solutions to a lot of problems to make sure people's workflows weren't too impacted, so we'd need a much more detailed proposal before any decision could be made.
-n
On May 20, 2018, at 10:19, Nathaniel Smith <njs@pobox.com> wrote:
IIRC, the general reaction was that it was definitely worth exploring, but that it would be a lot of work and require solutions to a lot of problems to make sure people's workflows weren't too impacted, so we'd need a much more detailed proposal before any decision could be made.
Note too that Bryan Clark from GitHub, who I believe is a product manager there, was at the packaging mini-summit. If/when we have a specific set of asks for the migration, we can reach out to him and see how they can help. For example, I specifically asked about my favorite GitLab feature “commit when CI passes” and it sounded like they were working on that.
-Barry
On Sun, 20 May 2018 at 10:43 Barry Warsaw <barry@python.org> wrote:
On May 20, 2018, at 10:19, Nathaniel Smith <njs@pobox.com> wrote:
IIRC, the general reaction was that it was definitely worth exploring,
but that it would be a lot of work and require solutions to a lot of problems to make sure people's workflows weren't too impacted, so we'd need a much more detailed proposal before any decision could be made.
Note too that Bryan Clark from GitHub, who I believe is a product manager there, was at the packaging mini-summit. If/when we have a specific set of asks for the migration, we can reach out to him and see how they can help. For example, I specifically asked about my favorite GitLab feature “commit when CI passes” and it sounded like they were working on that.
There was also general consensus that the state of maintenance for bpo is subpar due to lack of staffing and that more people will need to come forward to help maintain it if we decide to not transition to another issue tracker like GitHub or GitLab.
On 21 May 2018 at 05:03, Brett Cannon <brett@python.org> wrote:
On Sun, 20 May 2018 at 10:43 Barry Warsaw <barry@python.org> wrote:
On May 20, 2018, at 10:19, Nathaniel Smith <njs@pobox.com> wrote:
IIRC, the general reaction was that it was definitely worth exploring,
but that it would be a lot of work and require solutions to a lot of problems to make sure people's workflows weren't too impacted, so we'd need a much more detailed proposal before any decision could be made.
Note too that Bryan Clark from GitHub, who I believe is a product manager there, was at the packaging mini-summit. If/when we have a specific set of asks for the migration, we can reach out to him and see how they can help. For example, I specifically asked about my favorite GitLab feature “commit when CI passes” and it sounded like they were working on that.
There was also general consensus that the state of maintenance for bpo is subpar due to lack of staffing and that more people will need to come forward to help maintain it if we decide to not transition to another issue tracker like GitHub or GitLab.
Right, one of the outcomes of the discussion at the Summit was that any proposal to migrate to a different issue tracker would need to present a clear statement of the *problems intended to be solved*, such that the folks that would prefer to see us stay on our own issue tracker could present a competing proposal to solve those problems without a wholesale migration to another system.
Some examples of problems that would benefit from attention:
- fixing the SSL/TLS connectivity issues
- making the issue tracker usable on mobile devices
- ability to edit the description for issues that evolve over time, not just the title
- improved editing support for comments (both in initial formatting, and in being able to correct errors)
- REST API access to tracker data
- simplifying account creation (especially for folks that already have GitHub accounts)
- rationalising the metadata fields by asking which ones actually see significant use
Some examples of problems that in-place enhancement of the tracker would inherently avoid, but a migration proposal would need to address:
- preservation of existing incoming links to issues
- figuring out which issues to migrate automatically (all of them? None of them? Open issues only?)
- figuring out a new way to track PSF CLA signatures
- figuring out a replacement for the Experts Index integration into the Roundup nosy list
- figuring out replacements for the custom metadata fields that we actually use regularly
- meeting our original GitHub migration commitment to continue offering a way of engaging with the core development process without requiring accounts with any entity other than the PSF
It's far from being a foregone conclusion that migrating to a new issue tracker will be the preferred answer, but there are also genuine problems with the status quo that need to be addressed somehow.
Cheers, Nick.
-- Nick Coghlan | ncoghlan@gmail.com | Brisbane, Australia
On May 21, 2018, at 03:24, Nick Coghlan <ncoghlan@gmail.com> wrote:
Right, one of the outcomes of the discussion at the Summit was that any proposal to migrate to a different issue tracker would need to present a clear statement of the *problems intended to be solved*, such that the folks that would prefer to see us stay on our own issue tracker could present a competing proposal to solve those problems without a wholesale migration to another system.
I’d like to see multiple PEPs for this migration. The first would clearly outline discussion points that apply regardless of where we migrate to, or whether we migrate at all. This would include lists of common use cases, the problems with the current system, the features we like (and regularly use!) in the current system, and a list of key points that can be compared against any proposed solution.
E.g. for this latter, let’s say one of the points is “ability to easily ignore all discussions on tickets you don’t care about”. You could imagine a row in a table that shows how any of the proposed solutions compare to what we have today. You could color code this on a gradient, say from dark green (“it will be much better on system X”) to dark red (“it’ll be much more difficult on system Y”).
That would be one PEP, and it would be the baseline for making a decision. Additional PEPs would make specific proposals, e.g. move to GH, stay on bpo as is, significantly invest in bpo, etc. They’d reference the baseline PEP and include that table with the color coded rows.
Then perhaps after the decision is made, there would maybe be an implementation PEP describing the steps it will take to migrate, and the ETA.
Cheers, -Barry
On 05/20/2018 10:19 AM, Nathaniel Smith wrote:
On Sun, May 20, 2018, 03:18 Antoine Pitrou <antoine@python.org <mailto:antoine@python.org>> wrote:
Le 19/05/2018 à 02:10, Victor Stinner a écrit : > Hi, > > I failed to get the microphone after Mariatta's secret talk about > moving Python issues from bugs.python.org <http://bugs.python.org> (Roundup) to GitHub. A "secret talk"? What is that?
She gave a talk at the language summit to discuss what people thought of the idea, and she had some fun making the topic a surprise so she could see people's reactions. I don't think there's any secret beyond that.
You have it exactly. She wanted us (the Language Summit organizers) to keep the talk title a secret until she could reveal it herself in front of the audience. I suggested the official title on the schedule be "Mariatta's Topic Of Mystery" and we collectively went with that. At this point nothing about it is a secret.
//arry/
Yup, the "mystery" was just for fun 😛 There is no secret. I've been thinking that we should start using GitHub issues instead of the b.p.o.
I realized not everyone was able to get to the language summit, and I fully intended to update python-committers with this idea. I just haven't been reading the mailing list for sometime until today.
For those who missed it, some resources:
My language summit slides ( https://speakerdeck.com/mariatta/mariattas-python-language-summit-2018-prese... ) There are 3 bonus slides at the end which I did not get to cover, because we were running late and it was lunchtime. (in the end, we were 3 hrs overtime.) Those can be discussed in core-workflow.
LWN article: https://lwn.net/Articles/754779/ I will not be reading/responding to the comments in LWN. 🤐
My initial research into this topic: https://docs.google.com/document/d/1b3H-OQaZ7oc5jI9l7CEx9b_zCpao6PfEV1tIg0vp...
Mariatta
ᐧ
Hi Mariatta,
Le 02/06/2018 à 01:07, Mariatta Wijaya a écrit :
For those who missed it, some resources:
My language summit slides (https://speakerdeck.com/mariatta/mariattas-python-language-summit-2018-prese...) There are 3 bonus slides at the end which I did not get to cover, because we were running late and it was lunchtime. (in the end, we were 3 hrs overtime.) Those can be discussed in core-workflow.
LWN article: https://lwn.net/Articles/754779/ I will not be reading/responding to the comments in LWN. 🤐
Thanks for the pointers.
I agree with the UI concerns about b.p.o. But I also agree with the response mentioned in LWN. Especially the lack of categorization in Github issues.
I've used Github issues on other projects. It's fine when you have a small-to-medium number of open issues (say, no more than a couple hundreds). But I don't think it's usable for a project with several thousands issues open. At a micro level, the editing UI is pleasant to use. But at a more macro level, it's rather painful to navigate in a large number of issues.
I wonder if other hosted services, such as Gitlab, offer a more sophisticated issue tracker.
Regards
Antoine.
On Jun 1, 2018, at 16:54, Antoine Pitrou <antoine@python.org> wrote:
I wonder if other hosted services, such as Gitlab, offer a more sophisticated issue tracker.
Not really. Mailman has a little less than 200 open issues, but they are basically categorized in the same way as GitHub, i.e. via labels.
https://gitlab.com/mailman/mailman/issues
Cheers, -Barry
On 1 June 2018 at 20:29, Barry Warsaw <barry@python.org> wrote:
On Jun 1, 2018, at 16:54, Antoine Pitrou <antoine@python.org> wrote:
I wonder if other hosted services, such as Gitlab, offer a more sophisticated issue tracker.
Note that GitHub (and I think GitLab too) provides two additional ways to categorise issues: project boards, and milestones. I think together with labels this may simulate current b.p.o. structure to certain extent. For example (approximately): triaged, PR review
- We can have milestones for releases (including past releases)
- We can have "project boards" (slightly abusing this feature): new,
- Labels can be grouped using name prefix and color, for example (we have
similar structure in mypy):
- priority-low
- priority-normal
- priority-etc...
- kind-bug
- kind-docs
- kind-feature
- topic-asincio
- topic-etc..
This is still quite limited, but together with bots this can practically replace current categorisation.
-- Ivan
I think boards have improved since I last used them, but when I tried they added nothing but overhead. Possibly useful for planning, if we had someone who was responsible for that (maybe individual planning? But then you can’t really expect contributors to keep it up to date for you).
Milestones are one-per-issue, and get rolled up in a way that is most useful for planning rather than search or review. I use these all the time on work projects.
A good set of tags (which unfortunately are shared with the set of tags you can put on a PR) and some automation to auto-subscribe the core devs associated with that tag is a bare minimum, as far as I’m concerned. It would be nice if issue search supported the OR operator as well, but it can only do AND.
I’m far from convinced that GitHub issues will work well for an active team as large as ours with as little coordination as we use. It doesn’t work well for the “bucket of bugs” I keep open on one of my work projects, even though the team is smaller, and our tracker is almost entirely a bucket of bugs.
Top-posted from my Windows 10 phone
From: Ivan Levkivskyi Sent: Friday, June 1, 2018 18:05 To: Barry Warsaw Cc: python-committers Subject: Re: [python-committers] Comments on moving issues to GitHub
On 1 June 2018 at 20:29, Barry Warsaw <barry@python.org> wrote: On Jun 1, 2018, at 16:54, Antoine Pitrou <antoine@python.org> wrote:
I wonder if other hosted services, such as Gitlab, offer a more sophisticated issue tracker.
Note that GitHub (and I think GitLab too) provides two additional ways to categorise issues: project boards, and milestones. I think together with labels this may simulate current b.p.o. structure to certain extent. For example (approximately):
- We can have milestones for releases (including past releases)
- We can have "project boards" (slightly abusing this feature): new, triaged, PR review
- Labels can be grouped using name prefix and color, for example (we have similar structure in mypy): - priority-low - priority-normal - priority-etc... - kind-bug - kind-docs - kind-feature - topic-asincio - topic-etc..
This is still quite limited, but together with bots this can practically replace current categorisation.
-- Ivan
On 6/1/2018 7:07 PM, Mariatta Wijaya wrote:
Yup, the "mystery" was just for fun 😛 There is no secret. I've been thinking that we should start using GitHub issues instead of the b.p.o.
I realized not everyone was able to get to the language summit, and I fully intended to update python-committers with this idea. I just haven't been reading the mailing list for sometime until today.
For those who missed it, some resources:
- My language summit slides (https://speakerdeck.com/mariatta/mariattas-python-language-summit-2018-prese...)
"Old and languishing issues should just be closed / ignored"
I disagree with doing this blindly, and I would be mightily annoyed if someone did so with IDLE issues and hide valuable ideas and code. For example:
In Sept 2006, Tal Einat suggested that IDLE's class browser, based on the pyclbr module, should report nested classed. https://bugs.python.org/issue1612262
In August 2009, Guilherme Polo submitted patches for pyclbr and IDLE that also supported nested functions. https://bugs.python.org/issue6691 I discovered the issue and approved of the idea in Sept 2015
In June and July 2017, Cheryl Sabella and I updated, rewrote, finished, and merged both patches.
To deal with issues better, we need
More core developers, so more modules can have maintainers.
Better support for core developers in the tracker.
2a. The ability to tag issues with the module (or perhaps modules) that an issue more pertains to.
2b. Associated (linked) manager or dashboard for issues pertaining to a module or group of modules.
There are currently about 60 idlelib module and 250 IDLE issues. To not go crazy or become paralyzed, I keep a list (in a file) organized by topics, which mostly correspond to modules. Since I started this, I have closed perhaps 40-50 issues. For one thing, collecting together issues pertaining to a topic/module makes it easy to spot out of date and duplicate issues.
If I could tag IDLE issues with module names and retrieve them by module, that would partly duplicate what I have done. It would also be nice to have the line online, and public, with issue numbers linking back to issues. It would be nice if tagging an issue caused it to be automatically added to the appropriate sublist.
Would moving to github make such a substantial improvement?
There are 3 bonus slides at the end which I did not get to cover, because we were running late and it was lunchtime. (in the end, we were 3 hrs overtime.)
Automerge: should signal separate from 'I approve of this PR'. Commit message can be put in a labelled comment. I have started editing the initial commit message.
tjr
Reading the comments in the thread and having used Github issues myself for a few years now, I find the idea of moving from a dedicated issue tracker we can easily customize to our needs (or hire someone to do so via the PSF) to a simplistic tracker add-on, which Github issues is, not a very promising approach.
Github issues are fine for simple projects, but I wouldn't even want to use it for more than a hundred issues on Github.
As with many such proposals, if an existing system is seen to be lacking in certain ways, the first thing people suggest is to ditch it and move to this other new shiny thing or even worse, suggest to build a new one.
I've rarely seen this work. Most of the time you end up having a system with just different issues which leaves you with a situation that's not better than before.
The time invested in migration and making sure that at least part of the legacy will forward to the new solution is often better invested in addressing the issues with the older system.
Yes, that's not as interesting and exciting as building something new, but in the light of productivity and getting a working solution, it's very often the better approach.
So if there is a real need to fix issues with bpo, then I'd suggest to write up a proposal to get them fixed and find a group of developers to work on these. Have the PSF provide a grant to make it worthwhile and manage this project instead of spending time with migrations.
-- Marc-Andre Lemburg eGenix.com
Professional Python Services directly from the Experts (#1, Jun 02 2018)
Python Projects, Coaching and Consulting ... http://www.egenix.com/ Python Database Interfaces ... http://products.egenix.com/ Plone/Zope Database Interfaces ... http://zope.egenix.com/
::: We implement business ideas - efficiently in both time and costs :::
eGenix.com Software, Skills and Services GmbH Pastor-Loeh-Str.48 D-40764 Langenfeld, Germany. CEO Dipl.-Math. Marc-Andre Lemburg Registered at Amtsgericht Duesseldorf: HRB 46611 http://www.egenix.com/company/contact/ http://www.malemburg.com/
participants (13)
-
Antoine Pitrou
-
Barry Warsaw
-
Brett Cannon
-
Ivan Levkivskyi
-
Larry Hastings
-
M.-A. Lemburg
-
Mariatta Wijaya
-
Nathaniel Smith
-
Nick Coghlan
-
Stefan Krah
-
Steve Dower
-
Terry Reedy
-
Victor Stinner