This file remains polyglot, since the MIA tooling currently is not
polyglot.

Testing done:

paulproteus@quantz:/tmp/qa/mia$ PYTHONPATH=../carnivore python2 ./mia-query -n paulproteus >/dev/null ; echo $?
0

Additionally, I confirmed that the output is the same before and after
this change, at least for this one specific user that I searched (myself).

Note that in Python 3, it crashes due to "apt_pkg" not being available.
That's OK with me.

Asheesh Laroia authored Aug 09, 2018 and Mattia Rizzolo committed Aug 09, 2018

Testing done:

$ wget https://piuparts.debian.org/summary.json


$ data/piuparts/extract_piuparts.py summary.json

Then I validated that the outputted database exists. I did not validate its content.

Signed-off-by: Mattia Rizzolo <mattia@debian.org>

MR: qa/qa!7


Signed-off-by: Mattia Rizzolo <mattia@debian.org>

- update to use yaml instead of parsing html
- use urllib.request
- drop signal as urllib has timeout itself
- escape more strings in input html
- move to python3

MR: qa/qa!6


Signed-off-by: Mattia Rizzolo <mattia@debian.org>

ddpo: use HTTPS URLs where possible

See merge request qa/qa!5

MR: qa/qa!4


Signed-off-by: Mattia Rizzolo <mattia@debian.org>

The queue names used in new.822 are "stable-new" and "oldstable-new"

Fall back to a full clone if shallow is not supported.

Closes: #897625

Remove alioth hacks for decommissioned protocols, and throw a warning for redirected anonscm.debian.org URLs

Closes: #900872
Signed-off-by: Mattia Rizzolo <mattia@debian.org>

DDPO: link to modern package tracker

See merge request qa/qa!3

This will help ensure that usertags are on the right email addresses.

The Vcs-Git header now allows an additional [subdirectory] part (after
-b branch, if any).

Example: Vcs-Git: https://github.com/dimitri/ql-to-deb.git [packages/zs3]

There is a regular predictible release each year, and the website is
restructured more often than that.

Closes: #8985541
Thanks: Nicolas Boulenguez <nicolas@debian.org> for the patch
Signed-off-by: Mattia Rizzolo <mattia@debian.org>

<nthykier> elbrus: Myon: You want to pull at 45 rather than 15.  While britney runs at 0 to 15, the website sync starts at 30
<nthykier> (apologies for the caveat)
<nthykier> crontab: "30 * * * *              flock -s -E 0 -n /var/run/reboot-lock ~release/bin/make-and-sync-website.sh > ~release/tmp/sync-website.log"