Skip to content
Commits on Source (6)
Hide whitespace changes
Inline Side-by-side
_blog/posts/160.md
View file @ 1cc24846
......@@ -3,14 +3,114 @@ layout: blog
week: 160
---
* [FIXME](https://github.com/rubygems/rubygems/pull/2289#issuecomment-388707453)
Here's what happened in the [Reproducible Builds](https://reproducible-builds.org) effort between Sunday May 13 and Saturday May 19 2018:
* [click merged](https://github.com/pallets/click/pull/963)
* At the [MiniDebConfHamburg](https://wiki.debian.org/DebianEvents/de/2018/MiniDebConfHamburg) ([full schedule](https://wiki.debian.org/DebianEvents/de/2018/MiniDebConfHamburg#Schedule)):
* [FIXME](https://github.com/rubygems/rubygems/issues/2290)
* Chris Lamb presented on [diffoscope.org](https://diffoscope.org).
* [Git repositories migrated to salsa](https://lists.reproducible-builds.org/pipermail/rb-general/2018-May/000954.html)
* The entire team will present on Sunday 20th May on Reproducible Builds, focusing on the status in Debian *buster*.
* [Logo voting](https://lists.reproducible-builds.org/pipermail/rb-general/2018-May/000952.html)
* [Benjamin Hof](https://www.net.in.tum.de/members/hof/) gave an interesting talk entitled *Software transparency: package security beyond signatures and reproducible builds*.
* [website migrated to jenkins.debian.net](diffoscope)
* Jan Kiszka will also present on Sunday 20th May on *Getting (more) Debian into our civil infrastructure* which will touch on reproducible builds.
* anthraxx filed two pull requests for the [rubygems](https://rubygems.org/) package manager [adding support `SOURCE_DATE_EPOCH` to make tarball generation reproducible](https://github.com/rubygems/rubygems/pull/2289) and to [request that the gem utility exports `SOURCE_DATE_EPOCH`](https://github.com/rubygems/rubygems/issues/2290).
* Our Git repositories [were migrated to from the deprecated Alioth service](https://lists.reproducible-builds.org/pipermail/rb-general/2018-May/000954.html) to [salsa.debian.org](https://wiki.debian.org/Salsa) by Mattia Rizzolo and Chris Lamb. Thanks to the *salsa* administrators!
* Arnout Engelen [opened the final vote on our logo](https://lists.reproducible-builds.org/pipermail/rb-general/2018-May/000952.html) which will close on Tuesday 22nd May.
* Mattia Rizollo migrated the [diffoscope.org](https://diffoscope.org/) website the `jenkins.debian.net` infrastucture.
* 134 package reviews have been added, 25 have been updated and 29 have been removed in this week, adding to our [knowledge about identified issues](https://tests.reproducible-builds.org/debian/index_issues.html).
* Chris Lamb updated the [reproducible-builds.org](https://reproducible-builds.org) website, including [dropping unnecessary punctuation from opening paragraph on documentation page](https://salsa.debian.org/reproducible-builds/reproducible-website/commit/27ed2ed) and updating URIs now that website has migrated to Salsa ([1](https://salsa.debian.org/reproducible-builds/reproducible-website/commit/a0b7671), [2](https://salsa.debian.org/reproducible-builds/reproducible-website/commit/aa75184)).
Packages reviewed and fixed, and bugs filed
-------------------------------------------
* Chris Lamb:
* [#898912](https://bugs.debian.org/898912) against [telepathy-gabble](https://tracker.debian.org/pkg/telepathy-gabble).
* [fontconfig](https://www.freedesktop.org/wiki/Software/fontconfig/) ([fixed upstream](https://lists.freedesktop.org/archives/fontconfig/2018-May/006287.html))
In addition, build failure bugs were reported by Adrian Bunk (2) and Gilles Filippini (1).
diffoscope development
----------------------
[diffoscope](https://diffoscope.org) is our in-depth "diff-on-steroids" utility which helps us diagnose reproducibility issues in packages.
* Chris Lamb:
* Update referencess to Alioth now that the repository has migrated to salsa. ([1](https://salsa.debian.org/reproducible-builds/diffoscope/commit/d0aae3d), [2](https://salsa.debian.org/reproducible-builds/diffoscope/commit/1d504a9))
* [Drop extra whitespace in supported file format output](https://salsa.debian.org/reproducible-builds/diffoscope/commit/c1d61eb).
* Mattia Rizzolo:
* [Update URL in `debian/watch` to point to the new archive](https://salsa.debian.org/reproducible-builds/diffoscope/commit/351f8b6).
* [Make the dependency on `python3-distutils` an alternative on the previous versions of `libpython3.*-stdlib` that used to ship it](https://salsa.debian.org/reproducible-builds/diffoscope/commit/e85c017).
reprotest development
---------------------
*reprotest* is our tool to build software and check it for reproducibility.
* kpcyrd:
* [Add a Dockerfile](https://salsa.debian.org/reproducible-builds/reprotest/commit/c7996e7).
* Chris Lamb:
* Update referencess to Alioth now that the repository has migrated to Salsa. ([1](https://salsa.debian.org/reproducible-builds/reprotest/commit/7e7bc0c), [2](https://salsa.debian.org/reproducible-builds/reprotest/commit/8acc654), [3](https://salsa.debian.org/reproducible-builds/reprotest/commit/ffdbaf6))
jenkins.debian.net development
------------------------------
There made the following changes to our [Jenkins](https://jenkins.io/)-based testing framework, including:
* Mattia Rizzolo:
* Web scheduler:
* [Add a CGI script to schedule builds over HTTPS](https://salsa.debian.org/qa/jenkins.debian.net/commit/a9a895f4).
* [Exit cleanly in case of `ValidationError`](https://salsa.debian.org/qa/jenkins.debian.net/commit/21ef4d0b).
* [Fix crash for non-logged in users](https://salsa.debian.org/qa/jenkins.debian.net/commit/d8cd393d).
* [Add an `X-Error-Message` header in case of `ValidationError`](https://salsa.debian.org/qa/jenkins.debian.net/commit/26dcd3a5).
* [Print debug info also in case of `ValidationError`](https://salsa.debian.org/qa/jenkins.debian.net/commit/e9931086).
* [Add ♻ links to package pages to trigger new builds](https://salsa.debian.org/qa/jenkins.debian.net/commit/e5973377).
* [diffscope,org](https://diffoscope.org) website migration:
* [Configure Apache to serve the website](https://salsa.debian.org/qa/jenkins.debian.net/commit/66eac719).
* [Add Jenkins job to build the website](https://salsa.debian.org/qa/jenkins.debian.net/commit/a06daad4),
* [Configure SSL](https://salsa.debian.org/qa/jenkins.debian.net/commit/9034bf1e).
* [Build the website with Jekyll](https://salsa.debian.org/qa/jenkins.debian.net/commit/60a7efea).
* [Also notify also `#reproducible-builds` about those jobs](https://salsa.debian.org/qa/jenkins.debian.net/commit/ad15bc5d).
* Debian package testing:
* [Drop another special casing for our own packages](https://salsa.debian.org/qa/jenkins.debian.net/commit/ce1bb825).
* [Drop special-casing for debbindiff/strip-nondeterminis/diffoscope/disorderfs as we are not going to upload them to our repo anymore](https://salsa.debian.org/qa/jenkins.debian.net/commit/4cc3477e).
* [Update job descriptions for the Alioth → Salsa migration](https://salsa.debian.org/qa/jenkins.debian.net/commit/b8dc0267).
* Misc:
* [Update job descriptions for the Alioth to Salsa migration](https://salsa.debian.org/qa/jenkins.debian.net/commit/f45ac726).
* [Move our Debian package repository to `tests.reproducible-builds.org` and `SSL`](https://salsa.debian.org/qa/jenkins.debian.net/commit/d4b90724).
* [Move our repositories from Alioth to Salsa](https://salsa.debian.org/qa/jenkins.debian.net/commit/911acbf6).
* Eli Schwartz:
* [Move "UTC" printing directly into format string now that `date` is used](https://salsa.debian.org/qa/jenkins.debian.net/commit/81377cc9).
* [Replace several occurrences of parsing ls with cut, by the `date` command](https://salsa.debian.org/qa/jenkins.debian.net/commit/3b6edca5).
* [Fix filepaths for cleaning up the old build files](https://salsa.debian.org/qa/jenkins.debian.net/commit/33afb85f).
Misc.
-----
This week's edition was written by Chris Lamb, Mattia Rizzolo & reviewed by a bunch of Reproducible Builds folks on IRC & the mailing lists.
bin/generate-draft
View file @ 1cc24846
......@@ -26,7 +26,7 @@ PROJECTS = (
def main(*args):
for x in PROJECTS + ('notes',):
for x in PROJECTS + ('reproducible-notes',):
ensure_dir(sibling_repo_gitdir(x))
week = int(args[0]) if len(args) > 0 else prev_week()
......@@ -48,7 +48,7 @@ def log(msg, *args, **kwargs):
def prev_week():
now = int(time.time())
return ((now - WEEK_1_END) // (7*24*3600) + 1)
return ((now - WEEK_1_END) // (7 * 24 * 3600) + 1)
def sibling_repo_gitdir(path):
......@@ -239,18 +239,18 @@ def get_commits(week_start, week_end):
def get_issues_yml(week_start, week_end):
return commits(week_start, week_end, 'notes', 'issues.yml')
return commits(week_start, week_end, 'reproducible-notes', 'issues.yml')
def get_packages_yml(week_start, week_end):
return commits(week_start, week_end, 'notes', 'packages.yml')
return commits(week_start, week_end, 'reproducible-notes', 'packages.yml')
def open_packages_yml(date):
return subprocess.Popen(
"git show $(git rev-list -n1 --until @{0} origin/master):packages.yml".format(date),
shell=True,
cwd=sibling_repo_gitdir("notes"),
cwd=sibling_repo_gitdir('reproducible-notes'),
stdout=subprocess.PIPE).stdout
......
bin/generate-draft.template
View file @ 1cc24846
......@@ -24,11 +24,11 @@ In addition, build failure bugs were reported by:
{{ project }} development
------------{{ "-" * project|length }}
{% for x in uploads[project] %}
Version [{{ x['version'] }}](https://tracker.debian.org/news/FIXME) was uploaded to {{ x['distribution'] }} by {{ x['signed_by_name'] }}. It [includes contributions already convered by posts in previous weeks](https://salsa.debian.org/reproducible-builds/{{ project }}/commits/{% if project != 'diffoscope' %}debian/{% endif %}{{ x['version'] }}) as well as new ones from:
Version [{{ x['version'] }}](https://tracker.debian.org/pkg/project?FIXME) was uploaded to {{ x['distribution'] }} by {{ x['signed_by_name'] }}. It [includes contributions already covered by posts in previous weeks](https://salsa.debian.org/reproducible-builds/{{ project }}/commits/{% if project != 'diffoscope' %}debian/{% endif %}{{ x['version'] }}) as well as new ones from:
{% endfor %}
{% for x, ys in commits[project].items() %}* {{ x }}:{% for y in ys %}
* [{{ y['title'] }}]({% if project == "jenkins.debian.net" %}https://salsa.debian.org/qa/jenkins.debian.net/commit/{{ y['sha'] }}{% else %}https://salsa.debian.org/reproducible-builds/{{ project }}.git/commit/?id={{ y['sha'] }}{% endif %}){% endfor %}
* [{{ y['title'] }}]({% if project == "jenkins.debian.net" %}https://salsa.debian.org/qa/jenkins.debian.net/commit/{{ y['sha'] }}{% else %}https://salsa.debian.org/reproducible-builds/{{ project }}/commit/{{ y['sha'] }}{% endif %}){% endfor %}
{% endfor %}
{% endfor %}
......