WIP: new check-advisories command
This command makes sure that all advisories in the security tracker are regularly published on the website.
It can be called in DSA or DLA mode and will (respectively) check for official security advisories or LTS advsiories on a local copy of the website.
It does not check the integrity of that copy, it only checks to see if it's there.
This is useful to make sure we don't forget to publish some advisories.
This is a replacement for webwml!52 (closed)
Merge request reports
Activity
mentioned in merge request webwml!52 (closed)
this currently only checks a local copy of the repository - it seemed a bit silly to check the website if we have a local copy of the repository (as I have here) but I do not know in which environment the cron project runs.
for example, if it doesn't have a copy of the git repository, this will fail. it could be modified to ping the website instead and check if the files are present there instead, but that felt like too much overhead for my purposes. note that such a change would yield many HTTP hits on the website (one per advisory, at every run) so I'm not sure it's the right approach, unless we use some sort of caching.
Here's the current output when running in the webwml directory, in DLA mode:
anarcat@curie:webwml(master)$ ~/src/webmaster-team/cron/parts/10-check-advisories --mode DLA --verbose INFO: fetching URL https://salsa.debian.org/security-tracker-team/security-tracker/raw/master/data/DLA/list ERROR: .data or .wml file missing for DLA 1673-1 ERROR: .data or .wml file missing for DLA 1672-1 ERROR: .data or .wml file missing for DLA 1671-1 ERROR: .data or .wml file missing for DLA 1670-1 ERROR: .data or .wml file missing for DLA 1669-1 ERROR: .data or .wml file missing for DLA 1668-1 ERROR: .data or .wml file missing for DLA 1667-1 ERROR: .data or .wml file missing for DLA 1666-1 ERROR: .data or .wml file missing for DLA 1665-1 ERROR: .data or .wml file missing for DLA 1664-1 ERROR: .data or .wml file missing for DLA 1663-1 ERROR: .data or .wml file missing for DLA 1662-1 ERROR: .data or .wml file missing for DLA 1661-1 ERROR: .data or .wml file missing for DLA 1660-1 ERROR: .data or .wml file missing for DLA 1654-1 ERROR: .data or .wml file missing for DLA 1130-1 ERROR: .data or .wml file missing for DLA 772-1 ERROR: .data or .wml file missing for DLA 719-1 ERROR: .data or .wml file missing for DLA 706-1 ERROR: .data or .wml file missing for DLA 659-1 ERROR: .data or .wml file missing for DLA 607-1 ERROR: .data or .wml file missing for DLA 580-1 ERROR: .data or .wml file missing for DLA 567-1 ERROR: .data or .wml file missing for DLA 377-1 ERROR: .data or .wml file missing for DLA 267-1 ERROR: .data or .wml file missing for DLA 115-2 ERROR: .data or .wml file missing for DLA 145-2 ERROR: .data or .wml file missing for DLA 0015-1 ERROR: .data or .wml file missing for DLA 0014-1 ERROR: .data or .wml file missing for DLA 0013-1 ERROR: .data or .wml file missing for DLA 0012-1 ERROR: .data or .wml file missing for DLA 0011-1 ERROR: .data or .wml file missing for DLA 0010-1 ERROR: .data or .wml file missing for DLA 0009-1 ERROR: .data or .wml file missing for DLA 0008-1 ERROR: .data or .wml file missing for DLA 0007-1 ERROR: .data or .wml file missing for DLA 0006-1 ERROR: .data or .wml file missing for DLA 0005-1 ERROR: .data or .wml file missing for DLA 0004-1 ERROR: .data or .wml file missing for DLA 0003-1 ERROR: .data or .wml file missing for DLA 0002-1 ERROR: .data or .wml file missing for DLA 0001-1
That's about 40 entries, which more or less matches what the previous tool was giving us, modulo all those new DLAs that were published since the last mass import.
Here's the situation for DSAs:
anarcat@curie:webwml(master)$ ~/src/webmaster-team/cron/parts/10-check-advisories --mode DSA --verbose INFO: fetching URL https://salsa.debian.org/security-tracker-team/security-tracker/raw/master/data/DSA/list ERROR: .data or .wml file missing for DSA 4377-2 ERROR: .data or .wml file missing for DSA 4367-2 ERROR: .data or .wml file missing for DSA 4346-2 ERROR: .data or .wml file missing for DSA 4339-2 ERROR: .data or .wml file missing for DSA 4342-1 ERROR: .data or .wml file missing for DSA 4273-2 ERROR: .data or .wml file missing for DSA 4279-2 ERROR: .data or .wml file missing for DSA 4191-2 ERROR: .data or .wml file missing for DSA 4206-2 ERROR: .data or .wml file missing for DSA 4079-2 ERROR: .data or .wml file missing for DSA 4120-2 ERROR: .data or .wml file missing for DSA 4111-2 ERROR: .data or .wml file missing for DSA 4105-2 ERROR: .data or .wml file missing for DSA 4094-2 ERROR: .data or .wml file missing for DSA 4006-2 ERROR: .data or .wml file missing for DSA 3904-2 ERROR: .data or .wml file missing for DSA 3886-2 ERROR: .data or .wml file missing for DSA 3793-2 ERROR: .data or .wml file missing for DSA 3828-2 ERROR: .data or .wml file missing for DSA 3816-2 ERROR: .data or .wml file missing for DSA 3798-2 ERROR: .data or .wml file missing for DSA 3796-2 ERROR: .data or .wml file missing for DSA 3794-3 ERROR: .data or .wml file missing for DSA 3794-2 ERROR: .data or .wml file missing for DSA 3788-2 ERROR: .data or .wml file missing for DSA 3787-2 ERROR: .data or .wml file missing for DSA 3743-2 ERROR: .data or .wml file missing for DSA 3750-2 ERROR: .data or .wml file missing for DSA 3732-2 ERROR: .data or .wml file missing for DSA 3691-2 ERROR: .data or .wml file missing for DSA 3701-2 ERROR: .data or .wml file missing for DSA 3681-2 ERROR: .data or .wml file missing for DSA 3673-2 ERROR: .data or .wml file missing for DSA 3653-2 ERROR: .data or .wml file missing for DSA 3548-3 ERROR: .data or .wml file missing for DSA 3548-2 ERROR: .data or .wml file missing for DSA 3485-2 ERROR: .data or .wml file missing for DSA 3426-2 ERROR: .data or .wml file missing for DSA 3492-2 ERROR: .data or .wml file missing for DSA 3431-2 ERROR: .data or .wml file missing for DSA 3337-2 ERROR: .data or .wml file missing for DSA 3208-2 ERROR: .data or .wml file missing for DSA 3395-2 ERROR: .data or .wml file missing for DSA 3386-2 ERROR: .data or .wml file missing for DSA 3355-2 ERROR: .data or .wml file missing for DSA 3332-2 ERROR: .data or .wml file missing for DSA 3325-2 ERROR: .data or .wml file missing for DSA 3321-2 ERROR: .data or .wml file missing for DSA 3252-2 ERROR: .data or .wml file missing for DSA 3249-2 ERROR: .data or .wml file missing for DSA 3269-2 ERROR: .data or .wml file missing for DSA 3268-2 ERROR: .data or .wml file missing for DSA 3265-2 ERROR: .data or .wml file missing for DSA 3175-2 ERROR: .data or .wml file missing for DSA 3057-2 ERROR: .data or .wml file missing for DSA 3198-2 ERROR: .data or .wml file missing for DSA 3197-2 ERROR: .data or .wml file missing for DSA 3156-1 ERROR: .data or .wml file missing for DSA 3154-2 ERROR: .data or .wml file missing for DSA 2978-2 ERROR: .data or .wml file missing for DSA 3123-2 ERROR: .data or .wml file missing for DSA 3107-2 ERROR: .data or .wml file missing for DSA 3074-2 ERROR: .data or .wml file missing for DSA 3043-1 ERROR: .data or .wml file missing for DSA 2987-2 ERROR: .data or .wml file missing for DSA 2984-2 ERROR: .data or .wml file missing for DSA 2915-2 ERROR: .data or .wml file missing for DSA 2808-2 ERROR: .data or .wml file missing for DSA 2859-2 ERROR: .data or .wml file missing for DSA 2826-2 ERROR: .data or .wml file missing for DSA 2740-2 ERROR: .data or .wml file missing for DSA 2480-4 ERROR: .data or .wml file missing for DSA 2519-2 ERROR: .data or .wml file missing for DSA 2480-3 ERROR: .data or .wml file missing for DSA 2480-2 ERROR: .data or .wml file missing for DSA 2464-2 ERROR: .data or .wml file missing for DSA 2459-2 ERROR: .data or .wml file missing for DSA 2454-2 ERROR: .data or .wml file missing for DSA 2453-2 ERROR: .data or .wml file missing for DSA 2442-2 ERROR: .data or .wml file missing for DSA 2414-2 ERROR: .data or .wml file missing for DSA 2384-2 ERROR: .data or .wml file missing for DSA 2301-2 ERROR: .data or .wml file missing for DSA 2376-2 ERROR: .data or .wml file missing for DSA 2263-2 ERROR: .data or .wml file missing for DSA 2360-1 ERROR: .data or .wml file missing for DSA 2346-2 ERROR: .data or .wml file missing for DSA 2300-2 ERROR: .data or .wml file missing for DSA 2254-2 ERROR: .data or .wml file missing for DSA 2276-2 ERROR: .data or .wml file missing for DSA 2273-3 ERROR: .data or .wml file missing for DSA 2237-2 ERROR: .data or .wml file missing for DSA 2161-2 ERROR: .data or .wml file missing for DSA 2122-2 ERROR: .data or .wml file missing for DSA 2141-2 ERROR: .data or .wml file missing for DSA 2097-2 ERROR: .data or .wml file missing for DSA 2021-2 ERROR: .data or .wml file missing for DSA 1990-2 ERROR: .data or .wml file missing for DSA 1841-2 ERROR: .data or .wml file missing for DSA 1968-2 ERROR: .data or .wml file missing for DSA 1979-1 ERROR: .data or .wml file missing for DSA 1975-1 ERROR: .data or .wml file missing for DSA 1953-2 ERROR: .data or .wml file missing for DSA 1912-2 ERROR: .data or .wml file missing for DSA 1895-2 ERROR: .data or .wml file missing for DSA 1883-2 ERROR: .data or .wml file missing for DSA 1878-2 ERROR: .data or .wml file missing for DSA 1871-2 ERROR: .data or .wml file missing for DSA 1833-2 ERROR: .data or .wml file missing for DSA 1843-2 ERROR: .data or .wml file missing for DSA 1802-2 ERROR: .data or .wml file missing for DSA 1184-2 ERROR: .data or .wml file missing for DSA 833-2 ERROR: .data or .wml file missing for DSA 1667-1 ERROR: .data or .wml file missing for DSA 1646-2 ERROR: .data or .wml file missing for DSA 1629-2 ERROR: .data or .wml file missing for DSA 1627-2 ERROR: .data or .wml file missing for DSA 1616-2 ERROR: .data or .wml file missing for DSA 1544-2 ERROR: .data or .wml file missing for DSA 1534-2 ERROR: .data or .wml file missing for DSA 1556-2 ERROR: .data or .wml file missing for DSA 1533-2 ERROR: .data or .wml file missing for DSA 1531-2 ERROR: .data or .wml file missing for DSA 1493-2 ERROR: .data or .wml file missing for DSA 1503-2 ERROR: .data or .wml file missing for DSA 1485-2 ERROR: .data or .wml file missing for DSA 1466-2 ERROR: .data or .wml file missing for DSA 1465-2 ERROR: .data or .wml file missing for DSA 1409-3 ERROR: .data or .wml file missing for DSA 1409-2 ERROR: .data or .wml file missing for DSA 1405-2 ERROR: .data or .wml file missing for DSA 1388-3 ERROR: .data or .wml file missing for DSA 1389-2 ERROR: .data or .wml file missing for DSA 1373-2 ERROR: .data or .wml file missing for DSA 1381-2 ERROR: .data or .wml file missing for DSA 1365-3 ERROR: .data or .wml file missing for DSA 1378-2 ERROR: .data or .wml file missing for DSA 1343-2 ERROR: .data or .wml file missing for DSA 1377-2 ERROR: .data or .wml file missing for DSA 1364-2 ERROR: .data or .wml file missing for DSA 1370-2 ERROR: .data or .wml file missing for DSA 1365-2 ERROR: .data or .wml file missing for DSA 1288-2 ERROR: .data or .wml file missing for DSA 1341-2 ERROR: .data or .wml file missing for DSA 1291-2 ERROR: .data or .wml file missing for DSA 1267-1 ERROR: .data or .wml file missing for DSA 1265-1 ERROR: .data or .wml file missing for DSA 1185-2 ERROR: .data or .wml file missing for DSA 1167-1 ERROR: .data or .wml file missing for DSA 1000-2 ERROR: .data or .wml file missing for DSA 993-2 ERROR: .data or .wml file missing for DSA 960-3 ERROR: .data or .wml file missing for DSA 957-2 ERROR: .data or .wml file missing for DSA 951-2 ERROR: .data or .wml file missing for DSA 946-2 ERROR: .data or .wml file missing for DSA 930-2 ERROR: .data or .wml file missing for DSA 919-2 ERROR: .data or .wml file missing for DSA 900-3 ERROR: .data or .wml file missing for DSA 809-3 ERROR: .data or .wml file missing for DSA 797-2 ERROR: .data or .wml file missing for DSA 811-2 ERROR: .data or .wml file missing for DSA 804-2 ERROR: .data or .wml file missing for DSA 795-2 ERROR: .data or .wml file missing for DSA 779-2 ERROR: .data or .wml file missing for DSA 761-2 ERROR: .data or .wml file missing for DSA 725-2 ERROR: .data or .wml file missing for DSA 736-2 ERROR: .data or .wml file missing for DSA 735-2 ERROR: .data or .wml file missing for DSA 701-2 ERROR: .data or .wml file missing for DSA 662-2 ERROR: .data or .wml file missing for DSA 674-3 ERROR: .data or .wml file missing for DSA 674-2 ERROR: .data or .wml file missing for DSA 661-2 ERROR: .data or .wml file missing for DSA 596-2 ERROR: .data or .wml file missing for DSA 563-3 ERROR: .data or .wml file missing for DSA 562-2 ERROR: .data or .wml file missing for DSA 548-2 ERROR: .data or .wml file missing for DSA 458-3
Most of those are erratas, but some are also normal DSAs that are missing.
This shouldn't be merged in blindly: as it stands now, it will generate output which might be too noisy. It will also only work for DSAs which is probably not what we want - we could either change the default or use a wrapper to call it with
--mode DLA
or something else.Looking forward to your excellent feedback again,
A.
0001-10-check-advisories-optionally-fetch-author-info.patch
adds support for showing the author of the DSA/DLA which is missing in webwml.git
mentioned in merge request security-tracker-team/security-tracker!52 (closed)