Skip to content

JSON file comparison with python3-jsondiff needs enourmous quantities of RAM

Hi

This is a feedback ticket after seeing too many OOMKills caused by diffoscope on my rebuilderd instance (running debian Trixie).

It is related to jsondiff used to diff two different JSON files. Memory usage goes up really really high, eating all the RAM & Swap available.

Even a 4M file, like ./usr/lib/libreoffice/share/extensions/grammalecte/pythonpath/grammalecte/graphspell/_dictionaries/fr-allvars.json from rebuilding src:grammalecte that was different after rebuilding led to an OOMKill (61.2G memory peak, 68G memory swap peak)

It seems its related to https://github.com/xlwings/jsondiff/issues/73 that jochensp found.

Removing python3-jsondiff, helped circumvent the issue as now diffoscipe do a simple file diff.

To upload designs, you'll need to enable LFS and have an admin enable hashed storage. More information