JSON file comparison with python3-jsondiff needs enourmous quantities of RAM
Hi
This is a feedback ticket after seeing too many OOMKills caused by diffoscope on my rebuilderd instance (running debian Trixie).
It is related to jsondiff used to diff two different JSON files. Memory usage goes up really really high, eating all the RAM & Swap available.
Even a 4M file, like ./usr/lib/libreoffice/share/extensions/grammalecte/pythonpath/grammalecte/graphspell/_dictionaries/fr-allvars.json from rebuilding src:grammalecte that was different after rebuilding led to an OOMKill (61.2G memory peak, 68G memory swap peak)
It seems its related to https://github.com/xlwings/jsondiff/issues/73 that jochensp found.
Removing python3-jsondiff, helped circumvent the issue as now diffoscipe do a simple file diff.