1. 18 Dec, 2016 1 commit
  2. 05 Dec, 2015 1 commit
    • Jérémy Bobbio's avatar
      Use lazy extraction instead of explicit bracketing · 303aee94
      Jérémy Bobbio authored
      Previously, code requiring access to file content had to be explicitly
      bracketed using get_content() for files to be extracted and then deleted.
      Such construction is problematic for parallel processing as a file might be
      processed be multiple operations currently (e.g. multiple files being extracted
      from a unique archive at the same time).
      We thus removes the get_content() context and @needs_content decorator to
      prefer lazy path initialization: actual content will be made available through
      the path property. The extraction will happen then if necessary.
      The extracted file should normally be deleted when Python garbage collector
      reclaims the object. As a safety net, we still have a global registry of all
      temporary files and directories and remove them on exit.
  3. 03 Dec, 2015 1 commit
  4. 20 Aug, 2015 1 commit
  5. 03 Aug, 2015 1 commit
    • Jérémy Bobbio's avatar
      Rename to diffoscope · 98ff014e
      Jérémy Bobbio authored
      debbindiff has grown way beyond a being just a tool to compare Debian packages.
      Let's rename it to better reflect this state of things.
      Kudos to Jocelyn Delalande for the name “diffoscope”!
      We introduce a new transitional binary package to keep too many things to
  6. 29 Jul, 2015 1 commit
    • Jérémy Bobbio's avatar
      Massive rearchitecturing: make each file type have their own class · 5c02e000
      Jérémy Bobbio authored
      A good amount of the code for comparators is now based on classes
      instead of methods. Each file type gets its own classs.
      The base class, File, is an abstract class that can represent files
      on the filesystem but also files that can be extracted from an archive.
      This design makes room for future implementation of fuzzy-matching.
      Each file type class implements a class method recognizes() that will
      receives an unspecialized File instance. This is way more flexible than
      the old constrained regex table approach. The new identification method
      used for Haskell interfaces is a good illustration. Appropriate caching
      for calls to libmagic methods is there as they are still frequently used
      and tend to be rather slow.
      An unspecialized File object will then be typecasted into the class that
      recognized it. If that does not happen, binary comparison is implemented
      by the File class.
      Instead of redefining the compare() method which returns a single
      Difference or None, file type classes can implement compare_details()
      which returns an array of “inside” differences. An empty array means no
      differences were found.
      This new approach makes room to handle special file types better. As an
      example, device files can now be compared directly as their extraction
      from archives is problematic without root access.
      To reduce a good amount of boilerplate code, the Container and its
      subclass Archive has been introduced to represent anything that
      “contains” more file to be compared. While the API might still be
      improved, this already helped a good amount of code become more
      consistent. This will also make it pretty straightforward to implement
      parallel processing in a near future.
      Some archive formats (at least cpio and iso9660) were pretty annoying
      to work with. To get rid of some painful code, we now use
      libarchive—through the ctypes based wrapper libarchive-c—to handle these
      archives in a generic manner. One downside is that libarchive is very
      stream-oriented which is not really suited to our random-access model.
      We'll see how this impacts performance in the future.
      Other less crucial changes:
       - `find` is now used to compare directory listings.
       - The fallback code in case the `rpm` module cannot be found has been
         isolated to a `comparators.rpm_fallback` module.
       - Symlinks and devices are now compared in a consistent manner.
       - `md5sums` files in Debian packages are now only recognized when
         they are part of a Debian package.
       - Files in squashfs are now extracted one by one.
       - Text files with different encodings can be compared and this difference
         is recorded as well.
       - Test coverage is now at 92% for comparators.
      Sincere apologies for this unreviewable commit.
  7. 27 Jun, 2015 1 commit
    • Jérémy Bobbio's avatar
      Comparators now return a single Difference · 2d362505
      Jérémy Bobbio authored
      The forest approach was often clumsy and ill-specified. Now
      comparators are expected to return a single Difference, or None.
      To make it easy for comparators who are producing details, a new decorator
      `returns_details` will create a wrapping Difference object for free. This
      was previously a side-effect of using the `binary_fallback` decorator.
      This new decorator will filter None from the list of differences,
      removing some boilerplate from the comparators.
  8. 31 Mar, 2015 2 commits
  9. 30 Mar, 2015 1 commit
    • Jérémy Bobbio's avatar
      Refactor Difference constructor · e9d72ec4
      Jérémy Bobbio authored
      Difference() now takes an unified diff directly. Computing the diff is
      moved to a new static method from_content() which returns None when there are
      no differences.
      This paves the way for passing file descriptors to from_content() to avoid
      loading entire outputs in memory.
  10. 28 Mar, 2015 1 commit
  11. 27 Mar, 2015 1 commit
    • Jérémy Bobbio's avatar
      Perform content comparison when creating Difference objects · 3d5f0d7b
      Jérémy Bobbio authored
      Instead of storing the full content twice when creating Difference objects, we
      now directly run `diff` and store the unified diff. Large blocks in the diff
      are still trimmed. This results in huge memory savings and debbindiff can now
      happily compare changes for installation-guide.
      As tool_required() is not only for comparators anymore, we move it to
      debbindiff, together with logger.
      Text output becomes really straightforward as we just have to write what
      we've previously recorded.
      For the HTML output, we stop using vim and instead borrow code from
      diff2html.py found at <http://git.droids-corp.org/?p=diff2html.git>.
      Closes: #772029
      Closes: #779476
  12. 23 Mar, 2015 1 commit
  13. 19 Mar, 2015 1 commit
  14. 18 Mar, 2015 1 commit
    • Jérémy Bobbio's avatar
      Improve optional usage of external commands · ce420f6f
      Jérémy Bobbio authored
      The `tool_required` decorator now raises an exception when
      the command cannot be found. This enables more flexible handling.
      Associated Debian package is now suggested in the comment.
      The list of external tools is now available through the `--list-tools`
      command-line option. We also use this output to generate the Recommends field.
  15. 06 Mar, 2015 1 commit
  16. 04 Feb, 2015 1 commit
  17. 29 Dec, 2014 1 commit
  18. 30 Sep, 2014 1 commit
  19. 29 Sep, 2014 4 commits
  20. 28 Sep, 2014 1 commit
    • Jérémy Bobbio's avatar
      Initial commit for debbindiff · 89839110
      Jérémy Bobbio authored
      The version is successfully able to report differences in two
      .changes file. Not with much interesting details, but it's a start.