Add a timeout for blocking operation on socker for the worker

Baptiste Beauplatrequested to merge
lyknode/debexpo:fix/importer-hangs into live

This MR adds a global timeout on blocking socket operation in the worker.

The following has been tested and validated locally:

  • Full offline import
  • Full offline removal of old uploads
  • Import with a timeout from:
    • ftp-master api
    • debian archive
    • tracker.d.o
    • bugs.d.o
  • Removal of old uploads with a timeout from:
    • gmane NNTP server

How did I test the timeout?

With a nc -l -k -p 4242 and settings all required url to fetch from localhost:4242. Not writing anything on nc simulates a read timeout.

Closes #94 (closed)

Merge request reports