Revisions of duperemove
buildservice-autocommit
accepted
request 1129022
from
Dirk Mueller (dirkmueller)
(revision 69)
baserev update by copy to link target
Dirk Mueller (dirkmueller)
accepted
request 1128968
from
Michael Vetter (jubalh)
(revision 68)
- Update to 0.14.1: * file_scan: satisfy clang CFI * file_scan: walk_dir: improve rootfs support * dbfile: get_duplicate_files: exclude inlined files before looking for duplicates * filerec: fiemap_scan_extent: fix typo: we must check the return from get_extent
buildservice-autocommit
accepted
request 1127570
from
Dirk Mueller (dirkmueller)
(revision 67)
baserev update by copy to link target
Dirk Mueller (dirkmueller)
accepted
request 1127541
from
Michael Vetter (jubalh)
(revision 66)
- Update to 0.14: * Batching has been reimplemented on top of the dedupe_seq. * The "scan" phase has been reimplemented (see 8264336 for details). * Filesystem locking has been implemented. See f3947e9 for details.
buildservice-autocommit
accepted
request 1114344
from
David Sterba (dsterba)
(revision 65)
baserev update by copy to link target
David Sterba (dsterba)
accepted
request 1114307
from
Michael Vetter (jubalh)
(revision 64)
- Update to 0.13: * Add a new dedupe option: [no]rescan_files. It will increase performance in some use cases. * New behaviors from v0.12 has been consolidated. Extent-based lookup is always enabled, as is fiemap. The v2 hashfile is no longer supported. * Hashfile are now updated after deduplication, to reflect the new physical offsets. This avoid (re)deduplicating extents in some cases. * Partial mode has been enhanced to support batching. The overall performance of this mode (which was previously known as "block-based mode") has been improved. * All files are now open in readonly mode. * Hashfile version has been increased to reflect the new database behaviors. Previous hashfiles are not compatible. * Always compute a hash for the entire file. This let us deduplicate same files easily, regardless of their extents mappings. * Deduplicating only parts of a file can be disabled using the [no]only_whole_files dedupe option. * Hashfiles with unsupported features or hash algorithm are now recreated transparently. Migration of the old content is not implemented. * Relative exclude patterns are no longer silently ingested. Such patterns are now rebuilt on top of the current working directory. * Batching is now set to 1024 by default.
buildservice-autocommit
accepted
request 1112021
from
David Sterba (dsterba)
(revision 63)
baserev update by copy to link target
David Sterba (dsterba)
accepted
request 1111318
from
Petr Gajdos (pgajdos)
(revision 62)
- build for 15
buildservice-autocommit
accepted
request 1099122
from
David Sterba (dsterba)
(revision 61)
baserev update by copy to link target
David Sterba (dsterba)
accepted
request 1099030
from
Michael Vetter (jubalh)
(revision 60)
- Update to 0.12: * Duplication lookup is now based on extents. This leads to a massive increase of the performances. Block-based lookup is still possible via --dedupe-options=partial. * Following that change, a new hashfile format has been introduced. Previous hashfile format is still supported when extents lookup are disabled, this is not recommended. * Batching has been implemented. When enabled with the -B <batchsize> option, duperemove will run the deduplication phase every <batchsize> scanned files. This is meant to help running duperemove on large dataset, with small blocksize, or on memory-constrained systems. * All hash algorithm has been removed and replaced by xxh128. This variant is as robust as murmur3 while being faster. Choosing a hash function via the --hash option has been removed. Hashfiles built with other algorithm must be removed.
Dirk Mueller (dirkmueller)
accepted
request 951355
from
Michael Vetter (jubalh)
(revision 59)
- Update to 0.11.3: * Increase open file limit. (#269) * Create hash database file with 600 permission for improved security. (#262) * Read more data per pread, for v2 hashfile format this reduces the overall number of syscalls made which in turns results in better performance. * Fix truncated file handling, eliminating a an infinite loop case. (#255)
buildservice-autocommit
accepted
request 846202
from
David Sterba (dsterba)
(revision 58)
baserev update by copy to link target
David Sterba (dsterba)
accepted
request 846138
from
Nikolay Borisov (nikbor)
(revision 57)
- Update to v0.11.2 - Improved detection of hyperthreading - Multiple minor fixes and cleanups - Updated xxhash algorithm to latest release - Fixed extent collision handling - Fix overflow scanning in extents
buildservice-autocommit
accepted
request 819289
from
David Sterba (dsterba)
(revision 56)
baserev update by copy to link target
David Sterba (dsterba)
accepted
request 814537
from
Martin Pluskal (pluskalm)
(revision 55)
- Fix building with gcc10
buildservice-autocommit
accepted
request 654118
from
Mark Fasheh (mfasheh)
(revision 54)
baserev update by copy to link target
Mark Fasheh (mfasheh)
accepted
request 654107
from
Mark Fasheh (mfasheh)
(revision 53)
- Use source tarball from github
Mark Fasheh (mfasheh)
accepted
request 653159
from
Mark Fasheh (mfasheh)
(revision 52)
- Update to v0.11.1 - Add 'quiet' mode - duperemove will only print errors and a short summary of any dedupe. - Revert block dedupe default, it is causing excessive fragmentation on users systems.
Dirk Mueller (dirkmueller)
accepted
request 607705
from
Mark Fasheh (mfasheh)
(revision 51)
- Update to v0.11 - Fix a minor fd leak in hyperthreading detection code - Clean up some typos in documentation - Some build fixes - Removed patch: v0.11.beta4_to_git_f95e429.patch
buildservice-autocommit
accepted
request 432126
from
Mark Fasheh (mfasheh)
(revision 50)
baserev update by copy to link target
Displaying revisions 1 - 20 of 69