| Commit message (Collapse) | Author | Age | Files | Lines | |
|---|---|---|---|---|---|
| * | split_for_sort: Append mode implemented | Thorsten Töpper | 2025-08-29 | 1 | -16/+54 |
| | | | | | | | | There may be situations when not every input file is available at once, so those can't be handled in a single session. The append mode opens the files without overwriting the previous content so making the way the tool can be used in scripts more flexible. | ||||
| * | split_for_sort: set RLIMIT_NOFILE to max | Thorsten Töpper | 2025-08-23 | 1 | -0/+25 |
| | | |||||
| * | split_for_sort: make use of FS cache | Thorsten Töpper | 2025-08-23 | 1 | -3/+0 |
| | | |||||
| * | split_for_sort: add filename to warning | Thorsten Töpper | 2025-08-11 | 1 | -1/+1 |
| | | |||||
| * | split_for_sort: switch from strncpy to memcpy | Thorsten Töpper | 2025-08-10 | 1 | -4/+4 |
| | | |||||
| * | split_for_sort: Split a given file into buckets | Thorsten Töpper | 2025-08-10 | 1 | -0/+367 |
| The target bucket is decided based on the first X characters of a line. The bucket name gets a prefix defined as argument and can be sorted faster on weak hardware. Note: This is just a split alternative. Real world usage in a shell script with a file in which the first 10 characters are the equal in each line, the following 2 bytes are evaluated for splitting: split_for_sort TMPSFS 12 raw_data.txt for f in TMPSFS ; do sort -o "${f}_sorted" -u "${f}" done \# Rely on the argument resolution to go with lexical order cat TMPSFS*_sorted > sorted_data.txt rm TMPSFS* | |||||
