diff options
| author | Erich Eckner <git@eckner.net> | 2019-01-10 10:42:39 +0100 |
|---|---|---|
| committer | Erich Eckner <git@eckner.net> | 2019-01-10 10:42:39 +0100 |
| commit | 5cf2e600b9eac373ce2296da5587ce9c7eefe6ab (patch) | |
| tree | a669bbba2a1f8a10739a4c7dc81de5d34c51b88a | |
| parent | 4fbf7d38ce729c46dbd37e3f6bfb286fc9a6bfdb (diff) | |
| download | markov-5cf2e600b9eac373ce2296da5587ce9c7eefe6ab.tar.xz | |
generate-random-word-from-wikipedia.sh: save one word per line
| -rwxr-xr-x | generate-random-word-from-wikipedia.sh | 3 |
1 files changed, 2 insertions, 1 deletions
diff --git a/generate-random-word-from-wikipedia.sh b/generate-random-word-from-wikipedia.sh index 447cc81..dee670e 100755 --- a/generate-random-word-from-wikipedia.sh +++ b/generate-random-word-from-wikipedia.sh @@ -26,8 +26,9 @@ if [ ! -s "${base_dir}/.words.${depth}" ]; then printf '%s\n' "${urls[@]}" \ | parallel -j0 -n1 "${base_dir}/remove-tags.sh" \ - | sort -u \ + | tr -C '[a-zA-ZäöüÄÖÜß]' '\n' \ | grep -vxF '' \ + | sort -u \ > "${base_dir}/.words.${depth}" fi |