# Letter Grid word lists: sources and licences

The word lists in this folder were generated by `../tools/build-dictionary.mjs` from the
open-licensed sources below. The script folds every entry (lowercase, accents removed, œ → oe,
æ → ae), keeps only words of 3 to 16 letters a-z, drops entries with capitals (proper nouns),
apostrophes, hyphens or spaces, removes a short list of slurs (`../tools/word-filters.json`),
removes duplicates and sorts the result. Each list file comes from a single source and keeps that
source's licence. They are read by whatever runs the game: the home server, or the TV's browser
when it hosts (see docs/hosted-mode.md, which serves this file next to them). Phones never download them.

| File | Source | Licence |
| --- | --- | --- |
| `en/common.txt`, `en/rare.txt` | SCOWL | SCOWL licence (permissive, notice below) |
| `fr/common.txt`, `fr/rare.txt` | Lexique 3.83 | CC BY-SA 4.0 |
| `fr/inflections.txt` | Grammalecte lexicon 7.7 | MPL 2.0 |
| `en/rude.txt`, `fr/rude.txt` | LDNOOBW, plus our own entries, matched against the lists above | CC BY 4.0 |

## English: SCOWL (Spell Checker Oriented Word Lists)

- Source: SCOWL 2020.12.07 by Kevin Atkinson, <http://wordlist.aspell.net/>
  (`https://downloads.sourceforge.net/wordlist/scowl-2020.12.07.tar.gz`).
- Used: the `english`, `american`, `british` and `canadian` word lists of sizes 10 to 70.
  `en/common.txt` holds sizes up to 50; `en/rare.txt` holds sizes 55 to 70.
- Licence: "Permission to use, copy, modify, distribute and sell these word lists, the associated
  scripts, the output created from the scripts, and its documentation for any purpose is hereby
  granted without fee, provided that the above copyright notice appears in all copies and that
  both that copyright notice and this permission notice appear in supporting documentation."
  The complete copyright and permission notice, including the notices of the lists SCOWL is
  built from, is in [`licenses/SCOWL-Copyright.txt`](licenses/SCOWL-Copyright.txt).

Copyright 2000-2018 by Kevin Atkinson.

## French: Lexique 3.83

- Source: Lexique 3.83, <http://www.lexique.org/> (`Lexique383.zip`), by Boris New and
  Christophe Pallier, with Ronald Peereman, Sophie Dufour, Christian Lachaud and others.
- Reference: New, B., Pallier, C., Brysbaert, M., Ferrand, L. (2004). Lexique 2: A New French
  Lexical Database. *Behavior Research Methods, Instruments, & Computers*, 36(3), 516-524.
- Used: the `ortho` (spelling), `lemme`, `cgram`, `freqfilms2` and `freqlivres` columns. Entries
  that are only interjections or onomatopoeia (`ONO`) are left out. `fr/common.txt` holds the forms
  seen at least 0.5 times per million words in Lexique's film-subtitle or book corpus;
  `fr/rare.txt` holds the others.
- Licence: Creative Commons Attribution-ShareAlike 4.0 International (CC BY-SA 4.0),
  <https://creativecommons.org/licenses/by-sa/4.0/>. `fr/common.txt` and `fr/rare.txt` are
  adaptations (folded, filtered and split as described above) and are distributed under the same
  licence.

## French: Grammalecte lexicon 7.7

- Source: "Lexique français, liste des formes fléchies", version 7.7, by Olivier R. and the
  Dicollecte contributors, <https://grammalecte.net/> (`https://grammalecte.net/dic/lexique-grammalecte-fr-v7.7.zip`).
- Used: inflected forms (column `Flexion`) of verbs, nouns, adjectives, adverbs and grammatical
  words whose lemma is also in Lexique, and that Lexique doesn't list itself (mostly conjugations
  such as "lierai" or "salent"). They are in `fr/inflections.txt`.
- Licence: Mozilla Public License 2.0, <https://mozilla.org/MPL/2.0/>.

  This Source Code Form is subject to the terms of the Mozilla Public License, v. 2.0. If a copy
  of the MPL was not distributed with this file, You can obtain one at https://mozilla.org/MPL/2.0/.
  (This notice applies to `fr/inflections.txt`, which can't carry it itself because every line of
  it is read as a word.)

## Moderation lists: LDNOOBW

- Source: "List of Dirty, Naughty, Obscene, and Otherwise Bad Words", files `en` and `fr`, commit
  `5faf2ba42d7b1c0977169ec3611df25a3c08eb13`,
  <https://github.com/LDNOOBW/List-of-Dirty-Naughty-Obscene-and-Otherwise-Bad-Words>.
- Licence: Creative Commons Attribution 4.0 International (CC BY 4.0),
  <https://creativecommons.org/licenses/by/4.0/>.
- Changes: only single-word entries are used; words with an everyday innocent meaning are taken
  out ("escort", "pédale", "chatte"…), our own entries are added, and the result is matched against
  the word lists above (with plurals for English, and every form of the same lemma for French).
  `<lang>/rude.txt` lists the words that are accepted in the adults tone only and are never shown
  as "nobody found" or played by bots. They stay in the main lists.