# textproc/sentencepiece - The NetBSD Packages Collection

Unsupervised text tokenizer for Neural Network-based text generation

    SentencePiece is an unsupervised text tokenizer and detokenizer
    mainly for Neural Network-based text generation systems where the
    vocabulary size is predetermined prior to the neural model training.
    SentencePiece implements subword units (e.g., byte-pair-encoding
    (BPE)) and unigram language model with the extension of direct
    training from raw sentences. SentencePiece allows us to make a
    purely end-to-end system that does not depend on language-specific
    pre/postprocessing.

- Source version: `sentencepiece-0.1.97`
- Maintainer: pkgsrc-users AT NetBSD.org
- Website: https://github.com/google/sentencepiece/
- License: apache-2.0
- Package history: cvs, hg, git

## Build dependencies

devel/cmake pkgtools/mktools pkgtools/cwrappers

## Runtime dependencies

(none)

## Binary packages

OS | Architecture | Version
--- | --- | ---
NetBSD 10.0 | aarch64 | sentencepiece-0.1.97.tgz
NetBSD 10.0 | aarch64 | sentencepiece-0.1.97.tgz
NetBSD 10.0 | aarch64eb | sentencepiece-0.1.97.tgz
NetBSD 10.0 | alpha | sentencepiece-0.1.97.tgz
NetBSD 10.0 | alpha | sentencepiece-0.1.97.tgz
NetBSD 10.0 | earmv6hf | sentencepiece-0.1.97.tgz
NetBSD 10.0 | earmv6hf | sentencepiece-0.1.97.tgz
NetBSD 10.0 | earmv7hf | sentencepiece-0.1.97.tgz
NetBSD 10.0 | earmv7hf | sentencepiece-0.1.97.tgz
NetBSD 10.0 | i386 | sentencepiece-0.1.97.tgz
NetBSD 10.0 | i386 | sentencepiece-0.1.97.tgz
NetBSD 10.0 | powerpc | sentencepiece-0.1.97.tgz
NetBSD 10.0 | powerpc | sentencepiece-0.1.97.tgz
NetBSD 10.0 | sparc64 | sentencepiece-0.1.97.tgz
NetBSD 10.0 | x86_64 | sentencepiece-0.1.97.tgz
NetBSD 10.0 | x86_64 | sentencepiece-0.1.97.tgz
NetBSD 9.0 | aarch64 | sentencepiece-0.1.97.tgz
NetBSD 9.0 | aarch64 | sentencepiece-0.1.97.tgz
NetBSD 9.0 | alpha | sentencepiece-0.1.97.tgz
NetBSD 9.0 | alpha | sentencepiece-0.1.97.tgz
NetBSD 9.0 | earmv6hf | sentencepiece-0.1.97.tgz
NetBSD 9.0 | earmv6hf | sentencepiece-0.1.97.tgz
NetBSD 9.0 | earmv7hf | sentencepiece-0.1.97.tgz
NetBSD 9.0 | earmv7hf | sentencepiece-0.1.97.tgz
NetBSD 9.0 | i386 | sentencepiece-0.1.97.tgz
NetBSD 9.0 | i386 | sentencepiece-0.1.97.tgz
NetBSD 9.0 | mips64eb | sentencepiece-0.1.97.tgz
NetBSD 9.0 | powerpc | sentencepiece-0.1.97.tgz
NetBSD 9.0 | powerpc | sentencepiece-0.1.97.tgz
NetBSD 9.0 | sparc64 | sentencepiece-0.1.97.tgz
NetBSD 9.0 | sparc64 | sentencepiece-0.1.97.tgz
NetBSD 9.0 | x86_64 | sentencepiece-0.1.97.tgz
NetBSD 9.0 | x86_64 | sentencepiece-0.1.97.tgz
NetBSD 9.3 | x86_64 | sentencepiece-0.1.97.tgz
NetBSD 9.3 | x86_64 | sentencepiece-0.1.97.tgz

Binary packages can be installed with the high-level tool pkgin (which can be installed with pkg_add) or pkg_add(1) (installed by default). The NetBSD packages collection is also designed to permit easy installation from source.

## Available build options

(none)

## Known vulnerabilities

(no vulnerabilities known)

The pkg_admin audit command locates any installed package which has been mentioned in security advisories as having vulnerabilities.

Please note the vulnerabilities database might not be fully accurate, and not every bug is exploitable with every configuration.

Problem reports, updates or suggestions for this package should be reported with send-pr.