ยป
Keras API reference /
KerasNLP
KerasNLP
KerasNLP is a toolbox of modular building blocks (layers, metrics, etc.) that NLP engineers can leverage to develop production-grade, state-of-the-art training and inference pipelines for common NLP workflows.
Tokenizers
- Tokenizer base class
- WordPieceTokenizer
- SentencePieceTokenizer
- BytePairTokenizer
- ByteTokenizer
- UnicodeCharacterTokenizer
Layers
- TransformerEncoder layer
- TransformerDecoder layer
- FNetEncoder layer
- PositionEmbedding layer
- SinePositionEncoding layer
- TokenAndPositionEmbedding layer
- MLMMaskGenerator layer
- MLMHead layer
- StartEndPacker layer
- MultiSegmentPacker layer