ยป
Keras API reference /
KerasNLP
KerasNLP
KerasNLP is a toolbox of modular building blocks ranging from pretrained state-of-the-art models, to low-level Transformer Encoder layers. For an introduction to the library see the KerasNLP home page. For a high-level introduction to the API see our getting started guide.
Models
Tokenizers
- Tokenizer base class
- WordPieceTokenizer
- SentencePieceTokenizer
- BytePairTokenizer
- ByteTokenizer
- UnicodeCodepointTokenizer
- compute_word_piece_vocabulary function
- compute_sentence_piece_proto function
Preprocessing Layers
- StartEndPacker layer
- MultiSegmentPacker layer
- RandomSwap layer
- RandomDeletion layer
- MaskedLMMaskGenerator layer
Modeling Layers
- TransformerEncoder layer
- TransformerDecoder layer
- FNetEncoder layer
- PositionEmbedding layer
- SinePositionEncoding layer
- TokenAndPositionEmbedding layer
- MaskedLMHead layer