Star
About Keras Getting started Developer guides Keras API reference Models API Layers API Callbacks API Optimizers Metrics Losses Data loading Built-in small datasets Keras Applications Mixed precision Utilities KerasTuner KerasCV KerasNLP Models Tokenizers Preprocessing Layers Modeling Layers Metrics Utils Code examples Why choose Keras? Community & governance Contributing to Keras KerasTuner KerasCV KerasNLP
ยป Keras API reference / KerasNLP

KerasNLP

KerasNLP is a toolbox of modular building blocks ranging from pretrained state-of-the-art models, to low-level Transformer Encoder layers. For an introduction to the library see the KerasNLP home page. For a high-level introduction to the API see our getting started guide.

Models

  • Albert
  • Bert
  • DebertaV3
  • DistilBert
  • FNet
  • Roberta
  • XLMRoberta

Tokenizers

  • Tokenizer base class
  • WordPieceTokenizer
  • SentencePieceTokenizer
  • BytePairTokenizer
  • ByteTokenizer
  • UnicodeCodepointTokenizer
  • compute_word_piece_vocabulary function
  • compute_sentence_piece_proto function

Preprocessing Layers

  • StartEndPacker layer
  • MultiSegmentPacker layer
  • RandomSwap layer
  • RandomDeletion layer
  • MaskedLMMaskGenerator layer

Modeling Layers

  • TransformerEncoder layer
  • TransformerDecoder layer
  • FNetEncoder layer
  • PositionEmbedding layer
  • SinePositionEncoding layer
  • TokenAndPositionEmbedding layer
  • MaskedLMHead layer

Metrics

  • Perplexity metric
  • RougeL metric
  • RougeN metric
  • Bleu metric
  • EditDistance metric

Utils

  • greedy_search function
  • top_k_search function
  • top_p_search function
  • random_search function
  • beam_search function
KerasNLP
Models
Tokenizers
Preprocessing Layers
Modeling Layers
Metrics
Utils
Terms | Privacy