Thunder/llamacpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-06-13 01:52:49 -05:00
Code Issues Projects Releases Packages Wiki Activity
Page: Terminology
Pages
Feature matrix GGML Tips & Tricks Home HuggingFace Model Card Metadata Interoperability Consideration Metadata Override Modules PR And Issue Tickets Maintenance Templates supported by llama_chat_apply_template Tensor Encoding Schemes Terminology contribute dev notes
4 Terminology
Brian edited this page 2024-05-21 12:08:23 +10:00
Table of Contents

  • BOS Token - Beginning of Sentence Token

  • EOS Token - End of Sentence Token

  • Token - short segments of symbols (that could typically make up a word)

  • Embeddings - Higher level token vectors representations of tokens

  • NIHS - Needle In a Hay Stack

  • NINS - Needle In Needle Stack

Maintainers Specific Acronyms and Terminology

These are keywords in code that is not typically of importance to users.

  • FA - Flash Attention

Users Guide

Useful information for users that doesn't fit into Readme.

Technical Details

These are information useful for Maintainers and Developers which does not fit into code comments

Github Actions Main Branch Status

Click on a badge to jump to workflow. This is here as a useful general view of all the actions so that we may notice quicker if main branch automation is broken and where.

  • bench action status
  • build action status
  • close-issue action status
  • code-coverage action status
  • docker action status
  • editorconfig action status
  • gguf-publish action status
  • labeler action status
  • nix-ci-aarch64 action status
  • nix-ci action status
  • nix-flake-update action status
  • nix-publish-flake action status
  • python-check-requirements action status
  • python-lint action status
  • server action status