Skip to content
View tensor-fusion's full-sized avatar
💭
I may be slow to respond.
💭
I may be slow to respond.
71 followers · 59 following

Achievements

Achievement: StarstruckAchievement: QuickdrawAchievement: Pair ExtraordinaireAchievement: Pull Sharkx3Achievement: Arctic Code Vault Contributor

Achievements

Achievement: StarstruckAchievement: QuickdrawAchievement: Pair ExtraordinaireAchievement: Pull Sharkx3Achievement: Arctic Code Vault Contributor

Block or report tensor-fusion

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
tensor-fusion/README.md

$$ \large \begin{aligned} &\text{model} : \theta \times \xi \rightarrow (\chi \times \phi) \rightarrow \psi \\ &\text{loss} : \psi \times \psi \rightarrow \ell \\ &\text{optimization} : (\theta \times \xi \times \chi \rightarrow \psi) \rightarrow (\psi \times \psi \rightarrow \ell) \rightarrow \mathcal{D} \rightarrow \theta \times \lambda \times \mathcal{L} \\ &\text{inference} : (\theta \times \kappa \rightarrow \psi) \rightarrow \theta \rightarrow (\chi \times \kappa \times \zeta) \rightarrow \psi \end{aligned} $$

Pinned Loading

  1. microhaskell microhaskell Public

    Small autodiff lib and a simple working feedforward neural net in Haskell on top of it, from scratch, zero-deps.

    Haskell 15

  2. CUDA-Transformer CUDA-Transformer Public

    Simple tutorial transformer example with an attention CUDA kernel

    Cuda 1

  3. sophia-jax sophia-jax Public

    JAX implementation of 'Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training'

    Python 2

  4. GPT-Haskell GPT-Haskell Public

    A pure Haskell implementation of a decoder-only transformer (GPT)

    Haskell 19

  5. Coquand-SML Coquand-SML Public

    A bidirectional dependent type checker in Standard ML

    Standard ML

  6. llm.c llm.c Public

    Forked from karpathy/llm.c

    LLM training in simple, raw C/CUDA

    Cuda