EasyDeL - 0.0.66

[erfanzar]

• New Features

  • GenerationPipeLine was added for fast streaming and easy generation with JAX.
  • Using Int8Params instead of LinearBitKernel.
  • Better GPU support.
  • EasyDeLState is now better and supports more general options.
  • Trainers now support .save_pretrained(to_torch) and training logging.
  • EasyDeLState supports to_8bit.
  • All of the models support to_8bit for params.

• Removed API

  • JAXServe is no longer available.
  • PyTorchServe is no longer available.
  • EasyServe is no longer available.
  • LinearBitKernel is no longer available.
  • EasyDeL partitioners are no longer available.
  • Llama/Mistral/Falcon/Mpt static convertors or transforms are no longer available.

• Known Issues

  • Lora Kernel Sometimes Crash.
  • GenerationPipeLine has a compiling problem when the number of available devices is more than 4 and using 8_bit params.
  • Most of the features won't work for TPU-v3 and GPUs with compute capability lower than 7.5.
  • Kaggle session will crash after importing EasyDeL (Kaggle's latest environment is not stable it's not related to EasyDeL).

---

This discussion was created from the release EasyDeL - 0.0.66.