Jump to content

Leaderboard

Popular Content

Showing content with the highest reputation on 05/18/24 in Posts

  1. [Tool] Sugoi Offline Translator Repackage The following are some repackages I did to strip down Sugoi Offline Translator v4.0 to only the barebones essentials but filled with as many features as possible from the available sources. Disclaimers Sugoi Toolkit Repackage Description fairseq and CTranslate2 PyTorch AMD graphics cards Microsoft DirectML HTTP servers available for fairseq/CTranslate2 Notes on the repackages (Windows only) Converting to the CTranslate2 model format Pick one of the following. - DL https://mega.nz/folder/ZORBTLAS#f2G4ih7crgWIN-_uSjbqAA - The different repackage versions have - Support for the Sugoi v4.0 offline model. - Support for the fairseq and CTranslate2 inference libraries. This includes CPU, CUDA, and/or DirectML support. - Support for py3translationServer since their documentation is the most readable. - A preconfigured batch script to configure an isolated local environment. Repackage Option A) Sugoi-Repackage-CUDA.7z - Description - Normal and most flexible version recommended for most users. Supports both fairseq and CTranslate2 using both CPU and CUDA 11 or 12. - Has a reasonable download+install time. - Does not include PyTorch or the Sugoi model. - Sugoi-Repackage-CUDA-Full.7z is the same as "Sugoi-Repackage-CUDA.7z", but comes bundled with PyTorch CUDA 11.8 and the other dependencies which bloats the compressed size from <100MB to ~2.48 GB. Since setup has been done already and it includes the both versions of the models. Sugoi-Repackage-CUDA installation instructions Sugoi-Repackage-CUDA-Full installation instructions Repackage Option B) Sugoi-Repackage-CPU.7z - Description - This version is for the bandwidth and GPU impaired that know they will only be using CPU inferencing. It supports only CTranslate2 + CPU. - If you know your GPU will not work with CUDA 11.x, then this is the best option. - Has the fastest download+install time. - Does not need PyTorch at all, thus saving lots of space and bandwidth! - The model is not included. - The model must be in CTranslate2 format. Sugoi-Repackage-CPU Installation instructions: Repackage Option C) Sugoi-Repackage-DirectML.7z - Description - This version is for gamblers who want to roll the dice with Microsoft DirectML on Windows 10 1903+. - Read "DirectML" above and then use something else. - Does not include PyTorch or the model. - Do not expect anything to avoid the inevitable disapointment. Only sometimes works with fairseq ...for now. - This PyTorch-DirectML repackage is provided as-is. No support is provided here if it does not work or breaks later. - If it does not work, I do not care. If Microsoft does not care about supporting their library, then why should I? Sugoi-Repackage-DirectML Install Guide: Repackage Option D) Sugoi-Repackage-Global - Description - These are the same scripts as above but slightly tweaked to use the global git and Python interpreter. I have not tested these much. Sugoi Model Links Linux users Windows 7 and 8 not so Frequently Asked Questions Licensing
    1 point
×
×
  • Create New...