idea: model-in-Colab as a DSH inference engine via tunnel (horizon; likely ToS-problematic) #9
Labels
No labels
area/backup
area/cli
area/docs
area/dsh
area/forgejo
area/host
area/mcp
area/plugin
area/security
area/ux
needs-operator
priority/later
priority/next
priority/now
type/bug
type/research
type/task
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set
Reference
dsh-plugins/dsh-colab#9
Loading…
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Operator floated the fun version: run an open-weight model (e.g. Gemma 26A4B) in a Colab session and expose it to DSH as an inference engine via a tunnel — "free DSH for every Google AI customer".
Why it is parked (not just hard: likely against ToS)
If we ever pursue something like it
Decision
Keep as an exploration idea for a future "dsh-inference" plugin where the backend is an owned endpoint (vLLM/LM Studio/Ollama/Colab Enterprise), with Colab as a dev environment only. Revisit if Google ships stable networking/API access for managed runtimes.