Aalto Local LLM Gateway
Operated by Aalto University Scientific Computing
No-cost research and development inference across 1 model; not unrestricted production use.
https://llm-gateway.k8s.aalto.fi/api/v1Models mentioned
RedHatAI/gemma-4-31B-it-FP8-DynamicEquivalent paid value
How this was valued: The published allowance or a defensible paid comparison is not precise enough to calculate.
The free shared gateway publishes no numeric user quota, finite request/token envelope, or same-service paid unit.
Limits and terms
- Published Numeric Quota
- No
- Shared Capacity
- 8 L40S GPUs
- Fair Access
- Yes
What happens to your prompts?
Aalto says prompts and responses are not logged and records usage metadata only, but no explicit no-training rule or metadata-retention period is published.
- Plan Scope
- Aalto Local LLM Gateway for institutional research and teaching.
- Prompt Retention
- The service page says prompts are not logged.
- Response Retention
- The service page says responses are not logged.
- Ordinary Logging
- Local usage logs contain model, timestamp, and token-count metadata rather than prompt or response text; no metadata TTL is published.
- Model Training
- No explicit service-wide no-training commitment was found.
- Product Improvement
- Content-based improvement is not documented; stored usage metadata may support capacity and service operations.
- Human Or Operator Access
- Prompt/response review is constrained by the no-content-logging statement, while administrative access to usage metadata is not further bounded.
- Subprocessors And Routing
- The gateway runs on Aalto's local eight-L40S capacity; the page does not enumerate any additional processors.
- Deletion Controls
- No ordinary prompt/response copy should remain, but metadata and account/key deletion controls are not documented.
- Caveat
- The no-content-logging statement does not resolve training policy or metadata retention.
No provider terms or privacy-policy link is captured in this snapshot. Review the provider’s current legal documents before sending sensitive data.
Eligibility
- Account Required
- Yes
- Eligible Users
- Aalto employees for research and teaching; course students through the course organizer
- Network Or VPN Required
- Yes
- Keys Per User
- 10
- Payment Method Required
- No
Primary sources
Before you build with Aalto Local LLM Gateway
Read the classification narrowly
This record has current first-party evidence for some zero-cost hosted inference. The label describes the bounded offer supported by evidence on 2026-09-19; it does not guarantee permanence, production suitability, uptime, latency, model quality, or access from every region.
Resolve the live model route
This snapshot records 1 model ID. Match the exact ID against the provider's live catalog before using it in code; zero-price routes and aliases can rotate while an older documentation page remains online. The recorded base endpoint is https://llm-gateway.k8s.aalto.fi/api/v1, but the provider's current API reference remains authoritative for paths, authentication, and request shape.
Confirm account and billing boundaries
An account is required, so public catalog evidence cannot by itself prove the limits, balance, or billing behavior attached to your workspace. The reviewed evidence explicitly says no payment card is required. Re-check the signup flow because eligibility and billing controls can change after the snapshot. The equivalent paid value shown here prices a documented allowance where possible; it is not cash, guaranteed savings, or protection from overage.
Re-read the prompt policy for your plan
This record classifies the reviewed handling as “Partially private”: Aalto says prompts and responses are not logged and records usage metadata only, but no explicit no-training rule or metadata-retention period is published. Provider policies can distinguish free, paid, enterprise, opted-in, and feature-specific traffic, so verify the governing terms for the exact account and route that will receive your data.
Follow the evidence, then re-check it
The record links 1 first-party source covering the offer, catalog, limits, pricing, terms, privacy, or adoption evidence available to the audit. Prefer the newest governing document or live catalog when sources disagree, and submit a correction when a provider changes a material term.
Match the quota to the workload shape
Translate the published allowance into the traffic pattern you actually expect instead of comparing headline totals alone. A daily token pool can look generous while a low requests-per-minute or concurrency ceiling blocks interactive bursts; a high request limit can still fail a long-context job when input, output, or per-request tokens are capped. Separate prompt tokens from generated tokens, include retries and tool calls, and test the largest realistic payload. If the provider documents more than one limit window, the tightest window at your peak load is the practical ceiling. Research, experimental, and community access can also carry eligibility or fair-use constraints that cannot be modeled as a simple number.
Plan fallback without changing the rules
A fallback should preserve more than API syntax. Confirm that the substitute route supports the required modality, context length, streaming behavior, structured output, tools, and safety controls, then compare its prompt-retention and training terms. An OpenAI-compatible request shape does not make providers operationally or contractually equivalent. Decide which errors may trigger a retry, cap retry storms, and prevent an exhausted free route from silently switching to a billable model. If deterministic output matters, record the model revision and sampling settings; rotating aliases and free-model pools can change behavior even when the endpoint remains available.
Monitor the offer as a dependency
Capture the model ID, response model field, rate-limit headers, usage fields, latency, HTTP status, and any provider request identifier for each test. Watch for authorization failures, quota exhaustion, catalog removal, policy revisions, and dashboard balance changes as separate failure modes. Re-check the provider’s live catalog and governing pages on a schedule proportionate to the workload’s importance, and keep the dated sources that supported your decision. Free capacity is especially suitable for prototypes, evaluations, fallbacks, and bounded workloads when the application can tolerate change; a production dependency still needs observability, an exit path, and an owner responsible for re-verification.
Test one complete request before scaling
Start with the smallest permitted request using the exact credential, model ID, endpoint, and account type you intend to deploy. Record the HTTP status, response headers, usage fields, latency, and any dashboard balance change. Then exercise the failure path: an invalid model, an exhausted quota, or a rate-limit response should fail clearly without silently switching to a paid route. If the provider supports streaming or tool calls, validate those features separately because a free model can expose a narrower capability set than its paid counterpart. Keep a budget ceiling outside the application whenever billing is possible, and avoid sending sensitive data until the observed route matches the reviewed data agreement.