#cloud

• Wed, Jan 1, 2025. LLM Code Execution Sandboxes that let you run code in a sandbox via an API: #cloud #code-agents #github #hosting #llm-ops
  • AgentRun: open source, via Docker
  • e2b.dev. A day costs about $1 (on demand) and you get about $100 one time credits. Self-hosting is complex. Discussion

• Wed, Jan 1, 2025. LLM Observability tools: #cloud #llm-ops
  • LangFuse lets you build a self hosted LLM Proxy with API key distribution, logging, and SSO.
  • Helicone does not support SSO

• Fri, Dec 27, 2024. What would be the cost of storing about 500GB of LLM cache logs and 5 million write requests per month? #cloud
  • CloudFlare KV: $250 + $25 / month Ref
  • MongoDB: $125 + $5 / month Ref
  • S3: $0.0115 + $25 / month Ref + ?
  • CloudFlare R2: $0.0075 + $22.5 / month Ref

• Sat, Dec 21, 2024. What to use for hosting: ChatGPT #chatgpt #cloud #github #hosting #html #server #web-dev
  • GitHub Pages: Static websites, medium files
  • Cloudflare Pages: Static websites, global delivery
  • Vercel: Frontend frameworks (e.g. Next.js) with high DX and ISR, small files
  • Netlify: JAMstack projects, minimal back-end, moderate files
  • Glitch: Small static projects
  • Render: Full-stack apps requiring databases and server-side compute
  • Firebase Hosting: Small sites, limited large files
  • Archive.org: Public archival, large files
  • Google Drive: File sharing, large files
  • Dropbox: File sharing, moderate files
  • Cloudflare R2: Static assets, large file delivery

• Wed, Dec 11, 2024. Hyperbrowser is a cloud based puppeteer service. #cloud #future

• Tue, Nov 26, 2024. CloudFlare workers can bundle any kind of files, including text, data, and WASM. Docs #cloud #document-conversion #markdown

• Mon, Nov 11, 2024. Cloudflare R2 has the same API as S3 but is cheaper #cloud

• Sat, Nov 9, 2024. LLM Vision Use Cases in manufacturing and earth sciences (via Shivku) #cloud #image-generation #llm-ops
  • Automated geoscience image descriptions Ref
  • Interpret Wind Turbine photos and charts, construction monitoring, equipment maintenance & charts Ref
  • Forecast weather based on cloud photos! Ref
  • Analyze thermal image of solar panels, electroluminescence images for warranty claims, ROI estimates from Google Sunroof rooftop images Ref
  • Corrosion detection in electricity towers, turbines, storage tanks, penstock. Interpret non-destructive test images Ref

• Sun, Oct 27, 2024. Cohere Multimodal Embed v3 is available on Azure. #cloud #embeddings

• Fri, Oct 4, 2024. There's a movement towards embeddable databases on the cloud. #cloud
  • MotherDuck is hosted DuckDB.
  • Turso is hosted SQLite (with local sync, multi-tenant)
  • StarBase DB is SQLite with an API on top of Cloudflare Durable Objects.

• Fri, Sep 20, 2024. Jupyter Lite lets you run Jupyter notebooks in the browser #cloud #future

• Mon, Jul 22, 2024. Awesome PaaS lists self-hosted deployment platforms. Piku - similar to Dokku -- is promising. #cloud #github #hosting

• Sat, Jun 22, 2024. Luma Labs Dream Machine generated videos. It's free and is of reasonable quality #cloud #future #gpu

• Sat, Apr 27, 2024. Cheap cloud GPU services thread on Twitter lists: #ai-coding-tools #cloud #gpu
  • Runpod (17)
  • Vast.ai (17)
  • Modal Labs (8)
  • fly.io (4)
  • LightningAI (4)
  • Colab (4)
  • AkashNet (4)
  • Lambda Labs (4)
  • ShadeFormAI (3)
  • Mac Mini (3)
  • Tensor Dock (2)
  • Hetzner (2)
  • BrevDev (2)

• Wed, Feb 14, 2024. Fly.io offers GPU hosting and auto stop when they have nothing to do. #cloud #gpu #hosting

• Sun, Jan 28, 2024. Intel developer cloud has a liberal GPU in the free tier. #cloud #gpu

• Sun, Jan 7, 2024. mixtral-offloading cleverly loads only the model layer required at any point, letting you run Mixtral 8x7b on Colab Free and on 16GB GPUs. This notebook runs on Colab Free too. #cloud #gpu #markdown

• Sun, Dec 3, 2023. SkyPilot lets you run LLMs on any cloud provider. #cloud #future #llm-ops