#cloud

• Sat, May 31, 2025. I was exploring free alternatives to the $4/mo Hetzner instance I use. Google offers a free e2 micro instance. But it's much smaller than the Hetzner CAX11/CX-22 server I run. 25% of CPU, 25% of RAM (which is the main problem -- 1 GB is often not enough), slower HDD, 5% of outbound traffic. Hetzner remains one of the best value offerings. #cloud #hosting

• Tue, May 13, 2025. Today, if I had to store a bunch of data files (e.g. parquet) under 1GB, here are options: #cloud #database #github #markdown
  • GitHub Releases. 2 GiB per file, unlimited total & bandwidth. 🟢 Immortal URL, versioning, easy CI publish. 🔴 Each file must stay < 2 GiB; no built-in SQL.
  • Zenodo (CERN). 50 GB per record; one-off bumps to 200 GB. 🟢 DOI assignment, archival mandate. 🔴 Occasional throttled bandwidth; no API for partial file reads.
  • Hugging Face Hub. 300 GB per repo; 50 GB per file. 🟢 Git-based, dataset tooling, lively ML community. 🔴 Large files need git-LFS; pushes via LFS can be slow.
  • Cloudflare R2. 10 GB storage & 1 M ops / month. 🟢 S3 API, zero-egress to Cloudflare Workers, fast. 🔴 10 GB cap below your 50 GB target.
  • Kaggle Datasets. 20 GB per dataset, public only. 🟢 Built-in notebooks & GPU. 🔴 No programmatic SQL API; quotas sometimes change.
  • data.world (free). 1 GB total, 100 MB per dataset. 🟢 Nice social features. 🔴 Too small for your size.

• Tue, May 13, 2025. If I had to query a bunch of data files in an external Parquet or SQLite file, here are SQL engines-as-a-service: #cloud #database
  • MotherDuck. 10 GB storage + 10 CU-hrs/mo compute. Native DuckDB; no credit card; GA June 2024; monthly feature drops.
  • Datasette Cloud. Two-month trial (or 1-yr for non-profits). SQLite backend. Great UX; but not free forever for general use.
  • AWS Athena. Pay-per-TB scanned; no free tier; S3 fees after 12 mo. Costs creep quickly; free-tier S3 ends after a year.

• Tue, May 13, 2025. There's a lot of action on encrypted LLM operations. #cloud #llm-ops
  • Responses API allows reasoning tokens to be encrypted if organizations don't want their reasoning data to persist. Ref
  • Tinfoil (YC X25) offers an OpenAI-compatible inference API where data is encrypted from the client to the NVIDIA Hopper/Blackwell GPUs in confidential computing mode. Prompts, model weights, outputs are encrypted in transit and memory, with verifiable privacy on code running in GPU.
  • Modelyo (Israel) offers VMs/K8 clusters with encrypted GPUs across multiple cloud providers with continuous attestation, managed on Modelyo's portal.

• Mon, May 12, 2025. CloudFlare Zero Trust seems the easiest way to enable auth on static websites, especially if your DNS is already on Cloudflare. No cost #cloud #hosting

• Mon, May 12, 2025. Cloudflare Vectorize, at 768 dimensions / embedding, is free for ~6.5K chunks storage at ~1,000 queries / day. For a light load like 1M 768d chunks queried 1K times a day, the cost is: ChatGPT #cloud #gpu

  Service	$
  Cloudflare Vectorize	0.38
  TurboPuffer (min $64/mo)	1.12
  Pinecone (Serverless)	1.27
  Supabase (pgvector Micro)	10.00
  Redis Cloud Flex (~3 GB)	15.00
  Elastic Serverless	65.84
  Weaviate Cloud (Serverless)	73.00
  Qdrant Cloud (4 CPU / 8 GB)	107.16
  Azure AI Search (S1 1 SU)	245.28
  AWS OpenSearch Serverless	350.00
  Google Vertex AI Vector Search	547.50

• Tue, May 6, 2025. GitHub does not let you control the cache duration, but there are many creative workarounds. ChatGPT #cloud #github #hosting
  • HTML meta tags: <meta http-equiv="Cache-Control" content="no-cache, no-store, must-revalidate">
  • Use a service worker (blog)
  • Proxy through a CDN. Cloudflare, Netlify
  • Move to another static host: S3 + CloudFront, Heroku, Vercel, Surge, Firebase Hosting

• Sun, Apr 27, 2025. It's interesting how many places offer a free compute via shells (apart from Google Colab): #ai-coding-tools #cloud #github #hosting
  • Google Cloud Shell: Free for 50 hours/week, refreshed every Monday. Sessions last up to 12 hours and terminate after ~1 hour inactivity. Ref
  • Azure Cloud Shell: Always free to use with 5 GB free storage for first 12 months (standard rates after). No documented session limits but typically times out after prolonged inactivity. Ref
  • AWS Cloud9: Free IDE, underlying compute free under AWS Free Tier (750 hours/month EC2 t2.micro or t3.micro for first 12 months). Regular EC2 rates apply afterward. Ref
  • Gitpod: Free tier offers 500 credits/month (~50 hrs). Workspaces run up to 8 hours/session and stop after 30 minutes inactivity. Ref
  • GitHub Codespaces: 120 core-hours/month (~60 hrs with 2-core machine) and 15 GB storage free. Sessions timeout after 30 minutes inactivity. Ref
    • Create: gh codespace create --idle-timeout 10m --machine basicLinux32gb -R $USER/$REPO returns the $CONTAINER_ID
    • SSH: gh codespace ssh -c $CONTAINER_ID
    • Delete: gh codespace delete -c $CONTAINER_ID
  • Replit: Free Starter plan provides 20 hours/month, 1 vCPU, 2 GB RAM, 2 GiB storage. Repls sleep after 30 minutes inactivity. Ref
  • IBM Cloud Shell: Free for all users; 50 h/week per region; any open session counts toward quota; sessions can run any length up to weekly cap; 500 MB temporary workspace. Ref
  • Oracle Cloud Infrastructure Cloud Shell: Free within tenancy limits; up to 400 h/month on Pay-As-You-Go, 240 h/month on Universal Credits; 5 GB encrypted persistent home. Ref
  • PythonAnywhere: Free (beginner plan), includes one web app (restricted outbound), low CPU/bandwidth, no Jupyter; 2 concurrent Bash/Python consoles, 500 MB disk; limited daily CPU. Ref
  • Glitch: Starter (free) plan—full-stack apps sleep after 5 min inactivity and wake on request; unlimited public/private projects; container state preserved. Ref
  • CodeSandbox: Free tier provides 400 credits/month (~40 h of 2 vCPU+4 GB Devbox runtime), unlimited front-end Sandboxes (no credits), up to 20 Sandboxes/workspace. Ref

• Sun, Apr 20, 2025. OpenAI doesn't charge for file storage but does charge 10 cents / GB-day for vector storage beyond 1 GB. The first 1GB is free #cloud

• Sat, Mar 15, 2025. What makes client-side computing on the browser powerful is #cloud #html #server #web-dev
  • There's nothing to install
  • Private by default: data stays with client
  • Speed: no latency

• Thu, Jan 23, 2025. According to Portkey's LLM usage analysis #cloud #gpu
  • Anyscale and Fireworks AI have the lowest error rates (5xx, 429) and rate limits across providers
  • Groq and Anthropic are among the highest, OpenAI is among the lowest, Google is in-between
  • OpenAI has lower error rates and lower latency than Azure
  • They have a ~35% cache hit rate

• Sun, Jan 12, 2025. GitHub CodeSpaces seems to be coming up more often in my radar, but I'm yet to figure out a use for it. #ai-coding-tools #cloud #future #github #markdown

• Tue, Jan 7, 2025. Cloudflare tunnel is like ngrok but more permanent. It's a bit more complex, too. But given CloudFlare's liberal free tier, it's a good, viable option for long-term local hosting. #cloud #hosting #networking

• Wed, Jan 1, 2025. LLM Code Execution Sandboxes that let you run code in a sandbox via an API: #ai-coding-tools #cloud #code-agents #github #llm-ops
  • AgentRun: open source, via Docker
  • e2b.dev: A day costs about $1 (on demand) and you get about $100 one time credits. Self-hosting is complex. Discussion
  • nsjail: by Google. Write your own API

• Fri, Dec 27, 2024. What would be the cost of storing about 500GB of LLM cache logs and 5 million write requests per month? #cloud
  • CloudFlare KV: $250 + $25 / month Ref
  • MongoDB: $125 + $5 / month Ref
  • S3: $0.0115 + $25 / month Ref + ?
  • CloudFlare R2: $0.0075 + $22.5 / month Ref

• Sat, Dec 21, 2024. What to use for hosting: ChatGPT #chatgpt #cloud #github #hosting #html #server #web-dev
  • GitHub Pages: Static websites, medium files
  • Cloudflare Pages: Static websites, global delivery
  • Vercel: Frontend frameworks (e.g. Next.js) with high DX and ISR, small files
  • Netlify: JAMstack projects, minimal back-end, moderate files
  • Glitch: Small static projects
  • Render: Full-stack apps requiring databases and server-side compute
  • Firebase Hosting: Small sites, limited large files
  • Archive.org: Public archival, large files
  • Google Drive: File sharing, large files
  • Dropbox: File sharing, moderate files
  • Cloudflare R2: Static assets, large file delivery

• Wed, Dec 11, 2024. Hyperbrowser is a cloud based puppeteer service. #cloud #future

• Tue, Nov 26, 2024. CloudFlare workers can bundle any kind of files, including text, data, and WASM. Docs #cloud #document-conversion #markdown

• Mon, Nov 11, 2024. Cloudflare R2 has the same API as S3 but is cheaper #cloud

• Sat, Nov 9, 2024. LLM Vision Use Cases in manufacturing and earth sciences (via Shivku) #cloud #image-generation #llm-ops
  • Automated geoscience image descriptions Ref
  • Interpret Wind Turbine photos and charts, construction monitoring, equipment maintenance & charts Ref
  • Forecast weather based on cloud photos! Ref
  • Analyze thermal image of solar panels, electroluminescence images for warranty claims, ROI estimates from Google Sunroof rooftop images Ref
  • Corrosion detection in electricity towers, turbines, storage tanks, penstock. Interpret non-destructive test images Ref

• Sun, Oct 27, 2024. Cohere Multimodal Embed v3 is available on Azure. #cloud #embeddings

• Fri, Oct 4, 2024. There's a movement towards embeddable databases on the cloud. #cloud #database
  • MotherDuck is hosted DuckDB.
  • Turso is hosted SQLite (with local sync, multi-tenant)
  • StarBase DB is SQLite with an API on top of Cloudflare Durable Objects.

• Fri, Sep 20, 2024. Jupyter Lite lets you run Jupyter notebooks in the browser #cloud #future

• Mon, Jul 22, 2024. Awesome PaaS lists self-hosted deployment platforms. Piku - similar to Dokku -- is promising. #cloud #github #hosting

• Sat, Jun 22, 2024. Luma Labs Dream Machine generated videos. It's free and is of reasonable quality #cloud #future #gpu

• Sat, Apr 27, 2024. Cheap cloud GPU services thread on Twitter lists: #ai-coding-tools #cloud #gpu
  • Runpod (17)
  • Vast.ai (17)
  • Modal Labs (8)
  • fly.io (4)
  • LightningAI (4)
  • Colab (4)
  • AkashNet (4)
  • Lambda Labs (4)
  • ShadeFormAI (3)
  • Mac Mini (3)
  • Tensor Dock (2)
  • Hetzner (2)
  • BrevDev (2)

• Wed, Feb 14, 2024. Fly.io offers GPU hosting and auto stop when they have nothing to do. #cloud #gpu #hosting

• Sun, Jan 28, 2024. Intel developer cloud has a liberal GPU in the free tier. #cloud #gpu

• Sun, Jan 7, 2024. mixtral-offloading cleverly loads only the model layer required at any point, letting you run Mixtral 8x7b on Colab Free and on 16GB GPUs. This notebook runs on Colab Free too. #cloud #gpu #markdown

• Sun, Dec 3, 2023. SkyPilot lets you run LLMs on any cloud provider. #cloud #future #llm-ops