Sun, Mar 23, 2025 | Anand S - Things I Learned

If we can DESCRIBE what good looks like, training data is no gap. We can auto optimise models towards that. That's RLF. DeepSeek R1 side stepped the need for training data by creating reward functions and prompts. This tells the fine tuning process how to go correct as it goes along. This video is the first one that really help me understand what's going on. #optimization

Alexander Doria shares an interesting perspective on the app space. Model is the product #models
- Models are natively absorbing app capability and will become killer systems internalising workflows like Chat, Deep Research, Claude Code, Operator, etc. to wipe out the apps and workflow space. Models will "internalize" tool capabilities
- Opinionated or focused training will be a lever and model providers will acqui-hire the successful trainers
- API access from model providers will shrink. Selling tokens is not a viable business model given lowering costs

OpenAI now supports PDFs natively in the API. (Gemini has done so for a while) #document-conversion

Another way of scaling LLMs is generating multiple options and self evaluating. Eric Zhao #future #llm-ops

agents.json is a proposal for discovery of agents on a site that enhances the Open API spec: wild-card-ai/agents-json #agents #code-agents

Since Gemini Flash 2.0 is now an image GENERATION model, interactive VISUAL fiction is now a cool possibility. People are using it in interesting ways: #embeddings #future #image-generation Interleaved storytelling, Memes, Surrealism.

Andrej Karpathy's note taking mechanism is similar to mine, except I use Microsoft TODO. Ref #github #markdown
- I have 3 categories. Things I learnt, which I just note. Things to explore, which I can delegate, defer, drop, or do at any time. Things to do, which are the hardest and pile up.

The huggingface_hub cache-system uses symlinks by default to efficiently store duplicated files. To support symlinks on Windows, you either need to activate Developer Mode or to run Python as an administrator. #huggingface

In Windows, you can enable offline files for any SMB share via: Control Panel → Sync Center → Manage offline files and turn on the feature. Then, in File Explorer, right‑click the mapped network folder or drive and select "Always available offline."

Anger is a trigger for change. "Either change yourself or the environment, else you'll be uncomfortable."

Block notes is a notion like library for editor components. Converts to Markdown #html #markdown

duckdb -ui launches a DuckDB notebook. This is built into newer DuckDB releases #markdown

Monolith downloads web pages as a single HTML file by embedding content. #document-conversion #html #web-dev