Sun, Aug 25, 2024

Weekly Notes and Discoveries | S Anand

Karya.in is creating high quality datasets. Suhel mentioned them

An 8-year old uses Cursor.ai to code #ai-coding #code-agents #future

Hermes 3 has special tokens like <SCRATCHPAD>, <RESTATEMENT>, <THOUGHT_*>, <PYDANTIC_SCHEMAS>, <SCHEMA_*>, <REASONING>, <INNER_MONOLOGUE>, <PLAN>, <EXECUTION>, <REFLECTION>, <THINKING>, <SOLUTION>, <EXPLANATION>, <UNIT_TEST>, etc. This extends the capability dramatically. #future

Lumentis creates docs from transcripts and text #document-conversion #future #github #speech-to-text

LLMs write worse code in JSON than Markdown #ai-coding #llm-ops #markdown #write

Copilot's system prompt calls a search_enterprise(query: str) tool and a hint(M365Copilot_language: str) tool as assistants. #code-agents #prompt-engineering

Anthropic Prompt Caching is 90% cheaper to use and 25% costlier to create. So if there's a 27% chance it'll be re-used, cache it. #optimization #prompt-engineering