Sun, Aug 25, 2024

Weekly Notes and Discoveries | S Anand

An 8-year old uses Cursor.ai to code #ai-coding-tools #code-agents #future

Hermes 3 has special tokens like <SCRATCHPAD>, <RESTATEMENT>, <THOUGHT_*>, <PYDANTIC_SCHEMAS>, <SCHEMA_*>, <REASONING>, <INNER_MONOLOGUE>, <PLAN>, <EXECUTION>, <REFLECTION>, <THINKING>, <SOLUTION>, <EXPLANATION>, <UNIT_TEST>, etc. This extends the capability dramatically. #future

Lumentis creates docs from transcripts and text #document-conversion #future #github

LLMs write worse code in JSON than Markdown #ai-coding-tools #llm-ops #markdown

Copilot's system prompt calls a search_enterprise(query: str) tool and a hint(M365Copilot_language: str) tool as assistants. #code-agents #prompt-engineering

Anthropic Prompt Caching is 90% cheaper to use and 25% costlier to create. So if there's a 27% chance it'll be re-used, cache it. #optimization #prompt-engineering

Karya.in is creating high quality datasets. Suhel mentioned them