Sun, Jun 2, 2024

Weekly Notes and Discoveries | Recall | S Anand

Combining vector search and keyword search with reciprocal rank fusion seems to work well for RAG. Ref #search

Some audio embedding models: #embeddings #speech-to-text #voice-cloning unoti/voice-embeddings, retkowsky/audio_embeddings, pyannote/embedding (for speaker similarity), and more.

I tried Undermind.ai - an agent that researches for you. It guides you to ask a detailed question, spends 2-3 minutes finding the answer, and provides detailed results. But it's worth the wait. It's a good alternative to quick validations on SciSpace. #future #search #faq #ask #post

For popular results, search actually makes results worse! When not to trust language models

Perception of fluency and usefulness are NEGATIVELY correlated in LLM! Evaluating Verifiability in Generative Search Engines #llm-ops

GPTs are now available to non paying users. Apparently for a few weeks! Everyone also has limited access to GPT-4o. #chatgpt

More LLM routers: #llm-ops
- LiteLLM: Open source, OpenAI compatible, 100+ LLMs
- RouteLLM: Open source, OpenAI compatible, automatically routes based on cost
- OpenRouter: OpenAI compatible API, several models
- Unify: Supports many models
- Portkey: Supports popular providers
- Martian: Limited set of models

d-id and Heygen can modify videos of a person.

Knowledge Project podcast. Morgan Housel #lesson
- Differences of opinion exist because of different stories arising from origins and experiences. We are not debating facts. We are debating life lessons!
- Solution: hear their anecdotes. The stories that taught them their lessons.

AI reporting templates are a trend. Domain expertise comes in via structuring the report template and associated prompts. #ai-coding #automation #code-agents

Hidden Brain podcast: Innovation 2.0: The power of less
- Subtraction is hard because we are biologically and economically wired against it. It's also hard because there are fewer markers of subtraction. Additions are natural markers / triggers.
- Marie Kondo suggests keeping only what sparks joy

Discussion with Anand
- Explore BBC Microbit
- Everyone should get a Raspberry Pi!
- Watch 2 minutes paper on YouTube