Sun, Jan 5, 2025

uvx --python 3.9 --index https://download.pytorch.org/whl/cu121 whisperx --diarize --lang en --hf_token $HUGGINGFACE_TOKEN`

• Yes, the cost varies depending on the LLM. You can see costs and quality at https://llmpricing.straive.app/. The cost is measured in millions of tokens. For example, the Wikipedia page on the Bible is 100K tokens. You can paste text into https://platform.openai.com/tokenizer to count the number of tokens.Claude 3.5 Sonnet costs $3.5 / MTok, i.e. 35 cents for the Wikipedia Bible page. Gemini 1.5 Flash 8b costs $0.0375 / MTok, i.e. 0.375 cents for the same page. As you can see, the cost can vary by a factor of 100.

• uvx files-to-prompt
• npx git-ingest
• ingest - written in Go, only Mac/Linux binaries

• AgentRun: open source, via Docker
• e2b.dev. A day costs about $1 (on demand) and you get about $100 one time credits. Self-hosting is complex. Discussion

• LangFuse lets you build a self hosted LLM Proxy with API key distribution, logging, and SSO.
• Helicone does not support SSO

• Command-and-control hierarchy
• Taylorism: deep specialization
• Seniority-based advancement
• Annual performance reviews (without continuous feedback)
• Up-or-Out promotion models
• Confidential strategic information
• Narrow job descriptions
• Relying on formal authority

• Lead by example
• Fairness and empathy
• Clear, consistent communication
• Delegation and empowerment
• Strategic planning and foresight
• Consistent rule enforcement
• Rewarding merit
• Leadership by virtue and character

In the face of disruptive technologies, moats created by closed source are temporary. Even OpenAI’s closed source approach can’t prevent others from catching up. So we anchor our value in our team — our colleagues grow through this process, accumulate know-how, and form an organization and culture capable of innovation. That’s our moat.

Open source, publishing papers, in fact, do not cost us anything. For technical talent, having others follow your innovation gives a great sense of accomplishment. In fact, open source is more of a cultural behavior than a commercial one, and contributing to it earns us respect. There is also a cultural attraction for a company to do this.

Why is Silicon Valley so innovative? Because they dare to do things. When ChatGPT came out, the tech community in China lacked confidence in frontier innovation. From investors to big tech, they all thought that the gap was too big and opted to focus on applications instead. But innovation starts with confidence, which we often see more from young people.

• mitmproxy2swagger digs through the mitmproxy flows and generates an OpenAPI schema. A clever idea to reverse-engineer APIs.

• Add a daily habit to understand your ego. Where and how is it showing up? How are you fooling yourself? Where are you fighting battles without knowing the war?
• Speak less. Do more. E.g. Release more, blog less. Review, THEN publish.
• Always have a teacher, a student, and a peer to compete with. That's how you learn.
• "It is impossible for a man to learn what he thinks he already knows" - Epictetus.
• Passion makes you blind. Purpose and realism are less so. Delegate, take help, take feedback.

• git pull --recurse-submodules: Pulls parent repo along with submodules
• git submodule status: For each submodule, show current commit, path, and branch (if on a branch)
• git submodule update --init --recursive: Fetches/moves each submodule to the commit tracked by the parent repo