Sun, Feb 25, 2024

Weekly Notes and Discoveries | Recall | S Anand

My view: LLMs are general purpose and more capable than SLMs. They'll win, like CPUs won over special-purpose chips. GPUs will optimize for LLMs and as usage grows, cost will fall. #gpu #llm-ops

Andrej Karpathy's summary of sharp edges in tokenization uses tiktokenizer to explain: #markdown
- Why LLMs can't be used for spelling
- Why LLMs are better at English than other languages
- Why LLMs are bad at math
- Why SolidGoldMagiKarp is a single token
- Why trailing spaces are bad
- Why YAML tokenizes more efficiently than JSON

All image-to-text models on HuggingFace #future #huggingface #speech-to-text

Architecture.md is an emerging standard #future #markdown

Managing wealth requires training. #future #investment

htmz is a fantastic way to load HTML into elements! #future #html #markdown #web-dev

Suguna Poultry is
- Using robots to walk in their farms, use sound and bird eyes and movement to predict birth health over 1-2 weeks
- Light on the back of the bird's back AND face => lays eggs in 14 days, else takes days later (girls and mobile phones?)

Teknoturf is using Gen AI to #ai-coding #automation #prompt-engineering #speech-to-text #tts
- Improve prompts when teaching prompt engineering.
- Pronounce languages better, identifying which words Tamilians and Malayalis will mis-pronounce.

Explore IRBlaster. It can control AC and can automatically increase temperature at night.

ssyoutube.com: Just add "ss" to "youtube.com" on the video and you can download YouTube videos

Discussions with Sachin, AMAT #todo
- Microsoft said Indigo, Air India uses LLM based bookings
- Meta invested $70bn in GPUs. Sam Altman is investing $7tn!
- NVIDIA has a price PREMIUM not discount for bulk GPUs!
- AMD is the next company to watch for
- Numenta - Subutai Ahmad - deploys AI models on CPUs
- Read A Thousand Brains by Subutai Ahmad
- Sanjeev Sharma
  - Swaayatt Robots: Autonomous driving in India
  - Deepeigen: Education
- Rohan Shravan, Bangalore.
  - Likes sharing knowledge. Amazing teacher. IIT KGP 2008. Interested in exploring quantum computing
  - Tresa Motors, Inkers App, The School of AI
- AMAT is working on
  - photon-based computing.
  - science research models. AI for science. Like Google: Deepmind Genome, Microsoft: Metagen
  - quantum: AMAT is actively in into this. Nagapati Banda is driving this
- John Kelly is predicting a ChatGPT moment in quantum in a few years

Adobe express has a forever free video to GIF converter #document-conversion

Edge workspaces let me keep the same tabs open across laptops!

Command line interface guidelines #dev #faq

RAWGraphs has a custom charts API that is worth learning from

Python fastcore has decorators like @typedispatch, Self, etc. #markdown #python

wddbfs mounts SQLite as a file system. I had a bit of trouble, maybe with Python package versions.

Google is using LLM powered bug identification #github #llm-ops

HuggingFace Chat Assistants has open source system prompts!! #future #huggingface #speech-to-text #faq

OpenHermes training dataset is available. 1M prompts! #future

Jio has made IPL free. They make money on data and ads. That's Scale!

Daniel Dennett outsources thinking to students. Reviewing his books.
- BUT: I don't take feedback. When someone sends a pull requests, I ignore it.