Sun, Feb 25, 2024

• My view: LLMs are general purpose and more capable than SLMs. They'll win, like CPUs won over special-purpose chips. GPUs will optimize for LLMs and as usage grows, cost will fall. #gpu #llm-ops

• Andrej Karpathy's summary of sharp edges in tokenization uses tiktokenizer to explain: #markdown
  • Why LLMs can't be used for spelling
  • Why LLMs are better at English than other languages
  • Why LLMs are bad at math
  • Why SolidGoldMagiKarp is a single token
  • Why trailing spaces are bad
  • Why YAML tokenizes more efficiently than JSON

• All image-to-text models on HuggingFace #future #huggingface

• Architecture.md is an emerging standard #future #markdown

• Managing wealth requires training. #future #investment

• htmz is a fantastic way to load HTML into elements! #future #html #markdown #web-dev

• Suguna Poultry is
  • Using robots to walk in their farms, use sound and bird eyes and movement to predict birth health over 1-2 weeks
  • Light on the back of the bird's back AND face => lays eggs in 14 days, else takes days later (girls and mobile phones?)

• Teknoturf is using Gen AI to #ai-coding-tools #automation #prompt-engineering #tts
  • Improve prompts when teaching prompt engineering.
  • Pronounce languages better, identifying which words Tamilians and Malayalis will mis-pronounce.

• Explore IRBlaster. It can control AC and can automatically increase temperature at night.

• ssyoutube.com: Just add "ss" to "youtube.com" on the video and you can download YouTube videos

• Discussions with Sachin, AMAT
  • Microsoft said Indigo, Air India uses LLM based bookings
  • Meta invested $70bn in GPUs. Sam Altman is investing $7tn!
  • NVIDIA has a price PREMIUM not discount for bulk GPUs!
  • AMD is the next company to watch for
  • Numenta - Subutai Ahmad - deploys AI models on CPUs
  • #TODO Read A Thousand Brains by Subutai Ahmad
  • Sanjeev Sharma
    • Swaayatt Robots: Autonomous driving in India
    • Deepeigen: Education
  • Rohan Shravan, Bangalore.
    • Likes sharing knowledge. Amazing teacher. IIT KGP 2008. Interested in exploring quantum computing
    • Tresa Motors, Inkers App, The School of AI
  • AMAT is working on
    • photon-based computing.
    • science research models. AI for science. Like Google: Deepmind Genome, Microsoft: Metagen
    • quantum: AMAT is actively in into this. Nagapati Banda is driving this
  • John Kelly is predicting a ChatGPT moment in quantum in a few years

• Adobe express has a forever free video to GIF converter #document-conversion

• Edge workspaces let me keep the same tabs open across laptops!

• Command line interface guidelines #ai-coding-tools #dev

• RAWGraphs has a custom charts API that is worth learning from

• Python fastcore has decorators like @typedispatch, Self, etc. #markdown #python

• wddbfs mounts SQLite as a file system. I had a bit of trouble, maybe with Python package versions.

• Google is using LLM powered bug identification #github #llm-ops

• HuggingFace Chat Assistants has open source system prompts!! #future #huggingface

• OpenHermes training dataset is available. 1M prompts! #future

• Jio has made IPL free. They make money on data and ads. That's Scale!

• Daniel Dennett outsources thinking to students. Reviewing his books.
  • BUT: I don't take feedback. When someone sends a pull requests, I ignore it.