#markdown | Anand S - Things I Learned

Fri, Jan 3, 2025. Redash and Metabase are new open source data visualization tools sitting alongside Grafana and Apache Superset. #markdown

Thu, Jan 2, 2025. Tools that convert files to prompt / Markdown suitable for LLMs: #ai-coding-tools #document-conversion #github #markdown
- uvx files-to-prompt
- npx git-ingest
- ingest - written in Go, only Mac/Linux binaries

Mon, Dec 23, 2024. Document to Markdown Converters: #document-conversion #markdown
- PyMuPDF4LLM uses MuPDF. Requires PyTorch.
  - PYTHONUTF8=1 uv run --with pymupdf4llm python -c 'import pymupdf4llm; h = open("pymupdf4llm.md", "w"); h.write(pymupdf4llm.to_markdown("SpreadsheetLLM-2407.09025v1.pdf"))'
- markitdown from Microsoft. PDF via PDFMiner, DOCX via Mammoth, XLSX via Pandas, PPTX via Python-PPTD, ZIP, etc.
  - PYTHONUTF8=1 uvx markitdown SpreadsheetLLM-2407.09025v1.pdf > markitdown.md
- Docling by IBM. Unable to install via pip on Windows AND on Linux.
- MegaParse uses libreoffice, pandoc, tesseract-ocr, etc. Requires OpenAI API key.

Mon, Dec 23, 2024. Em dashes are a strong sign of ChatGPT use. Curly quotes too. Reddit #chatgpt #markdown

Mon, Dec 16, 2024. markdown2 is the new de facto Markdown library for Python. #markdown

Sat, Dec 14, 2024. Roaming RAG is an alternative to RAG without the vector database. #markdown
- Applicable to well structured documents, e.g. technical books, manuals, etc.
- Create a hierarchical outline of the document. Code
  - Keep the top-level headings.
  - Preserve the first ~100 characters of opening text from each section.
  - Present the second-level headings, but without any subsidiary content.
  - Provide each section a unique 8 digit hex identifier.
  - Each section heading is followed by a guiding comment for the model: Section collapsed - expand with expand_section("{identifier}").
- Then read the relevant sections as context to answer the question. Code

Sat, Dec 14, 2024. **/*.md can search for all Markdown files. Julia Evans #markdown

Tue, Nov 26, 2024. CloudFlare workers can bundle any kind of files, including text, data, and WASM. Docs #cloud #document-conversion #markdown

Sat, Nov 23, 2024. A list of Markdown to Website converters on this thread: #document-conversion #github #html #markdown
- Jekyll - Ruby - 2008
- MkDocs - Python - 2014
- GitBook - JavaScript (Node.js) - 2014
- MkDocs Material - Python (MkDocs-based) - 2016
- Docsify - JavaScript - 2016
- MdBook - Rust - 2017
- Antora - JavaScript (Node.js) - 2017
- Docusaurus - JavaScript (React) - 2017
- JupyterBook - Python - 2019
- Keenwrite - Java - ~2019
- Honkit - JavaScript (GitBook fork) - 2019
- Nextra - JavaScript (Next.js) - 2020
- Astro - JavaScript/TypeScript - 2021
- Hugo Book - Go (Hugo-based) - ~2020
- Clowncar - JavaScript/Node.js - ~2021
- Quarto - R and Python - 2022
- Starlight - JavaScript/TypeScript - 2023

Fri, Nov 22, 2024. DuckDB has an LLMs.txt. #github #llm-ops #markdown Today, 38 repos on GitHub support it

Fri, Nov 22, 2024. Style of writing impacts output style a lot. E.g. Adding an evil laugh makes Claude more creative. Ethan Mollick #markdown

Fri, Nov 22, 2024. For good structured mode output, we need good prompting. #ai-coding-tools #code-agents #markdown #prompt-engineering
- Mentioning examples and schema and "JSON" helps. When providing examples, using [user, assistant] message pairs helps (I think it's because it's easier for the LLM to parse).
- Using a {reasoning, answer} schema (with reasoning first) helps. Make reasoning concise and relevant Ref Arxiv
- We already know code in JSON is not a great idea. Ref

Mon, Nov 18, 2024. You can enable syntax highlighting just using fonts. Ref #ai-coding-tools #github #html #markdown

Mon, Nov 18, 2024. HTML is all you need shows examples of using HTML for notebooks instead of Jupyter, Observable, etc. #html #markdown #web-dev

Mon, Nov 11, 2024. Pass a complex data structure to Claude.ai and have it create an app to visualize it. It does well. Simin Willison #automation #markdown

Fri, Nov 8, 2024. GraphRAG is better if data is naturally graph-structured. Else, it's slow and fills up the context window with even vaguely related stuff. Vigneshbabu, AMAT. #gpu #markdown

Fri, Nov 8, 2024. uithub converts GitHub repos to Markdown. Just replace "g" in "github.com/..." with "u". Example #github #markdown

Wed, Nov 6, 2024. Docling by IBM converts PDF, DOCX, etc. to Markdown. Like PyMuPDF4LLM but better. #document-conversion #markdown

Mon, Nov 4, 2024. Zed.dev is an AI code editor by the creators of Atom. It's written in Rust and is blazing fast. It has native AI integration. #ai-coding-tools #code-agents #dev #github #markdown

Thu, Oct 31, 2024. /llms.txt is a proposal to standardize /llms.txt files as a way to share LLM prompts. #llm-ops #markdown
- Jina AI Meta Prompt is an example
- Remotion system prompt is an example
- https://docs.fastht.ml/llms-ctx.txt
- https://docs.fastht.ml/llms-ctx-full.txt

Wed, Oct 30, 2024. structuredClone deep clones objects in JS #markdown

Sun, Oct 27, 2024. AI code editors are not good with large code bases today. Keep the refactoring exercises to below 1000 lines. Also evaluate the ease of setting it up locally #ai-coding-tools #code-agents #github #markdown

Fri, Oct 11, 2024. DuckDB lets you create functions = macros #future #markdown

Sun, Oct 6, 2024. Late chunking is an interesting approach to adding context to embeddings. (I don't understand it, but it's cheap and effective.) #embeddings #markdown

Sun, Oct 6, 2024. Marimo supports: #markdown
- Publishing any notebook to static.marimo.app as a static app
- Creating a SINGLE link that embeds the ENTIRE notebook in the URL!
- Runnable via uvx marimo edit

Fri, Oct 4, 2024. Software 2.0 by Andrej Karpathy. #ai-coding-tools #automation #dev #markdown #prompt-engineering
- This is fundamentally altering the programming paradigm by which we iterate on our software, as the teams split in two:
  - the 2.0 programmers (data labelers) edit and grow the datasets, while
  - a few 1.0 programmers maintain and iterate on the surrounding training code infrastructure, analytics, visualizations and labeling interfaces.
- Adaptive UI ideas:
  - Adaptive Fields: Show only required fields based on what the user field so far.
  - Smart Inputs: Dropdowns and auto-complete based on user's context.
  - Smart Themes: Change font size, contrast, theme guessing the user's age and preferences.
  - Dynamic Menus: Show what they might need to do next. Like Nokia's right button, but using LLMs.
  - Smart Tooltips: Check what the user's doing (delays, confusions, previous clicks, current actions) and show relevant tips.
  - Personalized Layout: Show only the relevant sections of the app. E.g. based on what they're doing.
  - Smart Charts: Create the right chart that solve the user's question.
- Adaptive Back-end
  - Dynamic APIs: Create endpoints on the fly based on user needs
  - Dynamic Indexing: Create & update indices on the fly based on user needs
  - Dynamic Schema: Create & update schema on the fly based on user needs
  - Dynamic Migration: Migrate to a new database or OS or language as required
  - Dynamic Queries: Create SQL/NoSQL queries to solve the user problem
  - Dynamic RBAC: Figure out who needs permissions and why. Add OR REMOVE access as required
  - Dynamic Logging. Log what's required. Explain why it's logged and what's happening. Fix code that raised the error
  - Dynamic Caching. Cache what's likely to be required. Evict what may not be required. Figure out cache keys.

Mon, Sep 30, 2024. Coders are more likely to edit LLM code. Non-coders don't have that bad habit. #ai-coding-tools #code-agents #dev #github #llm-ops #markdown
- Vaishnavi and Ranjeet edited code
- Indal and Koustav didn't

Sat, Sep 28, 2024. PyMuPDF4LLM can convert PDFs to Markdown. It handles tables, too. #document-conversion #llm-ops #markdown
- 04 Oct 2024. PDF-Extract-Kit does PDF layout, formula, table, and OCR extraction using various models.
- 04 Oct 2024. llmsherpa extracts PDF layout, tables, not OCR

Fri, Sep 20, 2024. Prompt engineering for code generators: #ai-coding-tools #code-agents #dev #future #markdown #prompt-engineering
- Claude Artifacts Prompt
- Val.Townie system prompt. Good example of how to create
- Cursor editing
- Cursor debugging
- Cursor conversation

Fri, Sep 20, 2024. XML tags seem best to structure prompts across LLMs. #ai-coding-tools #code-agents #llm-ops #markdown #prompt-engineering
- Claude
- OpenAI
- Gemini

Tue, Aug 27, 2024. Cursor uses speculative edits and a variety of other techniques to speed up code editing. #ai-coding-tools #future #markdown #prompt-engineering

Mon, Aug 19, 2024. LLMs write worse code in JSON than Markdown #ai-coding-tools #llm-ops #markdown

Mon, Aug 12, 2024. Code agent frameworks to explore: #ai-coding-tools #automation #code-agents #dev #future #github #markdown #prompt-engineering

Sun, Aug 11, 2024. DocxTemplater is SlideSense but open-core and handles DOCX as well! #document-conversion #html #markdown

Sat, Aug 10, 2024. Embedding models can be fine-tuned. Example: #TODO #embeddings #future #gpu #markdown #models #optimization #prompt-engineering

Wed, Jul 24, 2024. If LLMs can generate any text, and text can describe the real world, we can rapidly generate "artifacts" that generate: #markdown
- 3D Printable Models:
  - STL (Stereolithography): Defines the surface geometry of 3D objects using triangular facets.
  - OBJ (Wavefront OBJ): Describes 3D geometry including vertices, textures, and normals.
  - X3D: An XML-based file format for representing 3D computer graphics.
- Vector Graphics:
  - SVG (Scalable Vector Graphics): Defines vector-based graphics in XML format, useful for illustrations, diagrams, and user interface elements.
- CAD Drawings:
  - DXF (Drawing Exchange Format): Represents CAD data, including shapes, lines, and curves, used in engineering and architecture.
- Circuit Designs:
  - KiCAD: An open-source software suite for Electronic Design Automation (EDA), which uses various file formats like PCBNew and EESchema to represent circuit designs.
- Blueprints and Architectural Designs:
  - GML (Geography Markup Language): Encodes geographical features and spatial information.
  - CityGML: A specific GML application schema for modeling and exchanging 3D city models.
- Molecular Structures:
  - PDB (Protein Data Bank): Describes the three-dimensional structures of molecules.
  - CML (Chemical Markup Language): An XML-based standard for representing molecular data.
- Robotics and Automation:
  - URDF (Unified Robot Description Format): Defines the physical configuration of a robot, including joints, links, and sensors.
  - COLLADA (Collaborative Design Activity): An XML-based schema to describe digital assets for 3D applications, often used in robotics.
- Geospatial Data:
  - KML (Keyhole Markup Language): Used for geographic data visualization, primarily in Google Earth.
  - GeoJSON: A format for encoding a variety of geographic data structures using JSON.
- Mathematical Markup:
  - MathML (Mathematical Markup Language): Describes mathematical notation and captures both its structure and content.
- Music and Sound:
  - MusicXML: Encodes sheet music in a structured format that can be easily shared between different music notation software.
- Documents and Text:
  - DocBook: A semantic markup language for technical documentation.
  - Markdown: A lightweight markup language with plain text formatting syntax.
- Biological Data:
  - SBML (Systems Biology Markup Language): Represents computational models of biological processes.
  - PhyloXML: An XML format for representing phylogenetic trees.
- Game Development:
  - FBX (Filmbox): A file format for 3D animation that can hold information about the geometry, textures, and animations.
  - VRML (Virtual Reality Modeling Language): Describes interactive 3D objects and worlds.
- Data Visualization:
  - ChartML: Encodes charts and graphs in a structured format.
  - D3.js (Data-Driven Documents): Uses HTML, SVG, and CSS to bring data to life with interactive visualizations.
- Building Information Modeling (BIM):
  - IFC (Industry Foundation Classes): Describes building and construction data.
- Textiles and Fabrics:
  - LoomML: Represents the design and structure of woven fabrics.
- Augmented Reality and Virtual Reality:
  - ARML (Augmented Reality Markup Language): Defines how augmented reality applications should behave and what content they should display.
  - VRML (Virtual Reality Modeling Language): For describing interactive 3D objects and worlds.
- Medical Imaging and Health Data:
  - DICOM (Digital Imaging and Communications in Medicine): Encodes medical imaging data.
  - HL7 (Health Level 7): A set of standards for the exchange of information between medical applications.
- Simulation Data:
  - FMI (Functional Mock-up Interface): Represents and exchanges dynamic simulation models.
  - SBML (Systems Biology Markup Language): For computational models of biological processes.
- Sound and Audio:
  - MML (Music Markup Language): For encoding music notation and performance information.
  - SoundFont: A file format for defining musical instrument sounds.
- Animation and Visual Effects:
  - BVH (Biovision Hierarchy): Encodes motion capture data.
  - Alembic: A computer graphics interchange framework primarily for exchanging animation and visual effects data.
- Textile Patterns:
  - WIF (Weaving Information File): Describes weaving patterns and structures.
  - Knitting Markup Language: Encodes knitting patterns in a structured format.
- Scientific Data:
  - CDF (Common Data Format): Used for storing scientific data.
  - NetCDF (Network Common Data Form): Supports the creation, access, and sharing of array-oriented scientific data.
- Photography and Imaging:
  - XMP (Extensible Metadata Platform): Used for embedding metadata in digital images and other media files.
- Construction and Engineering:
  - LandXML: For civil engineering and land surveying data.
  - gbXML (Green Building XML): Facilitates the transfer of building data for analysis of energy and environmental performance.
- Packaging and Retail:
  - BPL (Barcode Product Labeling): Encodes information for product packaging and labeling.
  - GS1 XML: Used for electronic business messaging, including product identification and tracking.
- Typography and Font Design:
  - UFO (Unified Font Object): A format for storing font data.
  - SFNT (Spline Font): Encodes scalable font information.
- Product Data Management:
  - PLMXML (Product Lifecycle Management XML): Used for sharing product data across PLM systems.

Fri, Jul 12, 2024. Carlton's TDS session #markdown
- Always create a new venv via VS Code when starting a training session. Helps reproduce issues (though I could use Colab instead)
- Create an empty .ipynb notebook and double-click it. That's another way (though slower) to open a Jupyter notebook

Wed, May 22, 2024. Predibase lets you run fine-tuned models at the same price, on a per-token basis. 25c/MTok up to 21B models. That's sames as Claude 3 Haiku, but with fine-tuning. #markdown #pricing

Sun, Apr 28, 2024. ESLint's new flat configuration does not support package.json #markdown

Sun, Apr 14, 2024. Outlines generates structured test with LLMs. It uses the ⭐ logit_bias trick to limit choices in output. See get_choice() #llm-ops #markdown

Thu, Apr 11, 2024. VS Code #ai-coding-tools #code-agents #github #markdown
- Select any code and command Explain this to understand the code
- %something in command bar searches ACROSS files for a term. Exactly like Ctrl+Shift+F
- Copilot has an Inline Chat: Start in Terminal (that needed me to unbind Ctrl+I in bash to work)
- Ctrl+2 opens a second window on the side. Ctrl+1 goes back to the first window
- Terminal: Open Detected Link lets you scroll through detected (file) links in terminal
- Terminal sticky scroll is transparent. (But Terminal stick scroll isn't working for me.)
- Copilot uses last 10 commit messages, Jupyter notebook kernel state (variables) as additional context
- 1.88: supports locked scrolling to sync scrolling of side-by-side windows

Fri, Mar 29, 2024. Rust is non-trivial. Inspired by We are under DDoS attack and we do nothing, I "wrote" a small binary that serves a parquet file as JSON. It failed and I couldn't fix it. #github #markdown

Fri, Mar 29, 2024. spleeter is a better alternative to demucs. Splits audio into #markdown

Wed, Mar 27, 2024. Representational engineering lets you control LLM output based on preference on the fly. #future #llm-ops #markdown #models #prompt-engineering

Wed, Feb 28, 2024. SourceGraph is the default platform for private code completion & search #ai-coding-tools #code-agents #future #github #markdown

Sun, Feb 25, 2024. demucs does an EXCELLENT job of splitting songs into drums, bass, vocals and others #ai-coding-tools #dev #markdown

Sat, Feb 24, 2024. Architecture.md is an emerging standard #future #markdown

Fri, Feb 23, 2024. Andrej Karpathy's summary of sharp edges in tokenization uses tiktokenizer to explain: #markdown
- Why LLMs can't be used for spelling
- Why LLMs are better at English than other languages
- Why LLMs are bad at math
- Why SolidGoldMagiKarp is a single token
- Why trailing spaces are bad
- Why YAML tokenizes more efficiently than JSON

Fri, Feb 23, 2024. htmz is a fantastic way to load HTML into elements! #future #html #markdown #web-dev

Mon, Feb 19, 2024. Python fastcore has decorators like @typedispatch, Self, etc. #markdown #python

Fri, Feb 9, 2024. Fine-tuning session by Dan. Notebook #gpu #llm-ops #markdown
- Example of fine-tuning Mistral. Consumed ~~28 computes (~~$2.8)
- Axlotl is what the top fine-tuned LLMs are trained on
- Deepspeed provides distributed training
- Flash attention lets data stay on GPU
- Sample packing packs samples of different lengths into equal length tensors

Sun, Feb 4, 2024. Stephen Osserman's Observables have some nice notes. #markdown
- Visualizing partial election results
- D3 Force Dilemmas: Data Distortion

Sun, Feb 4, 2024. Sandra Becker's 30 day D3 course #future #markdown

Sat, Jan 13, 2024. Marimo is a reactive alternative to Jupyter notebooks that saves files as pure Python. #github #markdown #python

Sun, Jan 7, 2024. mixtral-offloading cleverly loads only the model layer required at any point, letting you run Mixtral 8x7b on Colab Free and on 16GB GPUs. This notebook runs on Colab Free too. #cloud #gpu #markdown

Sat, Dec 23, 2023. DPO is a simpler alternative to RLHF for fine-tuning. Several HuggingFace models use DPO for training #gpu #markdown

Sat, Dec 16, 2023. Github Copilot's new features makes your entire workspace or a specific file its context. It also auto-writes your commit messages and PR descriptions. #github #markdown #prompt-engineering

Sun, Dec 10, 2023. v0.dev creates web pages from code. Example. #dev #future #github #html #markdown #web-dev

Thu, Dec 7, 2023. 12 Tuning Strategies for RAG #markdown #optimization #prompt-engineering

Thu, Dec 7, 2023. CodeAnt.ai is a VS Code plugin to detect code smells, refactor for modularity, to write docstrings and unit tests #ai-coding-tools #code-agents #github #markdown

Sun, Dec 3, 2023. Convert PDF to markdown with marker - an improvement over nougat. #document-conversion #markdown

Sat, Nov 25, 2023. Learn ML optimization approach - LLMOps. Have an evaluation framework with metrics like weights and biases or tensorboard. Helps figure out where fine tuning helps and where RAG does. Soon, this will become important. #llm-ops #markdown #optimization

Mon, Nov 20, 2023. jsonrepair can fix JSON fairly well. jsonformer wraps HuggingFace models to produce JSON. Ref #huggingface #markdown

Sun, Nov 12, 2023. Pydantic is all you need drives towards code = data = text! #ai-coding-tools #future #markdown

Sat, Nov 4, 2023. 04 Nov 2023: Sparsify quantizes models #markdown

Mon, Oct 23, 2023. 23 Oct 2023: Bits & Bytes, QLORA, llama.cpp, BigDL, are ways of quantizing models that you can run directly in Google Colab. Try them. Also try OpenVino. #ai-coding-tools #github #gpu #markdown