#document-conversion | Anand S - Things I Learned

Thu, Jan 2, 2025. Tools that convert files to prompt / Markdown suitable for LLMs: #ai-coding-tools #document-conversion #github #markdown
- uvx files-to-prompt
- npx git-ingest
- ingest - written in Go, only Mac/Linux binaries

Thu, Jan 2, 2025. uvx doc2docx converts Word .doc files to the new .docx format. I had several old .doc files that I converted. #document-conversion

Mon, Dec 23, 2024. Document to Markdown Converters: #document-conversion #markdown
- PyMuPDF4LLM uses MuPDF. Requires PyTorch.
  - PYTHONUTF8=1 uv run --with pymupdf4llm python -c 'import pymupdf4llm; h = open("pymupdf4llm.md", "w"); h.write(pymupdf4llm.to_markdown("SpreadsheetLLM-2407.09025v1.pdf"))'
- markitdown from Microsoft. PDF via PDFMiner, DOCX via Mammoth, XLSX via Pandas, PPTX via Python-PPTD, ZIP, etc.
  - PYTHONUTF8=1 uvx markitdown SpreadsheetLLM-2407.09025v1.pdf > markitdown.md
- Docling by IBM. Unable to install via pip on Windows AND on Linux.
- MegaParse uses libreoffice, pandoc, tesseract-ocr, etc. Requires OpenAI API key.

Sun, Dec 22, 2024. aspose-words is a Python library that converts documents with many formats (Word, RTF, PDF, HTML, Markdown, EPUB, etc.) #document-conversion

Tue, Nov 26, 2024. CloudFlare workers can bundle any kind of files, including text, data, and WASM. Docs #cloud #document-conversion #markdown

Mon, Nov 25, 2024. Crawl4AI and Firecrawl are tools / libraries to convert websites into LLM Friendly Markdown and extract structured data using LLMs. #ai-coding-tools #code-agents #document-conversion #html #llm-ops

Sat, Nov 23, 2024. A list of Markdown to Website converters on this thread: #document-conversion #github #html #markdown
- Jekyll - Ruby - 2008
- MkDocs - Python - 2014
- GitBook - JavaScript (Node.js) - 2014
- MkDocs Material - Python (MkDocs-based) - 2016
- Docsify - JavaScript - 2016
- MdBook - Rust - 2017
- Antora - JavaScript (Node.js) - 2017
- Docusaurus - JavaScript (React) - 2017
- JupyterBook - Python - 2019
- Keenwrite - Java - ~2019
- Honkit - JavaScript (GitBook fork) - 2019
- Nextra - JavaScript (Next.js) - 2020
- Astro - JavaScript/TypeScript - 2021
- Hugo Book - Go (Hugo-based) - ~2020
- Clowncar - JavaScript/Node.js - ~2021
- Quarto - R and Python - 2022
- Starlight - JavaScript/TypeScript - 2023

Wed, Nov 6, 2024. Docling by IBM converts PDF, DOCX, etc. to Markdown. Like PyMuPDF4LLM but better. #document-conversion #markdown

Sat, Sep 28, 2024. PyMuPDF4LLM can convert PDFs to Markdown. It handles tables, too. #document-conversion #llm-ops #markdown
- 04 Oct 2024. PDF-Extract-Kit does PDF layout, formula, table, and OCR extraction using various models.
- 04 Oct 2024. llmsherpa extracts PDF layout, tables, not OCR

Thu, Sep 12, 2024. Pixtral seems quite good at OCR #document-conversion #future

Tue, Aug 20, 2024. Lumentis creates docs from transcripts and text #document-conversion #future #github

Sun, Aug 11, 2024. DocxTemplater is SlideSense but open-core and handles DOCX as well! #document-conversion #html #markdown

Sun, Apr 14, 2024. llmsherpa extracts PDFs using LLMs. It has errors but it preserves hierarchy, extracts tables well, and retains image coordinates. Via +91 90031 35354 ~Vetrivel PS #document-conversion #llm-ops

Tue, Feb 20, 2024. Adobe express has a forever free video to GIF converter #document-conversion

Wed, Jan 3, 2024. Adobe Firefly offers a "generative fill" that lets you remove or paint new objects into an image. I'm awaiting text to vector images. #document-conversion #future #image-generation

Wed, Dec 27, 2023. Lica has a fascinating demo of how a document can be converted into a video story. #document-conversion

Sun, Dec 3, 2023. Microsoft released table-transformer to extract tables from PDFs. Sample usage #document-conversion

Sun, Dec 3, 2023. Convert PDF to markdown with marker - an improvement over nougat. #document-conversion #markdown

Thu, Nov 30, 2023. CoVA scrapes web pages via OCR #ai-coding-tools #code-agents #document-conversion

Sat, Nov 4, 2023. 04 Nov 2023: Seamless4MT does language and speech inter-conversion. CC-NC-BY license #document-conversion #tts #voice-cloning