#ai-coding-tools

• Sat, Apr 5, 2025. Notes from AI 2027. BTW, this is the most impactful piece I've read recently. It's been on my mind continuously for 36 hours. A bit distubring, too. #ai-coding-tools #code-agents #future
  • 2025: AI can act as autonomous agents, like Glean, Devin, Operator.
    • turn bullet points into emails
    • take instructions via Slack or Teams and make substantial code changes on their own
    • spend half an hour scouring the Internet to answer your question
  • 2026:
    • automating AI R&D is the biggest enabler for AI Labs
    • job market for junior software engineers is in turmoil
    • people who know how to manage and quality-control teams of AIs are making a killing
  • 2027:
    • potential demand for ~20,000 FTEs solving long-horizon tasks to train AI
    • every researcher/coder becomes the manager of an AI team
    • hiring new programmers has nearly stopped, but there’s never been a better time to be a consultant on integrating AI into your business

• Wed, Apr 2, 2025. No open source LLM-based tool handles live transcription and allows you to query notes so far during the transcription. The closest seems to be Meetily #ai-coding-tools #llm-ops #speech-to-text

• Wed, Apr 2, 2025. Learnings on AI code editors via Deep Research from ChatGPT, Gemini, Grok, Perplexity: #ai-coding-tools #code-agents #github #markdown #prompt-engineering
  • GitHub Copilot can identify the source of a code snippet as a repo. That helps with copyright issues.
  • Cursor uses a shadow workspace - a temporary sandbox where it edits files before applying changes at one shot.
  • Cursor auto-complete has context of other files, i.e. inserting an class in a .js file based on another HTML file's contents.
  • Windsurf seems to be best for large code bases and for large-scale refactoring. It can also run test results fix them.
  • Windsurf includes a browser and lets you click on an element and prompt to change its behavior, etc. That's good for front-end developers.
  • Roo Code can run scripts as part of the workflow, letting you run linting, tests, starting web apps, query databases, etc.
  • Roo Code lets you create persona, e.g. code reviewer, data storytelling and analysis, etc. with access to different tools and behaviors.
  • Roo Code does not support auto-complete.

• Sat, Mar 29, 2025. Discussion with Vedang #ai-coding-tools #code-agents #dev #github #llm-ops #markdown #prompt-engineering
  • Recurse center (Brooklyn, online) is a 6/12 week free self-driven programmer retreat. Runs every 6 weeks. You can do whatever you pick. There are daily standups for accountability. The groups are diverse. You can pair with them, pivot ideas, whatever. Principles: push yourself & learn.
  • Western education techniques (e.g. spaced repetition, adaptive learning) are very much present in Indian coaching systems, though not known by those names. However, interventions are hard since class 12 students just don't have enough time.
  • Coaching classes are a social phenomenon. It's not the smart students who are pulling in their friends. Smart students actually follow the popular students. (Coaching classes are below the typical smart students' standards.)
  • Monetizing coaching is hard. People don't want to pay for advice, and welcome free advice only if they ask for it. Coupling with execution is necessary.
  • Aider's integrations make it more powerful than Cursor/Windsurf. It auto-lints, runs test cases. Allows different models for "architecting" (generating changes) vs "editing" (applying code). It reads from the screen logs. Context is manual, not automated. Uses an ai! comment to trigger changes and ai? to ask questions.
  • Cline.bot is another Cursor-like open source AI code editor that's a VS Code plugin.
  • When coding with LLMs, a useful workflow is: data schema ➡️ interfaces ➡️ LLM-generated test cases ➡️ code.
  • ShellSage is a tmux based LLM tool for the command line. It screen-grabs from tmux, which is powerful.
  • Some MCPs that have proven useful: vega-lite, SQLite, sequential thinking, memory
  • make sucks but is hard to beat. just comes closest.
  • CRDTs are more powerful than for just collaborative editing. It can power a peer-to-peer Internet (beginning with office tools). Versioning schema is still problematic. yjs is a good start but automerge (Rust, WASM) is faster and may be better.
  • Fermyon hosts WASM serverless functions.

• Fri, Mar 28, 2025. 13 things I would have told myself before building an autorouter has a few interesting points: #ai-coding-tools #optimization
  • The A* algorithm finds the shortest path in a graph much quicker than others like Dijkstra's algorithm by preferring nodes closer to the goal.
  • Spatial Hash Indexing are O(1) and beat Tree Data Structures which are O(log n). Always prefer hashes when possible.

• Fri, Mar 28, 2025. There's an actual convention for using emojis in Git commits: gitemoji. It even has a VS Code plugin, a changelog generator, and more. #ai-coding-tools #github #markdown

• Fri, Mar 28, 2025. Notes from ThursdAI - Mar 27 #ai-coding-tools #chatgpt #gpu
  • Gemini 2.5 Pro has good instruction following despite long context. It automatically thinks for longer where required. Good at understanding large codebases. Very fast. You can upload a 2 hour audio to transcribe with timestamps.
  • ai.dev is the shortcut to Google AI studio.
  • ChatGPT native image generation is the best image generation model now. - Great character consistency AND prompt adherence thanks to autoregression and not using stable diffusion. - It tends to refuse image generation less than Dall-E. (While Ghibli-style is possible, Calvin and Hobbes strips are blocked.) "We added a refusal which triggers when a user attempts to generate an image in the style of a living artist." Addendum to GPT-4o System Card - A neat personalization implication is that you could put your kids into their favourite cartoon as a cartoon character that looks like them.
  • It's weird that the latest GPT 4o is ahead of GPT 4.5 on LM Arena.
  • The new DeepSeek V3 is about as good as GPT 4.5 and VERY cheap (27c), so is the obvious choice to run on OpenRouter.
  • MCP news:
    • Qwen.ai supports MCP in the UI! (But it's marked as "coming soon" in my case.)
    • Unlike tools, MCP uses servers that can remember the state or context. Tools are stateless.
    • MCP app store like Smithery, MCP.run, Glama, are mushrooming.
    • Awesome MCP Servers is another good starting point.
    • Azure lets you expose agents as MCP servers.
  • ChatGPT now uses semantic VAD. I interrupts less and typically when you have meaningfully complete something. It responds a little slower as a result.

• Thu, Mar 27, 2025. Notes from Writing with AI #ai-coding-tools #speech-to-text #voice-cloning
  • Personal writing with connection won't go away. AI can't give you heartbreak. But the rest of non fiction writing will vanish.
  • What AI is extraordinary at is personalizing to each audience member's interest
  • Outlier opinions will thrive among humans - since AI is trained on consensus.
  • Managers tend to be good at working with LLMs because it's mostly about delegation.
  • LLMs are perfect for things that don't have a wrong answer! -- Benedict Evans.
  • 💡 Explore arguing with AI. It's a safe way to get into a confrontational emotional state (which has its own benefits.)
  • 💡 Keep an LLM on in voice mode while reading and ask it any questions you have.
  • What models are good for what?
    • GPT 4.5 is great for creation - has a great sense of humor but a corporate style. Still, way better than GPT 4o.
    • ChatGPT is good for voice transcription and note taking. (Increasingly we take notes for AI rather than ourselves.)
    • Claude 3.7 has the best style of writing. It's also great for drawing charts.
    • O1 Pro and Deep Research is great for consumption - research.
    • Grok is the least corporate, able to argue with you, and the latest knowledge cutoff.
    • ElevenLabs for editing podcasts in your voice, making corrections.

• Tue, Mar 25, 2025. Cursor with Claude 3.7 Max seems surprisingly good at generating multi-page sites at one shot. Potentially, it can edit large repositories of code as well at one shot. If that's the case, the way we write code will require higher order thinking skills: broad sweeping changes rather than micro edits. #ai-coding-tools #code-agents #dev #github #html #markdown #prompt-engineering #web-dev

• Sat, Mar 15, 2025. SemGrep is a lot less open source than it used to be. ChatGPT. That's a pity. It was a good tool. #ai-coding-tools #chatgpt #github

• Sat, Mar 15, 2025. Here's a sample CI/CD pipeline with automated code review. #ai-coding-tools #github #gpu
  • Here is the script that generated it.
  • Note the use of NVIDIA's GPU Docker containers via nvcr.io

• Fri, Mar 14, 2025. Twine (docs) is an open source interactive fiction / story writing tool. #ai-coding-tools #github #markdown #tts
  • Snowman is a browser-based Twine 2 story template format.
  • These enable behavioural experimentation. Cheaper than using tools like Gorilla.sc and Pavlovia for behavioral experiments
  • For example, you can present a social or political issue and see if people change their opinions more or less depending on the content/path they see. Or, if it varies by demographics. Or, check if repeated mentions or emotional hooks improve memory / retention. More research ideas

• Fri, Mar 14, 2025. For LLM UIs, Open Web UI seems most popular. Run via WEBUI_SECRET_KEY=... uvx --python 3.11 open-webui serve #ai-coding-tools #llm-ops #web-dev Text generation Web UI is less so. KoboldAI, LMQL, LM Studio, GPT4All, etc are far behind.

• Fri, Mar 14, 2025. Apify is a cloud scraper platform. Here's how they optimize their AI Web agent - Source: #ai-coding-tools #automation #code-agents #html #optimization #prompt-engineering #web-dev
  • Remove redundant tags and attributes (e.g. accessibility, etc.). Explore readability.
  • Add a unique gid to each element.
  • Add the screenshot WITH a "Set of Marks" - "SoM" (read research paper) highlighting important clickable elements.
  • Code output is brittle. Use tools / DSL - e.g. visit_url(url), click_element(text, gid, tagName), etc.

• Fri, Mar 14, 2025. GenAIScript increasingly looks like a promising way to automate LLM workflows in the browser. #ai-coding-tools #automation #code-agents #future #github #llm-ops

• Thu, Mar 13, 2025. Marp is my new favorite way to generate slides from Markdown. Reveal.js is not easy with Markdown (though HTML works well.) #ai-coding-tools #github #markdown
  • The VS Code plugin makes development very easy
  • Marp CLI makes deployment easy.
  • I used it for my talk on LLM Hallucinations (source).
  • Supports all bespoke features and plugins
  • Transitions. Requires OS animation effects to be enabled
  • Animated SVG backgrounds are a good add-on.

• Tue, Mar 11, 2025. People are reporting that Roo Code is better than Windsurf. #ai-coding-tools #github
  • Roo Code is open source. Available as a VS Code extension and run-nable via git clone
  • Roo Code supports Computer Use. It can read files, take screenshots from a built-in browser, controls it, and reads browser console logs.
  • Opinions are mixed. A team member reported that it takes 10 LLM queries to do what Cursor does in 2. Another reported that it does in 1 query what Cursor does in 2.

• Mon, Mar 10, 2025. Notes from Thursday AI, 6 Mar 2025 #ai-coding-tools #voice-cloning
  • Google's AI overviews now use Gemini 2.0. They've introduced an AI mode that functions like a mini deep research tool, incorporating planning and search. (A Perplexity-killer). It's a fine-tuned model that is extra cautious with topics like healthcare and always verifies information.
  • QWQ from Quen competes with DeepSeq R1, but with only 32b parameters compared to R1's several hundred billion.
  • AI models are becoming less restrictive. Gemini and GPT-4.5 have relaxed some constraints, shifting more responsibility onto users, similar to Grok.
  • What's GPT-4.5 good for? It seems to excel in creativity, humor, education, emotional intelligence, and teaching. It follows instructions better and understands intent better. However, it's not a major leap in coding or math.
  • OpenAI's Deep Research mode always uses O3, regardless of the model selected in the UI.
  • Tencent has released a new video model available at https://aivideo.hunyuan.tencent.com/ and it appears to be quite good.
  • Many clients now support Model Context Protocol (MCP), including Cursor, Claude Code, and Claude Desktop. The clients list is long. Some MCP uses include:
    • Interact with GitHub using the GitHub API.
    • Using Knowledge Graph memory to premember previous conversations
    • Using the Cloudflare MCP server to perform Cloudflare actions.
    • File retrieval and custom prompts -- which MCP supports in addition to tools.
    • Calling other MCPs or LLMs (conditionally) from an MCP, enabling the creation of full-fledged workflows.
  • Composio offers a Hosted MCP service. CloudFlare lets you build remote MCP servers.
  • Notagen is an open-source note generation engine that produces high-quality classical sheet music.
  • Sesame has an open-source voice model worth exploring.
  • DiffRhythm is a music generation model that appears to be quite good.

• Sun, Mar 9, 2025. uv tool install and uv tool ensure-path are useful commands for installing and ensuring path for tools. Simon Willison #ai-coding-tools

• Sat, Mar 8, 2025. I agree with almost every point on this LinkedIn post on scoring candidates for AI roles. Rob Balian #ai-coding-tools #code-agents
  • Uses DeepSeek R1 or Claude 3.7 +5 points
  • Uses Langchain -5 points
  • Uses Langgraph +5 points (I don't know enough to comment)
  • Built a RAG in 2023 +3 points
  • Built a RAG in 2025 -3 points
  • "pinecone" -5 points (I don't know enough to comment)
  • "What is cursor" - 50 points no coming back from this
  • Uses Cursor composer +10 points
  • "You don't need a full agent for this" +5 points
  • Did hackathons to learn AI outside of work +5 points
  • "We probably need to fine tune for this" -3 points unless you can explain why
  • "Gemini is making a comeback" +3 points (I have a soft spot for Gemini)
  • +3 points each for mentioning reasoning trace, structured outputs, MCP, chain-of-thought, prompt caching, TPM limits

• Fri, Mar 7, 2025. Mistral released an impressive OCR model. #ai-coding-tools #document-conversion #github #gpu #markdown
  • Marker from DataLab seems comparable.
  • MinerU convert medical textbooks to Markdown well.
  • Gemini Flash may be more cost effective and better

• Mon, Mar 3, 2025. Notes from AI Engineering Summit, NY, Day 1 #ai-coding-tools #automation #code-agents #prompt-engineering
  • An agent requires 3 things: a router, tools or skills, and memory.
  • Agents are often sequential, but sometimes parallel execution makes sense for independent tasks that you consolidate.
  • Always allow LLMs the option of NOT answering a question if there is no good answer.
  • Focus prompts on the happy path. Use guard rails for edge cases.
  • Here are a few "tools" an agent would need to call:
    • Clarification from user
    • Saving to memory
    • Google search
    • Edit a file introducing SPECIFIC changes
    • Search in codebase using embeddings
    • Run scripts on the shell or in a REPL (Python, Node, etc.)
    • Run code in a new container for isolation
    • Automatically discover, read an API documentation and use it
  • Modify environment to enable logging and other system changes.
  • When code is cheap, you can explore more ideas and hence design and product management need to approach things differently. We also need to reaching testing completely because it makes very different kinds of mistakes and we don't often have an intuition
  • You can have an agent explore all the issues and full request and recent comments against the repository and summarise it for the project manager

• Sun, Mar 2, 2025. YayText converts text to Unicode that has strikethrough, bold, italics, alternate fonts, and other interesting features. So does #ai-coding-tools #speech-to-text #tts Unitextify, ConvertCase, and LingoJam.

• Sun, Feb 23, 2025. VS Code can be used as a code executor by adding {"key": "shift+enter", "command": "workbench.action.terminal.runSelectedText", "when": "editorFocus"} to the keybindings.json file. Press Shift-Enter to run the selection on the terminal. Useful for DuckDB, SQLite, etc. Ref #ai-coding-tools #dev #markdown

• Tue, Feb 18, 2025. I subscribed to ChatGPT Pro mainly for DeepResearch. Here are the reports I've generated: #ai-coding-tools #best-practices #code-agents #llm-ops
  1. uv Package Manager Overview
  2. DuckDB Analytics Comparison
  3. Rust vs Python / JavaScript
  4. Modern Data Engineering Course
  5. LLM Code Migration Practices
  6. Cloud Cost Optimization Strategies
  7. LLM Coding Interview Tools Report (compare with Perplexity)
  8. Text To Speech Engines
  9. Customer Service in Indian Public Sector Banks
  10. LLMs in Software Development
      • Old version 1: Gen AI in Software Development
      • Old version 2: Gen AI in Software Development
  11. Leadership Training Content
  12. Open-Source HTTP Servers. Caddy wins.
  13. Deep Research Use Cases
  14. Nagpur No-Parking Violations
  15. Data Science in Food Services
  16. Deep Research Disruption to Research Firms
  17. LLMs in Design Thinking
  18. EU Taxonomy Report Clarification
  19. Shell Valuation Analysis Inquiry
  20. LLMs in DSLs Research
  21. Public API-Based Data Storage Options. Supabase wins.
  22. Front-End JS Frameworks Analysis
  23. Database Evaluation Guide
  24. CSS Frameworks Evaluation Guide
  25. CI/CD Tooling Ecosystem Report
  26. Color Names Count
  27. S Anand Biography. Meh, I know more about me, and it gets a few things wrong.
  28. Cosmere Secrets Encyclopedia. This is the best. Deep Research is great if it's stuff I actually want to read, rather than just learn about.
  29. DBT course
  30. Future of Coding AI
  31. Claude Artifacts Use Cases. This is the only one that managed to get artifacts links correct. I used this for an article for The Hindu.
  32. MCP Servers and Clients Research. Learnings:
      • Practically any "tool" can be an MCP server: file systems, APIs, codebases, browsers, collaboration platforms, memory, etc.
      • Most platforms have (or are) integrating MCP.
      • Clients: code editors, chat, and automation tools support MCP. GenAIScript is a good starting point.
      • Tester MCP Client is a browser-based test environment.
      • mcp-cli-client is a CLI-based client
      • mcp-chatbot is a chatbot client
  33. Data Moats by Industry
  34. Attorney Profile Research
  35. Social Media Data APIs
  36. Adobe Software Alternatives
  37. LLM Hallucination Visualization Techniques
  38. API vs Self-hosting Cost Analysis: Always use APIs, avoid self-hosting models.
  39. AGI Preparation
      • AGI will emerge step by step. Knowing which step is next will help
      • AI native organisations will emerge in each of these areas. AI design agencies and AI creative Agencies being one example
      • Networking, empathy, leadership have more value now. So will human AI bridging roles
      • What's the value of one human when another human can do practically everything they can but much better? Or a drama or a sport?
  40. Modern digital note taking
      • Voice note taking is the game changer
      • Automatically popping of notes based on context such as people places or conversations will be a thing
  41. Local LLM Search Tools
  42. Blog Post to research paper on copying - suggestions
  43. Linux Dev Migration Guide
  44. Raspberry Pi SIM options
  45. Linux Dev migration guide
  46. HTML to JATS conversion
  47. LLM context splitting strategies
  48. Strategy for AI services in Publishing
  49. Gemini multi model editing use cases by industry
  50. Pharma Conference Participation Guide
  51. Funding Open Source Initiatives
  52. SEBI IPO Acquisition Guidelines
  53. Approximate Similarity Matching Databases
  54. Low-Risk LLM Use Cases
  55. AI Coding Tools Report. Also via Gemini, Grok, Perplexity
  56. Impact of US Tariffs. Mixed impact on India. Imports & oil might become cheaper. Electronics, gems, textile, auto exports could drop - but textile & other demand might pick up from elsewhere. Demand could also grow where China is more impacted.

• Sun, Feb 16, 2025. Interview Coder is a desktop app that offers live interview support for coding interviews. It's a transparent window that reads your screen and answers questions for you. (Given this, I think we need an interviewer support system that tells interviewers what to ask!) #ai-coding-tools #code-agents #prompt-engineering

• Thu, Feb 13, 2025. I switched to fish shell mainly because: #ai-coding-tools #github #html #markdown
  • Autocomplete and tab completion works perfectly, out-of-box.
  • Syntax highlighting is beautiful
  • Great multi-line editing

• Mon, Feb 10, 2025. Flipper Zero is now on my list of "To Buy" tools. It has a variety of hardware devices including NFC, RFID, Bluetooth, Infrared, etc. and is great to reverse engineer or hack devices. #ai-coding-tools

• Sun, Jan 26, 2025. A WebAssembly compiler that fits in a tweet deconstructs a piece of JS that creates a tiny WebAssembly calculator. It's a great walk-through of JavaScript compression tricks and how WebAssembly works. Simon Willison #ai-coding-tools #html #web-dev

• Sun, Jan 12, 2025. GitHub CodeSpaces seems to be coming up more often in my radar, but I'm yet to figure out a use for it. #ai-coding-tools #cloud #future #github #markdown

• Sat, Jan 11, 2025. Measuring developer productivity with the DX Core 4 is a framework for measuring developer productivity. It encapsulates other frameworks like DORA, SPACE, and DevEx. #ai-coding-tools #best-practices #dev #markdown

• Sat, Jan 11, 2025. Can LLMs write better code if you keep asking them to “write better code? A delightful exploration of how Claude 3.5 Sonnet keeps optimizing and adding features to improve code. My takeaway: repeatedly applying a prompt gives us interesting new directions to explore. #ai-coding-tools #code-agents #llm-ops #markdown #optimization #prompt-engineering

• Sat, Jan 4, 2025. mitmproxy is an open source tool to intercept, modify, and replay HTTP requests. An alternative to Charles, Fiddler, and partly WireShark. Guide. Like the others, it requires installing a trusted root certificate on your machine. #ai-coding-tools #prompt-engineering
  • mitmproxy2swagger digs through the mitmproxy flows and generates an OpenAPI schema. A clever idea to reverse-engineer APIs.

• Fri, Jan 3, 2025. Matomo, PostHog, Umami and Plausible are open source web analytics tools (like Google Analytics). #ai-coding-tools

• Thu, Jan 2, 2025. Tools that convert files to prompt / Markdown suitable for LLMs: #ai-coding-tools #document-conversion #github #markdown
  • uvx files-to-prompt
  • npx git-ingest
  • ingest - written in Go, only Mac/Linux binaries

• Wed, Jan 1, 2025. LLM Code Execution Sandboxes that let you run code in a sandbox via an API: #ai-coding-tools #cloud #code-agents #github #llm-ops
  • AgentRun: open source, via Docker
  • e2b.dev: A day costs about $1 (on demand) and you get about $100 one time credits. Self-hosting is complex. Discussion
  • nsjail: by Google. Write your own API

• Thu, Dec 26, 2024. aisuite by Andrew Ng is a unified interface to LLMs. Sort of like an openai library across multiple providers. #ai-coding-tools #llm-ops

• Thu, Dec 26, 2024. Learnings from Best of 2024 in Agents (from #1 on SWE-Bench Full, Prof. Graham Neubig of OpenHands/AllHands) #ai-coding-tools #code-agents #dev #github #prompt-engineering
  • Passing code execution as a tool is more powerful than granular tools. You combine multiple tools and tool calls into one. You move code to the data rather than the other way around. Mostly, you need bash, Python (or Jupyter), file manager, web browser.
  • UI: Go where the user is, instead of bringing them to you.
  • A remote runtime is a critical component.
  • Claude 3.5 Sonnet (20241022) and Claude 3.5 Haiku (20241022) perform best on SWE Bench, followed by Deepseek V3, then O1 2024-12-17. X

• Mon, Dec 23, 2024. Medical coding is an area ripe for LLMs. #ai-coding-tools #code-agents #llm-ops
  • Ojasvi Yadav created a repo that uses hierarchical classification (rather than embeddings) to find the right coding.
  • Gemini models seem to understand medical terms better than others.
  • RapidClaims, funded by TogetherAI, is apparently working on this problem.

• Sun, Dec 22, 2024. Examples of agentic AI #ai-coding-tools #automation #code-agents #llm-ops #prompt-engineering
  • Text-to-SQL automated business analyst: A system that generates SQL queries from natural language, handles errors, creates visualizations, and includes a FAQ component. The author calls it "constrained agentic AI."
  • Data source querying system: A bot that queries multiple SQL and API data sources, selecting tools and reformulating tasks as needed.
  • Cursor (agentic mode): An LLM-powered VS Code fork that chains together various LLM capabilities (code generation, applying changes, linting suggestions, terminal commands, codebase RAG) to reduce user prompts.
  • Vulnerability finding system: A system that uses LLM agents to discover novel vulnerabilities in open-source web applications. The agents leave traces of their actions.
  • Marketing strategy generation system: A system using approximately 60 agents to generate marketing strategies.
  • Restaurant finder: A system that searches for restaurants based on dietary preferences and group size, and downloads social media information.
  • Proofreading and editing of transcripts: LLM agents apply specific customer requirements to transcripts after human editing.
  • Meeting notes and action items generator: A system that generates meeting notes and action items.
  • O'Reilly auto parts customer service agent: An agent demonstrated using RAG.
  • UI enhancement agent: An agent that added features like language locales and dark mode to a UI.

• Sat, Dec 21, 2024. Anthropic defines agents. Building effective agents + Cookbook #ai-coding-tools #automation #code-agents #llm-ops #prompt-engineering
  • Augmented LLMs are LLMs enhanced with augmentations such as retrieval, tools, and memory.
  • Workflows are systems where LLMs and tools are orchestrated through predefined code paths.
    • Prompt chaining: Pipe each LLM output to the next LLM. E.g. Write report, then translate. Extract results, then verify them. Successively ask follow-up questions.
    • Routing: One LLMs decides which other LLM to call next. E.g. Evaluate complexity, then pick the right model. Classify request time, then pick the right prompt.
    • Parallelize: Sectioning: Break tasks into independent subtasks, then aggregate. E.g. Evaluate contracts against different clauses in parallel.
    • Parallelize: Voting: Run same task multiple times, then vote. E.g. Review code for prompt injection using different prompts. Evaluate content safety with different thresholds.
    • Orchestrator-workers: One LLM delegates to others, then syntheisizes. E.g. Search from multiple sources, then synthesize. Change multiple code files.
    • Evaluator-optimizer: One model checks another in a loop. E.g. Literary translation. Self-healing code. Policy violation checks.
    • Human-in-the-loop Checkpoints: The workflow explicitly requests human review at certain stages.
  • Agents are LLMs that dynamically direct their own processes and tool usage, consulting tools or the user as needed.

• Fri, Dec 6, 2024. Arena Hard is a set of hard prompts to test LLMs. Here is the code and evaluation #ai-coding-tools #llm-ops

• Wed, Nov 27, 2024. I tried LIDA from Microsoft, after almost a year of its release. A few notes: #ai-coding-tools #gpu
  • Just running uvx lida ui --port 8080 --docs works.
  • But I needed to use export TCL_LIBRARY=C:/Users/Anand/AppData/Roaming/uv/python/cpython-3.13.0-windows-x86_64-none/tcl/tcl8.6 to point it to my TCL installation for charts to work. I also chose to export OPENAI_BASE_URL=https://llmfoundry.straive.com/openai/v1
  • I also chose to replace gpt-3.5-turbo-0301 (the default model) with gpt-4o-mini in lida/web/ui/component*
  • It's quite impressive.

• Wed, Nov 27, 2024. I spoke at Automating Data Visualizations using LLMs at SUTD. Apparently, using LLMs to write code is much more common than writing code to use LLMs. I ran a quick quiz. #ai-coding-tools #llm-ops
  • Have you used ChatGPT or any LLM? 35 / 35 raised their hands.
  • Have you written code using an LLM? 34 / 35 raised their hands. (I was impressed.)
  • Have you uploaded a spreadsheet to an LLM for analysis? 15 / 35 raised their hands.
  • Have you programmatically called an LLM API? 6 / 35 raised their hands.

• Mon, Nov 25, 2024. Crawl4AI and Firecrawl are tools / libraries to convert websites into LLM Friendly Markdown and extract structured data using LLMs. #ai-coding-tools #code-agents #document-conversion #html #llm-ops

• Sat, Nov 23, 2024. OpenAI lets you download GPT instructions and execute arbitrary code in their containerized environment. This is not a bug. Ref #ai-coding-tools #chatgpt #code-agents #github #prompt-engineering

• Fri, Nov 22, 2024. For good structured mode output, we need good prompting. #ai-coding-tools #code-agents #markdown #prompt-engineering
  • Mentioning examples and schema and "JSON" helps. When providing examples, using [user, assistant] message pairs helps (I think it's because it's easier for the LLM to parse).
  • Using a {reasoning, answer} schema (with reasoning first) helps. Make reasoning concise and relevant Ref Arxiv
  • We already know code in JSON is not a great idea. Ref

• Mon, Nov 18, 2024. You can enable syntax highlighting just using fonts. Ref #ai-coding-tools #github #html #markdown

• Sat, Nov 9, 2024. Google counts auto-completion when saying "25% of all the code is written by AI at Google". "It's a helpful productivity tool but it's not doing any engineering at all. It's probably about as good, maybe slightly worse, than Copilot." YCombinator #ai-coding-tools #code-agents #prompt-engineering

• Fri, Nov 8, 2024. Here are some approaches to large-scale classification of medical codes. ChatGPT #ai-coding-tools #code-agents
  • Fine-Tuning LLMs on Medical Data: Enhance LLMs by training them on medical datasets, such as clinical notes and discharge summaries, to improve their understanding of medical terminology and context.
  • Multi-Agent Frameworks: Implement a multi-agent system that simulates real-world coding processes with distinct roles (e.g., patient, physician, coder, reviewer, adjuster). Each agent utilizes an LLM to perform specific functions, enhancing interpretability and reliability. ArXiv
  • Retrieve-Rank Systems: Develop a two-stage system where the LLM first retrieves potential ICD-10 codes and then ranks them based on relevance, improving precision in code assignment. ArXiv
  • Embedding-Based Approaches: Use LLMs to generate embeddings for ICD-10 codes and medical texts, facilitating the matching of texts to appropriate codes through similarity measures. GitHub
  • Hierarchical Classification: Leverage the hierarchical structure of ICD-10 codes by first classifying texts into broader categories before assigning specific codes, reducing complexity and improving accuracy. ArXiv
  • Two-Stage Verification Models: Combine LLMs with verification models, such as Long Short-Term Memory (LSTM) networks, to validate and refine the codes suggested by the LLM, balancing recall and precision. ArXiv
  • Also, a mixture of models approach might work. Feed any existing NLP model / rules as a second opinion.

• Mon, Nov 4, 2024. Zed.dev is an AI code editor by the creators of Atom. It's written in Rust and is blazing fast. It has native AI integration. #ai-coding-tools #code-agents #dev #github #markdown

• Mon, Oct 28, 2024. Pragmatic Podcast (I forgot which one) #ai-coding-tools #automation #code-agents #future #github #prompt-engineering
  • Automate changelogs for your codebases. Convert past commits into attractive release notes automatically
  • AI is going to be the consumer of many tools and logs. Build converters for these
  • Speed of validation such as linting, testing, etc. will allow LLMs to iterate faster and WILL become more important

• Sun, Oct 27, 2024. AI code editors are not good with large code bases today. Keep the refactoring exercises to below 1000 lines. Also evaluate the ease of setting it up locally #ai-coding-tools #code-agents #github #markdown

• Thu, Oct 24, 2024. Gemini has a code execution API! #ai-coding-tools #code-agents

• Sun, Oct 20, 2024. Replit is good for hobbyists, Cursor for developers, and Pythagora & Bolt for non-developers building business apps. Ref #ai-coding-tools

• Mon, Oct 14, 2024. How AI can improve education performance and engagement. Ref #ai-coding-tools #future #prompt-engineering
  • Student: Create study plan based on course and schedule
  • Student: Focus on what you need to learn more
  • Student: Align with your study style and pace
  • Teacher: Grading MCQs
  • Teacher: Writing conceptual guides
  • "New collar workers" was coined by Ginny Rometty
  • Embed tutor or document in video and ask for clarification! This is a new embedded interface. #TODO

• Mon, Oct 7, 2024. GitHub co-pilot workspaces let you code using your mobile with AI and deploy it at one shot #ai-coding-tools #future #github

• Sun, Oct 6, 2024. Continue.dev is another AI coding editor. It supports OpenRouter. So now I have heard good things about: #ai-coding-tools #code-agents #dev #github #prompt-engineering
  • Github Copilot
  • Cursor
  • Cody
  • Continue.dev (supports OpenRouter)
  • Aider (supports OpenRouter)
  • Maybe:
    • Codeium
  • Not:
    • Amazon Q Developer

• Fri, Oct 4, 2024. Software 2.0 by Andrej Karpathy. #ai-coding-tools #automation #dev #markdown #prompt-engineering
  • This is fundamentally altering the programming paradigm by which we iterate on our software, as the teams split in two:
    • the 2.0 programmers (data labelers) edit and grow the datasets, while
    • a few 1.0 programmers maintain and iterate on the surrounding training code infrastructure, analytics, visualizations and labeling interfaces.
  • Adaptive UI ideas:
    • Adaptive Fields: Show only required fields based on what the user field so far.
    • Smart Inputs: Dropdowns and auto-complete based on user's context.
    • Smart Themes: Change font size, contrast, theme guessing the user's age and preferences.
    • Dynamic Menus: Show what they might need to do next. Like Nokia's right button, but using LLMs.
    • Smart Tooltips: Check what the user's doing (delays, confusions, previous clicks, current actions) and show relevant tips.
    • Personalized Layout: Show only the relevant sections of the app. E.g. based on what they're doing.
    • Smart Charts: Create the right chart that solve the user's question.
  • Adaptive Back-end
    • Dynamic APIs: Create endpoints on the fly based on user needs
    • Dynamic Indexing: Create & update indices on the fly based on user needs
    • Dynamic Schema: Create & update schema on the fly based on user needs
    • Dynamic Migration: Migrate to a new database or OS or language as required
    • Dynamic Queries: Create SQL/NoSQL queries to solve the user problem
    • Dynamic RBAC: Figure out who needs permissions and why. Add OR REMOVE access as required
    • Dynamic Logging. Log what's required. Explain why it's logged and what's happening. Fix code that raised the error
    • Dynamic Caching. Cache what's likely to be required. Evict what may not be required. Figure out cache keys.

• Fri, Oct 4, 2024. Aider LLM Leaderboards show which LLMs code better. As of now, #ai-coding-tools #github #llm-ops
  • o1-preview > claude-3.5 sonnet on code editing
  • claude-3-opus > claude-3.5-sonnet on code refactoring
  • deepseek-coder-v
  • gpt-4o-mini sucks.

• Mon, Sep 30, 2024. Coders are more likely to edit LLM code. Non-coders don't have that bad habit. #ai-coding-tools #code-agents #dev #github #llm-ops #markdown
  • Vaishnavi and Ranjeet edited code
  • Indal and Koustav didn't

• Sun, Sep 29, 2024. "You have to put in a lot of work to become productive at AI coding." Simon Willison #ai-coding-tools

• Sat, Sep 28, 2024. API coding best practices Source via Simon Willison: #ai-coding-tools #best-practices #github #prompt-engineering
  • Always add screenshots to the Readme. They never break.
  • Always add every example. Human think in examples.
  • Avoid defaults and be explicit unless 99% of the usage is with the default.
  • Make the feedback loops incredibly fast.
  • Make deprecations easy for users to deal with.
  • Keep objects immutable.

• Fri, Sep 20, 2024. Prompt engineering for code generators: #ai-coding-tools #code-agents #dev #future #markdown #prompt-engineering
  • Claude Artifacts Prompt
  • Val.Townie system prompt. Good example of how to create
  • Cursor editing
  • Cursor debugging
  • Cursor conversation

• Fri, Sep 20, 2024. XML tags seem best to structure prompts across LLMs. #ai-coding-tools #code-agents #llm-ops #markdown #prompt-engineering
  • Claude
  • OpenAI
  • Gemini

• Sun, Sep 15, 2024. The skills required to vet the AI's response is the same skillset used to vet a Pull Request. It's a good way to teach code review. Source: My personal guide for developing software with AI #ai-coding-tools

• Sun, Sep 15, 2024. Prompt engineering tip: Tell LLMs another AI wrote code. Else they will agree with you! #ai-coding-tools #automation #code-agents #future #llm-ops #prompt-engineering

• Wed, Sep 11, 2024. LLM coding #ai-coding-tools #code-agents #future #llm-ops
  • Makes you more ambitious
  • Lets you code without stress. (Just pass it the error and have it fix it. Or find another approach)
  • Is unlimited. You can run dozens of agents in parallel

• Sun, Sep 8, 2024. The Impact of AI on Computer Science Education: #ai-coding-tools #code-agents
  • Eric Klopfer divided his undergrad CS class into three groups and gave them a Fortran task.
  • One used ChatGPT. Another, Meta's Code Llama LLM. Third, only use Google.
  • ChatGPT group was faster than Code Llama was faster than Google
  • When tested on the approach, the ChatGPT remembered nothing. Half the Code Llama group passed. The Google group passed fully

• Sun, Sep 8, 2024. Via Pratap Vardhan: #ai-coding-tools #code-agents #github
  • At Khan Academy, every developer working on Khanmigo has cursor. Everyone who's contributed to a Khan Academy GitHub repo has GitHub Copilot.
  • I stopped using Google + StackOverflow 2 years ago. I use ChatGPT, Copilot, etc. For humans, I ask Reddit.
  • Excited by async agents. Things that do my job while I sleep.
    • Zapier notifications.
    • Monitor what happens. Put it into a flow diagram and alert me.
    • Every month, did my broker trade? Did my bank transaction fail? Did I pay my electricity bill?
    • Every time you delegate, use an agent instead.
    • Read my RSS feeds.
    • Read my browser history and suggest interests.
  • Plan a session in Bain, BCG, etc. on Artifacts.
  • Explore sparse embeddings. More effective. ColiPali, ColBERT

• Sat, Aug 31, 2024. Val.town's code generation system prompt uses https://maxm-imggenurl.web.val.run/the-description-of-your-image to dynamically generate images #ai-coding-tools #dev #image-generation

• Tue, Aug 27, 2024. Cursor uses speculative edits and a variety of other techniques to speed up code editing. #ai-coding-tools #future #markdown #prompt-engineering

• Fri, Aug 23, 2024. An 8-year old uses Cursor.ai to code #ai-coding-tools #code-agents #future

• Mon, Aug 19, 2024. LLMs write worse code in JSON than Markdown #ai-coding-tools #llm-ops #markdown

• Mon, Aug 12, 2024. Code agent frameworks to explore: #ai-coding-tools #automation #code-agents #dev #future #github #markdown #prompt-engineering
  • Cognition
  • Factory
  • Codegen

• Thu, Aug 8, 2024. Agentic RAG (Ravi Theja, LlamaIndex) #ai-coding-tools #code-agents
  • RAG via top-k retrieval fails with
    • summarization => need to read all chunks
    • comparison: compare product X vs Y => need to split and re-combine
    • structured analytics. e.g. most expensive employees => Text2SQL first
    • multi-part questions. e.g. Tell me about speed of model X AND cost of model Y and recommend => need to split and re-combine
  • RAG failures: It's single shot. No query planning. No tools. No correction. No memory.
  • Agents that help in RAG
    • Route to the right tool
      • E.g. retrieve via vector top-k search or vector summary search or keyword search or combination?
    • One-shot query planning
      • E.g. Break query into multiple specific queries. RAG those. Then combine. #TRY - maybe in DocSearch
    • Tool use
      • E.g. Schema retrieval, Text2SQL, Calendar, Chat, APIs, Search, etc.
  • Agent orchestration
    • ReAct: An agent reasoning loop. Reason + Act. {Thought, Action, Action Input, Observation}*.
      • Orchestrate tools with a prompt
    • Multi-agent task solver: Llama agents
      • Instead of a single agent loop, use different agents. Also allows parallelization
      • Allow services to register. (MS TaskWeaver stores tool descriptions in YAML)
  • LlamaHub Tools has ideas for agents

• Wed, Aug 7, 2024. Notes from a 4-hour flight: #ai-coding-tools #llm-ops #prompt-engineering
  • What We’ve Learned From A Year of Building with LLMs
    • Strategy
      • IS IT TOO HARD/EXPENSIVE? Log it. LLMs are getting cheaper and better.
      • WILL OPENAI BUILD IT? If so, wait for it instead of building.
      • HAS A STARTUP BUILT IT? If so, use it instead. It's a generic use case there's no point re-inventing.
      • FOCUSED USE CASES over generic. Build trust by starting small.
      • Tools for LLM Ops (feedback): LangSmith, Log10, LangFuse, W&B Weave, HoneyHive #TRY
      • Human in the Loop is about humans evaluating model outputs. That's different from AI in the loop, human in the center, where AI accelerates human output (like Github Copilot)
    • Operations
      • CHECK EMBEDDINGS DRIFT over time. Users might be input-ing different things than before.
      • LOG AND REVIEW everything.
      • Instructor coaxes structured output from LLM APIs. #TRY
      • IMPLICIT FEEDBACK collection is easy. Just let users edit stuff. #TRY
    • Tactical
      • Try n-shot prompting (n=5-12) before bigger models. #TRY
      • Always structure for output: Markdown, XML/HTML tags.
      • Combine RAG with Keyword search. It reduces user frustration in edge cases.
      • Prefer multiple small prompts to one big prompt. Do X. Then Y. Then Z.
      • Jitter prompts for diversity beyond temperature.
      • LLM-as-judge works better when comparing outputs (not rating 1 output). Keep length similar (LLMs prefer wordiness). Swap order and compare. Allow for ties. Ask for reason FIRST.
  • Hermes: A Text-to-SQL solution at Swiggy
    • "Hermes performed significantly better for charters with well-defined metadata and a relatively smaller number of tables."
    • "We collect feedback on the accuracy of the returned query from stakeholders directly within the Slack bot."
  • How I use AI and "Replacing my right hand with AI"
    • EMBED in every app/workflow. E.g. Auto-fix spellings. Auto-review code. Auto-ask LLM on errors and apply patch! Auto-search for answer, assess, continue.
    • PERSIST. Stick with the LLM to the end. Don't fix it yourself. It's faster. #TRY
      • INTERVENE FAST. If an LLM can't solve it by itself in 2 tries, it needs in-depth help.
    • APP-IFY one-off tasks. Disposable tools. "Write web-app to convert JSON to tab-delimited." "Extract fields as a table." "Diff JSON." #TRY
    • BEST language/frameworks preferred. CUDA in Python. Rust. C. Raspberry Pi. Arduino. Bluetooth. Modern ESM/JS. #TRY
    • TEACH examples. "Here's the LLM Foundry API." "Here's how to use gramex.data."
    • DUMP entire code. Models can handle it. Refactoring to SQLAlchemy 2, Pandas 2. API Documentation. Test case generation. #TRY
    • ASK for features & packages. Docker without root access. GPU access inside docker. Windows CLI-only C++ compiler.
    • TEST CASE writing. #TRY
    • SPEC IN DETAIL. Use these libraries. Write like this: code example.
    • SPEC USAGE in detail.
      • "I will just pipe it into sqlite", or "I will just run ffmpeg -i filename [YOUR OPTIONS].
      • Describe the UI, API input/output, data structure, and internal data structure.
    • HELP on usage. "ffmpeg to get audio.mp3".
  • My benchmark for large language models
    • LLM(text) is a useful function to have in JS and Python too. Useful as a simple pip install llmfoundry
    • Allow images, files in LLM()
  • Current list of #IMPOSSIBLE (or hard) things for LLMs
    • Translate technical documents to Dutch -- because they don't understand the technical terms well
    • Translate large documents (JSON to XML, English to Chinese, Python to Rust, Wrong to right spelling) -- because the output tokens are limited

• Wed, Jul 31, 2024. Interest Turing complete languages: #ai-coding-tools
  • find + mkdir, maybe
  • sed and awk
  • Minecraft's Redstone Circuits
  • Conway's Game of Life
  • Cellular Automata Rule 110
  • Magic: The Gathering
  • SQL
  • Excel

• Thu, Jul 25, 2024. Speech editing in audio files is a thing. Speech Editing Toolkit and Descript #ai-coding-tools #speech-to-text #voice-cloning

• Tue, Jun 25, 2024. LLM Patterns include Evals, RAG, Fine-tuning, Caching, Guardrails, Defensive UX, Collect feedback. Notably: #ai-coding-tools #automation #best-practices #future #llm-ops #optimization #prompt-engineering
  • Defensive UX: Microsoft, Google, and Apple have guidelines for Human-AI interactions
  • Collect feedback: Explicit and implicit

• Wed, May 29, 2024. AI reporting templates are a trend. Domain expertise comes in via structuring the report template and associated prompts. #ai-coding-tools #automation #code-agents

• Tue, May 28, 2024. #POST I tried Undermind.ai - an agent that researches for you. It guides you to ask a detailed question, spends 2-3 minutes finding the answer, and provides detailed results. But it's worth the wait. It's a good alternative to quick validations on SciSpace. #ai-coding-tools #code-agents #future

• Sat, May 18, 2024. Artificial Analysis benchmarks LLM APIs on speed, cost, and quality. #ai-coding-tools #llm-ops

• Sat, Apr 27, 2024. Cheap cloud GPU services thread on Twitter lists: #ai-coding-tools #cloud #gpu
  • Runpod (17)
  • Vast.ai (17)
  • Modal Labs (8)
  • fly.io (4)
  • LightningAI (4)
  • Colab (4)
  • AkashNet (4)
  • Lambda Labs (4)
  • ShadeFormAI (3)
  • Mac Mini (3)
  • Tensor Dock (2)
  • Hetzner (2)
  • BrevDev (2)

• Wed, Apr 17, 2024. Tests and homework have a purpose. It helps people figure out whether they've learnt. So: #ai-coding-tools #best-practices #dev #future #github
  • Write tests that make people think! Like DuckDB workshop
  • Share a list of exercises that people can explore

• Sun, Apr 14, 2024. www.web.sp.am is a content farm that's getting hit by OpenAI. Highlights how easy it is to create content farms, and therefore "easy" it can be to introduce bias into LLMs. #ai-coding-tools #llm-ops

• Sun, Apr 14, 2024. Marvin provides Python decorators to create AI functions. Pretty intuitive! #ai-coding-tools

• Sun, Apr 14, 2024. With RAG on search becoming big, search APIs are growing. serper.dev, you.com, searxng being examples. #ai-coding-tools #code-agents #search

• Thu, Apr 11, 2024. VS Code #ai-coding-tools #code-agents #github #markdown
  • Select any code and command Explain this to understand the code
  • %something in command bar searches ACROSS files for a term. Exactly like Ctrl+Shift+F
  • Copilot has an Inline Chat: Start in Terminal (that needed me to unbind Ctrl+I in bash to work)
  • Ctrl+2 opens a second window on the side. Ctrl+1 goes back to the first window
  • Terminal: Open Detected Link lets you scroll through detected (file) links in terminal
  • Terminal sticky scroll is transparent. (But Terminal stick scroll isn't working for me.)
  • Copilot uses last 10 commit messages, Jupyter notebook kernel state (variables) as additional context
  • 1.88: supports locked scrolling to sync scrolling of side-by-side windows

• Sat, Mar 30, 2024. twinny is an open source VC Code Copilot alternative. #ai-coding-tools #dev #future #github

• Sat, Mar 30, 2024. Binary embeddings are good enough. Cohere releases binary embeddings. #ai-coding-tools #embeddings #gpu

• Sun, Mar 3, 2024. Making a tool more usable, e.g. a video, can have a 10-100X impact. Yet every developer thinks it's redundant #ai-coding-tools #prompt-engineering #web-dev

• Wed, Feb 28, 2024. SourceGraph is the default platform for private code completion & search #ai-coding-tools #code-agents #future #github #markdown

• Sun, Feb 25, 2024. demucs does an EXCELLENT job of splitting songs into drums, bass, vocals and others #ai-coding-tools #dev #markdown

• Fri, Feb 23, 2024. Teknoturf is using Gen AI to #ai-coding-tools #automation #prompt-engineering #speech-to-text #tts
  • Improve prompts when teaching prompt engineering.
  • Pronounce languages better, identifying which words Tamilians and Malayalis will mis-pronounce.

• Mon, Feb 19, 2024. Command line interface guidelines #ai-coding-tools #dev

• Sat, Feb 17, 2024. Discussion with Karthik A #ai-coding-tools #github #prompt-engineering
  • #TODO Ask IIT students to do internship tasks. Use advent of code is a qualifying criterion
  • Tata motors unionized DB admins for longevity. No one can take their jobs. Hires people who LIKE their jobs
  • Rust gives me typing. It's very efficient. Pola.rs is interesting but Pandas as good enough.
  • Explore alerts from CCTV feeds. Karthik sends email alerts with pictures for:
    • "Is the machine on or off"? for productivity
    • "Are people not wearing helmets?" for safety at Cummins
  • #TODO Integrate with WhatsApp. Use LLMs with function calling for responses
  • Use expiring links (to pictures or content). It increases engagement
  • Check Deno licensing. Is there a commercial clause? #ANS No - it's MIT license
  • Centre or excellence for zero emission tech at IIT. Karthik is part of it
  • Explore auth0. 7000 users are free
  • toml is part of the Python 3.11 standard library!
  • If copilot writes code we don't understand we are screwed. Hence expertise matters

• Sun, Feb 11, 2024. Two pass generation is a clever technique to get multiple SEQUENTIAL answers in a single API request. For example the schema {'code', 'optimized_code'} will generate code and then optimize it. #ai-coding-tools #code-agents #future #optimization #prompt-engineering

• Mon, Jan 29, 2024. Vanna is a SQL generation LLM. An alternative to SQLCoder. This thread has a detailed discussion on SQL generation and BI #ai-coding-tools #dev

• Sun, Jan 28, 2024. Big Code Models Leaderboard is a leaderboard for open source code models. #ai-coding-tools #github

• Sat, Jan 27, 2024. OpenAI summarizes books by recursively summarizing sections and maintaining a running commentary of the summary so far. #ai-coding-tools

• Tue, Jan 16, 2024. Lilac is an LLM-based data curation tool. Use it to search by concept (e.g. PII, duplicates, etc.) and then drop/update the results. #ai-coding-tools #database #llm-ops

• Sun, Jan 14, 2024. AI by API is the norm today and will grow #ai-coding-tools #automation #future
  • Just having AI is no longer a differentiator
  • AI is part of life, not just work
  • #TODO Explore quickdrop from Stability for Maruti
  • #TODO Explore Codium VS Code plugin and Continue.dev
  • Hybrid systems that combine stats, ML, DL and AI models will grow
  • AGI and AutoGPT resurgence
  • RAG will continue to be a focus
  • GPT4 will be beaten by open source models. Special purpose models beat it already
  • Self hosted and cloud hosted models will grow for security
  • Small language models will grow
  • Productivity will be enhanced rather than replaced
  • Multi modal models will grow
  • Cost efficiency will grow in focus

• Sun, Jan 7, 2024. In-browser playgrounds has compiled WASM versions of Python, PHP, SQLite. #ai-coding-tools #github #html #web-dev

• Sun, Jan 7, 2024. CodeGPT is an alternative to Github Copilot that can use any LLM. #ai-coding-tools #chatgpt #code-agents #future #github #llm-ops

• Wed, Jan 3, 2024. Duet AI is Google's answer to Github Copilot. #ai-coding-tools #future #github

• Wed, Jan 3, 2024. Teachers are using LLMs to plan lessons, write emails to parents, create tests, adjust reading level of materials, personalize content with tools like MagicSchool, Diffit, Eduaide. #ai-coding-tools #future #llm-ops

• Wed, Dec 13, 2023. Practical AI podcast #ai-coding-tools #github
  • Advent of Gen AI is going on. Explore
  • add to tools in data science course. Model validation
  • write a book as an open source to github repository. Easier to evolve and easier to get feedback on..
  • Explore utterances as a GitHub commenting platform
  • automatically give credits to contributors who have center pull request that was accepted or an issue that was fixed. This encourages contribution
  • Visit book.premai.io

• Mon, Dec 11, 2023. ast-grep is a semgrep alternative that focuses on code refactoring rather than security. Comby is another such tool #ai-coding-tools #code-agents #github

• Thu, Dec 7, 2023. CodeAnt.ai is a VS Code plugin to detect code smells, refactor for modularity, to write docstrings and unit tests #ai-coding-tools #code-agents #github #markdown

• Tue, Dec 5, 2023. Tools to identify personally identifiable information: #ai-coding-tools #llm-ops
  • galactic can use LLMs to detect PII
  • Presidio by Microsoft
  • Sherlock is a generic sematic type matching DL model
  • pii-extractor-llm was trained on Indian names
  • GLiNER is a Lightweight Generalist model for NER

• Sun, Dec 3, 2023. Tools to explore #ai-coding-tools #speech-to-text #voice-cloning
  • ElevenLabs speaks in your voice
  • Cutout Pro removes backgrounds and parts of images
  • Vocal Remover removes vocals from songs
  • CapCut video editor

• Thu, Nov 30, 2023. CoVA scrapes web pages via OCR #ai-coding-tools #code-agents #document-conversion

• Thu, Nov 30, 2023. When coding with LLMs, have SHORT, RELIABLE feedback loops. Ref #ai-coding-tools #automation #code-agents #future #llm-ops #optimization #prompt-engineering

• Sat, Nov 25, 2023. Quote from Jerry Liu: "RAG is a hack". It's engineered, not machine learnt, so it's suboptimal. We need an ML way of creating the context. Maybe fine tuning can be a way of CREATING the right context. But RAG can handle deterministic stuff like access control. #ai-coding-tools #code-agents #gpu

• Sat, Nov 25, 2023. Agents mimic programming primitives. Switch. While. Call a function. Print. #ai-coding-tools #automation #code-agents #prompt-engineering

• Tue, Nov 21, 2023. CoVA scrapes web pages using LLMs and visual information. #ai-coding-tools #code-agents

• Sun, Nov 12, 2023. Pydantic is all you need drives towards code = data = text! #ai-coding-tools #future #markdown

• Mon, Nov 6, 2023. 06 Nov 2023: ChatGPT is slightly better that Github Copilot or CodeWhisperer #ai-coding-tools #chatgpt #code-agents #github #speech-to-text

• Thu, Oct 26, 2023. 26 Oct 2023: Auxi pro is a VS Code + Github Copilot Chat for PowerPoint #ai-coding-tools #github #speech-to-text

• Thu, Oct 26, 2023. 26 Oct 2023: ChatGPT AutoExpert is a great prompt mechanism for higher accuracy, context and control. Example #ai-coding-tools #automation #chatgpt #code-agents #prompt-engineering #speech-to-text #tts

• Mon, Oct 23, 2023. 23 Oct 2023: Bits & Bytes, QLORA, llama.cpp, BigDL, are ways of quantizing models that you can run directly in Google Colab. Try them. Also try OpenVino. #ai-coding-tools #github #gpu #markdown