#ai-coding-tools | Anand S - Things I Learned

Sat, Jan 4, 2025. mitmproxy is an open source tool to intercept, modify, and replay HTTP requests. An alternative to Charles, Fiddler, and partly WireShark. Guide. Like the others, it requires installing a trusted root certificate on your machine. #ai-coding-tools #prompt-engineering
- mitmproxy2swagger digs through the mitmproxy flows and generates an OpenAPI schema. A clever idea to reverse-engineer APIs.

Fri, Jan 3, 2025. Matomo, PostHog, Umami and Plausible are open source web analytics tools (like Google Analytics). #ai-coding-tools

Thu, Jan 2, 2025. Tools that convert files to prompt / Markdown suitable for LLMs: #ai-coding-tools #document-conversion #github #markdown
- uvx files-to-prompt
- npx git-ingest
- ingest - written in Go, only Mac/Linux binaries

Thu, Dec 26, 2024. Learnings from Best of 2024 in Agents (from #1 on SWE-Bench Full, Prof. Graham Neubig of OpenHands/AllHands) #ai-coding-tools #code-agents #dev #github #prompt-engineering
- Passing code execution as a tool is more powerful than granular tools. You combine multiple tools and tool calls into one. You move code to the data rather than the other way around. Mostly, you need bash, Python (or Jupyter), file manager, web browser.
- UI: Go where the user is, instead of bringing them to you.
- A remote runtime is a critical component.
- Claude 3.5 Sonnet (20241022) and Claude 3.5 Haiku (20241022) perform best on SWE Bench, followed by Deepseek V3, then O1 2024-12-17. X

Mon, Dec 23, 2024. Medical coding is an area ripe for LLMs. #ai-coding-tools #code-agents #llm-ops
- Ojasvi Yadav created a repo that uses hierarchical classification (rather than embeddings) to find the right coding.
- Gemini models seem to understand medical terms better than others.
- RapidClaims, funded by TogetherAI, is apparently working on this problem.

Sun, Dec 22, 2024. Examples of agentic AI #ai-coding-tools #automation #code-agents #llm-ops #prompt-engineering
- Text-to-SQL automated business analyst: A system that generates SQL queries from natural language, handles errors, creates visualizations, and includes a FAQ component. The author calls it "constrained agentic AI."
- Data source querying system: A bot that queries multiple SQL and API data sources, selecting tools and reformulating tasks as needed.
- Cursor (agentic mode): An LLM-powered VS Code fork that chains together various LLM capabilities (code generation, applying changes, linting suggestions, terminal commands, codebase RAG) to reduce user prompts.
- Vulnerability finding system: A system that uses LLM agents to discover novel vulnerabilities in open-source web applications. The agents leave traces of their actions.
- Marketing strategy generation system: A system using approximately 60 agents to generate marketing strategies.
- Restaurant finder: A system that searches for restaurants based on dietary preferences and group size, and downloads social media information.
- Proofreading and editing of transcripts: LLM agents apply specific customer requirements to transcripts after human editing.
- Meeting notes and action items generator: A system that generates meeting notes and action items.
- O'Reilly auto parts customer service agent: An agent demonstrated using RAG.
- UI enhancement agent: An agent that added features like language locales and dark mode to a UI.

Sat, Dec 21, 2024. Anthropic defines agents. Building effective agents + Cookbook #ai-coding-tools #automation #code-agents #llm-ops #prompt-engineering
- Augmented LLMs are LLMs enhanced with augmentations such as retrieval, tools, and memory.
- Workflows are systems where LLMs and tools are orchestrated through predefined code paths.
  - Prompt chaining: Pipe each LLM output to the next LLM. E.g. Write report, then translate. Extract results, then verify them. Successively ask follow-up questions.
  - Routing: One LLMs decides which other LLM to call next. E.g. Evaluate complexity, then pick the right model. Classify request time, then pick the right prompt.
  - Parallelize: Sectioning: Break tasks into independent subtasks, then aggregate. E.g. Evaluate contracts against different clauses in parallel.
  - Parallelize: Voting: Run same task multiple times, then vote. E.g. Review code for prompt injection using different prompts. Evaluate content safety with different thresholds.
  - Orchestrator-workers: One LLM delegates to others, then syntheisizes. E.g. Search from multiple sources, then synthesize. Change multiple code files.
  - Evaluator-optimizer: One model checks another in a loop. E.g. Literary translation. Self-healing code. Policy violation checks.
  - Human-in-the-loop Checkpoints: The workflow explicitly requests human review at certain stages.
- Agents are LLMs that dynamically direct their own processes and tool usage, consulting tools or the user as needed.

Fri, Dec 6, 2024. Arena Hard is a set of hard prompts to test LLMs. Here is the code and evaluation #ai-coding-tools #llm-ops

Wed, Nov 27, 2024. I tried LIDA from Microsoft, after almost a year of its release. A few notes: #ai-coding-tools #gpu
- Just running uvx lida ui --port 8080 --docs works.
- But I needed to use export TCL_LIBRARY=C:/Users/Anand/AppData/Roaming/uv/python/cpython-3.13.0-windows-x86_64-none/tcl/tcl8.6 to point it to my TCL installation for charts to work. I also chose to export OPENAI_BASE_URL=https://llmfoundry.straive.com/openai/v1
- I also chose to replace gpt-3.5-turbo-0301 (the default model) with gpt-4o-mini in lida/web/ui/component*
- It's quite impressive.

Wed, Nov 27, 2024. I spoke at Automating Data Visualizations using LLMs at SUTD. Apparently, using LLMs to write code is much more common than writing code to use LLMs. I ran a quick quiz. #ai-coding-tools #llm-ops
- Have you used ChatGPT or any LLM? 35 / 35 raised their hands.
- Have you written code using an LLM? 34 / 35 raised their hands. (I was impressed.)
- Have you uploaded a spreadsheet to an LLM for analysis? 15 / 35 raised their hands.
- Have you programmatically called an LLM API? 6 / 35 raised their hands.

Mon, Nov 25, 2024. Crawl4AI and Firecrawl are tools / libraries to convert websites into LLM Friendly Markdown and extract structured data using LLMs. #ai-coding-tools #code-agents #document-conversion #html #llm-ops

Sat, Nov 23, 2024. OpenAI lets you download GPT instructions and execute arbitrary code in their containerized environment. This is not a bug. Ref #ai-coding-tools #chatgpt #code-agents #github #prompt-engineering

Fri, Nov 22, 2024. For good structured mode output, we need good prompting. #ai-coding-tools #code-agents #markdown #prompt-engineering
- Mentioning examples and schema and "JSON" helps. When providing examples, using [user, assistant] message pairs helps (I think it's because it's easier for the LLM to parse).
- Using a {reasoning, answer} schema (with reasoning first) helps. Make reasoning concise and relevant Ref Arxiv
- We already know code in JSON is not a great idea. Ref

Mon, Nov 18, 2024. You can enable syntax highlighting just using fonts. Ref #ai-coding-tools #github #html #markdown

Sat, Nov 9, 2024. Google counts auto-completion when saying "25% of all the code is written by AI at Google". "It's a helpful productivity tool but it's not doing any engineering at all. It's probably about as good, maybe slightly worse, than Copilot." YCombinator #ai-coding-tools #code-agents #prompt-engineering

Fri, Nov 8, 2024. Here are some approaches to large-scale classification of medical codes. ChatGPT #ai-coding-tools #code-agents
- Fine-Tuning LLMs on Medical Data: Enhance LLMs by training them on medical datasets, such as clinical notes and discharge summaries, to improve their understanding of medical terminology and context.
- Multi-Agent Frameworks: Implement a multi-agent system that simulates real-world coding processes with distinct roles (e.g., patient, physician, coder, reviewer, adjuster). Each agent utilizes an LLM to perform specific functions, enhancing interpretability and reliability. ArXiv
- Retrieve-Rank Systems: Develop a two-stage system where the LLM first retrieves potential ICD-10 codes and then ranks them based on relevance, improving precision in code assignment. ArXiv
- Embedding-Based Approaches: Use LLMs to generate embeddings for ICD-10 codes and medical texts, facilitating the matching of texts to appropriate codes through similarity measures. GitHub
- Hierarchical Classification: Leverage the hierarchical structure of ICD-10 codes by first classifying texts into broader categories before assigning specific codes, reducing complexity and improving accuracy. ArXiv
- Two-Stage Verification Models: Combine LLMs with verification models, such as Long Short-Term Memory (LSTM) networks, to validate and refine the codes suggested by the LLM, balancing recall and precision. ArXiv
- Also, a mixture of models approach might work. Feed any existing NLP model / rules as a second opinion.

Mon, Nov 4, 2024. Zed.dev is an AI code editor by the creators of Atom. It's written in Rust and is blazing fast. It has native AI integration. #ai-coding-tools #code-agents #dev #github #markdown

Mon, Oct 28, 2024. Pragmatic Podcast (I forgot which one) #ai-coding-tools #automation #code-agents #future #github #prompt-engineering
- Automate changelogs for your codebases. Convert past commits into attractive release notes automatically
- AI is going to be the consumer of many tools and logs. Build converters for these
- Speed of validation such as linting, testing, etc. will allow LLMs to iterate faster and WILL become more important

Sun, Oct 27, 2024. AI code editors are not good with large code bases today. Keep the refactoring exercises to below 1000 lines. Also evaluate the ease of setting it up locally #ai-coding-tools #code-agents #github #markdown

Thu, Oct 24, 2024. Gemini has a code execution API! #ai-coding-tools #code-agents

Sun, Oct 20, 2024. Replit is good for hobbyists, Cursor for developers, and Pythagora & Bolt for non-developers building business apps. Ref #ai-coding-tools

Mon, Oct 14, 2024. How AI can improve education performance and engagement. Ref #ai-coding-tools #future #prompt-engineering
- Student: Create study plan based on course and schedule
- Student: Focus on what you need to learn more
- Student: Align with your study style and pace
- Teacher: Grading MCQs
- Teacher: Writing conceptual guides
- "New collar workers" was coined by Ginny Rometty
- Embed tutor or document in video and ask for clarification! This is a new embedded interface. #TODO

Mon, Oct 7, 2024. GitHub co-pilot workspaces let you code using your mobile with AI and deploy it at one shot #ai-coding-tools #future #github

Sun, Oct 6, 2024. Continue.dev is another AI coding editor. It supports OpenRouter. So now I have heard good things about: #ai-coding-tools #code-agents #dev #github #prompt-engineering
- Github Copilot
- Cursor
- Cody
- Continue.dev (supports OpenRouter)
- Aider (supports OpenRouter)
- Maybe:
  - Codeium
- Not:
  - Amazon Q Developer

Fri, Oct 4, 2024. Software 2.0 by Andrej Karpathy. #ai-coding-tools #automation #dev #markdown #prompt-engineering
- This is fundamentally altering the programming paradigm by which we iterate on our software, as the teams split in two:
  - the 2.0 programmers (data labelers) edit and grow the datasets, while
  - a few 1.0 programmers maintain and iterate on the surrounding training code infrastructure, analytics, visualizations and labeling interfaces.
- Adaptive UI ideas:
  - Adaptive Fields: Show only required fields based on what the user field so far.
  - Smart Inputs: Dropdowns and auto-complete based on user's context.
  - Smart Themes: Change font size, contrast, theme guessing the user's age and preferences.
  - Dynamic Menus: Show what they might need to do next. Like Nokia's right button, but using LLMs.
  - Smart Tooltips: Check what the user's doing (delays, confusions, previous clicks, current actions) and show relevant tips.
  - Personalized Layout: Show only the relevant sections of the app. E.g. based on what they're doing.
  - Smart Charts: Create the right chart that solve the user's question.
- Adaptive Back-end
  - Dynamic APIs: Create endpoints on the fly based on user needs
  - Dynamic Indexing: Create & update indices on the fly based on user needs
  - Dynamic Schema: Create & update schema on the fly based on user needs
  - Dynamic Migration: Migrate to a new database or OS or language as required
  - Dynamic Queries: Create SQL/NoSQL queries to solve the user problem
  - Dynamic RBAC: Figure out who needs permissions and why. Add OR REMOVE access as required
  - Dynamic Logging. Log what's required. Explain why it's logged and what's happening. Fix code that raised the error
  - Dynamic Caching. Cache what's likely to be required. Evict what may not be required. Figure out cache keys.

Fri, Oct 4, 2024. Aider LLM Leaderboards show which LLMs code better. As of now, #ai-coding-tools #github #llm-ops
- o1-preview > claude-3.5 sonnet on code editing
- claude-3-opus > claude-3.5-sonnet on code refactoring
- deepseek-coder-v
- gpt-4o-mini sucks.

Mon, Sep 30, 2024. Coders are more likely to edit LLM code. Non-coders don't have that bad habit. #ai-coding-tools #code-agents #dev #github #llm-ops #markdown
- Vaishnavi and Ranjeet edited code
- Indal and Koustav didn't

Sun, Sep 29, 2024. "You have to put in a lot of work to become productive at AI coding." Simon Willison #ai-coding-tools

Sat, Sep 28, 2024. API coding best practices Source via Simon Willison: #ai-coding-tools #best-practices #github #prompt-engineering
- Always add screenshots to the Readme. They never break.
- Always add every example. Human think in examples.
- Avoid defaults and be explicit unless 99% of the usage is with the default.
- Make the feedback loops incredibly fast.
- Make deprecations easy for users to deal with.
- Keep objects immutable.

Fri, Sep 20, 2024. Prompt engineering for code generators: #ai-coding-tools #code-agents #dev #future #markdown #prompt-engineering
- Claude Artifacts Prompt
- Val.Townie system prompt. Good example of how to create
- Cursor editing
- Cursor debugging
- Cursor conversation

Fri, Sep 20, 2024. XML tags seem best to structure prompts across LLMs. #ai-coding-tools #code-agents #llm-ops #markdown #prompt-engineering
- Claude
- OpenAI
- Gemini

Sun, Sep 15, 2024. Prompt engineering tip: Tell LLMs another AI wrote code. Else they will agree with you! #ai-coding-tools #automation #code-agents #future #llm-ops #prompt-engineering

Sun, Sep 15, 2024. The skills required to vet the AI's response is the same skillset used to vet a Pull Request. It's a good way to teach code review. Source: My personal guide for developing software with AI #ai-coding-tools

Wed, Sep 11, 2024. LLM coding #ai-coding-tools #code-agents #future #llm-ops
- Makes you more ambitious
- Lets you code without stress. (Just pass it the error and have it fix it. Or find another approach)
- Is unlimited. You can run dozens of agents in parallel

Sun, Sep 8, 2024. The Impact of AI on Computer Science Education: #ai-coding-tools #code-agents
- Eric Klopfer divided his undergrad CS class into three groups and gave them a Fortran task.
- One used ChatGPT. Another, Meta's Code Llama LLM. Third, only use Google.
- ChatGPT group was faster than Code Llama was faster than Google
- When tested on the approach, the ChatGPT remembered nothing. Half the Code Llama group passed. The Google group passed fully

Sun, Sep 8, 2024. Via Pratap Vardhan: #ai-coding-tools #code-agents #github
- At Khan Academy, every developer working on Khanmigo has cursor. Everyone who's contributed to a Khan Academy GitHub repo has GitHub Copilot.
- I stopped using Google + StackOverflow 2 years ago. I use ChatGPT, Copilot, etc. For humans, I ask Reddit.
- Excited by async agents. Things that do my job while I sleep.
  - Zapier notifications.
  - Monitor what happens. Put it into a flow diagram and alert me.
  - Every month, did my broker trade? Did my bank transaction fail? Did I pay my electricity bill?
  - Every time you delegate, use an agent instead.
  - Read my RSS feeds.
  - Read my browser history and suggest interests.
- Plan a session in Bain, BCG, etc. on Artifacts.
- Explore sparse embeddings. More effective. ColiPali, ColBERT

Sat, Aug 31, 2024. Val.town's code generation system prompt uses https://maxm-imggenurl.web.val.run/the-description-of-your-image to dynamically generate images #ai-coding-tools #dev #image-generation

Tue, Aug 27, 2024. Cursor uses speculative edits and a variety of other techniques to speed up code editing. #ai-coding-tools #future #markdown #prompt-engineering

Fri, Aug 23, 2024. An 8-year old uses Cursor.ai to code #ai-coding-tools #code-agents #future

Mon, Aug 19, 2024. LLMs write worse code in JSON than Markdown #ai-coding-tools #llm-ops #markdown

Mon, Aug 12, 2024. Code agent frameworks to explore: #ai-coding-tools #automation #code-agents #dev #future #github #markdown #prompt-engineering

Thu, Aug 8, 2024. Agentic RAG (Ravi Theja, LlamaIndex) #ai-coding-tools #code-agents
- RAG via top-k retrieval fails with
  - summarization => need to read all chunks
  - comparison: compare product X vs Y => need to split and re-combine
  - structured analytics. e.g. most expensive employees => Text2SQL first
  - multi-part questions. e.g. Tell me about speed of model X AND cost of model Y and recommend => need to split and re-combine
- RAG failures: It's single shot. No query planning. No tools. No correction. No memory.
- Agents that help in RAG
  - Route to the right tool
    - E.g. retrieve via vector top-k search or vector summary search or keyword search or combination?
  - One-shot query planning
    - E.g. Break query into multiple specific queries. RAG those. Then combine. #TRY - maybe in DocSearch
  - Tool use
    - E.g. Schema retrieval, Text2SQL, Calendar, Chat, APIs, Search, etc.
- Agent orchestration
  - ReAct: An agent reasoning loop. Reason + Act. {Thought, Action, Action Input, Observation}*.
    - Orchestrate tools with a prompt
  - Multi-agent task solver: Llama agents
    - Instead of a single agent loop, use different agents. Also allows parallelization
    - Allow services to register. (MS TaskWeaver stores tool descriptions in YAML)
- LlamaHub Tools has ideas for agents

Wed, Aug 7, 2024. Notes from a 4-hour flight: #ai-coding-tools #llm-ops #prompt-engineering
- What We’ve Learned From A Year of Building with LLMs
  - Strategy
    - IS IT TOO HARD/EXPENSIVE? Log it. LLMs are getting cheaper and better.
    - WILL OPENAI BUILD IT? If so, wait for it instead of building.
    - HAS A STARTUP BUILT IT? If so, use it instead. It's a generic use case there's no point re-inventing.
    - FOCUSED USE CASES over generic. Build trust by starting small.
    - Tools for LLM Ops (feedback): LangSmith, Log10, LangFuse, W&B Weave, HoneyHive #TRY
    - Human in the Loop is about humans evaluating model outputs. That's different from AI in the loop, human in the center, where AI accelerates human output (like Github Copilot)
  - Operations
    - CHECK EMBEDDINGS DRIFT over time. Users might be input-ing different things than before.
    - LOG AND REVIEW everything.
    - Instructor coaxes structured output from LLM APIs. #TRY
    - IMPLICIT FEEDBACK collection is easy. Just let users edit stuff. #TRY
  - Tactical
    - Try n-shot prompting (n=5-12) before bigger models. #TRY
    - Always structure for output: Markdown, XML/HTML tags.
    - Combine RAG with Keyword search. It reduces user frustration in edge cases.
    - Prefer multiple small prompts to one big prompt. Do X. Then Y. Then Z.
    - Jitter prompts for diversity beyond temperature.
    - LLM-as-judge works better when comparing outputs (not rating 1 output). Keep length similar (LLMs prefer wordiness). Swap order and compare. Allow for ties. Ask for reason FIRST.
- Hermes: A Text-to-SQL solution at Swiggy
  - "Hermes performed significantly better for charters with well-defined metadata and a relatively smaller number of tables."
  - "We collect feedback on the accuracy of the returned query from stakeholders directly within the Slack bot."
- How I use AI and "Replacing my right hand with AI"
  - EMBED in every app/workflow. E.g. Auto-fix spellings. Auto-review code. Auto-ask LLM on errors and apply patch! Auto-search for answer, assess, continue.
  - PERSIST. Stick with the LLM to the end. Don't fix it yourself. It's faster. #TRY
    - INTERVENE FAST. If an LLM can't solve it by itself in 2 tries, it needs in-depth help.
  - APP-IFY one-off tasks. Disposable tools. "Write web-app to convert JSON to tab-delimited." "Extract fields as a table." "Diff JSON." #TRY
  - BEST language/frameworks preferred. CUDA in Python. Rust. C. Raspberry Pi. Arduino. Bluetooth. Modern ESM/JS. #TRY
  - TEACH examples. "Here's the LLM Foundry API." "Here's how to use gramex.data."
  - DUMP entire code. Models can handle it. Refactoring to SQLAlchemy 2, Pandas 2. API Documentation. Test case generation. #TRY
  - ASK for features & packages. Docker without root access. GPU access inside docker. Windows CLI-only C++ compiler.
  - TEST CASE writing. #TRY
  - SPEC IN DETAIL. Use these libraries. Write like this: code example.
  - SPEC USAGE in detail.
    - "I will just pipe it into sqlite", or "I will just run ffmpeg -i filename [YOUR OPTIONS].
    - Describe the UI, API input/output, data structure, and internal data structure.
  - HELP on usage. "ffmpeg to get audio.mp3".
- My benchmark for large language models
  - LLM(text) is a useful function to have in JS and Python too. Useful as a simple pip install llmfoundry
  - Allow images, files in LLM()
- Current list of #IMPOSSIBLE (or hard) things for LLMs
  - Translate technical documents to Dutch -- because they don't understand the technical terms well
  - Translate large documents (JSON to XML, English to Chinese, Python to Rust, Wrong to right spelling) -- because the output tokens are limited

Wed, Jul 31, 2024. Interest Turing complete languages: #ai-coding-tools
- find + mkdir, maybe
- sed and awk
- Minecraft's Redstone Circuits
- Conway's Game of Life
- Cellular Automata Rule 110
- Magic: The Gathering
- SQL
- Excel

Thu, Jul 25, 2024. Speech editing in audio files is a thing. Speech Editing Toolkit and Descript #ai-coding-tools #voice-cloning

Tue, Jun 25, 2024. LLM Patterns include Evals, RAG, Fine-tuning, Caching, Guardrails, Defensive UX, Collect feedback. Notably: #ai-coding-tools #automation #best-practices #future #llm-ops #optimization #prompt-engineering
- Defensive UX: Microsoft, Google, and Apple have guidelines for Human-AI interactions
- Collect feedback: Explicit and implicit

Wed, May 29, 2024. AI reporting templates are a trend. Domain expertise comes in via structuring the report template and associated prompts. #ai-coding-tools #automation #code-agents

Tue, May 28, 2024. #POST I tried Undermind.ai - an agent that researches for you. It guides you to ask a detailed question, spends 2-3 minutes finding the answer, and provides detailed results. But it's worth the wait. It's a good alternative to quick validations on SciSpace. #ai-coding-tools #code-agents #future

Sat, May 18, 2024. Artificial Analysis benchmarks LLM APIs on speed, cost, and quality. #ai-coding-tools #llm-ops

Sat, Apr 27, 2024. Cheap cloud GPU services thread on Twitter lists: #ai-coding-tools #cloud #gpu
- Runpod (17)
- Vast.ai (17)
- Modal Labs (8)
- fly.io (4)
- LightningAI (4)
- Colab (4)
- AkashNet (4)
- Lambda Labs (4)
- ShadeFormAI (3)
- Mac Mini (3)
- Tensor Dock (2)
- Hetzner (2)
- BrevDev (2)

Wed, Apr 17, 2024. Tests and homework have a purpose. It helps people figure out whether they've learnt. So: #ai-coding-tools #best-practices #dev #future #github
- Write tests that make people think! Like DuckDB workshop
- Share a list of exercises that people can explore

Sun, Apr 14, 2024. www.web.sp.am is a content farm that's getting hit by OpenAI. Highlights how easy it is to create content farms, and therefore "easy" it can be to introduce bias into LLMs. #ai-coding-tools #llm-ops

Sun, Apr 14, 2024. Marvin provides Python decorators to create AI functions. Pretty intuitive! #ai-coding-tools

Sun, Apr 14, 2024. With RAG on search becoming big, search APIs are growing. serper.dev, you.com, searxng being examples. #ai-coding-tools #code-agents #search

Thu, Apr 11, 2024. VS Code #ai-coding-tools #code-agents #github #markdown
- Select any code and command Explain this to understand the code
- %something in command bar searches ACROSS files for a term. Exactly like Ctrl+Shift+F
- Copilot has an Inline Chat: Start in Terminal (that needed me to unbind Ctrl+I in bash to work)
- Ctrl+2 opens a second window on the side. Ctrl+1 goes back to the first window
- Terminal: Open Detected Link lets you scroll through detected (file) links in terminal
- Terminal sticky scroll is transparent. (But Terminal stick scroll isn't working for me.)
- Copilot uses last 10 commit messages, Jupyter notebook kernel state (variables) as additional context
- 1.88: supports locked scrolling to sync scrolling of side-by-side windows

Sat, Mar 30, 2024. twinny is an open source VC Code Copilot alternative. #ai-coding-tools #dev #future #github

Sat, Mar 30, 2024. Binary embeddings are good enough. Cohere releases binary embeddings. #ai-coding-tools #embeddings #gpu

Sun, Mar 3, 2024. Making a tool more usable, e.g. a video, can have a 10-100X impact. Yet every developer thinks it's redundant #ai-coding-tools #prompt-engineering #web-dev

Wed, Feb 28, 2024. SourceGraph is the default platform for private code completion & search #ai-coding-tools #code-agents #future #github #markdown

Sun, Feb 25, 2024. demucs does an EXCELLENT job of splitting songs into drums, bass, vocals and others #ai-coding-tools #dev #markdown

Fri, Feb 23, 2024. Teknoturf is using Gen AI to #ai-coding-tools #automation #prompt-engineering #tts
- Improve prompts when teaching prompt engineering.
- Pronounce languages better, identifying which words Tamilians and Malayalis will mis-pronounce.

Mon, Feb 19, 2024. Command line interface guidelines #ai-coding-tools #dev

Sat, Feb 17, 2024. Discussion with Karthik A #ai-coding-tools #github #prompt-engineering
- #TODO Ask IIT students to do internship tasks. Use advent of code is a qualifying criterion
- Tata motors unionized DB admins for longevity. No one can take their jobs. Hires people who LIKE their jobs
- Rust gives me typing. It's very efficient. Pola.rs is interesting but Pandas as good enough.
- Explore alerts from CCTV feeds. Karthik sends email alerts with pictures for:
  - "Is the machine on or off"? for productivity
  - "Are people not wearing helmets?" for safety at Cummins
- #TODO Integrate with WhatsApp. Use LLMs with function calling for responses
- Use expiring links (to pictures or content). It increases engagement
- Check Deno licensing. Is there a commercial clause? #ANS No - it's MIT license
- Centre or excellence for zero emission tech at IIT. Karthik is part of it
- Explore auth0. 7000 users are free
- toml is part of the Python 3.11 standard library!
- If copilot writes code we don't understand we are screwed. Hence expertise matters

Sun, Feb 11, 2024. Two pass generation is a clever technique to get multiple SEQUENTIAL answers in a single API request. For example the schema {'code', 'optimized_code'} will generate code and then optimize it. #ai-coding-tools #code-agents #future #optimization #prompt-engineering

Mon, Jan 29, 2024. Vanna is a SQL generation LLM. An alternative to SQLCoder. This thread has a detailed discussion on SQL generation and BI #ai-coding-tools #dev

Sun, Jan 28, 2024. Big Code Models Leaderboard is a leaderboard for open source code models. #ai-coding-tools #github

Sat, Jan 27, 2024. OpenAI summarizes books by recursively summarizing sections and maintaining a running commentary of the summary so far. #ai-coding-tools

Tue, Jan 16, 2024. Lilac is an LLM-based data curation tool. Use it to search by concept (e.g. PII, duplicates, etc.) and then drop/update the results. #ai-coding-tools #llm-ops

Sun, Jan 14, 2024. AI by API is the norm today and will grow #ai-coding-tools #automation #future
- Just having AI is no longer a differentiator
- AI is part of life, not just work
- #TODO Explore quickdrop from Stability for Maruti
- #TODO Explore Codium VS Code plugin and Continue.dev
- Hybrid systems that combine stats, ML, DL and AI models will grow
- AGI and AutoGPT resurgence
- RAG will continue to be a focus
- GPT4 will be beaten by open source models. Special purpose models beat it already
- Self hosted and cloud hosted models will grow for security
- Small language models will grow
- Productivity will be enhanced rather than replaced
- Multi modal models will grow
- Cost efficiency will grow in focus

Sun, Jan 7, 2024. CodeGPT is an alternative to Github Copilot that can use any LLM. #ai-coding-tools #chatgpt #code-agents #future #github #llm-ops

Sun, Jan 7, 2024. In-browser playgrounds has compiled WASM versions of Python, PHP, SQLite. #ai-coding-tools #github #html #web-dev

Wed, Jan 3, 2024. Duet AI is Google's answer to Github Copilot. #ai-coding-tools #future #github

Wed, Jan 3, 2024. Teachers are using LLMs to plan lessons, write emails to parents, create tests, adjust reading level of materials, personalize content with tools like MagicSchool, Diffit, Eduaide. #ai-coding-tools #future #llm-ops

Wed, Dec 13, 2023. Practical AI podcast #ai-coding-tools #github
- Advent of Gen AI is going on. Explore
- add to tools in data science course. Model validation
- write a book as an open source to github repository. Easier to evolve and easier to get feedback on..
- Explore utterances as a GitHub commenting platform
- automatically give credits to contributors who have center pull request that was accepted or an issue that was fixed. This encourages contribution
- Visit book.premai.io

Mon, Dec 11, 2023. ast-grep is a semgrep alternative that focuses on code refactoring rather than security. Comby is another such tool #ai-coding-tools #code-agents #github

Thu, Dec 7, 2023. CodeAnt.ai is a VS Code plugin to detect code smells, refactor for modularity, to write docstrings and unit tests #ai-coding-tools #code-agents #github #markdown

Tue, Dec 5, 2023. Tools to identify personally identifiable information: #ai-coding-tools #llm-ops
- galactic can use LLMs to detect PII
- Presidio by Microsoft
- Sherlock is a generic sematic type matching DL model
- pii-extractor-llm was trained on Indian names
- GLiNER is a Lightweight Generalist model for NER

Sun, Dec 3, 2023. Tools to explore #ai-coding-tools #voice-cloning
- ElevenLabs speaks in your voice
- Cutout Pro removes backgrounds and parts of images
- Vocal Remover removes vocals from songs
- CapCut video editor

Thu, Nov 30, 2023. CoVA scrapes web pages via OCR #ai-coding-tools #code-agents #document-conversion

Thu, Nov 30, 2023. When coding with LLMs, have SHORT, RELIABLE feedback loops. Ref #ai-coding-tools #automation #code-agents #future #llm-ops #optimization #prompt-engineering

Sat, Nov 25, 2023. Quote from Jerry Liu: "RAG is a hack". It's engineered, not machine learnt, so it's suboptimal. We need an ML way of creating the context. Maybe fine tuning can be a way of CREATING the right context. But RAG can handle deterministic stuff like access control. #ai-coding-tools #code-agents #gpu

Sat, Nov 25, 2023. Agents mimic programming primitives. Switch. While. Call a function. Print. #ai-coding-tools #automation #code-agents #prompt-engineering

Tue, Nov 21, 2023. CoVA scrapes web pages using LLMs and visual information. #ai-coding-tools #code-agents

Sun, Nov 12, 2023. Pydantic is all you need drives towards code = data = text! #ai-coding-tools #future #markdown

Mon, Nov 6, 2023. 06 Nov 2023: ChatGPT is slightly better that Github Copilot or CodeWhisperer #ai-coding-tools #chatgpt #code-agents #github

Thu, Oct 26, 2023. 26 Oct 2023: Auxi pro is a VS Code + Github Copilot Chat for PowerPoint #ai-coding-tools #github

Thu, Oct 26, 2023. 26 Oct 2023: ChatGPT AutoExpert is a great prompt mechanism for higher accuracy, context and control. Example #ai-coding-tools #automation #chatgpt #code-agents #prompt-engineering #tts

Mon, Oct 23, 2023. 23 Oct 2023: Bits & Bytes, QLORA, llama.cpp, BigDL, are ways of quantizing models that you can run directly in Google Colab. Try them. Also try OpenVino. #ai-coding-tools #github #gpu #markdown