#code-agents

• Sat, Apr 5, 2025. Notes from AI 2027. BTW, this is the most impactful piece I've read recently. It's been on my mind continuously for 36 hours. A bit distubring, too. #ai-coding-tools #code-agents #future
  • 2025: AI can act as autonomous agents, like Glean, Devin, Operator.
    • turn bullet points into emails
    • take instructions via Slack or Teams and make substantial code changes on their own
    • spend half an hour scouring the Internet to answer your question
  • 2026:
    • automating AI R&D is the biggest enabler for AI Labs
    • job market for junior software engineers is in turmoil
    • people who know how to manage and quality-control teams of AIs are making a killing
  • 2027:
    • potential demand for ~20,000 FTEs solving long-horizon tasks to train AI
    • every researcher/coder becomes the manager of an AI team
    • hiring new programmers has nearly stopped, but there’s never been a better time to be a consultant on integrating AI into your business

• Wed, Apr 2, 2025. Learnings on AI code editors via Deep Research from ChatGPT, Gemini, Grok, Perplexity: #ai-coding-tools #code-agents #github #markdown #prompt-engineering
  • GitHub Copilot can identify the source of a code snippet as a repo. That helps with copyright issues.
  • Cursor uses a shadow workspace - a temporary sandbox where it edits files before applying changes at one shot.
  • Cursor auto-complete has context of other files, i.e. inserting an class in a .js file based on another HTML file's contents.
  • Windsurf seems to be best for large code bases and for large-scale refactoring. It can also run test results fix them.
  • Windsurf includes a browser and lets you click on an element and prompt to change its behavior, etc. That's good for front-end developers.
  • Roo Code can run scripts as part of the workflow, letting you run linting, tests, starting web apps, query databases, etc.
  • Roo Code lets you create persona, e.g. code reviewer, data storytelling and analysis, etc. with access to different tools and behaviors.
  • Roo Code does not support auto-complete.

• Tue, Apr 1, 2025. There's outrage around Cursor not taking responsibility for a rules file backdoor (via Grok Deep Research) and pricing. #code-agents #github

• Tue, Apr 1, 2025. Airflow AI SDK is a clever idea. Airflow is a workflow system. Agents are a workflow system (sort of). This SDK exposes LLMs as Airflow tasks. #automation #code-agents #future #llm-ops

• Sat, Mar 29, 2025. Discussion with Vedang #ai-coding-tools #code-agents #dev #github #llm-ops #markdown #prompt-engineering
  • Recurse center (Brooklyn, online) is a 6/12 week free self-driven programmer retreat. Runs every 6 weeks. You can do whatever you pick. There are daily standups for accountability. The groups are diverse. You can pair with them, pivot ideas, whatever. Principles: push yourself & learn.
  • Western education techniques (e.g. spaced repetition, adaptive learning) are very much present in Indian coaching systems, though not known by those names. However, interventions are hard since class 12 students just don't have enough time.
  • Coaching classes are a social phenomenon. It's not the smart students who are pulling in their friends. Smart students actually follow the popular students. (Coaching classes are below the typical smart students' standards.)
  • Monetizing coaching is hard. People don't want to pay for advice, and welcome free advice only if they ask for it. Coupling with execution is necessary.
  • Aider's integrations make it more powerful than Cursor/Windsurf. It auto-lints, runs test cases. Allows different models for "architecting" (generating changes) vs "editing" (applying code). It reads from the screen logs. Context is manual, not automated. Uses an ai! comment to trigger changes and ai? to ask questions.
  • Cline.bot is another Cursor-like open source AI code editor that's a VS Code plugin.
  • When coding with LLMs, a useful workflow is: data schema ➡️ interfaces ➡️ LLM-generated test cases ➡️ code.
  • ShellSage is a tmux based LLM tool for the command line. It screen-grabs from tmux, which is powerful.
  • Some MCPs that have proven useful: vega-lite, SQLite, sequential thinking, memory
  • make sucks but is hard to beat. just comes closest.
  • CRDTs are more powerful than for just collaborative editing. It can power a peer-to-peer Internet (beginning with office tools). Versioning schema is still problematic. yjs is a good start but automerge (Rust, WASM) is faster and may be better.
  • Fermyon hosts WASM serverless functions.

• Tue, Mar 25, 2025. Cursor with Claude 3.7 Max seems surprisingly good at generating multi-page sites at one shot. Potentially, it can edit large repositories of code as well at one shot. If that's the case, the way we write code will require higher order thinking skills: broad sweeping changes rather than micro edits. #ai-coding-tools #code-agents #dev #github #html #markdown #prompt-engineering #web-dev

• Sun, Mar 16, 2025. agents.json is a proposal for discovery of agents on a site that enhances the Open API spec: wild-card-ai/agents-json #agents #code-agents

• Sat, Mar 15, 2025. Playbook driven agents are another approach to agentic workflows. Simon Willison #agents #automation #code-agents #future

• Fri, Mar 14, 2025. Apify is a cloud scraper platform. Here's how they optimize their AI Web agent - Source: #ai-coding-tools #automation #code-agents #html #optimization #prompt-engineering #web-dev
  • Remove redundant tags and attributes (e.g. accessibility, etc.). Explore readability.
  • Add a unique gid to each element.
  • Add the screenshot WITH a "Set of Marks" - "SoM" (read research paper) highlighting important clickable elements.
  • Code output is brittle. Use tools / DSL - e.g. visit_url(url), click_element(text, gid, tagName), etc.

• Fri, Mar 14, 2025. GenAIScript increasingly looks like a promising way to automate LLM workflows in the browser. #ai-coding-tools #automation #code-agents #future #github #llm-ops

• Tue, Mar 11, 2025. Bots need structured content (e.g. Markdown, XML). Humans need rich content (e.g. HTML). Here are 4 ways to serve both, roughly in increasing order of sophistication: #code-agents #html #markdown #prompt-engineering
  1. Different URLs. E.g. https://example.org/about/ vs https://example.org/about.md (this is how Jekyll or Hugo work). Use for static sites generators.
  2. JavaScript. Inject after Markdown: <script src="https://cdn.jsdelivr.net/npm/marked/marked.min.js"></script><script>document.body.innerHTML = marked(document.body.textContent);</script>. Use for dynamically generated static sites.
  3. URL query parameters. E.g. ?format=markdown vs ?format=html vs ?format=json. Use in APIs.
  4. Content Negotiation. Based on the user agent and Accept header, serve Markdown or HTML. Send Vary: Accept to indicate that the response depends on the Accept header. Use for dynamic web apps.

• Sat, Mar 8, 2025. I agree with almost every point on this LinkedIn post on scoring candidates for AI roles. Rob Balian #ai-coding-tools #code-agents
  • Uses DeepSeek R1 or Claude 3.7 +5 points
  • Uses Langchain -5 points
  • Uses Langgraph +5 points (I don't know enough to comment)
  • Built a RAG in 2023 +3 points
  • Built a RAG in 2025 -3 points
  • "pinecone" -5 points (I don't know enough to comment)
  • "What is cursor" - 50 points no coming back from this
  • Uses Cursor composer +10 points
  • "You don't need a full agent for this" +5 points
  • Did hackathons to learn AI outside of work +5 points
  • "We probably need to fine tune for this" -3 points unless you can explain why
  • "Gemini is making a comeback" +3 points (I have a soft spot for Gemini)
  • +3 points each for mentioning reasoning trace, structured outputs, MCP, chain-of-thought, prompt caching, TPM limits

• Wed, Mar 5, 2025. Build apps (not just content) for agents. In the next 3 to 5 years, agents will surpass humans as the top product users. #agents #automation #code-agents #future

• Mon, Mar 3, 2025. Notes from AI Engineering Summit, NY, Day 1 #ai-coding-tools #automation #code-agents #prompt-engineering
  • An agent requires 3 things: a router, tools or skills, and memory.
  • Agents are often sequential, but sometimes parallel execution makes sense for independent tasks that you consolidate.
  • Always allow LLMs the option of NOT answering a question if there is no good answer.
  • Focus prompts on the happy path. Use guard rails for edge cases.
  • Here are a few "tools" an agent would need to call:
    • Clarification from user
    • Saving to memory
    • Google search
    • Edit a file introducing SPECIFIC changes
    • Search in codebase using embeddings
    • Run scripts on the shell or in a REPL (Python, Node, etc.)
    • Run code in a new container for isolation
    • Automatically discover, read an API documentation and use it
  • Modify environment to enable logging and other system changes.
  • When code is cheap, you can explore more ideas and hence design and product management need to approach things differently. We also need to reaching testing completely because it makes very different kinds of mistakes and we don't often have an intuition
  • You can have an agent explore all the issues and full request and recent comments against the repository and summarise it for the project manager

• Mon, Mar 3, 2025. Notes from AI Engineering Summit, NY. Session by Lux Capital. #automation #code-agents #llm-ops #optimization #prompt-engineering
  • Agents make multiple LLM calls. Errors accumulate. So the quality of the model is key
  • What's really critical: data + context + user preference
  • Set up evals for subjective responses by collecting signals continuously.
  • Create scaffolding for agents where errors don't accumulate. Better yet, make it FIX errors
  • UX is critical. We need lots more UX styles

• Tue, Feb 18, 2025. I subscribed to ChatGPT Pro mainly for DeepResearch. Here are the reports I've generated: #ai-coding-tools #best-practices #code-agents #llm-ops
  1. uv Package Manager Overview
  2. DuckDB Analytics Comparison
  3. Rust vs Python / JavaScript
  4. Modern Data Engineering Course
  5. LLM Code Migration Practices
  6. Cloud Cost Optimization Strategies
  7. LLM Coding Interview Tools Report (compare with Perplexity)
  8. Text To Speech Engines
  9. Customer Service in Indian Public Sector Banks
  10. LLMs in Software Development
      • Old version 1: Gen AI in Software Development
      • Old version 2: Gen AI in Software Development
  11. Leadership Training Content
  12. Open-Source HTTP Servers. Caddy wins.
  13. Deep Research Use Cases
  14. Nagpur No-Parking Violations
  15. Data Science in Food Services
  16. Deep Research Disruption to Research Firms
  17. LLMs in Design Thinking
  18. EU Taxonomy Report Clarification
  19. Shell Valuation Analysis Inquiry
  20. LLMs in DSLs Research
  21. Public API-Based Data Storage Options. Supabase wins.
  22. Front-End JS Frameworks Analysis
  23. Database Evaluation Guide
  24. CSS Frameworks Evaluation Guide
  25. CI/CD Tooling Ecosystem Report
  26. Color Names Count
  27. S Anand Biography. Meh, I know more about me, and it gets a few things wrong.
  28. Cosmere Secrets Encyclopedia. This is the best. Deep Research is great if it's stuff I actually want to read, rather than just learn about.
  29. DBT course
  30. Future of Coding AI
  31. Claude Artifacts Use Cases. This is the only one that managed to get artifacts links correct. I used this for an article for The Hindu.
  32. MCP Servers and Clients Research. Learnings:
      • Practically any "tool" can be an MCP server: file systems, APIs, codebases, browsers, collaboration platforms, memory, etc.
      • Most platforms have (or are) integrating MCP.
      • Clients: code editors, chat, and automation tools support MCP. GenAIScript is a good starting point.
      • Tester MCP Client is a browser-based test environment.
      • mcp-cli-client is a CLI-based client
      • mcp-chatbot is a chatbot client
  33. Data Moats by Industry
  34. Attorney Profile Research
  35. Social Media Data APIs
  36. Adobe Software Alternatives
  37. LLM Hallucination Visualization Techniques
  38. API vs Self-hosting Cost Analysis: Always use APIs, avoid self-hosting models.
  39. AGI Preparation
      • AGI will emerge step by step. Knowing which step is next will help
      • AI native organisations will emerge in each of these areas. AI design agencies and AI creative Agencies being one example
      • Networking, empathy, leadership have more value now. So will human AI bridging roles
      • What's the value of one human when another human can do practically everything they can but much better? Or a drama or a sport?
  40. Modern digital note taking
      • Voice note taking is the game changer
      • Automatically popping of notes based on context such as people places or conversations will be a thing
  41. Local LLM Search Tools
  42. Blog Post to research paper on copying - suggestions
  43. Linux Dev Migration Guide
  44. Raspberry Pi SIM options
  45. Linux Dev migration guide
  46. HTML to JATS conversion
  47. LLM context splitting strategies
  48. Strategy for AI services in Publishing
  49. Gemini multi model editing use cases by industry
  50. Pharma Conference Participation Guide
  51. Funding Open Source Initiatives
  52. SEBI IPO Acquisition Guidelines
  53. Approximate Similarity Matching Databases
  54. Low-Risk LLM Use Cases
  55. AI Coding Tools Report. Also via Gemini, Grok, Perplexity
  56. Impact of US Tariffs. Mixed impact on India. Imports & oil might become cheaper. Electronics, gems, textile, auto exports could drop - but textile & other demand might pick up from elsewhere. Demand could also grow where China is more impacted.

• Sun, Feb 16, 2025. Interview Coder is a desktop app that offers live interview support for coding interviews. It's a transparent window that reads your screen and answers questions for you. (Given this, I think we need an interviewer support system that tells interviewers what to ask!) #ai-coding-tools #code-agents #prompt-engineering

• Sun, Feb 2, 2025. Curiosity and agency may be the differentiator in a world of LLMs (not experience, knowledge, or ability), since LLMs will democratize expertise. Jack Clark #code-agents #future #llm-ops

• Sat, Jan 11, 2025. Can LLMs write better code if you keep asking them to “write better code? A delightful exploration of how Claude 3.5 Sonnet keeps optimizing and adding features to improve code. My takeaway: repeatedly applying a prompt gives us interesting new directions to explore. #ai-coding-tools #code-agents #llm-ops #markdown #optimization #prompt-engineering

• Wed, Jan 8, 2025. smolagents is a new agents library from HuggingFace. It seems simple enough to use. #code-agents #huggingface

• Wed, Jan 1, 2025. LLM Code Execution Sandboxes that let you run code in a sandbox via an API: #ai-coding-tools #cloud #code-agents #github #llm-ops
  • AgentRun: open source, via Docker
  • e2b.dev: A day costs about $1 (on demand) and you get about $100 one time credits. Self-hosting is complex. Discussion
  • nsjail: by Google. Write your own API

• Thu, Dec 26, 2024. WOW. This is how a software agent will work alongside humans: Fix issue #5478: Add color to the line next to "Ran a XXX Command" based on return value - using @openhands-agent. #automation #code-agents #future

• Thu, Dec 26, 2024. Learnings from Best of 2024 in Agents (from #1 on SWE-Bench Full, Prof. Graham Neubig of OpenHands/AllHands) #ai-coding-tools #code-agents #dev #github #prompt-engineering
  • Passing code execution as a tool is more powerful than granular tools. You combine multiple tools and tool calls into one. You move code to the data rather than the other way around. Mostly, you need bash, Python (or Jupyter), file manager, web browser.
  • UI: Go where the user is, instead of bringing them to you.
  • A remote runtime is a critical component.
  • Claude 3.5 Sonnet (20241022) and Claude 3.5 Haiku (20241022) perform best on SWE Bench, followed by Deepseek V3, then O1 2024-12-17. X

• Mon, Dec 23, 2024. Medical coding is an area ripe for LLMs. #ai-coding-tools #code-agents #llm-ops
  • Ojasvi Yadav created a repo that uses hierarchical classification (rather than embeddings) to find the right coding.
  • Gemini models seem to understand medical terms better than others.
  • RapidClaims, funded by TogetherAI, is apparently working on this problem.

• Sun, Dec 22, 2024. Examples of agentic AI #ai-coding-tools #automation #code-agents #llm-ops #prompt-engineering
  • Text-to-SQL automated business analyst: A system that generates SQL queries from natural language, handles errors, creates visualizations, and includes a FAQ component. The author calls it "constrained agentic AI."
  • Data source querying system: A bot that queries multiple SQL and API data sources, selecting tools and reformulating tasks as needed.
  • Cursor (agentic mode): An LLM-powered VS Code fork that chains together various LLM capabilities (code generation, applying changes, linting suggestions, terminal commands, codebase RAG) to reduce user prompts.
  • Vulnerability finding system: A system that uses LLM agents to discover novel vulnerabilities in open-source web applications. The agents leave traces of their actions.
  • Marketing strategy generation system: A system using approximately 60 agents to generate marketing strategies.
  • Restaurant finder: A system that searches for restaurants based on dietary preferences and group size, and downloads social media information.
  • Proofreading and editing of transcripts: LLM agents apply specific customer requirements to transcripts after human editing.
  • Meeting notes and action items generator: A system that generates meeting notes and action items.
  • O'Reilly auto parts customer service agent: An agent demonstrated using RAG.
  • UI enhancement agent: An agent that added features like language locales and dark mode to a UI.

• Sat, Dec 21, 2024. Anthropic defines agents. Building effective agents + Cookbook #ai-coding-tools #automation #code-agents #llm-ops #prompt-engineering
  • Augmented LLMs are LLMs enhanced with augmentations such as retrieval, tools, and memory.
  • Workflows are systems where LLMs and tools are orchestrated through predefined code paths.
    • Prompt chaining: Pipe each LLM output to the next LLM. E.g. Write report, then translate. Extract results, then verify them. Successively ask follow-up questions.
    • Routing: One LLMs decides which other LLM to call next. E.g. Evaluate complexity, then pick the right model. Classify request time, then pick the right prompt.
    • Parallelize: Sectioning: Break tasks into independent subtasks, then aggregate. E.g. Evaluate contracts against different clauses in parallel.
    • Parallelize: Voting: Run same task multiple times, then vote. E.g. Review code for prompt injection using different prompts. Evaluate content safety with different thresholds.
    • Orchestrator-workers: One LLM delegates to others, then syntheisizes. E.g. Search from multiple sources, then synthesize. Change multiple code files.
    • Evaluator-optimizer: One model checks another in a loop. E.g. Literary translation. Self-healing code. Policy violation checks.
    • Human-in-the-loop Checkpoints: The workflow explicitly requests human review at certain stages.
  • Agents are LLMs that dynamically direct their own processes and tool usage, consulting tools or the user as needed.

• Wed, Nov 27, 2024. Andrew Ng Explores The Rise Of Al Agents And Agentic Reasoning | BUILD 2024 Keynote #automation #code-agents #prompt-engineering
  • Innovation is now a path to production. People are able to build 20 prototypes at the cost of one and see which sticks
  • Machine learning is much faster. Things that took months now date days. But engineering and evaluations are only slightly faster and have become a bottleneck
  • A good analogy to zero shot prompting is to ask a person to write an entire essay without pressing backspace even once
  • Andrew scenes to align with the line chain definition of agentic workflow, which is about agents being able to craft their own control flows
  • People find it very easy to understand agentic workflows once they read through the code
  • Reflection or feedback is a useful agentic pattern
  • In multi-agent collaboration, it may be the same underlying model that is acting as different agents. But just like we find it useful for the same CPU to run multiple processes and each application is its own abstraction, agents of useful abstraction

• Mon, Nov 25, 2024. The OpenAI Desktop App can interact with native applications, e.g. read from Terminal, VS Code, etc. This takes it on a path to becoming a copilot for ANY apps. Putting every copilot app and every LLM integration under threat. #automation #code-agents

• Mon, Nov 25, 2024. Crawl4AI and Firecrawl are tools / libraries to convert websites into LLM Friendly Markdown and extract structured data using LLMs. #ai-coding-tools #code-agents #document-conversion #html #llm-ops

• Sat, Nov 23, 2024. OpenAI lets you download GPT instructions and execute arbitrary code in their containerized environment. This is not a bug. Ref #ai-coding-tools #chatgpt #code-agents #github #prompt-engineering

• Fri, Nov 22, 2024. For good structured mode output, we need good prompting. #ai-coding-tools #code-agents #markdown #prompt-engineering
  • Mentioning examples and schema and "JSON" helps. When providing examples, using [user, assistant] message pairs helps (I think it's because it's easier for the LLM to parse).
  • Using a {reasoning, answer} schema (with reasoning first) helps. Make reasoning concise and relevant Ref Arxiv
  • We already know code in JSON is not a great idea. Ref

• Tue, Nov 19, 2024. Langchain suggests multiple levels of agentic behaviour. LLM Call < LLM Chain < LLM Rounter < State Machine < Autonomous Langchain #code-agents #llm-ops

• Sat, Nov 9, 2024. Google counts auto-completion when saying "25% of all the code is written by AI at Google". "It's a helpful productivity tool but it's not doing any engineering at all. It's probably about as good, maybe slightly worse, than Copilot." YCombinator #ai-coding-tools #code-agents #prompt-engineering

• Fri, Nov 8, 2024. Here are some approaches to large-scale classification of medical codes. ChatGPT #ai-coding-tools #code-agents
  • Fine-Tuning LLMs on Medical Data: Enhance LLMs by training them on medical datasets, such as clinical notes and discharge summaries, to improve their understanding of medical terminology and context.
  • Multi-Agent Frameworks: Implement a multi-agent system that simulates real-world coding processes with distinct roles (e.g., patient, physician, coder, reviewer, adjuster). Each agent utilizes an LLM to perform specific functions, enhancing interpretability and reliability. ArXiv
  • Retrieve-Rank Systems: Develop a two-stage system where the LLM first retrieves potential ICD-10 codes and then ranks them based on relevance, improving precision in code assignment. ArXiv
  • Embedding-Based Approaches: Use LLMs to generate embeddings for ICD-10 codes and medical texts, facilitating the matching of texts to appropriate codes through similarity measures. GitHub
  • Hierarchical Classification: Leverage the hierarchical structure of ICD-10 codes by first classifying texts into broader categories before assigning specific codes, reducing complexity and improving accuracy. ArXiv
  • Two-Stage Verification Models: Combine LLMs with verification models, such as Long Short-Term Memory (LSTM) networks, to validate and refine the codes suggested by the LLM, balancing recall and precision. ArXiv
  • Also, a mixture of models approach might work. Feed any existing NLP model / rules as a second opinion.

• Mon, Nov 4, 2024. Zed.dev is an AI code editor by the creators of Atom. It's written in Rust and is blazing fast. It has native AI integration. #ai-coding-tools #code-agents #dev #github #markdown

• Mon, Nov 4, 2024. Chain of Thought reduces performance where thinking makes humans worse. Ref. Specifically: #code-agents
  • Artificial grammar learning
  • Facial recognition
  • Classifying data that has exceptions

• Mon, Oct 28, 2024. Pragmatic Podcast (I forgot which one) #ai-coding-tools #automation #code-agents #future #github #prompt-engineering
  • Automate changelogs for your codebases. Convert past commits into attractive release notes automatically
  • AI is going to be the consumer of many tools and logs. Build converters for these
  • Speed of validation such as linting, testing, etc. will allow LLMs to iterate faster and WILL become more important

• Sun, Oct 27, 2024. AI code editors are not good with large code bases today. Keep the refactoring exercises to below 1000 lines. Also evaluate the ease of setting it up locally #ai-coding-tools #code-agents #github #markdown

• Thu, Oct 24, 2024. Gemini has a code execution API! #ai-coding-tools #code-agents

• Sun, Oct 6, 2024. Continue.dev is another AI coding editor. It supports OpenRouter. So now I have heard good things about: #ai-coding-tools #code-agents #dev #github #prompt-engineering
  • Github Copilot
  • Cursor
  • Cody
  • Continue.dev (supports OpenRouter)
  • Aider (supports OpenRouter)
  • Maybe:
    • Codeium
  • Not:
    • Amazon Q Developer

• Thu, Oct 3, 2024. Quotes on Graph RAG from a Generative AI WhatsApp Group. #code-agents
  • "Damn so literally nobody uses Graph RAG yet. Good to know." ~Sumba
  • "A big four consulting firm uses GraphRAG to retrieve related documents and excerpts from governance and compliance docs." ~Vinayak Hegde (Microsoft)
  • "Graph RAG is expensive and unnecessary in most of the cases." ~Utkarsh Saxena

• Mon, Sep 30, 2024. Coders are more likely to edit LLM code. Non-coders don't have that bad habit. #ai-coding-tools #code-agents #dev #github #llm-ops #markdown
  • Vaishnavi and Ranjeet edited code
  • Indal and Koustav didn't

• Fri, Sep 20, 2024. Prompt engineering for code generators: #ai-coding-tools #code-agents #dev #future #markdown #prompt-engineering
  • Claude Artifacts Prompt
  • Val.Townie system prompt. Good example of how to create
  • Cursor editing
  • Cursor debugging
  • Cursor conversation

• Fri, Sep 20, 2024. XML tags seem best to structure prompts across LLMs. #ai-coding-tools #code-agents #llm-ops #markdown #prompt-engineering
  • Claude
  • OpenAI
  • Gemini

• Sun, Sep 15, 2024. Prompt engineering tip: Tell LLMs another AI wrote code. Else they will agree with you! #ai-coding-tools #automation #code-agents #future #llm-ops #prompt-engineering

• Wed, Sep 11, 2024. LLM coding #ai-coding-tools #code-agents #future #llm-ops
  • Makes you more ambitious
  • Lets you code without stress. (Just pass it the error and have it fix it. Or find another approach)
  • Is unlimited. You can run dozens of agents in parallel

• Sun, Sep 8, 2024. The Impact of AI on Computer Science Education: #ai-coding-tools #code-agents
  • Eric Klopfer divided his undergrad CS class into three groups and gave them a Fortran task.
  • One used ChatGPT. Another, Meta's Code Llama LLM. Third, only use Google.
  • ChatGPT group was faster than Code Llama was faster than Google
  • When tested on the approach, the ChatGPT remembered nothing. Half the Code Llama group passed. The Google group passed fully

• Sun, Sep 8, 2024. Via Pratap Vardhan: #ai-coding-tools #code-agents #github
  • At Khan Academy, every developer working on Khanmigo has cursor. Everyone who's contributed to a Khan Academy GitHub repo has GitHub Copilot.
  • I stopped using Google + StackOverflow 2 years ago. I use ChatGPT, Copilot, etc. For humans, I ask Reddit.
  • Excited by async agents. Things that do my job while I sleep.
    • Zapier notifications.
    • Monitor what happens. Put it into a flow diagram and alert me.
    • Every month, did my broker trade? Did my bank transaction fail? Did I pay my electricity bill?
    • Every time you delegate, use an agent instead.
    • Read my RSS feeds.
    • Read my browser history and suggest interests.
  • Plan a session in Bain, BCG, etc. on Artifacts.
  • Explore sparse embeddings. More effective. ColiPali, ColBERT

• Fri, Aug 23, 2024. An 8-year old uses Cursor.ai to code #ai-coding-tools #code-agents #future

• Mon, Aug 19, 2024. Copilot's system prompt calls a search_enterprise(query: str) tool and a hint(M365Copilot_language: str) tool as assistants. #code-agents #prompt-engineering

• Mon, Aug 12, 2024. Code agent frameworks to explore: #ai-coding-tools #automation #code-agents #dev #future #github #markdown #prompt-engineering
  • Cognition
  • Factory
  • Codegen

• Thu, Aug 8, 2024. Agentic RAG (Ravi Theja, LlamaIndex) #ai-coding-tools #code-agents
  • RAG via top-k retrieval fails with
    • summarization => need to read all chunks
    • comparison: compare product X vs Y => need to split and re-combine
    • structured analytics. e.g. most expensive employees => Text2SQL first
    • multi-part questions. e.g. Tell me about speed of model X AND cost of model Y and recommend => need to split and re-combine
  • RAG failures: It's single shot. No query planning. No tools. No correction. No memory.
  • Agents that help in RAG
    • Route to the right tool
      • E.g. retrieve via vector top-k search or vector summary search or keyword search or combination?
    • One-shot query planning
      • E.g. Break query into multiple specific queries. RAG those. Then combine. #TRY - maybe in DocSearch
    • Tool use
      • E.g. Schema retrieval, Text2SQL, Calendar, Chat, APIs, Search, etc.
  • Agent orchestration
    • ReAct: An agent reasoning loop. Reason + Act. {Thought, Action, Action Input, Observation}*.
      • Orchestrate tools with a prompt
    • Multi-agent task solver: Llama agents
      • Instead of a single agent loop, use different agents. Also allows parallelization
      • Allow services to register. (MS TaskWeaver stores tool descriptions in YAML)
  • LlamaHub Tools has ideas for agents

• Wed, Aug 7, 2024. micro-agent generates test cases first when asked to build an app. Then it iterates until the test cases pass. #code-agents #future #github

• Sun, Jul 14, 2024. Github Copilot internals walks through how Copilot constructs its prompts #code-agents #future #prompt-engineering

• Wed, May 29, 2024. AI reporting templates are a trend. Domain expertise comes in via structuring the report template and associated prompts. #ai-coding-tools #automation #code-agents

• Tue, May 28, 2024. #POST I tried Undermind.ai - an agent that researches for you. It guides you to ask a detailed question, spends 2-3 minutes finding the answer, and provides detailed results. But it's worth the wait. It's a good alternative to quick validations on SciSpace. #ai-coding-tools #code-agents #future

• Sun, Apr 14, 2024. With RAG on search becoming big, search APIs are growing. serper.dev, you.com, searxng being examples. #ai-coding-tools #code-agents #search

• Thu, Apr 11, 2024. VS Code #ai-coding-tools #code-agents #github #markdown
  • Select any code and command Explain this to understand the code
  • %something in command bar searches ACROSS files for a term. Exactly like Ctrl+Shift+F
  • Copilot has an Inline Chat: Start in Terminal (that needed me to unbind Ctrl+I in bash to work)
  • Ctrl+2 opens a second window on the side. Ctrl+1 goes back to the first window
  • Terminal: Open Detected Link lets you scroll through detected (file) links in terminal
  • Terminal sticky scroll is transparent. (But Terminal stick scroll isn't working for me.)
  • Copilot uses last 10 commit messages, Jupyter notebook kernel state (variables) as additional context
  • 1.88: supports locked scrolling to sync scrolling of side-by-side windows

• Sat, Mar 30, 2024. browser.new is a good example of a browser agent. It slowly but independently does a good job of achieving the result. Example: What crew is common in Ingrid Bergman - Cary Grant films? #code-agents #prompt-engineering

• Wed, Feb 28, 2024. SourceGraph is the default platform for private code completion & search #ai-coding-tools #code-agents #future #github #markdown

• Sun, Feb 11, 2024. Two pass generation is a clever technique to get multiple SEQUENTIAL answers in a single API request. For example the schema {'code', 'optimized_code'} will generate code and then optimize it. #ai-coding-tools #code-agents #future #optimization #prompt-engineering

• Sun, Jan 28, 2024. AppAgent is an LLM that can navigate mobile / web apps #code-agents #future #llm-ops

• Sun, Jan 28, 2024. Retrieval Centric Generation is an emerging alternative to RAG, where the LLM is explicitly built to leverage external knowledge. SimplyRetrieve is an early implementation. #code-agents #future

• Sun, Jan 7, 2024. CodeGPT is an alternative to Github Copilot that can use any LLM. #ai-coding-tools #chatgpt #code-agents #future #github #llm-ops

• Mon, Dec 11, 2023. ast-grep is a semgrep alternative that focuses on code refactoring rather than security. Comby is another such tool #ai-coding-tools #code-agents #github

• Thu, Dec 7, 2023. CodeAnt.ai is a VS Code plugin to detect code smells, refactor for modularity, to write docstrings and unit tests #ai-coding-tools #code-agents #github #markdown

• Thu, Nov 30, 2023. CoVA scrapes web pages via OCR #ai-coding-tools #code-agents #document-conversion

• Thu, Nov 30, 2023. When coding with LLMs, have SHORT, RELIABLE feedback loops. Ref #ai-coding-tools #automation #code-agents #future #llm-ops #optimization #prompt-engineering

• Sat, Nov 25, 2023. Quote from Jerry Liu: "RAG is a hack". It's engineered, not machine learnt, so it's suboptimal. We need an ML way of creating the context. Maybe fine tuning can be a way of CREATING the right context. But RAG can handle deterministic stuff like access control. #ai-coding-tools #code-agents #gpu

• Sat, Nov 25, 2023. Agents mimic programming primitives. Switch. While. Call a function. Print. #ai-coding-tools #automation #code-agents #prompt-engineering

• Tue, Nov 21, 2023. CoVA scrapes web pages using LLMs and visual information. #ai-coding-tools #code-agents

• Mon, Nov 6, 2023. microsoft/autogen enables multi-agent conversations. #automation #code-agents #future

• Mon, Nov 6, 2023. 06 Nov 2023: ChatGPT is slightly better that Github Copilot or CodeWhisperer #ai-coding-tools #chatgpt #code-agents #github #speech-to-text

• Sat, Nov 4, 2023. 04 Nov 2023: Running LLMs in production lists experiments to run. Validation CAN be automated! #code-agents #llm-ops

• Thu, Oct 26, 2023. 26 Oct 2023: ChatGPT AutoExpert is a great prompt mechanism for higher accuracy, context and control. Example #ai-coding-tools #automation #chatgpt #code-agents #prompt-engineering #speech-to-text #tts