From 16f6661062d939621b91a279a243116a15faf9f3 Mon Sep 17 00:00:00 2001 From: sami Date: Fri, 5 Sep 2025 14:33:26 +0100 Subject: [PATCH 1/2] Add AI development tools guide MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit This guide compiles Thoughtbot's collective experience with AI tools in development to save time and improve knowledge sharing. It summarizes: - Frequency of AI usage - AI models and tools being used - Where AI is used (editor, browser, terminal, etc.) - Tasks AI supports (coding, debugging, testing, code review, planning) - Prompting strategies employed - Agentic AI usage and associated tasks - Tools used by task How it works: 1. **Survey and gather input** – Once a quarter, the team provides input on which AI tools they are using, how they are using them, and what has or hasn’t worked. 2. **Create a shared guide** – Survey responses are collected here to give visibility into what people are actually using, allowing team members to learn from others’ experiences and decide what to experiment with themselves. This outcome is the result of the **Fusion-based AI task force**. - Initial creation of the AI task force: [How to get the best out of AI task force](https://hub.thoughtbot.com/messages/how-to-get-the-best-out-of-ai-task-force) - Link to the survey: [The AI Development Survey](https://hub.thoughtbot.com/messages/the-ai-development-survey) The guide is a living resource, updated regularly with survey input, to help team members learn from each other’s experiences rather than starting from scratch. Co-authored-by: Jose.blanco@thoughtbot.com Co-authored-by: rakesh@thoughtbot.com --- artificial-intelligence/README.md | 133 ++++++++++++++++++++++++++++++ 1 file changed, 133 insertions(+) create mode 100644 artificial-intelligence/README.md diff --git a/artificial-intelligence/README.md b/artificial-intelligence/README.md new file mode 100644 index 00000000..1689afc8 --- /dev/null +++ b/artificial-intelligence/README.md @@ -0,0 +1,133 @@ +This guide exists to save time by showing which AI tools are being used and how, so everyone can learn from collective experience rather than starting from scratch. + +AI is evolving quickly, and people at thoughtbot are experimenting with different tools in their work. Instead of everyone spending time evaluating tools on their own, this guide brings together our shared experiences so we can learn from each other and make faster, better-informed choices. + +This makes the guide a living resource, updated regularly to reflect how our use of AI is changing. It is not a fixed set of rules, but a practical reference that saves time, helps people get started more quickly, and ensures our decisions are built on collective experience. + +Here’s how it works: + • Survey and gather input: Once a quarter, we ask everyone what AI tools they are using, how they are using them, and what has or hasn’t worked. + • Create a shared guide: The survey responses are collected here to give visibility into what people are actually using. This lets everyone see the range of tools in play, learn from others’ experiences, and decide what they’d like to experiment with themselves. + +# AI in Development Survey Q3 2025 – Summary + +## 1. Frequency of AI Usage +| Frequency | Count | +|-----------|-------| +| Daily | 12 | +| A few times a week | 2 | +| Occasionally | 3 | +| Rarely | 1 | +| Never | 1 | + +> **Insight:** Most developers in the survey use AI daily in their work. + +--- + +## 2. AI Models Used +| AI Model | Count | +|----------|-------| +| OpenAI (GPT-3, GPT-4, DALL-E) | 12 | +| Anthropic (Claude) | 11 | +| Google AI (Gemini, LaMDA, PaLM) | 2 | +| Open Source Models | 1 | +| CodeRabbit | 1 | + +> **Insight:** OpenAI and Anthropic are the dominant AI models among respondents. + +--- + +## 3. AI Tools / Software Used +| Tool / Software | Count | +|----------------|-------| +| ChatGPT | 12 | +| GitHub Copilot | 7 | +| Claude Code | 6 | +| Cursor | 3 | +| Roo Code | 1 | +| gptel in Emacs | 1 | +| Other | 4 | + +> **Insight:** ChatGPT is the most commonly used AI tool, followed by Copilot and Claude Code. + +--- + +## 4. Where AI is Used +| Location | Count | +|---------|-------| +| Inside the code editor | 12 | +| In the browser | 8 | +| In the terminal | 5 | +| Native apps | 2 | +| ChatGPT software/app | 2 | +| Sometimes in desktop apps | 1 | + +> **Insight:** Developers mostly use AI integrated into their code editor, with secondary use in browsers or terminals. + +--- + +## 5. Tasks AI is Used For +| Task | Count | +|------|-------| +| Writing code | 14 | +| Debugging code | 11 | +| Writing tests | 8 | +| Explaining unfamiliar code | 11 | +| Planning features / architecture | 8 | +| Writing commit messages | 2 | +| Generating documentation | 3 | +| Reminders / recalling knowledge | 1 | +| Autocomplete | 1 | +| Finding best practices / options | 1 | + +> **Insight:** Core programming tasks like writing code, debugging, and understanding code are the most common AI applications. + +--- + +## 6. Prompting Strategies +| Prompt Strategy | Count | +|----------------|-------| +| No specific strategy | 5 | +| Zero-shot prompting | 4 | +| Few-shot prompting | 5 | +| Chain-of-thought prompting | 2 | +| Persona-based prompting | 3 | +| Constraint-based prompting | 5 | +| Iterative prompting | 8 | +| Asking clarifying questions | 7 | +| Using templates / pre-defined prompts | 2 | +| Giving hard constraints (e.g., tests must pass) | 1 | + +> **Insight:** Iterative prompting and asking clarifying questions are highly used strategies. Many developers combine multiple strategies. + +--- + +## 7. Agentic AI Usage +| Usage | Count | +|-------|-------| +| Yes, frequently | 3 | +| Yes, occasionally | 3 | +| No, not yet | 10 | +| Never | 1 | + +**Agentic AI Tasks:** +- Automated refactoring across multiple files +- Generating end-to-end features from a high-level description +- Automated testing and bug fixing workflows +- Intelligent code migration/upgrades +- Research and exploration of new technologies + +> **Insight:** Most developers are **not yet using agentic AI**, but those who do focus on automation and feature generation. + +--- + +## 8. AI Tools by Task +| Task | Tools | +|------|-------| +| **Writing Code** | ChatGPT, Copilot, Claude, Cursor, Other | +| **Debugging** | ChatGPT, Copilot, Claude, Cursor, Other | +| **Writing Tests** | Copilot, Claude, Cursor, Other | +| **Code Review** | Copilot, Claude, Other | +| **Planning & Architecture** | ChatGPT, Claude, Other | +| **Researching** | ChatGPT, Cursor, Other | + +> **Insight:** ChatGPT and Copilot dominate coding and debugging, while Claude is frequently used for planning, testing, and research. From 79b3f0ecdb5216ca027ec9d0f83a790be5cfc757 Mon Sep 17 00:00:00 2001 From: Sami <84500175+samithoughtbot@users.noreply.github.com> Date: Fri, 12 Sep 2025 14:11:51 +0100 Subject: [PATCH 2/2] Update insight statement in README.md --- artificial-intelligence/README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/artificial-intelligence/README.md b/artificial-intelligence/README.md index 1689afc8..47431e42 100644 --- a/artificial-intelligence/README.md +++ b/artificial-intelligence/README.md @@ -19,7 +19,7 @@ Here’s how it works: | Rarely | 1 | | Never | 1 | -> **Insight:** Most developers in the survey use AI daily in their work. +> **Insight:** Most people in the survey use AI daily in their work. ---