copilot-arena

[dense goblet]

A quick update! Our paper is out!

https://x.com/iamwaynechi/status/1896996806481109377

Wayne Chi (@iamwaynechi) on X

What do developers 𝘳𝘦𝘢𝘭𝘭𝘺 think of AI coding assistants?

In October, we launched @CopilotArena to collect user preferences on real dev workflows. After months of live service, we’re here to share our findings in our recent preprint.

Here's what we have learned /🧵

X · Mar 4, 2025, 6:50 PM

[leaden marten]

额

[foggy arrow]

what

[white sandal]

latest Copilot Arena update! https://x.com/CopilotArena/status/1900584541170860497

Copilot Arena (@CopilotArena) on X

New #1 Leaders of Code Edit Leaderboard:
Strong performance from both Claude 3.7 Sonnet and Gemini-2.0-Pro! Congratulations to @AnthropicAI and @GoogleDeepMind 🥇

We also release new live leaderboard interface✨. You can now easily toggle between code completion and code edit.

X · Mar 14, 2025, 4:27 PM

[deft aurora]

• Very often Copilot Arena offers suggestions when I don't need them. Then it disrupt my workflow because I'm constantly hitting ESC instead of writing the code.
• Often when I actually need suggestions it does nothing.

-> Is it possible to turn off automatic completion and fire the completion request manually with some keybinding (e.g. CTRL+SHIFT+SPACE)?

[gloomy token]

yes it is possible ^

[deft aurora]

How?

[dense goblet]

@deft aurora You can!

1. Go into the extension settings and disable "Arena: Enable Automatic Tab Autocomplete".
2. We use the inbuilt "@command:editor.action.inlineSuggest.trigger" command to trigger a suggestion. You can add a hotkey/keyboard shortcut of your choice to this. You can just search for this in your keyboard shortcuts.

Please let me know if you need any more help 🙂

[amber bramble]

@woeful valve could you add code indexing and a codebase to the copilot arena extension?

[deft aurora]

It works, thank you very much! ☺️

[woeful valve]

cc @dense goblet !

[amber bramble]

@dense goblet please

[dense goblet]

Codebase wide indexing is a current WIP!

[amber bramble]

Ok and maybe model choosing?

[amber bramble]

@dense goblet @woeful valve can we also get a bolt.new styled interface for webdev?

[tender summit]

I can give anyone access to github spark if it helps (for ui inspiration, it sucks at everything else)

also you can just use bolt.diy

[amber bramble]

@tender summit what is github spark

[tender summit]

I didn't mean anyone as in regular user I meant anyone developing for lmarena

[amber bramble]

still interesting

[regal frost]

Hi there.

I haven't seen this being asked over the new channel: is there a way to make use of copilot-arena with Neovim?

[noble panther]

Idk, but there's a Neovim plugin for VSCode that connects to your actual Neovim.

[worldly burrow]

<:warning:892823499205406760> Channel locked

Site outage, will turn back on when resolved.

@pineapple.___. · Sep 3, 2025, 2:57 PM

[worldly burrow]

<:success:865860339278413864> Channel unlocked

Welcome back :ablobwave:

@pineapple.___. · Sep 3, 2025, 4:01 PM

[worldly burrow]

<:warning:892823499205406760> Channel locked

@pineapple.___. · May 12, 2026, 2:53 PM