Benchmark the Profiles in the Profiler

Benchmark the profiled AI models in the Profiler to view real-time responses side-by-side.

Overview

Benchmark selected AI models side-by-side using the identical Prompt. Each AI model runs in its own profile during the test to display real-time responses.

Note that usage costs apply for the AI models run in the Profiler.

See this best practice when selecting the AI model in each profile prior to benchmarking.

Benchmark the Profiles

  1. View the Profiler.

  2. Add a profile for each AI model to benchmark.

  3. Select the AI model in each profile as necessary.

  4. In the prompt shown as using the $ symbol within any of the profiles, enter the Prompt for benchmarking. The same Prompt displays in the other profile panes as you enter your Prompt.

  5. Select the Enter key on your keyboard.

The benchmark test runs in real-time. Faster-responding AI models display their responses before slower-responding models. Benchmarking data display for each profile after the test completes.

Last updated