Skip to content

Conversation

@crazy-max
Copy link
Member

@crazy-max crazy-max commented Jul 21, 2022

closes #1054

also needs to update docker/docker to a60b458 (22.06 branch) otherwise
build breaks since docker/cli#3512 with:

# github.com/docker/cli/cli/flags
vendor/github.com/docker/cli/cli/flags/common.go:40:37: undefined: client.EnvOverrideCertPath
vendor/github.com/docker/cli/cli/flags/common.go:41:37: undefined: client.EnvTLSVerify
vendor/github.com/docker/cli/cli/flags/common.go:89:76: undefined: client.EnvOverrideHost

needs also to update github.com/spf13/cobra to v1.5.0 otherwise
build breaks with:

# github.com/docker/cli/cli-plugins/plugin
vendor/github.com/docker/cli/cli-plugins/plugin/plugin.go:130:4: unknown field 'HiddenDefaultCmd' in struct literal of type cobra.CompletionOptions

Signed-off-by: CrazyMax crazy-max@users.noreply.github.com

@crazy-max
Copy link
Member Author

@thaJeztah Maybe I should wait for docker/cli#3713 🤔

@thaJeztah
Copy link
Member

docker/cli#3713 was merged (note that I updated it to latest docker/docker in the v22.06 branch as well)

"github.com/docker/buildx/util/platformutil"
"github.com/docker/cli/cli/config"
"github.com/docker/docker/pkg/urlutil"
"github.com/docker/docker/builder/remotecontext/urlutil"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should look at replacing this with something from BuildKit, e.g. https://github.com/moby/buildkit/blob/df49b648c8bfef657ba99543390516a3f518d22a/util/gitutil/git_protocol.go#L18

And/or move this package to BuildKit.

The documentation I put in the packege may be nice to preserve though, so if there's no equivalent in BuildKit; perhaps at least copy the docs; https://github.com/moby/moby/blob/7624f8aeb1836cd75a0912d9614930e8a59eaf4e/builder/remotecontext/urlutil/urlutil.go#L24-L75

tonistiigi
tonistiigi previously approved these changes Jul 21, 2022
github.com/spf13/cobra v1.0.0/go.mod h1:/6GTrnGXV9HjY+aR4k0oJ5tcvakLuG6EuKReYlHNrgE=
github.com/spf13/cobra v1.2.1 h1:+KmjbUw1hriSNMF55oPrkZcb27aECyrj8V2ytv7kWDw=
github.com/spf13/cobra v1.2.1/go.mod h1:ExllRjgxM/piMAM+3tAZvg8fsklGAf3tPfi+i8t68Nk=
github.com/spf13/cobra v1.5.0 h1:X+jTBEBqF0bHN+9cSMgmfuvv2VHJ9ezmFNf9Y/XstYU=
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This doesn't introduce docker/cli#3621 ?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated bench results in https://github.com/crazy-max/docker-cli-bench to take that PR into account as well as latest changes from docker/cli (docker/cli@f1615fa) and it looks like it's actually slightly improved compared to v0.8.2:

docker buildx version:

  • v0.8.2 ~392ms
  • crazy-max/buildx#update-docker-cli ~364ms

But a bit worse compared to current changes on master branch:

docker buildx version:

  • docker/buildx#master ~352ms
  • crazy-max/buildx#update-docker-cli ~364ms

Full bench:

BuildxVersion/buildx-0-v0.8.2-docker-19.03.15-32                                                                            524ms ± 0%
BuildxVersion/buildx-0-v0.8.2-docker-20.10.0-32                                                                             482ms ± 0%
BuildxVersion/buildx-0-v0.8.2-docker-20.10.12-32                                                                            489ms ± 0%
BuildxVersion/buildx-0-v0.8.2-docker-20.10.17-32                                                                            488ms ± 0%
BuildxVersion/buildx-0-v0.8.2-docker-22.xx-0-2b4ffb301bb1cdd1adeb321807e10a9c656f346e-32                                    295ms ± 0%
BuildxVersion/buildx-0-v0.8.2-docker-22.xx-1-a09e61a247656c780d2ae487a276ea1761ceb85c-32                                    383ms ± 0%
BuildxVersion/buildx-0-v0.8.2-docker-22.xx-2-84b86e23b7f520b0bb956df88331d6c8d472ce0e-32                                    362ms ± 0%
BuildxVersion/buildx-0-v0.8.2-docker-22.xx-3-c59773f1551a8fd289538efc82274332f31f8c19-32                                    390ms ± 0%
BuildxVersion/buildx-0-v0.8.2-docker-22.xx-4-f1615facb1ca44e4336ab20e621315fc2cfb845a-32                                    392ms ± 0%
BuildxVersion/buildx-1-701c548e46348da2958104907c9572ea7ce6ab52-docker-19.03.15-32                                          491ms ± 0%
BuildxVersion/buildx-1-701c548e46348da2958104907c9572ea7ce6ab52-docker-20.10.0-32                                           456ms ± 0%
BuildxVersion/buildx-1-701c548e46348da2958104907c9572ea7ce6ab52-docker-20.10.12-32                                          474ms ± 0%
BuildxVersion/buildx-1-701c548e46348da2958104907c9572ea7ce6ab52-docker-20.10.17-32                                          457ms ± 0%
BuildxVersion/buildx-1-701c548e46348da2958104907c9572ea7ce6ab52-docker-22.xx-0-2b4ffb301bb1cdd1adeb321807e10a9c656f346e-32  275ms ± 0%
BuildxVersion/buildx-1-701c548e46348da2958104907c9572ea7ce6ab52-docker-22.xx-1-a09e61a247656c780d2ae487a276ea1761ceb85c-32  350ms ± 0%
BuildxVersion/buildx-1-701c548e46348da2958104907c9572ea7ce6ab52-docker-22.xx-2-84b86e23b7f520b0bb956df88331d6c8d472ce0e-32  351ms ± 0%
BuildxVersion/buildx-1-701c548e46348da2958104907c9572ea7ce6ab52-docker-22.xx-3-c59773f1551a8fd289538efc82274332f31f8c19-32  359ms ± 0%
BuildxVersion/buildx-1-701c548e46348da2958104907c9572ea7ce6ab52-docker-22.xx-4-f1615facb1ca44e4336ab20e621315fc2cfb845a-32  352ms ± 0%
BuildxVersion/buildx-2-update-docker-cli-docker-19.03.15-32                                                                 494ms ± 0%
BuildxVersion/buildx-2-update-docker-cli-docker-20.10.0-32                                                                  444ms ± 0%
BuildxVersion/buildx-2-update-docker-cli-docker-20.10.12-32                                                                 488ms ± 0%
BuildxVersion/buildx-2-update-docker-cli-docker-20.10.17-32                                                                 452ms ± 0%
BuildxVersion/buildx-2-update-docker-cli-docker-22.xx-0-2b4ffb301bb1cdd1adeb321807e10a9c656f346e-32                         272ms ± 0%
BuildxVersion/buildx-2-update-docker-cli-docker-22.xx-1-a09e61a247656c780d2ae487a276ea1761ceb85c-32                         354ms ± 0%
BuildxVersion/buildx-2-update-docker-cli-docker-22.xx-2-84b86e23b7f520b0bb956df88331d6c8d472ce0e-32                         361ms ± 0%
BuildxVersion/buildx-2-update-docker-cli-docker-22.xx-3-c59773f1551a8fd289538efc82274332f31f8c19-32                         374ms ± 0%
BuildxVersion/buildx-2-update-docker-cli-docker-22.xx-4-f1615facb1ca44e4336ab20e621315fc2cfb845a-32                         364ms ± 0%

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Any idea what changed between v0.8 and master?

What about the times in buildx itself. I assume in your times the main bottleneck is in compose-cli to docker-cli to buildx redirect and not in buildx itself.

Is the difference because buildx doesn't enable completions?

Copy link
Member Author

@crazy-max crazy-max Jul 22, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Any idea what changed between v0.8 and master?

I will bisect and keep you posted

What about the times in buildx itself. I assume in your times the main bottleneck is in compose-cli to docker-cli to buildx redirect and not in buildx itself.

Here is the standalone bench result:

BuildxVersionStandalone/buildx-0-v0.8.2-32                                    489ms ± 0%
BuildxVersionStandalone/buildx-1-701c548e46348da2958104907c9572ea7ce6ab52-32  456ms ± 0%
BuildxVersionStandalone/buildx-2-update-docker-cli-32                         457ms ± 0%

Looks quite odd to me 🤔

Complete bench results: https://github.com/crazy-max/docker-cli-bench#readme

Is the difference because buildx doesn't enable completions?

Good point will take a look at this

Copy link
Member Author

@crazy-max crazy-max Jul 22, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Added v0.7.0 to bench results: https://github.com/crazy-max/docker-cli-bench#readme

BuildxVersionStandalone/buildx-0-v0.7.0-32                                      502ms ± 0%
BuildxVersionStandalone/buildx-1-v0.8.2-32                                      524ms ± 0%
BuildxVersionStandalone/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-32    501ms ± 0%
BuildxVersionStandalone/buildx-3-update-docker-cli-32                           492ms ± 0%

I will run bench tests on a barebone system without Docker Desktop to see how it behaves.

also needs to update docker/docker to a60b458 (22.06 branch) otherwise
build breaks since docker/cli#3512 with:

    # github.com/docker/cli/cli/flags
    vendor/github.com/docker/cli/cli/flags/common.go:40:37: undefined: client.EnvOverrideCertPath
    vendor/github.com/docker/cli/cli/flags/common.go:41:37: undefined: client.EnvTLSVerify
    vendor/github.com/docker/cli/cli/flags/common.go:89:76: undefined: client.EnvOverrideHost

needs also to update github.com/spf13/cobra to v1.5.0 otherwise
build breaks with:

    # github.com/docker/cli/cli-plugins/plugin
    vendor/github.com/docker/cli/cli-plugins/plugin/plugin.go:130:4: unknown field 'HiddenDefaultCmd' in struct literal of type cobra.CompletionOptions

Signed-off-by: CrazyMax <crazy-max@users.noreply.github.com>
@crazy-max crazy-max force-pushed the update-docker-cli branch from 50c81bf to b0deb8b Compare July 22, 2022 08:53
@crazy-max crazy-max changed the title vendor: update docker/cli to d84255c vendor: update docker/cli to f1615fa Jul 22, 2022
@crazy-max
Copy link
Member Author

crazy-max commented Jul 23, 2022

Doing tests on an M1 system with latest Docker Desktop (4.10.1) gives results that make more sense:

$ buildx version (standalone)

BuildxVersionStandalone/buildx-0-v0.7.0                                       23.6ms ± 0%
BuildxVersionStandalone/buildx-1-v0.8.2                                       23.8ms ± 0%
BuildxVersionStandalone/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52     18.5ms ± 0%
BuildxVersionStandalone/buildx-3-update-docker-cli                            18.0ms ± 0%

$ docker buildx version (docker/cli > buildx)

BuildxVersion/buildx-0-v0.7.0-docker-20.10.12                                                                             65.3ms ± 0%
BuildxVersion/buildx-0-v0.7.0-docker-20.10.17                                                                             65.1ms ± 0%
BuildxVersion/buildx-0-v0.7.0-docker-22.xx-0-2b4ffb301bb1cdd1adeb321807e10a9c656f346e                                     57.0ms ± 0%
BuildxVersion/buildx-0-v0.7.0-docker-22.xx-1-a09e61a247656c780d2ae487a276ea1761ceb85c                                      119ms ± 0%
BuildxVersion/buildx-0-v0.7.0-docker-22.xx-2-84b86e23b7f520b0bb956df88331d6c8d472ce0e                                      119ms ± 0%
BuildxVersion/buildx-0-v0.7.0-docker-22.xx-3-c59773f1551a8fd289538efc82274332f31f8c19                                      119ms ± 0%
BuildxVersion/buildx-0-v0.7.0-docker-22.xx-4-f1615facb1ca44e4336ab20e621315fc2cfb845a                                      118ms ± 0%
BuildxVersion/buildx-1-v0.8.2-docker-20.10.12                                                                             65.5ms ± 0%
BuildxVersion/buildx-1-v0.8.2-docker-20.10.17                                                                             65.7ms ± 0%
BuildxVersion/buildx-1-v0.8.2-docker-22.xx-0-2b4ffb301bb1cdd1adeb321807e10a9c656f346e                                     57.9ms ± 0%
BuildxVersion/buildx-1-v0.8.2-docker-22.xx-1-a09e61a247656c780d2ae487a276ea1761ceb85c                                      119ms ± 0%
BuildxVersion/buildx-1-v0.8.2-docker-22.xx-2-84b86e23b7f520b0bb956df88331d6c8d472ce0e                                      120ms ± 0%
BuildxVersion/buildx-1-v0.8.2-docker-22.xx-3-c59773f1551a8fd289538efc82274332f31f8c19                                      119ms ± 0%
BuildxVersion/buildx-1-v0.8.2-docker-22.xx-4-f1615facb1ca44e4336ab20e621315fc2cfb845a                                      119ms ± 0%
BuildxVersion/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-docker-20.10.12                                           53.7ms ± 0%
BuildxVersion/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-docker-20.10.17                                           53.9ms ± 0%
BuildxVersion/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-docker-22.xx-0-2b4ffb301bb1cdd1adeb321807e10a9c656f346e   45.7ms ± 0%
BuildxVersion/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-docker-22.xx-1-a09e61a247656c780d2ae487a276ea1761ceb85c    100ms ± 0%
BuildxVersion/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-docker-22.xx-2-84b86e23b7f520b0bb956df88331d6c8d472ce0e    100ms ± 0%
BuildxVersion/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-docker-22.xx-3-c59773f1551a8fd289538efc82274332f31f8c19    100ms ± 0%
BuildxVersion/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-docker-22.xx-4-f1615facb1ca44e4336ab20e621315fc2cfb845a    100ms ± 0%
BuildxVersion/buildx-3-update-docker-cli-docker-20.10.12                                                                  53.4ms ± 0%
BuildxVersion/buildx-3-update-docker-cli-docker-20.10.17                                                                  54.1ms ± 0%
BuildxVersion/buildx-3-update-docker-cli-docker-22.xx-0-2b4ffb301bb1cdd1adeb321807e10a9c656f346e                          45.7ms ± 0%
BuildxVersion/buildx-3-update-docker-cli-docker-22.xx-1-a09e61a247656c780d2ae487a276ea1761ceb85c                           101ms ± 0%
BuildxVersion/buildx-3-update-docker-cli-docker-22.xx-2-84b86e23b7f520b0bb956df88331d6c8d472ce0e                           100ms ± 0%
BuildxVersion/buildx-3-update-docker-cli-docker-22.xx-3-c59773f1551a8fd289538efc82274332f31f8c19                           100ms ± 0%
BuildxVersion/buildx-3-update-docker-cli-docker-22.xx-4-f1615facb1ca44e4336ab20e621315fc2cfb845a                           100ms ± 0%

$ docker version (compose-cli > docker cli)

CliVersionViaComposeCli/compose-cli-0-1.0.26-env-docker-20.10.12                                                           72.7ms ± 0%
CliVersionViaComposeCli/compose-cli-0-1.0.26-env-docker-20.10.17                                                           70.8ms ± 0%
CliVersionViaComposeCli/compose-cli-0-1.0.26-env-docker-22.xx-0-2b4ffb301bb1cdd1adeb321807e10a9c656f346e                   61.8ms ± 0%
CliVersionViaComposeCli/compose-cli-0-1.0.26-env-docker-22.xx-1-a09e61a247656c780d2ae487a276ea1761ceb85c                    119ms ± 0%
CliVersionViaComposeCli/compose-cli-0-1.0.26-env-docker-22.xx-2-84b86e23b7f520b0bb956df88331d6c8d472ce0e                    120ms ± 0%
CliVersionViaComposeCli/compose-cli-0-1.0.26-env-docker-22.xx-3-c59773f1551a8fd289538efc82274332f31f8c19                    120ms ± 0%
CliVersionViaComposeCli/compose-cli-0-1.0.26-env-docker-22.xx-4-f1615facb1ca44e4336ab20e621315fc2cfb845a                    119ms ± 0%
CliVersionViaComposeCli/compose-cli-1-build-metrics-futureproof2-docker-20.10.12                                           62.6ms ± 0%
CliVersionViaComposeCli/compose-cli-1-build-metrics-futureproof2-docker-20.10.17                                           63.1ms ± 0%
CliVersionViaComposeCli/compose-cli-1-build-metrics-futureproof2-docker-22.xx-0-2b4ffb301bb1cdd1adeb321807e10a9c656f346e   52.5ms ± 0%
CliVersionViaComposeCli/compose-cli-1-build-metrics-futureproof2-docker-22.xx-1-a09e61a247656c780d2ae487a276ea1761ceb85c    112ms ± 0%
CliVersionViaComposeCli/compose-cli-1-build-metrics-futureproof2-docker-22.xx-2-84b86e23b7f520b0bb956df88331d6c8d472ce0e    112ms ± 0%
CliVersionViaComposeCli/compose-cli-1-build-metrics-futureproof2-docker-22.xx-3-c59773f1551a8fd289538efc82274332f31f8c19    110ms ± 0%
CliVersionViaComposeCli/compose-cli-1-build-metrics-futureproof2-docker-22.xx-4-f1615facb1ca44e4336ab20e621315fc2cfb845a    112ms ± 0%
CliVersionViaComposeCli/compose-cli-2-go-1.18-test-docker-20.10.12                                                         62.1ms ± 0%
CliVersionViaComposeCli/compose-cli-2-go-1.18-test-docker-20.10.17                                                         62.5ms ± 0%
CliVersionViaComposeCli/compose-cli-2-go-1.18-test-docker-22.xx-0-2b4ffb301bb1cdd1adeb321807e10a9c656f346e                 53.1ms ± 0%
CliVersionViaComposeCli/compose-cli-2-go-1.18-test-docker-22.xx-1-a09e61a247656c780d2ae487a276ea1761ceb85c                  111ms ± 0%
CliVersionViaComposeCli/compose-cli-2-go-1.18-test-docker-22.xx-2-84b86e23b7f520b0bb956df88331d6c8d472ce0e                  113ms ± 0%
CliVersionViaComposeCli/compose-cli-2-go-1.18-test-docker-22.xx-3-c59773f1551a8fd289538efc82274332f31f8c19                  113ms ± 0%
CliVersionViaComposeCli/compose-cli-2-go-1.18-test-docker-22.xx-4-f1615facb1ca44e4336ab20e621315fc2cfb845a                  113ms ± 0%
CliVersionViaComposeCli/compose-cli-3-go-1.18-docker-20.10.12                                                              63.8ms ± 0%
CliVersionViaComposeCli/compose-cli-3-go-1.18-docker-20.10.17                                                              60.5ms ± 0%
CliVersionViaComposeCli/compose-cli-3-go-1.18-docker-22.xx-0-2b4ffb301bb1cdd1adeb321807e10a9c656f346e                      51.6ms ± 0%
CliVersionViaComposeCli/compose-cli-3-go-1.18-docker-22.xx-1-a09e61a247656c780d2ae487a276ea1761ceb85c                       112ms ± 0%
CliVersionViaComposeCli/compose-cli-3-go-1.18-docker-22.xx-2-84b86e23b7f520b0bb956df88331d6c8d472ce0e                       112ms ± 0%
CliVersionViaComposeCli/compose-cli-3-go-1.18-docker-22.xx-3-c59773f1551a8fd289538efc82274332f31f8c19                       113ms ± 0%
CliVersionViaComposeCli/compose-cli-3-go-1.18-docker-22.xx-4-f1615facb1ca44e4336ab20e621315fc2cfb845a                       112ms ± 0%

$ docker buildx version (compose-cli > docker/cli > buildx)

BuildxVersionViaComposeCli/buildx-0-v0.7.0-compose-cli-0-1.0.26-env-docker-20.10.12-8                                                                                             102ms ± 0%
BuildxVersionViaComposeCli/buildx-0-v0.7.0-compose-cli-0-1.0.26-env-docker-20.10.17-8                                                                                             101ms ± 0%
BuildxVersionViaComposeCli/buildx-0-v0.7.0-compose-cli-0-1.0.26-env-docker-22.xx-0-2b4ffb301bb1cdd1adeb321807e10a9c656f346e-8                                                    92.8ms ± 0%
BuildxVersionViaComposeCli/buildx-0-v0.7.0-compose-cli-0-1.0.26-env-docker-22.xx-1-a09e61a247656c780d2ae487a276ea1761ceb85c-8                                                     154ms ± 0%
BuildxVersionViaComposeCli/buildx-0-v0.7.0-compose-cli-0-1.0.26-env-docker-22.xx-2-84b86e23b7f520b0bb956df88331d6c8d472ce0e-8                                                     155ms ± 0%
BuildxVersionViaComposeCli/buildx-0-v0.7.0-compose-cli-0-1.0.26-env-docker-22.xx-3-c59773f1551a8fd289538efc82274332f31f8c19-8                                                     154ms ± 0%
BuildxVersionViaComposeCli/buildx-0-v0.7.0-compose-cli-0-1.0.26-env-docker-22.xx-4-f1615facb1ca44e4336ab20e621315fc2cfb845a-8                                                     154ms ± 0%
BuildxVersionViaComposeCli/buildx-0-v0.7.0-compose-cli-1-build-metrics-futureproof2-docker-20.10.12-8                                                                             109ms ± 0%
BuildxVersionViaComposeCli/buildx-0-v0.7.0-compose-cli-1-build-metrics-futureproof2-docker-20.10.17-8                                                                             109ms ± 0%
BuildxVersionViaComposeCli/buildx-0-v0.7.0-compose-cli-1-build-metrics-futureproof2-docker-22.xx-0-2b4ffb301bb1cdd1adeb321807e10a9c656f346e-8                                    93.8ms ± 0%
BuildxVersionViaComposeCli/buildx-0-v0.7.0-compose-cli-1-build-metrics-futureproof2-docker-22.xx-1-a09e61a247656c780d2ae487a276ea1761ceb85c-8                                     154ms ± 0%
BuildxVersionViaComposeCli/buildx-0-v0.7.0-compose-cli-1-build-metrics-futureproof2-docker-22.xx-2-84b86e23b7f520b0bb956df88331d6c8d472ce0e-8                                     154ms ± 0%
BuildxVersionViaComposeCli/buildx-0-v0.7.0-compose-cli-1-build-metrics-futureproof2-docker-22.xx-3-c59773f1551a8fd289538efc82274332f31f8c19-8                                     155ms ± 0%
BuildxVersionViaComposeCli/buildx-0-v0.7.0-compose-cli-1-build-metrics-futureproof2-docker-22.xx-4-f1615facb1ca44e4336ab20e621315fc2cfb845a-8                                     154ms ± 0%
BuildxVersionViaComposeCli/buildx-0-v0.7.0-compose-cli-2-go-1.18-test-docker-20.10.12-8                                                                                           107ms ± 0%
BuildxVersionViaComposeCli/buildx-0-v0.7.0-compose-cli-2-go-1.18-test-docker-20.10.17-8                                                                                           106ms ± 0%
BuildxVersionViaComposeCli/buildx-0-v0.7.0-compose-cli-2-go-1.18-test-docker-22.xx-0-2b4ffb301bb1cdd1adeb321807e10a9c656f346e-8                                                  92.8ms ± 0%
BuildxVersionViaComposeCli/buildx-0-v0.7.0-compose-cli-2-go-1.18-test-docker-22.xx-1-a09e61a247656c780d2ae487a276ea1761ceb85c-8                                                   153ms ± 0%
BuildxVersionViaComposeCli/buildx-0-v0.7.0-compose-cli-2-go-1.18-test-docker-22.xx-2-84b86e23b7f520b0bb956df88331d6c8d472ce0e-8                                                   153ms ± 0%
BuildxVersionViaComposeCli/buildx-0-v0.7.0-compose-cli-2-go-1.18-test-docker-22.xx-3-c59773f1551a8fd289538efc82274332f31f8c19-8                                                   153ms ± 0%
BuildxVersionViaComposeCli/buildx-0-v0.7.0-compose-cli-2-go-1.18-test-docker-22.xx-4-f1615facb1ca44e4336ab20e621315fc2cfb845a-8                                                   154ms ± 0%
BuildxVersionViaComposeCli/buildx-0-v0.7.0-compose-cli-3-go-1.18-docker-20.10.12-8                                                                                               93.5ms ± 0%
BuildxVersionViaComposeCli/buildx-0-v0.7.0-compose-cli-3-go-1.18-docker-20.10.17-8                                                                                               93.9ms ± 0%
BuildxVersionViaComposeCli/buildx-0-v0.7.0-compose-cli-3-go-1.18-docker-22.xx-0-2b4ffb301bb1cdd1adeb321807e10a9c656f346e-8                                                       85.7ms ± 0%
BuildxVersionViaComposeCli/buildx-0-v0.7.0-compose-cli-3-go-1.18-docker-22.xx-1-a09e61a247656c780d2ae487a276ea1761ceb85c-8                                                        147ms ± 0%
BuildxVersionViaComposeCli/buildx-0-v0.7.0-compose-cli-3-go-1.18-docker-22.xx-2-84b86e23b7f520b0bb956df88331d6c8d472ce0e-8                                                        148ms ± 0%
BuildxVersionViaComposeCli/buildx-0-v0.7.0-compose-cli-3-go-1.18-docker-22.xx-3-c59773f1551a8fd289538efc82274332f31f8c19-8                                                        147ms ± 0%
BuildxVersionViaComposeCli/buildx-0-v0.7.0-compose-cli-3-go-1.18-docker-22.xx-4-f1615facb1ca44e4336ab20e621315fc2cfb845a-8                                                        146ms ± 0%
BuildxVersionViaComposeCli/buildx-1-v0.8.2-compose-cli-0-1.0.26-env-docker-20.10.12-8                                                                                             103ms ± 0%
BuildxVersionViaComposeCli/buildx-1-v0.8.2-compose-cli-0-1.0.26-env-docker-20.10.17-8                                                                                             102ms ± 0%
BuildxVersionViaComposeCli/buildx-1-v0.8.2-compose-cli-0-1.0.26-env-docker-22.xx-0-2b4ffb301bb1cdd1adeb321807e10a9c656f346e-8                                                    94.5ms ± 0%
BuildxVersionViaComposeCli/buildx-1-v0.8.2-compose-cli-0-1.0.26-env-docker-22.xx-1-a09e61a247656c780d2ae487a276ea1761ceb85c-8                                                     156ms ± 0%
BuildxVersionViaComposeCli/buildx-1-v0.8.2-compose-cli-0-1.0.26-env-docker-22.xx-2-84b86e23b7f520b0bb956df88331d6c8d472ce0e-8                                                     155ms ± 0%
BuildxVersionViaComposeCli/buildx-1-v0.8.2-compose-cli-0-1.0.26-env-docker-22.xx-3-c59773f1551a8fd289538efc82274332f31f8c19-8                                                     155ms ± 0%
BuildxVersionViaComposeCli/buildx-1-v0.8.2-compose-cli-0-1.0.26-env-docker-22.xx-4-f1615facb1ca44e4336ab20e621315fc2cfb845a-8                                                     156ms ± 0%
BuildxVersionViaComposeCli/buildx-1-v0.8.2-compose-cli-1-build-metrics-futureproof2-docker-20.10.12-8                                                                             109ms ± 0%
BuildxVersionViaComposeCli/buildx-1-v0.8.2-compose-cli-1-build-metrics-futureproof2-docker-20.10.17-8                                                                             107ms ± 0%
BuildxVersionViaComposeCli/buildx-1-v0.8.2-compose-cli-1-build-metrics-futureproof2-docker-22.xx-0-2b4ffb301bb1cdd1adeb321807e10a9c656f346e-8                                    92.4ms ± 0%
BuildxVersionViaComposeCli/buildx-1-v0.8.2-compose-cli-1-build-metrics-futureproof2-docker-22.xx-1-a09e61a247656c780d2ae487a276ea1761ceb85c-8                                     152ms ± 0%
BuildxVersionViaComposeCli/buildx-1-v0.8.2-compose-cli-1-build-metrics-futureproof2-docker-22.xx-2-84b86e23b7f520b0bb956df88331d6c8d472ce0e-8                                     154ms ± 0%
BuildxVersionViaComposeCli/buildx-1-v0.8.2-compose-cli-1-build-metrics-futureproof2-docker-22.xx-3-c59773f1551a8fd289538efc82274332f31f8c19-8                                     156ms ± 0%
BuildxVersionViaComposeCli/buildx-1-v0.8.2-compose-cli-1-build-metrics-futureproof2-docker-22.xx-4-f1615facb1ca44e4336ab20e621315fc2cfb845a-8                                     155ms ± 0%
BuildxVersionViaComposeCli/buildx-1-v0.8.2-compose-cli-2-go-1.18-test-docker-20.10.12-8                                                                                           108ms ± 0%
BuildxVersionViaComposeCli/buildx-1-v0.8.2-compose-cli-2-go-1.18-test-docker-20.10.17-8                                                                                           107ms ± 0%
BuildxVersionViaComposeCli/buildx-1-v0.8.2-compose-cli-2-go-1.18-test-docker-22.xx-0-2b4ffb301bb1cdd1adeb321807e10a9c656f346e-8                                                  92.6ms ± 0%
BuildxVersionViaComposeCli/buildx-1-v0.8.2-compose-cli-2-go-1.18-test-docker-22.xx-1-a09e61a247656c780d2ae487a276ea1761ceb85c-8                                                   154ms ± 0%
BuildxVersionViaComposeCli/buildx-1-v0.8.2-compose-cli-2-go-1.18-test-docker-22.xx-2-84b86e23b7f520b0bb956df88331d6c8d472ce0e-8                                                   154ms ± 0%
BuildxVersionViaComposeCli/buildx-1-v0.8.2-compose-cli-2-go-1.18-test-docker-22.xx-3-c59773f1551a8fd289538efc82274332f31f8c19-8                                                   154ms ± 0%
BuildxVersionViaComposeCli/buildx-1-v0.8.2-compose-cli-2-go-1.18-test-docker-22.xx-4-f1615facb1ca44e4336ab20e621315fc2cfb845a-8                                                   154ms ± 0%
BuildxVersionViaComposeCli/buildx-1-v0.8.2-compose-cli-3-go-1.18-docker-20.10.12-8                                                                                               95.3ms ± 0%
BuildxVersionViaComposeCli/buildx-1-v0.8.2-compose-cli-3-go-1.18-docker-20.10.17-8                                                                                               94.4ms ± 0%
BuildxVersionViaComposeCli/buildx-1-v0.8.2-compose-cli-3-go-1.18-docker-22.xx-0-2b4ffb301bb1cdd1adeb321807e10a9c656f346e-8                                                       86.5ms ± 0%
BuildxVersionViaComposeCli/buildx-1-v0.8.2-compose-cli-3-go-1.18-docker-22.xx-1-a09e61a247656c780d2ae487a276ea1761ceb85c-8                                                        149ms ± 0%
BuildxVersionViaComposeCli/buildx-1-v0.8.2-compose-cli-3-go-1.18-docker-22.xx-2-84b86e23b7f520b0bb956df88331d6c8d472ce0e-8                                                        147ms ± 0%
BuildxVersionViaComposeCli/buildx-1-v0.8.2-compose-cli-3-go-1.18-docker-22.xx-3-c59773f1551a8fd289538efc82274332f31f8c19-8                                                        148ms ± 0%
BuildxVersionViaComposeCli/buildx-1-v0.8.2-compose-cli-3-go-1.18-docker-22.xx-4-f1615facb1ca44e4336ab20e621315fc2cfb845a-8                                                        147ms ± 0%
BuildxVersionViaComposeCli/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-compose-cli-0-1.0.26-env-docker-20.10.12-8                                                          90.7ms ± 0%
BuildxVersionViaComposeCli/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-compose-cli-0-1.0.26-env-docker-20.10.17-8                                                          91.0ms ± 0%
BuildxVersionViaComposeCli/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-compose-cli-0-1.0.26-env-docker-22.xx-0-2b4ffb301bb1cdd1adeb321807e10a9c656f346e-8                  81.4ms ± 0%
BuildxVersionViaComposeCli/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-compose-cli-0-1.0.26-env-docker-22.xx-1-a09e61a247656c780d2ae487a276ea1761ceb85c-8                   136ms ± 0%
BuildxVersionViaComposeCli/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-compose-cli-0-1.0.26-env-docker-22.xx-2-84b86e23b7f520b0bb956df88331d6c8d472ce0e-8                   137ms ± 0%
BuildxVersionViaComposeCli/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-compose-cli-0-1.0.26-env-docker-22.xx-3-c59773f1551a8fd289538efc82274332f31f8c19-8                   137ms ± 0%
BuildxVersionViaComposeCli/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-compose-cli-0-1.0.26-env-docker-22.xx-4-f1615facb1ca44e4336ab20e621315fc2cfb845a-8                   137ms ± 0%
BuildxVersionViaComposeCli/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-compose-cli-1-build-metrics-futureproof2-docker-20.10.12-8                                          98.6ms ± 0%
BuildxVersionViaComposeCli/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-compose-cli-1-build-metrics-futureproof2-docker-20.10.17-8                                          98.1ms ± 0%
BuildxVersionViaComposeCli/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-compose-cli-1-build-metrics-futureproof2-docker-22.xx-0-2b4ffb301bb1cdd1adeb321807e10a9c656f346e-8  83.4ms ± 0%
BuildxVersionViaComposeCli/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-compose-cli-1-build-metrics-futureproof2-docker-22.xx-1-a09e61a247656c780d2ae487a276ea1761ceb85c-8   139ms ± 0%
BuildxVersionViaComposeCli/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-compose-cli-1-build-metrics-futureproof2-docker-22.xx-2-84b86e23b7f520b0bb956df88331d6c8d472ce0e-8   137ms ± 0%
BuildxVersionViaComposeCli/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-compose-cli-1-build-metrics-futureproof2-docker-22.xx-3-c59773f1551a8fd289538efc82274332f31f8c19-8   137ms ± 0%
BuildxVersionViaComposeCli/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-compose-cli-1-build-metrics-futureproof2-docker-22.xx-4-f1615facb1ca44e4336ab20e621315fc2cfb845a-8   136ms ± 0%
BuildxVersionViaComposeCli/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-compose-cli-2-go-1.18-test-docker-20.10.12-8                                                        94.4ms ± 0%
BuildxVersionViaComposeCli/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-compose-cli-2-go-1.18-test-docker-20.10.17-8                                                        94.3ms ± 0%
BuildxVersionViaComposeCli/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-compose-cli-2-go-1.18-test-docker-22.xx-0-2b4ffb301bb1cdd1adeb321807e10a9c656f346e-8                80.2ms ± 0%
BuildxVersionViaComposeCli/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-compose-cli-2-go-1.18-test-docker-22.xx-1-a09e61a247656c780d2ae487a276ea1761ceb85c-8                 136ms ± 0%
BuildxVersionViaComposeCli/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-compose-cli-2-go-1.18-test-docker-22.xx-2-84b86e23b7f520b0bb956df88331d6c8d472ce0e-8                 135ms ± 0%
BuildxVersionViaComposeCli/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-compose-cli-2-go-1.18-test-docker-22.xx-3-c59773f1551a8fd289538efc82274332f31f8c19-8                 135ms ± 0%
BuildxVersionViaComposeCli/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-compose-cli-2-go-1.18-test-docker-22.xx-4-f1615facb1ca44e4336ab20e621315fc2cfb845a-8                 135ms ± 0%
BuildxVersionViaComposeCli/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-compose-cli-3-go-1.18-docker-20.10.12-8                                                             81.5ms ± 0%
BuildxVersionViaComposeCli/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-compose-cli-3-go-1.18-docker-20.10.17-8                                                             82.0ms ± 0%
BuildxVersionViaComposeCli/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-compose-cli-3-go-1.18-docker-22.xx-0-2b4ffb301bb1cdd1adeb321807e10a9c656f346e-8                     74.5ms ± 0%
BuildxVersionViaComposeCli/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-compose-cli-3-go-1.18-docker-22.xx-1-a09e61a247656c780d2ae487a276ea1761ceb85c-8                      130ms ± 0%
BuildxVersionViaComposeCli/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-compose-cli-3-go-1.18-docker-22.xx-2-84b86e23b7f520b0bb956df88331d6c8d472ce0e-8                      129ms ± 0%
BuildxVersionViaComposeCli/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-compose-cli-3-go-1.18-docker-22.xx-3-c59773f1551a8fd289538efc82274332f31f8c19-8                      129ms ± 0%
BuildxVersionViaComposeCli/buildx-2-701c548e46348da2958104907c9572ea7ce6ab52-compose-cli-3-go-1.18-docker-22.xx-4-f1615facb1ca44e4336ab20e621315fc2cfb845a-8                      129ms ± 0%
BuildxVersionViaComposeCli/buildx-3-update-docker-cli-compose-cli-0-1.0.26-env-docker-20.10.12-8                                                                                 90.4ms ± 0%
BuildxVersionViaComposeCli/buildx-3-update-docker-cli-compose-cli-0-1.0.26-env-docker-20.10.17-8                                                                                 90.3ms ± 0%
BuildxVersionViaComposeCli/buildx-3-update-docker-cli-compose-cli-0-1.0.26-env-docker-22.xx-0-2b4ffb301bb1cdd1adeb321807e10a9c656f346e-8                                         81.5ms ± 0%
BuildxVersionViaComposeCli/buildx-3-update-docker-cli-compose-cli-0-1.0.26-env-docker-22.xx-1-a09e61a247656c780d2ae487a276ea1761ceb85c-8                                          136ms ± 0%
BuildxVersionViaComposeCli/buildx-3-update-docker-cli-compose-cli-0-1.0.26-env-docker-22.xx-2-84b86e23b7f520b0bb956df88331d6c8d472ce0e-8                                          137ms ± 0%
BuildxVersionViaComposeCli/buildx-3-update-docker-cli-compose-cli-0-1.0.26-env-docker-22.xx-3-c59773f1551a8fd289538efc82274332f31f8c19-8                                          137ms ± 0%
BuildxVersionViaComposeCli/buildx-3-update-docker-cli-compose-cli-0-1.0.26-env-docker-22.xx-4-f1615facb1ca44e4336ab20e621315fc2cfb845a-8                                          138ms ± 0%
BuildxVersionViaComposeCli/buildx-3-update-docker-cli-compose-cli-1-build-metrics-futureproof2-docker-20.10.12-8                                                                 97.0ms ± 0%
BuildxVersionViaComposeCli/buildx-3-update-docker-cli-compose-cli-1-build-metrics-futureproof2-docker-20.10.17-8                                                                 98.2ms ± 0%
BuildxVersionViaComposeCli/buildx-3-update-docker-cli-compose-cli-1-build-metrics-futureproof2-docker-22.xx-0-2b4ffb301bb1cdd1adeb321807e10a9c656f346e-8                         80.9ms ± 0%
BuildxVersionViaComposeCli/buildx-3-update-docker-cli-compose-cli-1-build-metrics-futureproof2-docker-22.xx-1-a09e61a247656c780d2ae487a276ea1761ceb85c-8                          136ms ± 0%
BuildxVersionViaComposeCli/buildx-3-update-docker-cli-compose-cli-1-build-metrics-futureproof2-docker-22.xx-2-84b86e23b7f520b0bb956df88331d6c8d472ce0e-8                          135ms ± 0%
BuildxVersionViaComposeCli/buildx-3-update-docker-cli-compose-cli-1-build-metrics-futureproof2-docker-22.xx-3-c59773f1551a8fd289538efc82274332f31f8c19-8                          136ms ± 0%
BuildxVersionViaComposeCli/buildx-3-update-docker-cli-compose-cli-1-build-metrics-futureproof2-docker-22.xx-4-f1615facb1ca44e4336ab20e621315fc2cfb845a-8                          136ms ± 0%
BuildxVersionViaComposeCli/buildx-3-update-docker-cli-compose-cli-2-go-1.18-test-docker-20.10.12-8                                                                               92.9ms ± 0%
BuildxVersionViaComposeCli/buildx-3-update-docker-cli-compose-cli-2-go-1.18-test-docker-20.10.17-8                                                                               93.5ms ± 0%
BuildxVersionViaComposeCli/buildx-3-update-docker-cli-compose-cli-2-go-1.18-test-docker-22.xx-0-2b4ffb301bb1cdd1adeb321807e10a9c656f346e-8                                       79.9ms ± 0%
BuildxVersionViaComposeCli/buildx-3-update-docker-cli-compose-cli-2-go-1.18-test-docker-22.xx-1-a09e61a247656c780d2ae487a276ea1761ceb85c-8                                        134ms ± 0%
BuildxVersionViaComposeCli/buildx-3-update-docker-cli-compose-cli-2-go-1.18-test-docker-22.xx-2-84b86e23b7f520b0bb956df88331d6c8d472ce0e-8                                        135ms ± 0%
BuildxVersionViaComposeCli/buildx-3-update-docker-cli-compose-cli-2-go-1.18-test-docker-22.xx-3-c59773f1551a8fd289538efc82274332f31f8c19-8                                        135ms ± 0%
BuildxVersionViaComposeCli/buildx-3-update-docker-cli-compose-cli-2-go-1.18-test-docker-22.xx-4-f1615facb1ca44e4336ab20e621315fc2cfb845a-8                                        136ms ± 0%
BuildxVersionViaComposeCli/buildx-3-update-docker-cli-compose-cli-3-go-1.18-docker-20.10.12-8                                                                                    82.3ms ± 0%
BuildxVersionViaComposeCli/buildx-3-update-docker-cli-compose-cli-3-go-1.18-docker-20.10.17-8                                                                                    83.7ms ± 0%
BuildxVersionViaComposeCli/buildx-3-update-docker-cli-compose-cli-3-go-1.18-docker-22.xx-0-2b4ffb301bb1cdd1adeb321807e10a9c656f346e-8                                            75.0ms ± 0%
BuildxVersionViaComposeCli/buildx-3-update-docker-cli-compose-cli-3-go-1.18-docker-22.xx-1-a09e61a247656c780d2ae487a276ea1761ceb85c-8                                             129ms ± 0%
BuildxVersionViaComposeCli/buildx-3-update-docker-cli-compose-cli-3-go-1.18-docker-22.xx-2-84b86e23b7f520b0bb956df88331d6c8d472ce0e-8                                             129ms ± 0%
BuildxVersionViaComposeCli/buildx-3-update-docker-cli-compose-cli-3-go-1.18-docker-22.xx-3-c59773f1551a8fd289538efc82274332f31f8c19-8                                             128ms ± 0%
BuildxVersionViaComposeCli/buildx-3-update-docker-cli-compose-cli-3-go-1.18-docker-22.xx-4-f1615facb1ca44e4336ab20e621315fc2cfb845a-8                                             129ms ± 0%

For compose-cli tests the branch build-metrics-futureproof2 does not shell out with docker version but uses debug/buildinfo to retrieve the cli version: crazy-max/compose-cli@ec18d50 which reduces the call to <1ms and branch 1.0.26-env is the latest stable.

@tonistiigi I updated the test suite so you can run it on your system if you want: https://github.com/crazy-max/docker-cli-bench

@tonistiigi tonistiigi merged commit 9ff5fb0 into docker:master Jul 25, 2022
@crazy-max crazy-max deleted the update-docker-cli branch July 25, 2022 19:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants