Ubuntu Wiki

NOTE: This page is part of the Ubuntu Specification process. Please check the status and details in Launchpad before editing. If the spec is Approved then you should contact the Assignee, or another knowledgeable person, before making changes.

• Launchpad entry: [https://features.launchpad.net/distros/ubuntu/+spec/metalink-iso-downloads metalink-iso-downloads]

• Created: 2007-02-26 by [https://launchpad.net/~albryan Ant]

• Contributors: [https://launchpad.net/~albryan Ant]

• Packages affected: None

Summary

Using Metalink for Ubuntu CD ISO downloads could increase availability, efficiency, and eliminate errors during download and repair corrupted files.

Rationale

Metalink can list FTP/HTTP/P2P sources for files and provide error free downloads. When dealing with large downloads, normally if there is an error and you are using FTP or HTTP then the download needs to be restarted from the beginning (double the bandwidth, a 600 MB transfer is now 1.2 GB). Most users do not know how to repair a download.

Metalink has the following advantages:

• List multiple FTP/HTTP/P2P sources for a download. (This allows for faster downloading with segmented multi-source downloads, if you want).
• Some ISPs and organizations don't allow P2P, so it's good to have the FTP/HTTP sources to fall back on.
• If one link or server fails, download automatically continues using another.
• Automatic full file checksum verification at end of transfer.
• Automatic error correction for downloads in progress and repairing of corrupted downloads (using optional chunk checksums/repair info/segment hashes).
• Ability to give certain mirrors or P2P sources priority.
• List location information (by country) for mirrors, so downloads can be filtered by location.
• Simplifies download page layout. (The current download page has 14 screens of mirrors. This can be reduced to 3 .metalinks).
• No server side changes or tracker necessary.
• GPLed Clients for Mac, Unix, and Windows, along with non-Free clients. (aria2 included in feisty).

More information is available here:

• http://www.metalinker.org/

• http://en.wikipedia.org/wiki/Metalink

Use cases

1. John is a non-technical Windows/Mac/Linux user. He wants to download an Ubuntu CD image from Ubuntu.com, all he needs to choose is his architecture and CD type (Desktop/Alternate/Server) and use the small Metalink client linked to from that page.

2. Harriet is using Firefox with a Metalink client extension, this downloads an Ubuntu CD image for her from the given metalink files.

3. Eric has an incredibly fast Internet connection. His computer uses multiple sources from the Ubuntu Metalink file to maximise his bandwidth usage.

4. Mary has an unreliable wireless connection. Downloading an Ubuntu CD image is a major time investment, and she does not want to keep restarting it on error. Metalink checks the image for her as it is downloaded and only redownloads what is needed, leaving Mary with an error-free Ubuntu CD image.

Scope

Reducing bandwidth costs in distributing Ubuntu online by using P2P and current mirror network more efficiently. Reduce support costs of dealing with corrupted and error downloads. Simplify download pages. Simplify download process for happier users.

Design

Implementation

For simplicity, [http://metalinks.sourceforge.net/ metalink tools] can be used. Or [http://download.packages.ro/perl-foundry/ RoPkg::Metalink] (Perl). If you want to get fancy, there's a patch to add Metalink creation to [http://wiki.osuosl.org/display/Bouncer/Home Bouncer].

Code

N/A

Data preservation and migration

N/A

Unresolved issues

[http://download.packages.ro/metalink/ Metalink @ Package Resources] does not contain chunk checksums/repair information for Ubuntu, Edubuntu, and Kubuntu ISOs yet, only full file checksums. Chunk checksums/repair information are being added now.

BoF agenda and discussion

CategorySpec