Xubuntu is a version of Ubuntu using the Xfce desktop, rather than Gnome or KDE. Xfce is smaller and faster, looks good, and has a full set of utilities.
With an external CD-ROM, you can install the .iso directly. Using a pendrive for the installation is another alternative.