Difference between revisions of "CSC352 Notes 2013"
| Line 84: | Line 84: | ||
** Dumps are here: [ftp://ftpmirror.your.org/pub/wikimedia/imagedumps/tarballs/fulls/ ftp://ftpmirror.your.org/pub/wikimedia/imagedumps/tarballs/fulls/] | ** Dumps are here: [ftp://ftpmirror.your.org/pub/wikimedia/imagedumps/tarballs/fulls/ ftp://ftpmirror.your.org/pub/wikimedia/imagedumps/tarballs/fulls/] | ||
** The size of all the all the media media for 20121201 is 172 GB for the local dumps, and 2.153 TB for the remote dumps. Total = 2.3 TB. | ** The size of all the all the media media for 20121201 is 172 GB for the local dumps, and 2.153 TB for the remote dumps. Total = 2.3 TB. | ||
| + | enwiki-20121201-local-media-2.tar 22.5 GB 12/6/12 12:00:00 AM | ||
| + | enwiki-20121201-local-media-3.tar 25.6 GB 12/6/12 12:00:00 AM | ||
| + | enwiki-20121201-local-media-4.tar 21.5 GB 12/6/12 12:00:00 AM | ||
| + | enwiki-20121201-local-media-5.tar 20.7 GB 12/6/12 12:00:00 AM | ||
| + | enwiki-20121201-local-media-6.tar 22.4 GB 12/6/12 12:00:00 AM | ||
| + | enwiki-20121201-local-media-7.tar 18.2 GB 12/6/12 12:00:00 AM | ||
| + | enwiki-20121201-local-media-8.tar 24.4 GB 12/6/12 12:00:00 AM | ||
| + | enwiki-20121201-local-media-9.tar 1.3 GB 12/6/12 12:00:00 AM | ||
| + | enwiki-20121201-remote-media-1.tar 89.9 GB 12/6/12 12:00:00 AM | ||
| + | enwiki-20121201-remote-media-10.tar 90.5 GB 12/7/12 12:00:00 AM | ||
| + | enwiki-20121201-remote-media-11.tar 88.2 GB 12/7/12 12:00:00 AM | ||
| + | enwiki-20121201-remote-media-12.tar 88.4 GB 12/7/12 12:00:00 AM | ||
| + | enwiki-20121201-remote-media-13.tar 89.6 GB 12/7/12 12:00:00 AM | ||
| + | enwiki-20121201-remote-media-14.tar 88.6 GB 12/7/12 12:00:00 AM | ||
| + | enwiki-20121201-remote-media-15.tar 91.2 GB 12/7/12 12:00:00 AM | ||
| + | enwiki-20121201-remote-media-16.tar 91.3 GB 12/7/12 12:00:00 AM | ||
| + | enwiki-20121201-remote-media-17.tar 89.4 GB 12/7/12 12:00:00 AM | ||
| + | enwiki-20121201-remote-media-18.tar 90.0 GB 12/7/12 12:00:00 AM | ||
| + | enwiki-20121201-remote-media-19.tar 90.0 GB 12/7/12 12:00:00 AM | ||
| + | enwiki-20121201-remote-media-2.tar 90.5 GB 12/6/12 12:00:00 AM | ||
| + | enwiki-20121201-remote-media-20.tar 90.1 GB 12/7/12 12:00:00 AM | ||
| + | enwiki-20121201-remote-media-21.tar 91.2 GB 12/7/12 12:00:00 AM | ||
| + | enwiki-20121201-remote-media-22.tar 89.3 GB 12/7/12 12:00:00 AM | ||
| + | enwiki-20121201-remote-media-23.tar 91.0 GB 12/7/12 12:00:00 AM | ||
| + | enwiki-20121201-remote-media-24.tar 44.3 GB 12/7/12 12:00:00 AM | ||
| + | enwiki-20121201-remote-media-24.tar.bz2 42.6 GB 12/7/12 12:00:00 AM | ||
| + | enwiki-20121201-remote-media-3.tar 88.6 GB 12/6/12 12:00:00 AM | ||
| + | enwiki-20121201-remote-media-4.tar 90.0 GB 12/6/12 12:00:00 AM | ||
| + | enwiki-20121201-remote-media-5.tar 90.9 GB 12/6/12 12:00:00 AM | ||
| + | enwiki-20121201-remote-media-6.tar 88.3 GB 12/6/12 12:00:00 AM | ||
| + | enwiki-20121201-remote-media-7.tar 89.6 GB 12/6/12 12:00:00 AM | ||
| + | enwiki-20121201-remote-media-8.tar 90.4 GB 12/7/12 12:00:00 AM | ||
| + | enwiki-20121201-remote-media-9.tar 89.7 GB 12/7/12 12:00:00 AM | ||
| + | |||
| + | * To get them, store list above in a text file (listOfTarArchives.txt) and use wget: | ||
| + | |||
| + | for i in `cat listOfTarArchives.txt | cut -f 1 | grep -v bz2`; do | ||
| + | echo $i | ||
| + | wget ftp://ftpmirror.your.org/pub/wikimedia/imagedumps/tarballs/fulls/20121201/$i | ||
| + | done | ||
| + | |||
| + | * Total size should be 2.310 TB. | ||
---- | ---- | ||
