= Data Delivery =
Preparation and verification steps are on another [wiki:Internal/DeliveryCreation/LIDAR page] now.
=== Preparing hard disks for delivery ===
Plug in the external hard drive.
You will need to have root permissions before you start ('sudo su' and then type in your password).
Run dmesg to find device name. Listed at the bottom if just plugged in.
e.g
{{{
SSELinux: initialized (dev sdb, type fuseblk), uses genfs_contexts
}}}
or
{{{
sd 7:0:0:0: [sdb] 488397168 512-byte hardware sectors (250059 MB)
}}}
Device path is then /dev/sdb (not sdb1 etc, this indicates a partition on sdb)
'''Create a partition:[[BR]]'''
run mount to find the name of the partition you need to unmount e.g /dev/sdb1
Unmount the partition with umount /dev/device_name, e.g. umount /dev/sdb1 (if not already unmounted)[[BR]]
Run fdisk /dev/DEVICE_NAME (not partition)
enter 'p' to print partition table and check you have selected the correct disk[[BR]]
enter 'd' to delete the current partition[[BR]]
enter 'n' to create a new partition [[BR]]
enter 'p' to make new partition the primary partition. If it asks you to give a partition number press 1 and enter. Then press enter twice.[[BR]]
enter 'p' to print new partition table – if all seems fine enter 'w' to write
'''Format the disk:[[BR]]'''
To be on the safe side, run dmesg again to make sure device name hasn't changed. You should now see the partition listed as device_name1, e.g. sdb1[[BR]]
Unmount the partition.
Run mke2fs -j /dev/partition
'''Change permissions:[[BR]]'''
Unplug the disk and plug back in. The disk space will be located under /media/disk.
Make writable for everyone using chmod a+rwx /media/disk
[[BR]]
=== Copy over your data onto the disk ===
Top directory should be the one with the project code (from within the delivery directory).
Copy the data to /media/disk.
[[BR]]
=== Finalising hard disk ===
Set permissions and owner:
chmod a+rX,a-w -R /media/disk [[BR]]
chown root.root -R /media/disk
NOTE: Be sure to record the number of the hard disk (or giving it one if it does not yet have one) before packing it.
=== Cover letter ===
There should be a cover letter with all deliveries. Templates can be found in ~arsf/arsf_data/YYYY/delivery/
=== Data quality report ===
There should be a hard copy of the most recent data quality report included with all deliveries. Print off the most recent one from ~arsf/doc
=== Trac and website updating ===
1. Add a comment on the trac ticket for this project that this data has been delivered (describe what was sent and when).
1. Update the status database to reflect the delivered data (http://arsf-dan.nerc.ac.uk/status/addflight/editflight.php)
1. Update the [wiki:Internal/Disk_Locations page saying who has our disks] (if sent on disk)
1. Update the status spreadsheet (and record the time the project took you)
=== Email the PI ===
1. email them that you're putting the disk in the post and to ask for confirmation of receipt
1. Please CC to arsf-processing@pml.ac.uk to keep others informed
1. Please set a reply-to header to arsf-processing@pml.ac.uk to ensure replies don't go to personal mail
-----------------
'''Subject:'''
Notification of ARSF data delivery for
'''Reply-to and CC headers''':
arsf-processing@pml.ac.uk
'''Body:'''
(note you need to fill in PI, DATE, NOTES, TICKETNO, also mention if you aren't sending all their data at once)
{{{
Dear ,
--PICK ONE OF THE NEXT THREE SENTENCES (HDD, DVD, FTP)--
This is to notify you that we have just dispatched your ARSF data on a USB hard disk formatted with the Linux ext3 filesystem. Please let us know when the data arrive so we know not to resend. We'd appreciate it if you could copy the data onto your system and return the disk to us (see below for address) for reuse.
This is to notify you that we have just dispatched your ARSF data on DVDs. Please let us know when the data arrive so we know not to resend.
This is to notify you that we have placed your ARSF data on a FTP server accessible at . Please let us know when you have downloaded the data so we can reuse the space.
The delivery comprises:
- Specim Eagle flight lines taken on
- Specim Hawk flight lines taken on
- LIDAR flight lines taken on
Information about the processing of the project is included with the delivery, but our internal notes are also available at:
http://arsf-dan.nerc.ac.uk/trac/ticket/
Regards,
ARSF Data Analysis Node.
Plymouth Marine Laboratory,
Prospect Place,
Plymouth.
PL1 3DH.
UK.
Email: arsf-processing@pml.ac.uk
Tel: +44 (0)1752 633432
Fax: +44 (0)1752 633101
Web (NERC): http://arsf.nerc.ac.uk/
Web (processing wiki): http://arsf-dan.nerc.ac.uk/trac/
}}}
=== Next stage ===
1. Set the ticket component to "Archiving" and put a comment in the ticket that it's ready for local and NEODC archiving.
--------------------------------------------------------------------------------------------------------
= This section relates to burning data to DVD =
=== Burning the data ===
1. create an iso image with `mkisofs -R -udf -verbose -o /tmp/dvd.iso -V `
1. test the iso with `sudo mount -o ro,loop /tmp/dvd.iso /mnt/tmp` - mounts to /mnt/tmp, go look at it, then unmount with `sudo umount /mnt/tmp` (yes, that is umount not unmount). Create /mnt/tmp if it doesn't exist.
1. if it's ok, burn to CD/DVD with `sudo cdrecord dev=/dev/dvd -sao fs=100m driveropts=burnfree -v /tmp/dvd.iso`
1. clean up with `rm /tmp/dvd.iso`
1. check the dvd on another machine (ideally Windows)
==== Lightscribe ====
1. open the CD template from ~arsf/arsf_data/2007/delivery/cd_covers/arsf_cd_label_gimp_editable.xcf in gimp
1. lick on the text button in the toolbox, then click the GB... text and edit to reflect the correct project code
1. save as a .bmp file somewhere, e.g. ~/ipy0708214ef.bmp
1. Insert the disk (upside down) on the lightscribe machine (currently pmpc974) and run `4L-cli print /dev/sr0 ~/ipy0708214ef.bmp`
If it appears to be stuck on "Starting up", it may still be burning - give it time to complete. For a dense full disk picture, wait at least 45mins!
If the drive seems wrong, try `4L-cli enumerate` to list attached lightscribe compatible drives.