Use the Tomcat Administration page to edit these properties in JNDI. Go to Tomcat Admin and click Tomcat Server -> Service -> Host -> Context (astrogrid-pal) -> Resources -> DataSources, click on the the context file, and fill in or change any properties in the text boxes to the right of the screen. Click "Commit Changes." This creates an XML file in $Tomcat/conf/Catalina/locahost with your updated properties. Astrogrid and Tomcat will always look for these properties in JNDI - any further changes made in a text editor to $Tomcat/webapps/warname/WEB-INF/classes/default.properties and $Tomcat/common/classes/astrogrid.properties will be ignored. (See note below.) * datacenter.querier.plugin * Important 4 lines:

Note: if you undeploy the PAL component or install a new version of Tomcat, the PAL properties will no longer be in JNDI. Open $Tomcat/common/classes/astrogrid.properties in the Tomcat Administration page again and click "commit changes" to add the properties to JNDI. For this reason, it is good practice to manually add any properties changes you make in JNDI to the $Tomcat/common/classes/astrogrid.properties file.

Note 2: if your PAL is named anything other than "pal.war", be sure to reflect this change in the astrogrid.properties file.

Note 3: The astrogrid.properties variable "datacenter.max.return" defines the maximum number of records that will be returned by PAL in response to a query, regardless of the query source. The default setting is 2000.

Workflow steps:

User sends ADQL query to PAL (query received by PAL web service). PAL has internal web service used for internal tests - results can be sent to local directory, URL, or email address. The public PAL CEA web service (inputs: ADQL, outputs: lookup identifier [registry identifier, ie ivo://org.filemanager]) sends query results to the lookup identifier. Lookup identifiers are specified in the portal workflow. They can be a directly specified filemanager (such as ivo://uk.ac.mssl/filemanager) OR a community-based name that will lookup a registered user's mySpace area (such as ivo://MSSL/Elizabeth since user Elizabeth is known to the MSSL community). Advanced - specify community user and filemanager - ivo://MSSL/Elizabeth#ivo://uk.ac.mssl/filemanager#ivo://uk.ac.roe/filestore

PAL CEA web service looks up which plugin is used to query data, ie, JDBC, FitsQuerier, EGSOQuerier - this is specified in the pal.config file.

ADQL is converted to SQL or XQuery, and query is submitted to the database. Results are returned as resultset and converted to VOTable. VOTable is returned to filemanager specified by lookup identifier

Query for fits files and receive List of URLs back

2 perl programs: findfits.pl and PrepareXML.pl inside ~griduser//downloads - find fits files and return list of URLs. (Can download from $Tomcat/webapps/servlets-examples/downloads.) findfits.pl searches for filenames and returns URLs for each file found (whether the machine is publicly accessible or not). PrepareXML.pl changes URLs (replaces non-publicly accessible machine name with a publicly accessible machine name) and calls a servlet to redirect files from non-public location (machine with no http access) to public location (machine with http access). Files are not actually transferred from one machine to another - they are simply redirected.

Building a Workflow

If there's a workflow currently loaded, move cursor to "File" on the toolbar and select "New". If not, i.e "new workflow" displayed in the "Name:" box, go to Step 5.

Click "OK" on the "Any unsaved workflow information will be removed..." pop-up.

Move cursor to "Edit" on the toolbar, then select "Insert step" -> "here".

Verify "Step" appended to "Sequence".

Select "Step" (highlighted with yellow box) and verify Step/Task panel displayed at the bottom of the webpage.

Click-on the --Select task-- dropdown menu, move cursor to chosen task (highlighted in blue) and click using left mouse button. Note: The dropdown menu displays a small fraction of the available registered tasks. Any task not shown in the list, such as the one used in the "pal_esdo" workflow to connect to the msslxx MySQL database ("astrogrid.mssl/pal_esdo/ceaApplication") will need to be manually entered.

Enter meaningful "Step name:" in the left of the Step/Task panel and click-on the "update step details" button.Wait while webpage is refreshed. Note: May be necessary to repeat step 13 as the "Step name" is sometimes lost at the first attempt.

Click-on workflow "Step".

Verify a step parameters box is displayed with "VOTABLE" and "Query" as inputs and "Result" as single output.

Click-on "Browse" button on the "Query" input line and verify the MySpace page is displayed.

Find and click-on desired query, verify that query is highlighted and that its name appears in the "Name:" box.

Click-on "OK".

Verify that the MySpace page is removed and the query input parameter now displays the MySpace pathname of the selected query.

Click-on "Browse" button on the "Result" output line and verify the MySpace page is displayed.

Find and click-on existing output file or type in the name of a new file into the "Name:".

Click on "OK".

Verify that the MySpace page is removed and the result output parameter now displays the pathname of the selected query.

Click on the appropriate folder icons in the mySpace browser until you see the name of your file.

Click the filename once to highlight in yellow.

Under "File" at the top of the mySpace broswer, select "Properties and Downloads". A dialogue box will open with details of your file.

Inside the dialogue box, click the link shown next to "Path" - your file should open in the same window.

To rename a file:

Under "File" at the top of the mySpace broswer, select "Rename".

Click on the appropriate folder icons in the mySpace browser until you see the name of your file.

Click the filename once to highlight in yellow. This will populate the "Location" and "Name" boxes at the top of the mySpace browser. Press "OK" - the browser should reload, showing a copy with the new name of your file.

To delete a file:

Click on the appropriate folder icons in the mySpace browser until you see the name of your file.

Click the filename once to highlight in yellow.

Choose "Delete" from the "File" menu. The browser should reload showing your mySpace area without the file.

Solar Examples

Search for MDI data

Get MDI data

SEC query

Solar Movie Maker tool

Solar Overlay tool

Generic Movie Maker

Registry

There are occasions when it is desirable to be able remove a registered component, such as when the component has been created accidentally, or added for experimental purposes but is no longer required. There is no facility for removing a resource from the Registry at present, although this feature is to be added in the near future.

If a component is no longer required, then the Resource status should be set to "inactive" to prevent it from being accidentally built into a workflow (although it will still appear in the Registry list) and the "title" modified to show that the component has been deprecated.

Portal Workflow

The dropdown Task menu at the foot of the Workflow page displays only a small fraction of the total number of registered components. If the task name is known but not displayed it can be entered alongside the "Task name:" label or selected from the browser.

Portal MySpace

Output files created by cancelled workflow jobs, i.e. jobs stopped before completion (successful or otherwise) cannot be deleted, moved or renamed.

Additional Support Software

Java

Download:http://java.sun.com/downloads/index.htmlInstallation: Download a JDK such as JSEE 1.4.2. Set environment variable JAVA_HOME to the location of the directory where the JDK software is installed (for example, c:\j2re1.4.2_03 or /usr/local/j2re1.4.2_03).

Tomcat

Tomcat is a free, open-source servlet container that works with the Apache webserver. Tomcat is also an EJB container, but Astrogrid software only uses the servlet container aspects. Other free servlet containers include Jetty and Resin.

Note: Set environment variable CATALINA_OPTS to specify the size of TOMCAT's working memory: this will affect the size of files that can be spooled from the AG server to MySpace.
For example, CATALINA_OPTS="-Xmx400M" will allocate 400 MB of memory to TOMCAT. Don't forget to export CATALINA_OPTS!

conf - contains config files. Note: Changes made to the config files in this directory do not require Tomcat to be restarted. This config file is picked up before changes inside the war directory /WEB-INF/web.xml. Protocol: make changes to $Tomcat/conf/Catalina/localhost/warname.xml or in Tomcat Administration - $Tomcat/webapps/warname/WEB-INF/web.xml is ignored (even after Tomcat restart). Also contains server.xml (contains port number configuration). Warname.xml files contain configuration properties.

webapps - contains .war files (Tomcat automatically unzips war files into directory structures). Once unzipped, war file can be renamed

inside war directory (ie, astro.war becomes /astro/), there is a WEB-INF/webapps.xml file - this will make a config file in the Tomcat "conf" directory, ie $Tomcat/conf/Catalina/localhost/astro.xml

in webapps/warname/WEB-INF/classes, look for astrogrid.properties file. This should be the last place that properties are searched for.

logs - directory containing Tomcat logs - catalina.out is particularly helpful as it holds a log of all Tomcat messages and errors.

Notes: After deploy, if warname.xml is not in $Tomcat/conf/Catalina/localhost/, go to Tomcat administration and click "commit changes" button.

Tomcat manager

Tomcat administration

Tomcat Server -> Service -> Host-> Context -> environment entries: click on any context name and change any type, value, or description in a context. Also, click under Context Actions to create and delete new properties. Note: in this page, value lengths are limited to 70 characters. For values containing more than 70 characters, edit warname.xml in $Tomcat/conf/Catalina/localhost.

CVS

Code repository containing Astrogrid source code - can be used to download code directly as an alternative to downloading .war files into $Tomcat/webapps.

Download - should be installed on linux / unix machines
Installation - :pserver register for /astrogrid/community/pal, then run maven astrogrid-install-artifact. cvs checkout Header (do this once), cvs update-/astrogrid (do this N times to get updates)

eXist data base

EXist is an XML database (as opposed to a relational database like MySQL, Oracle, etc). XML files can be stored in eXist and queried with the XQuery syntax. XQuery tutorial:

Download:http://exist.sourceForge.net/
Install: Can install as a resource external to Tomcat - download zipfile and unzip to location external to Tomcat. Run on a hidden port, such as 9080 - this hides access to outside world. Zip file contains /thirdparties/etc/jetty.xml - can change port numbers.