NAME

VERSION

SYNOPSIS

INTRODUCTION: THE BENEFITS OF STATIC WEBSITES

Static websites have a lot of advantages, when serving data that changes rarely:

speed

security

deployment by copy

Dynamic websites have more to do with JavaScript than with POST or query strings. JavaScript code run on the client can take advantage of JSON files containing useful data. Updates to the data do not necessarily have to be performed on the public side of the site.

WRITING A PSGI APPLICATION FOR WALLFLOWER

The point of saving URLs from a PSGI application to files is not simply to make a static version of a fully dynamic site.

Unlike many static website generators, wallflower does not enforce any conventions on its users.

wallflower makes it very easy to write a static website using the web framework of your choice.

To make the most of a static website, there are a few simple rules to follow, listed below:

All URLs should have an extension

A PSGI/Plack application can specify the Content-Type returned for any URL content.

On the other hand, static servers use the file extension to decide what Content-Type to send for a given file. When unable to decide what the file content is, servers usually send application/octet-stream as the Content-Type.

Since the goal of a Wallflower application is to generate a static website, all URL pathnames should have an extension.

All responses should have a Content-Type header

Similarly, wallflower decides to check the body of a response for links it may contain based on its Content-Type header, as links only make sense for HTML and CSS files.

If the response has no Content-Type header, wallflower will miss some of the links, and thus not properly crawl the whole site.

Hide the non-static elements in a specific Plack environment

Because the website can be written with any modern web framework, it's also very easy to have URLs that reply to POST requests. Obviously, these pages cannot be saved on the static destination.

It's very easy to use the Plack environment to decide which pages to enable. By default, plackup sets the Plack environment to development, while wallflower sets it to deployment.

It's therefore possible to hide the dynamic parts of the application in the development environment, while only the static elements are reachable from the deployment environment.

Make all URLs eventually reachable from the root

By default, wallflower starts by loading /, and automatically and repeatedly follows all URLs found in HTML and CSS documents, until all reachable URLs have been processed.

The simplest way to generate the full static site is to make sure that all URLs can be reached by repeatedly following links from the root.

URL SEMANTICS COMPARED TO DIRECTORY SEMANTICS

A Plack application deals with URLs. Nothing prevents the application from treating /thunk and /thunk/ differently and returning different content bodies for them.

From the perspective of a filesystem, however, if thunk is a directory, then it is semantically equivalent to thunk/. And it is impossible to have both a file and a directory with the same name inside the same parent directory.

When dealing with a static site, the server maps the URLs to the filesystem. If thunk is a directory, the server usually redirects the client to thunk/ (using a 301 Moved Permanently response). Then the default file is picked for the content, traditionally thunk/index.html.

Because Wallflower does not know the conventions used by the Plack application it calls, it cannot decide if /thunk should be understood as a "file" or as a "directory" when generating the file name that will receive the content for that URL.

So, if your application treats /thunk and /thunk/ as identical, you should:

Always request /thunk/ when providing a list of URLs to wallflower. Otherwise you might end up with the thunk file already existing when it tries to create files under the thunk/ directory, or vice-versa.

Make sure that links provided by your application are always to /thunk/, so that when wallflower follows links automatically, we're back to the previous case.

Try to make the application reply with status 301 Moved Permanently to requests for thunk. This is what a well-behaved web server serving static pages will do when a user-agent requests a "directory" without a final /.

At this point, you know that an application that treats /thunk ("file") and /thunk/ ("directory") differently will not work with wallflower.