Making configuration/installation automatable

Details

Description

Currently, we still have installation instructions which ask people to edit the hive-site.xml,etc. This is not really feasible for automatability. Hadoop install/setup scripts have recently started taking command line arguments to set up appropriately.

Made changes to the installation shell script provided above to work for rpm and deb packages. Minor changes in the rpm-spec file and the deb postinst file. Replaced file update-hcatalog-env.sh contents with those of the hcat-configure.sh. In the file hcat_server.sh changed HIVE_SITE_XML to point to correct hive location. In the file hcat-config.sh changed DEFAULT_CONF_DIR to point to the right location. Also changed the permissions for the hive-site.xml in the above script from 700 to 755.

Vikram Dixit K
added a comment - 13/Jan/12 23:46 Made changes to the installation shell script provided above to work for rpm and deb packages. Minor changes in the rpm-spec file and the deb postinst file. Replaced file update-hcatalog-env.sh contents with those of the hcat-configure.sh. In the file hcat_server.sh changed HIVE_SITE_XML to point to correct hive location. In the file hcat-config.sh changed DEFAULT_CONF_DIR to point to the right location. Also changed the permissions for the hive-site.xml in the above script from 700 to 755.

a) Has --install option to do things like setting up log dir, pid dir,etc (also ignores --output-env and --output-site when --install is specified, because it places them automatically in the conf dir) – this is so we can replace hcat_server_install.sh functionality
b) has --kerberos_realm , defaults to hcat/$

Sushanth Sowmyan
added a comment - 18/Nov/11 23:01 Also,
a) Has --install option to do things like setting up log dir, pid dir,etc (also ignores --output-env and --output-site when --install is specified, because it places them automatically in the conf dir) – this is so we can replace hcat_server_install.sh functionality
b) has --kerberos_realm , defaults to hcat/$
{METASTORE_HOST}
@$
{REALM}
if realm is specified and --kerberos_principal is not specified.
(metastore host determined elsewhere)
c) --dbname option added

Above mimics actual values from rpm-based installation on box using an
unsecure cluster, and replaces hcat-env.sh and hive-site.xml in
CONF_DIR (be careful!) Alternatively, you can use the --output-env and
--output-site parameters and move yourself if you want to verify/test

I took an initial stab at this, and this is tested/deployed for rpm-based installations, as a replacement for our current hcat-env-update.sh. We need to test with non-rpm-based installs, and if so, make this change.

Sushanth Sowmyan
added a comment - 18/Nov/11 22:58 I took an initial stab at this, and this is tested/deployed for rpm-based installations, as a replacement for our current hcat-env-update.sh. We need to test with non-rpm-based installs, and if so, make this change.