Debug Hadoop in HDInsight: Error messages

Introduction

The error messages itemized in this topic are provided to help the users of Hadoop in Azure HDInsight understand possible error conditions that they can encounter when administering the service using Azure PowerShell and to advise them on the steps which can be taken to recover from the error.

Some of these error messages could also be seen in the Azure portal when it is used to manage HDInsight clusters. But other error messages you might encounter there are less granular due to the constraints on the remedial actions possible in this context. Other error messages are provided in the contexts where the mitigation is obvious. If the constraints on parameters are violated, for example, the message pops-up in on the right side of the box where the value was entered. Here is a case where too many data nodes have been requested. The remedy is to reduce the number to an allowed value that is 22 or less.

The errors a user can encounter in Azure PowerShell or in the Azure Portal are listed alphabetically by name in the HDInsight Errors section where they are linked to an entry in the Discription and Mitigation of Errors section that provide the following information for the error:

Diagnosis and Mitigation of Errors

AtleastOneSqlMetastoreMustBeProvided

Description: Please provide Azure SQL database details for at least one component in order to use custom settings for Hive and Oozie metastores.

Mitigation: The user needs to supply a valid SQL Azure metastore and retry the request.

AzureRegionNotSupported

Description: Could not create cluster in region nameOfYourRegion. Use a valid HDInsight region and retry request.

Mitigation: Customer should create the cluster region that currently supports them: Southeast Asia, West Europe, North Europe, East US, or West US.

ClusterContainerRecordNotFound

Description: The server could not find the requested cluster record.

Mitigation: Retry the operation.

ClusterDnsNameInvalidReservedWord

Description: Cluster DNS name yourDnsName is invalid. Please ensure name starts and ends with alphanumeric and can only contain '-' special character

Mitigation: Make sure that you have used a valid DNS name for your cluster that starts and ends with alphanumeric and contains no special characters other than the dash '-' and then retry the operation.

ClusterNameUnavailable

Description: Cluster name yourClusterName is unavailable. Please pick another name.

Mitigation: The user should specify a clustername that is unique and does not exist and retry. If the user is using the portal, the UI will notify them if a cluster name is already being used during the create steps.

ClusterPasswordInvalid

Description: Cluster password is invalid. Password must be at least 10 characters long and must contain at least one number, uppercase letter, lowercase letter and special character with no spaces and should not contain the username as part of it.

HostedServiceCreationFailure

HostedServiceHasProductionDeployment

Description: Hosted Service nameOfYourHostedService already has a production deployment. A hosted service cannot contain multiple production deployments. Retry the request with a different cluster name.

Mitigation: Use a different cluster name and retry the request.

HostedServiceNotFound

Description: Hosted Service nameOfYourHostedService for the cluster could not be found.

Mitigation: If the cluster is in error state, delete it and then try again.

HostedServiceWithNoDeployment

Description: Hosted Service nameOfYourHostedService has no associated deployment.

Mitigation: If the cluster is in error state, delete it and then try again.

InsufficientResourcesCores

Description: The SubscriptionId yourSubscriptionId does not have cores left to create cluster yourClusterName. Required: resourcesRequired, Available: resourcesAvailable.

Mitigation: Free up resources in your subscription or increase the resources available to the subscription and try to create the cluster again.

InsufficientResourcesHostedServices

Description: Subscription ID yourSubscriptionId does not have quota for a new HostedService to create cluster yourClusterName.

Mitigation: Free up resources in your subscription or increase the resources available to the subscription and try to create the cluster again.

InvalidNodeSizeForDataNode

Mitigation: Specify the supported node size for the data node and retry the operation.

InvalidNodeSizeForHeadNode

Description: Invalid VM size for head node. Only 'ExtraLarge VM' size is supported for head node.

Mitigation: Specify the supported node size for the head node and retry the operation

InvalidRightsForDeploymentDeletion

Description: Subscription ID yourSubscriptionId being used does not have sufficient permissions to execute delete operation for cluster yourClusterName.

Mitigation: If the cluster is in error state, drop it and then try again.

InvalidStorageAccountBlobContainerName

Description: External storage account blob container name yourContainerName is invalid. Make sure name starts with a letter and contains only lowercase letters, numbers and dash.

Mitigation: Specify a valid storage account blob container name and retry the operation.

InvalidStorageAccountConfigurationSecretKey

Description: Configuration for external storage account yourStorageAccountName is required to have secret key details to be set.

Mitigation: Specify a valid secret key for the storage account and retry the operation.

InvalidVersionHeaderFormat

Description: Version header yourVersionHeader is not in valid format of yyyy-mm-dd.

Mitigation: Specify a valid format for the version-header and retry the request.

MoreThanOneHeadNode

Description: Invalid cluster configuration. Found more than one head node configuration.

Mitigation: Edit the configuration so that onloy one head node is specified.

OperationTimedOutRetryRequest

Description: The operation could not be completed within the permitted time or the maximum retry attempts possible. Please retry request.

Mitigation: Retry the request.

ParameterNullOrEmpty

Description: Parameter yourParameterName cannot be null or empty.

Mitigation: Specify a valid value for the parameter.

PreClusterCreationValidationFailure

Description: One or more of the cluster creation request inputs is not valid. Make sure the input values are correct and retry request.

Mitigation: Make sure the input values are correct and retry request.

RegionCapabilityNotAvailable

Description: Region capability not available for region yourRegionName and Subscription ID yourSubscriptionId.

Mitigation: Specify a region that supports HDInsight clusters. The publicly supported regions are: Southeast Asia, West Europe, North Europe, East US, or West US.

StorageAccountNotColocated

Description: Storage account yourStorageAccountName is in region currentRegionName. It should be same as the cluster region yourClusterRegionName.

Mitigation: Either specify a storage account in the same region that your cluster is in or if your data is already in the storage account, create a new cluster in the same region as the existing storage account. If you are using the portal, the UI will notify them of this issue in advance.

SubscriptionIdNotActive

Description: Given Subscription ID yourSubscriptionId is not active.

Mitigation: Re-activate your subscription or get a new valid subscription.

SubscriptionIdNotFound

Description: Subscription ID yourSubscriptionId could not be found.

Mitigation: Check that your subscription ID is valid and retry the operation.

UnableToResolveDNS

Mitigation: Supply a valid blob URL. The URL MUST be fully valid, including starting with http:// and ending in .com. The fully qualified URL can usually be found in the storage tab of the manage.windowsazure.com portal.

UnableToVerifyLocationOfResource

Description: Unable to verify location of resource yourDnsUrl. Please ensure the fully qualified URL for the blob endpoint is provided.

Mitigation: Supply a valid blob URL. The URL MUST be fully valid, including starting with http:// and ending in .com. The fully qualified URL can usually be found in the storage tab of the manage.windowsazure.com portal.

VersionCapabilityNotAvailable

Description: Version capability not available for version specifiedVersion and Subscription ID yourSubscriptionId.

Mitigation: Choose a version that is available and retry the operation.

VersionNotSupported

Description: Version specifiedVersion not supported.

Mitigation: Choose a version that is supported and retry the operation.

VersionNotSupportedInRegion

Description: Version specifiedVersion is not available in Azure region specifiedRegion.

Mitigation: Choose a version that is supported in the region specified and retry the operation.