Microsoft Azure template

The Microsoft Azure workbook template includes several flows that consolidate subscription, usage, and resource ownership information to a simple format that allows you to understand how to charge for the actual usage of specific Microsoft Azure services. This template is used in the CloudSmart-Now solution for Microsoft Azure.

imports resource-ownership data from the ResourceOwnership collection, and then creates lookup files that are used by later flows to associate owners and departments to specific resources. This flow is useful when you are not using fields in the Azure billing data to associate departments and owners with resources.

ImportServices

Collects raw Microsoft Azure usage data from the Azure1 collection, and then normalizes the unique measure names for each service to a common name (ResourceQtyConsumed). This consolidates the measurement columns for various Azure services to a single column, making it easier to read Cost and Rate usage data in HPE Consumption Analytics Portal. To ensure that it keeps only the data that is relevant and useful, the flow deletes all dimensions except for Product, ServiceInfo, and ServiceResource, and deletes all measures that have a value of 0. The flow then aggregates the transformed data and publishes it to your HPE Consumption Analytics Portal database

PublishData

Collects raw Microsoft Azure usage data from the Azure1 collection, and normalizes the unique measure names for each service to a common name (ResourceQtyConsumed). It then determines whether it should retrieve owner and department information from Microsoft Azure data or from data you entered in the ResourceOwnership.csv file, based on the the value of the UseOwnershipFile workbook parameter. If it uses the file, the flow obtains owner and department information from the lookup files created by the Ownership flow. If the flow cannot locate an owner or department, it sets the related Owner or Department dimension to Unknown.

The flow also calculates VM sizing data for Virtual Machine records, and then compares that data to standard VM sizes defined in the lookup tables you imported. For VMs that fall outside of the definitions in the lookup table, the flow marks those records as nonstandard. For more information, see VM sizing guidelines for CloudSmart-Now.

Imports non-standard VMs identified by the PublishData step, and then removes all measures, and dimensions other than VMType, ResourceID, Owner, and Department. For every non-standard VM, the flow generates an exception message visible in the Data > Processing > Monitoring area of HPE Consumption Analytics Portal.

ImportCustomers

Imports data from the PublishData dataset, and then removes all measures, and all dimensions other than Owner and Department. It aggregates and publishes Owner data, and the aggregates and publishes Department data.

HandleUnknowns

Alerts you about any resources that do not have assigned owners and departments. It begins by importing data from the PublishData dataset, removing all measures, and removing all dimensions except for ResourceGUID, Owner, and Department. The flow then scans the Owner and Department fields for a value of Unknown. For every Unknown value, the flow generates an exception message visible in the Data > Processing > Monitoring area of HPE Consumption Analytics Portal.

The Microsoft Azure Tags workbook template includes two flows that collect raw service and usage data from Microsoft Azure, and then transform and publish the data in HPE Consumption Analytics Portal. The template includes two additional flows to collect and process tag information.

Collects raw Microsoft Azure service data into HPE Consumption Analytics Portal. As part of its transformation process the flow renames the Product dimension to ComputedServiceName, which is later used in HPE Consumption Analytics Portal to list he name of each service. The flow also deletes all unnecessary dimensions, and all measures. The purpose of this flow is to transform and publish collected service data, so measures are not needed as part of this flow. Measurement data is processed in the PublishData flow, described below. The flow aggregates matching rows of data to speed processing and reduce storage needs for the transformed data in your HPE Consumption Analytics Portal database, and then publishes service names to HPE Consumption Analytics Portal.

PublishData

Collects raw Microsoft Azure usage data into HPE Consumption Analytics Portal, and then normalizes the unique measure names for each service to a common name (ResourceQtyConsumed). This consolidates the various measurement columns for various Azure services to a single column, making it easier to read Cost and Rate usage data in HPE Consumption Analytics Portal. The flow then publishes the transformed usage data to your HPE Consumption Analytics Portal database, allowing you to understand how to charge for the actual usage of the services collected by the ImportServices flow.

ClassicTags

Imports resource tags from the collection named apc_tags_group_collection. By default, the flow removes hidden tags, though you can disable the processor that hides those tags. The flow removes unnecessary dimensions, and then renames dimensions to show ResourceGroup andSubscriptionGuid data. Lastly, the flow aggregates tag data.

ModernTags

Imports resource and group tags from the collection named apc_tags_both_collection. By default, the flow shows hidden tags, though you can enable a processor that removes hidden tags. The flow removes unnecessary dimensions, and then renames dimensions to show ResourceGroup and Instance Id data.