[Webinar] Discover key trends and best practices in Kubernetes observability with DevOps expert, Viktor Farcic.Register now
Our recognition in the inaugural Gartner MQ for DEM

AWS Storage Gateway Monitoring

Overview

AWS Storage Gateway is a hybrid cloud storage service that connects your on-premises infrastructure with AWS cloud storage. It allows seamless and secure data transfer between your local environment and AWS storage services, providing virtually unlimited cloud storage for applications running both on-premises and in the cloud.

AWS Storage Gateway File Share enable on-premises and cloud applications to store and retrieve files as objects in Amazon S3. This service is ideal for file-based workloads that need scalable cloud storage. File Share provide:

  • Secure, scalable storage with seamless integration to Amazon S3
  • Support for NFS and SMB protocols for easy file access
  • Local caching for frequently accessed files to reduce latency

AWS Storage Gateway Volume provide block storage that on-premises applications can access using the iSCSI (Internet Small Computer System Interface) protocol. This service allows you to create storage Volume in AWS while maintaining local access for applications.

  • Cached Volume: Store data in AWS while caching frequently accessed data locally for low-latency access.
  • Stored Volume: Keep all data on-premises while asynchronously backing up snapshots to AWS.

These services together help organizations extend their on-premises storage capabilities into the cloud, improving scalability, reliability, and cost efficiency.

Creating a new AWS Storage Gateway monitor

To learn how to create a new AWS Storage Gateway monitor, refer here.

Monitored Parameters

Go to the Monitors Category View by clicking the Monitors tab. Click on the Storage Gateway/Storage Gateway File Share/Storage Gateway Volume instance available under Amazon in the Cloud Apps section. Displayed is the Amazon Route Health Checks bulk configuration view distributed into three tabs:

  • Availability tab gives the availability history for the past 24 hours or 30 days.
  • Performance tab gives the health status and events for the past 24 hours or 30 days.
  • List view tab enables you to perform bulk admin configurations.

Click on the monitor name to see all the Amazon Storage Gateway metrics listed under the following tabs:

Click on the monitor name to see all the Amazon Storage Gateway File Share metrics listed under the following tabs:

Click on the monitor name to see all the Amazon Storage Gateway Volume metrics listed under the following tabs:

Amazon Storage Gateway Metrics

Amazon Storage Gateway - Performance Overview

ParameterDescription
UTILIZATION IN %
User CPU Utilization The percentage of CPU time spent on gateway processing, across all the cores at the time of polling (in %).
IO Wait Utilization The percentage of time the gateway spent waiting for I/O operations to finish at the time of polling (in %).
Cache Utilization The percentage of the gateway's cache in use at the time of polling (in %).
Cache Hit Percentage The percentage of application read requests served from the cache at the time of polling (in %).
Dirty Cache The average percentage of the gateway cache that has not been persisted to AWS at the time of polling (in %).
Upload Buffer Utilization The average percentage of the upload buffer in use between the poll interval (in %).
Working Storage Utilization The percentage of the gateway's working storage in use between the poll interval (in %).
MEMORY USAGE
Used Memory The total amount of RAM currently in use by the gateway VM at the time of polling (in MB).
Free Memory The total amount of RAM currently available on the gateway VM at the time of polling (in MB).
Total Memory The total amount of RAM provisioned to the gateway VM at the time of polling (in MB).
CACHE USAGE
Cache Used The average amount of data used in the gateway's cache storage at the time of polling (in MB).
Cache Free The average amount of data available in the gateway's cache storage at the time of polling (in MB).
UPLOAD BUFFER USAGE
Upload Buffer Used The average amount of upload buffer storage used between the poll interval (in MB).
Upload Buffer Free The average amount of upload buffer storage available between the poll interval (in MB).
WORKING STORAGE USAGE
Working Storage Used The total number of bytes used in the gateway's working storage between the poll interval (in MB).
Working Storage Free The total amount of free space in the gateway's working storage between the poll interval (in MB).

Amazon Storage Gateway - Traffic

ParameterDescription
CLOUD TRAFFIC
Rate of Cloud Data Uploaded The total amount of data uploaded per minute to AWS between the poll interval (in MB/min).
Total Cloud Data Uploaded The total amount of data uploaded to AWS between the poll interval (in MB).
Rate of Cloud Data Downloaded The total amount of data downloaded per minute from AWS between the poll interval (in MB/min).
Total Cloud Data Downloaded The total amount of data downloaded from AWS between the poll interval (in MB).
CLIENT TRAFFIC
Rate of Data Read The total amount of data read per second from your on-premises applications between the poll interval (in MB/s).
Total Data Read The total amount of data read from your on-premises applications between the poll interval (in MB).
Rate of Data Written The total amount of data written per second to your on-premises applications between the poll interval (in MB/s).
Total Data Written The total amount of data written to your on-premises applications between the poll interval (in MB).
CLOUD IOPS
Read Operations The total number of read operations per second from the on-premises applications between the poll interval (in operations/s).
Write Operations The total number of write operations per second to the on-premises applications between the poll interval (in operations/s).
GATEWAY IO PERFORMANCE
Read Time The average amount of time spent on read operations from your on-premises applications between the poll interval (in ms).
Write Time The average amount of time spent on write operations to your on-premises applications between the poll interval (in ms).
QUEUED WRITES
Rate of Queued Writes The average amount of data waiting to be written to AWS per minute between the poll interval (in MB/min).
Queued Writes The average amount of data waiting to be written to AWS between the poll interval (in MB).
CLOUD DOWNLOAD LATENCY
Cloud Download Latency The average latency while downloading bytes from the cloud at the time of polling (in ms).
TIME SINCE LAST RECOVERY POINT
Time Since Last Recovery Point The total accumulated time since the last recovery point was created at the time of polling (in mins).
INDEX CACHE
Index Evictions The average number of files whose metadata was evicted from the cached index of file metadata to make room for new entries between the poll interval.
Index Fetches The average number of files for which metadata was fetched between the poll interval.

Amazon Storage Gateway - Configuration

ParameterDescription
CONFIGURATION
Gateway ID The unique identifier assigned to your gateway during activation.
Gateway Type The type of the gateway.
Possible Values: FILE_S3, VOLUME, STORED, CACHED.
Gateway State The current operational state of the gateway.
Possible Values: RUNNING, OFFLINE, ONLINE, SHUTDOWN.
Gateway Capacity Specifies the size of the gateway's metadata cache.
Possible Values: Small, Medium, Large.
Gateway Timezone A value that indicates the time zone configured for the gateway.
Host Environment The type of hardware or software platform on which the gateway is running.
Possible Values: VMWARE, HYPER-V, EC2, KVM, OTHER, SNOWBALL.
Host Environment ID A unique identifier for the specific instance of the host platform running the gateway.
EC2 Instance ID The ID of the Amazon EC2 instance that was used to launch the gateway.
Endpoint Type The type of endpoint for your gateway.
Possible Values: STANDARD, FIPS.
VPC Endpoint The configuration settings for the virtual private cloud (VPC) endpoint for your gateway.
Log Group Name The Amazon Resource Name (ARN) of the Amazon CloudWatch log group that is used to monitor events in the gateway.
Last Software Update The date on which the last software update was applied to the gateway.
Next Update Availability The number of days remaining for the next gateway update to be available (in days).

Amazon Storage Gateway File Share Metrics

Amazon Storage Gateway File Share - Performance Overview

ParameterDescription
CACHE UTILIZATION
Cache Utilization The percentage of the gateway's cache storage used by the file share at the time of polling (in %).
Cache Hit Percentage The percentage of read operations from the file share served from cache at the time of polling (in %).
Dirty Cache The average percentage of the gateway's cache used by the file share that hasn't been persisted to AWS at the time of polling (in %).
CLOUD TRAFFIC
Rate of Cloud Data Uploaded The total amount of data uploaded to cloud per minute by the file share between the poll interval (in MB/min).
Total Cloud Data Uploaded The total amount of data uploaded to cloud by the file share between the poll interval (in MB).
Rate of Cloud Data Downloaded The total amount of data downloaded from cloud per minute by the file share between the poll interval (in MB/min).
Total Cloud Data Downloaded The total amount of data downloaded from cloud by the file share between the poll interval (in MB).
CLIENT TRAFFIC
Rate of Data Read The total amount of data read by on-premises applications per second from the file share between the poll interval (in MB/s).
Total Data Read The total amount of data read by on-premises applications from the file share between the poll interval (in MB).
Rate of Data Written The total amount of data written by on-premises applications per second to the file share between the poll interval (in MB/s).
Total Data Written The total amount of data written by on-premises applications to the file share between the poll interval (in MB).
FILE SHARE IOPS
Read Operations The total number of read operations per second from the on-premises applications between the poll interval (in operations/s).
Write Operations The total number of write operations per second to the on-premises applications between the poll interval (in operations/s).
FILES FAILING TO UPLOAD
Files Failing to Upload The total number of files failing to upload to AWS between the poll interval.
INDEX FETCHES
Index Fetches The average number of times the file share attempts to fetch data from its index between the poll interval.
S3 REQUEST TIME
Get Object Request Time The average time taken to complete S3 GET object requests between the poll interval (in ms).
Put Object Request Time The average time taken to complete S3 PUT object requests between the poll interval (in ms).
Put Upload Part Request Time The average time taken to complete S3 PUT upload part object requests between the poll interval (in ms).

Amazon Storage Gateway File Share - Configuration

ParameterDescription
CONFIGURATION
File Share Name The name of the file share.
File Share State The status of the file share.
Possible Values: CREATING, UPDATING, AVAILABLE, DELETING.
Gateway The Amazon Resource Name (ARN) that uniquely identifies the attached storage gateway.
KMS Key A symmetric customer master key (CMK) used for Amazon S3 server-side encryption.
STORAGE
Mount Path The file share path used by the client to identify the mount point.
Bucket Region Specifies the Region of the S3 bucket where the file share stores files.
Default Storage Class Specifies the default storage class for objects uploaded to the S3 bucket by the S3 File Gateway.
Possible Values: S3_STANDARD, S3_INTELLIGENT_TIERING, S3_STANDARD_IA, S3_ONEZONE_IA.
Guess MIME Type Shows whether MIME type guessing is ENABLED or DISABLED.
USERS
Authentication The authentication method of the file share.
Possible Values: ActiveDirectory, GuestAccess.
File and Directory Access Control Displays the permission control mode of the SMB file share.
Possible Values: ACL MODE, POSIX MODE.
Object ACL Displays the ACL permission for objects in the S3 bucket used by the S3 File Gateway.
Possible Values: private, public-read, public-read-write, authenticated-read, bucket-owner-read, bucket-owner-full-control, aws-exec-read.
Requester Pays Specifies who pays the request and data download costs from the S3 bucket.
Possible Values: REQUESTER, BUCKET OWNER.
Squash Specifies the user mapping to the anonymous user.
Possible Values: RootSquash, NoSquash, AllSquash.
Number of Admins The number of users or groups in the Active Directory that have administrator rights to the file share.
Number of Clients The number of clients that are allowed to access the S3 File Gateway.
Number of Valid Users The number of users or groups in the Active Directory that are allowed to access the file share.
Number of Invalid Users The number of users or groups in the Active Directory that are not allowed to access the file share.

Amazon Storage Gateway Volume Metrics

Amazon Storage Gateway Volume - Performance Overview

ParameterDescription
STATUS DETAILS
Volume State The current state of the volume.
Possible Values: AVAILABLE, CREATING, BOOTSTRAPPING, UPLOAD BUFFER NOT CONFIGURED, PASS THROUGH, RESTORING, IRRECOVERABLE, DELETING.
Attachment Status Indicates the current attachment state of a volume to a gateway.
Possible Values: ATTACHED, DETACHED.
UTILIZATION IN %
User CPU Utilization The percentage of allocated CPU compute units that are currently used by the volume at the time of polling (in %).
I/O Wait Consumption The percentage of IoWaitPercent units utilized by the volume at the time of polling (in %).
Cache Utilization The volume's contribution to the overall percent use of the gateway's cache storage at the time of polling (in %).
Cache Hit Percentage The percentage of application read operations from the volume that are served from cache at the time of polling (in %).
Dirty Cache The volume's contribution to the overall percentage of the gateway's cache that isn’t persisted to AWS at the time of polling (in %).
Volume Utilization The percentage of the volume's total capacity that is currently in use at the time of polling (in %).
Memory Utilization The percentage of memory that is currently used by the volume at the time of polling (in %).
VOLUME USAGE
Used Volume The amount of data currently stored on the volume (in GB).
Available Volume The amount of available storage space on the volume (in GB).
Total Volume The total capacity of the volume (in GB).
CLOUD TRAFFIC
Rate of Cloud Data Uploaded The amount of data uploaded per minute from the cloud to the volume between the poll interval (in MB/min).
Total Cloud Data Uploaded The amount of data uploaded from the cloud to the volume between the poll interval (in MB).
Rate of Cloud Data Downloaded The amount of data downloaded per minute from the cloud to the volume between the poll interval (in MB/min).
Total Cloud Data Downloaded The amount of data downloaded from the cloud to the volume between the poll interval (in MB).
CLIENT TRAFFIC
Rate of Data Read The total amount of data read per minute from the on-premises applications between the poll interval (in MB/s).
Data Read The total amount of data read from the on-premises applications between the poll interval (in MB).
Rate of Data Written The total amount of data written per minute to the on-premises applications between the poll interval (in MB/s).
Data Written The total amount of data written to the on-premises applications between the poll interval (in MB).
VOLUME IOPS
Read Operations The total number of read operations per second from the on-premises applications between the poll interval (in operations/s).
Write Operations The total number of write operations per second to the on-premises applications between the poll interval (in operations/s).
LATENCY
Read Latency The average number of milliseconds spent on read operations from the on-premises applications between the poll interval (in ms).
Write Latency The average number of milliseconds spent on write operations from your on-premises applications between the poll interval (in ms).
QUEUED WRITES
Rate of Queued Writes The total amount of data waiting to be written to AWS per minute, sampled between the poll interval (in MB/min).
Queued Writes The average amount of data waiting to be written to AWS, sampled between the poll interval (in MB).
NOTIFICATIONS
Availability Notification The average number of availability notifications sent by the volume between the poll interval.
Health Notification The average number of health notifications sent by the volume between the poll interval.

Amazon Storage Gateway Volume - Configuration

ParameterDescription
CONFIGURATION
Target Name The name of the iSCSI target used by an initiator to connect to a volume.
Creation Date The date the volume was created.
Snapshot ID If the stored volume was created from a snapshot, this field contains the ID of the snapshot used.
KMS Key A symmetric customer master key (CMK) used for Amazon S3 server-side encryption.
Volume Progress A value that indicates whether a storage volume is attached to, detached from, or is in the process of detaching from a gateway.
Chap Enabled Indicates whether mutual CHAP is enabled for the iSCSI target.
Volume Disk ID The disk ID of the local disk that was specified in the CreateStorediSCSIVolume operation.
Preserved Existing Data Indicates if when the stored volume was created, existing data on the underlying local disk was preserved.

Thank you for your feedback!

Was this content helpful?

We are sorry. Help us improve this page.

How can we improve this page?
Do you need assistance with this topic?
By clicking "Submit", you agree to processing of personal data according to the Privacy Policy.
Back to Top