Is your feature request related to a problem? Please describe.
This is interesting feedback from our internal SA team:
"Currently, the CacheDataset can obviously improve the training speed with caching either on main memory or on GPU memory. It would be nice to support caching on both sides to totally leverage the memory resources."
We can consider to set cache rate for both main memory and GPU memory to cache more data.
Is your feature request related to a problem? Please describe.
This is interesting feedback from our internal SA team:
"Currently, the
CacheDatasetcan obviously improve the training speed with caching either on main memory or on GPU memory. It would be nice to support caching on both sides to totally leverage the memory resources."We can consider to set cache rate for both main memory and GPU memory to cache more data.