Comments on: HDP – Response to Marc Farley http://blog.nigelpoulton.com/hdp-response-to-marc-farley/#utm_source=feed&utm_medium=feed&utm_campaign=feed with nigel poulton Tue, 20 Dec 2011 19:37:54 +0000 http://wordpress.org/?v=2.8.6 hourly 1 By: Nigel Poulton http://blog.nigelpoulton.com/hdp-response-to-marc-farley/comment-page-1/#comment-469 Nigel Poulton Tue, 29 Sep 2009 00:07:11 +0000 http://blogs.rupturedmonkey.com/?p=461#comment-469 Hi Biju,<br /><br />I am referring to a feature built in to recent versions of ucode on the USP V and XP24000 arrays.  Yes from within the Storage NAvigator GUI you have to run ZPR jobs per HDP LUN etc.<br /><br />Its value at the moment is post migration, when migrating from thick to thin.  For example, I am involved in a migration project at the moment.  We have several weekends scheduled for host migrations with between 20-30 servers per weekend.  As part of the post migration tasks for each server we can run ZPR jobs for their new HDP LUNs.<br /><br />Yes it requires effort on behalf of the storage admin.  But its not a job that you will regularly run against LUN.  Really just after migrations.  And if you can reclaim 30% or more of your capacity then I suggest its worth it in this economy.<br /><br />Nigel Hi Biju,

I am referring to a feature built in to recent versions of ucode on the USP V and XP24000 arrays.  Yes from within the Storage NAvigator GUI you have to run ZPR jobs per HDP LUN etc.

Its value at the moment is post migration, when migrating from thick to thin.  For example, I am involved in a migration project at the moment.  We have several weekends scheduled for host migrations with between 20-30 servers per weekend.  As part of the post migration tasks for each server we can run ZPR jobs for their new HDP LUNs.

Yes it requires effort on behalf of the storage admin.  But its not a job that you will regularly run against LUN.  Really just after migrations.  And if you can reclaim 30% or more of your capacity then I suggest its worth it in this economy.

Nigel

]]> By: Biju Krishnan http://blog.nigelpoulton.com/hdp-response-to-marc-farley/comment-page-1/#comment-468 Biju Krishnan Mon, 28 Sep 2009 19:05:53 +0000 http://blogs.rupturedmonkey.com/?p=461#comment-468 the demo I saw for ZPR didnt impress me at all. We will have to wait for ZPR to develop itself and be a mature boy before we hand over the task of housekeeping to him. Some of the posts here are impressed by ZPR, which leads me into doubt of whether I have understood it well. Aren't you folks referring to the little program that needs to be run on every server to free zero pages?? Could be nice for an enterprise with a probably a hundred servers or so. I wouldn't call this revolutionary yet. the demo I saw for ZPR didnt impress me at all. We will have to wait for ZPR to develop itself and be a mature boy before we hand over the task of housekeeping to him.

Some of the posts here are impressed by ZPR, which leads me into doubt of whether I have understood it well. Aren’t you folks referring to the little program that needs to be run on every server to free zero pages?? Could be nice for an enterprise with a probably a hundred servers or so. I wouldn’t call this revolutionary yet.

]]> By: Nigel Poulton http://blog.nigelpoulton.com/hdp-response-to-marc-farley/comment-page-1/#comment-467 Nigel Poulton Thu, 30 Jul 2009 08:58:06 +0000 http://blogs.rupturedmonkey.com/?p=461#comment-467 lots-o-data, Ive just been informed that the current documented limit is 1.1PB. So thats quite a lot, but worth keeping in mind if you plan on a very large implementation.  Obviously these things are subject to change. Hope this is helpful. lots-o-data,
Ive just been informed that the current documented limit is 1.1PB.
So thats quite a lot, but worth keeping in mind if you plan on a very large implementation.  Obviously these things are subject to change.
Hope this is helpful.

]]> By: Nigel Poulton http://blog.nigelpoulton.com/hdp-response-to-marc-farley/comment-page-1/#comment-466 Nigel Poulton Wed, 29 Jul 2009 20:59:29 +0000 http://blogs.rupturedmonkey.com/?p=461#comment-466 I dont personally know, although its an interesting question.  I suspect a formula to work something like this out might reveal too much of the inner workings of HDP so is not likely to be made GA by Hitachi.<br /><br />Working out such a limit would require knowing how much shared memory each row in the free page list consumes as well as other metadata constructs.  This may also change any time Hitachi supported larger Shared Memory DIMMs etc....  <br /><br />As you will know, the metadata constructs are stored in a particular and dedicated area of Shared Memory, so it depends how large that area is - 4GB from memory although that might be old info now......<br /><br />Either way, I expect that the theoretical limit might behigher than any realistic deployment - much like the theoretical limit of max external storage on a USP or USP V.  I know of a couple of quite large HDP deployments and none of them have come across issues hat I am aware of.<br /><br />Of course you are right - the smaller the allocation unit, the more metadata required. I dont personally know, although its an interesting question.  I suspect a formula to work something like this out might reveal too much of the inner workings of HDP so is not likely to be made GA by Hitachi.

Working out such a limit would require knowing how much shared memory each row in the free page list consumes as well as other metadata constructs.  This may also change any time Hitachi supported larger Shared Memory DIMMs etc…. 

As you will know, the metadata constructs are stored in a particular and dedicated area of Shared Memory, so it depends how large that area is – 4GB from memory although that might be old info now……

Either way, I expect that the theoretical limit might behigher than any realistic deployment – much like the theoretical limit of max external storage on a USP or USP V.  I know of a couple of quite large HDP deployments and none of them have come across issues hat I am aware of.

Of course you are right – the smaller the allocation unit, the more metadata required.

]]> By: lots-o-data http://blog.nigelpoulton.com/hdp-response-to-marc-farley/comment-page-1/#comment-465 lots-o-data Wed, 29 Jul 2009 19:06:29 +0000 http://blogs.rupturedmonkey.com/?p=461#comment-465 Anyone know of a way to calculate the maximum amount of storage that can be managed by HDP?  A capacity limit in mapping the pages/chunks would be one reason for 42MB (or larger) chunks/pages Anyone know of a way to calculate the maximum amount of storage that can be managed by HDP? 
A capacity limit in mapping the pages/chunks would be one reason for 42MB (or larger) chunks/pages

]]> By: Stephen2615 http://blog.nigelpoulton.com/hdp-response-to-marc-farley/comment-page-1/#comment-464 Stephen2615 Fri, 10 Jul 2009 12:37:58 +0000 http://blogs.rupturedmonkey.com/?p=461#comment-464 Nigel,  I was just waffling on about finding out about the free UVM licences in a very round about way.  I sometimes marvel at the "deals" I get from our sales rep.  Eg, I now have 5 Clariions as part of a merger and I wanted to virtualise storage from them to give me cheaper storage behind the new USP V's.  I wanted some licences and was offered 8 TB for a price.  That was not long ago. That lead me to Hu's blog about HDP and external "directors".  It just took me a round about way from here to HDS via links on blog pages. I just loved your response to Marc and I was going to do some sort of  video with kangaroo's but alas there are not many cars around with live kangaroo's.  Our local roads are littered with kangaroo road kill.  Keep up the good work as I am not doing much these last 9 months..  One day a week at work is enough for me but I still rule the storage roost.. :)   Nigel,
 I was just waffling on about finding out about the free UVM licences in a very round about way.  I sometimes marvel at the "deals" I get from our sales rep.  Eg, I now have 5 Clariions as part of a merger and I wanted to virtualise storage from them to give me cheaper storage behind the new USP V’s.  I wanted some licences and was offered 8 TB for a price.  That was not long ago.
That lead me to Hu’s blog about HDP and external "directors".  It just took me a round about way from here to HDS via links on blog pages.
I just loved your response to Marc and I was going to do some sort of  video with kangaroo’s but alas there are not many cars around with live kangaroo’s.  Our local roads are littered with kangaroo road kill. 
Keep up the good work as I am not doing much these last 9 months..  One day a week at work is enough for me but I still rule the storage roost.. :)
 

]]> By: Nigel Poulton http://blog.nigelpoulton.com/hdp-response-to-marc-farley/comment-page-1/#comment-463 Nigel Poulton Thu, 09 Jul 2009 20:46:59 +0000 http://blogs.rupturedmonkey.com/?p=461#comment-463 Hi Stephen,<br /><br />Firstly I wish you all the best with your cancer medication and hope you are fit and well soon.<br /><br />Secondly, Im not sure how to read the rest of your comment.  MAy be Im missing something.  Are you having a pop at me and being critical/sarcastic or are you being positive.  Like I say, may be Im missing something :-S<br /><br />Nigel Hi Stephen,

Firstly I wish you all the best with your cancer medication and hope you are fit and well soon.

Secondly, Im not sure how to read the rest of your comment.  MAy be Im missing something.  Are you having a pop at me and being critical/sarcastic or are you being positive.  Like I say, may be Im missing something :-S

Nigel

]]> By: Stephen2615 http://blog.nigelpoulton.com/hdp-response-to-marc-farley/comment-page-1/#comment-462 Stephen2615 Thu, 09 Jul 2009 02:13:16 +0000 http://blogs.rupturedmonkey.com/?p=461#comment-462 È bene per vedere una risposta da cincetica. Is this six degrees of seperation.. I wonder if I can get Tony Asaro to class me as an independent consultant and storage expert.   I must admit that the past year has been tough for me when it comes to keeping up with events but I found a link from Tony's blog (as discussed by Cinetica) to something that Chris Evans said and that points to a HDS press release that states: Hitachi Data Systems Offers Free Storage Virtualization through “Switch it On” Program Boy do I feel ripped off with the recent purchase of new USP V's where I was "given" an relatively small UVM licence at a special price so I could virtualise a couple of Clariions with large SATA disks sitting around doing nothing... yeah nothing.  Don't you just love company mergers. This leads to Hu's Blog that says: Currently there is a <a title="Hu's Blog: Switch It On" href="http://blogs.hds.com/hu/2009/04/switch-it-on.html" rel="nofollow">“Switch It On”</a> promotion for virtualization of 3rd party storage systems behind the USP V which runs till the end of the year..... Its also goes on to talk about free DP licences and I look forward to seeing our sales rep in the near future...  Another of Hu's blogs makes for exception reading if not slightly confusing for people with concentration problems related to cancer medication... <a href="http://blogs.hds.com/hu/2009/07/overheads-for-thin-provisioning.html" rel="nofollow">http://blogs.hds.com/hu/2009/07/overheads-for-thin-provisioning.html</a> "Unlike other thin provisioning systems that have no externalized storage virtualization, the USP V can leverage either internal or external RAID director hardware." Now.. where was I?  Oh thats right.  I have a paddock near me full of kangaroo's that just wont stay behind me when cars get close for my version of the HDP videos..  Good job Nige..   È bene per vedere una risposta da cincetica.
Is this six degrees of seperation..
I wonder if I can get Tony Asaro to class me as an independent consultant and storage expert. 
 I must admit that the past year has been tough for me when it comes to keeping up with events but I found a link from Tony’s blog (as discussed by Cinetica) to something that Chris Evans said and that points to a HDS press release that states:
Hitachi Data Systems Offers Free Storage Virtualization through “Switch it On” Program
Boy do I feel ripped off with the recent purchase of new USP V’s where I was "given" an relatively small UVM licence at a special price so I could virtualise a couple of Clariions with large SATA disks sitting around doing nothing… yeah nothing.  Don’t you just love company mergers.
This leads to Hu’s Blog that says:
Currently there is a “Switch It On” promotion for virtualization of 3rd party storage systems behind the USP V which runs till the end of the year…..
Its also goes on to talk about free DP licences and I look forward to seeing our sales rep in the near future… 
Another of Hu’s blogs makes for exception reading if not slightly confusing for people with concentration problems related to cancer medication…
http://blogs.hds.com/hu/2009/07/overheads-for-thin-provisioning.html
"Unlike other thin provisioning systems that have no externalized storage virtualization, the USP V can leverage either internal or external RAID director hardware."
Now.. where was I?  Oh thats right.  I have a paddock near me full of kangaroo’s that just wont stay behind me when cars get close for my version of the HDP videos..  Good job Nige..
 

]]> By: Cinetica Blog » L’acqua calda, il wide striping e il thin provisioning! http://blog.nigelpoulton.com/hdp-response-to-marc-farley/comment-page-1/#comment-461 Cinetica Blog » L’acqua calda, il wide striping e il thin provisioning! Tue, 07 Jul 2009 13:15:10 +0000 http://blogs.rupturedmonkey.com/?p=461#comment-461 [...] Nel recente passato avevo già scritto un post sull’implementazione del TP paragonando l’implementazione di EMC a quelle di vendor meno tradizionali e più innovativi (3Par e Compellent in primis). E’ sempre difficile dire chi fà meglio cosa e spesso ci si perde in discussioni, divertenti, ma sterili…come quando ci si ritrova a parlare di mucche su twitter invece che di storage, vedi qui e qui. [...] [...] Nel recente passato avevo già scritto un post sull’implementazione del TP paragonando l’implementazione di EMC a quelle di vendor meno tradizionali e più innovativi (3Par e Compellent in primis). E’ sempre difficile dire chi fà meglio cosa e spesso ci si perde in discussioni, divertenti, ma sterili…come quando ci si ritrova a parlare di mucche su twitter invece che di storage, vedi qui e qui. [...]

]]> By: Cinetica Blog » HDS e i Modulari http://blog.nigelpoulton.com/hdp-response-to-marc-farley/comment-page-1/#comment-460 Cinetica Blog » HDS e i Modulari Tue, 30 Jun 2009 15:48:57 +0000 http://blogs.rupturedmonkey.com/?p=461#comment-460 [...] già facendo, (vedi qui il post di Tony Asaro o i simpatici video con le mucche di Marc Farley e Nigel Poulton )… ma ora la discussione si può aprire prima era un pò più [...] [...] già facendo, (vedi qui il post di Tony Asaro o i simpatici video con le mucche di Marc Farley e Nigel Poulton )… ma ora la discussione si può aprire prima era un pò più [...]

]]>