I need to migrate lot of file servers with lot of Tbytes to a new ISILON. I had 3 questions:
1)) What tool is better for this task ? Emcopy or Robocopy.
I never use Emcopy, I used in the past Robocopy. Emcopy, can copy ACL, NTFS permissions, etc ??
2)) I'm novice but I wondered if is possible to launch an instance of emcopy from the isilon without any computer using ssh or something similar to avoid bottlenecks using bridge machine to launch the copy. ?? ( if this is not possible, I understand that the best solution is to launch emcopy from command line in windows 2003/8 server to the Isilon)
3)) What tool or way you recommend after migration is finished , to compare/ensure total size between old server and new server is OK ?
1) In our testing, EMCopy has shown good performance (+20-25% improvement) for copying CIFS data as compared to Robocopy with the same number of threads. We recommend using EMCopy as it has other features added as well like migrating local user data to a AD users using the sidmapfile function.
2) EMCopy is a .exe or Windows application. You need to use a Windows host. If you plan migrating data from NetApp filers or Celerra Filers you can use isi_vol_copy or isi_vol_copy_vnx respectively which can be run directly on the Isilon OneFS CLI to eliminate any intermediary copy hosts.
3) There are several methods to compare data sizes between source and destination. I would recommend maintaining a log of each EMCopy session as that log indicates how much data was copied and if there were any errors. Personally, I have seen customers using Beyondcompare and some have used powershell scripts to compare folder sizes (PS I dont have those scripts as they were written by our customers).
emcopy is a fancy version of robocopy ( if you are familiar with it). It allows you to copy data while preserving all NTFS ACLs, it's also multi-threaded so it's very fast. Sharedup allows you to migrate your shares/share permissions from your windows host to Celerra/Isilon so you don't have to recreate those manually. Great tools.
Here is a sample syntax, i am copying data from x: drive to z: drive
EMCOPY is supported by EMC and Robocopy is not. EMCOPY preserves NTFS ACLs and also it is multithreaded so faster. Honestly I cannot tell which one is better, I guess you will have to decide for yourself. I prefer EMCOPY just because it is faster.
EMCOPY is Windows based tool, meaning it will run only on system which has windows on it. Isilon is based on FreeBSD Linux, so you cannot run EMCOPY on Isilon. Also, it is not advisable to run any kind of scripts or tools on Isilon that are not Isilon related or otherwise suggested by EMC, it will void EMC support policy.
PEG, I have recently migrated about 30TB of file data to an Isilon cluster. I can tell you that EMCopy is significantly faster and works really well. If you're familiar with Robocopy, you won't have any issue learning EMCopy syntax. The format is the same, just different syntax. I would also recommend a product called Beyond Compare. It will do file comparison of the source and destination and if there are any differences, it gives you the ability to move the delta's over. It is also extremely affordable and offers a 30+ day trial.
Thank you for your opinions!!. They are all very useful.
In the past, I used robocopy a lot. But now we have to copy hundreds of W2k servers and some filers (EVA, Netapp) to a new Isilon.
Last doubts,
1) What would be the best way to migrate another NAS filer such as (Netapp with CIFS) to a One File Isilon (CIFS too) ?? I think the only way is using a windows host (intermediary copy hosts) this is correct? I have some alternative?
2) If I need to use the intermediary Windows there are difference between using w2008r64 or w2003r32 in a portable computer?? Or better I use Windows 7-64 ? (Thinking in speed performance, etc.) or better use some old server with Windows 2003 instead?¿
3) What is the best practice?? Start to copy with emcopy in old filer LAN to the ISILON by WAN or start the copy process in the DESTINATION LAN and copy files from the old filers? (the ISILON is a cloud service connected to old filers by WAN)
2) does not matter, as long as it has good network connection and plenty of memory.
3) do you have this data on tape (not in NDMP format), that could be restored onto Isilon and only then run emcopy/robocopy to sync up new/changed files ...so not to copy everything over WAN.
1) ISI_VOL_COPY is magnitudes faster than any host based tool when it comes to migrating data from OnTAp.
It totally eliminates the need for the intermediary host. It uses NDMP to copy data as well as permissions from the source to the target.
2) For your other windows file servers, you can use EMCopy64 on a 64 Bit Windows 2008 host. It just performs better when multithreading is used on a 64-Bit host from our tests and then you can use a higher memory VM to run the copies. I would suggest atleast 16GB VRAM if its Virtual or RAM if its physical server.
3) Dynamox is right on with his solution to restore from a tape device locally if your only option is WAN and then incremental/Syncup using EMCopy.
ACHOUKEKAR
22 Posts
12867
2
Posted December 2nd, 2013 07:00
1) In our testing, EMCopy has shown good performance (+20-25% improvement) for copying CIFS data as compared to Robocopy with the same number of threads. We recommend using EMCopy as it has other features added as well like migrating local user data to a AD users using the sidmapfile function.
2) EMCopy is a .exe or Windows application. You need to use a Windows host. If you plan migrating data from NetApp filers or Celerra Filers you can use isi_vol_copy or isi_vol_copy_vnx respectively which can be run directly on the Isilon OneFS CLI to eliminate any intermediary copy hosts.
3) There are several methods to compare data sizes between source and destination. I would recommend maintaining a log of each EMCopy session as that log indicates how much data was copied and if there were any errors. Personally, I have seen customers using Beyondcompare and some have used powershell scripts to compare folder sizes (PS I dont have those scripts as they were written by our customers).
Hope this answers your questions.