OneDrive comes installed with windows 10, and whilst some may trust Microsoft with their personal, corporate and confidential data, I'm not one of those. So I want it gone and that's gone from windows explorer, gone from the task bar and just generally not there anymore. If you've previously removed it following the instructions below then with the windows 10 refresh, it will be back so repeat the process.

OneDrive Removal Proceedure

So firstly, open up a command prompt. This can be done by pressing the Windows Key + R and type CMD or by typing CMD into the I'm cortana box by the start button and select cmd/Run Command or by going to Start /All Apps / Windows System / Command Prompt. You should wind up with a black box and some text in it saying something like "Microsoft Windows [Version 10.0.10586]" and so on.
Now with any luck its going to leave you with

C:\WINDOWS\system32>

Type in

taskkill /f /im OneDrive.exe

to kill off any onedrive executable that's running and then do one of the following depending on whether your running 32bit or 64bit windows 10. If your not sure then try both in the order below as only one will work.

32Bit: Type cd \windows\sysWOW64
64Bit: Type cd \windows\system32

Now, we are ready to remove one drive, and the command is:

OneDriveSetup.exe /uninstall

Once you've run this, you will probably get one of those suitably annoying UAC confirmation's and you should select YES.
And its done, its gone, no more OneDrive.