I basically went in and uninstalled Office 2007, shutdown/restart and re-installed from cd. Word/Excel/Powerpoint all work no problem - OneNote pops up the same overlay on the start screen.

Microsoft's OneNote app for Windows 10 will now allow the editing of attached files. The new ability is currently being rolled out to Office Insiders, and will come to more channels later.