You might think CSV files are just spreadsheets, similar to Excel files, but it's a lot more interesting than that: Open any CSV file in a text document and you'll learn that the "comma separated ...

Go to the File Types tab, scroll down to Microsoft Excel Worksheet (.xls not .csv) and click Advanced. Uncheck 'Browse in same window' (or 'Open Web documents' in place) and OK.