Verify Java is associated with JNLP files using the Java Control Panel window. Open it by clicking "Start," selecting "Control Panel," clicking "Programs" and clicking the "Java (32-bit)" option.

Since JNLP files are simply Java Web Start files that open applications through an Internet browser, any browser that works in Windows 8.1 will open a JNLP file as long as you have Java installed.