For Windows machines, Java (whether JDK or JRE) might be installed in Program Files/Java and one can examine that directory to see which versions of Java are installed.