Indeed, Firefox does support the HTML5 <video> tag, but the linked video file should be encoded in .ogg rather than H264. As Philip writes: “Firefox is essentially forcing people to offer two versions ...

Microsoft's new plug-in for Firefox supports HTML5 video on Windows 7.