Android Police reports that the Open Camera app can shoot continuous videos with a file size larger than 4GB on a phone running Android 11’s first public beta that was released earlier this week.

Otherwise, you could split the file? It's surprising though, I've played video files larger than that on my phone and tablet that had/have android 8, 9, 10 and 11. No issues that I remember.