This might be an issue with the window manager more so than x11 itself. However, I would suggest trying it with VLC in OpenGL to confirm.
Are you running the recommended drivers for your GPU?
If VLC doesn't do it, check to see how their code differs from yours perhaps?