Settings for AVCHD 2.0 Progressive compliant file, playback

[Selur]

since FFmpeg does not mux PCM audio.

I was trying Open GOP, it exceeded Buffer size, no go.

I agree it seems to be a muxing issue, but I doubt it's related to the stream structure (open gop).
AVCHD should support H.264-style open GoP. GoP length up to 30 frames with up to 4 B-frames between anchor frames.
I doubt that changed for AVCHD 2.0
My guess is that it's more an issue on how the m2ts file is created or something similar.

Cu Selur