At first I thought this is a browser issue, then I installed Twitter as PWA which works just fine as when I put the phone sideway, there should be a prompt to enter landscape mode instead of entering automatically(Unless you have the phone set to auto-rotate).
My current solution is to enable airplane mode before refreshing the site so that I can “Add to desktop” instead of installing, the downside is the icon will become auto generated alphabet.