Yes, the PS5 can be placed vertically or horizontally, using the the universal stand that comes with the console.
Depending on which PS5 model you have, the stand is slightly different. But both models can be placed sideways as shown below:
Can the PS5 lay horizontally / sideways?
0