Hi Bartosz,
Welcome to Microsoft Community.
I'm Hahn and I'm here to help you with your concern.
Based on the information you provided, this problem is most likely related to your graphics card driver.
First of all, I suggest you can go to the official website of the graphics card brand to reinstall and update the graphics card driver. Try to see how it works.
You mentioned that you can turn off GPU acceleration in the browser settings and everything shows up fine, you can press "Alt + Shift + I" in Edge to open "Send Feedback" and send this issue to Microsoft Edge team.
It is recommended that you temporarily turn off GPU acceleration and wait for the Microsoft Edge team to fix this problem in the subsequent version update.
In addition you can also try the following methods:
1. Repair Microsoft Edge
Go to Start > Settings > Apps > Apps & features.
In the apps list, select Microsoft Edge and then select Modify.
When prompted Do you want to allow this app to make changes to your device?, select Yes.
Make sure you're connected to internet and select Repair. Your browser data and settings shouldn't be affected by repair.
2. Clean boot
"Clean Boot" starts Windows with a minimal set of drivers and boot programs so you can determine if a background program is interfering with you.
Please refer to the following links for how to do this:
How to perform a clean boot in Windows - Microsoft Support
Disclaimer: A “clean boot” starts Windows with a minimal set of drivers and startup programs. It helps to determine whether a background program is interfering with your game or program and to isolate the cause of a problem.
These steps of "clean boot" might look complicated at first glance. However, to avoid any trouble for you, please follow them in order and step-by step so that it will help you get you back on track.
3. Perform DISM and SFC scans
Search for “cmd” inside Windows search bar. Right click on command prompt and click on Run as administrator.
Type the following command and press Enter to run a full system scan to check the integrity of system components:
sfc /scannow
DISM is used when a sfc/scannow command is unable to repair corrupted or modified system files.
Dism /Online /Cleanup-Image /ScanHealth
This command will scan all system files and compare them with the official system files, scanning the computer for inconsistencies.
Dism /Online /Cleanup-Image /CheckHealth
This command must be used after the previous command has been executed and the system file is found to be corrupted.
DISM /Online /Cleanup-image /RestoreHealth
This command is to restore those different system files to the official system source files.
Reboot after completion and type the following command angin:
sfc /scannow
Check if the system files are repaired.
If there is anything not clear, please do not hesitate to let me know.
Your Sincerely
Hahn - MSFT | Microsoft Community Support Specialist