I found a way and successfully upgraded from 26040 to 26080, and everything seems fine so far.
The method mainly comes from: https://www.reddit.com/r/windowsinsiders/comments/1bcstn6/bug_cant_update_windows_11_insider_preview/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button
"
1. Attain an ISO of 26040
*You can use https://uupdump.net/ to build an ISO of 26040.
2. Extract the ISO to someplace like c:\Win11
3. Download an ISO of the current release preview (as of writing this is 26080)
4. Replace the install.wim from 26040's extracted ISO (c:\win11\sources\install.wim) with the install.wim from 26080 (or latest build)
5. run c:\Win11\setup.exe and do an upgrade as usual and the install will complete.
"
In fact, I guess that it may work if you throw 26080's install.wim into any recent iso decompression file.
However, note that after I installed 26080 through this method, the windows HDCP service stopped working in a complicated way. I tried many methods: driver reinstall, ipconfig, iprenew, restarting the HDCP service, and modifying the registry, but none of them worked. Finally, I remounted the original iso of 26080 without network connection and used setup.exe to complete the installation again, and the problem was solved. I'm not sure if this problem occurs to everyone or just me.