You should be able to do this without installing new fonts. Segoe UI Symbol is part of Windows and contains a wealth of musical symbols starting at Unicode 1D100. To insert a symbol and browse what's available from any Office application click Insert Symbol: under the Insert tab, then the Symbols group, click Symbol / More Symbols.
In the Symbols dialog that opens, for "Font", select "Segoe UI Symbol". You can scroll down to just past the middle, or you can directly type the Character Code at the bottom (above the Insert button, and be sure "Unicode (hex)" is selected in "from"): 1d100. You don't need to press tab or enter. It will automatically take you to the first musical symbol, after which you can see all of them.
Select your symbol then click the Insert button. After you've inserted the symbols you plan to use repeatedly, you don't have to go through all of this. When you click the Symbol button in the ribbon, your musical symbols will appear automatically because they were most recently used.
