Try the following:
Select File > Options > Advanced.
Clear the check box 'Use system settings'.
Set 'Decimal separator' to a point (dot), and 'Thousands separator' to a comma.
Click OK.
Export to CSV.
Select File > Options > Advanced.
Tick the check box 'Use system settings'.
Click OK.