caiyu/LibreVNA
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Fix floating point limitation in frequency correction

Browse Source
This commit is contained in:
Jan Käberich 2022-06-07 16:13:45 +02:00
parent fa3a74df94
commit a9312aab4d
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
Software/VNA_embedded/Application/Cal.cpp
View File

@ -154,7 +154,7 @@ uint64_t Cal::FrequencyCorrectionToDevice(uint64_t freq) {
// The frequency calibration is only used when the internal reference is active.
// If an external reference is in use, it is assumed to already be at the correct frequency
if(!HW::Ref::usingExternal()) {
freq -= freq * cal.TCXO_PPM_correction * 1e-6f;
freq -= (int32_t) (freq * cal.TCXO_PPM_correction * 1e-6f);
}
return freq;
}