Skip to content

Merged the IR and Vis uncertainty changes #144

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 85 commits into
base: main
Choose a base branch
from
Open

Merged the IR and Vis uncertainty changes #144

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
85 commits
Select commit Hold shift + click to select a range
e997266
Added vis_uncertainty
Feb 12, 2025
37c6a77
Added vis_uncertainty
Feb 12, 2025
6c49721
Added systematic uncertainty components
Feb 24, 2025
83bdd61
tidying up
Feb 24, 2025
acb87f1
added function get_bad_space_counts to utils
Mar 27, 2025
2fb1427
fixed solar contamination flag
Apr 2, 2025
80bf186
added command line test for visible uncertainty
Apr 3, 2025
740894d
added flag for bad space counts
Apr 9, 2025
f7e7d76
Preparing code for v1 delivery
Apr 10, 2025
5314d08
Merged the IR and Vis uncertainty changes into code including a new m…
jmittaz Apr 11, 2025
0e4e02c
Update vis_uncertainty.py
nicoleyaghnam Apr 14, 2025
7bf8f81
Merge remote-tracking branch 'origin/combined_uncertainties' into vis…
Apr 14, 2025
4dadca7
Merge pull request #1 from NPL-EO/visible
nicoleyaghnam Apr 14, 2025
cae1901
Fixed issue of NaNs appearing in uncertainty output
Apr 23, 2025
cefaf30
Fixed issue of logical chan_3a overriding other channels in gain eval…
Apr 24, 2025
adec61e
Modified version of code to remove some of the errors/warnings by pygac
jmittaz Apr 24, 2025
4fa2626
Merge pull request #2 from NPL-EO/visible
jmittaz Apr 24, 2025
5a3049c
Fix output dataset through calibration to include the raw counts rath…
jmittaz Apr 24, 2025
2115461
Fixed potential bug in iprt numbering routine (line_diff outside 1-4)
jmittaz May 2, 2025
a7edd07
Moved "counts" xarray DataArray to allow for different calibrators
jmittaz May 2, 2025
55df948
Update solar contamination routine to allow for detection at two loca…
jmittaz May 2, 2025
c6b9f9b
Fix a bug in flagging plus extra plotting
jmittaz May 3, 2025
bcfb947
Fixed a few bugs related to plotting and added tests for uncertainty …
jmittaz May 4, 2025
9cdac44
Changed systematic uncertainty for 3.7 micron channel to allow for Pl…
jmittaz May 7, 2025
e259a7c
Changed 3.7mu sys uncertainty to take Planck variation into account (…
jmittaz May 7, 2025
1c8cb89
Added to possible outputs for solar contamination detection and added a
jmittaz May 18, 2025
069f0d4
Added tests for updated noaa calibration module and for IR uncertainty.
jmittaz May 18, 2025
e6b4988
Modified csv_file to correct location
jmittaz May 19, 2025
c6e3f69
Added test for noise calculation of IR channels
jmittaz May 21, 2025
fed0965
Modified code to change default command line procedure to not have pl…
jmittaz May 22, 2025
40b590b
Removed top level import of matplotlib
jmittaz May 23, 2025
a828589
Remove reference to matplotlib
jmittaz May 23, 2025
8b4cfc6
Fix bugs in test routine
jmittaz May 23, 2025
d8dd305
Removed *_uncert.nc data which is now stored in zenodo. Added test fo…
jmittaz May 27, 2025
87bd950
Added cftime to environment
jmittaz May 28, 2025
16b84d0
Added test for zenodo file opening to trap no file available
jmittaz May 29, 2025
d3ae91c
Added visible channel test routines and made modifications to klm_rea…
jmittaz Jun 6, 2025
a56056d
Moved matplotlib include
jmittaz Jun 6, 2025
d3d9fd7
Added filenotfound exception to try:except loops
jmittaz Jun 8, 2025
c26c40f
Fixed bug in except sections
jmittaz Jun 9, 2025
2787304
Merge branch 'main' into combined_uncertainties
mraspaud Jun 11, 2025
b8caaee
Updated test_vis_uncertainty.py to account for functions changing loc…
Jun 18, 2025
17ad6f9
Merge branch 'main' into combined_uncertainties
mraspaud Jun 19, 2025
d4b502d
Added seaborn to requirements.txt
Jun 19, 2025
08a416b
Remove seaborn from hard dependencies, and clean up some code
mraspaud Jun 19, 2025
dab8468
Added import "files" to test_ir_uncertainty.py
Jun 19, 2025
051693b
Add files from importlib.resources
jmittaz Jun 19, 2025
44c9b88
Fixed bugs
jmittaz Jun 24, 2025
99c4396
Added in extra test to test complete IR uncertainty package. Also added
jmittaz Jun 24, 2025
b512b4b
Merge branch 'combined_uncertainties' of https://github.com/NPL-EO/py…
jmittaz Jun 24, 2025
1153995
Fix bug with test data filename
jmittaz Jun 25, 2025
bfbaec1
Fix bug in Uict test
jmittaz Jun 25, 2025
1caa3fe
Fix error in get_telemetry in klm_reader.py and fix associated get_te…
jmittaz Jun 26, 2025
a2ca0dc
Added netCDF4 to environment
jmittaz Jun 26, 2025
b31a70d
Add get_vis_telemetry to fake POD reader class for testing
jmittaz Jul 4, 2025
389c39c
Merge remote-tracking branch 'upstream/main' into combined_uncertainties
nicoleyaghnam Aug 1, 2025
3536232
Replaced 'self.reader.tle_lines = ("first line", "second line")' with…
nicoleyaghnam Aug 4, 2025
ab4346f
Fixed TLE path
nicoleyaghnam Aug 5, 2025
cafbdd0
Removed redundant line
jmittaz Aug 14, 2025
9112693
Made changes to many tests/test data to correct problems related to the
jmittaz Aug 14, 2025
5dd7772
Fix last test
mraspaud Aug 15, 2025
9916c1a
Remove spurious breakpoint
mraspaud Aug 15, 2025
316f94e
Fixed spelling error and variable name error (avhrr_name)
jmittaz Aug 15, 2025
d4cb709
Cache zenodo files
mraspaud Aug 18, 2025
7c9e861
Add missing dependencies to CI env
mraspaud Aug 18, 2025
a76460b
Fix minimal python version
mraspaud Aug 18, 2025
4271a84
Simplify Allan deviation computation
mraspaud Aug 18, 2025
7203701
Update pygac/runner.py
mraspaud Aug 19, 2025
0847d26
Fix small bug in ir_uncertainty and updated associated tests/test data
jmittaz Aug 20, 2025
e8487f5
Merge branch 'combined_uncertainties' of https://github.com/NPL-EO/py…
jmittaz Aug 20, 2025
354569b
Add uncertainty to calibrated dataset
mraspaud Aug 20, 2025
d416d52
Fix median gcp distance assignment
mraspaud Aug 21, 2025
be63e2b
Added code to support creation of auxilliary data (min gain and solar
jmittaz Aug 21, 2025
8832d4a
Merge branch 'combined_uncertainties' of https://github.com/NPL-EO/py…
jmittaz Aug 21, 2025
907afdd
Changed zenodo reference to updated file location
jmittaz Aug 22, 2025
b0c07e3
Fixed bugs in IR calibration (zenodo naming and dealing with missing 3.7
jmittaz Aug 29, 2025
1bf0036
Fixed bug in uratio calculation
jmittaz Aug 29, 2025
657e8bc
Fixed uncertainty flags metadata
jmittaz Aug 29, 2025
19b6a4b
Do not crash on failing georeferencing and uncertainties
mraspaud Sep 2, 2025
d10de75
Fixed Rcal evaluation to store for all scanlines
nicoleyaghnam Sep 4, 2025
900e17c
Fix time offset correction
mraspaud Sep 4, 2025
ce82f8d
Fixed shape mis-match with Rcal and noise
nicoleyaghnam Sep 29, 2025
d27a1df
Switch on cf compatibility for uncertainty flags
mraspaud Oct 9, 2025
d84135a
Add quality_flags in dataset
mraspaud Oct 9, 2025
74198f8
Warn when georeferencing or uncertainty computations fail
mraspaud Oct 9, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions continuous_integration/environment.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,10 +8,15 @@ dependencies:
- python-dateutil
- hdf5
- h5py
- netCDF4
- packaging
- pytest
- pytest-cov
- xarray
- cftime
- aiohttp
- requests
- truststore
- pip
- pip:
- docutils
Expand Down
Loading
Loading