0:00:00.000029 PROGRESS:           _      _         ___ ___   _   
0:00:00.000126 PROGRESS:      __ _| |_ __| |_  __ _|   \_ _| /_\  
0:00:00.000156 PROGRESS:     / _` | | '_ \ ' \/ _` | |) | | / _ \ 
0:00:00.000198 PROGRESS:     \__,_|_| .__/_||_\__,_|___/___/_/ \_\
0:00:00.000221 PROGRESS:            |_|                           
0:00:00.000244 PROGRESS: 
0:00:00.000271 PROGRESS: version: 1.7.2
0:00:00.000299 PROGRESS: hostname: alphadia0
0:00:00.000343 PROGRESS: date: 2024-09-02 11:58:59
0:00:00.000369 PROGRESS: =================== Environment ===================
0:00:00.000395 PROGRESS: alphatims       : 1.0.8
0:00:00.000419 PROGRESS: alpharaw        : 0.4.5
0:00:00.000441 PROGRESS: alphabase       : 1.2.5
0:00:00.000464 PROGRESS: alphapeptdeep   : 1.2.1
0:00:00.000486 PROGRESS: directlfq       : 0.2.19
0:00:00.000507 PROGRESS: ===================================================
0:00:00.000544 INFO: loading default config from /home/alphadia/miniconda3/envs/alphadia172/lib/python3.11/site-packages/alphadia/constants/default.yaml
0:00:00.011371 INFO: ├──version: 1 
0:00:00.011445 INFO: ├──general
0:00:00.011486 INFO: │   ├──thread_count: 10 
0:00:00.011519 INFO: │   ├──[32;20mthread_count: 24 (user defined)[0m
0:00:00.011554 INFO: │   ├──reuse_calibration: False 
0:00:00.011587 INFO: │   ├──reuse_quant: False 
0:00:00.011635 INFO: │   ├──astral_ms1: False 
0:00:00.011667 INFO: │   ├──log_level: INFO 
0:00:00.011698 INFO: │   ├──wsl: False 
0:00:00.011728 INFO: │   ├──mmap_detector_events: False 
0:00:00.011757 INFO: │   └──use_gpu: True 
0:00:00.011786 INFO: ├──library_loading
0:00:00.011817 INFO: │   └──rt_heuristic: 180 
0:00:00.011845 INFO: ├──library_prediction
0:00:00.011875 INFO: │   ├──predict: False 
0:00:00.011901 INFO: │   ├──[32;20mpredict: True (user defined)[0m
0:00:00.011930 INFO: │   ├──enzyme: trypsin 
0:00:00.011959 INFO: │   ├──fixed_modifications: Carbamidomethyl@C 
0:00:00.011988 INFO: │   ├──variable_modifications: Oxidation@M;Acetyl@Protein N-term 
0:00:00.012018 INFO: │   ├──max_var_mod_num: 2 
0:00:00.012047 INFO: │   ├──missed_cleavages: 1 
0:00:00.012074 INFO: │   ├──precursor_len
0:00:00.012104 INFO: │   │   ├──7 
0:00:00.012133 INFO: │   │   └──35 
0:00:00.012160 INFO: │   ├──precursor_charge
0:00:00.012189 INFO: │   │   ├──2 
0:00:00.012217 INFO: │   │   └──4 
0:00:00.012244 INFO: │   ├──precursor_mz
0:00:00.012274 INFO: │   │   ├──400 
0:00:00.012304 INFO: │   │   ├──[32;20m380 (user defined)[0m
0:00:00.012333 INFO: │   │   └──1200 
0:00:00.012361 INFO: │   │   └──[32;20m980 (user defined)[0m
0:00:00.012388 INFO: │   ├──fragment_mz
0:00:00.012455 INFO: │   │   ├──200 
0:00:00.012487 INFO: │   │   └──2000 
0:00:00.012519 INFO: │   ├──nce: 25.0 
0:00:00.012550 INFO: │   ├──fragment_types: b;y 
0:00:00.012579 INFO: │   ├──max_fragment_charge: 2 
0:00:00.012609 INFO: │   ├──instrument: Lumos 
0:00:00.012638 INFO: │   └──checkpoint_folder_path: None 
0:00:00.012666 INFO: ├──search
0:00:00.012696 INFO: │   ├──channel_filter: 0 
0:00:00.012725 INFO: │   ├──exclude_shared_ions: True 
0:00:00.012754 INFO: │   ├──compete_for_fragments: True 
0:00:00.012784 INFO: │   ├──target_num_candidates: 2 
0:00:00.012813 INFO: │   ├──[32;20mtarget_num_candidates: 1 (user defined)[0m
0:00:00.012842 INFO: │   ├──target_ms1_tolerance: 15 
0:00:00.012868 INFO: │   ├──[32;20mtarget_ms1_tolerance: 4 (user defined)[0m
0:00:00.012896 INFO: │   ├──target_ms2_tolerance: 15 
0:00:00.012923 INFO: │   ├──[32;20mtarget_ms2_tolerance: 7 (user defined)[0m
0:00:00.012951 INFO: │   ├──target_mobility_tolerance: 0.04 
0:00:00.012991 INFO: │   ├──target_rt_tolerance: 60 
0:00:00.013027 INFO: │   ├──[32;20mtarget_rt_tolerance: 100 (user defined)[0m
0:00:00.013064 INFO: │   ├──quant_window: 3 
0:00:00.013093 INFO: │   └──quant_all: True 
0:00:00.013120 INFO: ├──search_advanced
0:00:00.013150 INFO: │   └──top_k_fragments: 12 
0:00:00.013177 INFO: ├──calibration
0:00:00.013207 INFO: │   ├──min_epochs: 3 
0:00:00.013235 INFO: │   ├──batch_size: 8000 
0:00:00.013262 INFO: │   ├──[32;20mbatch_size: 1000 (user defined)[0m
0:00:00.013290 INFO: │   ├──recalibration_target: 200 
0:00:00.013319 INFO: │   ├──max_epochs: 20 
0:00:00.013348 INFO: │   ├──final_full_calibration: False 
0:00:00.013376 INFO: │   └──norm_rt_mode: linear 
0:00:00.013403 INFO: ├──search_initial
0:00:00.013433 INFO: │   ├──initial_num_candidates: 1 
0:00:00.013462 INFO: │   ├──initial_ms1_tolerance: 30 
0:00:00.013489 INFO: │   ├──[32;20minitial_ms1_tolerance: 10 (user defined)[0m
0:00:00.013517 INFO: │   ├──initial_ms2_tolerance: 30 
0:00:00.013544 INFO: │   ├──[32;20minitial_ms2_tolerance: 10 (user defined)[0m
0:00:00.013572 INFO: │   ├──initial_mobility_tolerance: 0.08 
0:00:00.013602 INFO: │   └──initial_rt_tolerance: 240 
0:00:00.013628 INFO: ├──selection_config
0:00:00.013659 INFO: │   ├──peak_len_rt: 10.0 
0:00:00.013689 INFO: │   ├──sigma_scale_rt: 0.5 
0:00:00.013718 INFO: │   ├──peak_len_mobility: 0.01 
0:00:00.013746 INFO: │   ├──sigma_scale_mobility: 1.0 
0:00:00.013813 INFO: │   ├──top_k_precursors: 3 
0:00:00.013842 INFO: │   ├──kernel_size: 30 
0:00:00.013870 INFO: │   ├──f_mobility: 1.0 
0:00:00.013907 INFO: │   ├──f_rt: 0.99 
0:00:00.013936 INFO: │   ├──center_fraction: 0.5 
0:00:00.013963 INFO: │   ├──min_size_mobility: 8 
0:00:00.013991 INFO: │   ├──min_size_rt: 3 
0:00:00.014019 INFO: │   ├──max_size_mobility: 20 
0:00:00.014046 INFO: │   ├──max_size_rt: 15 
0:00:00.014074 INFO: │   ├──group_channels: False 
0:00:00.014102 INFO: │   ├──use_weighted_score: True 
0:00:00.014130 INFO: │   ├──join_close_candidates: False 
0:00:00.014159 INFO: │   ├──join_close_candidates_scan_threshold: 0.6 
0:00:00.014188 INFO: │   └──join_close_candidates_cycle_threshold: 0.6 
0:00:00.014215 INFO: ├──scoring_config
0:00:00.014245 INFO: │   ├──score_grouped: False 
0:00:00.014273 INFO: │   ├──top_k_isotopes: 3 
0:00:00.014300 INFO: │   ├──reference_channel: -1 
0:00:00.014327 INFO: │   ├──precursor_mz_tolerance: 10 
0:00:00.014355 INFO: │   └──fragment_mz_tolerance: 15 
0:00:00.014383 INFO: ├──multiplexing
0:00:00.014413 INFO: │   ├──enabled: False 
0:00:00.014442 INFO: │   ├──target_channels: 4,8 
0:00:00.014470 INFO: │   ├──decoy_channel: 12 
0:00:00.014498 INFO: │   ├──reference_channel: 0 
0:00:00.014526 INFO: │   └──competetive_scoring: True 
0:00:00.014553 INFO: ├──fdr
0:00:00.014584 INFO: │   ├──fdr: 0.01 
0:00:00.014612 INFO: │   ├──group_level: proteins 
0:00:00.014640 INFO: │   ├──competetive_scoring: True 
0:00:00.014668 INFO: │   ├──keep_decoys: False 
0:00:00.014695 INFO: │   ├──channel_wise_fdr: False 
0:00:00.014723 INFO: │   └──inference_strategy: heuristic 
0:00:00.014750 INFO: ├──search_output
0:00:00.014780 INFO: │   ├──peptide_level_lfq: False 
0:00:00.014809 INFO: │   ├──precursor_level_lfq: False 
0:00:00.014838 INFO: │   ├──min_k_fragments: 12 
0:00:00.014884 INFO: │   ├──min_correlation: 0.9 
0:00:00.014915 INFO: │   ├──num_samples_quadratic: 50 
0:00:00.014943 INFO: │   ├──min_nonnan: 3 
0:00:00.014971 INFO: │   ├──normalize_lfq: True 
0:00:00.014998 INFO: │   └──file_format: tsv 
0:00:00.015025 INFO: ├──optimization_manager
0:00:00.015054 INFO: │   ├──fwhm_rt: 5 
0:00:00.015095 INFO: │   ├──fwhm_mobility: 0.01 
0:00:00.015129 INFO: │   └──score_cutoff: 0 
0:00:00.015156 INFO: ├──transfer_library
0:00:00.015185 INFO: │   ├──enabled: False 
0:00:00.015213 INFO: │   ├──fragment_types: b;y 
0:00:00.015241 INFO: │   ├──max_charge: 2 
0:00:00.015269 INFO: │   ├──top_k_samples: 3 
0:00:00.015297 INFO: │   ├──norm_delta_max: True 
0:00:00.015325 INFO: │   ├──precursor_correlation_cutoff: 0.5 
0:00:00.015354 INFO: │   └──fragment_correlation_ratio: 0.75 
0:00:00.015381 INFO: ├──transfer_learning
0:00:00.015410 INFO: │   ├──enabled: False 
0:00:00.015437 INFO: │   ├──batch_size: 2000 
0:00:00.015465 INFO: │   ├──max_lr: 0.0001 
0:00:00.015493 INFO: │   ├──train_fraction: 0.7 
0:00:00.015521 INFO: │   ├──validation_fraction: 0.2 
0:00:00.015549 INFO: │   ├──test_fraction: 0.1 
0:00:00.015577 INFO: │   ├──test_interval: 1 
0:00:00.015605 INFO: │   ├──lr_patience: 3 
0:00:00.015632 INFO: │   ├──epochs: 51 
0:00:00.015660 INFO: │   ├──warmup_epochs: 5 
0:00:00.015703 INFO: │   ├──nce: 25 
0:00:00.015732 INFO: │   └──instrument: Lumos 
0:00:00.015759 INFO: └──calibration_manager
0:00:00.015788 INFO:     ├──0
0:00:00.015817 INFO:     │   ├──name: fragment 
0:00:00.015844 INFO:     │   └──estimators
0:00:00.015871 INFO:     │       └──0
0:00:00.015901 INFO:     │           ├──name: mz 
0:00:00.015942 INFO:     │           ├──model: LOESSRegression 
0:00:00.015970 INFO:     │           ├──model_args
0:00:00.015998 INFO:     │           │   └──n_kernels: 2 
0:00:00.016026 INFO:     │           ├──input_columns
0:00:00.016053 INFO:     │           │   └──mz_library 
0:00:00.016080 INFO:     │           ├──target_columns
0:00:00.016108 INFO:     │           │   └──mz_observed 
0:00:00.016135 INFO:     │           ├──output_columns
0:00:00.016163 INFO:     │           │   └──mz_calibrated 
0:00:00.016191 INFO:     │           └──transform_deviation: 1e6 
0:00:00.016219 INFO:     └──1
0:00:00.016248 INFO:         ├──name: precursor 
0:00:00.016288 INFO:         └──estimators
0:00:00.016317 INFO:             ├──0
0:00:00.016345 INFO:             │   ├──name: mz 
0:00:00.016375 INFO:             │   ├──model: LOESSRegression 
0:00:00.016402 INFO:             │   ├──model_args
0:00:00.016432 INFO:             │   │   └──n_kernels: 2 
0:00:00.016459 INFO:             │   ├──input_columns
0:00:00.016488 INFO:             │   │   └──mz_library 
0:00:00.016515 INFO:             │   ├──target_columns
0:00:00.016543 INFO:             │   │   └──mz_observed 
0:00:00.016570 INFO:             │   ├──output_columns
0:00:00.016598 INFO:             │   │   └──mz_calibrated 
0:00:00.016636 INFO:             │   └──transform_deviation: 1e6 
0:00:00.016665 INFO:             ├──1
0:00:00.016693 INFO:             │   ├──name: rt 
0:00:00.016721 INFO:             │   ├──model: LOESSRegression 
0:00:00.016755 INFO:             │   ├──model_args
0:00:00.016785 INFO:             │   │   └──n_kernels: 6 
0:00:00.016812 INFO:             │   ├──input_columns
0:00:00.016842 INFO:             │   │   └──rt_library 
0:00:00.016869 INFO:             │   ├──target_columns
0:00:00.016897 INFO:             │   │   └──rt_observed 
0:00:00.016933 INFO:             │   └──output_columns
0:00:00.016962 INFO:             │       └──rt_calibrated 
0:00:00.016990 INFO:             └──2
0:00:00.017019 INFO:                 ├──name: mobility 
0:00:00.017047 INFO:                 ├──model: LOESSRegression 
0:00:00.017075 INFO:                 ├──model_args
0:00:00.017103 INFO:                 │   └──n_kernels: 2 
0:00:00.017131 INFO:                 ├──input_columns
0:00:00.017182 INFO:                 │   └──mobility_library 
0:00:00.017210 INFO:                 ├──target_columns
0:00:00.017238 INFO:                 │   └──mobility_observed 
0:00:00.017266 INFO:                 └──output_columns
0:00:00.017294 INFO:                     └──mobility_calibrated 
0:00:00.017734 PROGRESS: No library provided. Building library from fasta files.
0:00:00.017810 INFO: Running FastaDigest
0:00:01.188893 INFO: Digesting fasta file
0:00:08.497376 INFO: Adding modifications
0:01:47.456635 INFO: Removing non-canonical amino acids
0:01:54.348804 INFO: Fasta library contains 5,177,971 precursors
0:01:54.348972 PROGRESS: Predicting library properties.
0:01:54.349026 INFO: Running PeptDeepPrediction
0:01:54.349093 INFO: Device set to gpu
0:01:55.417398 INFO: Loading PeptDeep models from None
0:01:55.417514 INFO: Using external ms2 model: 'None/ms2.pth'
0:01:55.417577 INFO:  -- This model file does not exist
0:01:55.417607 INFO: Using external rt model: 'None/rt.pth'
0:01:55.417633 INFO:  -- This model file does not exist
0:01:55.417659 INFO: Using external ccs model: 'None/ccs.pth'
0:01:55.417683 INFO:  -- This model file does not exist
0:01:55.417710 INFO: Predicting RT, MS2 and mobility
0:01:55.435017 INFO: Predicting RT ...
0:03:46.267133 INFO: Predicting mobility ...
0:06:21.571270 INFO: Predicting MS2 ...
0:10:31.464258 INFO: Adding fragment mz information
0:10:31.911479 INFO: Adding fragment intensity information
0:10:32.350764 INFO: Adding precursor information
0:10:32.407088 INFO: Running PrecursorInitializer
0:10:32.429612 INFO: Running AnnotateFasta
0:10:32.622810 INFO: Dropping decoys from input library before annotation
0:11:03.500951 INFO: Running IsotopeGenerator
0:11:48.535105 INFO: Running RTNormalization
0:11:48.535349 WARNING: Input library already contains normalized RT information. Skipping RT normalization
0:11:48.535401 INFO: Saving library to output/speclib.hdf
0:12:14.639632 INFO: Running DecoyGenerator
0:14:22.750923 INFO: Running FlattenLibrary
0:14:59.434091 INFO: Running InitFlatColumns
0:14:59.938631 INFO: Running LogFlatLibraryStats
0:14:59.938757 INFO: ============ Library Stats ============
0:14:59.938795 INFO: Number of precursors: 10,353,911
0:15:02.180998 INFO: 	thereof targets:5,177,971
0:15:02.181123 INFO: 	thereof decoys: 5,175,940
0:15:02.285457 INFO: Number of elution groups: 5,177,971
0:15:02.285577 INFO: 	average size: 2.00
0:15:02.658799 INFO: Number of proteins: 50,669
0:15:02.689739 INFO: Number of channels: 1 ([0])
0:15:02.689912 INFO: Isotopes Distribution for 4 isotopes
0:15:02.689957 INFO: =======================================
0:15:02.708657 PROGRESS: Starting Search Workflows
0:15:02.708878 PROGRESS: Loading raw file 1/6: LFQ_Orbitrap_AIF_Condition_B_Sample_Alpha_03
0:15:02.709019 INFO: Creating parent folder for workflows at output/.progress
0:15:02.709205 INFO: Creating workflow folder for LFQ_Orbitrap_AIF_Condition_B_Sample_Alpha_03 at output/.progress/LFQ_Orbitrap_AIF_Condition_B_Sample_Alpha_03
0:15:32.205068 INFO: Determining DIA cycle
0:15:32.410741 WARNING: Failed to determine DIA cycle, will retry without MS1 spectra.
0:15:32.416931 INFO: Determining DIA cycle
0:15:32.582522 INFO: Found cycle with start 0.00 min and length 151.
0:15:32.718069 INFO: ============ Raw file stats ============
0:15:32.718463 INFO: RT (min)            : 0.0 - 150.0
0:15:32.718544 INFO: RT duration (sec)   : 8999.7
0:15:32.718576 INFO: RT duration (min)   : 150.0
0:15:32.718684 INFO: Cycle len (scans)   : 151
0:15:32.718724 INFO: Cycle len (sec)     : 5.84
0:15:32.718752 INFO: Number of cycles    : 1542
0:15:32.718808 INFO: MS2 range (m/z)     : 396.4 - 1004.7
0:15:32.718839 INFO: ========================================
0:15:34.971125 INFO: Initializing CalibrationManager
0:15:34.971400 INFO: Loading calibration config
0:15:34.971511 INFO: Calibration config: [{'name': 'fragment', 'estimators': [{'name': 'mz', 'model': 'LOESSRegression', 'model_args': {'n_kernels': 2}, 'input_columns': ['mz_library'], 'target_columns': ['mz_observed'], 'output_columns': ['mz_calibrated'], 'transform_deviation': '1e6'}]}, {'name': 'precursor', 'estimators': [{'name': 'mz', 'model': 'LOESSRegression', 'model_args': {'n_kernels': 2}, 'input_columns': ['mz_library'], 'target_columns': ['mz_observed'], 'output_columns': ['mz_calibrated'], 'transform_deviation': '1e6'}, {'name': 'rt', 'model': 'LOESSRegression', 'model_args': {'n_kernels': 6}, 'input_columns': ['rt_library'], 'target_columns': ['rt_observed'], 'output_columns': ['rt_calibrated']}, {'name': 'mobility', 'model': 'LOESSRegression', 'model_args': {'n_kernels': 2}, 'input_columns': ['mobility_library'], 'target_columns': ['mobility_observed'], 'output_columns': ['mobility_calibrated']}]}]
0:15:34.971597 INFO: Calibration group :fragment, found 1 estimator(s)
0:15:34.971681 INFO: Calibration group :precursor, found 3 estimator(s)
0:15:34.971756 INFO: Disabling ion mobility calibration
0:15:34.971787 INFO: removed mobility estimator from group precursor
0:15:34.971861 INFO: Initializing OptimizationManager
0:15:34.971952 INFO: initial parameter: fwhm_rt = 5
0:15:34.972012 INFO: initial parameter: fwhm_mobility = 0.01
0:15:34.972067 INFO: initial parameter: score_cutoff = 0
0:15:34.972157 PROGRESS: Initializing workflow LFQ_Orbitrap_AIF_Condition_B_Sample_Alpha_03
0:15:34.972231 INFO: Initializing OptimizationManager
0:15:34.972261 INFO: initial parameter: current_epoch = 0
0:15:34.972284 INFO: initial parameter: current_step = 0
0:15:34.972305 INFO: initial parameter: ms1_error = 10
0:15:34.972326 INFO: initial parameter: ms2_error = 10
0:15:34.972346 INFO: initial parameter: rt_error = 240
0:15:34.972368 INFO: initial parameter: mobility_error = 0.08
0:15:34.972388 INFO: initial parameter: column_type = library
0:15:34.972407 INFO: initial parameter: num_candidates = 1
0:15:34.972426 INFO: initial parameter: recalibration_target = 200
0:15:34.972447 INFO: initial parameter: accumulated_precursors = 0
0:15:34.972466 INFO: initial parameter: accumulated_precursors_01FDR = 0
0:15:34.972486 INFO: initial parameter: accumulated_precursors_001FDR = 0
0:15:34.972516 INFO: Initializing FDRManager
0:15:34.972546 INFO: Loading classifier store from /home/alphadia/miniconda3/envs/alphadia172/lib/python3.11/site-packages/alphadia/constants/classifier
0:15:34.982325 PROGRESS: Applying channel filter using only: [0]
0:15:36.974655 PROGRESS: 4,989,882 target precursors potentially observable (188,089 removed)
0:15:40.538783 INFO: === checking if epoch conditions were reached ===
0:15:40.539044 INFO: ❌ ms2_error      : 10.0000 > 7
0:15:40.539125 INFO: ❌ rt_error       : 240.0000 > 100
0:15:40.539188 INFO: ❌ current_epoch  : 0 < 3
0:15:40.539244 INFO: ==============================================
0:15:40.762379 INFO: calibration group: precursor, predicting mz
0:15:40.762633 WARNING: mz prediction was skipped as it has not been fitted yet
0:15:40.762674 INFO: calibration group: precursor, predicting rt
0:15:40.762734 WARNING: rt prediction was skipped as it has not been fitted yet
0:15:40.762769 INFO: calibration group: fragment, predicting mz
0:15:40.762824 WARNING: mz prediction was skipped as it has not been fitted yet
0:15:40.762859 PROGRESS: === Epoch 0, step 0, extracting elution groups 0 to 1000 ===
0:15:40.835500 PROGRESS: Extracting batch of 1977 precursors
0:15:42.708781 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:15:42.708899 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:15:42.708968 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
0:15:42.708999 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
0:15:44.371862 INFO: Starting candidate selection
0:16:24.634769 INFO: Starting candidate scoring
0:19:25.901815 INFO: Finished candidate processing
0:19:25.901926 INFO: Collecting candidate features
0:19:28.375218 INFO: Collecting fragment features
0:19:30.196005 INFO: Finished candidate scoring
0:19:30.469861 PROGRESS: === Epoch 0, step 0, extracted 1712 precursors and 8078 fragments ===
0:19:30.470135 INFO: performing precursor FDR with 47 features
0:19:30.470192 INFO: Decoy channel: -1
0:19:30.470218 INFO: Competetive: True
0:19:32.790126 INFO: Test AUC: 0.534
0:19:32.790252 INFO: Train AUC: 0.516
0:19:32.790298 INFO: AUC difference: 3.51%
0:19:32.912991 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
0:19:32.913904 PROGRESS: ============================= Precursor FDR =============================
0:19:32.914061 PROGRESS: Total precursors accumulated: 1
0:19:32.914166 PROGRESS: Target precursors: 1 (100.00%)
0:19:32.914263 PROGRESS: Decoy precursors: 0 (0.00%)
0:19:32.914353 PROGRESS: 
0:19:32.914449 PROGRESS: Precursor Summary:
0:19:32.916541 PROGRESS: Channel   0:	 0.05 FDR:     1; 0.01 FDR:     1; 0.001 FDR:     1
0:19:32.916683 PROGRESS: 
0:19:32.916789 PROGRESS: Protein Summary:
0:19:32.919141 PROGRESS: Channel   0:	 0.05 FDR:     1; 0.01 FDR:     1; 0.001 FDR:     1
0:19:32.919276 PROGRESS: =========================================================================
0:19:32.920182 PROGRESS: === Epoch 0, step 1, extracting elution groups 1000 to 3000 ===
0:19:32.997293 PROGRESS: Extracting batch of 3947 precursors
0:19:32.999450 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:19:32.999510 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:19:32.999560 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
0:19:32.999628 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
0:19:32.999869 INFO: Starting candidate selection
0:19:35.996174 INFO: Starting candidate scoring
0:19:37.093221 INFO: Finished candidate processing
0:19:37.093310 INFO: Collecting candidate features
0:19:39.229735 INFO: Collecting fragment features
0:19:39.837319 INFO: Finished candidate scoring
0:19:40.111958 PROGRESS: === Epoch 0, step 1, extracted 3376 precursors and 15752 fragments ===
0:19:40.112233 INFO: performing precursor FDR with 47 features
0:19:40.112278 INFO: Decoy channel: -1
0:19:40.112306 INFO: Competetive: True
0:19:40.154692 INFO: Test AUC: 0.517
0:19:40.154804 INFO: Train AUC: 0.511
0:19:40.154850 INFO: AUC difference: 1.17%
0:19:40.272735 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
0:19:40.273555 PROGRESS: ============================= Precursor FDR =============================
0:19:40.273679 PROGRESS: Total precursors accumulated: 2
0:19:40.273756 PROGRESS: Target precursors: 2 (100.00%)
0:19:40.273836 PROGRESS: Decoy precursors: 0 (0.00%)
0:19:40.273900 PROGRESS: 
0:19:40.273961 PROGRESS: Precursor Summary:
0:19:40.275457 PROGRESS: Channel   0:	 0.05 FDR:     2; 0.01 FDR:     2; 0.001 FDR:     2
0:19:40.275586 PROGRESS: 
0:19:40.275661 PROGRESS: Protein Summary:
0:19:40.277342 PROGRESS: Channel   0:	 0.05 FDR:     2; 0.01 FDR:     2; 0.001 FDR:     2
0:19:40.277467 PROGRESS: =========================================================================
0:19:40.278373 PROGRESS: === Epoch 0, step 2, extracting elution groups 3000 to 7000 ===
0:19:40.361219 PROGRESS: Extracting batch of 7901 precursors
0:19:40.364349 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:19:40.364409 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:19:40.364448 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
0:19:40.364493 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
0:19:40.364715 INFO: Starting candidate selection
0:19:43.423892 INFO: Starting candidate scoring
0:19:44.549045 INFO: Finished candidate processing
0:19:44.549136 INFO: Collecting candidate features
0:19:46.722666 INFO: Collecting fragment features
0:19:47.342798 INFO: Finished candidate scoring
0:19:47.625019 PROGRESS: === Epoch 0, step 2, extracted 6634 precursors and 30888 fragments ===
0:19:47.625304 INFO: performing precursor FDR with 47 features
0:19:47.625348 INFO: Decoy channel: -1
0:19:47.625374 INFO: Competetive: True
0:19:47.690095 INFO: Test AUC: 0.513
0:19:47.690228 INFO: Train AUC: 0.514
0:19:47.690275 INFO: AUC difference: 0.23%
0:19:47.810129 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
0:19:47.811003 PROGRESS: ============================= Precursor FDR =============================
0:19:47.811136 PROGRESS: Total precursors accumulated: 1
0:19:47.811214 PROGRESS: Target precursors: 1 (100.00%)
0:19:47.811282 PROGRESS: Decoy precursors: 0 (0.00%)
0:19:47.811346 PROGRESS: 
0:19:47.811408 PROGRESS: Precursor Summary:
0:19:47.812909 PROGRESS: Channel   0:	 0.05 FDR:     1; 0.01 FDR:     1; 0.001 FDR:     1
0:19:47.813040 PROGRESS: 
0:19:47.813114 PROGRESS: Protein Summary:
0:19:47.814821 PROGRESS: Channel   0:	 0.05 FDR:     1; 0.01 FDR:     1; 0.001 FDR:     1
0:19:47.814933 PROGRESS: =========================================================================
0:19:47.815822 PROGRESS: === Epoch 0, step 3, extracting elution groups 7000 to 15000 ===
0:19:47.907499 PROGRESS: Extracting batch of 15827 precursors
0:19:47.912879 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:19:47.912948 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:19:47.912984 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
0:19:47.913025 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
0:19:47.913251 INFO: Starting candidate selection
0:19:51.685564 INFO: Starting candidate scoring
0:19:52.889565 INFO: Finished candidate processing
0:19:52.889654 INFO: Collecting candidate features
0:19:55.092873 INFO: Collecting fragment features
0:19:55.721301 INFO: Finished candidate scoring
0:19:56.012089 PROGRESS: === Epoch 0, step 3, extracted 13490 precursors and 63012 fragments ===
0:19:56.012422 INFO: performing precursor FDR with 47 features
0:19:56.012469 INFO: Decoy channel: -1
0:19:56.012496 INFO: Competetive: True
0:19:57.920285 INFO: Test AUC: 0.518
0:19:57.920449 INFO: Train AUC: 0.533
0:19:57.920497 INFO: AUC difference: 2.85%
0:19:58.045500 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
0:19:58.051166 PROGRESS: ============================= Precursor FDR =============================
0:19:58.051378 PROGRESS: Total precursors accumulated: 13,182
0:19:58.051458 PROGRESS: Target precursors: 7,079 (53.70%)
0:19:58.051527 PROGRESS: Decoy precursors: 6,103 (46.30%)
0:19:58.051589 PROGRESS: 
0:19:58.051651 PROGRESS: Precursor Summary:
0:19:58.053236 PROGRESS: Channel   0:	 0.05 FDR:     0; 0.01 FDR:     0; 0.001 FDR:     0
0:19:58.053388 PROGRESS: 
0:19:58.053465 PROGRESS: Protein Summary:
0:19:58.055195 PROGRESS: Channel   0:	 0.05 FDR:     0; 0.01 FDR:     0; 0.001 FDR:     0
0:19:58.055307 PROGRESS: =========================================================================
0:19:58.056196 PROGRESS: === Epoch 0, step 4, extracting elution groups 15000 to 31000 ===
0:19:58.163985 PROGRESS: Extracting batch of 31636 precursors
0:19:58.174227 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:19:58.174324 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:19:58.174365 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
0:19:58.174392 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
0:19:58.174643 INFO: Starting candidate selection
0:20:01.768419 INFO: Starting candidate scoring
0:20:03.086923 INFO: Finished candidate processing
0:20:03.087111 INFO: Collecting candidate features
0:20:05.308949 WARNING: intensity_correlation has 1 NaNs ( 0.00 % out of 26733)
0:20:05.315651 INFO: Collecting fragment features
0:20:05.956512 INFO: Finished candidate scoring
0:20:06.259893 PROGRESS: === Epoch 0, step 4, extracted 26733 precursors and 124401 fragments ===
0:20:06.260200 INFO: performing precursor FDR with 47 features
0:20:06.260248 INFO: Decoy channel: -1
0:20:06.260276 INFO: Competetive: True
0:20:06.309316 WARNING: dropped 1 target PSMs due to missing features
0:20:07.872450 INFO: Test AUC: 0.544
0:20:07.872594 INFO: Train AUC: 0.541
0:20:07.872640 INFO: AUC difference: 0.49%
0:20:08.000664 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
0:20:08.001525 PROGRESS: ============================= Precursor FDR =============================
0:20:08.001645 PROGRESS: Total precursors accumulated: 31
0:20:08.001721 PROGRESS: Target precursors: 29 (93.55%)
0:20:08.001812 PROGRESS: Decoy precursors: 2 (6.45%)
0:20:08.001877 PROGRESS: 
0:20:08.001939 PROGRESS: Precursor Summary:
0:20:08.003389 PROGRESS: Channel   0:	 0.05 FDR:    25; 0.01 FDR:    23; 0.001 FDR:    23
0:20:08.003524 PROGRESS: 
0:20:08.003598 PROGRESS: Protein Summary:
0:20:08.005227 PROGRESS: Channel   0:	 0.05 FDR:    25; 0.01 FDR:    23; 0.001 FDR:    23
0:20:08.005338 PROGRESS: =========================================================================
0:20:08.006208 PROGRESS: === Epoch 0, step 5, extracting elution groups 31000 to 63000 ===
0:20:08.140929 PROGRESS: Extracting batch of 63239 precursors
0:20:08.167384 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:20:08.167491 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:20:08.167530 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
0:20:08.167573 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
0:20:08.167836 INFO: Starting candidate selection
0:20:12.428332 INFO: Starting candidate scoring
0:20:14.011045 INFO: Finished candidate processing
0:20:14.011138 INFO: Collecting candidate features
0:20:16.338895 WARNING: intensity_correlation has 2 NaNs ( 0.00 % out of 53424)
0:20:16.347234 INFO: Collecting fragment features
0:20:17.022706 INFO: Finished candidate scoring
0:20:17.365373 PROGRESS: === Epoch 0, step 5, extracted 53424 precursors and 247528 fragments ===
0:20:17.365686 INFO: performing precursor FDR with 47 features
0:20:17.365732 INFO: Decoy channel: -1
0:20:17.365760 INFO: Competetive: True
0:20:17.482908 WARNING: dropped 2 target PSMs due to missing features
0:20:17.483021 WARNING: dropped 1 decoy PSMs due to missing features
0:20:20.861920 INFO: Test AUC: 0.537
0:20:20.862043 INFO: Train AUC: 0.555
0:20:20.862084 INFO: AUC difference: 3.35%
0:20:20.998548 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
0:20:20.999488 PROGRESS: ============================= Precursor FDR =============================
0:20:20.999610 PROGRESS: Total precursors accumulated: 242
0:20:20.999689 PROGRESS: Target precursors: 221 (91.32%)
0:20:20.999758 PROGRESS: Decoy precursors: 21 (8.68%)
0:20:20.999823 PROGRESS: 
0:20:20.999886 PROGRESS: Precursor Summary:
0:20:21.001413 PROGRESS: Channel   0:	 0.05 FDR:   190; 0.01 FDR:   101; 0.001 FDR:    77
0:20:21.001523 PROGRESS: 
0:20:21.001594 PROGRESS: Protein Summary:
0:20:21.003376 PROGRESS: Channel   0:	 0.05 FDR:   185; 0.01 FDR:    97; 0.001 FDR:    75
0:20:21.003503 PROGRESS: =========================================================================
0:20:21.004409 PROGRESS: === Epoch 0, step 6, extracting elution groups 63000 to 127000 ===
0:20:21.177637 PROGRESS: Extracting batch of 126459 precursors
0:20:21.214878 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:20:21.214996 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:20:21.215051 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
0:20:21.215078 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
0:20:21.215366 INFO: Starting candidate selection
0:20:26.848848 INFO: Starting candidate scoring
0:20:28.974914 INFO: Finished candidate processing
0:20:28.975047 INFO: Collecting candidate features
0:20:31.484102 WARNING: intensity_correlation has 6 NaNs ( 0.01 % out of 107363)
0:20:31.496083 INFO: Collecting fragment features
0:20:32.229004 INFO: Finished candidate scoring
0:20:32.636775 PROGRESS: === Epoch 0, step 6, extracted 107363 precursors and 499628 fragments ===
0:20:32.637091 INFO: performing precursor FDR with 47 features
0:20:32.637136 INFO: Decoy channel: -1
0:20:32.637163 INFO: Competetive: True
0:20:32.885697 WARNING: dropped 5 target PSMs due to missing features
0:20:32.885838 WARNING: dropped 4 decoy PSMs due to missing features
0:20:40.294115 INFO: Test AUC: 0.539
0:20:40.294259 INFO: Train AUC: 0.559
0:20:40.294299 INFO: AUC difference: 3.60%
0:20:40.444413 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
0:20:40.445490 PROGRESS: ============================= Precursor FDR =============================
0:20:40.445627 PROGRESS: Total precursors accumulated: 620
0:20:40.445705 PROGRESS: Target precursors: 564 (90.97%)
0:20:40.445793 PROGRESS: Decoy precursors: 56 (9.03%)
0:20:40.445863 PROGRESS: 
0:20:40.445925 PROGRESS: Precursor Summary:
0:20:40.447605 PROGRESS: Channel   0:	 0.05 FDR:   492; 0.01 FDR:   233; 0.001 FDR:    83
0:20:40.447717 PROGRESS: 
0:20:40.447791 PROGRESS: Protein Summary:
0:20:40.449738 PROGRESS: Channel   0:	 0.05 FDR:   462; 0.01 FDR:   223; 0.001 FDR:    82
0:20:40.449855 PROGRESS: =========================================================================
0:20:40.451485 INFO: calibration group: precursor, fitting rt estimator 
0:20:40.559588 INFO: calibration group: fragment, fitting mz estimator 
0:20:40.845701 INFO: === checking if epoch conditions were reached ===
0:20:40.845840 INFO: ✅ ms2_error      : 7.0000 <= 7
0:20:40.845927 INFO: ❌ rt_error       : 224.5540 > 100
0:20:40.846000 INFO: ❌ current_epoch  : 0 < 3
0:20:40.846073 INFO: ==============================================
0:20:41.087695 INFO: calibration group: precursor, predicting mz
0:20:41.087949 WARNING: mz prediction was skipped as it has not been fitted yet
0:20:41.087990 INFO: calibration group: precursor, predicting rt
0:20:48.258869 INFO: calibration group: fragment, predicting mz
0:21:05.507372 PROGRESS: === Epoch 1, step 0, extracting elution groups 0 to 1000 ===
0:21:05.588017 PROGRESS: Extracting batch of 1975 precursors
0:21:05.589655 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:21:05.589731 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:21:05.589803 INFO: FWHM in RT is 16.96 seconds, sigma is 0.62
0:21:05.589852 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:21:05.590101 INFO: Starting candidate selection
0:21:09.469963 INFO: Starting candidate scoring
0:21:10.777243 INFO: Finished candidate processing
0:21:10.777331 INFO: Collecting candidate features
0:21:12.946412 WARNING: intensity_correlation has 8 NaNs ( 0.43 % out of 1850)
0:21:12.953305 INFO: Collecting fragment features
0:21:13.579818 INFO: Finished candidate scoring
0:21:13.872215 PROGRESS: === Epoch 1, step 0, extracted 1850 precursors and 8561 fragments ===
0:21:13.872516 INFO: performing precursor FDR with 47 features
0:21:13.872560 INFO: Decoy channel: -1
0:21:13.872586 INFO: Competetive: True
0:21:13.877165 WARNING: dropped 2 target PSMs due to missing features
0:21:13.877239 WARNING: dropped 6 decoy PSMs due to missing features
0:21:13.906237 INFO: Test AUC: 0.577
0:21:13.906331 INFO: Train AUC: 0.548
0:21:13.906373 INFO: AUC difference: 5.30%
0:21:13.906409 WARNING: AUC difference > 5%. This may indicate overfitting.
0:21:14.025540 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
0:21:14.026337 PROGRESS: ============================= Precursor FDR =============================
0:21:14.026460 PROGRESS: Total precursors accumulated: 23
0:21:14.026537 PROGRESS: Target precursors: 21 (91.30%)
0:21:14.026606 PROGRESS: Decoy precursors: 2 (8.70%)
0:21:14.026669 PROGRESS: 
0:21:14.026731 PROGRESS: Precursor Summary:
0:21:14.028151 PROGRESS: Channel   0:	 0.05 FDR:    12; 0.01 FDR:    12; 0.001 FDR:    12
0:21:14.028265 PROGRESS: 
0:21:14.028339 PROGRESS: Protein Summary:
0:21:14.029995 PROGRESS: Channel   0:	 0.05 FDR:    12; 0.01 FDR:    12; 0.001 FDR:    12
0:21:14.030113 PROGRESS: =========================================================================
0:21:14.030976 PROGRESS: === Epoch 1, step 1, extracting elution groups 1000 to 3000 ===
0:21:14.108305 PROGRESS: Extracting batch of 3949 precursors
0:21:14.110581 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:21:14.110647 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:21:14.110688 INFO: FWHM in RT is 16.96 seconds, sigma is 0.62
0:21:14.110718 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:21:14.110943 INFO: Starting candidate selection
0:21:17.582397 INFO: Starting candidate scoring
0:21:18.890439 INFO: Finished candidate processing
0:21:18.890546 INFO: Collecting candidate features
0:21:21.040119 WARNING: intensity_correlation has 15 NaNs ( 0.40 % out of 3713)
0:21:21.046458 INFO: Collecting fragment features
0:21:21.651630 INFO: Finished candidate scoring
0:21:21.927724 PROGRESS: === Epoch 1, step 1, extracted 3713 precursors and 17171 fragments ===
0:21:21.928004 INFO: performing precursor FDR with 47 features
0:21:21.928049 INFO: Decoy channel: -1
0:21:21.928076 INFO: Competetive: True
0:21:21.936475 WARNING: dropped 8 target PSMs due to missing features
0:21:21.936564 WARNING: dropped 15 decoy PSMs due to missing features
0:21:21.973967 INFO: Test AUC: 0.571
0:21:21.974084 INFO: Train AUC: 0.541
0:21:21.974128 INFO: AUC difference: 5.56%
0:21:21.974163 WARNING: AUC difference > 5%. This may indicate overfitting.
0:21:22.094101 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
0:21:22.094880 PROGRESS: ============================= Precursor FDR =============================
0:21:22.095001 PROGRESS: Total precursors accumulated: 34
0:21:22.095078 PROGRESS: Target precursors: 31 (91.18%)
0:21:22.095146 PROGRESS: Decoy precursors: 3 (8.82%)
0:21:22.095209 PROGRESS: 
0:21:22.095271 PROGRESS: Precursor Summary:
0:21:22.096702 PROGRESS: Channel   0:	 0.05 FDR:    27; 0.01 FDR:    27; 0.001 FDR:    27
0:21:22.096831 PROGRESS: 
0:21:22.096905 PROGRESS: Protein Summary:
0:21:22.098532 PROGRESS: Channel   0:	 0.05 FDR:    27; 0.01 FDR:    27; 0.001 FDR:    27
0:21:22.098646 PROGRESS: =========================================================================
0:21:22.099501 PROGRESS: === Epoch 1, step 2, extracting elution groups 3000 to 7000 ===
0:21:22.181540 PROGRESS: Extracting batch of 7905 precursors
0:21:22.184773 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:21:22.184838 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:21:22.184876 INFO: FWHM in RT is 16.96 seconds, sigma is 0.62
0:21:22.184920 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:21:22.185137 INFO: Starting candidate selection
0:21:25.730648 INFO: Starting candidate scoring
0:21:27.078433 INFO: Finished candidate processing
0:21:27.078524 INFO: Collecting candidate features
0:21:29.241465 WARNING: intensity_correlation has 32 NaNs ( 0.43 % out of 7445)
0:21:29.247020 INFO: Collecting fragment features
0:21:29.860003 INFO: Finished candidate scoring
0:21:30.140816 PROGRESS: === Epoch 1, step 2, extracted 7445 precursors and 34569 fragments ===
0:21:30.141099 INFO: performing precursor FDR with 47 features
0:21:30.141146 INFO: Decoy channel: -1
0:21:30.141173 INFO: Competetive: True
0:21:30.156170 WARNING: dropped 26 target PSMs due to missing features
0:21:30.156271 WARNING: dropped 29 decoy PSMs due to missing features
0:21:30.404602 INFO: Test AUC: 0.543
0:21:30.404732 INFO: Train AUC: 0.551
0:21:30.404878 INFO: AUC difference: 1.44%
0:21:30.527969 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
0:21:30.528821 PROGRESS: ============================= Precursor FDR =============================
0:21:30.528940 PROGRESS: Total precursors accumulated: 61
0:21:30.529019 PROGRESS: Target precursors: 56 (91.80%)
0:21:30.529100 PROGRESS: Decoy precursors: 5 (8.20%)
0:21:30.529166 PROGRESS: 
0:21:30.529227 PROGRESS: Precursor Summary:
0:21:30.530687 PROGRESS: Channel   0:	 0.05 FDR:    49; 0.01 FDR:    46; 0.001 FDR:    46
0:21:30.530801 PROGRESS: 
0:21:30.530875 PROGRESS: Protein Summary:
0:21:30.532542 PROGRESS: Channel   0:	 0.05 FDR:    49; 0.01 FDR:    46; 0.001 FDR:    46
0:21:30.532653 PROGRESS: =========================================================================
0:21:30.533532 PROGRESS: === Epoch 1, step 3, extracting elution groups 7000 to 15000 ===
0:21:30.625180 PROGRESS: Extracting batch of 15795 precursors
0:21:30.630601 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:21:30.630686 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:21:30.630722 INFO: FWHM in RT is 16.96 seconds, sigma is 0.62
0:21:30.630749 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:21:30.630991 INFO: Starting candidate selection
0:21:34.366990 INFO: Starting candidate scoring
0:21:35.785515 INFO: Finished candidate processing
0:21:35.785610 INFO: Collecting candidate features
0:21:37.971642 WARNING: intensity_correlation has 60 NaNs ( 0.40 % out of 14849)
0:21:37.977598 INFO: Collecting fragment features
0:21:38.601299 INFO: Finished candidate scoring
0:21:38.890257 PROGRESS: === Epoch 1, step 3, extracted 14849 precursors and 68519 fragments ===
0:21:38.890545 INFO: performing precursor FDR with 47 features
0:21:38.890589 INFO: Decoy channel: -1
0:21:38.890615 INFO: Competetive: True
0:21:38.918610 WARNING: dropped 60 target PSMs due to missing features
0:21:38.918725 WARNING: dropped 55 decoy PSMs due to missing features
0:21:39.705741 INFO: Test AUC: 0.547
0:21:39.705897 INFO: Train AUC: 0.568
0:21:39.705960 INFO: AUC difference: 3.57%
0:21:40.362406 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
0:21:40.363297 PROGRESS: ============================= Precursor FDR =============================
0:21:40.363423 PROGRESS: Total precursors accumulated: 137
0:21:40.363504 PROGRESS: Target precursors: 125 (91.24%)
0:21:40.363573 PROGRESS: Decoy precursors: 12 (8.76%)
0:21:40.363637 PROGRESS: 
0:21:40.363698 PROGRESS: Precursor Summary:
0:21:40.365188 PROGRESS: Channel   0:	 0.05 FDR:   101; 0.01 FDR:    64; 0.001 FDR:    64
0:21:40.365302 PROGRESS: 
0:21:40.365386 PROGRESS: Protein Summary:
0:21:40.367130 PROGRESS: Channel   0:	 0.05 FDR:    99; 0.01 FDR:    62; 0.001 FDR:    62
0:21:40.367242 PROGRESS: =========================================================================
0:21:40.368141 PROGRESS: === Epoch 1, step 4, extracting elution groups 15000 to 31000 ===
0:21:40.475612 PROGRESS: Extracting batch of 31606 precursors
0:21:40.486304 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:21:40.486401 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:21:40.486444 INFO: FWHM in RT is 16.96 seconds, sigma is 0.62
0:21:40.486470 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:21:40.486715 INFO: Starting candidate selection
0:21:44.547589 INFO: Starting candidate scoring
0:21:46.127085 INFO: Finished candidate processing
0:21:46.127174 INFO: Collecting candidate features
0:21:48.366305 WARNING: intensity_correlation has 123 NaNs ( 0.41 % out of 29700)
0:21:48.373203 INFO: Collecting fragment features
0:21:49.014201 INFO: Finished candidate scoring
0:21:49.321399 PROGRESS: === Epoch 1, step 4, extracted 29700 precursors and 136668 fragments ===
0:21:49.321714 INFO: performing precursor FDR with 47 features
0:21:49.321763 INFO: Decoy channel: -1
0:21:49.321801 INFO: Competetive: True
0:21:49.379001 WARNING: dropped 120 target PSMs due to missing features
0:21:49.379109 WARNING: dropped 118 decoy PSMs due to missing features
0:21:51.176864 INFO: Test AUC: 0.546
0:21:51.177047 INFO: Train AUC: 0.575
0:21:51.177098 INFO: AUC difference: 4.98%
0:21:51.303536 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
0:21:51.304479 PROGRESS: ============================= Precursor FDR =============================
0:21:51.304602 PROGRESS: Total precursors accumulated: 268
0:21:51.304680 PROGRESS: Target precursors: 245 (91.42%)
0:21:51.304749 PROGRESS: Decoy precursors: 23 (8.58%)
0:21:51.304813 PROGRESS: 
0:21:51.304874 PROGRESS: Precursor Summary:
0:21:51.306443 PROGRESS: Channel   0:	 0.05 FDR:   211; 0.01 FDR:   115; 0.001 FDR:   100
0:21:51.306561 PROGRESS: 
0:21:51.306635 PROGRESS: Protein Summary:
0:21:51.308420 PROGRESS: Channel   0:	 0.05 FDR:   208; 0.01 FDR:   113; 0.001 FDR:    99
0:21:51.308531 PROGRESS: =========================================================================
0:21:51.309471 PROGRESS: === Epoch 1, step 5, extracting elution groups 31000 to 63000 ===
0:21:51.447055 PROGRESS: Extracting batch of 63218 precursors
0:21:51.467111 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:21:51.467219 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:21:51.467288 INFO: FWHM in RT is 16.96 seconds, sigma is 0.62
0:21:51.467316 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:21:51.467577 INFO: Starting candidate selection
0:21:56.199847 INFO: Starting candidate scoring
0:21:58.100809 INFO: Finished candidate processing
0:21:58.100913 INFO: Collecting candidate features
0:22:00.440115 WARNING: intensity_correlation has 262 NaNs ( 0.44 % out of 59638)
0:22:00.449114 INFO: Collecting fragment features
0:22:01.119278 INFO: Finished candidate scoring
0:22:01.465271 PROGRESS: === Epoch 1, step 5, extracted 59638 precursors and 273440 fragments ===
0:22:01.472570 INFO: performing precursor FDR with 47 features
0:22:01.472739 INFO: Decoy channel: -1
0:22:01.472829 INFO: Competetive: True
0:22:01.602174 WARNING: dropped 251 target PSMs due to missing features
0:22:01.602292 WARNING: dropped 249 decoy PSMs due to missing features
0:22:05.297657 INFO: Test AUC: 0.547
0:22:05.297791 INFO: Train AUC: 0.571
0:22:05.297849 INFO: AUC difference: 4.23%
0:22:05.432394 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
0:22:05.433462 PROGRESS: ============================= Precursor FDR =============================
0:22:05.433587 PROGRESS: Total precursors accumulated: 551
0:22:05.433666 PROGRESS: Target precursors: 504 (91.47%)
0:22:05.433735 PROGRESS: Decoy precursors: 47 (8.53%)
0:22:05.433808 PROGRESS: 
0:22:05.433870 PROGRESS: Precursor Summary:
0:22:05.435543 PROGRESS: Channel   0:	 0.05 FDR:   412; 0.01 FDR:   276; 0.001 FDR:   183
0:22:05.435675 PROGRESS: 
0:22:05.435750 PROGRESS: Protein Summary:
0:22:05.437724 PROGRESS: Channel   0:	 0.05 FDR:   399; 0.01 FDR:   268; 0.001 FDR:   180
0:22:05.437846 PROGRESS: =========================================================================
0:22:05.438874 PROGRESS: === Epoch 1, step 6, extracting elution groups 63000 to 127000 ===
0:22:05.616403 PROGRESS: Extracting batch of 126476 precursors
0:22:05.654426 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:22:05.654542 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:22:05.654586 INFO: FWHM in RT is 16.96 seconds, sigma is 0.62
0:22:05.654614 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:22:05.654877 INFO: Starting candidate selection
0:22:11.605421 INFO: Starting candidate scoring
0:22:14.084702 INFO: Finished candidate processing
0:22:14.084881 INFO: Collecting candidate features
0:22:16.629120 WARNING: intensity_correlation has 483 NaNs ( 0.41 % out of 119211)
0:22:16.642256 INFO: Collecting fragment features
0:22:17.378386 INFO: Finished candidate scoring
0:22:17.801423 PROGRESS: === Epoch 1, step 6, extracted 119211 precursors and 549314 fragments ===
0:22:17.801721 INFO: performing precursor FDR with 47 features
0:22:17.801767 INFO: Decoy channel: -1
0:22:17.801817 INFO: Competetive: True
0:22:18.075903 WARNING: dropped 499 target PSMs due to missing features
0:22:18.076017 WARNING: dropped 484 decoy PSMs due to missing features
0:22:26.574890 INFO: Test AUC: 0.544
0:22:26.575018 INFO: Train AUC: 0.571
0:22:26.575075 INFO: AUC difference: 4.81%
0:22:26.729955 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
0:22:26.731162 PROGRESS: ============================= Precursor FDR =============================
0:22:26.731289 PROGRESS: Total precursors accumulated: 1,024
0:22:26.731367 PROGRESS: Target precursors: 934 (91.21%)
0:22:26.731446 PROGRESS: Decoy precursors: 90 (8.79%)
0:22:26.731511 PROGRESS: 
0:22:26.731573 PROGRESS: Precursor Summary:
0:22:26.733417 PROGRESS: Channel   0:	 0.05 FDR:   764; 0.01 FDR:   535; 0.001 FDR:   179
0:22:26.733549 PROGRESS: 
0:22:26.733622 PROGRESS: Protein Summary:
0:22:26.735863 PROGRESS: Channel   0:	 0.05 FDR:   706; 0.01 FDR:   496; 0.001 FDR:   171
0:22:26.735978 PROGRESS: =========================================================================
0:22:26.737942 INFO: calibration group: precursor, fitting rt estimator 
0:22:26.858611 INFO: calibration group: fragment, fitting mz estimator 
0:22:27.448840 INFO: === checking if epoch conditions were reached ===
0:22:27.448989 INFO: ✅ ms2_error      : 7.0000 <= 7
0:22:27.449078 INFO: ❌ rt_error       : 203.8544 > 100
0:22:27.449152 INFO: ❌ current_epoch  : 1 < 3
0:22:27.449218 INFO: ==============================================
0:22:27.698493 INFO: calibration group: precursor, predicting mz
0:22:27.698747 WARNING: mz prediction was skipped as it has not been fitted yet
0:22:27.698789 INFO: calibration group: precursor, predicting rt
0:22:34.624821 INFO: calibration group: fragment, predicting mz
0:22:52.270100 PROGRESS: === Epoch 2, step 0, extracting elution groups 0 to 1000 ===
0:22:52.351928 PROGRESS: Extracting batch of 1980 precursors
0:22:52.353571 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:22:52.353647 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:22:52.353685 INFO: FWHM in RT is 14.90 seconds, sigma is 0.54
0:22:52.353731 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:22:52.354015 INFO: Starting candidate selection
0:22:56.135255 INFO: Starting candidate scoring
0:22:57.419250 INFO: Finished candidate processing
0:22:57.419340 INFO: Collecting candidate features
0:22:59.568234 WARNING: intensity_correlation has 6 NaNs ( 0.32 % out of 1850)
0:22:59.574089 INFO: Collecting fragment features
0:23:00.174799 INFO: Finished candidate scoring
0:23:00.467077 PROGRESS: === Epoch 2, step 0, extracted 1850 precursors and 8534 fragments ===
0:23:00.467419 INFO: performing precursor FDR with 47 features
0:23:00.467470 INFO: Decoy channel: -1
0:23:00.467501 INFO: Competetive: True
0:23:00.473109 WARNING: dropped 1 target PSMs due to missing features
0:23:00.473190 WARNING: dropped 5 decoy PSMs due to missing features
0:23:00.501070 INFO: Test AUC: 0.570
0:23:00.501164 INFO: Train AUC: 0.540
0:23:00.501210 INFO: AUC difference: 5.62%
0:23:00.501244 WARNING: AUC difference > 5%. This may indicate overfitting.
0:23:00.618310 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
0:23:00.619069 PROGRESS: ============================= Precursor FDR =============================
0:23:00.619190 PROGRESS: Total precursors accumulated: 13
0:23:00.619267 PROGRESS: Target precursors: 12 (92.31%)
0:23:00.619334 PROGRESS: Decoy precursors: 1 (7.69%)
0:23:00.619395 PROGRESS: 
0:23:00.619456 PROGRESS: Precursor Summary:
0:23:00.620861 PROGRESS: Channel   0:	 0.05 FDR:     6; 0.01 FDR:     6; 0.001 FDR:     6
0:23:00.620972 PROGRESS: 
0:23:00.621043 PROGRESS: Protein Summary:
0:23:00.622666 PROGRESS: Channel   0:	 0.05 FDR:     6; 0.01 FDR:     6; 0.001 FDR:     6
0:23:00.622779 PROGRESS: =========================================================================
0:23:00.623623 PROGRESS: === Epoch 2, step 1, extracting elution groups 1000 to 3000 ===
0:23:00.701371 PROGRESS: Extracting batch of 3944 precursors
0:23:00.703597 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:23:00.703676 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:23:00.703717 INFO: FWHM in RT is 14.90 seconds, sigma is 0.54
0:23:00.703748 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:23:00.703980 INFO: Starting candidate selection
0:23:04.223115 INFO: Starting candidate scoring
0:23:05.557271 INFO: Finished candidate processing
0:23:05.557451 INFO: Collecting candidate features
0:23:07.738131 WARNING: intensity_correlation has 16 NaNs ( 0.43 % out of 3700)
0:23:07.744323 INFO: Collecting fragment features
0:23:08.357609 INFO: Finished candidate scoring
0:23:08.636903 PROGRESS: === Epoch 2, step 1, extracted 3700 precursors and 16966 fragments ===
0:23:08.637180 INFO: performing precursor FDR with 47 features
0:23:08.637226 INFO: Decoy channel: -1
0:23:08.637254 INFO: Competetive: True
0:23:08.645713 WARNING: dropped 9 target PSMs due to missing features
0:23:08.645833 WARNING: dropped 13 decoy PSMs due to missing features
0:23:08.682644 INFO: Test AUC: 0.551
0:23:08.682765 INFO: Train AUC: 0.542
0:23:08.682811 INFO: AUC difference: 1.75%
0:23:08.805754 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
0:23:08.806564 PROGRESS: ============================= Precursor FDR =============================
0:23:08.806687 PROGRESS: Total precursors accumulated: 31
0:23:08.806766 PROGRESS: Target precursors: 29 (93.55%)
0:23:08.806834 PROGRESS: Decoy precursors: 2 (6.45%)
0:23:08.806904 PROGRESS: 
0:23:08.806966 PROGRESS: Precursor Summary:
0:23:08.808400 PROGRESS: Channel   0:	 0.05 FDR:    29; 0.01 FDR:    26; 0.001 FDR:    26
0:23:08.808533 PROGRESS: 
0:23:08.808606 PROGRESS: Protein Summary:
0:23:08.810243 PROGRESS: Channel   0:	 0.05 FDR:    29; 0.01 FDR:    26; 0.001 FDR:    26
0:23:08.810358 PROGRESS: =========================================================================
0:23:08.811219 PROGRESS: === Epoch 2, step 2, extracting elution groups 3000 to 7000 ===
0:23:08.893564 PROGRESS: Extracting batch of 7902 precursors
0:23:08.896856 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:23:08.896922 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:23:08.896961 INFO: FWHM in RT is 14.90 seconds, sigma is 0.54
0:23:08.897007 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:23:08.897228 INFO: Starting candidate selection
0:23:12.484118 INFO: Starting candidate scoring
0:23:13.837616 INFO: Finished candidate processing
0:23:13.837709 INFO: Collecting candidate features
0:23:16.032797 WARNING: intensity_correlation has 19 NaNs ( 0.25 % out of 7462)
0:23:16.038528 INFO: Collecting fragment features
0:23:16.661065 INFO: Finished candidate scoring
0:23:16.944601 PROGRESS: === Epoch 2, step 2, extracted 7462 precursors and 34388 fragments ===
0:23:16.944895 INFO: performing precursor FDR with 47 features
0:23:16.944940 INFO: Decoy channel: -1
0:23:16.944968 INFO: Competetive: True
0:23:16.960018 WARNING: dropped 21 target PSMs due to missing features
0:23:16.960117 WARNING: dropped 20 decoy PSMs due to missing features
0:23:17.270369 INFO: Test AUC: 0.535
0:23:17.270691 INFO: Train AUC: 0.566
0:23:17.270823 INFO: AUC difference: 5.52%
0:23:17.270964 WARNING: AUC difference > 5%. This may indicate overfitting.
0:23:17.393223 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
0:23:17.394085 PROGRESS: ============================= Precursor FDR =============================
0:23:17.394205 PROGRESS: Total precursors accumulated: 71
0:23:17.394283 PROGRESS: Target precursors: 65 (91.55%)
0:23:17.394353 PROGRESS: Decoy precursors: 6 (8.45%)
0:23:17.394417 PROGRESS: 
0:23:17.394479 PROGRESS: Precursor Summary:
0:23:17.395932 PROGRESS: Channel   0:	 0.05 FDR:    50; 0.01 FDR:    36; 0.001 FDR:    36
0:23:17.396045 PROGRESS: 
0:23:17.396119 PROGRESS: Protein Summary:
0:23:17.397777 PROGRESS: Channel   0:	 0.05 FDR:    50; 0.01 FDR:    36; 0.001 FDR:    36
0:23:17.397900 PROGRESS: =========================================================================
0:23:17.398772 PROGRESS: === Epoch 2, step 3, extracting elution groups 7000 to 15000 ===
0:23:17.490084 PROGRESS: Extracting batch of 15830 precursors
0:23:17.495718 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:23:17.495788 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:23:17.495821 INFO: FWHM in RT is 14.90 seconds, sigma is 0.54
0:23:17.495863 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:23:17.496087 INFO: Starting candidate selection
0:23:21.269444 INFO: Starting candidate scoring
0:23:22.713429 INFO: Finished candidate processing
0:23:22.713561 INFO: Collecting candidate features
0:23:24.917691 WARNING: intensity_correlation has 40 NaNs ( 0.27 % out of 14858)
0:23:24.924973 INFO: Collecting fragment features
0:23:25.560254 INFO: Finished candidate scoring
0:23:25.850728 PROGRESS: === Epoch 2, step 3, extracted 14858 precursors and 68220 fragments ===
0:23:25.851002 INFO: performing precursor FDR with 47 features
0:23:25.851050 INFO: Decoy channel: -1
0:23:25.851077 INFO: Competetive: True
0:23:25.879125 WARNING: dropped 42 target PSMs due to missing features
0:23:25.879235 WARNING: dropped 39 decoy PSMs due to missing features
0:23:26.621759 INFO: Test AUC: 0.536
0:23:26.621913 INFO: Train AUC: 0.577
0:23:26.621961 INFO: AUC difference: 7.00%
0:23:26.621995 WARNING: AUC difference > 5%. This may indicate overfitting.
0:23:26.750639 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
0:23:26.751511 PROGRESS: ============================= Precursor FDR =============================
0:23:26.751634 PROGRESS: Total precursors accumulated: 224
0:23:26.751712 PROGRESS: Target precursors: 204 (91.07%)
0:23:26.751780 PROGRESS: Decoy precursors: 20 (8.93%)
0:23:26.751843 PROGRESS: 
0:23:26.751905 PROGRESS: Precursor Summary:
0:23:26.753404 PROGRESS: Channel   0:	 0.05 FDR:   126; 0.01 FDR:   113; 0.001 FDR:   113
0:23:26.753531 PROGRESS: 
0:23:26.753605 PROGRESS: Protein Summary:
0:23:26.755342 PROGRESS: Channel   0:	 0.05 FDR:   125; 0.01 FDR:   112; 0.001 FDR:   112
0:23:26.755454 PROGRESS: =========================================================================
0:23:26.756364 PROGRESS: === Epoch 2, step 4, extracting elution groups 15000 to 31000 ===
0:23:26.864139 PROGRESS: Extracting batch of 31616 precursors
0:23:26.874645 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:23:26.874747 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:23:26.874786 INFO: FWHM in RT is 14.90 seconds, sigma is 0.54
0:23:26.874812 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:23:26.875050 INFO: Starting candidate selection
0:23:30.927874 INFO: Starting candidate scoring
0:23:32.518940 INFO: Finished candidate processing
0:23:32.519060 INFO: Collecting candidate features
0:23:34.785459 WARNING: intensity_correlation has 53 NaNs ( 0.18 % out of 29693)
0:23:34.792486 INFO: Collecting fragment features
0:23:35.440559 INFO: Finished candidate scoring
0:23:35.751255 PROGRESS: === Epoch 2, step 4, extracted 29693 precursors and 135984 fragments ===
0:23:35.751557 INFO: performing precursor FDR with 47 features
0:23:35.751602 INFO: Decoy channel: -1
0:23:35.751629 INFO: Competetive: True
0:23:35.810238 WARNING: dropped 76 target PSMs due to missing features
0:23:35.810365 WARNING: dropped 58 decoy PSMs due to missing features
0:23:37.566088 INFO: Test AUC: 0.549
0:23:37.566243 INFO: Train AUC: 0.580
0:23:37.566289 INFO: AUC difference: 5.24%
0:23:37.566325 WARNING: AUC difference > 5%. This may indicate overfitting.
0:23:37.695264 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
0:23:37.696229 PROGRESS: ============================= Precursor FDR =============================
0:23:37.696357 PROGRESS: Total precursors accumulated: 322
0:23:37.696434 PROGRESS: Target precursors: 293 (90.99%)
0:23:37.696503 PROGRESS: Decoy precursors: 29 (9.01%)
0:23:37.696566 PROGRESS: 
0:23:37.696627 PROGRESS: Precursor Summary:
0:23:37.698216 PROGRESS: Channel   0:	 0.05 FDR:   232; 0.01 FDR:   175; 0.001 FDR:   141
0:23:37.698329 PROGRESS: 
0:23:37.698402 PROGRESS: Protein Summary:
0:23:37.700227 PROGRESS: Channel   0:	 0.05 FDR:   227; 0.01 FDR:   171; 0.001 FDR:   139
0:23:37.700336 PROGRESS: =========================================================================
0:23:37.701287 PROGRESS: === Epoch 2, step 5, extracting elution groups 31000 to 63000 ===
0:23:37.837820 PROGRESS: Extracting batch of 63183 precursors
0:23:37.857397 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:23:37.857506 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:23:37.857542 INFO: FWHM in RT is 14.90 seconds, sigma is 0.54
0:23:37.857584 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:23:37.857865 INFO: Starting candidate selection
0:23:43.132295 INFO: Starting candidate scoring
0:23:45.014988 INFO: Finished candidate processing
0:23:45.015106 INFO: Collecting candidate features
0:23:47.347062 WARNING: intensity_correlation has 155 NaNs ( 0.26 % out of 59208)
0:23:47.355910 INFO: Collecting fragment features
0:23:48.041194 INFO: Finished candidate scoring
0:23:48.387608 PROGRESS: === Epoch 2, step 5, extracted 59208 precursors and 270777 fragments ===
0:23:48.387936 INFO: performing precursor FDR with 47 features
0:23:48.387986 INFO: Decoy channel: -1
0:23:48.388013 INFO: Competetive: True
0:23:48.517959 WARNING: dropped 158 target PSMs due to missing features
0:23:48.518093 WARNING: dropped 131 decoy PSMs due to missing features
0:23:52.421054 INFO: Test AUC: 0.544
0:23:52.421172 INFO: Train AUC: 0.580
0:23:52.421231 INFO: AUC difference: 6.18%
0:23:52.421258 WARNING: AUC difference > 5%. This may indicate overfitting.
0:23:52.556753 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
0:23:52.557888 PROGRESS: ============================= Precursor FDR =============================
0:23:52.558024 PROGRESS: Total precursors accumulated: 681
0:23:52.558102 PROGRESS: Target precursors: 621 (91.19%)
0:23:52.558171 PROGRESS: Decoy precursors: 60 (8.81%)
0:23:52.558237 PROGRESS: 
0:23:52.558298 PROGRESS: Precursor Summary:
0:23:52.560091 PROGRESS: Channel   0:	 0.05 FDR:   490; 0.01 FDR:   388; 0.001 FDR:   311
0:23:52.560216 PROGRESS: 
0:23:52.560290 PROGRESS: Protein Summary:
0:23:52.562417 PROGRESS: Channel   0:	 0.05 FDR:   459; 0.01 FDR:   363; 0.001 FDR:   290
0:23:52.562534 PROGRESS: =========================================================================
0:23:52.563642 PROGRESS: === Epoch 2, step 6, extracting elution groups 63000 to 127000 ===
0:23:52.739415 PROGRESS: Extracting batch of 126433 precursors
0:23:52.777601 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:23:52.777736 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:23:52.777789 INFO: FWHM in RT is 14.90 seconds, sigma is 0.54
0:23:52.777819 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:23:52.778084 INFO: Starting candidate selection
0:23:58.771468 INFO: Starting candidate scoring
0:24:01.274081 INFO: Finished candidate processing
0:24:01.274272 INFO: Collecting candidate features
0:24:03.792473 WARNING: intensity_correlation has 291 NaNs ( 0.25 % out of 118743)
0:24:03.805275 INFO: Collecting fragment features
0:24:04.531512 INFO: Finished candidate scoring
0:24:04.947573 PROGRESS: === Epoch 2, step 6, extracted 118743 precursors and 542944 fragments ===
0:24:04.947877 INFO: performing precursor FDR with 47 features
0:24:04.947924 INFO: Decoy channel: -1
0:24:04.947951 INFO: Competetive: True
0:24:05.219612 WARNING: dropped 315 target PSMs due to missing features
0:24:05.219727 WARNING: dropped 265 decoy PSMs due to missing features
0:24:13.724377 INFO: Test AUC: 0.543
0:24:13.724502 INFO: Train AUC: 0.574
0:24:13.724558 INFO: AUC difference: 5.45%
0:24:13.724586 WARNING: AUC difference > 5%. This may indicate overfitting.
0:24:13.878006 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
0:24:13.879274 PROGRESS: ============================= Precursor FDR =============================
0:24:13.879429 PROGRESS: Total precursors accumulated: 1,214
0:24:13.879510 PROGRESS: Target precursors: 1,109 (91.35%)
0:24:13.879579 PROGRESS: Decoy precursors: 105 (8.65%)
0:24:13.879644 PROGRESS: 
0:24:13.879707 PROGRESS: Precursor Summary:
0:24:13.881703 PROGRESS: Channel   0:	 0.05 FDR:   952; 0.01 FDR:   709; 0.001 FDR:   580
0:24:13.881847 PROGRESS: 
0:24:13.881925 PROGRESS: Protein Summary:
0:24:13.884370 PROGRESS: Channel   0:	 0.05 FDR:   850; 0.01 FDR:   638; 0.001 FDR:   530
0:24:13.884495 PROGRESS: =========================================================================
0:24:13.886614 INFO: calibration group: precursor, fitting rt estimator 
0:24:14.054410 INFO: calibration group: fragment, fitting mz estimator 
0:24:14.652600 INFO: === checking if epoch conditions were reached ===
0:24:14.652757 INFO: ✅ ms2_error      : 7.0000 <= 7
0:24:14.652844 INFO: ❌ rt_error       : 196.5372 > 100
0:24:14.652918 INFO: ✅ current_epoch  : 2 >= 3
0:24:14.652983 INFO: ==============================================
0:24:14.900227 INFO: calibration group: precursor, predicting mz
0:24:14.900481 WARNING: mz prediction was skipped as it has not been fitted yet
0:24:14.900534 INFO: calibration group: precursor, predicting rt
0:24:21.738859 INFO: calibration group: fragment, predicting mz
0:24:39.713570 PROGRESS: === Epoch 3, step 0, extracting elution groups 0 to 1000 ===
0:24:39.795302 PROGRESS: Extracting batch of 1973 precursors
0:24:39.796953 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:24:39.797048 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:24:39.797089 INFO: FWHM in RT is 14.53 seconds, sigma is 0.53
0:24:39.797147 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:24:39.797390 INFO: Starting candidate selection
0:24:43.600194 INFO: Starting candidate scoring
0:24:44.882364 INFO: Finished candidate processing
0:24:44.882470 INFO: Collecting candidate features
0:24:47.023923 WARNING: intensity_correlation has 4 NaNs ( 0.22 % out of 1840)
0:24:47.029767 INFO: Collecting fragment features
0:24:47.643018 INFO: Finished candidate scoring
0:24:47.936897 PROGRESS: === Epoch 3, step 0, extracted 1840 precursors and 8419 fragments ===
0:24:47.937204 INFO: performing precursor FDR with 47 features
0:24:47.937274 INFO: Decoy channel: -1
0:24:47.937321 INFO: Competetive: True
0:24:47.941933 WARNING: dropped 3 target PSMs due to missing features
0:24:47.942017 WARNING: dropped 1 decoy PSMs due to missing features
0:24:47.969416 INFO: Test AUC: 0.522
0:24:47.969508 INFO: Train AUC: 0.524
0:24:47.969553 INFO: AUC difference: 0.26%
0:24:48.087639 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
0:24:48.088421 PROGRESS: ============================= Precursor FDR =============================
0:24:48.088547 PROGRESS: Total precursors accumulated: 7
0:24:48.088624 PROGRESS: Target precursors: 7 (100.00%)
0:24:48.088692 PROGRESS: Decoy precursors: 0 (0.00%)
0:24:48.088755 PROGRESS: 
0:24:48.088816 PROGRESS: Precursor Summary:
0:24:48.090321 PROGRESS: Channel   0:	 0.05 FDR:     7; 0.01 FDR:     7; 0.001 FDR:     7
0:24:48.090449 PROGRESS: 
0:24:48.090525 PROGRESS: Protein Summary:
0:24:48.092198 PROGRESS: Channel   0:	 0.05 FDR:     7; 0.01 FDR:     7; 0.001 FDR:     7
0:24:48.092308 PROGRESS: =========================================================================
0:24:48.093189 PROGRESS: === Epoch 3, step 1, extracting elution groups 1000 to 3000 ===
0:24:48.170470 PROGRESS: Extracting batch of 3963 precursors
0:24:48.172566 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:24:48.172626 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:24:48.172664 INFO: FWHM in RT is 14.53 seconds, sigma is 0.53
0:24:48.172709 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:24:48.172917 INFO: Starting candidate selection
0:24:51.641058 INFO: Starting candidate scoring
0:24:52.947926 INFO: Finished candidate processing
0:24:52.948017 INFO: Collecting candidate features
0:24:55.123106 WARNING: intensity_correlation has 6 NaNs ( 0.16 % out of 3707)
0:24:55.129116 INFO: Collecting fragment features
0:24:55.732218 INFO: Finished candidate scoring
0:24:56.008018 PROGRESS: === Epoch 3, step 1, extracted 3707 precursors and 16905 fragments ===
0:24:56.008298 INFO: performing precursor FDR with 47 features
0:24:56.008346 INFO: Decoy channel: -1
0:24:56.008372 INFO: Competetive: True
0:24:56.016742 WARNING: dropped 6 target PSMs due to missing features
0:24:56.016833 WARNING: dropped 4 decoy PSMs due to missing features
0:24:56.054989 INFO: Test AUC: 0.551
0:24:56.055106 INFO: Train AUC: 0.529
0:24:56.055151 INFO: AUC difference: 4.20%
0:24:56.176080 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
0:24:56.176875 PROGRESS: ============================= Precursor FDR =============================
0:24:56.176998 PROGRESS: Total precursors accumulated: 37
0:24:56.177075 PROGRESS: Target precursors: 34 (91.89%)
0:24:56.177141 PROGRESS: Decoy precursors: 3 (8.11%)
0:24:56.177203 PROGRESS: 
0:24:56.177264 PROGRESS: Precursor Summary:
0:24:56.178699 PROGRESS: Channel   0:	 0.05 FDR:    29; 0.01 FDR:    23; 0.001 FDR:    23
0:24:56.178814 PROGRESS: 
0:24:56.178901 PROGRESS: Protein Summary:
0:24:56.180512 PROGRESS: Channel   0:	 0.05 FDR:    29; 0.01 FDR:    23; 0.001 FDR:    23
0:24:56.180622 PROGRESS: =========================================================================
0:24:56.181478 PROGRESS: === Epoch 3, step 2, extracting elution groups 3000 to 7000 ===
0:24:56.263369 PROGRESS: Extracting batch of 7915 precursors
0:24:56.266574 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:24:56.266639 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:24:56.266681 INFO: FWHM in RT is 14.53 seconds, sigma is 0.53
0:24:56.266727 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:24:56.266961 INFO: Starting candidate selection
0:24:59.865130 INFO: Starting candidate scoring
0:25:01.240741 INFO: Finished candidate processing
0:25:01.240906 INFO: Collecting candidate features
0:25:03.403310 WARNING: intensity_correlation has 10 NaNs ( 0.14 % out of 7387)
0:25:03.408887 INFO: Collecting fragment features
0:25:04.019372 INFO: Finished candidate scoring
0:25:04.300237 PROGRESS: === Epoch 3, step 2, extracted 7387 precursors and 33629 fragments ===
0:25:04.300528 INFO: performing precursor FDR with 47 features
0:25:04.300575 INFO: Decoy channel: -1
0:25:04.300606 INFO: Competetive: True
0:25:04.315424 WARNING: dropped 12 target PSMs due to missing features
0:25:04.315539 WARNING: dropped 8 decoy PSMs due to missing features
0:25:04.557102 INFO: Test AUC: 0.535
0:25:04.557237 INFO: Train AUC: 0.558
0:25:04.557324 INFO: AUC difference: 4.17%
0:25:04.682077 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
0:25:04.682901 PROGRESS: ============================= Precursor FDR =============================
0:25:04.683027 PROGRESS: Total precursors accumulated: 56
0:25:04.683107 PROGRESS: Target precursors: 51 (91.07%)
0:25:04.683177 PROGRESS: Decoy precursors: 5 (8.93%)
0:25:04.683241 PROGRESS: 
0:25:04.683303 PROGRESS: Precursor Summary:
0:25:04.684763 PROGRESS: Channel   0:	 0.05 FDR:    37; 0.01 FDR:    34; 0.001 FDR:    34
0:25:04.684896 PROGRESS: 
0:25:04.684971 PROGRESS: Protein Summary:
0:25:04.686642 PROGRESS: Channel   0:	 0.05 FDR:    37; 0.01 FDR:    34; 0.001 FDR:    34
0:25:04.686757 PROGRESS: =========================================================================
0:25:04.687624 PROGRESS: === Epoch 3, step 3, extracting elution groups 7000 to 15000 ===
0:25:04.779988 PROGRESS: Extracting batch of 15795 precursors
0:25:04.785345 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:25:04.785426 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:25:04.785462 INFO: FWHM in RT is 14.53 seconds, sigma is 0.53
0:25:04.785489 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:25:04.785721 INFO: Starting candidate selection
0:25:08.498259 INFO: Starting candidate scoring
0:25:09.904326 INFO: Finished candidate processing
0:25:09.904415 INFO: Collecting candidate features
0:25:12.117670 WARNING: intensity_correlation has 30 NaNs ( 0.20 % out of 14672)
0:25:12.123660 INFO: Collecting fragment features
0:25:12.753358 INFO: Finished candidate scoring
0:25:13.042698 PROGRESS: === Epoch 3, step 3, extracted 14672 precursors and 66705 fragments ===
0:25:13.042975 INFO: performing precursor FDR with 47 features
0:25:13.043022 INFO: Decoy channel: -1
0:25:13.043049 INFO: Competetive: True
0:25:13.072682 WARNING: dropped 24 target PSMs due to missing features
0:25:13.072790 WARNING: dropped 26 decoy PSMs due to missing features
0:25:13.762636 INFO: Test AUC: 0.522
0:25:13.762804 INFO: Train AUC: 0.580
0:25:13.762868 INFO: AUC difference: 9.99%
0:25:13.762903 WARNING: AUC difference > 5%. This may indicate overfitting.
0:25:13.889554 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
0:25:13.890477 PROGRESS: ============================= Precursor FDR =============================
0:25:13.890600 PROGRESS: Total precursors accumulated: 210
0:25:13.890687 PROGRESS: Target precursors: 192 (91.43%)
0:25:13.890756 PROGRESS: Decoy precursors: 18 (8.57%)
0:25:13.890824 PROGRESS: 
0:25:13.890886 PROGRESS: Precursor Summary:
0:25:13.892387 PROGRESS: Channel   0:	 0.05 FDR:   121; 0.01 FDR:   111; 0.001 FDR:    94
0:25:13.892514 PROGRESS: 
0:25:13.892588 PROGRESS: Protein Summary:
0:25:13.894315 PROGRESS: Channel   0:	 0.05 FDR:   120; 0.01 FDR:   110; 0.001 FDR:    93
0:25:13.894425 PROGRESS: =========================================================================
0:25:13.895331 PROGRESS: === Epoch 3, step 4, extracting elution groups 15000 to 31000 ===
0:25:14.003241 PROGRESS: Extracting batch of 31639 precursors
0:25:14.013384 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:25:14.013480 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:25:14.013515 INFO: FWHM in RT is 14.53 seconds, sigma is 0.53
0:25:14.013558 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:25:14.013830 INFO: Starting candidate selection
0:25:18.048484 INFO: Starting candidate scoring
0:25:19.617836 INFO: Finished candidate processing
0:25:19.618027 INFO: Collecting candidate features
0:25:21.861499 WARNING: intensity_correlation has 51 NaNs ( 0.17 % out of 29518)
0:25:21.868410 INFO: Collecting fragment features
0:25:22.509069 INFO: Finished candidate scoring
0:25:22.815535 PROGRESS: === Epoch 3, step 4, extracted 29518 precursors and 134945 fragments ===
0:25:22.815835 INFO: performing precursor FDR with 47 features
0:25:22.815885 INFO: Decoy channel: -1
0:25:22.815917 INFO: Competetive: True
0:25:22.872977 WARNING: dropped 50 target PSMs due to missing features
0:25:22.873085 WARNING: dropped 51 decoy PSMs due to missing features
0:25:24.616248 INFO: Test AUC: 0.552
0:25:24.616395 INFO: Train AUC: 0.586
0:25:24.616442 INFO: AUC difference: 5.83%
0:25:24.616477 WARNING: AUC difference > 5%. This may indicate overfitting.
0:25:24.742851 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
0:25:24.743831 PROGRESS: ============================= Precursor FDR =============================
0:25:24.743959 PROGRESS: Total precursors accumulated: 377
0:25:24.744036 PROGRESS: Target precursors: 343 (90.98%)
0:25:24.744103 PROGRESS: Decoy precursors: 34 (9.02%)
0:25:24.744165 PROGRESS: 
0:25:24.744226 PROGRESS: Precursor Summary:
0:25:24.745847 PROGRESS: Channel   0:	 0.05 FDR:   247; 0.01 FDR:   179; 0.001 FDR:   174
0:25:24.745961 PROGRESS: 
0:25:24.746045 PROGRESS: Protein Summary:
0:25:24.747900 PROGRESS: Channel   0:	 0.05 FDR:   239; 0.01 FDR:   171; 0.001 FDR:   166
0:25:24.748028 PROGRESS: =========================================================================
0:25:24.748988 PROGRESS: === Epoch 3, step 5, extracting elution groups 31000 to 63000 ===
0:25:24.888252 PROGRESS: Extracting batch of 63223 precursors
0:25:24.908124 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:25:24.908228 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:25:24.908265 INFO: FWHM in RT is 14.53 seconds, sigma is 0.53
0:25:24.908307 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:25:24.908558 INFO: Starting candidate selection
0:25:29.584146 INFO: Starting candidate scoring
0:25:31.450329 INFO: Finished candidate processing
0:25:31.450437 INFO: Collecting candidate features
0:25:33.811456 WARNING: intensity_correlation has 84 NaNs ( 0.14 % out of 59017)
0:25:33.811842 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 59017)
0:25:33.820550 INFO: Collecting fragment features
0:25:34.500537 INFO: Finished candidate scoring
0:25:34.848970 PROGRESS: === Epoch 3, step 5, extracted 59017 precursors and 268121 fragments ===
0:25:34.856176 INFO: performing precursor FDR with 47 features
0:25:34.856252 INFO: Decoy channel: -1
0:25:34.856280 INFO: Competetive: True
0:25:34.986600 WARNING: dropped 97 target PSMs due to missing features
0:25:34.986720 WARNING: dropped 88 decoy PSMs due to missing features
0:25:38.948559 INFO: Test AUC: 0.549
0:25:38.948684 INFO: Train AUC: 0.582
0:25:38.948739 INFO: AUC difference: 5.76%
0:25:38.948768 WARNING: AUC difference > 5%. This may indicate overfitting.
0:25:39.084152 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
0:25:39.085277 PROGRESS: ============================= Precursor FDR =============================
0:25:39.085408 PROGRESS: Total precursors accumulated: 732
0:25:39.085486 PROGRESS: Target precursors: 667 (91.12%)
0:25:39.085554 PROGRESS: Decoy precursors: 65 (8.88%)
0:25:39.085617 PROGRESS: 
0:25:39.085678 PROGRESS: Precursor Summary:
0:25:39.087466 PROGRESS: Channel   0:	 0.05 FDR:   555; 0.01 FDR:   436; 0.001 FDR:   324
0:25:39.087600 PROGRESS: 
0:25:39.087673 PROGRESS: Protein Summary:
0:25:39.089782 PROGRESS: Channel   0:	 0.05 FDR:   520; 0.01 FDR:   407; 0.001 FDR:   303
0:25:39.089911 PROGRESS: =========================================================================
0:25:39.091009 PROGRESS: === Epoch 3, step 6, extracting elution groups 63000 to 127000 ===
0:25:39.267447 PROGRESS: Extracting batch of 126464 precursors
0:25:39.305063 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:25:39.305177 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:25:39.305220 INFO: FWHM in RT is 14.53 seconds, sigma is 0.53
0:25:39.305259 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:25:39.305588 INFO: Starting candidate selection
0:25:45.268989 INFO: Starting candidate scoring
0:25:47.752868 INFO: Finished candidate processing
0:25:47.753028 INFO: Collecting candidate features
0:25:50.292697 WARNING: intensity_correlation has 216 NaNs ( 0.18 % out of 118001)
0:25:50.306985 INFO: Collecting fragment features
0:25:51.061728 INFO: Finished candidate scoring
0:25:51.485353 PROGRESS: === Epoch 3, step 6, extracted 118001 precursors and 538794 fragments ===
0:25:51.485676 INFO: performing precursor FDR with 47 features
0:25:51.485722 INFO: Decoy channel: -1
0:25:51.485747 INFO: Competetive: True
0:25:51.756057 WARNING: dropped 211 target PSMs due to missing features
0:25:51.756176 WARNING: dropped 190 decoy PSMs due to missing features
0:26:00.073094 INFO: Test AUC: 0.547
0:26:00.073249 INFO: Train AUC: 0.576
0:26:00.073292 INFO: AUC difference: 5.16%
0:26:00.073320 WARNING: AUC difference > 5%. This may indicate overfitting.
0:26:00.226351 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
0:26:00.227674 PROGRESS: ============================= Precursor FDR =============================
0:26:00.227805 PROGRESS: Total precursors accumulated: 1,456
0:26:00.227884 PROGRESS: Target precursors: 1,327 (91.14%)
0:26:00.227953 PROGRESS: Decoy precursors: 129 (8.86%)
0:26:00.228017 PROGRESS: 
0:26:00.228083 PROGRESS: Precursor Summary:
0:26:00.230109 PROGRESS: Channel   0:	 0.05 FDR: 1,005; 0.01 FDR:   824; 0.001 FDR:   472
0:26:00.230228 PROGRESS: 
0:26:00.230303 PROGRESS: Protein Summary:
0:26:00.232748 PROGRESS: Channel   0:	 0.05 FDR:   891; 0.01 FDR:   724; 0.001 FDR:   417
0:26:00.232875 PROGRESS: =========================================================================
0:26:00.235096 INFO: calibration group: precursor, fitting rt estimator 
0:26:00.377382 INFO: calibration group: fragment, fitting mz estimator 
0:26:00.964015 INFO: === checking if epoch conditions were reached ===
0:26:00.964168 INFO: ✅ ms2_error      : 7.0000 <= 7
0:26:00.964254 INFO: ❌ rt_error       : 198.2256 > 100
0:26:00.964326 INFO: ✅ current_epoch  : 3 >= 3
0:26:00.964391 INFO: ==============================================
0:26:01.210269 INFO: calibration group: precursor, predicting mz
0:26:01.210497 WARNING: mz prediction was skipped as it has not been fitted yet
0:26:01.210537 INFO: calibration group: precursor, predicting rt
0:26:07.938718 INFO: calibration group: fragment, predicting mz
0:26:25.817041 PROGRESS: === Epoch 4, step 0, extracting elution groups 0 to 1000 ===
0:26:25.899587 PROGRESS: Extracting batch of 1961 precursors
0:26:25.901245 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:26:25.901330 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:26:25.901370 INFO: FWHM in RT is 14.35 seconds, sigma is 0.52
0:26:25.901416 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:26:25.901666 INFO: Starting candidate selection
0:26:29.764398 INFO: Starting candidate scoring
0:26:31.044588 INFO: Finished candidate processing
0:26:31.044712 INFO: Collecting candidate features
0:26:33.209276 WARNING: intensity_correlation has 1 NaNs ( 0.05 % out of 1824)
0:26:33.215278 INFO: Collecting fragment features
0:26:33.845588 INFO: Finished candidate scoring
0:26:34.135549 PROGRESS: === Epoch 4, step 0, extracted 1824 precursors and 8417 fragments ===
0:26:34.135836 INFO: performing precursor FDR with 47 features
0:26:34.135881 INFO: Decoy channel: -1
0:26:34.135908 INFO: Competetive: True
0:26:34.140390 WARNING: dropped 1 target PSMs due to missing features
0:26:34.167987 INFO: Test AUC: 0.585
0:26:34.168080 INFO: Train AUC: 0.503
0:26:34.168125 INFO: AUC difference: 16.38%
0:26:34.168160 WARNING: AUC difference > 5%. This may indicate overfitting.
0:26:34.934224 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
0:26:34.935114 PROGRESS: ============================= Precursor FDR =============================
0:26:34.935247 PROGRESS: Total precursors accumulated: 8
0:26:34.935326 PROGRESS: Target precursors: 8 (100.00%)
0:26:34.935395 PROGRESS: Decoy precursors: 0 (0.00%)
0:26:34.935457 PROGRESS: 
0:26:34.935518 PROGRESS: Precursor Summary:
0:26:34.937023 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
0:26:34.937155 PROGRESS: 
0:26:34.937230 PROGRESS: Protein Summary:
0:26:34.938952 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
0:26:34.939062 PROGRESS: =========================================================================
0:26:34.939965 PROGRESS: === Epoch 4, step 1, extracting elution groups 1000 to 3000 ===
0:26:35.017349 PROGRESS: Extracting batch of 3959 precursors
0:26:35.019471 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:26:35.019530 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:26:35.019568 INFO: FWHM in RT is 14.35 seconds, sigma is 0.52
0:26:35.019613 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:26:35.019827 INFO: Starting candidate selection
0:26:38.564459 INFO: Starting candidate scoring
0:26:39.890790 INFO: Finished candidate processing
0:26:39.890882 INFO: Collecting candidate features
0:26:42.049052 WARNING: intensity_correlation has 4 NaNs ( 0.11 % out of 3684)
0:26:42.055036 INFO: Collecting fragment features
0:26:42.663193 INFO: Finished candidate scoring
0:26:42.939923 PROGRESS: === Epoch 4, step 1, extracted 3684 precursors and 16766 fragments ===
0:26:42.940215 INFO: performing precursor FDR with 47 features
0:26:42.940263 INFO: Decoy channel: -1
0:26:42.940289 INFO: Competetive: True
0:26:42.948654 WARNING: dropped 3 target PSMs due to missing features
0:26:42.948760 WARNING: dropped 2 decoy PSMs due to missing features
0:26:42.985587 INFO: Test AUC: 0.553
0:26:42.985706 INFO: Train AUC: 0.537
0:26:42.985752 INFO: AUC difference: 2.93%
0:26:43.106079 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
0:26:43.106851 PROGRESS: ============================= Precursor FDR =============================
0:26:43.106973 PROGRESS: Total precursors accumulated: 28
0:26:43.107051 PROGRESS: Target precursors: 26 (92.86%)
0:26:43.107120 PROGRESS: Decoy precursors: 2 (7.14%)
0:26:43.107183 PROGRESS: 
0:26:43.107244 PROGRESS: Precursor Summary:
0:26:43.108659 PROGRESS: Channel   0:	 0.05 FDR:    26; 0.01 FDR:    23; 0.001 FDR:    23
0:26:43.108788 PROGRESS: 
0:26:43.108862 PROGRESS: Protein Summary:
0:26:43.110477 PROGRESS: Channel   0:	 0.05 FDR:    26; 0.01 FDR:    23; 0.001 FDR:    23
0:26:43.110589 PROGRESS: =========================================================================
0:26:43.111435 PROGRESS: === Epoch 4, step 2, extracting elution groups 3000 to 7000 ===
0:26:43.193355 PROGRESS: Extracting batch of 7889 precursors
0:26:43.196633 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:26:43.196694 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:26:43.196744 INFO: FWHM in RT is 14.35 seconds, sigma is 0.52
0:26:43.196790 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:26:43.197008 INFO: Starting candidate selection
0:26:46.777005 INFO: Starting candidate scoring
0:26:48.131220 INFO: Finished candidate processing
0:26:48.131311 INFO: Collecting candidate features
0:26:50.324200 WARNING: intensity_correlation has 7 NaNs ( 0.10 % out of 7334)
0:26:50.329748 INFO: Collecting fragment features
0:26:50.947266 INFO: Finished candidate scoring
0:26:51.230843 PROGRESS: === Epoch 4, step 2, extracted 7334 precursors and 33478 fragments ===
0:26:51.231144 INFO: performing precursor FDR with 47 features
0:26:51.231190 INFO: Decoy channel: -1
0:26:51.231217 INFO: Competetive: True
0:26:51.246137 WARNING: dropped 6 target PSMs due to missing features
0:26:51.246253 WARNING: dropped 6 decoy PSMs due to missing features
0:26:51.462226 INFO: Test AUC: 0.543
0:26:51.462355 INFO: Train AUC: 0.562
0:26:51.462402 INFO: AUC difference: 3.43%
0:26:51.587361 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
0:26:51.588212 PROGRESS: ============================= Precursor FDR =============================
0:26:51.588336 PROGRESS: Total precursors accumulated: 68
0:26:51.588415 PROGRESS: Target precursors: 63 (92.65%)
0:26:51.588484 PROGRESS: Decoy precursors: 5 (7.35%)
0:26:51.588560 PROGRESS: 
0:26:51.588623 PROGRESS: Precursor Summary:
0:26:51.590102 PROGRESS: Channel   0:	 0.05 FDR:    63; 0.01 FDR:    43; 0.001 FDR:    43
0:26:51.590216 PROGRESS: 
0:26:51.590290 PROGRESS: Protein Summary:
0:26:51.591948 PROGRESS: Channel   0:	 0.05 FDR:    63; 0.01 FDR:    43; 0.001 FDR:    43
0:26:51.592076 PROGRESS: =========================================================================
0:26:51.592947 PROGRESS: === Epoch 4, step 3, extracting elution groups 7000 to 15000 ===
0:26:51.685340 PROGRESS: Extracting batch of 15799 precursors
0:26:51.690861 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:26:51.690930 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:26:51.690964 INFO: FWHM in RT is 14.35 seconds, sigma is 0.52
0:26:51.691006 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:26:51.691223 INFO: Starting candidate selection
0:26:55.422908 INFO: Starting candidate scoring
0:26:56.846083 INFO: Finished candidate processing
0:26:56.846215 INFO: Collecting candidate features
0:26:59.074851 WARNING: intensity_correlation has 24 NaNs ( 0.17 % out of 14502)
0:26:59.080915 INFO: Collecting fragment features
0:26:59.712072 INFO: Finished candidate scoring
0:27:00.004531 PROGRESS: === Epoch 4, step 3, extracted 14502 precursors and 66029 fragments ===
0:27:00.004836 INFO: performing precursor FDR with 47 features
0:27:00.004882 INFO: Decoy channel: -1
0:27:00.004909 INFO: Competetive: True
0:27:00.032936 WARNING: dropped 18 target PSMs due to missing features
0:27:00.033052 WARNING: dropped 18 decoy PSMs due to missing features
0:27:00.693341 INFO: Test AUC: 0.528
0:27:00.693485 INFO: Train AUC: 0.577
0:27:00.693532 INFO: AUC difference: 8.49%
0:27:00.693567 WARNING: AUC difference > 5%. This may indicate overfitting.
0:27:00.823276 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
0:27:00.824174 PROGRESS: ============================= Precursor FDR =============================
0:27:00.824298 PROGRESS: Total precursors accumulated: 182
0:27:00.824377 PROGRESS: Target precursors: 167 (91.76%)
0:27:00.824446 PROGRESS: Decoy precursors: 15 (8.24%)
0:27:00.824510 PROGRESS: 
0:27:00.824572 PROGRESS: Precursor Summary:
0:27:00.826104 PROGRESS: Channel   0:	 0.05 FDR:   138; 0.01 FDR:   104; 0.001 FDR:    95
0:27:00.826221 PROGRESS: 
0:27:00.826295 PROGRESS: Protein Summary:
0:27:00.828042 PROGRESS: Channel   0:	 0.05 FDR:   137; 0.01 FDR:   104; 0.001 FDR:    95
0:27:00.828181 PROGRESS: =========================================================================
0:27:00.829094 PROGRESS: === Epoch 4, step 4, extracting elution groups 15000 to 31000 ===
0:27:00.938061 PROGRESS: Extracting batch of 31633 precursors
0:27:00.948527 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:27:00.948652 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:27:00.948692 INFO: FWHM in RT is 14.35 seconds, sigma is 0.52
0:27:00.948719 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:27:00.948955 INFO: Starting candidate selection
0:27:05.008226 INFO: Starting candidate scoring
0:27:06.577856 INFO: Finished candidate processing
0:27:06.578050 INFO: Collecting candidate features
0:27:08.851897 WARNING: intensity_correlation has 47 NaNs ( 0.16 % out of 29287)
0:27:08.858956 INFO: Collecting fragment features
0:27:09.508000 INFO: Finished candidate scoring
0:27:09.818309 PROGRESS: === Epoch 4, step 4, extracted 29287 precursors and 133519 fragments ===
0:27:09.818618 INFO: performing precursor FDR with 47 features
0:27:09.818666 INFO: Decoy channel: -1
0:27:09.818692 INFO: Competetive: True
0:27:09.876215 WARNING: dropped 46 target PSMs due to missing features
0:27:09.876328 WARNING: dropped 37 decoy PSMs due to missing features
0:27:11.719873 INFO: Test AUC: 0.533
0:27:11.720017 INFO: Train AUC: 0.589
0:27:11.720065 INFO: AUC difference: 9.53%
0:27:11.720100 WARNING: AUC difference > 5%. This may indicate overfitting.
0:27:11.848554 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
0:27:11.849567 PROGRESS: ============================= Precursor FDR =============================
0:27:11.849690 PROGRESS: Total precursors accumulated: 423
0:27:11.849775 PROGRESS: Target precursors: 386 (91.25%)
0:27:11.849848 PROGRESS: Decoy precursors: 37 (8.75%)
0:27:11.849912 PROGRESS: 
0:27:11.849974 PROGRESS: Precursor Summary:
0:27:11.851606 PROGRESS: Channel   0:	 0.05 FDR:   309; 0.01 FDR:   213; 0.001 FDR:   132
0:27:11.851735 PROGRESS: 
0:27:11.851809 PROGRESS: Protein Summary:
0:27:11.853714 PROGRESS: Channel   0:	 0.05 FDR:   303; 0.01 FDR:   210; 0.001 FDR:   131
0:27:11.853835 PROGRESS: =========================================================================
0:27:11.854828 PROGRESS: === Epoch 4, step 5, extracting elution groups 31000 to 63000 ===
0:27:11.992239 PROGRESS: Extracting batch of 63245 precursors
0:27:12.012133 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:27:12.012241 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:27:12.012280 INFO: FWHM in RT is 14.35 seconds, sigma is 0.52
0:27:12.012323 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:27:12.012572 INFO: Starting candidate selection
0:27:16.733858 INFO: Starting candidate scoring
0:27:18.599034 INFO: Finished candidate processing
0:27:18.599133 INFO: Collecting candidate features
0:27:20.957845 WARNING: intensity_correlation has 91 NaNs ( 0.16 % out of 58433)
0:27:20.966673 INFO: Collecting fragment features
0:27:21.646755 INFO: Finished candidate scoring
0:27:21.994463 PROGRESS: === Epoch 4, step 5, extracted 58433 precursors and 267709 fragments ===
0:27:21.994749 INFO: performing precursor FDR with 47 features
0:27:21.994798 INFO: Decoy channel: -1
0:27:21.994826 INFO: Competetive: True
0:27:22.122450 WARNING: dropped 92 target PSMs due to missing features
0:27:22.122566 WARNING: dropped 82 decoy PSMs due to missing features
0:27:25.857002 INFO: Test AUC: 0.549
0:27:25.857143 INFO: Train AUC: 0.585
0:27:25.857184 INFO: AUC difference: 6.16%
0:27:25.857213 WARNING: AUC difference > 5%. This may indicate overfitting.
0:27:26.014136 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
0:27:26.015385 PROGRESS: ============================= Precursor FDR =============================
0:27:26.015513 PROGRESS: Total precursors accumulated: 1,041
0:27:26.015592 PROGRESS: Target precursors: 948 (91.07%)
0:27:26.015661 PROGRESS: Decoy precursors: 93 (8.93%)
0:27:26.015724 PROGRESS: 
0:27:26.015784 PROGRESS: Precursor Summary:
0:27:26.017596 PROGRESS: Channel   0:	 0.05 FDR:   582; 0.01 FDR:   461; 0.001 FDR:   357
0:27:26.017731 PROGRESS: 
0:27:26.017814 PROGRESS: Protein Summary:
0:27:26.019984 PROGRESS: Channel   0:	 0.05 FDR:   557; 0.01 FDR:   443; 0.001 FDR:   344
0:27:26.020109 PROGRESS: =========================================================================
0:27:26.021238 PROGRESS: === Epoch 4, step 6, extracting elution groups 63000 to 127000 ===
0:27:26.196974 PROGRESS: Extracting batch of 126449 precursors
0:27:26.234684 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:27:26.234815 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:27:26.234854 INFO: FWHM in RT is 14.35 seconds, sigma is 0.52
0:27:26.234882 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:27:26.235138 INFO: Starting candidate selection
0:27:32.186946 INFO: Starting candidate scoring
0:27:34.658690 INFO: Finished candidate processing
0:27:34.658869 INFO: Collecting candidate features
0:27:37.168710 WARNING: intensity_correlation has 152 NaNs ( 0.13 % out of 117147)
0:27:37.181239 INFO: Collecting fragment features
0:27:37.930419 INFO: Finished candidate scoring
0:27:38.348868 PROGRESS: === Epoch 4, step 6, extracted 117147 precursors and 533270 fragments ===
0:27:38.349177 INFO: performing precursor FDR with 47 features
0:27:38.349221 INFO: Decoy channel: -1
0:27:38.349246 INFO: Competetive: True
0:27:38.619312 WARNING: dropped 170 target PSMs due to missing features
0:27:38.619429 WARNING: dropped 156 decoy PSMs due to missing features
0:27:47.027833 INFO: Test AUC: 0.546
0:27:47.027958 INFO: Train AUC: 0.576
0:27:47.028013 INFO: AUC difference: 5.20%
0:27:47.028042 WARNING: AUC difference > 5%. This may indicate overfitting.
0:27:47.180881 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
0:27:47.182277 PROGRESS: ============================= Precursor FDR =============================
0:27:47.182404 PROGRESS: Total precursors accumulated: 1,587
0:27:47.182483 PROGRESS: Target precursors: 1,445 (91.05%)
0:27:47.182554 PROGRESS: Decoy precursors: 142 (8.95%)
0:27:47.182618 PROGRESS: 
0:27:47.182690 PROGRESS: Precursor Summary:
0:27:47.184758 PROGRESS: Channel   0:	 0.05 FDR: 1,041; 0.01 FDR:   809; 0.001 FDR:   689
0:27:47.184890 PROGRESS: 
0:27:47.184963 PROGRESS: Protein Summary:
0:27:47.187553 PROGRESS: Channel   0:	 0.05 FDR:   944; 0.01 FDR:   729; 0.001 FDR:   621
0:27:47.187682 PROGRESS: =========================================================================
0:27:47.188999 PROGRESS: === Epoch 4, step 7, extracting elution groups 127000 to 255000 ===
0:27:47.412789 PROGRESS: Extracting batch of 252982 precursors
0:27:47.484433 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:27:47.484540 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:27:47.484578 INFO: FWHM in RT is 14.35 seconds, sigma is 0.52
0:27:47.484621 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:27:47.484880 INFO: Starting candidate selection
0:27:55.958705 INFO: Starting candidate scoring
0:27:59.657134 INFO: Finished candidate processing
0:27:59.657297 INFO: Collecting candidate features
0:28:02.634331 WARNING: intensity_correlation has 295 NaNs ( 0.13 % out of 234236)
0:28:02.654351 INFO: Collecting fragment features
0:28:03.524802 INFO: Finished candidate scoring
0:28:04.093097 PROGRESS: === Epoch 4, step 7, extracted 234236 precursors and 1068737 fragments ===
0:28:04.093415 INFO: performing precursor FDR with 47 features
0:28:04.093462 INFO: Decoy channel: -1
0:28:04.093489 INFO: Competetive: True
0:28:04.675506 WARNING: dropped 312 target PSMs due to missing features
0:28:04.675628 WARNING: dropped 309 decoy PSMs due to missing features
0:28:21.715435 INFO: Test AUC: 0.547
0:28:21.715562 INFO: Train AUC: 0.569
0:28:21.715618 INFO: AUC difference: 3.87%
0:28:21.900511 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
0:28:21.902343 PROGRESS: ============================= Precursor FDR =============================
0:28:21.902498 PROGRESS: Total precursors accumulated: 2,901
0:28:21.902577 PROGRESS: Target precursors: 2,644 (91.14%)
0:28:21.902645 PROGRESS: Decoy precursors: 257 (8.86%)
0:28:21.902720 PROGRESS: 
0:28:21.902782 PROGRESS: Precursor Summary:
0:28:21.905459 PROGRESS: Channel   0:	 0.05 FDR: 2,134; 0.01 FDR: 1,688; 0.001 FDR: 1,383
0:28:21.905594 PROGRESS: 
0:28:21.905667 PROGRESS: Protein Summary:
0:28:21.909046 PROGRESS: Channel   0:	 0.05 FDR: 1,743; 0.01 FDR: 1,367; 0.001 FDR: 1,136
0:28:21.909175 PROGRESS: =========================================================================
0:28:21.912108 INFO: calibration group: precursor, fitting rt estimator 
0:28:22.141729 INFO: calibration group: fragment, fitting mz estimator 
0:28:22.726268 INFO: === checking if epoch conditions were reached ===
0:28:22.726419 INFO: ✅ ms2_error      : 7.0000 <= 7
0:28:22.726504 INFO: ❌ rt_error       : 201.0769 > 100
0:28:22.726578 INFO: ✅ current_epoch  : 4 >= 3
0:28:22.726642 INFO: ==============================================
0:28:22.970922 INFO: calibration group: precursor, predicting mz
0:28:22.971172 WARNING: mz prediction was skipped as it has not been fitted yet
0:28:22.971211 INFO: calibration group: precursor, predicting rt
0:28:29.796536 INFO: calibration group: fragment, predicting mz
0:28:47.630812 PROGRESS: === Epoch 5, step 0, extracting elution groups 0 to 1000 ===
0:28:47.719048 PROGRESS: Extracting batch of 1980 precursors
0:28:47.720743 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:28:47.720820 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:28:47.720860 INFO: FWHM in RT is 14.12 seconds, sigma is 0.51
0:28:47.720905 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:28:47.721162 INFO: Starting candidate selection
0:28:51.578414 INFO: Starting candidate scoring
0:28:52.883393 INFO: Finished candidate processing
0:28:52.883482 INFO: Collecting candidate features
0:28:55.047765 WARNING: intensity_correlation has 3 NaNs ( 0.16 % out of 1834)
0:28:55.053627 INFO: Collecting fragment features
0:28:55.685474 INFO: Finished candidate scoring
0:28:55.997820 PROGRESS: === Epoch 5, step 0, extracted 1834 precursors and 8489 fragments ===
0:28:55.998107 INFO: performing precursor FDR with 47 features
0:28:55.998148 INFO: Decoy channel: -1
0:28:55.998175 INFO: Competetive: True
0:28:56.002758 WARNING: dropped 1 target PSMs due to missing features
0:28:56.002830 WARNING: dropped 2 decoy PSMs due to missing features
0:28:56.030437 INFO: Test AUC: 0.517
0:28:56.030534 INFO: Train AUC: 0.556
0:28:56.030579 INFO: AUC difference: 6.97%
0:28:56.030614 WARNING: AUC difference > 5%. This may indicate overfitting.
0:28:56.152138 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
0:28:56.152906 PROGRESS: ============================= Precursor FDR =============================
0:28:56.153029 PROGRESS: Total precursors accumulated: 12
0:28:56.153106 PROGRESS: Target precursors: 11 (91.67%)
0:28:56.153174 PROGRESS: Decoy precursors: 1 (8.33%)
0:28:56.153237 PROGRESS: 
0:28:56.153298 PROGRESS: Precursor Summary:
0:28:56.154737 PROGRESS: Channel   0:	 0.05 FDR:    11; 0.01 FDR:    11; 0.001 FDR:    11
0:28:56.154853 PROGRESS: 
0:28:56.154928 PROGRESS: Protein Summary:
0:28:56.156530 PROGRESS: Channel   0:	 0.05 FDR:    11; 0.01 FDR:    11; 0.001 FDR:    11
0:28:56.156643 PROGRESS: =========================================================================
0:28:56.157500 PROGRESS: === Epoch 5, step 1, extracting elution groups 1000 to 3000 ===
0:28:56.235045 PROGRESS: Extracting batch of 3955 precursors
0:28:56.237110 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:28:56.237168 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:28:56.237206 INFO: FWHM in RT is 14.12 seconds, sigma is 0.51
0:28:56.237251 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:28:56.237458 INFO: Starting candidate selection
0:28:59.797167 INFO: Starting candidate scoring
0:29:01.130553 INFO: Finished candidate processing
0:29:01.130739 INFO: Collecting candidate features
0:29:03.277904 WARNING: intensity_correlation has 5 NaNs ( 0.14 % out of 3646)
0:29:03.283858 INFO: Collecting fragment features
0:29:03.912154 INFO: Finished candidate scoring
0:29:04.188533 PROGRESS: === Epoch 5, step 1, extracted 3646 precursors and 16558 fragments ===
0:29:04.188811 INFO: performing precursor FDR with 47 features
0:29:04.188857 INFO: Decoy channel: -1
0:29:04.188884 INFO: Competetive: True
0:29:04.197219 WARNING: dropped 3 target PSMs due to missing features
0:29:04.197309 WARNING: dropped 5 decoy PSMs due to missing features
0:29:04.234361 INFO: Test AUC: 0.554
0:29:04.234477 INFO: Train AUC: 0.559
0:29:04.234524 INFO: AUC difference: 0.92%
0:29:04.354705 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
0:29:04.355490 PROGRESS: ============================= Precursor FDR =============================
0:29:04.355613 PROGRESS: Total precursors accumulated: 31
0:29:04.355691 PROGRESS: Target precursors: 29 (93.55%)
0:29:04.355759 PROGRESS: Decoy precursors: 2 (6.45%)
0:29:04.355822 PROGRESS: 
0:29:04.355883 PROGRESS: Precursor Summary:
0:29:04.357302 PROGRESS: Channel   0:	 0.05 FDR:    28; 0.01 FDR:    25; 0.001 FDR:    25
0:29:04.357431 PROGRESS: 
0:29:04.357505 PROGRESS: Protein Summary:
0:29:04.359138 PROGRESS: Channel   0:	 0.05 FDR:    28; 0.01 FDR:    25; 0.001 FDR:    25
0:29:04.359264 PROGRESS: =========================================================================
0:29:04.360126 PROGRESS: === Epoch 5, step 2, extracting elution groups 3000 to 7000 ===
0:29:04.441807 PROGRESS: Extracting batch of 7900 precursors
0:29:04.444999 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:29:04.445056 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:29:04.445094 INFO: FWHM in RT is 14.12 seconds, sigma is 0.51
0:29:04.445139 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:29:04.445351 INFO: Starting candidate selection
0:29:08.056516 INFO: Starting candidate scoring
0:29:09.419916 INFO: Finished candidate processing
0:29:09.420007 INFO: Collecting candidate features
0:29:11.593109 WARNING: intensity_correlation has 8 NaNs ( 0.11 % out of 7315)
0:29:11.598680 INFO: Collecting fragment features
0:29:12.231628 INFO: Finished candidate scoring
0:29:12.512238 PROGRESS: === Epoch 5, step 2, extracted 7315 precursors and 33426 fragments ===
0:29:12.512537 INFO: performing precursor FDR with 47 features
0:29:12.512579 INFO: Decoy channel: -1
0:29:12.512606 INFO: Competetive: True
0:29:12.527316 WARNING: dropped 10 target PSMs due to missing features
0:29:12.527416 WARNING: dropped 6 decoy PSMs due to missing features
0:29:12.752202 INFO: Test AUC: 0.538
0:29:12.752337 INFO: Train AUC: 0.581
0:29:12.752384 INFO: AUC difference: 7.50%
0:29:12.752436 WARNING: AUC difference > 5%. This may indicate overfitting.
0:29:13.572023 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
0:29:13.572912 PROGRESS: ============================= Precursor FDR =============================
0:29:13.573036 PROGRESS: Total precursors accumulated: 61
0:29:13.573115 PROGRESS: Target precursors: 56 (91.80%)
0:29:13.573184 PROGRESS: Decoy precursors: 5 (8.20%)
0:29:13.573247 PROGRESS: 
0:29:13.573307 PROGRESS: Precursor Summary:
0:29:13.574779 PROGRESS: Channel   0:	 0.05 FDR:    52; 0.01 FDR:    48; 0.001 FDR:    48
0:29:13.574897 PROGRESS: 
0:29:13.574972 PROGRESS: Protein Summary:
0:29:13.576632 PROGRESS: Channel   0:	 0.05 FDR:    52; 0.01 FDR:    48; 0.001 FDR:    48
0:29:13.576744 PROGRESS: =========================================================================
0:29:13.577624 PROGRESS: === Epoch 5, step 3, extracting elution groups 7000 to 15000 ===
0:29:13.669921 PROGRESS: Extracting batch of 15837 precursors
0:29:13.675523 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:29:13.675599 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:29:13.675635 INFO: FWHM in RT is 14.12 seconds, sigma is 0.51
0:29:13.675675 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:29:13.675901 INFO: Starting candidate selection
0:29:17.464830 INFO: Starting candidate scoring
0:29:18.906446 INFO: Finished candidate processing
0:29:18.907526 INFO: Collecting candidate features
0:29:21.129128 WARNING: intensity_correlation has 10 NaNs ( 0.07 % out of 14620)
0:29:21.135714 INFO: Collecting fragment features
0:29:21.764661 INFO: Finished candidate scoring
0:29:22.056396 PROGRESS: === Epoch 5, step 3, extracted 14620 precursors and 66554 fragments ===
0:29:22.056741 INFO: performing precursor FDR with 47 features
0:29:22.056806 INFO: Decoy channel: -1
0:29:22.056851 INFO: Competetive: True
0:29:22.085113 WARNING: dropped 14 target PSMs due to missing features
0:29:22.085227 WARNING: dropped 12 decoy PSMs due to missing features
0:29:22.826396 INFO: Test AUC: 0.532
0:29:22.826538 INFO: Train AUC: 0.587
0:29:22.826584 INFO: AUC difference: 9.32%
0:29:22.826618 WARNING: AUC difference > 5%. This may indicate overfitting.
0:29:22.953761 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
0:29:22.954690 PROGRESS: ============================= Precursor FDR =============================
0:29:22.954825 PROGRESS: Total precursors accumulated: 167
0:29:22.954904 PROGRESS: Target precursors: 153 (91.62%)
0:29:22.954973 PROGRESS: Decoy precursors: 14 (8.38%)
0:29:22.955035 PROGRESS: 
0:29:22.955096 PROGRESS: Precursor Summary:
0:29:22.956613 PROGRESS: Channel   0:	 0.05 FDR:   123; 0.01 FDR:    89; 0.001 FDR:    89
0:29:22.956727 PROGRESS: 
0:29:22.956817 PROGRESS: Protein Summary:
0:29:22.958565 PROGRESS: Channel   0:	 0.05 FDR:   121; 0.01 FDR:    87; 0.001 FDR:    87
0:29:22.958678 PROGRESS: =========================================================================
0:29:22.959581 PROGRESS: === Epoch 5, step 4, extracting elution groups 15000 to 31000 ===
0:29:23.067640 PROGRESS: Extracting batch of 31638 precursors
0:29:23.078345 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:29:23.078444 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:29:23.078482 INFO: FWHM in RT is 14.12 seconds, sigma is 0.51
0:29:23.078511 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:29:23.078753 INFO: Starting candidate selection
0:29:27.125898 INFO: Starting candidate scoring
0:29:28.677334 INFO: Finished candidate processing
0:29:28.677425 INFO: Collecting candidate features
0:29:30.913910 WARNING: intensity_correlation has 32 NaNs ( 0.11 % out of 29217)
0:29:30.920894 INFO: Collecting fragment features
0:29:31.562069 INFO: Finished candidate scoring
0:29:31.870440 PROGRESS: === Epoch 5, step 4, extracted 29217 precursors and 133525 fragments ===
0:29:31.870768 INFO: performing precursor FDR with 47 features
0:29:31.870823 INFO: Decoy channel: -1
0:29:31.870854 INFO: Competetive: True
0:29:31.929916 WARNING: dropped 29 target PSMs due to missing features
0:29:31.930034 WARNING: dropped 29 decoy PSMs due to missing features
0:29:33.713453 INFO: Test AUC: 0.545
0:29:33.713606 INFO: Train AUC: 0.592
0:29:33.713656 INFO: AUC difference: 7.89%
0:29:33.713691 WARNING: AUC difference > 5%. This may indicate overfitting.
0:29:33.841940 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
0:29:33.843014 PROGRESS: ============================= Precursor FDR =============================
0:29:33.843143 PROGRESS: Total precursors accumulated: 553
0:29:33.843221 PROGRESS: Target precursors: 504 (91.14%)
0:29:33.843288 PROGRESS: Decoy precursors: 49 (8.86%)
0:29:33.843351 PROGRESS: 
0:29:33.843413 PROGRESS: Precursor Summary:
0:29:33.845050 PROGRESS: Channel   0:	 0.05 FDR:   264; 0.01 FDR:   221; 0.001 FDR:   161
0:29:33.845198 PROGRESS: 
0:29:33.845274 PROGRESS: Protein Summary:
0:29:33.847194 PROGRESS: Channel   0:	 0.05 FDR:   250; 0.01 FDR:   209; 0.001 FDR:   151
0:29:33.847324 PROGRESS: =========================================================================
0:29:33.848321 PROGRESS: === Epoch 5, step 5, extracting elution groups 31000 to 63000 ===
0:29:33.984185 PROGRESS: Extracting batch of 63243 precursors
0:29:34.004178 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:29:34.004286 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:29:34.004354 INFO: FWHM in RT is 14.12 seconds, sigma is 0.51
0:29:34.004385 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:29:34.004641 INFO: Starting candidate selection
0:29:38.706895 INFO: Starting candidate scoring
0:29:40.559288 INFO: Finished candidate processing
0:29:40.559385 INFO: Collecting candidate features
0:29:42.919480 WARNING: intensity_correlation has 43 NaNs ( 0.07 % out of 58487)
0:29:42.928681 INFO: Collecting fragment features
0:29:43.607587 INFO: Finished candidate scoring
0:29:43.956727 PROGRESS: === Epoch 5, step 5, extracted 58487 precursors and 265984 fragments ===
0:29:43.964012 INFO: performing precursor FDR with 47 features
0:29:43.964086 INFO: Decoy channel: -1
0:29:43.964113 INFO: Competetive: True
0:29:44.093061 WARNING: dropped 51 target PSMs due to missing features
0:29:44.093181 WARNING: dropped 50 decoy PSMs due to missing features
0:29:48.012305 INFO: Test AUC: 0.544
0:29:48.012423 INFO: Train AUC: 0.589
0:29:48.012460 INFO: AUC difference: 7.61%
0:29:48.012505 WARNING: AUC difference > 5%. This may indicate overfitting.
0:29:48.149800 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
0:29:48.151044 PROGRESS: ============================= Precursor FDR =============================
0:29:48.151174 PROGRESS: Total precursors accumulated: 1,064
0:29:48.151252 PROGRESS: Target precursors: 971 (91.26%)
0:29:48.151321 PROGRESS: Decoy precursors: 93 (8.74%)
0:29:48.151383 PROGRESS: 
0:29:48.151444 PROGRESS: Precursor Summary:
0:29:48.153271 PROGRESS: Channel   0:	 0.05 FDR:   662; 0.01 FDR:   406; 0.001 FDR:   209
0:29:48.153410 PROGRESS: 
0:29:48.153485 PROGRESS: Protein Summary:
0:29:48.156976 PROGRESS: Channel   0:	 0.05 FDR:   624; 0.01 FDR:   374; 0.001 FDR:   195
0:29:48.157165 PROGRESS: =========================================================================
0:29:48.159002 PROGRESS: === Epoch 5, step 6, extracting elution groups 63000 to 127000 ===
0:29:48.336965 PROGRESS: Extracting batch of 126491 precursors
0:29:48.375628 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:29:48.375742 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:29:48.375782 INFO: FWHM in RT is 14.12 seconds, sigma is 0.51
0:29:48.375825 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:29:48.376086 INFO: Starting candidate selection
0:29:54.307814 INFO: Starting candidate scoring
0:29:56.747020 INFO: Finished candidate processing
0:29:56.747205 INFO: Collecting candidate features
0:29:59.286472 WARNING: intensity_correlation has 98 NaNs ( 0.08 % out of 117125)
0:29:59.299378 INFO: Collecting fragment features
0:30:00.036676 INFO: Finished candidate scoring
0:30:00.462157 PROGRESS: === Epoch 5, step 6, extracted 117125 precursors and 533047 fragments ===
0:30:00.462471 INFO: performing precursor FDR with 47 features
0:30:00.462517 INFO: Decoy channel: -1
0:30:00.462545 INFO: Competetive: True
0:30:00.733418 WARNING: dropped 106 target PSMs due to missing features
0:30:00.733536 WARNING: dropped 93 decoy PSMs due to missing features
0:30:09.075936 INFO: Test AUC: 0.548
0:30:09.076061 INFO: Train AUC: 0.579
0:30:09.076118 INFO: AUC difference: 5.32%
0:30:09.076145 WARNING: AUC difference > 5%. This may indicate overfitting.
0:30:09.231479 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
0:30:09.233074 PROGRESS: ============================= Precursor FDR =============================
0:30:09.233221 PROGRESS: Total precursors accumulated: 1,946
0:30:09.233300 PROGRESS: Target precursors: 1,774 (91.16%)
0:30:09.233371 PROGRESS: Decoy precursors: 172 (8.84%)
0:30:09.233434 PROGRESS: 
0:30:09.233496 PROGRESS: Precursor Summary:
0:30:09.235652 PROGRESS: Channel   0:	 0.05 FDR: 1,282; 0.01 FDR:   760; 0.001 FDR:   443
0:30:09.235793 PROGRESS: 
0:30:09.235867 PROGRESS: Protein Summary:
0:30:09.238543 PROGRESS: Channel   0:	 0.05 FDR: 1,159; 0.01 FDR:   661; 0.001 FDR:   398
0:30:09.238664 PROGRESS: =========================================================================
0:30:09.240018 PROGRESS: === Epoch 5, step 7, extracting elution groups 127000 to 255000 ===
0:30:09.465875 PROGRESS: Extracting batch of 252925 precursors
0:30:09.540880 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:30:09.540998 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:30:09.541039 INFO: FWHM in RT is 14.12 seconds, sigma is 0.51
0:30:09.541085 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:30:09.541345 INFO: Starting candidate selection
0:30:18.046757 INFO: Starting candidate scoring
0:30:21.744731 INFO: Finished candidate processing
0:30:21.744921 INFO: Collecting candidate features
0:30:24.694478 WARNING: intensity_correlation has 223 NaNs ( 0.10 % out of 233590)
0:30:24.715157 INFO: Collecting fragment features
0:30:25.545851 INFO: Finished candidate scoring
0:30:26.121604 PROGRESS: === Epoch 5, step 7, extracted 233590 precursors and 1064083 fragments ===
0:30:26.121935 INFO: performing precursor FDR with 47 features
0:30:26.121983 INFO: Decoy channel: -1
0:30:26.122010 INFO: Competetive: True
0:30:26.713511 WARNING: dropped 219 target PSMs due to missing features
0:30:26.713631 WARNING: dropped 203 decoy PSMs due to missing features
0:30:43.847473 INFO: Test AUC: 0.550
0:30:43.847609 INFO: Train AUC: 0.572
0:30:43.847658 INFO: AUC difference: 3.87%
0:30:44.032922 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
0:30:44.034811 PROGRESS: ============================= Precursor FDR =============================
0:30:44.034959 PROGRESS: Total precursors accumulated: 3,146
0:30:44.035064 PROGRESS: Target precursors: 2,868 (91.16%)
0:30:44.035134 PROGRESS: Decoy precursors: 278 (8.84%)
0:30:44.035197 PROGRESS: 
0:30:44.035259 PROGRESS: Precursor Summary:
0:30:44.037903 PROGRESS: Channel   0:	 0.05 FDR: 2,264; 0.01 FDR: 1,683; 0.001 FDR: 1,165
0:30:44.038028 PROGRESS: 
0:30:44.038101 PROGRESS: Protein Summary:
0:30:44.041524 PROGRESS: Channel   0:	 0.05 FDR: 1,857; 0.01 FDR: 1,353; 0.001 FDR:   950
0:30:44.041654 PROGRESS: =========================================================================
0:30:44.044571 INFO: calibration group: precursor, fitting rt estimator 
0:30:44.277976 INFO: calibration group: fragment, fitting mz estimator 
0:30:44.864829 INFO: === checking if epoch conditions were reached ===
0:30:44.864982 INFO: ✅ ms2_error      : 7.0000 <= 7
0:30:44.865070 INFO: ❌ rt_error       : 196.2803 > 100
0:30:44.865143 INFO: ✅ current_epoch  : 5 >= 3
0:30:44.865209 INFO: ==============================================
0:30:45.114408 INFO: calibration group: precursor, predicting mz
0:30:45.114663 WARNING: mz prediction was skipped as it has not been fitted yet
0:30:45.114704 INFO: calibration group: precursor, predicting rt
0:30:51.919208 INFO: calibration group: fragment, predicting mz
0:31:09.764130 PROGRESS: === Epoch 6, step 0, extracting elution groups 0 to 1000 ===
0:31:09.852549 PROGRESS: Extracting batch of 1980 precursors
0:31:09.854237 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:31:09.854317 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:31:09.854357 INFO: FWHM in RT is 14.17 seconds, sigma is 0.52
0:31:09.854403 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:31:09.854639 INFO: Starting candidate selection
0:31:13.672544 INFO: Starting candidate scoring
0:31:14.956977 INFO: Finished candidate processing
0:31:14.957063 INFO: Collecting candidate features
0:31:17.101890 WARNING: intensity_correlation has 3 NaNs ( 0.17 % out of 1801)
0:31:17.107742 INFO: Collecting fragment features
0:31:17.711021 INFO: Finished candidate scoring
0:31:18.020762 PROGRESS: === Epoch 6, step 0, extracted 1801 precursors and 8195 fragments ===
0:31:18.021065 INFO: performing precursor FDR with 47 features
0:31:18.021107 INFO: Decoy channel: -1
0:31:18.021134 INFO: Competetive: True
0:31:18.025715 WARNING: dropped 2 target PSMs due to missing features
0:31:18.025798 WARNING: dropped 1 decoy PSMs due to missing features
0:31:18.053210 INFO: Test AUC: 0.534
0:31:18.053304 INFO: Train AUC: 0.550
0:31:18.053362 INFO: AUC difference: 2.96%
0:31:18.174913 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
0:31:18.175703 PROGRESS: ============================= Precursor FDR =============================
0:31:18.175819 PROGRESS: Total precursors accumulated: 9
0:31:18.175896 PROGRESS: Target precursors: 9 (100.00%)
0:31:18.175964 PROGRESS: Decoy precursors: 0 (0.00%)
0:31:18.176027 PROGRESS: 
0:31:18.176089 PROGRESS: Precursor Summary:
0:31:18.177572 PROGRESS: Channel   0:	 0.05 FDR:     9; 0.01 FDR:     9; 0.001 FDR:     9
0:31:18.177699 PROGRESS: 
0:31:18.177781 PROGRESS: Protein Summary:
0:31:18.179470 PROGRESS: Channel   0:	 0.05 FDR:     9; 0.01 FDR:     9; 0.001 FDR:     9
0:31:18.179578 PROGRESS: =========================================================================
0:31:18.180462 PROGRESS: === Epoch 6, step 1, extracting elution groups 1000 to 3000 ===
0:31:18.257535 PROGRESS: Extracting batch of 3955 precursors
0:31:18.259671 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:31:18.259747 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:31:18.259788 INFO: FWHM in RT is 14.17 seconds, sigma is 0.52
0:31:18.259819 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:31:18.260046 INFO: Starting candidate selection
0:31:21.746156 INFO: Starting candidate scoring
0:31:23.050723 INFO: Finished candidate processing
0:31:23.050812 INFO: Collecting candidate features
0:31:25.202495 WARNING: intensity_correlation has 9 NaNs ( 0.25 % out of 3636)
0:31:25.208559 INFO: Collecting fragment features
0:31:25.813606 INFO: Finished candidate scoring
0:31:26.089688 PROGRESS: === Epoch 6, step 1, extracted 3636 precursors and 16609 fragments ===
0:31:26.089979 INFO: performing precursor FDR with 47 features
0:31:26.090025 INFO: Decoy channel: -1
0:31:26.090052 INFO: Competetive: True
0:31:26.098372 WARNING: dropped 7 target PSMs due to missing features
0:31:26.098463 WARNING: dropped 5 decoy PSMs due to missing features
0:31:26.135873 INFO: Test AUC: 0.559
0:31:26.135992 INFO: Train AUC: 0.540
0:31:26.136037 INFO: AUC difference: 3.58%
0:31:26.254909 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
0:31:26.255697 PROGRESS: ============================= Precursor FDR =============================
0:31:26.255824 PROGRESS: Total precursors accumulated: 36
0:31:26.255902 PROGRESS: Target precursors: 33 (91.67%)
0:31:26.255982 PROGRESS: Decoy precursors: 3 (8.33%)
0:31:26.256047 PROGRESS: 
0:31:26.256109 PROGRESS: Precursor Summary:
0:31:26.257539 PROGRESS: Channel   0:	 0.05 FDR:    32; 0.01 FDR:    28; 0.001 FDR:    28
0:31:26.257672 PROGRESS: 
0:31:26.257746 PROGRESS: Protein Summary:
0:31:26.259376 PROGRESS: Channel   0:	 0.05 FDR:    32; 0.01 FDR:    28; 0.001 FDR:    28
0:31:26.259501 PROGRESS: =========================================================================
0:31:26.260358 PROGRESS: === Epoch 6, step 2, extracting elution groups 3000 to 7000 ===
0:31:26.342296 PROGRESS: Extracting batch of 7916 precursors
0:31:26.345445 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:31:26.345505 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:31:26.345543 INFO: FWHM in RT is 14.17 seconds, sigma is 0.52
0:31:26.345588 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:31:26.345834 INFO: Starting candidate selection
0:31:29.934125 INFO: Starting candidate scoring
0:31:31.293012 INFO: Finished candidate processing
0:31:31.293203 INFO: Collecting candidate features
0:31:33.478493 WARNING: intensity_correlation has 6 NaNs ( 0.08 % out of 7286)
0:31:33.484037 INFO: Collecting fragment features
0:31:34.098399 INFO: Finished candidate scoring
0:31:34.382813 PROGRESS: === Epoch 6, step 2, extracted 7286 precursors and 33105 fragments ===
0:31:34.383112 INFO: performing precursor FDR with 47 features
0:31:34.383159 INFO: Decoy channel: -1
0:31:34.383185 INFO: Competetive: True
0:31:34.397886 WARNING: dropped 11 target PSMs due to missing features
0:31:34.398007 WARNING: dropped 7 decoy PSMs due to missing features
0:31:34.713589 INFO: Test AUC: 0.544
0:31:34.713729 INFO: Train AUC: 0.577
0:31:34.713810 INFO: AUC difference: 5.65%
0:31:34.713860 WARNING: AUC difference > 5%. This may indicate overfitting.
0:31:34.835424 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
0:31:34.836292 PROGRESS: ============================= Precursor FDR =============================
0:31:34.836413 PROGRESS: Total precursors accumulated: 67
0:31:34.836491 PROGRESS: Target precursors: 61 (91.04%)
0:31:34.836559 PROGRESS: Decoy precursors: 6 (8.96%)
0:31:34.836622 PROGRESS: 
0:31:34.836684 PROGRESS: Precursor Summary:
0:31:34.838156 PROGRESS: Channel   0:	 0.05 FDR:    49; 0.01 FDR:    37; 0.001 FDR:    37
0:31:34.838271 PROGRESS: 
0:31:34.838346 PROGRESS: Protein Summary:
0:31:34.840015 PROGRESS: Channel   0:	 0.05 FDR:    49; 0.01 FDR:    37; 0.001 FDR:    37
0:31:34.840126 PROGRESS: =========================================================================
0:31:34.841000 PROGRESS: === Epoch 6, step 3, extracting elution groups 7000 to 15000 ===
0:31:34.933538 PROGRESS: Extracting batch of 15790 precursors
0:31:34.939034 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:31:34.939104 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:31:34.939139 INFO: FWHM in RT is 14.17 seconds, sigma is 0.52
0:31:34.939181 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:31:34.939396 INFO: Starting candidate selection
0:31:38.644430 INFO: Starting candidate scoring
0:31:40.038180 INFO: Finished candidate processing
0:31:40.038267 INFO: Collecting candidate features
0:31:42.225450 WARNING: intensity_correlation has 11 NaNs ( 0.08 % out of 14595)
0:31:42.231429 INFO: Collecting fragment features
0:31:42.853321 INFO: Finished candidate scoring
0:31:43.143474 PROGRESS: === Epoch 6, step 3, extracted 14595 precursors and 66840 fragments ===
0:31:43.143764 INFO: performing precursor FDR with 47 features
0:31:43.143809 INFO: Decoy channel: -1
0:31:43.143836 INFO: Competetive: True
0:31:43.172240 WARNING: dropped 17 target PSMs due to missing features
0:31:43.172343 WARNING: dropped 12 decoy PSMs due to missing features
0:31:43.874175 INFO: Test AUC: 0.553
0:31:43.874423 INFO: Train AUC: 0.586
0:31:43.874483 INFO: AUC difference: 5.67%
0:31:43.874518 WARNING: AUC difference > 5%. This may indicate overfitting.
0:31:44.001326 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
0:31:44.002288 PROGRESS: ============================= Precursor FDR =============================
0:31:44.002410 PROGRESS: Total precursors accumulated: 280
0:31:44.002489 PROGRESS: Target precursors: 256 (91.43%)
0:31:44.002557 PROGRESS: Decoy precursors: 24 (8.57%)
0:31:44.002621 PROGRESS: 
0:31:44.002682 PROGRESS: Precursor Summary:
0:31:44.004208 PROGRESS: Channel   0:	 0.05 FDR:   163; 0.01 FDR:    80; 0.001 FDR:    80
0:31:44.004340 PROGRESS: 
0:31:44.004414 PROGRESS: Protein Summary:
0:31:44.006174 PROGRESS: Channel   0:	 0.05 FDR:   162; 0.01 FDR:    80; 0.001 FDR:    80
0:31:44.006287 PROGRESS: =========================================================================
0:31:44.007199 PROGRESS: === Epoch 6, step 4, extracting elution groups 15000 to 31000 ===
0:31:44.114878 PROGRESS: Extracting batch of 31614 precursors
0:31:44.125368 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:31:44.125480 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:31:44.125521 INFO: FWHM in RT is 14.17 seconds, sigma is 0.52
0:31:44.125548 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:31:44.125819 INFO: Starting candidate selection
0:31:48.199232 INFO: Starting candidate scoring
0:31:49.760571 INFO: Finished candidate processing
0:31:49.760674 INFO: Collecting candidate features
0:31:52.001312 WARNING: intensity_correlation has 38 NaNs ( 0.13 % out of 29282)
0:31:52.008266 INFO: Collecting fragment features
0:31:52.656039 INFO: Finished candidate scoring
0:31:52.963926 PROGRESS: === Epoch 6, step 4, extracted 29282 precursors and 133855 fragments ===
0:31:52.964254 INFO: performing precursor FDR with 47 features
0:31:52.964303 INFO: Decoy channel: -1
0:31:52.964328 INFO: Competetive: True
0:31:53.020990 WARNING: dropped 36 target PSMs due to missing features
0:31:53.021101 WARNING: dropped 31 decoy PSMs due to missing features
0:31:54.874497 INFO: Test AUC: 0.547
0:31:54.874644 INFO: Train AUC: 0.594
0:31:54.874691 INFO: AUC difference: 7.89%
0:31:54.874728 WARNING: AUC difference > 5%. This may indicate overfitting.
0:31:55.002458 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
0:31:55.003525 PROGRESS: ============================= Precursor FDR =============================
0:31:55.003650 PROGRESS: Total precursors accumulated: 582
0:31:55.003728 PROGRESS: Target precursors: 531 (91.24%)
0:31:55.003796 PROGRESS: Decoy precursors: 51 (8.76%)
0:31:55.003858 PROGRESS: 
0:31:55.003919 PROGRESS: Precursor Summary:
0:31:55.005538 PROGRESS: Channel   0:	 0.05 FDR:   336; 0.01 FDR:   201; 0.001 FDR:   170
0:31:55.005666 PROGRESS: 
0:31:55.005741 PROGRESS: Protein Summary:
0:31:55.007664 PROGRESS: Channel   0:	 0.05 FDR:   322; 0.01 FDR:   193; 0.001 FDR:   163
0:31:55.007776 PROGRESS: =========================================================================
0:31:55.008754 PROGRESS: === Epoch 6, step 5, extracting elution groups 31000 to 63000 ===
0:31:55.145744 PROGRESS: Extracting batch of 63230 precursors
0:31:55.165488 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:31:55.165598 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:31:55.165637 INFO: FWHM in RT is 14.17 seconds, sigma is 0.52
0:31:55.165679 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:31:55.165942 INFO: Starting candidate selection
0:31:59.864372 INFO: Starting candidate scoring
0:32:01.737215 INFO: Finished candidate processing
0:32:01.737323 INFO: Collecting candidate features
0:32:04.096100 WARNING: intensity_correlation has 51 NaNs ( 0.09 % out of 58462)
0:32:04.105084 INFO: Collecting fragment features
0:32:04.783212 INFO: Finished candidate scoring
0:32:05.131696 PROGRESS: === Epoch 6, step 5, extracted 58462 precursors and 267434 fragments ===
0:32:05.132008 INFO: performing precursor FDR with 47 features
0:32:05.132056 INFO: Decoy channel: -1
0:32:05.132082 INFO: Competetive: True
0:32:05.261984 WARNING: dropped 61 target PSMs due to missing features
0:32:05.262119 WARNING: dropped 57 decoy PSMs due to missing features
0:32:09.159462 INFO: Test AUC: 0.546
0:32:09.159587 INFO: Train AUC: 0.589
0:32:09.159643 INFO: AUC difference: 7.26%
0:32:09.159672 WARNING: AUC difference > 5%. This may indicate overfitting.
0:32:09.295063 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
0:32:09.296310 PROGRESS: ============================= Precursor FDR =============================
0:32:09.296434 PROGRESS: Total precursors accumulated: 1,141
0:32:09.296513 PROGRESS: Target precursors: 1,039 (91.06%)
0:32:09.296582 PROGRESS: Decoy precursors: 102 (8.94%)
0:32:09.296657 PROGRESS: 
0:32:09.296719 PROGRESS: Precursor Summary:
0:32:09.298506 PROGRESS: Channel   0:	 0.05 FDR:   604; 0.01 FDR:   326; 0.001 FDR:   242
0:32:09.298623 PROGRESS: 
0:32:09.298699 PROGRESS: Protein Summary:
0:32:09.300793 PROGRESS: Channel   0:	 0.05 FDR:   565; 0.01 FDR:   303; 0.001 FDR:   227
0:32:09.300903 PROGRESS: =========================================================================
0:32:09.301976 PROGRESS: === Epoch 6, step 6, extracting elution groups 63000 to 127000 ===
0:32:09.477252 PROGRESS: Extracting batch of 126533 precursors
0:32:09.514836 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:32:09.514953 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:32:09.514991 INFO: FWHM in RT is 14.17 seconds, sigma is 0.52
0:32:09.515037 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:32:09.515294 INFO: Starting candidate selection
0:32:16.268628 INFO: Starting candidate scoring
0:32:18.739293 INFO: Finished candidate processing
0:32:18.739476 INFO: Collecting candidate features
0:32:21.246754 WARNING: intensity_correlation has 114 NaNs ( 0.10 % out of 116696)
0:32:21.260573 INFO: Collecting fragment features
0:32:21.991102 INFO: Finished candidate scoring
0:32:22.411110 PROGRESS: === Epoch 6, step 6, extracted 116696 precursors and 532891 fragments ===
0:32:22.411434 INFO: performing precursor FDR with 47 features
0:32:22.411478 INFO: Decoy channel: -1
0:32:22.411505 INFO: Competetive: True
0:32:22.678107 WARNING: dropped 113 target PSMs due to missing features
0:32:22.678220 WARNING: dropped 119 decoy PSMs due to missing features
0:32:31.011202 INFO: Test AUC: 0.544
0:32:31.011329 INFO: Train AUC: 0.580
0:32:31.011387 INFO: AUC difference: 6.09%
0:32:31.011416 WARNING: AUC difference > 5%. This may indicate overfitting.
0:32:31.176341 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
0:32:31.177985 PROGRESS: ============================= Precursor FDR =============================
0:32:31.178122 PROGRESS: Total precursors accumulated: 2,132
0:32:31.178201 PROGRESS: Target precursors: 1,943 (91.14%)
0:32:31.178269 PROGRESS: Decoy precursors: 189 (8.86%)
0:32:31.178332 PROGRESS: 
0:32:31.178393 PROGRESS: Precursor Summary:
0:32:31.180591 PROGRESS: Channel   0:	 0.05 FDR: 1,306; 0.01 FDR:   787; 0.001 FDR:   694
0:32:31.180731 PROGRESS: 
0:32:31.180807 PROGRESS: Protein Summary:
0:32:31.183598 PROGRESS: Channel   0:	 0.05 FDR: 1,167; 0.01 FDR:   694; 0.001 FDR:   615
0:32:31.183744 PROGRESS: =========================================================================
0:32:31.185113 PROGRESS: === Epoch 6, step 7, extracting elution groups 127000 to 255000 ===
0:32:31.410151 PROGRESS: Extracting batch of 252915 precursors
0:32:31.483135 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:32:31.483253 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:32:31.483292 INFO: FWHM in RT is 14.17 seconds, sigma is 0.52
0:32:31.483335 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:32:31.483597 INFO: Starting candidate selection
0:32:39.982568 INFO: Starting candidate scoring
0:32:43.669581 INFO: Finished candidate processing
0:32:43.669787 INFO: Collecting candidate features
0:32:46.624445 WARNING: intensity_correlation has 212 NaNs ( 0.09 % out of 233604)
0:32:46.644406 INFO: Collecting fragment features
0:32:47.475127 INFO: Finished candidate scoring
0:32:48.055315 PROGRESS: === Epoch 6, step 7, extracted 233604 precursors and 1068475 fragments ===
0:32:48.055644 INFO: performing precursor FDR with 47 features
0:32:48.055692 INFO: Decoy channel: -1
0:32:48.055719 INFO: Competetive: True
0:32:48.649247 WARNING: dropped 224 target PSMs due to missing features
0:32:48.649370 WARNING: dropped 220 decoy PSMs due to missing features
0:33:05.297598 INFO: Test AUC: 0.547
0:33:05.297731 INFO: Train AUC: 0.570
0:33:05.297800 INFO: AUC difference: 4.02%
0:33:05.480672 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
0:33:05.482744 PROGRESS: ============================= Precursor FDR =============================
0:33:05.482881 PROGRESS: Total precursors accumulated: 3,641
0:33:05.482961 PROGRESS: Target precursors: 3,321 (91.21%)
0:33:05.483030 PROGRESS: Decoy precursors: 320 (8.79%)
0:33:05.483093 PROGRESS: 
0:33:05.483154 PROGRESS: Precursor Summary:
0:33:05.485785 PROGRESS: Channel   0:	 0.05 FDR: 2,341; 0.01 FDR: 1,706; 0.001 FDR: 1,174
0:33:05.485922 PROGRESS: 
0:33:05.486011 PROGRESS: Protein Summary:
0:33:05.489520 PROGRESS: Channel   0:	 0.05 FDR: 1,918; 0.01 FDR: 1,372; 0.001 FDR:   964
0:33:05.489639 PROGRESS: =========================================================================
0:33:05.492670 INFO: calibration group: precursor, fitting rt estimator 
0:33:05.722353 INFO: calibration group: fragment, fitting mz estimator 
0:33:06.313296 INFO: === checking if epoch conditions were reached ===
0:33:06.313461 INFO: ✅ ms2_error      : 7.0000 <= 7
0:33:06.313558 INFO: ❌ rt_error       : 200.4631 > 100
0:33:06.313637 INFO: ✅ current_epoch  : 6 >= 3
0:33:06.313709 INFO: ==============================================
0:33:06.556252 INFO: calibration group: precursor, predicting mz
0:33:06.556510 WARNING: mz prediction was skipped as it has not been fitted yet
0:33:06.556549 INFO: calibration group: precursor, predicting rt
0:33:13.308818 INFO: calibration group: fragment, predicting mz
0:33:31.169797 PROGRESS: === Epoch 7, step 0, extracting elution groups 0 to 1000 ===
0:33:31.258173 PROGRESS: Extracting batch of 1969 precursors
0:33:31.259839 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:33:31.259916 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:33:31.259953 INFO: FWHM in RT is 13.90 seconds, sigma is 0.51
0:33:31.259999 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:33:31.260229 INFO: Starting candidate selection
0:33:35.080500 INFO: Starting candidate scoring
0:33:36.360085 INFO: Finished candidate processing
0:33:36.360177 INFO: Collecting candidate features
0:33:38.506888 INFO: Collecting fragment features
0:33:39.107935 INFO: Finished candidate scoring
0:33:39.417324 PROGRESS: === Epoch 7, step 0, extracted 1798 precursors and 8268 fragments ===
0:33:39.417629 INFO: performing precursor FDR with 47 features
0:33:39.417670 INFO: Decoy channel: -1
0:33:39.417697 INFO: Competetive: True
0:33:39.472480 INFO: Test AUC: 0.568
0:33:39.472596 INFO: Train AUC: 0.539
0:33:39.472663 INFO: AUC difference: 5.50%
0:33:39.472711 WARNING: AUC difference > 5%. This may indicate overfitting.
0:33:39.590004 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
0:33:39.590770 PROGRESS: ============================= Precursor FDR =============================
0:33:39.590888 PROGRESS: Total precursors accumulated: 18
0:33:39.590965 PROGRESS: Target precursors: 17 (94.44%)
0:33:39.591034 PROGRESS: Decoy precursors: 1 (5.56%)
0:33:39.591097 PROGRESS: 
0:33:39.591159 PROGRESS: Precursor Summary:
0:33:39.592561 PROGRESS: Channel   0:	 0.05 FDR:    10; 0.01 FDR:    10; 0.001 FDR:    10
0:33:39.592692 PROGRESS: 
0:33:39.592765 PROGRESS: Protein Summary:
0:33:39.594365 PROGRESS: Channel   0:	 0.05 FDR:    10; 0.01 FDR:    10; 0.001 FDR:    10
0:33:39.594478 PROGRESS: =========================================================================
0:33:39.595335 PROGRESS: === Epoch 7, step 1, extracting elution groups 1000 to 3000 ===
0:33:39.672503 PROGRESS: Extracting batch of 3947 precursors
0:33:39.674622 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:33:39.674680 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:33:39.674720 INFO: FWHM in RT is 13.90 seconds, sigma is 0.51
0:33:39.674766 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:33:39.674983 INFO: Starting candidate selection
0:33:43.179140 INFO: Starting candidate scoring
0:33:44.479411 INFO: Finished candidate processing
0:33:44.479504 INFO: Collecting candidate features
0:33:46.637469 INFO: Collecting fragment features
0:33:47.246191 INFO: Finished candidate scoring
0:33:47.522775 PROGRESS: === Epoch 7, step 1, extracted 3618 precursors and 16372 fragments ===
0:33:47.523058 INFO: performing precursor FDR with 47 features
0:33:47.523104 INFO: Decoy channel: -1
0:33:47.523130 INFO: Competetive: True
0:33:47.567310 INFO: Test AUC: 0.561
0:33:47.567430 INFO: Train AUC: 0.555
0:33:47.567475 INFO: AUC difference: 0.98%
0:33:47.687005 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
0:33:47.687790 PROGRESS: ============================= Precursor FDR =============================
0:33:47.687912 PROGRESS: Total precursors accumulated: 30
0:33:47.687989 PROGRESS: Target precursors: 28 (93.33%)
0:33:47.688057 PROGRESS: Decoy precursors: 2 (6.67%)
0:33:47.688119 PROGRESS: 
0:33:47.688179 PROGRESS: Precursor Summary:
0:33:47.689597 PROGRESS: Channel   0:	 0.05 FDR:    27; 0.01 FDR:    25; 0.001 FDR:    25
0:33:47.689725 PROGRESS: 
0:33:47.689807 PROGRESS: Protein Summary:
0:33:47.691416 PROGRESS: Channel   0:	 0.05 FDR:    27; 0.01 FDR:    25; 0.001 FDR:    25
0:33:47.691528 PROGRESS: =========================================================================
0:33:47.692395 PROGRESS: === Epoch 7, step 2, extracting elution groups 3000 to 7000 ===
0:33:47.774312 PROGRESS: Extracting batch of 7919 precursors
0:33:47.777400 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:33:47.777456 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:33:47.777494 INFO: FWHM in RT is 13.90 seconds, sigma is 0.51
0:33:47.777539 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:33:47.777749 INFO: Starting candidate selection
0:33:51.356291 INFO: Starting candidate scoring
0:33:52.693995 INFO: Finished candidate processing
0:33:52.694104 INFO: Collecting candidate features
0:33:54.883644 WARNING: intensity_correlation has 6 NaNs ( 0.08 % out of 7309)
0:33:54.890921 INFO: Collecting fragment features
0:33:55.515549 INFO: Finished candidate scoring
0:33:55.797194 PROGRESS: === Epoch 7, step 2, extracted 7309 precursors and 33368 fragments ===
0:33:55.797500 INFO: performing precursor FDR with 47 features
0:33:55.797549 INFO: Decoy channel: -1
0:33:55.797575 INFO: Competetive: True
0:33:55.812013 WARNING: dropped 4 target PSMs due to missing features
0:33:55.812111 WARNING: dropped 2 decoy PSMs due to missing features
0:33:56.113411 INFO: Test AUC: 0.549
0:33:56.113547 INFO: Train AUC: 0.577
0:33:56.113623 INFO: AUC difference: 4.86%
0:33:56.234446 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
0:33:56.235321 PROGRESS: ============================= Precursor FDR =============================
0:33:56.235440 PROGRESS: Total precursors accumulated: 112
0:33:56.235518 PROGRESS: Target precursors: 102 (91.07%)
0:33:56.235585 PROGRESS: Decoy precursors: 10 (8.93%)
0:33:56.235648 PROGRESS: 
0:33:56.235709 PROGRESS: Precursor Summary:
0:33:56.237181 PROGRESS: Channel   0:	 0.05 FDR:    90; 0.01 FDR:    51; 0.001 FDR:    51
0:33:56.237293 PROGRESS: 
0:33:56.237367 PROGRESS: Protein Summary:
0:33:56.239058 PROGRESS: Channel   0:	 0.05 FDR:    88; 0.01 FDR:    51; 0.001 FDR:    51
0:33:56.239170 PROGRESS: =========================================================================
0:33:56.240048 PROGRESS: === Epoch 7, step 3, extracting elution groups 7000 to 15000 ===
0:33:56.332291 PROGRESS: Extracting batch of 15818 precursors
0:33:56.337591 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:33:56.337654 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:33:56.337689 INFO: FWHM in RT is 13.90 seconds, sigma is 0.51
0:33:56.337732 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:33:56.337960 INFO: Starting candidate selection
0:34:00.071026 INFO: Starting candidate scoring
0:34:01.487182 INFO: Finished candidate processing
0:34:01.487273 INFO: Collecting candidate features
0:34:03.706833 WARNING: intensity_correlation has 5 NaNs ( 0.03 % out of 14540)
0:34:03.713171 INFO: Collecting fragment features
0:34:04.338816 INFO: Finished candidate scoring
0:34:04.629485 PROGRESS: === Epoch 7, step 3, extracted 14540 precursors and 66540 fragments ===
0:34:04.629799 INFO: performing precursor FDR with 47 features
0:34:04.629854 INFO: Decoy channel: -1
0:34:04.629881 INFO: Competetive: True
0:34:04.657294 WARNING: dropped 5 target PSMs due to missing features
0:34:04.657409 WARNING: dropped 6 decoy PSMs due to missing features
0:34:05.443634 INFO: Test AUC: 0.565
0:34:05.443789 INFO: Train AUC: 0.589
0:34:05.443835 INFO: AUC difference: 3.91%
0:34:05.571568 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
0:34:05.572558 PROGRESS: ============================= Precursor FDR =============================
0:34:05.572679 PROGRESS: Total precursors accumulated: 411
0:34:05.572755 PROGRESS: Target precursors: 374 (91.00%)
0:34:05.572823 PROGRESS: Decoy precursors: 37 (9.00%)
0:34:05.572886 PROGRESS: 
0:34:05.572946 PROGRESS: Precursor Summary:
0:34:05.574509 PROGRESS: Channel   0:	 0.05 FDR:   188; 0.01 FDR:   122; 0.001 FDR:    93
0:34:05.574624 PROGRESS: 
0:34:05.574696 PROGRESS: Protein Summary:
0:34:05.576469 PROGRESS: Channel   0:	 0.05 FDR:   185; 0.01 FDR:   120; 0.001 FDR:    93
0:34:05.576580 PROGRESS: =========================================================================
0:34:05.577502 PROGRESS: === Epoch 7, step 4, extracting elution groups 15000 to 31000 ===
0:34:05.685401 PROGRESS: Extracting batch of 31592 precursors
0:34:05.695598 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:34:05.695690 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:34:05.695726 INFO: FWHM in RT is 13.90 seconds, sigma is 0.51
0:34:05.695769 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:34:05.696006 INFO: Starting candidate selection
0:34:09.747931 INFO: Starting candidate scoring
0:34:11.302838 INFO: Finished candidate processing
0:34:11.302933 INFO: Collecting candidate features
0:34:13.569418 WARNING: intensity_correlation has 24 NaNs ( 0.08 % out of 29088)
0:34:13.576453 INFO: Collecting fragment features
0:34:14.224519 INFO: Finished candidate scoring
0:34:14.535093 PROGRESS: === Epoch 7, step 4, extracted 29088 precursors and 132364 fragments ===
0:34:14.535404 INFO: performing precursor FDR with 47 features
0:34:14.535451 INFO: Decoy channel: -1
0:34:14.535479 INFO: Competetive: True
0:34:14.593561 WARNING: dropped 19 target PSMs due to missing features
0:34:14.593673 WARNING: dropped 16 decoy PSMs due to missing features
0:34:16.361539 INFO: Test AUC: 0.548
0:34:16.361684 INFO: Train AUC: 0.599
0:34:16.361731 INFO: AUC difference: 8.45%
0:34:16.361767 WARNING: AUC difference > 5%. This may indicate overfitting.
0:34:16.487551 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
0:34:16.488660 PROGRESS: ============================= Precursor FDR =============================
0:34:16.488788 PROGRESS: Total precursors accumulated: 798
0:34:16.488865 PROGRESS: Target precursors: 726 (90.98%)
0:34:16.488933 PROGRESS: Decoy precursors: 72 (9.02%)
0:34:16.488996 PROGRESS: 
0:34:16.489057 PROGRESS: Precursor Summary:
0:34:16.490761 PROGRESS: Channel   0:	 0.05 FDR:   441; 0.01 FDR:   263; 0.001 FDR:   236
0:34:16.490879 PROGRESS: 
0:34:16.490953 PROGRESS: Protein Summary:
0:34:16.492943 PROGRESS: Channel   0:	 0.05 FDR:   426; 0.01 FDR:   255; 0.001 FDR:   228
0:34:16.493054 PROGRESS: =========================================================================
0:34:16.494092 PROGRESS: === Epoch 7, step 5, extracting elution groups 31000 to 63000 ===
0:34:16.630278 PROGRESS: Extracting batch of 63263 precursors
0:34:16.649882 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:34:16.649999 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:34:16.650040 INFO: FWHM in RT is 13.90 seconds, sigma is 0.51
0:34:16.650068 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:34:16.650316 INFO: Starting candidate selection
0:34:21.353476 INFO: Starting candidate scoring
0:34:23.213573 INFO: Finished candidate processing
0:34:23.213755 INFO: Collecting candidate features
0:34:25.571999 WARNING: intensity_correlation has 45 NaNs ( 0.08 % out of 58116)
0:34:25.580977 INFO: Collecting fragment features
0:34:26.261901 INFO: Finished candidate scoring
0:34:26.609045 PROGRESS: === Epoch 7, step 5, extracted 58116 precursors and 264884 fragments ===
0:34:26.616229 INFO: performing precursor FDR with 47 features
0:34:26.616418 INFO: Decoy channel: -1
0:34:26.616549 INFO: Competetive: True
0:34:26.745392 WARNING: dropped 37 target PSMs due to missing features
0:34:26.745513 WARNING: dropped 43 decoy PSMs due to missing features
0:34:30.836543 INFO: Test AUC: 0.555
0:34:30.836685 INFO: Train AUC: 0.593
0:34:30.836726 INFO: AUC difference: 6.39%
0:34:30.836755 WARNING: AUC difference > 5%. This may indicate overfitting.
0:34:30.970717 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
0:34:30.972101 PROGRESS: ============================= Precursor FDR =============================
0:34:30.972228 PROGRESS: Total precursors accumulated: 1,520
0:34:30.972311 PROGRESS: Target precursors: 1,387 (91.25%)
0:34:30.972393 PROGRESS: Decoy precursors: 133 (8.75%)
0:34:30.972457 PROGRESS: 
0:34:30.972519 PROGRESS: Precursor Summary:
0:34:30.974386 PROGRESS: Channel   0:	 0.05 FDR:   837; 0.01 FDR:   446; 0.001 FDR:   267
0:34:30.974504 PROGRESS: 
0:34:30.974578 PROGRESS: Protein Summary:
0:34:30.976802 PROGRESS: Channel   0:	 0.05 FDR:   802; 0.01 FDR:   423; 0.001 FDR:   256
0:34:30.976932 PROGRESS: =========================================================================
0:34:30.978068 PROGRESS: === Epoch 7, step 6, extracting elution groups 63000 to 127000 ===
0:34:31.152987 PROGRESS: Extracting batch of 126454 precursors
0:34:31.191011 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:34:31.191127 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:34:31.191163 INFO: FWHM in RT is 13.90 seconds, sigma is 0.51
0:34:31.191206 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:34:31.191462 INFO: Starting candidate selection
0:34:37.172443 INFO: Starting candidate scoring
0:34:39.642705 INFO: Finished candidate processing
0:34:39.642799 INFO: Collecting candidate features
0:34:42.178745 WARNING: intensity_correlation has 91 NaNs ( 0.08 % out of 116333)
0:34:42.191497 INFO: Collecting fragment features
0:34:42.926364 INFO: Finished candidate scoring
0:34:43.349350 PROGRESS: === Epoch 7, step 6, extracted 116333 precursors and 530736 fragments ===
0:34:43.349663 INFO: performing precursor FDR with 47 features
0:34:43.349708 INFO: Decoy channel: -1
0:34:43.349735 INFO: Competetive: True
0:34:43.617451 WARNING: dropped 88 target PSMs due to missing features
0:34:43.617579 WARNING: dropped 83 decoy PSMs due to missing features
0:34:51.668590 INFO: Test AUC: 0.555
0:34:51.668718 INFO: Train AUC: 0.581
0:34:51.668777 INFO: AUC difference: 4.40%
0:34:51.822024 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
0:34:51.823789 PROGRESS: ============================= Precursor FDR =============================
0:34:51.823948 PROGRESS: Total precursors accumulated: 2,770
0:34:51.824028 PROGRESS: Target precursors: 2,525 (91.16%)
0:34:51.824096 PROGRESS: Decoy precursors: 245 (8.84%)
0:34:51.824162 PROGRESS: 
0:34:51.824224 PROGRESS: Precursor Summary:
0:34:51.826435 PROGRESS: Channel   0:	 0.05 FDR: 1,342; 0.01 FDR:   877; 0.001 FDR:   682
0:34:51.826558 PROGRESS: 
0:34:51.826633 PROGRESS: Protein Summary:
0:34:51.829391 PROGRESS: Channel   0:	 0.05 FDR: 1,228; 0.01 FDR:   805; 0.001 FDR:   625
0:34:51.829509 PROGRESS: =========================================================================
0:34:51.830900 PROGRESS: === Epoch 7, step 7, extracting elution groups 127000 to 255000 ===
0:34:52.056987 PROGRESS: Extracting batch of 252997 precursors
0:34:52.130220 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:34:52.130352 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:34:52.130393 INFO: FWHM in RT is 13.90 seconds, sigma is 0.51
0:34:52.130421 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:34:52.130684 INFO: Starting candidate selection
0:35:00.675805 INFO: Starting candidate scoring
0:35:04.294891 INFO: Finished candidate processing
0:35:04.294996 INFO: Collecting candidate features
0:35:07.237268 WARNING: intensity_correlation has 134 NaNs ( 0.06 % out of 232837)
0:35:07.257195 INFO: Collecting fragment features
0:35:08.081201 INFO: Finished candidate scoring
0:35:08.651943 PROGRESS: === Epoch 7, step 7, extracted 232837 precursors and 1062037 fragments ===
0:35:08.652264 INFO: performing precursor FDR with 47 features
0:35:08.652309 INFO: Decoy channel: -1
0:35:08.652336 INFO: Competetive: True
0:35:09.231716 WARNING: dropped 162 target PSMs due to missing features
0:35:09.231834 WARNING: dropped 143 decoy PSMs due to missing features
0:35:25.822129 INFO: Test AUC: 0.550
0:35:25.822260 INFO: Train AUC: 0.574
0:35:25.822300 INFO: AUC difference: 4.17%
0:35:26.006605 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
0:35:26.008743 PROGRESS: ============================= Precursor FDR =============================
0:35:26.008913 PROGRESS: Total precursors accumulated: 4,113
0:35:26.008993 PROGRESS: Target precursors: 3,751 (91.20%)
0:35:26.009075 PROGRESS: Decoy precursors: 362 (8.80%)
0:35:26.009140 PROGRESS: 
0:35:26.009201 PROGRESS: Precursor Summary:
0:35:26.011940 PROGRESS: Channel   0:	 0.05 FDR: 2,734; 0.01 FDR: 1,826; 0.001 FDR: 1,115
0:35:26.012080 PROGRESS: 
0:35:26.012154 PROGRESS: Protein Summary:
0:35:26.015811 PROGRESS: Channel   0:	 0.05 FDR: 2,275; 0.01 FDR: 1,493; 0.001 FDR:   935
0:35:26.015925 PROGRESS: =========================================================================
0:35:26.019049 INFO: calibration group: precursor, fitting rt estimator 
0:35:26.260339 INFO: calibration group: fragment, fitting mz estimator 
0:35:26.846273 INFO: === checking if epoch conditions were reached ===
0:35:26.846434 INFO: ✅ ms2_error      : 7.0000 <= 7
0:35:26.846523 INFO: ❌ rt_error       : 206.4120 > 100
0:35:26.846597 INFO: ✅ current_epoch  : 7 >= 3
0:35:26.846662 INFO: ==============================================
0:35:27.092110 INFO: calibration group: precursor, predicting mz
0:35:27.092365 WARNING: mz prediction was skipped as it has not been fitted yet
0:35:27.092405 INFO: calibration group: precursor, predicting rt
0:35:33.911199 INFO: calibration group: fragment, predicting mz
0:35:51.971825 PROGRESS: === Epoch 8, step 0, extracting elution groups 0 to 1000 ===
0:35:52.060126 PROGRESS: Extracting batch of 1976 precursors
0:35:52.061793 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:35:52.061882 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:35:52.061925 INFO: FWHM in RT is 14.05 seconds, sigma is 0.51
0:35:52.061955 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:35:52.062181 INFO: Starting candidate selection
0:35:55.949975 INFO: Starting candidate scoring
0:35:57.252371 INFO: Finished candidate processing
0:35:57.252461 INFO: Collecting candidate features
0:35:59.422950 WARNING: intensity_correlation has 1 NaNs ( 0.05 % out of 1820)
0:35:59.428879 INFO: Collecting fragment features
0:36:00.043884 INFO: Finished candidate scoring
0:36:00.355892 PROGRESS: === Epoch 8, step 0, extracted 1820 precursors and 8431 fragments ===
0:36:00.356215 INFO: performing precursor FDR with 47 features
0:36:00.356272 INFO: Decoy channel: -1
0:36:00.356317 INFO: Competetive: True
0:36:00.360785 WARNING: dropped 1 decoy PSMs due to missing features
0:36:00.389022 INFO: Test AUC: 0.562
0:36:00.389112 INFO: Train AUC: 0.536
0:36:00.389156 INFO: AUC difference: 4.81%
0:36:00.510675 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
0:36:00.511503 PROGRESS: ============================= Precursor FDR =============================
0:36:00.511628 PROGRESS: Total precursors accumulated: 8
0:36:00.511718 PROGRESS: Target precursors: 8 (100.00%)
0:36:00.511788 PROGRESS: Decoy precursors: 0 (0.00%)
0:36:00.511852 PROGRESS: 
0:36:00.511913 PROGRESS: Precursor Summary:
0:36:00.513408 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
0:36:00.513538 PROGRESS: 
0:36:00.513612 PROGRESS: Protein Summary:
0:36:00.515319 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
0:36:00.515431 PROGRESS: =========================================================================
0:36:00.516325 PROGRESS: === Epoch 8, step 1, extracting elution groups 1000 to 3000 ===
0:36:00.593212 PROGRESS: Extracting batch of 3960 precursors
0:36:00.595290 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:36:00.595348 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:36:00.595387 INFO: FWHM in RT is 14.05 seconds, sigma is 0.51
0:36:00.595432 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:36:00.595635 INFO: Starting candidate selection
0:36:04.173745 INFO: Starting candidate scoring
0:36:05.507694 INFO: Finished candidate processing
0:36:05.507872 INFO: Collecting candidate features
0:36:07.687504 WARNING: intensity_correlation has 4 NaNs ( 0.11 % out of 3607)
0:36:07.693575 INFO: Collecting fragment features
0:36:08.308940 INFO: Finished candidate scoring
0:36:08.587138 PROGRESS: === Epoch 8, step 1, extracted 3607 precursors and 16335 fragments ===
0:36:08.587420 INFO: performing precursor FDR with 47 features
0:36:08.587467 INFO: Decoy channel: -1
0:36:08.587493 INFO: Competetive: True
0:36:08.595868 WARNING: dropped 3 target PSMs due to missing features
0:36:08.595956 WARNING: dropped 2 decoy PSMs due to missing features
0:36:08.633276 INFO: Test AUC: 0.525
0:36:08.633392 INFO: Train AUC: 0.546
0:36:08.633437 INFO: AUC difference: 3.89%
0:36:08.751958 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
0:36:08.752661 PROGRESS: ============================= Precursor FDR =============================
0:36:08.752774 PROGRESS: Total precursors accumulated: 25
0:36:08.752841 PROGRESS: Target precursors: 23 (92.00%)
0:36:08.752899 PROGRESS: Decoy precursors: 2 (8.00%)
0:36:08.752952 PROGRESS: 
0:36:08.753004 PROGRESS: Precursor Summary:
0:36:08.754426 PROGRESS: Channel   0:	 0.05 FDR:    23; 0.01 FDR:    21; 0.001 FDR:    21
0:36:08.754554 PROGRESS: 
0:36:08.754631 PROGRESS: Protein Summary:
0:36:08.756249 PROGRESS: Channel   0:	 0.05 FDR:    23; 0.01 FDR:    21; 0.001 FDR:    21
0:36:08.756378 PROGRESS: =========================================================================
0:36:08.757236 PROGRESS: === Epoch 8, step 2, extracting elution groups 3000 to 7000 ===
0:36:08.839135 PROGRESS: Extracting batch of 7913 precursors
0:36:08.842315 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:36:08.842376 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:36:08.842417 INFO: FWHM in RT is 14.05 seconds, sigma is 0.51
0:36:08.842448 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:36:08.842678 INFO: Starting candidate selection
0:36:12.425879 INFO: Starting candidate scoring
0:36:13.763288 INFO: Finished candidate processing
0:36:13.763384 INFO: Collecting candidate features
0:36:15.955318 WARNING: intensity_correlation has 7 NaNs ( 0.10 % out of 7272)
0:36:15.962168 INFO: Collecting fragment features
0:36:16.582515 INFO: Finished candidate scoring
0:36:16.866953 PROGRESS: === Epoch 8, step 2, extracted 7272 precursors and 32968 fragments ===
0:36:16.867247 INFO: performing precursor FDR with 47 features
0:36:16.867294 INFO: Decoy channel: -1
0:36:16.867321 INFO: Competetive: True
0:36:16.882189 WARNING: dropped 10 target PSMs due to missing features
0:36:16.882309 WARNING: dropped 2 decoy PSMs due to missing features
0:36:17.963066 INFO: Test AUC: 0.532
0:36:17.963199 INFO: Train AUC: 0.580
0:36:17.963245 INFO: AUC difference: 8.15%
0:36:17.963279 WARNING: AUC difference > 5%. This may indicate overfitting.
0:36:18.087387 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
0:36:18.088217 PROGRESS: ============================= Precursor FDR =============================
0:36:18.088336 PROGRESS: Total precursors accumulated: 67
0:36:18.088414 PROGRESS: Target precursors: 61 (91.04%)
0:36:18.088481 PROGRESS: Decoy precursors: 6 (8.96%)
0:36:18.088543 PROGRESS: 
0:36:18.088603 PROGRESS: Precursor Summary:
0:36:18.090060 PROGRESS: Channel   0:	 0.05 FDR:    40; 0.01 FDR:    34; 0.001 FDR:    34
0:36:18.090175 PROGRESS: 
0:36:18.090249 PROGRESS: Protein Summary:
0:36:18.091878 PROGRESS: Channel   0:	 0.05 FDR:    39; 0.01 FDR:    33; 0.001 FDR:    33
0:36:18.091989 PROGRESS: =========================================================================
0:36:18.092852 PROGRESS: === Epoch 8, step 3, extracting elution groups 7000 to 15000 ===
0:36:18.184391 PROGRESS: Extracting batch of 15801 precursors
0:36:18.189707 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:36:18.189766 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:36:18.189829 INFO: FWHM in RT is 14.05 seconds, sigma is 0.51
0:36:18.189855 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:36:18.190098 INFO: Starting candidate selection
0:36:22.003520 INFO: Starting candidate scoring
0:36:23.453108 INFO: Finished candidate processing
0:36:23.453261 INFO: Collecting candidate features
0:36:25.678200 WARNING: intensity_correlation has 9 NaNs ( 0.06 % out of 14591)
0:36:25.684206 INFO: Collecting fragment features
0:36:26.318900 INFO: Finished candidate scoring
0:36:26.611863 PROGRESS: === Epoch 8, step 3, extracted 14591 precursors and 66455 fragments ===
0:36:26.612183 INFO: performing precursor FDR with 47 features
0:36:26.612229 INFO: Decoy channel: -1
0:36:26.612256 INFO: Competetive: True
0:36:26.640637 WARNING: dropped 15 target PSMs due to missing features
0:36:26.640757 WARNING: dropped 6 decoy PSMs due to missing features
0:36:27.399516 INFO: Test AUC: 0.541
0:36:27.399662 INFO: Train AUC: 0.596
0:36:27.406502 INFO: AUC difference: 9.11%
0:36:27.406537 WARNING: AUC difference > 5%. This may indicate overfitting.
0:36:27.532166 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
0:36:27.533122 PROGRESS: ============================= Precursor FDR =============================
0:36:27.533248 PROGRESS: Total precursors accumulated: 300
0:36:27.533327 PROGRESS: Target precursors: 273 (91.00%)
0:36:27.533396 PROGRESS: Decoy precursors: 27 (9.00%)
0:36:27.533458 PROGRESS: 
0:36:27.533519 PROGRESS: Precursor Summary:
0:36:27.535064 PROGRESS: Channel   0:	 0.05 FDR:   133; 0.01 FDR:   106; 0.001 FDR:   104
0:36:27.535182 PROGRESS: 
0:36:27.535256 PROGRESS: Protein Summary:
0:36:27.537029 PROGRESS: Channel   0:	 0.05 FDR:   130; 0.01 FDR:   104; 0.001 FDR:   102
0:36:27.537143 PROGRESS: =========================================================================
0:36:27.538076 PROGRESS: === Epoch 8, step 4, extracting elution groups 15000 to 31000 ===
0:36:27.646640 PROGRESS: Extracting batch of 31664 precursors
0:36:27.656945 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:36:27.657058 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:36:27.657097 INFO: FWHM in RT is 14.05 seconds, sigma is 0.51
0:36:27.657125 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:36:27.657365 INFO: Starting candidate selection
0:36:31.782674 INFO: Starting candidate scoring
0:36:33.364699 INFO: Finished candidate processing
0:36:33.364797 INFO: Collecting candidate features
0:36:35.628250 WARNING: intensity_correlation has 26 NaNs ( 0.09 % out of 29183)
0:36:35.635193 INFO: Collecting fragment features
0:36:36.274551 INFO: Finished candidate scoring
0:36:36.581139 PROGRESS: === Epoch 8, step 4, extracted 29183 precursors and 133049 fragments ===
0:36:36.581462 INFO: performing precursor FDR with 47 features
0:36:36.581510 INFO: Decoy channel: -1
0:36:36.581537 INFO: Competetive: True
0:36:36.638231 WARNING: dropped 26 target PSMs due to missing features
0:36:36.638344 WARNING: dropped 21 decoy PSMs due to missing features
0:36:38.487313 INFO: Test AUC: 0.558
0:36:38.487456 INFO: Train AUC: 0.597
0:36:38.487499 INFO: AUC difference: 6.50%
0:36:38.487532 WARNING: AUC difference > 5%. This may indicate overfitting.
0:36:38.617662 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
0:36:38.618773 PROGRESS: ============================= Precursor FDR =============================
0:36:38.618911 PROGRESS: Total precursors accumulated: 676
0:36:38.619002 PROGRESS: Target precursors: 617 (91.27%)
0:36:38.619072 PROGRESS: Decoy precursors: 59 (8.73%)
0:36:38.619135 PROGRESS: 
0:36:38.619198 PROGRESS: Precursor Summary:
0:36:38.620823 PROGRESS: Channel   0:	 0.05 FDR:   354; 0.01 FDR:   139; 0.001 FDR:   127
0:36:38.620953 PROGRESS: 
0:36:38.621027 PROGRESS: Protein Summary:
0:36:38.622923 PROGRESS: Channel   0:	 0.05 FDR:   342; 0.01 FDR:   134; 0.001 FDR:   123
0:36:38.623034 PROGRESS: =========================================================================
0:36:38.623975 PROGRESS: === Epoch 8, step 5, extracting elution groups 31000 to 63000 ===
0:36:38.759862 PROGRESS: Extracting batch of 63227 precursors
0:36:38.779392 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:36:38.779496 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:36:38.779565 INFO: FWHM in RT is 14.05 seconds, sigma is 0.51
0:36:38.779594 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:36:38.779842 INFO: Starting candidate selection
0:36:43.509032 INFO: Starting candidate scoring
0:36:45.378536 INFO: Finished candidate processing
0:36:45.378630 INFO: Collecting candidate features
0:36:47.735819 WARNING: intensity_correlation has 47 NaNs ( 0.08 % out of 58260)
0:36:47.744944 INFO: Collecting fragment features
0:36:48.424491 INFO: Finished candidate scoring
0:36:48.773640 PROGRESS: === Epoch 8, step 5, extracted 58260 precursors and 266807 fragments ===
0:36:48.780927 INFO: performing precursor FDR with 47 features
0:36:48.781085 INFO: Decoy channel: -1
0:36:48.781175 INFO: Competetive: True
0:36:48.910462 WARNING: dropped 49 target PSMs due to missing features
0:36:48.910578 WARNING: dropped 45 decoy PSMs due to missing features
0:36:52.823892 INFO: Test AUC: 0.547
0:36:52.824014 INFO: Train AUC: 0.591
0:36:52.824075 INFO: AUC difference: 7.42%
0:36:52.824105 WARNING: AUC difference > 5%. This may indicate overfitting.
0:36:52.960967 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
0:36:52.962482 PROGRESS: ============================= Precursor FDR =============================
0:36:52.962617 PROGRESS: Total precursors accumulated: 1,735
0:36:52.962695 PROGRESS: Target precursors: 1,582 (91.18%)
0:36:52.962764 PROGRESS: Decoy precursors: 153 (8.82%)
0:36:52.962829 PROGRESS: 
0:36:52.962890 PROGRESS: Precursor Summary:
0:36:52.964752 PROGRESS: Channel   0:	 0.05 FDR:   821; 0.01 FDR:   336; 0.001 FDR:   232
0:36:52.964890 PROGRESS: 
0:36:52.964978 PROGRESS: Protein Summary:
0:36:52.967218 PROGRESS: Channel   0:	 0.05 FDR:   768; 0.01 FDR:   309; 0.001 FDR:   218
0:36:52.967348 PROGRESS: =========================================================================
0:36:52.968431 PROGRESS: === Epoch 8, step 6, extracting elution groups 63000 to 127000 ===
0:36:53.144837 PROGRESS: Extracting batch of 126433 precursors
0:36:53.183342 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:36:53.183457 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:36:53.183493 INFO: FWHM in RT is 14.05 seconds, sigma is 0.51
0:36:53.183535 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:36:53.183790 INFO: Starting candidate selection
0:36:59.138479 INFO: Starting candidate scoring
0:37:01.595788 INFO: Finished candidate processing
0:37:01.595974 INFO: Collecting candidate features
0:37:04.119891 WARNING: intensity_correlation has 104 NaNs ( 0.09 % out of 116701)
0:37:04.132572 INFO: Collecting fragment features
0:37:04.860030 INFO: Finished candidate scoring
0:37:05.279620 PROGRESS: === Epoch 8, step 6, extracted 116701 precursors and 534061 fragments ===
0:37:05.279965 INFO: performing precursor FDR with 47 features
0:37:05.280029 INFO: Decoy channel: -1
0:37:05.280077 INFO: Competetive: True
0:37:05.544132 WARNING: dropped 103 target PSMs due to missing features
0:37:05.544244 WARNING: dropped 95 decoy PSMs due to missing features
0:37:13.914357 INFO: Test AUC: 0.546
0:37:13.914502 INFO: Train AUC: 0.582
0:37:13.914544 INFO: AUC difference: 6.19%
0:37:13.914572 WARNING: AUC difference > 5%. This may indicate overfitting.
0:37:14.090425 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
0:37:14.092157 PROGRESS: ============================= Precursor FDR =============================
0:37:14.092308 PROGRESS: Total precursors accumulated: 2,577
0:37:14.092386 PROGRESS: Target precursors: 2,346 (91.04%)
0:37:14.092454 PROGRESS: Decoy precursors: 231 (8.96%)
0:37:14.092523 PROGRESS: 
0:37:14.092584 PROGRESS: Precursor Summary:
0:37:14.094764 PROGRESS: Channel   0:	 0.05 FDR: 1,476; 0.01 FDR:   810; 0.001 FDR:   479
0:37:14.094889 PROGRESS: 
0:37:14.094965 PROGRESS: Protein Summary:
0:37:14.097660 PROGRESS: Channel   0:	 0.05 FDR: 1,320; 0.01 FDR:   715; 0.001 FDR:   429
0:37:14.097799 PROGRESS: =========================================================================
0:37:14.099156 PROGRESS: === Epoch 8, step 7, extracting elution groups 127000 to 255000 ===
0:37:14.322967 PROGRESS: Extracting batch of 252934 precursors
0:37:14.396152 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:37:14.396267 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:37:14.396305 INFO: FWHM in RT is 14.05 seconds, sigma is 0.51
0:37:14.396349 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:37:14.396620 INFO: Starting candidate selection
0:37:22.987380 INFO: Starting candidate scoring
0:37:26.653665 INFO: Finished candidate processing
0:37:26.653899 INFO: Collecting candidate features
0:37:29.602494 WARNING: intensity_correlation has 201 NaNs ( 0.09 % out of 233334)
0:37:29.622814 INFO: Collecting fragment features
0:37:30.479691 INFO: Finished candidate scoring
0:37:31.057196 PROGRESS: === Epoch 8, step 7, extracted 233334 precursors and 1067205 fragments ===
0:37:31.057522 INFO: performing precursor FDR with 47 features
0:37:31.057570 INFO: Decoy channel: -1
0:37:31.057596 INFO: Competetive: True
0:37:31.647925 WARNING: dropped 195 target PSMs due to missing features
0:37:31.648046 WARNING: dropped 204 decoy PSMs due to missing features
0:37:48.825651 INFO: Test AUC: 0.546
0:37:48.825812 INFO: Train AUC: 0.574
0:37:48.825857 INFO: AUC difference: 4.79%
0:37:49.010562 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
0:37:49.012810 PROGRESS: ============================= Precursor FDR =============================
0:37:49.012958 PROGRESS: Total precursors accumulated: 4,370
0:37:49.013037 PROGRESS: Target precursors: 3,976 (90.98%)
0:37:49.013106 PROGRESS: Decoy precursors: 394 (9.02%)
0:37:49.013169 PROGRESS: 
0:37:49.013229 PROGRESS: Precursor Summary:
0:37:49.015908 PROGRESS: Channel   0:	 0.05 FDR: 2,692; 0.01 FDR: 1,627; 0.001 FDR: 1,195
0:37:49.016027 PROGRESS: 
0:37:49.016096 PROGRESS: Protein Summary:
0:37:49.019665 PROGRESS: Channel   0:	 0.05 FDR: 2,239; 0.01 FDR: 1,320; 0.001 FDR:   978
0:37:49.019775 PROGRESS: =========================================================================
0:37:49.021483 PROGRESS: === Epoch 8, step 8, extracting elution groups 255000 to 511000 ===
0:37:49.323570 PROGRESS: Extracting batch of 505744 precursors
0:37:49.454014 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:37:49.454131 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:37:49.454172 INFO: FWHM in RT is 14.05 seconds, sigma is 0.51
0:37:49.454200 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:37:49.454461 INFO: Starting candidate selection
0:38:03.027779 INFO: Starting candidate scoring
0:38:09.236291 INFO: Finished candidate processing
0:38:09.236484 INFO: Collecting candidate features
0:38:12.977037 WARNING: intensity_correlation has 411 NaNs ( 0.09 % out of 465969)
0:38:13.010411 INFO: Collecting fragment features
0:38:14.076845 INFO: Finished candidate scoring
0:38:14.950296 PROGRESS: === Epoch 8, step 8, extracted 465969 precursors and 2129582 fragments ===
0:38:14.950638 INFO: performing precursor FDR with 47 features
0:38:14.950684 INFO: Decoy channel: -1
0:38:14.950711 INFO: Competetive: True
0:38:16.091830 WARNING: dropped 408 target PSMs due to missing features
0:38:16.091956 WARNING: dropped 402 decoy PSMs due to missing features
0:38:50.764410 INFO: Test AUC: 0.547
0:38:50.764541 INFO: Train AUC: 0.568
0:38:50.764595 INFO: AUC difference: 3.55%
0:38:51.001065 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
0:38:51.003914 PROGRESS: ============================= Precursor FDR =============================
0:38:51.004077 PROGRESS: Total precursors accumulated: 6,565
0:38:51.004156 PROGRESS: Target precursors: 5,980 (91.09%)
0:38:51.004233 PROGRESS: Decoy precursors: 585 (8.91%)
0:38:51.004296 PROGRESS: 
0:38:51.004356 PROGRESS: Precursor Summary:
0:38:51.007709 PROGRESS: Channel   0:	 0.05 FDR: 4,587; 0.01 FDR: 2,948; 0.001 FDR: 1,558
0:38:51.007849 PROGRESS: 
0:38:51.007921 PROGRESS: Protein Summary:
0:38:51.012589 PROGRESS: Channel   0:	 0.05 FDR: 3,269; 0.01 FDR: 2,053; 0.001 FDR: 1,191
0:38:51.012700 PROGRESS: =========================================================================
0:38:51.016627 INFO: calibration group: precursor, fitting rt estimator 
0:38:51.373513 INFO: calibration group: fragment, fitting mz estimator 
0:38:51.961690 INFO: === checking if epoch conditions were reached ===
0:38:51.961878 INFO: ✅ ms2_error      : 7.0000 <= 7
0:38:51.961966 INFO: ❌ rt_error       : 200.8668 > 100
0:38:51.962037 INFO: ✅ current_epoch  : 8 >= 3
0:38:51.962100 INFO: ==============================================
0:38:52.178742 INFO: calibration group: precursor, predicting mz
0:38:52.179034 WARNING: mz prediction was skipped as it has not been fitted yet
0:38:52.179079 INFO: calibration group: precursor, predicting rt
0:38:58.962698 INFO: calibration group: fragment, predicting mz
0:39:16.873988 PROGRESS: === Epoch 9, step 0, extracting elution groups 0 to 1000 ===
0:39:16.972755 PROGRESS: Extracting batch of 1980 precursors
0:39:16.974478 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:39:16.974572 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:39:16.974613 INFO: FWHM in RT is 14.17 seconds, sigma is 0.52
0:39:16.974643 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:39:16.974891 INFO: Starting candidate selection
0:39:20.893447 INFO: Starting candidate scoring
0:39:22.205298 INFO: Finished candidate processing
0:39:22.205393 INFO: Collecting candidate features
0:39:24.349836 WARNING: intensity_correlation has 3 NaNs ( 0.16 % out of 1836)
0:39:24.355739 INFO: Collecting fragment features
0:39:24.986125 INFO: Finished candidate scoring
0:39:25.323890 PROGRESS: === Epoch 9, step 0, extracted 1836 precursors and 8439 fragments ===
0:39:25.324214 INFO: performing precursor FDR with 47 features
0:39:25.324259 INFO: Decoy channel: -1
0:39:25.324285 INFO: Competetive: True
0:39:25.328913 WARNING: dropped 2 target PSMs due to missing features
0:39:25.328987 WARNING: dropped 1 decoy PSMs due to missing features
0:39:25.356555 INFO: Test AUC: 0.566
0:39:25.356652 INFO: Train AUC: 0.556
0:39:25.356700 INFO: AUC difference: 1.65%
0:39:25.480656 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
0:39:25.481639 PROGRESS: ============================= Precursor FDR =============================
0:39:25.481779 PROGRESS: Total precursors accumulated: 5
0:39:25.481882 PROGRESS: Target precursors: 5 (100.00%)
0:39:25.481950 PROGRESS: Decoy precursors: 0 (0.00%)
0:39:25.482013 PROGRESS: 
0:39:25.482074 PROGRESS: Precursor Summary:
0:39:25.483542 PROGRESS: Channel   0:	 0.05 FDR:     5; 0.01 FDR:     5; 0.001 FDR:     5
0:39:25.483648 PROGRESS: 
0:39:25.483719 PROGRESS: Protein Summary:
0:39:25.485358 PROGRESS: Channel   0:	 0.05 FDR:     5; 0.01 FDR:     5; 0.001 FDR:     5
0:39:25.485464 PROGRESS: =========================================================================
0:39:25.486360 PROGRESS: === Epoch 9, step 1, extracting elution groups 1000 to 3000 ===
0:39:25.563125 PROGRESS: Extracting batch of 3957 precursors
0:39:25.565181 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:39:25.565240 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:39:25.565279 INFO: FWHM in RT is 14.17 seconds, sigma is 0.52
0:39:25.565325 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:39:25.565534 INFO: Starting candidate selection
0:39:29.107704 INFO: Starting candidate scoring
0:39:30.422707 INFO: Finished candidate processing
0:39:30.422805 INFO: Collecting candidate features
0:39:32.612821 WARNING: intensity_correlation has 5 NaNs ( 0.14 % out of 3662)
0:39:32.619011 INFO: Collecting fragment features
0:39:33.264562 INFO: Finished candidate scoring
0:39:33.543511 PROGRESS: === Epoch 9, step 1, extracted 3662 precursors and 16555 fragments ===
0:39:33.543786 INFO: performing precursor FDR with 47 features
0:39:33.543828 INFO: Decoy channel: -1
0:39:33.543855 INFO: Competetive: True
0:39:33.552310 WARNING: dropped 5 target PSMs due to missing features
0:39:33.552409 WARNING: dropped 3 decoy PSMs due to missing features
0:39:33.589383 INFO: Test AUC: 0.542
0:39:33.589505 INFO: Train AUC: 0.561
0:39:33.589550 INFO: AUC difference: 3.28%
0:39:33.711727 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
0:39:33.712518 PROGRESS: ============================= Precursor FDR =============================
0:39:33.712642 PROGRESS: Total precursors accumulated: 19
0:39:33.712721 PROGRESS: Target precursors: 18 (94.74%)
0:39:33.712788 PROGRESS: Decoy precursors: 1 (5.26%)
0:39:33.712863 PROGRESS: 
0:39:33.712924 PROGRESS: Precursor Summary:
0:39:33.714365 PROGRESS: Channel   0:	 0.05 FDR:    16; 0.01 FDR:    16; 0.001 FDR:    16
0:39:33.714480 PROGRESS: 
0:39:33.714554 PROGRESS: Protein Summary:
0:39:33.716169 PROGRESS: Channel   0:	 0.05 FDR:    16; 0.01 FDR:    16; 0.001 FDR:    16
0:39:33.716280 PROGRESS: =========================================================================
0:39:33.717136 PROGRESS: === Epoch 9, step 2, extracting elution groups 3000 to 7000 ===
0:39:33.798965 PROGRESS: Extracting batch of 7913 precursors
0:39:33.802191 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:39:33.802256 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:39:33.802297 INFO: FWHM in RT is 14.17 seconds, sigma is 0.52
0:39:33.802328 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:39:33.802552 INFO: Starting candidate selection
0:39:37.450025 INFO: Starting candidate scoring
0:39:38.808672 INFO: Finished candidate processing
0:39:38.808764 INFO: Collecting candidate features
0:39:40.978025 WARNING: intensity_correlation has 10 NaNs ( 0.14 % out of 7343)
0:39:40.983570 INFO: Collecting fragment features
0:39:41.627316 INFO: Finished candidate scoring
0:39:41.909271 PROGRESS: === Epoch 9, step 2, extracted 7343 precursors and 33740 fragments ===
0:39:41.909570 INFO: performing precursor FDR with 47 features
0:39:41.909615 INFO: Decoy channel: -1
0:39:41.909640 INFO: Competetive: True
0:39:41.924346 WARNING: dropped 8 target PSMs due to missing features
0:39:41.924465 WARNING: dropped 10 decoy PSMs due to missing features
0:39:42.174345 INFO: Test AUC: 0.536
0:39:42.174477 INFO: Train AUC: 0.581
0:39:42.174522 INFO: AUC difference: 7.86%
0:39:42.174556 WARNING: AUC difference > 5%. This may indicate overfitting.
0:39:42.293936 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
0:39:42.294772 PROGRESS: ============================= Precursor FDR =============================
0:39:42.294894 PROGRESS: Total precursors accumulated: 84
0:39:42.294971 PROGRESS: Target precursors: 77 (91.67%)
0:39:42.295040 PROGRESS: Decoy precursors: 7 (8.33%)
0:39:42.295104 PROGRESS: 
0:39:42.295165 PROGRESS: Precursor Summary:
0:39:42.296610 PROGRESS: Channel   0:	 0.05 FDR:    48; 0.01 FDR:    36; 0.001 FDR:    36
0:39:42.296721 PROGRESS: 
0:39:42.296794 PROGRESS: Protein Summary:
0:39:42.298454 PROGRESS: Channel   0:	 0.05 FDR:    48; 0.01 FDR:    36; 0.001 FDR:    36
0:39:42.298576 PROGRESS: =========================================================================
0:39:42.299442 PROGRESS: === Epoch 9, step 3, extracting elution groups 7000 to 15000 ===
0:39:42.391116 PROGRESS: Extracting batch of 15796 precursors
0:39:42.396483 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:39:42.396550 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:39:42.396583 INFO: FWHM in RT is 14.17 seconds, sigma is 0.52
0:39:42.396625 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:39:42.396842 INFO: Starting candidate selection
0:39:46.205327 INFO: Starting candidate scoring
0:39:47.646373 INFO: Finished candidate processing
0:39:47.646480 INFO: Collecting candidate features
0:39:49.871870 WARNING: intensity_correlation has 18 NaNs ( 0.12 % out of 14562)
0:39:49.877953 INFO: Collecting fragment features
0:39:50.539655 INFO: Finished candidate scoring
0:39:50.831865 PROGRESS: === Epoch 9, step 3, extracted 14562 precursors and 67234 fragments ===
0:39:50.832189 INFO: performing precursor FDR with 47 features
0:39:50.832235 INFO: Decoy channel: -1
0:39:50.832262 INFO: Competetive: True
0:39:50.860530 WARNING: dropped 22 target PSMs due to missing features
0:39:50.860657 WARNING: dropped 14 decoy PSMs due to missing features
0:39:51.615326 INFO: Test AUC: 0.551
0:39:51.615469 INFO: Train AUC: 0.594
0:39:51.615543 INFO: AUC difference: 7.34%
0:39:51.615592 WARNING: AUC difference > 5%. This may indicate overfitting.
0:39:51.741595 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
0:39:51.742528 PROGRESS: ============================= Precursor FDR =============================
0:39:51.742655 PROGRESS: Total precursors accumulated: 210
0:39:51.742733 PROGRESS: Target precursors: 192 (91.43%)
0:39:51.742801 PROGRESS: Decoy precursors: 18 (8.57%)
0:39:51.742864 PROGRESS: 
0:39:51.742925 PROGRESS: Precursor Summary:
0:39:51.744413 PROGRESS: Channel   0:	 0.05 FDR:   152; 0.01 FDR:    62; 0.001 FDR:    62
0:39:51.744542 PROGRESS: 
0:39:51.744614 PROGRESS: Protein Summary:
0:39:51.746340 PROGRESS: Channel   0:	 0.05 FDR:   152; 0.01 FDR:    62; 0.001 FDR:    62
0:39:51.746452 PROGRESS: =========================================================================
0:39:51.747331 PROGRESS: === Epoch 9, step 4, extracting elution groups 15000 to 31000 ===
0:39:51.855122 PROGRESS: Extracting batch of 31634 precursors
0:39:51.865493 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:39:51.865603 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:39:51.865642 INFO: FWHM in RT is 14.17 seconds, sigma is 0.52
0:39:51.865669 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:39:51.865915 INFO: Starting candidate selection
0:39:55.960292 INFO: Starting candidate scoring
0:39:57.525430 INFO: Finished candidate processing
0:39:57.525525 INFO: Collecting candidate features
0:39:59.795233 WARNING: intensity_correlation has 31 NaNs ( 0.11 % out of 29140)
0:39:59.803358 INFO: Collecting fragment features
0:40:00.484035 INFO: Finished candidate scoring
0:40:00.793900 PROGRESS: === Epoch 9, step 4, extracted 29140 precursors and 133066 fragments ===
0:40:00.794231 INFO: performing precursor FDR with 47 features
0:40:00.794279 INFO: Decoy channel: -1
0:40:00.794304 INFO: Competetive: True
0:40:00.854638 WARNING: dropped 36 target PSMs due to missing features
0:40:00.854751 WARNING: dropped 31 decoy PSMs due to missing features
0:40:02.706722 INFO: Test AUC: 0.546
0:40:02.706872 INFO: Train AUC: 0.598
0:40:02.706918 INFO: AUC difference: 8.70%
0:40:02.706950 WARNING: AUC difference > 5%. This may indicate overfitting.
0:40:02.834839 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
0:40:02.835984 PROGRESS: ============================= Precursor FDR =============================
0:40:02.836110 PROGRESS: Total precursors accumulated: 869
0:40:02.836188 PROGRESS: Target precursors: 796 (91.60%)
0:40:02.836256 PROGRESS: Decoy precursors: 73 (8.40%)
0:40:02.836319 PROGRESS: 
0:40:02.836380 PROGRESS: Precursor Summary:
0:40:02.838049 PROGRESS: Channel   0:	 0.05 FDR:   357; 0.01 FDR:   192; 0.001 FDR:   146
0:40:02.838166 PROGRESS: 
0:40:02.838239 PROGRESS: Protein Summary:
0:40:02.840143 PROGRESS: Channel   0:	 0.05 FDR:   350; 0.01 FDR:   187; 0.001 FDR:   144
0:40:02.840253 PROGRESS: =========================================================================
0:40:02.841223 PROGRESS: === Epoch 9, step 5, extracting elution groups 31000 to 63000 ===
0:40:02.977144 PROGRESS: Extracting batch of 63286 precursors
0:40:02.996458 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:40:02.996563 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:40:02.996599 INFO: FWHM in RT is 14.17 seconds, sigma is 0.52
0:40:02.996642 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:40:02.996885 INFO: Starting candidate selection
0:40:07.703386 INFO: Starting candidate scoring
0:40:09.554288 INFO: Finished candidate processing
0:40:09.554374 INFO: Collecting candidate features
0:40:11.885865 WARNING: intensity_correlation has 47 NaNs ( 0.08 % out of 58194)
0:40:11.894586 INFO: Collecting fragment features
0:40:12.596018 INFO: Finished candidate scoring
0:40:12.939200 PROGRESS: === Epoch 9, step 5, extracted 58194 precursors and 265813 fragments ===
0:40:12.939516 INFO: performing precursor FDR with 47 features
0:40:12.939564 INFO: Decoy channel: -1
0:40:12.939590 INFO: Competetive: True
0:40:13.065836 WARNING: dropped 60 target PSMs due to missing features
0:40:13.065966 WARNING: dropped 54 decoy PSMs due to missing features
0:40:16.875036 INFO: Test AUC: 0.551
0:40:16.875162 INFO: Train AUC: 0.593
0:40:16.875208 INFO: AUC difference: 7.11%
0:40:16.875238 WARNING: AUC difference > 5%. This may indicate overfitting.
0:40:17.030746 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
0:40:17.032185 PROGRESS: ============================= Precursor FDR =============================
0:40:17.032357 PROGRESS: Total precursors accumulated: 1,581
0:40:17.032436 PROGRESS: Target precursors: 1,441 (91.14%)
0:40:17.032504 PROGRESS: Decoy precursors: 140 (8.86%)
0:40:17.032568 PROGRESS: 
0:40:17.032642 PROGRESS: Precursor Summary:
0:40:17.034549 PROGRESS: Channel   0:	 0.05 FDR:   747; 0.01 FDR:   478; 0.001 FDR:   416
0:40:17.034669 PROGRESS: 
0:40:17.034742 PROGRESS: Protein Summary:
0:40:17.037021 PROGRESS: Channel   0:	 0.05 FDR:   719; 0.01 FDR:   453; 0.001 FDR:   391
0:40:17.037151 PROGRESS: =========================================================================
0:40:17.038316 PROGRESS: === Epoch 9, step 6, extracting elution groups 63000 to 127000 ===
0:40:17.214321 PROGRESS: Extracting batch of 126370 precursors
0:40:17.252656 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:40:17.252769 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:40:17.252806 INFO: FWHM in RT is 14.17 seconds, sigma is 0.52
0:40:17.252850 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:40:17.253107 INFO: Starting candidate selection
0:40:23.289349 INFO: Starting candidate scoring
0:40:25.756589 INFO: Finished candidate processing
0:40:25.756774 INFO: Collecting candidate features
0:40:28.295554 WARNING: intensity_correlation has 113 NaNs ( 0.10 % out of 116292)
0:40:28.308470 INFO: Collecting fragment features
0:40:29.075858 INFO: Finished candidate scoring
0:40:29.497226 PROGRESS: === Epoch 9, step 6, extracted 116292 precursors and 532023 fragments ===
0:40:29.497547 INFO: performing precursor FDR with 47 features
0:40:29.497598 INFO: Decoy channel: -1
0:40:29.497627 INFO: Competetive: True
0:40:29.767469 WARNING: dropped 114 target PSMs due to missing features
0:40:29.767581 WARNING: dropped 113 decoy PSMs due to missing features
0:40:37.655991 INFO: Test AUC: 0.554
0:40:37.656118 INFO: Train AUC: 0.583
0:40:37.656177 INFO: AUC difference: 5.02%
0:40:37.656206 WARNING: AUC difference > 5%. This may indicate overfitting.
0:40:37.809010 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
0:40:37.810853 PROGRESS: ============================= Precursor FDR =============================
0:40:37.811014 PROGRESS: Total precursors accumulated: 2,902
0:40:37.811093 PROGRESS: Target precursors: 2,642 (91.04%)
0:40:37.811161 PROGRESS: Decoy precursors: 260 (8.96%)
0:40:37.811224 PROGRESS: 
0:40:37.811285 PROGRESS: Precursor Summary:
0:40:37.813400 PROGRESS: Channel   0:	 0.05 FDR: 1,368; 0.01 FDR:   808; 0.001 FDR:   385
0:40:37.813522 PROGRESS: 
0:40:37.813597 PROGRESS: Protein Summary:
0:40:37.816269 PROGRESS: Channel   0:	 0.05 FDR: 1,245; 0.01 FDR:   727; 0.001 FDR:   358
0:40:37.816411 PROGRESS: =========================================================================
0:40:37.817767 PROGRESS: === Epoch 9, step 7, extracting elution groups 127000 to 255000 ===
0:40:38.043928 PROGRESS: Extracting batch of 252912 precursors
0:40:38.116470 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:40:38.116585 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:40:38.116652 INFO: FWHM in RT is 14.17 seconds, sigma is 0.52
0:40:38.116682 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:40:38.116946 INFO: Starting candidate selection
0:40:47.578816 INFO: Starting candidate scoring
0:40:51.222143 INFO: Finished candidate processing
0:40:51.222331 INFO: Collecting candidate features
0:40:54.168382 WARNING: intensity_correlation has 214 NaNs ( 0.09 % out of 232732)
0:40:54.188766 INFO: Collecting fragment features
0:40:55.022752 INFO: Finished candidate scoring
0:40:55.599670 PROGRESS: === Epoch 9, step 7, extracted 232732 precursors and 1064229 fragments ===
0:40:55.600000 INFO: performing precursor FDR with 47 features
0:40:55.600046 INFO: Decoy channel: -1
0:40:55.600072 INFO: Competetive: True
0:40:56.185979 WARNING: dropped 223 target PSMs due to missing features
0:40:56.186105 WARNING: dropped 218 decoy PSMs due to missing features
0:41:13.082408 INFO: Test AUC: 0.545
0:41:13.082538 INFO: Train AUC: 0.576
0:41:13.082597 INFO: AUC difference: 5.26%
0:41:13.082636 WARNING: AUC difference > 5%. This may indicate overfitting.
0:41:13.266583 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
0:41:13.268851 PROGRESS: ============================= Precursor FDR =============================
0:41:13.269011 PROGRESS: Total precursors accumulated: 4,205
0:41:13.269091 PROGRESS: Target precursors: 3,837 (91.25%)
0:41:13.269158 PROGRESS: Decoy precursors: 368 (8.75%)
0:41:13.269220 PROGRESS: 
0:41:13.269281 PROGRESS: Precursor Summary:
0:41:13.271917 PROGRESS: Channel   0:	 0.05 FDR: 2,826; 0.01 FDR: 1,528; 0.001 FDR:   661
0:41:13.272061 PROGRESS: 
0:41:13.272134 PROGRESS: Protein Summary:
0:41:13.275669 PROGRESS: Channel   0:	 0.05 FDR: 2,363; 0.01 FDR: 1,253; 0.001 FDR:   575
0:41:13.275805 PROGRESS: =========================================================================
0:41:13.277532 PROGRESS: === Epoch 9, step 8, extracting elution groups 255000 to 511000 ===
0:41:13.585190 PROGRESS: Extracting batch of 505859 precursors
0:41:13.718846 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:41:13.718963 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:41:13.719006 INFO: FWHM in RT is 14.17 seconds, sigma is 0.52
0:41:13.719054 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:41:13.719325 INFO: Starting candidate selection
0:41:27.316928 INFO: Starting candidate scoring
0:41:33.404543 INFO: Finished candidate processing
0:41:33.404737 INFO: Collecting candidate features
0:41:37.008855 WARNING: intensity_correlation has 430 NaNs ( 0.09 % out of 465339)
0:41:37.041576 INFO: Collecting fragment features
0:41:38.047543 INFO: Finished candidate scoring
0:41:38.914884 PROGRESS: === Epoch 9, step 8, extracted 465339 precursors and 2128186 fragments ===
0:41:38.922081 INFO: performing precursor FDR with 47 features
0:41:38.922230 INFO: Decoy channel: -1
0:41:38.922329 INFO: Competetive: True
0:41:40.010499 WARNING: dropped 439 target PSMs due to missing features
0:41:40.010646 WARNING: dropped 432 decoy PSMs due to missing features
0:42:14.794083 INFO: Test AUC: 0.548
0:42:14.794232 INFO: Train AUC: 0.569
0:42:14.794274 INFO: AUC difference: 3.69%
0:42:15.039948 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
0:42:15.042939 PROGRESS: ============================= Precursor FDR =============================
0:42:15.043093 PROGRESS: Total precursors accumulated: 6,325
0:42:15.043168 PROGRESS: Target precursors: 5,773 (91.27%)
0:42:15.043268 PROGRESS: Decoy precursors: 552 (8.73%)
0:42:15.043403 PROGRESS: 
0:42:15.043494 PROGRESS: Precursor Summary:
0:42:15.047369 PROGRESS: Channel   0:	 0.05 FDR: 4,709; 0.01 FDR: 3,367; 0.001 FDR: 2,303
0:42:15.047511 PROGRESS: 
0:42:15.047585 PROGRESS: Protein Summary:
0:42:15.052987 PROGRESS: Channel   0:	 0.05 FDR: 3,375; 0.01 FDR: 2,354; 0.001 FDR: 1,674
0:42:15.053124 PROGRESS: =========================================================================
0:42:15.057596 INFO: calibration group: precursor, fitting rt estimator 
0:42:15.467688 INFO: calibration group: fragment, fitting mz estimator 
0:42:16.054013 INFO: === checking if epoch conditions were reached ===
0:42:16.054255 INFO: ✅ ms2_error      : 7.0000 <= 7
0:42:16.054430 INFO: ❌ rt_error       : 199.4727 > 100
0:42:16.054564 INFO: ✅ current_epoch  : 9 >= 3
0:42:16.054651 INFO: ==============================================
0:42:16.301541 INFO: calibration group: precursor, predicting mz
0:42:16.301820 WARNING: mz prediction was skipped as it has not been fitted yet
0:42:16.301862 INFO: calibration group: precursor, predicting rt
0:42:23.144423 INFO: calibration group: fragment, predicting mz
0:42:41.086358 PROGRESS: === Epoch 10, step 0, extracting elution groups 0 to 1000 ===
0:42:41.185288 PROGRESS: Extracting batch of 1974 precursors
0:42:41.187242 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:42:41.187323 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:42:41.187363 INFO: FWHM in RT is 13.96 seconds, sigma is 0.51
0:42:41.187393 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:42:41.187713 INFO: Starting candidate selection
0:42:45.125680 INFO: Starting candidate scoring
0:42:46.432977 INFO: Finished candidate processing
0:42:46.433078 INFO: Collecting candidate features
0:42:48.611996 INFO: Collecting fragment features
0:42:49.249932 INFO: Finished candidate scoring
0:42:49.591025 PROGRESS: === Epoch 10, step 0, extracted 1826 precursors and 8426 fragments ===
0:42:49.591345 INFO: performing precursor FDR with 47 features
0:42:49.591391 INFO: Decoy channel: -1
0:42:49.591418 INFO: Competetive: True
0:42:49.624820 INFO: Test AUC: 0.529
0:42:49.624929 INFO: Train AUC: 0.560
0:42:49.624974 INFO: AUC difference: 5.43%
0:42:49.625008 WARNING: AUC difference > 5%. This may indicate overfitting.
0:42:49.744468 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
0:42:49.745247 PROGRESS: ============================= Precursor FDR =============================
0:42:49.745372 PROGRESS: Total precursors accumulated: 13
0:42:49.745452 PROGRESS: Target precursors: 12 (92.31%)
0:42:49.745520 PROGRESS: Decoy precursors: 1 (7.69%)
0:42:49.745582 PROGRESS: 
0:42:49.745644 PROGRESS: Precursor Summary:
0:42:49.747063 PROGRESS: Channel   0:	 0.05 FDR:    11; 0.01 FDR:    11; 0.001 FDR:    11
0:42:49.747179 PROGRESS: 
0:42:49.747255 PROGRESS: Protein Summary:
0:42:49.748846 PROGRESS: Channel   0:	 0.05 FDR:    11; 0.01 FDR:    11; 0.001 FDR:    11
0:42:49.748961 PROGRESS: =========================================================================
0:42:49.749818 PROGRESS: === Epoch 10, step 1, extracting elution groups 1000 to 3000 ===
0:42:49.827175 PROGRESS: Extracting batch of 3943 precursors
0:42:49.829381 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:42:49.829442 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:42:49.829479 INFO: FWHM in RT is 13.96 seconds, sigma is 0.51
0:42:49.829508 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:42:49.829743 INFO: Starting candidate selection
0:42:53.398471 INFO: Starting candidate scoring
0:42:54.719191 INFO: Finished candidate processing
0:42:54.719284 INFO: Collecting candidate features
0:42:56.906575 WARNING: intensity_correlation has 5 NaNs ( 0.14 % out of 3582)
0:42:56.912524 INFO: Collecting fragment features
0:42:57.539771 INFO: Finished candidate scoring
0:42:57.818552 PROGRESS: === Epoch 10, step 1, extracted 3582 precursors and 16432 fragments ===
0:42:57.818843 INFO: performing precursor FDR with 47 features
0:42:57.818889 INFO: Decoy channel: -1
0:42:57.818916 INFO: Competetive: True
0:42:57.827586 WARNING: dropped 3 target PSMs due to missing features
0:42:57.827679 WARNING: dropped 2 decoy PSMs due to missing features
0:42:57.864613 INFO: Test AUC: 0.559
0:42:57.864733 INFO: Train AUC: 0.545
0:42:57.864778 INFO: AUC difference: 2.53%
0:42:57.987139 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
0:42:57.987930 PROGRESS: ============================= Precursor FDR =============================
0:42:57.988073 PROGRESS: Total precursors accumulated: 41
0:42:57.988154 PROGRESS: Target precursors: 38 (92.68%)
0:42:57.988224 PROGRESS: Decoy precursors: 3 (7.32%)
0:42:57.988288 PROGRESS: 
0:42:57.988348 PROGRESS: Precursor Summary:
0:42:57.989795 PROGRESS: Channel   0:	 0.05 FDR:    31; 0.01 FDR:    31; 0.001 FDR:    31
0:42:57.989928 PROGRESS: 
0:42:57.990002 PROGRESS: Protein Summary:
0:42:57.991637 PROGRESS: Channel   0:	 0.05 FDR:    31; 0.01 FDR:    31; 0.001 FDR:    31
0:42:57.991750 PROGRESS: =========================================================================
0:42:57.992618 PROGRESS: === Epoch 10, step 2, extracting elution groups 3000 to 7000 ===
0:42:58.074835 PROGRESS: Extracting batch of 7895 precursors
0:42:58.078119 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:42:58.078184 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:42:58.078242 INFO: FWHM in RT is 13.96 seconds, sigma is 0.51
0:42:58.078273 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:42:58.078496 INFO: Starting candidate selection
0:43:01.727244 INFO: Starting candidate scoring
0:43:03.089260 INFO: Finished candidate processing
0:43:03.089463 INFO: Collecting candidate features
0:43:05.262779 WARNING: intensity_correlation has 3 NaNs ( 0.04 % out of 7207)
0:43:05.268414 INFO: Collecting fragment features
0:43:05.888668 INFO: Finished candidate scoring
0:43:06.169498 PROGRESS: === Epoch 10, step 2, extracted 7207 precursors and 33101 fragments ===
0:43:06.169793 INFO: performing precursor FDR with 47 features
0:43:06.169857 INFO: Decoy channel: -1
0:43:06.169884 INFO: Competetive: True
0:43:06.184762 WARNING: dropped 5 target PSMs due to missing features
0:43:06.184862 WARNING: dropped 3 decoy PSMs due to missing features
0:43:06.439025 INFO: Test AUC: 0.534
0:43:06.439157 INFO: Train AUC: 0.583
0:43:06.439202 INFO: AUC difference: 8.35%
0:43:06.439236 WARNING: AUC difference > 5%. This may indicate overfitting.
0:43:06.587670 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
0:43:06.588540 PROGRESS: ============================= Precursor FDR =============================
0:43:06.588665 PROGRESS: Total precursors accumulated: 93
0:43:06.588744 PROGRESS: Target precursors: 85 (91.40%)
0:43:06.588813 PROGRESS: Decoy precursors: 8 (8.60%)
0:43:06.588876 PROGRESS: 
0:43:06.588938 PROGRESS: Precursor Summary:
0:43:06.590434 PROGRESS: Channel   0:	 0.05 FDR:    67; 0.01 FDR:    36; 0.001 FDR:    36
0:43:06.590553 PROGRESS: 
0:43:06.590627 PROGRESS: Protein Summary:
0:43:06.592291 PROGRESS: Channel   0:	 0.05 FDR:    67; 0.01 FDR:    36; 0.001 FDR:    36
0:43:06.592408 PROGRESS: =========================================================================
0:43:06.593283 PROGRESS: === Epoch 10, step 3, extracting elution groups 7000 to 15000 ===
0:43:06.685449 PROGRESS: Extracting batch of 15805 precursors
0:43:06.690977 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:43:06.691063 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:43:06.691099 INFO: FWHM in RT is 13.96 seconds, sigma is 0.51
0:43:06.691126 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:43:06.691346 INFO: Starting candidate selection
0:43:10.522402 INFO: Starting candidate scoring
0:43:11.965425 INFO: Finished candidate processing
0:43:11.965518 INFO: Collecting candidate features
0:43:14.194430 WARNING: intensity_correlation has 8 NaNs ( 0.05 % out of 14570)
0:43:14.200564 INFO: Collecting fragment features
0:43:14.841184 INFO: Finished candidate scoring
0:43:15.134215 PROGRESS: === Epoch 10, step 3, extracted 14570 precursors and 66095 fragments ===
0:43:15.134518 INFO: performing precursor FDR with 47 features
0:43:15.134567 INFO: Decoy channel: -1
0:43:15.134593 INFO: Competetive: True
0:43:15.163298 WARNING: dropped 6 target PSMs due to missing features
0:43:15.163441 WARNING: dropped 10 decoy PSMs due to missing features
0:43:15.872653 INFO: Test AUC: 0.552
0:43:15.879612 INFO: Train AUC: 0.596
0:43:15.879710 INFO: AUC difference: 7.39%
0:43:15.879752 WARNING: AUC difference > 5%. This may indicate overfitting.
0:43:16.004736 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
0:43:16.005638 PROGRESS: ============================= Precursor FDR =============================
0:43:16.005760 PROGRESS: Total precursors accumulated: 178
0:43:16.005850 PROGRESS: Target precursors: 163 (91.57%)
0:43:16.005919 PROGRESS: Decoy precursors: 15 (8.43%)
0:43:16.005982 PROGRESS: 
0:43:16.006043 PROGRESS: Precursor Summary:
0:43:16.007542 PROGRESS: Channel   0:	 0.05 FDR:   125; 0.01 FDR:    83; 0.001 FDR:    83
0:43:16.007668 PROGRESS: 
0:43:16.007741 PROGRESS: Protein Summary:
0:43:16.009460 PROGRESS: Channel   0:	 0.05 FDR:   124; 0.01 FDR:    82; 0.001 FDR:    82
0:43:16.009584 PROGRESS: =========================================================================
0:43:16.010491 PROGRESS: === Epoch 10, step 4, extracting elution groups 15000 to 31000 ===
0:43:16.118265 PROGRESS: Extracting batch of 31608 precursors
0:43:16.128723 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:43:16.128835 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:43:16.128874 INFO: FWHM in RT is 13.96 seconds, sigma is 0.51
0:43:16.128901 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:43:16.129140 INFO: Starting candidate selection
0:43:20.262732 INFO: Starting candidate scoring
0:43:21.847373 INFO: Finished candidate processing
0:43:21.847465 INFO: Collecting candidate features
0:43:24.127138 WARNING: intensity_correlation has 16 NaNs ( 0.06 % out of 28980)
0:43:24.134702 INFO: Collecting fragment features
0:43:24.793402 INFO: Finished candidate scoring
0:43:25.103639 PROGRESS: === Epoch 10, step 4, extracted 28980 precursors and 132897 fragments ===
0:43:25.103958 INFO: performing precursor FDR with 47 features
0:43:25.104006 INFO: Decoy channel: -1
0:43:25.104032 INFO: Competetive: True
0:43:25.161717 WARNING: dropped 13 target PSMs due to missing features
0:43:25.161852 WARNING: dropped 19 decoy PSMs due to missing features
0:43:26.729052 INFO: Test AUC: 0.559
0:43:26.729202 INFO: Train AUC: 0.602
0:43:26.729250 INFO: AUC difference: 7.07%
0:43:26.729285 WARNING: AUC difference > 5%. This may indicate overfitting.
0:43:26.858135 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
0:43:26.859235 PROGRESS: ============================= Precursor FDR =============================
0:43:26.859365 PROGRESS: Total precursors accumulated: 715
0:43:26.859443 PROGRESS: Target precursors: 652 (91.19%)
0:43:26.859512 PROGRESS: Decoy precursors: 63 (8.81%)
0:43:26.859575 PROGRESS: 
0:43:26.859638 PROGRESS: Precursor Summary:
0:43:26.861296 PROGRESS: Channel   0:	 0.05 FDR:   322; 0.01 FDR:   190; 0.001 FDR:   178
0:43:26.861413 PROGRESS: 
0:43:26.861488 PROGRESS: Protein Summary:
0:43:26.863441 PROGRESS: Channel   0:	 0.05 FDR:   314; 0.01 FDR:   184; 0.001 FDR:   172
0:43:26.863559 PROGRESS: =========================================================================
0:43:26.864548 PROGRESS: === Epoch 10, step 5, extracting elution groups 31000 to 63000 ===
0:43:27.002427 PROGRESS: Extracting batch of 63208 precursors
0:43:27.022194 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:43:27.022321 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:43:27.022362 INFO: FWHM in RT is 13.96 seconds, sigma is 0.51
0:43:27.022389 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:43:27.022642 INFO: Starting candidate selection
0:43:31.801380 INFO: Starting candidate scoring
0:43:33.686165 INFO: Finished candidate processing
0:43:33.686259 INFO: Collecting candidate features
0:43:36.049510 WARNING: intensity_correlation has 36 NaNs ( 0.06 % out of 57957)
0:43:36.059732 INFO: Collecting fragment features
0:43:36.750519 INFO: Finished candidate scoring
0:43:37.096066 PROGRESS: === Epoch 10, step 5, extracted 57957 precursors and 264879 fragments ===
0:43:37.096387 INFO: performing precursor FDR with 47 features
0:43:37.096433 INFO: Decoy channel: -1
0:43:37.096470 INFO: Competetive: True
0:43:37.225920 WARNING: dropped 28 target PSMs due to missing features
0:43:37.226054 WARNING: dropped 40 decoy PSMs due to missing features
0:43:41.106647 INFO: Test AUC: 0.555
0:43:41.106788 INFO: Train AUC: 0.602
0:43:41.106828 INFO: AUC difference: 7.88%
0:43:41.106856 WARNING: AUC difference > 5%. This may indicate overfitting.
0:43:41.245543 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
0:43:41.246956 PROGRESS: ============================= Precursor FDR =============================
0:43:41.247132 PROGRESS: Total precursors accumulated: 1,427
0:43:41.247215 PROGRESS: Target precursors: 1,300 (91.10%)
0:43:41.247285 PROGRESS: Decoy precursors: 127 (8.90%)
0:43:41.247349 PROGRESS: 
0:43:41.247411 PROGRESS: Precursor Summary:
0:43:41.249283 PROGRESS: Channel   0:	 0.05 FDR:   739; 0.01 FDR:   377; 0.001 FDR:   306
0:43:41.249417 PROGRESS: 
0:43:41.249492 PROGRESS: Protein Summary:
0:43:41.251733 PROGRESS: Channel   0:	 0.05 FDR:   703; 0.01 FDR:   354; 0.001 FDR:   287
0:43:41.251847 PROGRESS: =========================================================================
0:43:41.252955 PROGRESS: === Epoch 10, step 6, extracting elution groups 63000 to 127000 ===
0:43:41.428875 PROGRESS: Extracting batch of 126539 precursors
0:43:41.467699 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:43:41.467815 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:43:41.467852 INFO: FWHM in RT is 13.96 seconds, sigma is 0.51
0:43:41.467896 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:43:41.468159 INFO: Starting candidate selection
0:43:47.529188 INFO: Starting candidate scoring
0:43:50.006058 INFO: Finished candidate processing
0:43:50.006272 INFO: Collecting candidate features
0:43:52.549174 WARNING: intensity_correlation has 80 NaNs ( 0.07 % out of 116027)
0:43:52.561956 INFO: Collecting fragment features
0:43:53.305531 INFO: Finished candidate scoring
0:43:53.726700 PROGRESS: === Epoch 10, step 6, extracted 116027 precursors and 530355 fragments ===
0:43:53.727031 INFO: performing precursor FDR with 47 features
0:43:53.727075 INFO: Decoy channel: -1
0:43:53.727101 INFO: Competetive: True
0:43:53.998291 WARNING: dropped 64 target PSMs due to missing features
0:43:53.998425 WARNING: dropped 84 decoy PSMs due to missing features
0:44:02.068033 INFO: Test AUC: 0.550
0:44:02.068161 INFO: Train AUC: 0.590
0:44:02.068218 INFO: AUC difference: 6.91%
0:44:02.068246 WARNING: AUC difference > 5%. This may indicate overfitting.
0:44:02.220671 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
0:44:02.222294 PROGRESS: ============================= Precursor FDR =============================
0:44:02.222433 PROGRESS: Total precursors accumulated: 2,152
0:44:02.222511 PROGRESS: Target precursors: 1,964 (91.26%)
0:44:02.222581 PROGRESS: Decoy precursors: 188 (8.74%)
0:44:02.222647 PROGRESS: 
0:44:02.222708 PROGRESS: Precursor Summary:
0:44:02.224782 PROGRESS: Channel   0:	 0.05 FDR: 1,282; 0.01 FDR:   717; 0.001 FDR:   579
0:44:02.224932 PROGRESS: 
0:44:02.225008 PROGRESS: Protein Summary:
0:44:02.227636 PROGRESS: Channel   0:	 0.05 FDR: 1,162; 0.01 FDR:   638; 0.001 FDR:   515
0:44:02.227764 PROGRESS: =========================================================================
0:44:02.229037 PROGRESS: === Epoch 10, step 7, extracting elution groups 127000 to 255000 ===
0:44:02.452659 PROGRESS: Extracting batch of 253000 precursors
0:44:02.524948 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:44:02.525064 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:44:02.525100 INFO: FWHM in RT is 13.96 seconds, sigma is 0.51
0:44:02.525145 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:44:02.525407 INFO: Starting candidate selection
0:44:11.054531 INFO: Starting candidate scoring
0:44:14.690012 INFO: Finished candidate processing
0:44:14.690203 INFO: Collecting candidate features
0:44:17.647619 WARNING: intensity_correlation has 165 NaNs ( 0.07 % out of 232220)
0:44:17.667981 INFO: Collecting fragment features
0:44:18.503642 INFO: Finished candidate scoring
0:44:19.083555 PROGRESS: === Epoch 10, step 7, extracted 232220 precursors and 1062421 fragments ===
0:44:19.083884 INFO: performing precursor FDR with 47 features
0:44:19.083931 INFO: Decoy channel: -1
0:44:19.083958 INFO: Competetive: True
0:44:19.671092 WARNING: dropped 149 target PSMs due to missing features
0:44:19.671230 WARNING: dropped 164 decoy PSMs due to missing features
0:44:36.161720 INFO: Test AUC: 0.551
0:44:36.161883 INFO: Train AUC: 0.579
0:44:36.161925 INFO: AUC difference: 4.80%
0:44:36.343028 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
0:44:36.345245 PROGRESS: ============================= Precursor FDR =============================
0:44:36.345406 PROGRESS: Total precursors accumulated: 4,151
0:44:36.345486 PROGRESS: Target precursors: 3,787 (91.23%)
0:44:36.345554 PROGRESS: Decoy precursors: 364 (8.77%)
0:44:36.345617 PROGRESS: 
0:44:36.345679 PROGRESS: Precursor Summary:
0:44:36.349686 PROGRESS: Channel   0:	 0.05 FDR: 2,585; 0.01 FDR: 1,736; 0.001 FDR: 1,252
0:44:36.349890 PROGRESS: 
0:44:36.350007 PROGRESS: Protein Summary:
0:44:36.354922 PROGRESS: Channel   0:	 0.05 FDR: 2,154; 0.01 FDR: 1,423; 0.001 FDR: 1,036
0:44:36.355039 PROGRESS: =========================================================================
0:44:36.356832 PROGRESS: === Epoch 10, step 8, extracting elution groups 255000 to 511000 ===
0:44:36.663349 PROGRESS: Extracting batch of 505808 precursors
0:44:36.796615 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:44:36.796740 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:44:36.796781 INFO: FWHM in RT is 13.96 seconds, sigma is 0.51
0:44:36.796809 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:44:36.797078 INFO: Starting candidate selection
0:44:50.392289 INFO: Starting candidate scoring
0:44:56.405330 INFO: Finished candidate processing
0:44:56.405519 INFO: Collecting candidate features
0:45:00.009362 WARNING: intensity_correlation has 326 NaNs ( 0.07 % out of 464138)
0:45:00.010403 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 464138)
0:45:00.041962 INFO: Collecting fragment features
0:45:01.051440 INFO: Finished candidate scoring
0:45:01.918152 PROGRESS: === Epoch 10, step 8, extracted 464138 precursors and 2123427 fragments ===
0:45:01.925349 INFO: performing precursor FDR with 47 features
0:45:01.925404 INFO: Decoy channel: -1
0:45:01.925447 INFO: Competetive: True
0:45:03.022326 WARNING: dropped 325 target PSMs due to missing features
0:45:03.022451 WARNING: dropped 314 decoy PSMs due to missing features
0:45:37.010368 INFO: Test AUC: 0.550
0:45:37.010519 INFO: Train AUC: 0.569
0:45:37.010571 INFO: AUC difference: 3.37%
0:45:37.249333 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
0:45:37.252185 PROGRESS: ============================= Precursor FDR =============================
0:45:37.252347 PROGRESS: Total precursors accumulated: 6,538
0:45:37.252426 PROGRESS: Target precursors: 5,970 (91.31%)
0:45:37.252495 PROGRESS: Decoy precursors: 568 (8.69%)
0:45:37.252579 PROGRESS: 
0:45:37.252641 PROGRESS: Precursor Summary:
0:45:37.256246 PROGRESS: Channel   0:	 0.05 FDR: 4,613; 0.01 FDR: 3,346; 0.001 FDR: 2,250
0:45:37.256393 PROGRESS: 
0:45:37.256466 PROGRESS: Protein Summary:
0:45:37.261542 PROGRESS: Channel   0:	 0.05 FDR: 3,217; 0.01 FDR: 2,307; 0.001 FDR: 1,623
0:45:37.261668 PROGRESS: =========================================================================
0:45:37.265900 INFO: calibration group: precursor, fitting rt estimator 
0:45:37.654118 INFO: calibration group: fragment, fitting mz estimator 
0:45:38.252053 INFO: === checking if epoch conditions were reached ===
0:45:38.252236 INFO: ✅ ms2_error      : 7.0000 <= 7
0:45:38.252316 INFO: ❌ rt_error       : 199.8589 > 100
0:45:38.252380 INFO: ✅ current_epoch  : 10 >= 3
0:45:38.252445 INFO: ==============================================
0:45:38.497030 INFO: calibration group: precursor, predicting mz
0:45:38.497310 WARNING: mz prediction was skipped as it has not been fitted yet
0:45:38.497353 INFO: calibration group: precursor, predicting rt
0:45:45.352655 INFO: calibration group: fragment, predicting mz
0:46:03.381868 PROGRESS: === Epoch 11, step 0, extracting elution groups 0 to 1000 ===
0:46:03.481340 PROGRESS: Extracting batch of 1985 precursors
0:46:03.483068 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:46:03.483146 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:46:03.483185 INFO: FWHM in RT is 14.17 seconds, sigma is 0.52
0:46:03.483230 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:46:03.483459 INFO: Starting candidate selection
0:46:07.402575 INFO: Starting candidate scoring
0:46:08.685512 INFO: Finished candidate processing
0:46:08.685604 INFO: Collecting candidate features
0:46:10.853035 WARNING: intensity_correlation has 4 NaNs ( 0.22 % out of 1820)
0:46:10.859011 INFO: Collecting fragment features
0:46:11.492655 INFO: Finished candidate scoring
0:46:11.834090 PROGRESS: === Epoch 11, step 0, extracted 1820 precursors and 8412 fragments ===
0:46:11.834404 INFO: performing precursor FDR with 47 features
0:46:11.834448 INFO: Decoy channel: -1
0:46:11.834474 INFO: Competetive: True
0:46:11.839165 WARNING: dropped 2 target PSMs due to missing features
0:46:11.839242 WARNING: dropped 2 decoy PSMs due to missing features
0:46:11.866694 INFO: Test AUC: 0.577
0:46:11.866791 INFO: Train AUC: 0.556
0:46:11.866837 INFO: AUC difference: 3.77%
0:46:11.987666 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
0:46:11.988433 PROGRESS: ============================= Precursor FDR =============================
0:46:11.988558 PROGRESS: Total precursors accumulated: 16
0:46:11.988637 PROGRESS: Target precursors: 15 (93.75%)
0:46:11.988706 PROGRESS: Decoy precursors: 1 (6.25%)
0:46:11.988770 PROGRESS: 
0:46:11.988831 PROGRESS: Precursor Summary:
0:46:11.990274 PROGRESS: Channel   0:	 0.05 FDR:     9; 0.01 FDR:     9; 0.001 FDR:     9
0:46:11.990393 PROGRESS: 
0:46:11.990468 PROGRESS: Protein Summary:
0:46:11.992070 PROGRESS: Channel   0:	 0.05 FDR:     9; 0.01 FDR:     9; 0.001 FDR:     9
0:46:11.992196 PROGRESS: =========================================================================
0:46:11.993049 PROGRESS: === Epoch 11, step 1, extracting elution groups 1000 to 3000 ===
0:46:12.070162 PROGRESS: Extracting batch of 3953 precursors
0:46:12.072358 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:46:12.072418 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:46:12.072471 INFO: FWHM in RT is 14.17 seconds, sigma is 0.52
0:46:12.072502 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:46:12.072714 INFO: Starting candidate selection
0:46:15.611275 INFO: Starting candidate scoring
0:46:16.910966 INFO: Finished candidate processing
0:46:16.911099 INFO: Collecting candidate features
0:46:19.067831 WARNING: intensity_correlation has 5 NaNs ( 0.14 % out of 3604)
0:46:19.074048 INFO: Collecting fragment features
0:46:19.690227 INFO: Finished candidate scoring
0:46:19.966977 PROGRESS: === Epoch 11, step 1, extracted 3604 precursors and 16249 fragments ===
0:46:19.967286 INFO: performing precursor FDR with 47 features
0:46:19.967354 INFO: Decoy channel: -1
0:46:19.967403 INFO: Competetive: True
0:46:19.975884 WARNING: dropped 6 target PSMs due to missing features
0:46:19.975978 WARNING: dropped 3 decoy PSMs due to missing features
0:46:20.013588 INFO: Test AUC: 0.564
0:46:20.013717 INFO: Train AUC: 0.553
0:46:20.013784 INFO: AUC difference: 1.86%
0:46:20.134364 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
0:46:20.135163 PROGRESS: ============================= Precursor FDR =============================
0:46:20.135318 PROGRESS: Total precursors accumulated: 24
0:46:20.135424 PROGRESS: Target precursors: 22 (91.67%)
0:46:20.135521 PROGRESS: Decoy precursors: 2 (8.33%)
0:46:20.135612 PROGRESS: 
0:46:20.135700 PROGRESS: Precursor Summary:
0:46:20.137146 PROGRESS: Channel   0:	 0.05 FDR:    18; 0.01 FDR:    18; 0.001 FDR:    18
0:46:20.137291 PROGRESS: 
0:46:20.137395 PROGRESS: Protein Summary:
0:46:20.139603 PROGRESS: Channel   0:	 0.05 FDR:    18; 0.01 FDR:    18; 0.001 FDR:    18
0:46:20.139754 PROGRESS: =========================================================================
0:46:20.140644 PROGRESS: === Epoch 11, step 2, extracting elution groups 3000 to 7000 ===
0:46:20.222535 PROGRESS: Extracting batch of 7910 precursors
0:46:20.225739 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:46:20.225834 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:46:20.225895 INFO: FWHM in RT is 14.17 seconds, sigma is 0.52
0:46:20.225965 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:46:20.226222 INFO: Starting candidate selection
0:46:23.837595 INFO: Starting candidate scoring
0:46:25.182294 INFO: Finished candidate processing
0:46:25.182380 INFO: Collecting candidate features
0:46:27.353429 WARNING: intensity_correlation has 8 NaNs ( 0.11 % out of 7234)
0:46:27.359008 INFO: Collecting fragment features
0:46:27.980274 INFO: Finished candidate scoring
0:46:28.261524 PROGRESS: === Epoch 11, step 2, extracted 7234 precursors and 32863 fragments ===
0:46:28.261832 INFO: performing precursor FDR with 47 features
0:46:28.261879 INFO: Decoy channel: -1
0:46:28.261909 INFO: Competetive: True
0:46:28.276734 WARNING: dropped 10 target PSMs due to missing features
0:46:28.276832 WARNING: dropped 7 decoy PSMs due to missing features
0:46:28.535290 INFO: Test AUC: 0.534
0:46:28.535421 INFO: Train AUC: 0.582
0:46:28.535488 INFO: AUC difference: 8.23%
0:46:28.535522 WARNING: AUC difference > 5%. This may indicate overfitting.
0:46:28.659961 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
0:46:28.660809 PROGRESS: ============================= Precursor FDR =============================
0:46:28.660937 PROGRESS: Total precursors accumulated: 100
0:46:28.661018 PROGRESS: Target precursors: 91 (91.00%)
0:46:28.661098 PROGRESS: Decoy precursors: 9 (9.00%)
0:46:28.661163 PROGRESS: 
0:46:28.661226 PROGRESS: Precursor Summary:
0:46:28.662697 PROGRESS: Channel   0:	 0.05 FDR:    50; 0.01 FDR:    27; 0.001 FDR:    27
0:46:28.662813 PROGRESS: 
0:46:28.662888 PROGRESS: Protein Summary:
0:46:28.664530 PROGRESS: Channel   0:	 0.05 FDR:    49; 0.01 FDR:    26; 0.001 FDR:    26
0:46:28.664642 PROGRESS: =========================================================================
0:46:28.665509 PROGRESS: === Epoch 11, step 3, extracting elution groups 7000 to 15000 ===
0:46:28.756720 PROGRESS: Extracting batch of 15812 precursors
0:46:28.762076 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:46:28.762156 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:46:28.762195 INFO: FWHM in RT is 14.17 seconds, sigma is 0.52
0:46:28.762223 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:46:28.762454 INFO: Starting candidate selection
0:46:33.572570 INFO: Starting candidate scoring
0:46:34.996218 INFO: Finished candidate processing
0:46:34.996403 INFO: Collecting candidate features
0:46:37.221885 WARNING: intensity_correlation has 22 NaNs ( 0.15 % out of 14529)
0:46:37.228248 INFO: Collecting fragment features
0:46:37.860512 INFO: Finished candidate scoring
0:46:38.151726 PROGRESS: === Epoch 11, step 3, extracted 14529 precursors and 66929 fragments ===
0:46:38.152045 INFO: performing precursor FDR with 47 features
0:46:38.152095 INFO: Decoy channel: -1
0:46:38.152125 INFO: Competetive: True
0:46:38.179866 WARNING: dropped 19 target PSMs due to missing features
0:46:38.179979 WARNING: dropped 20 decoy PSMs due to missing features
0:46:38.894412 INFO: Test AUC: 0.562
0:46:38.894556 INFO: Train AUC: 0.594
0:46:38.894602 INFO: AUC difference: 5.41%
0:46:38.894637 WARNING: AUC difference > 5%. This may indicate overfitting.
0:46:39.022781 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
0:46:39.023760 PROGRESS: ============================= Precursor FDR =============================
0:46:39.023901 PROGRESS: Total precursors accumulated: 231
0:46:39.023981 PROGRESS: Target precursors: 211 (91.34%)
0:46:39.024050 PROGRESS: Decoy precursors: 20 (8.66%)
0:46:39.024114 PROGRESS: 
0:46:39.024174 PROGRESS: Precursor Summary:
0:46:39.025690 PROGRESS: Channel   0:	 0.05 FDR:   136; 0.01 FDR:    85; 0.001 FDR:    85
0:46:39.025834 PROGRESS: 
0:46:39.025919 PROGRESS: Protein Summary:
0:46:39.027661 PROGRESS: Channel   0:	 0.05 FDR:   135; 0.01 FDR:    84; 0.001 FDR:    84
0:46:39.027774 PROGRESS: =========================================================================
0:46:39.028677 PROGRESS: === Epoch 11, step 4, extracting elution groups 15000 to 31000 ===
0:46:39.140845 PROGRESS: Extracting batch of 31611 precursors
0:46:39.151456 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:46:39.151559 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:46:39.151598 INFO: FWHM in RT is 14.17 seconds, sigma is 0.52
0:46:39.151627 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:46:39.151873 INFO: Starting candidate selection
0:46:43.294230 INFO: Starting candidate scoring
0:46:44.883752 INFO: Finished candidate processing
0:46:44.883880 INFO: Collecting candidate features
0:46:47.169302 WARNING: intensity_correlation has 34 NaNs ( 0.12 % out of 29159)
0:46:47.176345 INFO: Collecting fragment features
0:46:47.833928 INFO: Finished candidate scoring
0:46:48.144779 PROGRESS: === Epoch 11, step 4, extracted 29159 precursors and 133604 fragments ===
0:46:48.145109 INFO: performing precursor FDR with 47 features
0:46:48.145157 INFO: Decoy channel: -1
0:46:48.145185 INFO: Competetive: True
0:46:48.202913 WARNING: dropped 30 target PSMs due to missing features
0:46:48.203022 WARNING: dropped 43 decoy PSMs due to missing features
0:46:49.795720 INFO: Test AUC: 0.543
0:46:49.795873 INFO: Train AUC: 0.607
0:46:49.795920 INFO: AUC difference: 10.52%
0:46:49.795955 WARNING: AUC difference > 5%. This may indicate overfitting.
0:46:49.925598 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
0:46:49.926681 PROGRESS: ============================= Precursor FDR =============================
0:46:49.926820 PROGRESS: Total precursors accumulated: 619
0:46:49.926898 PROGRESS: Target precursors: 564 (91.11%)
0:46:49.926966 PROGRESS: Decoy precursors: 55 (8.89%)
0:46:49.927030 PROGRESS: 
0:46:49.927091 PROGRESS: Precursor Summary:
0:46:49.928686 PROGRESS: Channel   0:	 0.05 FDR:   275; 0.01 FDR:   130; 0.001 FDR:   103
0:46:49.928815 PROGRESS: 
0:46:49.928890 PROGRESS: Protein Summary:
0:46:49.930754 PROGRESS: Channel   0:	 0.05 FDR:   268; 0.01 FDR:   127; 0.001 FDR:   101
0:46:49.930867 PROGRESS: =========================================================================
0:46:49.931809 PROGRESS: === Epoch 11, step 5, extracting elution groups 31000 to 63000 ===
0:46:50.067993 PROGRESS: Extracting batch of 63205 precursors
0:46:50.087914 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:46:50.088023 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:46:50.088060 INFO: FWHM in RT is 14.17 seconds, sigma is 0.52
0:46:50.088103 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:46:50.088352 INFO: Starting candidate selection
0:46:54.851092 INFO: Starting candidate scoring
0:46:56.728545 INFO: Finished candidate processing
0:46:56.728637 INFO: Collecting candidate features
0:46:59.063389 WARNING: intensity_correlation has 60 NaNs ( 0.10 % out of 58060)
0:46:59.072100 INFO: Collecting fragment features
0:46:59.754994 INFO: Finished candidate scoring
0:47:00.098008 PROGRESS: === Epoch 11, step 5, extracted 58060 precursors and 265514 fragments ===
0:47:00.105206 INFO: performing precursor FDR with 47 features
0:47:00.105393 INFO: Decoy channel: -1
0:47:00.105513 INFO: Competetive: True
0:47:00.232119 WARNING: dropped 66 target PSMs due to missing features
0:47:00.232239 WARNING: dropped 67 decoy PSMs due to missing features
0:47:04.312286 INFO: Test AUC: 0.548
0:47:04.312416 INFO: Train AUC: 0.605
0:47:04.312470 INFO: AUC difference: 9.40%
0:47:04.312510 WARNING: AUC difference > 5%. This may indicate overfitting.
0:47:04.449982 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
0:47:04.451440 PROGRESS: ============================= Precursor FDR =============================
0:47:04.451587 PROGRESS: Total precursors accumulated: 1,577
0:47:04.451667 PROGRESS: Target precursors: 1,438 (91.19%)
0:47:04.451735 PROGRESS: Decoy precursors: 139 (8.81%)
0:47:04.451797 PROGRESS: 
0:47:04.451858 PROGRESS: Precursor Summary:
0:47:04.453747 PROGRESS: Channel   0:	 0.05 FDR:   703; 0.01 FDR:   424; 0.001 FDR:   298
0:47:04.453882 PROGRESS: 
0:47:04.453958 PROGRESS: Protein Summary:
0:47:04.456188 PROGRESS: Channel   0:	 0.05 FDR:   661; 0.01 FDR:   396; 0.001 FDR:   280
0:47:04.456301 PROGRESS: =========================================================================
0:47:04.457434 PROGRESS: === Epoch 11, step 6, extracting elution groups 63000 to 127000 ===
0:47:04.633210 PROGRESS: Extracting batch of 126449 precursors
0:47:04.671753 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:47:04.671873 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:47:04.671909 INFO: FWHM in RT is 14.17 seconds, sigma is 0.52
0:47:04.671952 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:47:04.672205 INFO: Starting candidate selection
0:47:10.728558 INFO: Starting candidate scoring
0:47:13.206423 INFO: Finished candidate processing
0:47:13.206563 INFO: Collecting candidate features
0:47:15.755512 WARNING: intensity_correlation has 126 NaNs ( 0.11 % out of 115982)
0:47:15.768328 INFO: Collecting fragment features
0:47:16.511246 INFO: Finished candidate scoring
0:47:16.930871 PROGRESS: === Epoch 11, step 6, extracted 115982 precursors and 529590 fragments ===
0:47:16.931201 INFO: performing precursor FDR with 47 features
0:47:16.931247 INFO: Decoy channel: -1
0:47:16.931275 INFO: Competetive: True
0:47:17.197622 WARNING: dropped 132 target PSMs due to missing features
0:47:17.197735 WARNING: dropped 127 decoy PSMs due to missing features
0:47:25.335829 INFO: Test AUC: 0.554
0:47:25.335955 INFO: Train AUC: 0.592
0:47:25.336011 INFO: AUC difference: 6.40%
0:47:25.336040 WARNING: AUC difference > 5%. This may indicate overfitting.
0:47:25.490323 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
0:47:25.491917 PROGRESS: ============================= Precursor FDR =============================
0:47:25.492042 PROGRESS: Total precursors accumulated: 2,287
0:47:25.492137 PROGRESS: Target precursors: 2,083 (91.08%)
0:47:25.492217 PROGRESS: Decoy precursors: 204 (8.92%)
0:47:25.492281 PROGRESS: 
0:47:25.492343 PROGRESS: Precursor Summary:
0:47:25.494498 PROGRESS: Channel   0:	 0.05 FDR: 1,405; 0.01 FDR:   803; 0.001 FDR:   419
0:47:25.494622 PROGRESS: 
0:47:25.494696 PROGRESS: Protein Summary:
0:47:25.497345 PROGRESS: Channel   0:	 0.05 FDR: 1,286; 0.01 FDR:   734; 0.001 FDR:   391
0:47:25.497473 PROGRESS: =========================================================================
0:47:25.498830 PROGRESS: === Epoch 11, step 7, extracting elution groups 127000 to 255000 ===
0:47:25.722323 PROGRESS: Extracting batch of 252909 precursors
0:47:25.794521 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:47:25.794653 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:47:25.794693 INFO: FWHM in RT is 14.17 seconds, sigma is 0.52
0:47:25.794720 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:47:25.794983 INFO: Starting candidate selection
0:47:34.322850 INFO: Starting candidate scoring
0:47:37.961888 INFO: Finished candidate processing
0:47:37.962011 INFO: Collecting candidate features
0:47:40.913089 WARNING: intensity_correlation has 200 NaNs ( 0.09 % out of 232491)
0:47:40.934775 INFO: Collecting fragment features
0:47:41.788883 INFO: Finished candidate scoring
0:47:42.365587 PROGRESS: === Epoch 11, step 7, extracted 232491 precursors and 1061351 fragments ===
0:47:42.365935 INFO: performing precursor FDR with 47 features
0:47:42.365993 INFO: Decoy channel: -1
0:47:42.366020 INFO: Competetive: True
0:47:42.949961 WARNING: dropped 235 target PSMs due to missing features
0:47:42.950087 WARNING: dropped 224 decoy PSMs due to missing features
0:47:59.399050 INFO: Test AUC: 0.553
0:47:59.399177 INFO: Train AUC: 0.579
0:47:59.399231 INFO: AUC difference: 4.50%
0:47:59.580601 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
0:47:59.582808 PROGRESS: ============================= Precursor FDR =============================
0:47:59.582970 PROGRESS: Total precursors accumulated: 4,192
0:47:59.583049 PROGRESS: Target precursors: 3,820 (91.13%)
0:47:59.583117 PROGRESS: Decoy precursors: 372 (8.87%)
0:47:59.583180 PROGRESS: 
0:47:59.583242 PROGRESS: Precursor Summary:
0:47:59.586036 PROGRESS: Channel   0:	 0.05 FDR: 2,671; 0.01 FDR: 1,719; 0.001 FDR: 1,294
0:47:59.586183 PROGRESS: 
0:47:59.586258 PROGRESS: Protein Summary:
0:47:59.590018 PROGRESS: Channel   0:	 0.05 FDR: 2,229; 0.01 FDR: 1,412; 0.001 FDR: 1,076
0:47:59.590140 PROGRESS: =========================================================================
0:47:59.591936 PROGRESS: === Epoch 11, step 8, extracting elution groups 255000 to 511000 ===
0:47:59.895288 PROGRESS: Extracting batch of 505799 precursors
0:48:00.026751 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:48:00.026895 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:48:00.026951 INFO: FWHM in RT is 14.17 seconds, sigma is 0.52
0:48:00.026979 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:48:00.027244 INFO: Starting candidate selection
0:48:13.617781 INFO: Starting candidate scoring
0:48:19.675381 INFO: Finished candidate processing
0:48:19.675509 INFO: Collecting candidate features
0:48:23.325778 WARNING: intensity_correlation has 466 NaNs ( 0.10 % out of 464305)
0:48:23.359589 INFO: Collecting fragment features
0:48:24.382267 INFO: Finished candidate scoring
0:48:25.264139 PROGRESS: === Epoch 11, step 8, extracted 464305 precursors and 2122689 fragments ===
0:48:25.271277 INFO: performing precursor FDR with 47 features
0:48:25.271432 INFO: Decoy channel: -1
0:48:25.271521 INFO: Competetive: True
0:48:26.383486 WARNING: dropped 473 target PSMs due to missing features
0:48:26.383615 WARNING: dropped 452 decoy PSMs due to missing features
0:49:01.020519 INFO: Test AUC: 0.550
0:49:01.020655 INFO: Train AUC: 0.570
0:49:01.020706 INFO: AUC difference: 3.62%
0:49:01.262087 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
0:49:01.264893 PROGRESS: ============================= Precursor FDR =============================
0:49:01.265051 PROGRESS: Total precursors accumulated: 6,466
0:49:01.265131 PROGRESS: Target precursors: 5,887 (91.05%)
0:49:01.265197 PROGRESS: Decoy precursors: 579 (8.95%)
0:49:01.265260 PROGRESS: 
0:49:01.265319 PROGRESS: Precursor Summary:
0:49:01.268860 PROGRESS: Channel   0:	 0.05 FDR: 4,519; 0.01 FDR: 3,224; 0.001 FDR: 2,443
0:49:01.269008 PROGRESS: 
0:49:01.269079 PROGRESS: Protein Summary:
0:49:01.274139 PROGRESS: Channel   0:	 0.05 FDR: 3,249; 0.01 FDR: 2,252; 0.001 FDR: 1,728
0:49:01.274258 PROGRESS: =========================================================================
0:49:01.278439 INFO: calibration group: precursor, fitting rt estimator 
0:49:01.654165 INFO: calibration group: fragment, fitting mz estimator 
0:49:02.240542 INFO: === checking if epoch conditions were reached ===
0:49:02.240736 INFO: ✅ ms2_error      : 7.0000 <= 7
0:49:02.240826 INFO: ❌ rt_error       : 201.9061 > 100
0:49:02.240899 INFO: ✅ current_epoch  : 11 >= 3
0:49:02.240964 INFO: ==============================================
0:49:02.460238 INFO: calibration group: precursor, predicting mz
0:49:02.460510 WARNING: mz prediction was skipped as it has not been fitted yet
0:49:02.460551 INFO: calibration group: precursor, predicting rt
0:49:09.336219 INFO: calibration group: fragment, predicting mz
0:49:27.378104 PROGRESS: === Epoch 12, step 0, extracting elution groups 0 to 1000 ===
0:49:27.477619 PROGRESS: Extracting batch of 1975 precursors
0:49:27.479367 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:49:27.479447 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:49:27.479486 INFO: FWHM in RT is 13.97 seconds, sigma is 0.51
0:49:27.479532 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:49:27.479762 INFO: Starting candidate selection
0:49:31.454677 INFO: Starting candidate scoring
0:49:32.769427 INFO: Finished candidate processing
0:49:32.769541 INFO: Collecting candidate features
0:49:34.918929 WARNING: intensity_correlation has 2 NaNs ( 0.11 % out of 1793)
0:49:34.924943 INFO: Collecting fragment features
0:49:35.553622 INFO: Finished candidate scoring
0:49:35.892131 PROGRESS: === Epoch 12, step 0, extracted 1793 precursors and 8251 fragments ===
0:49:35.892430 INFO: performing precursor FDR with 47 features
0:49:35.892470 INFO: Decoy channel: -1
0:49:35.892496 INFO: Competetive: True
0:49:35.896980 WARNING: dropped 2 target PSMs due to missing features
0:49:35.924551 INFO: Test AUC: 0.595
0:49:35.924643 INFO: Train AUC: 0.532
0:49:35.924688 INFO: AUC difference: 11.89%
0:49:35.924721 WARNING: AUC difference > 5%. This may indicate overfitting.
0:49:36.069690 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
0:49:36.070463 PROGRESS: ============================= Precursor FDR =============================
0:49:36.070585 PROGRESS: Total precursors accumulated: 15
0:49:36.070663 PROGRESS: Target precursors: 14 (93.33%)
0:49:36.070730 PROGRESS: Decoy precursors: 1 (6.67%)
0:49:36.070793 PROGRESS: 
0:49:36.070854 PROGRESS: Precursor Summary:
0:49:36.072239 PROGRESS: Channel   0:	 0.05 FDR:    11; 0.01 FDR:    11; 0.001 FDR:    11
0:49:36.072350 PROGRESS: 
0:49:36.072422 PROGRESS: Protein Summary:
0:49:36.074016 PROGRESS: Channel   0:	 0.05 FDR:    10; 0.01 FDR:    10; 0.001 FDR:    10
0:49:36.074141 PROGRESS: =========================================================================
0:49:36.074992 PROGRESS: === Epoch 12, step 1, extracting elution groups 1000 to 3000 ===
0:49:36.152975 PROGRESS: Extracting batch of 3954 precursors
0:49:36.155165 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:49:36.155225 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:49:36.155263 INFO: FWHM in RT is 13.97 seconds, sigma is 0.51
0:49:36.155308 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:49:36.155520 INFO: Starting candidate selection
0:49:39.739360 INFO: Starting candidate scoring
0:49:41.043998 INFO: Finished candidate processing
0:49:41.044086 INFO: Collecting candidate features
0:49:43.198298 WARNING: intensity_correlation has 2 NaNs ( 0.05 % out of 3650)
0:49:43.205109 INFO: Collecting fragment features
0:49:43.814785 INFO: Finished candidate scoring
0:49:44.090648 PROGRESS: === Epoch 12, step 1, extracted 3650 precursors and 16835 fragments ===
0:49:44.090932 INFO: performing precursor FDR with 47 features
0:49:44.090978 INFO: Decoy channel: -1
0:49:44.091005 INFO: Competetive: True
0:49:44.099437 WARNING: dropped 3 target PSMs due to missing features
0:49:44.099525 WARNING: dropped 1 decoy PSMs due to missing features
0:49:44.150717 INFO: Test AUC: 0.552
0:49:44.150850 INFO: Train AUC: 0.540
0:49:44.150905 INFO: AUC difference: 2.14%
0:49:44.326190 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
0:49:44.326984 PROGRESS: ============================= Precursor FDR =============================
0:49:44.327103 PROGRESS: Total precursors accumulated: 30
0:49:44.327182 PROGRESS: Target precursors: 28 (93.33%)
0:49:44.327250 PROGRESS: Decoy precursors: 2 (6.67%)
0:49:44.327314 PROGRESS: 
0:49:44.327376 PROGRESS: Precursor Summary:
0:49:44.328802 PROGRESS: Channel   0:	 0.05 FDR:    26; 0.01 FDR:    25; 0.001 FDR:    25
0:49:44.328929 PROGRESS: 
0:49:44.329003 PROGRESS: Protein Summary:
0:49:44.330634 PROGRESS: Channel   0:	 0.05 FDR:    24; 0.01 FDR:    23; 0.001 FDR:    23
0:49:44.330746 PROGRESS: =========================================================================
0:49:44.331619 PROGRESS: === Epoch 12, step 2, extracting elution groups 3000 to 7000 ===
0:49:44.413589 PROGRESS: Extracting batch of 7906 precursors
0:49:44.416841 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:49:44.416922 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:49:44.416962 INFO: FWHM in RT is 13.97 seconds, sigma is 0.51
0:49:44.416993 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:49:44.417212 INFO: Starting candidate selection
0:49:48.097380 INFO: Starting candidate scoring
0:49:49.459996 INFO: Finished candidate processing
0:49:49.460095 INFO: Collecting candidate features
0:49:51.652744 WARNING: intensity_correlation has 2 NaNs ( 0.03 % out of 7236)
0:49:51.658358 INFO: Collecting fragment features
0:49:52.282410 INFO: Finished candidate scoring
0:49:52.565906 PROGRESS: === Epoch 12, step 2, extracted 7236 precursors and 33119 fragments ===
0:49:52.566232 INFO: performing precursor FDR with 47 features
0:49:52.566291 INFO: Decoy channel: -1
0:49:52.566333 INFO: Competetive: True
0:49:52.581115 WARNING: dropped 4 target PSMs due to missing features
0:49:52.581214 WARNING: dropped 2 decoy PSMs due to missing features
0:49:52.791496 INFO: Test AUC: 0.540
0:49:52.791625 INFO: Train AUC: 0.580
0:49:52.791672 INFO: AUC difference: 6.95%
0:49:52.791706 WARNING: AUC difference > 5%. This may indicate overfitting.
0:49:52.913225 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
0:49:52.914129 PROGRESS: ============================= Precursor FDR =============================
0:49:52.914261 PROGRESS: Total precursors accumulated: 136
0:49:52.914338 PROGRESS: Target precursors: 125 (91.91%)
0:49:52.914406 PROGRESS: Decoy precursors: 11 (8.09%)
0:49:52.914469 PROGRESS: 
0:49:52.914530 PROGRESS: Precursor Summary:
0:49:52.916022 PROGRESS: Channel   0:	 0.05 FDR:   110; 0.01 FDR:    53; 0.001 FDR:    53
0:49:52.916157 PROGRESS: 
0:49:52.916233 PROGRESS: Protein Summary:
0:49:52.917954 PROGRESS: Channel   0:	 0.05 FDR:   108; 0.01 FDR:    51; 0.001 FDR:    51
0:49:52.918068 PROGRESS: =========================================================================
0:49:52.918954 PROGRESS: === Epoch 12, step 3, extracting elution groups 7000 to 15000 ===
0:49:53.010318 PROGRESS: Extracting batch of 15827 precursors
0:49:53.015630 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:49:53.015696 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:49:53.015730 INFO: FWHM in RT is 13.97 seconds, sigma is 0.51
0:49:53.015771 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:49:53.015987 INFO: Starting candidate selection
0:49:56.810091 INFO: Starting candidate scoring
0:49:58.218243 INFO: Finished candidate processing
0:49:58.218333 INFO: Collecting candidate features
0:50:00.438680 WARNING: intensity_correlation has 9 NaNs ( 0.06 % out of 14542)
0:50:00.444793 INFO: Collecting fragment features
0:50:01.075960 INFO: Finished candidate scoring
0:50:01.369828 PROGRESS: === Epoch 12, step 3, extracted 14542 precursors and 66967 fragments ===
0:50:01.370136 INFO: performing precursor FDR with 47 features
0:50:01.370185 INFO: Decoy channel: -1
0:50:01.370212 INFO: Competetive: True
0:50:01.398444 WARNING: dropped 7 target PSMs due to missing features
0:50:01.398575 WARNING: dropped 8 decoy PSMs due to missing features
0:50:02.084159 INFO: Test AUC: 0.561
0:50:02.084327 INFO: Train AUC: 0.598
0:50:02.084376 INFO: AUC difference: 6.14%
0:50:02.084410 WARNING: AUC difference > 5%. This may indicate overfitting.
0:50:02.220303 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
0:50:02.221280 PROGRESS: ============================= Precursor FDR =============================
0:50:02.221404 PROGRESS: Total precursors accumulated: 339
0:50:02.221481 PROGRESS: Target precursors: 310 (91.45%)
0:50:02.221550 PROGRESS: Decoy precursors: 29 (8.55%)
0:50:02.221612 PROGRESS: 
0:50:02.221685 PROGRESS: Precursor Summary:
0:50:02.223252 PROGRESS: Channel   0:	 0.05 FDR:   236; 0.01 FDR:   131; 0.001 FDR:   111
0:50:02.223392 PROGRESS: 
0:50:02.223467 PROGRESS: Protein Summary:
0:50:02.225260 PROGRESS: Channel   0:	 0.05 FDR:   230; 0.01 FDR:   126; 0.001 FDR:   107
0:50:02.225387 PROGRESS: =========================================================================
0:50:02.226323 PROGRESS: === Epoch 12, step 4, extracting elution groups 15000 to 31000 ===
0:50:02.334002 PROGRESS: Extracting batch of 31606 precursors
0:50:02.344215 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:50:02.344310 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:50:02.344363 INFO: FWHM in RT is 13.97 seconds, sigma is 0.51
0:50:02.344389 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:50:02.344619 INFO: Starting candidate selection
0:50:06.503047 INFO: Starting candidate scoring
0:50:08.080163 INFO: Finished candidate processing
0:50:08.080261 INFO: Collecting candidate features
0:50:10.351364 WARNING: intensity_correlation has 25 NaNs ( 0.09 % out of 28965)
0:50:10.358363 INFO: Collecting fragment features
0:50:11.013191 INFO: Finished candidate scoring
0:50:11.323127 PROGRESS: === Epoch 12, step 4, extracted 28965 precursors and 131890 fragments ===
0:50:11.323448 INFO: performing precursor FDR with 47 features
0:50:11.323496 INFO: Decoy channel: -1
0:50:11.323523 INFO: Competetive: True
0:50:11.381149 WARNING: dropped 19 target PSMs due to missing features
0:50:11.381263 WARNING: dropped 21 decoy PSMs due to missing features
0:50:13.008900 INFO: Test AUC: 0.552
0:50:13.009059 INFO: Train AUC: 0.605
0:50:13.009112 INFO: AUC difference: 8.77%
0:50:13.009151 WARNING: AUC difference > 5%. This may indicate overfitting.
0:50:13.135384 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
0:50:13.136478 PROGRESS: ============================= Precursor FDR =============================
0:50:13.136608 PROGRESS: Total precursors accumulated: 694
0:50:13.136696 PROGRESS: Target precursors: 634 (91.35%)
0:50:13.136775 PROGRESS: Decoy precursors: 60 (8.65%)
0:50:13.136849 PROGRESS: 
0:50:13.136921 PROGRESS: Precursor Summary:
0:50:13.138621 PROGRESS: Channel   0:	 0.05 FDR:   411; 0.01 FDR:   229; 0.001 FDR:   213
0:50:13.138743 PROGRESS: 
0:50:13.138837 PROGRESS: Protein Summary:
0:50:13.141541 PROGRESS: Channel   0:	 0.05 FDR:   395; 0.01 FDR:   215; 0.001 FDR:   200
0:50:13.141683 PROGRESS: =========================================================================
0:50:13.142707 PROGRESS: === Epoch 12, step 5, extracting elution groups 31000 to 63000 ===
0:50:13.279459 PROGRESS: Extracting batch of 63229 precursors
0:50:13.299199 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:50:13.299314 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:50:13.299356 INFO: FWHM in RT is 13.97 seconds, sigma is 0.51
0:50:13.299387 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:50:13.299629 INFO: Starting candidate selection
0:50:18.124470 INFO: Starting candidate scoring
0:50:20.018074 INFO: Finished candidate processing
0:50:20.018182 INFO: Collecting candidate features
0:50:22.361864 WARNING: intensity_correlation has 50 NaNs ( 0.09 % out of 57909)
0:50:22.370671 INFO: Collecting fragment features
0:50:23.044589 INFO: Finished candidate scoring
0:50:23.387993 PROGRESS: === Epoch 12, step 5, extracted 57909 precursors and 264014 fragments ===
0:50:23.395174 INFO: performing precursor FDR with 47 features
0:50:23.395247 INFO: Decoy channel: -1
0:50:23.395274 INFO: Competetive: True
0:50:23.521096 WARNING: dropped 50 target PSMs due to missing features
0:50:23.521209 WARNING: dropped 40 decoy PSMs due to missing features
0:50:27.511585 INFO: Test AUC: 0.555
0:50:27.511705 INFO: Train AUC: 0.595
0:50:27.511760 INFO: AUC difference: 6.71%
0:50:27.511789 WARNING: AUC difference > 5%. This may indicate overfitting.
0:50:27.648551 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
0:50:27.649961 PROGRESS: ============================= Precursor FDR =============================
0:50:27.650089 PROGRESS: Total precursors accumulated: 1,514
0:50:27.650181 PROGRESS: Target precursors: 1,381 (91.22%)
0:50:27.650249 PROGRESS: Decoy precursors: 133 (8.78%)
0:50:27.650312 PROGRESS: 
0:50:27.650373 PROGRESS: Precursor Summary:
0:50:27.652165 PROGRESS: Channel   0:	 0.05 FDR:   706; 0.01 FDR:   401; 0.001 FDR:   176
0:50:27.652296 PROGRESS: 
0:50:27.652369 PROGRESS: Protein Summary:
0:50:27.654538 PROGRESS: Channel   0:	 0.05 FDR:   672; 0.01 FDR:   380; 0.001 FDR:   170
0:50:27.654651 PROGRESS: =========================================================================
0:50:27.655762 PROGRESS: === Epoch 12, step 6, extracting elution groups 63000 to 127000 ===
0:50:27.831511 PROGRESS: Extracting batch of 126542 precursors
0:50:27.869961 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:50:27.870078 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:50:27.870118 INFO: FWHM in RT is 13.97 seconds, sigma is 0.51
0:50:27.870145 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:50:27.870407 INFO: Starting candidate selection
0:50:33.941419 INFO: Starting candidate scoring
0:50:36.416835 INFO: Finished candidate processing
0:50:36.416968 INFO: Collecting candidate features
0:50:38.949445 WARNING: intensity_correlation has 76 NaNs ( 0.07 % out of 115917)
0:50:38.961909 INFO: Collecting fragment features
0:50:39.703217 INFO: Finished candidate scoring
0:50:40.120142 PROGRESS: === Epoch 12, step 6, extracted 115917 precursors and 529875 fragments ===
0:50:40.120461 INFO: performing precursor FDR with 47 features
0:50:40.120509 INFO: Decoy channel: -1
0:50:40.120536 INFO: Competetive: True
0:50:40.386780 WARNING: dropped 86 target PSMs due to missing features
0:50:40.386895 WARNING: dropped 80 decoy PSMs due to missing features
0:50:48.458773 INFO: Test AUC: 0.541
0:50:48.458910 INFO: Train AUC: 0.591
0:50:48.458949 INFO: AUC difference: 8.46%
0:50:48.458993 WARNING: AUC difference > 5%. This may indicate overfitting.
0:50:48.613342 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
0:50:48.615076 PROGRESS: ============================= Precursor FDR =============================
0:50:48.615224 PROGRESS: Total precursors accumulated: 2,524
0:50:48.615303 PROGRESS: Target precursors: 2,309 (91.48%)
0:50:48.615371 PROGRESS: Decoy precursors: 215 (8.52%)
0:50:48.615435 PROGRESS: 
0:50:48.615496 PROGRESS: Precursor Summary:
0:50:48.617625 PROGRESS: Channel   0:	 0.05 FDR: 1,534; 0.01 FDR:   817; 0.001 FDR:   181
0:50:48.617744 PROGRESS: 
0:50:48.617830 PROGRESS: Protein Summary:
0:50:48.620486 PROGRESS: Channel   0:	 0.05 FDR: 1,394; 0.01 FDR:   730; 0.001 FDR:   175
0:50:48.620600 PROGRESS: =========================================================================
0:50:48.621974 PROGRESS: === Epoch 12, step 7, extracting elution groups 127000 to 255000 ===
0:50:48.849400 PROGRESS: Extracting batch of 252936 precursors
0:50:48.922301 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:50:48.922436 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:50:48.922476 INFO: FWHM in RT is 13.97 seconds, sigma is 0.51
0:50:48.922504 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:50:48.922764 INFO: Starting candidate selection
0:50:57.589564 INFO: Starting candidate scoring
0:51:01.224808 INFO: Finished candidate processing
0:51:01.224904 INFO: Collecting candidate features
0:51:04.171302 WARNING: intensity_correlation has 164 NaNs ( 0.07 % out of 231588)
0:51:04.192742 INFO: Collecting fragment features
0:51:05.030065 INFO: Finished candidate scoring
0:51:05.616534 PROGRESS: === Epoch 12, step 7, extracted 231588 precursors and 1058599 fragments ===
0:51:05.616862 INFO: performing precursor FDR with 47 features
0:51:05.616908 INFO: Decoy channel: -1
0:51:05.616935 INFO: Competetive: True
0:51:06.202359 WARNING: dropped 169 target PSMs due to missing features
0:51:06.202488 WARNING: dropped 161 decoy PSMs due to missing features
0:51:22.674545 INFO: Test AUC: 0.549
0:51:22.674686 INFO: Train AUC: 0.579
0:51:22.674728 INFO: AUC difference: 5.18%
0:51:22.674767 WARNING: AUC difference > 5%. This may indicate overfitting.
0:51:22.854797 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
0:51:22.857030 PROGRESS: ============================= Precursor FDR =============================
0:51:22.857182 PROGRESS: Total precursors accumulated: 4,308
0:51:22.857261 PROGRESS: Target precursors: 3,929 (91.20%)
0:51:22.857329 PROGRESS: Decoy precursors: 379 (8.80%)
0:51:22.857393 PROGRESS: 
0:51:22.857455 PROGRESS: Precursor Summary:
0:51:22.860072 PROGRESS: Channel   0:	 0.05 FDR: 2,855; 0.01 FDR: 1,684; 0.001 FDR:   731
0:51:22.860198 PROGRESS: 
0:51:22.860271 PROGRESS: Protein Summary:
0:51:22.863795 PROGRESS: Channel   0:	 0.05 FDR: 2,374; 0.01 FDR: 1,376; 0.001 FDR:   647
0:51:22.863920 PROGRESS: =========================================================================
0:51:22.865651 PROGRESS: === Epoch 12, step 8, extracting elution groups 255000 to 511000 ===
0:51:23.168657 PROGRESS: Extracting batch of 505879 precursors
0:51:23.301075 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:51:23.301192 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:51:23.301230 INFO: FWHM in RT is 13.97 seconds, sigma is 0.51
0:51:23.301273 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:51:23.301530 INFO: Starting candidate selection
0:51:36.900542 INFO: Starting candidate scoring
0:51:42.916789 INFO: Finished candidate processing
0:51:42.916983 INFO: Collecting candidate features
0:51:46.533530 WARNING: intensity_correlation has 330 NaNs ( 0.07 % out of 462947)
0:51:46.534580 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 462947)
0:51:46.568078 INFO: Collecting fragment features
0:51:47.589572 INFO: Finished candidate scoring
0:51:48.466420 PROGRESS: === Epoch 12, step 8, extracted 462947 precursors and 2113305 fragments ===
0:51:48.473686 INFO: performing precursor FDR with 47 features
0:51:48.473861 INFO: Decoy channel: -1
0:51:48.473953 INFO: Competetive: True
0:51:49.582279 WARNING: dropped 351 target PSMs due to missing features
0:51:49.582422 WARNING: dropped 309 decoy PSMs due to missing features
0:52:23.789584 INFO: Test AUC: 0.549
0:52:23.789714 INFO: Train AUC: 0.570
0:52:23.789784 INFO: AUC difference: 3.70%
0:52:24.027509 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
0:52:24.030333 PROGRESS: ============================= Precursor FDR =============================
0:52:24.030491 PROGRESS: Total precursors accumulated: 6,827
0:52:24.030572 PROGRESS: Target precursors: 6,223 (91.15%)
0:52:24.030640 PROGRESS: Decoy precursors: 604 (8.85%)
0:52:24.030703 PROGRESS: 
0:52:24.030763 PROGRESS: Precursor Summary:
0:52:24.034422 PROGRESS: Channel   0:	 0.05 FDR: 4,830; 0.01 FDR: 3,281; 0.001 FDR: 2,381
0:52:24.034568 PROGRESS: 
0:52:24.034643 PROGRESS: Protein Summary:
0:52:24.039810 PROGRESS: Channel   0:	 0.05 FDR: 3,480; 0.01 FDR: 2,300; 0.001 FDR: 1,731
0:52:24.039932 PROGRESS: =========================================================================
0:52:24.044133 INFO: calibration group: precursor, fitting rt estimator 
0:52:24.424340 INFO: calibration group: fragment, fitting mz estimator 
0:52:25.021302 INFO: === checking if epoch conditions were reached ===
0:52:25.021488 INFO: ✅ ms2_error      : 7.0000 <= 7
0:52:25.021577 INFO: ❌ rt_error       : 202.1352 > 100
0:52:25.021652 INFO: ✅ current_epoch  : 12 >= 3
0:52:25.021719 INFO: ==============================================
0:52:25.268721 INFO: calibration group: precursor, predicting mz
0:52:25.268993 WARNING: mz prediction was skipped as it has not been fitted yet
0:52:25.269034 INFO: calibration group: precursor, predicting rt
0:52:32.113161 INFO: calibration group: fragment, predicting mz
0:52:50.184452 PROGRESS: === Epoch 13, step 0, extracting elution groups 0 to 1000 ===
0:52:50.289112 PROGRESS: Extracting batch of 1974 precursors
0:52:50.290807 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:52:50.290878 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:52:50.290939 INFO: FWHM in RT is 14.19 seconds, sigma is 0.52
0:52:50.290986 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:52:50.291218 INFO: Starting candidate selection
0:52:54.269629 INFO: Starting candidate scoring
0:52:55.555286 INFO: Finished candidate processing
0:52:55.555377 INFO: Collecting candidate features
0:52:57.729171 WARNING: intensity_correlation has 2 NaNs ( 0.11 % out of 1794)
0:52:57.734966 INFO: Collecting fragment features
0:52:58.374306 INFO: Finished candidate scoring
0:52:58.694688 PROGRESS: === Epoch 13, step 0, extracted 1794 precursors and 8140 fragments ===
0:52:58.694987 INFO: performing precursor FDR with 47 features
0:52:58.695031 INFO: Decoy channel: -1
0:52:58.695057 INFO: Competetive: True
0:52:58.699673 WARNING: dropped 1 target PSMs due to missing features
0:52:58.699745 WARNING: dropped 1 decoy PSMs due to missing features
0:52:58.727618 INFO: Test AUC: 0.545
0:52:58.727711 INFO: Train AUC: 0.546
0:52:58.727757 INFO: AUC difference: 0.28%
0:52:58.847519 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
0:52:58.848306 PROGRESS: ============================= Precursor FDR =============================
0:52:58.848432 PROGRESS: Total precursors accumulated: 8
0:52:58.848510 PROGRESS: Target precursors: 8 (100.00%)
0:52:58.848589 PROGRESS: Decoy precursors: 0 (0.00%)
0:52:58.848651 PROGRESS: 
0:52:58.848711 PROGRESS: Precursor Summary:
0:52:58.850223 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
0:52:58.850336 PROGRESS: 
0:52:58.850409 PROGRESS: Protein Summary:
0:52:58.852082 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
0:52:58.852193 PROGRESS: =========================================================================
0:52:58.853059 PROGRESS: === Epoch 13, step 1, extracting elution groups 1000 to 3000 ===
0:52:58.930514 PROGRESS: Extracting batch of 3948 precursors
0:52:58.932591 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:52:58.932655 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:52:58.932693 INFO: FWHM in RT is 14.19 seconds, sigma is 0.52
0:52:58.932739 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:52:58.932952 INFO: Starting candidate selection
0:53:02.490449 INFO: Starting candidate scoring
0:53:03.789210 INFO: Finished candidate processing
0:53:03.789320 INFO: Collecting candidate features
0:53:05.947611 WARNING: intensity_correlation has 2 NaNs ( 0.06 % out of 3628)
0:53:07.088158 INFO: Collecting fragment features
0:53:07.702463 INFO: Finished candidate scoring
0:53:07.978070 PROGRESS: === Epoch 13, step 1, extracted 3628 precursors and 16638 fragments ===
0:53:07.978355 INFO: performing precursor FDR with 47 features
0:53:07.978401 INFO: Decoy channel: -1
0:53:07.978427 INFO: Competetive: True
0:53:07.986668 WARNING: dropped 2 target PSMs due to missing features
0:53:07.986772 WARNING: dropped 2 decoy PSMs due to missing features
0:53:08.022810 INFO: Test AUC: 0.512
0:53:08.022933 INFO: Train AUC: 0.551
0:53:08.022979 INFO: AUC difference: 7.20%
0:53:08.023013 WARNING: AUC difference > 5%. This may indicate overfitting.
0:53:08.143007 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
0:53:08.143805 PROGRESS: ============================= Precursor FDR =============================
0:53:08.143923 PROGRESS: Total precursors accumulated: 30
0:53:08.144000 PROGRESS: Target precursors: 28 (93.33%)
0:53:08.144067 PROGRESS: Decoy precursors: 2 (6.67%)
0:53:08.144130 PROGRESS: 
0:53:08.144191 PROGRESS: Precursor Summary:
0:53:08.145590 PROGRESS: Channel   0:	 0.05 FDR:    28; 0.01 FDR:    23; 0.001 FDR:    23
0:53:08.145720 PROGRESS: 
0:53:08.145806 PROGRESS: Protein Summary:
0:53:08.147401 PROGRESS: Channel   0:	 0.05 FDR:    28; 0.01 FDR:    23; 0.001 FDR:    23
0:53:08.147512 PROGRESS: =========================================================================
0:53:08.148355 PROGRESS: === Epoch 13, step 2, extracting elution groups 3000 to 7000 ===
0:53:08.231026 PROGRESS: Extracting batch of 7906 precursors
0:53:08.234297 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:53:08.234360 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:53:08.234400 INFO: FWHM in RT is 14.19 seconds, sigma is 0.52
0:53:08.234430 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:53:08.234646 INFO: Starting candidate selection
0:53:11.880318 INFO: Starting candidate scoring
0:53:13.220511 INFO: Finished candidate processing
0:53:13.220602 INFO: Collecting candidate features
0:53:15.400289 WARNING: intensity_correlation has 6 NaNs ( 0.08 % out of 7254)
0:53:15.405834 INFO: Collecting fragment features
0:53:16.025896 INFO: Finished candidate scoring
0:53:16.307001 PROGRESS: === Epoch 13, step 2, extracted 7254 precursors and 33415 fragments ===
0:53:16.307310 INFO: performing precursor FDR with 47 features
0:53:16.307355 INFO: Decoy channel: -1
0:53:16.307381 INFO: Competetive: True
0:53:16.322028 WARNING: dropped 4 target PSMs due to missing features
0:53:16.322142 WARNING: dropped 6 decoy PSMs due to missing features
0:53:16.577080 INFO: Test AUC: 0.572
0:53:16.577218 INFO: Train AUC: 0.587
0:53:16.577263 INFO: AUC difference: 2.65%
0:53:16.697424 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
0:53:16.698302 PROGRESS: ============================= Precursor FDR =============================
0:53:16.698421 PROGRESS: Total precursors accumulated: 60
0:53:16.698499 PROGRESS: Target precursors: 55 (91.67%)
0:53:16.698567 PROGRESS: Decoy precursors: 5 (8.33%)
0:53:16.698630 PROGRESS: 
0:53:16.698691 PROGRESS: Precursor Summary:
0:53:16.700144 PROGRESS: Channel   0:	 0.05 FDR:    55; 0.01 FDR:    49; 0.001 FDR:    49
0:53:16.700273 PROGRESS: 
0:53:16.700349 PROGRESS: Protein Summary:
0:53:16.702046 PROGRESS: Channel   0:	 0.05 FDR:    55; 0.01 FDR:    49; 0.001 FDR:    49
0:53:16.702158 PROGRESS: =========================================================================
0:53:16.703033 PROGRESS: === Epoch 13, step 3, extracting elution groups 7000 to 15000 ===
0:53:16.794522 PROGRESS: Extracting batch of 15812 precursors
0:53:16.799884 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:53:16.799947 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:53:16.799981 INFO: FWHM in RT is 14.19 seconds, sigma is 0.52
0:53:16.800022 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:53:16.800241 INFO: Starting candidate selection
0:53:20.630666 INFO: Starting candidate scoring
0:53:22.052296 INFO: Finished candidate processing
0:53:22.052388 INFO: Collecting candidate features
0:53:24.276386 WARNING: intensity_correlation has 12 NaNs ( 0.08 % out of 14469)
0:53:24.282607 INFO: Collecting fragment features
0:53:24.921943 INFO: Finished candidate scoring
0:53:25.215307 PROGRESS: === Epoch 13, step 3, extracted 14469 precursors and 66039 fragments ===
0:53:25.215623 INFO: performing precursor FDR with 47 features
0:53:25.215667 INFO: Decoy channel: -1
0:53:25.215693 INFO: Competetive: True
0:53:25.244183 WARNING: dropped 11 target PSMs due to missing features
0:53:25.244296 WARNING: dropped 11 decoy PSMs due to missing features
0:53:26.001486 INFO: Test AUC: 0.549
0:53:26.001648 INFO: Train AUC: 0.603
0:53:26.001696 INFO: AUC difference: 8.85%
0:53:26.001731 WARNING: AUC difference > 5%. This may indicate overfitting.
0:53:26.141441 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
0:53:26.142442 PROGRESS: ============================= Precursor FDR =============================
0:53:26.142594 PROGRESS: Total precursors accumulated: 304
0:53:26.142674 PROGRESS: Target precursors: 277 (91.12%)
0:53:26.142742 PROGRESS: Decoy precursors: 27 (8.88%)
0:53:26.142805 PROGRESS: 
0:53:26.142865 PROGRESS: Precursor Summary:
0:53:26.144433 PROGRESS: Channel   0:	 0.05 FDR:   147; 0.01 FDR:   114; 0.001 FDR:   103
0:53:26.144561 PROGRESS: 
0:53:26.144635 PROGRESS: Protein Summary:
0:53:26.146425 PROGRESS: Channel   0:	 0.05 FDR:   146; 0.01 FDR:   114; 0.001 FDR:   103
0:53:26.146538 PROGRESS: =========================================================================
0:53:26.147481 PROGRESS: === Epoch 13, step 4, extracting elution groups 15000 to 31000 ===
0:53:26.256235 PROGRESS: Extracting batch of 31641 precursors
0:53:26.266958 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:53:26.267056 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:53:26.267093 INFO: FWHM in RT is 14.19 seconds, sigma is 0.52
0:53:26.267121 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:53:26.267362 INFO: Starting candidate selection
0:53:30.455240 INFO: Starting candidate scoring
0:53:32.047718 INFO: Finished candidate processing
0:53:32.047818 INFO: Collecting candidate features
0:53:34.318080 WARNING: intensity_correlation has 25 NaNs ( 0.09 % out of 28923)
0:53:34.325154 INFO: Collecting fragment features
0:53:34.979520 INFO: Finished candidate scoring
0:53:35.290346 PROGRESS: === Epoch 13, step 4, extracted 28923 precursors and 132899 fragments ===
0:53:35.290675 INFO: performing precursor FDR with 47 features
0:53:35.290736 INFO: Decoy channel: -1
0:53:35.290776 INFO: Competetive: True
0:53:35.347967 WARNING: dropped 25 target PSMs due to missing features
0:53:35.348073 WARNING: dropped 22 decoy PSMs due to missing features
0:53:37.060797 INFO: Test AUC: 0.548
0:53:37.060953 INFO: Train AUC: 0.607
0:53:37.061000 INFO: AUC difference: 9.73%
0:53:37.061037 WARNING: AUC difference > 5%. This may indicate overfitting.
0:53:37.193094 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
0:53:37.194164 PROGRESS: ============================= Precursor FDR =============================
0:53:37.194290 PROGRESS: Total precursors accumulated: 528
0:53:37.194366 PROGRESS: Target precursors: 482 (91.29%)
0:53:37.194433 PROGRESS: Decoy precursors: 46 (8.71%)
0:53:37.194494 PROGRESS: 
0:53:37.194555 PROGRESS: Precursor Summary:
0:53:37.196183 PROGRESS: Channel   0:	 0.05 FDR:   283; 0.01 FDR:   202; 0.001 FDR:   161
0:53:37.196326 PROGRESS: 
0:53:37.196402 PROGRESS: Protein Summary:
0:53:37.198332 PROGRESS: Channel   0:	 0.05 FDR:   277; 0.01 FDR:   198; 0.001 FDR:   157
0:53:37.198444 PROGRESS: =========================================================================
0:53:37.199429 PROGRESS: === Epoch 13, step 5, extracting elution groups 31000 to 63000 ===
0:53:37.334814 PROGRESS: Extracting batch of 63286 precursors
0:53:37.354480 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:53:37.354585 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:53:37.354626 INFO: FWHM in RT is 14.19 seconds, sigma is 0.52
0:53:37.354654 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:53:37.354901 INFO: Starting candidate selection
0:53:42.156011 INFO: Starting candidate scoring
0:53:44.040450 INFO: Finished candidate processing
0:53:44.040543 INFO: Collecting candidate features
0:53:46.408931 WARNING: intensity_correlation has 55 NaNs ( 0.09 % out of 58040)
0:53:46.417785 INFO: Collecting fragment features
0:53:47.105838 INFO: Finished candidate scoring
0:53:47.451697 PROGRESS: === Epoch 13, step 5, extracted 58040 precursors and 266018 fragments ===
0:53:47.452033 INFO: performing precursor FDR with 47 features
0:53:47.452078 INFO: Decoy channel: -1
0:53:47.452105 INFO: Competetive: True
0:53:47.579063 WARNING: dropped 55 target PSMs due to missing features
0:53:47.579180 WARNING: dropped 47 decoy PSMs due to missing features
0:53:51.350346 INFO: Test AUC: 0.558
0:53:51.350476 INFO: Train AUC: 0.602
0:53:51.350526 INFO: AUC difference: 7.34%
0:53:51.350561 WARNING: AUC difference > 5%. This may indicate overfitting.
0:53:51.489084 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
0:53:51.490505 PROGRESS: ============================= Precursor FDR =============================
0:53:51.490633 PROGRESS: Total precursors accumulated: 1,537
0:53:51.490713 PROGRESS: Target precursors: 1,402 (91.22%)
0:53:51.490781 PROGRESS: Decoy precursors: 135 (8.78%)
0:53:51.490845 PROGRESS: 
0:53:51.490907 PROGRESS: Precursor Summary:
0:53:51.492799 PROGRESS: Channel   0:	 0.05 FDR:   696; 0.01 FDR:   404; 0.001 FDR:   291
0:53:51.492937 PROGRESS: 
0:53:51.493012 PROGRESS: Protein Summary:
0:53:51.495259 PROGRESS: Channel   0:	 0.05 FDR:   660; 0.01 FDR:   383; 0.001 FDR:   276
0:53:51.495375 PROGRESS: =========================================================================
0:53:51.496508 PROGRESS: === Epoch 13, step 6, extracting elution groups 63000 to 127000 ===
0:53:51.672850 PROGRESS: Extracting batch of 126502 precursors
0:53:51.712070 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:53:51.712190 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:53:51.712230 INFO: FWHM in RT is 14.19 seconds, sigma is 0.52
0:53:51.712257 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:53:51.712516 INFO: Starting candidate selection
0:53:57.837067 INFO: Starting candidate scoring
0:54:00.317322 INFO: Finished candidate processing
0:54:00.317448 INFO: Collecting candidate features
0:54:02.825349 WARNING: intensity_correlation has 130 NaNs ( 0.11 % out of 116100)
0:54:02.837794 INFO: Collecting fragment features
0:54:03.569870 INFO: Finished candidate scoring
0:54:03.983884 PROGRESS: === Epoch 13, step 6, extracted 116100 precursors and 531776 fragments ===
0:54:03.984220 INFO: performing precursor FDR with 47 features
0:54:03.984266 INFO: Decoy channel: -1
0:54:03.984293 INFO: Competetive: True
0:54:04.249358 WARNING: dropped 116 target PSMs due to missing features
0:54:04.249476 WARNING: dropped 116 decoy PSMs due to missing features
0:54:12.349185 INFO: Test AUC: 0.551
0:54:12.349312 INFO: Train AUC: 0.594
0:54:12.349370 INFO: AUC difference: 7.21%
0:54:12.349398 WARNING: AUC difference > 5%. This may indicate overfitting.
0:54:12.502904 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
0:54:12.504499 PROGRESS: ============================= Precursor FDR =============================
0:54:12.504650 PROGRESS: Total precursors accumulated: 2,148
0:54:12.504728 PROGRESS: Target precursors: 1,957 (91.11%)
0:54:12.504795 PROGRESS: Decoy precursors: 191 (8.89%)
0:54:12.504858 PROGRESS: 
0:54:12.504919 PROGRESS: Precursor Summary:
0:54:12.507112 PROGRESS: Channel   0:	 0.05 FDR: 1,392; 0.01 FDR:   836; 0.001 FDR:   621
0:54:12.507252 PROGRESS: 
0:54:12.507325 PROGRESS: Protein Summary:
0:54:12.510115 PROGRESS: Channel   0:	 0.05 FDR: 1,269; 0.01 FDR:   754; 0.001 FDR:   563
0:54:12.510231 PROGRESS: =========================================================================
0:54:12.511603 PROGRESS: === Epoch 13, step 7, extracting elution groups 127000 to 255000 ===
0:54:12.735845 PROGRESS: Extracting batch of 252859 precursors
0:54:12.807353 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:54:12.807464 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:54:12.807503 INFO: FWHM in RT is 14.19 seconds, sigma is 0.52
0:54:12.807544 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:54:12.807803 INFO: Starting candidate selection
0:54:21.342972 INFO: Starting candidate scoring
0:54:24.966611 INFO: Finished candidate processing
0:54:24.966758 INFO: Collecting candidate features
0:54:27.878740 WARNING: intensity_correlation has 269 NaNs ( 0.12 % out of 231443)
0:54:27.898681 INFO: Collecting fragment features
0:54:28.726577 INFO: Finished candidate scoring
0:54:29.299802 PROGRESS: === Epoch 13, step 7, extracted 231443 precursors and 1058436 fragments ===
0:54:29.300128 INFO: performing precursor FDR with 47 features
0:54:29.300173 INFO: Decoy channel: -1
0:54:29.300199 INFO: Competetive: True
0:54:29.875694 WARNING: dropped 258 target PSMs due to missing features
0:54:29.875810 WARNING: dropped 243 decoy PSMs due to missing features
0:54:46.300116 INFO: Test AUC: 0.548
0:54:46.300263 INFO: Train AUC: 0.579
0:54:46.300304 INFO: AUC difference: 5.41%
0:54:46.300333 WARNING: AUC difference > 5%. This may indicate overfitting.
0:54:46.482795 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
0:54:46.484907 PROGRESS: ============================= Precursor FDR =============================
0:54:46.485059 PROGRESS: Total precursors accumulated: 3,726
0:54:46.485147 PROGRESS: Target precursors: 3,397 (91.17%)
0:54:46.485218 PROGRESS: Decoy precursors: 329 (8.83%)
0:54:46.485281 PROGRESS: 
0:54:46.485342 PROGRESS: Precursor Summary:
0:54:46.488036 PROGRESS: Channel   0:	 0.05 FDR: 2,646; 0.01 FDR: 1,723; 0.001 FDR: 1,186
0:54:46.488168 PROGRESS: 
0:54:46.488240 PROGRESS: Protein Summary:
0:54:46.491854 PROGRESS: Channel   0:	 0.05 FDR: 2,204; 0.01 FDR: 1,409; 0.001 FDR:   995
0:54:46.491963 PROGRESS: =========================================================================
0:54:46.493732 PROGRESS: === Epoch 13, step 8, extracting elution groups 255000 to 511000 ===
0:54:46.796431 PROGRESS: Extracting batch of 505859 precursors
0:54:46.930775 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:54:46.930887 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:54:46.930925 INFO: FWHM in RT is 14.19 seconds, sigma is 0.52
0:54:46.930967 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:54:46.931223 INFO: Starting candidate selection
0:55:00.581027 INFO: Starting candidate scoring
0:55:06.668712 INFO: Finished candidate processing
0:55:06.668902 INFO: Collecting candidate features
0:55:10.275487 WARNING: intensity_correlation has 502 NaNs ( 0.11 % out of 463193)
0:55:10.309868 INFO: Collecting fragment features
0:55:11.321208 INFO: Finished candidate scoring
0:55:12.189714 PROGRESS: === Epoch 13, step 8, extracted 463193 precursors and 2119747 fragments ===
0:55:12.190084 INFO: performing precursor FDR with 47 features
0:55:12.190132 INFO: Decoy channel: -1
0:55:12.190161 INFO: Competetive: True
0:55:13.277379 WARNING: dropped 513 target PSMs due to missing features
0:55:13.277508 WARNING: dropped 490 decoy PSMs due to missing features
0:55:47.220454 INFO: Test AUC: 0.551
0:55:47.220589 INFO: Train AUC: 0.570
0:55:47.220644 INFO: AUC difference: 3.43%
0:55:47.457624 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
0:55:47.460384 PROGRESS: ============================= Precursor FDR =============================
0:55:47.460540 PROGRESS: Total precursors accumulated: 6,296
0:55:47.460618 PROGRESS: Target precursors: 5,741 (91.18%)
0:55:47.460683 PROGRESS: Decoy precursors: 555 (8.82%)
0:55:47.460745 PROGRESS: 
0:55:47.460805 PROGRESS: Precursor Summary:
0:55:47.464463 PROGRESS: Channel   0:	 0.05 FDR: 4,655; 0.01 FDR: 3,527; 0.001 FDR: 2,646
0:55:47.464613 PROGRESS: 
0:55:47.464696 PROGRESS: Protein Summary:
0:55:47.469949 PROGRESS: Channel   0:	 0.05 FDR: 3,316; 0.01 FDR: 2,473; 0.001 FDR: 1,901
0:55:47.470074 PROGRESS: =========================================================================
0:55:47.474372 INFO: calibration group: precursor, fitting rt estimator 
0:55:47.882128 INFO: calibration group: fragment, fitting mz estimator 
0:55:48.469052 INFO: === checking if epoch conditions were reached ===
0:55:48.469227 INFO: ✅ ms2_error      : 7.0000 <= 7
0:55:48.469306 INFO: ❌ rt_error       : 199.9394 > 100
0:55:48.469370 INFO: ✅ current_epoch  : 13 >= 3
0:55:48.469426 INFO: ==============================================
0:55:48.687302 INFO: calibration group: precursor, predicting mz
0:55:48.687566 WARNING: mz prediction was skipped as it has not been fitted yet
0:55:48.687606 INFO: calibration group: precursor, predicting rt
0:55:55.455351 INFO: calibration group: fragment, predicting mz
0:56:13.248287 PROGRESS: === Epoch 14, step 0, extracting elution groups 0 to 1000 ===
0:56:13.347585 PROGRESS: Extracting batch of 1979 precursors
0:56:13.349264 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:56:13.349342 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:56:13.349380 INFO: FWHM in RT is 13.94 seconds, sigma is 0.51
0:56:13.349426 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:56:13.349656 INFO: Starting candidate selection
0:56:17.259457 INFO: Starting candidate scoring
0:56:18.538668 INFO: Finished candidate processing
0:56:18.538876 INFO: Collecting candidate features
0:56:20.705891 WARNING: intensity_correlation has 1 NaNs ( 0.05 % out of 1828)
0:56:20.711740 INFO: Collecting fragment features
0:56:21.344702 INFO: Finished candidate scoring
0:56:21.665484 PROGRESS: === Epoch 14, step 0, extracted 1828 precursors and 8414 fragments ===
0:56:21.665810 INFO: performing precursor FDR with 47 features
0:56:21.665857 INFO: Decoy channel: -1
0:56:21.665884 INFO: Competetive: True
0:56:21.670471 WARNING: dropped 1 decoy PSMs due to missing features
0:56:21.704519 INFO: Test AUC: 0.533
0:56:21.704616 INFO: Train AUC: 0.545
0:56:21.704661 INFO: AUC difference: 2.26%
0:56:21.824005 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
0:56:21.824810 PROGRESS: ============================= Precursor FDR =============================
0:56:21.824934 PROGRESS: Total precursors accumulated: 8
0:56:21.825012 PROGRESS: Target precursors: 8 (100.00%)
0:56:21.825093 PROGRESS: Decoy precursors: 0 (0.00%)
0:56:21.825157 PROGRESS: 
0:56:21.825219 PROGRESS: Precursor Summary:
0:56:21.826732 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
0:56:21.826849 PROGRESS: 
0:56:21.826923 PROGRESS: Protein Summary:
0:56:21.828607 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
0:56:21.828735 PROGRESS: =========================================================================
0:56:21.829623 PROGRESS: === Epoch 14, step 1, extracting elution groups 1000 to 3000 ===
0:56:21.907255 PROGRESS: Extracting batch of 3948 precursors
0:56:21.909334 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:56:21.909395 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:56:21.909433 INFO: FWHM in RT is 13.94 seconds, sigma is 0.51
0:56:21.909478 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:56:21.909691 INFO: Starting candidate selection
0:56:25.498618 INFO: Starting candidate scoring
0:56:26.809278 INFO: Finished candidate processing
0:56:26.809459 INFO: Collecting candidate features
0:56:28.990443 WARNING: intensity_correlation has 1 NaNs ( 0.03 % out of 3674)
0:56:28.996681 INFO: Collecting fragment features
0:56:29.616689 INFO: Finished candidate scoring
0:56:29.894885 PROGRESS: === Epoch 14, step 1, extracted 3674 precursors and 16850 fragments ===
0:56:29.895168 INFO: performing precursor FDR with 47 features
0:56:29.895215 INFO: Decoy channel: -1
0:56:29.895240 INFO: Competetive: True
0:56:29.903355 WARNING: dropped 2 decoy PSMs due to missing features
0:56:29.940001 INFO: Test AUC: 0.562
0:56:29.940122 INFO: Train AUC: 0.562
0:56:29.940168 INFO: AUC difference: 0.00%
0:56:30.059754 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
0:56:30.060527 PROGRESS: ============================= Precursor FDR =============================
0:56:30.060648 PROGRESS: Total precursors accumulated: 31
0:56:30.060726 PROGRESS: Target precursors: 29 (93.55%)
0:56:30.060794 PROGRESS: Decoy precursors: 2 (6.45%)
0:56:30.060856 PROGRESS: 
0:56:30.060916 PROGRESS: Precursor Summary:
0:56:30.062352 PROGRESS: Channel   0:	 0.05 FDR:    28; 0.01 FDR:    27; 0.001 FDR:    27
0:56:30.062483 PROGRESS: 
0:56:30.062558 PROGRESS: Protein Summary:
0:56:30.064171 PROGRESS: Channel   0:	 0.05 FDR:    28; 0.01 FDR:    27; 0.001 FDR:    27
0:56:30.064282 PROGRESS: =========================================================================
0:56:30.065125 PROGRESS: === Epoch 14, step 2, extracting elution groups 3000 to 7000 ===
0:56:30.147956 PROGRESS: Extracting batch of 7901 precursors
0:56:30.151192 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:56:30.151254 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:56:30.151291 INFO: FWHM in RT is 13.94 seconds, sigma is 0.51
0:56:30.151335 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:56:30.151554 INFO: Starting candidate selection
0:56:33.857961 INFO: Starting candidate scoring
0:56:35.221501 INFO: Finished candidate processing
0:56:35.221592 INFO: Collecting candidate features
0:56:37.414056 WARNING: intensity_correlation has 7 NaNs ( 0.10 % out of 7275)
0:56:37.420817 INFO: Collecting fragment features
0:56:38.048502 INFO: Finished candidate scoring
0:56:38.332314 PROGRESS: === Epoch 14, step 2, extracted 7275 precursors and 33329 fragments ===
0:56:38.332621 INFO: performing precursor FDR with 47 features
0:56:38.332665 INFO: Decoy channel: -1
0:56:38.332691 INFO: Competetive: True
0:56:38.347675 WARNING: dropped 5 target PSMs due to missing features
0:56:38.347775 WARNING: dropped 4 decoy PSMs due to missing features
0:56:38.686065 INFO: Test AUC: 0.548
0:56:38.686200 INFO: Train AUC: 0.592
0:56:38.686246 INFO: AUC difference: 7.31%
0:56:38.686281 WARNING: AUC difference > 5%. This may indicate overfitting.
0:56:38.830999 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
0:56:38.831865 PROGRESS: ============================= Precursor FDR =============================
0:56:38.831990 PROGRESS: Total precursors accumulated: 112
0:56:38.832068 PROGRESS: Target precursors: 102 (91.07%)
0:56:38.832136 PROGRESS: Decoy precursors: 10 (8.93%)
0:56:38.832199 PROGRESS: 
0:56:38.832261 PROGRESS: Precursor Summary:
0:56:38.833718 PROGRESS: Channel   0:	 0.05 FDR:    78; 0.01 FDR:    40; 0.001 FDR:    40
0:56:38.833855 PROGRESS: 
0:56:38.833930 PROGRESS: Protein Summary:
0:56:38.835600 PROGRESS: Channel   0:	 0.05 FDR:    78; 0.01 FDR:    40; 0.001 FDR:    40
0:56:38.835729 PROGRESS: =========================================================================
0:56:38.836605 PROGRESS: === Epoch 14, step 3, extracting elution groups 7000 to 15000 ===
0:56:38.928274 PROGRESS: Extracting batch of 15811 precursors
0:56:38.933521 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:56:38.933587 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:56:38.933622 INFO: FWHM in RT is 13.94 seconds, sigma is 0.51
0:56:38.933664 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:56:38.933894 INFO: Starting candidate selection
0:56:42.748076 INFO: Starting candidate scoring
0:56:44.166657 INFO: Finished candidate processing
0:56:44.166815 INFO: Collecting candidate features
0:56:46.396095 WARNING: intensity_correlation has 15 NaNs ( 0.10 % out of 14518)
0:56:46.396413 WARNING: height_correlation has 1 NaNs ( 0.01 % out of 14518)
0:56:46.402785 INFO: Collecting fragment features
0:56:47.040576 INFO: Finished candidate scoring
0:56:47.332592 PROGRESS: === Epoch 14, step 3, extracted 14518 precursors and 66201 fragments ===
0:56:47.332919 INFO: performing precursor FDR with 47 features
0:56:47.332967 INFO: Decoy channel: -1
0:56:47.332994 INFO: Competetive: True
0:56:47.361353 WARNING: dropped 14 target PSMs due to missing features
0:56:47.361465 WARNING: dropped 10 decoy PSMs due to missing features
0:56:48.116414 INFO: Test AUC: 0.535
0:56:48.116566 INFO: Train AUC: 0.608
0:56:48.123417 INFO: AUC difference: 11.98%
0:56:48.123544 WARNING: AUC difference > 5%. This may indicate overfitting.
0:56:48.246688 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
0:56:48.247668 PROGRESS: ============================= Precursor FDR =============================
0:56:48.247788 PROGRESS: Total precursors accumulated: 377
0:56:48.247864 PROGRESS: Target precursors: 345 (91.51%)
0:56:48.247929 PROGRESS: Decoy precursors: 32 (8.49%)
0:56:48.247988 PROGRESS: 
0:56:48.248046 PROGRESS: Precursor Summary:
0:56:48.249570 PROGRESS: Channel   0:	 0.05 FDR:   223; 0.01 FDR:   104; 0.001 FDR:    67
0:56:48.249682 PROGRESS: 
0:56:48.249754 PROGRESS: Protein Summary:
0:56:48.251571 PROGRESS: Channel   0:	 0.05 FDR:   221; 0.01 FDR:   103; 0.001 FDR:    66
0:56:48.251681 PROGRESS: =========================================================================
0:56:48.252583 PROGRESS: === Epoch 14, step 4, extracting elution groups 15000 to 31000 ===
0:56:48.360389 PROGRESS: Extracting batch of 31607 precursors
0:56:48.371084 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:56:48.371195 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:56:48.371253 INFO: FWHM in RT is 13.94 seconds, sigma is 0.51
0:56:48.371281 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:56:48.371520 INFO: Starting candidate selection
0:56:52.510374 INFO: Starting candidate scoring
0:56:54.074296 INFO: Finished candidate processing
0:56:54.074390 INFO: Collecting candidate features
0:56:56.339217 WARNING: intensity_correlation has 21 NaNs ( 0.07 % out of 29030)
0:56:56.346216 INFO: Collecting fragment features
0:56:56.998303 INFO: Finished candidate scoring
0:56:57.307889 PROGRESS: === Epoch 14, step 4, extracted 29030 precursors and 132500 fragments ===
0:56:57.308221 INFO: performing precursor FDR with 47 features
0:56:57.308282 INFO: Decoy channel: -1
0:56:57.308322 INFO: Competetive: True
0:56:57.366330 WARNING: dropped 22 target PSMs due to missing features
0:56:57.366459 WARNING: dropped 23 decoy PSMs due to missing features
0:56:59.028643 INFO: Test AUC: 0.560
0:56:59.028791 INFO: Train AUC: 0.605
0:56:59.028837 INFO: AUC difference: 7.43%
0:56:59.028871 WARNING: AUC difference > 5%. This may indicate overfitting.
0:56:59.169320 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
0:56:59.177260 PROGRESS: ============================= Precursor FDR =============================
0:56:59.177402 PROGRESS: Total precursors accumulated: 735
0:56:59.177482 PROGRESS: Target precursors: 671 (91.29%)
0:56:59.177551 PROGRESS: Decoy precursors: 64 (8.71%)
0:56:59.177622 PROGRESS: 
0:56:59.177685 PROGRESS: Precursor Summary:
0:56:59.179362 PROGRESS: Channel   0:	 0.05 FDR:   421; 0.01 FDR:   219; 0.001 FDR:   170
0:56:59.179493 PROGRESS: 
0:56:59.179567 PROGRESS: Protein Summary:
0:56:59.181524 PROGRESS: Channel   0:	 0.05 FDR:   406; 0.01 FDR:   209; 0.001 FDR:   163
0:56:59.181636 PROGRESS: =========================================================================
0:56:59.182639 PROGRESS: === Epoch 14, step 5, extracting elution groups 31000 to 63000 ===
0:56:59.319237 PROGRESS: Extracting batch of 63255 precursors
0:56:59.338836 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:56:59.338943 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:56:59.338983 INFO: FWHM in RT is 13.94 seconds, sigma is 0.51
0:56:59.339031 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:56:59.339283 INFO: Starting candidate selection
0:57:04.157461 INFO: Starting candidate scoring
0:57:06.039202 INFO: Finished candidate processing
0:57:06.039296 INFO: Collecting candidate features
0:57:08.399993 WARNING: intensity_correlation has 50 NaNs ( 0.09 % out of 58176)
0:57:08.408734 INFO: Collecting fragment features
0:57:09.092481 INFO: Finished candidate scoring
0:57:09.437423 PROGRESS: === Epoch 14, step 5, extracted 58176 precursors and 265185 fragments ===
0:57:09.437754 INFO: performing precursor FDR with 47 features
0:57:09.437815 INFO: Decoy channel: -1
0:57:09.437842 INFO: Competetive: True
0:57:09.566100 WARNING: dropped 51 target PSMs due to missing features
0:57:09.566235 WARNING: dropped 44 decoy PSMs due to missing features
0:57:13.555934 INFO: Test AUC: 0.557
0:57:13.556054 INFO: Train AUC: 0.604
0:57:13.556108 INFO: AUC difference: 7.83%
0:57:13.556137 WARNING: AUC difference > 5%. This may indicate overfitting.
0:57:13.693030 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
0:57:13.694381 PROGRESS: ============================= Precursor FDR =============================
0:57:13.694513 PROGRESS: Total precursors accumulated: 1,358
0:57:13.694592 PROGRESS: Target precursors: 1,239 (91.24%)
0:57:13.694662 PROGRESS: Decoy precursors: 119 (8.76%)
0:57:13.694726 PROGRESS: 
0:57:13.694789 PROGRESS: Precursor Summary:
0:57:13.696607 PROGRESS: Channel   0:	 0.05 FDR:   743; 0.01 FDR:   429; 0.001 FDR:   345
0:57:13.696722 PROGRESS: 
0:57:13.696794 PROGRESS: Protein Summary:
0:57:13.699044 PROGRESS: Channel   0:	 0.05 FDR:   702; 0.01 FDR:   404; 0.001 FDR:   326
0:57:13.699167 PROGRESS: =========================================================================
0:57:13.700267 PROGRESS: === Epoch 14, step 6, extracting elution groups 63000 to 127000 ===
0:57:13.877004 PROGRESS: Extracting batch of 126484 precursors
0:57:13.915128 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:57:13.915244 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:57:13.915282 INFO: FWHM in RT is 13.94 seconds, sigma is 0.51
0:57:13.915327 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:57:13.915585 INFO: Starting candidate selection
0:57:19.979775 INFO: Starting candidate scoring
0:57:22.439363 INFO: Finished candidate processing
0:57:22.439521 INFO: Collecting candidate features
0:57:24.988551 WARNING: intensity_correlation has 88 NaNs ( 0.08 % out of 116335)
0:57:25.001545 INFO: Collecting fragment features
0:57:25.744152 INFO: Finished candidate scoring
0:57:26.166998 PROGRESS: === Epoch 14, step 6, extracted 116335 precursors and 531257 fragments ===
0:57:26.167322 INFO: performing precursor FDR with 47 features
0:57:26.167366 INFO: Decoy channel: -1
0:57:26.167394 INFO: Competetive: True
0:57:26.438037 WARNING: dropped 95 target PSMs due to missing features
0:57:26.438169 WARNING: dropped 88 decoy PSMs due to missing features
0:57:34.478357 INFO: Test AUC: 0.548
0:57:34.478501 INFO: Train AUC: 0.595
0:57:34.478543 INFO: AUC difference: 7.82%
0:57:34.478571 WARNING: AUC difference > 5%. This may indicate overfitting.
0:57:34.630843 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
0:57:34.632424 PROGRESS: ============================= Precursor FDR =============================
0:57:34.632569 PROGRESS: Total precursors accumulated: 2,128
0:57:34.632647 PROGRESS: Target precursors: 1,941 (91.21%)
0:57:34.632715 PROGRESS: Decoy precursors: 187 (8.79%)
0:57:34.632777 PROGRESS: 
0:57:34.632839 PROGRESS: Precursor Summary:
0:57:34.634920 PROGRESS: Channel   0:	 0.05 FDR: 1,132; 0.01 FDR:   686; 0.001 FDR:   519
0:57:34.635053 PROGRESS: 
0:57:34.635128 PROGRESS: Protein Summary:
0:57:34.637676 PROGRESS: Channel   0:	 0.05 FDR: 1,029; 0.01 FDR:   628; 0.001 FDR:   475
0:57:34.637814 PROGRESS: =========================================================================
0:57:34.639101 PROGRESS: === Epoch 14, step 7, extracting elution groups 127000 to 255000 ===
0:57:34.864607 PROGRESS: Extracting batch of 252997 precursors
0:57:34.936885 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:57:34.936999 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:57:34.937041 INFO: FWHM in RT is 13.94 seconds, sigma is 0.51
0:57:34.937085 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:57:34.937342 INFO: Starting candidate selection
0:57:43.530907 INFO: Starting candidate scoring
0:57:47.206604 INFO: Finished candidate processing
0:57:47.206788 INFO: Collecting candidate features
0:57:50.137076 WARNING: intensity_correlation has 158 NaNs ( 0.07 % out of 232697)
0:57:50.157190 INFO: Collecting fragment features
0:57:50.979599 INFO: Finished candidate scoring
0:57:51.556382 PROGRESS: === Epoch 14, step 7, extracted 232697 precursors and 1062166 fragments ===
0:57:51.556716 INFO: performing precursor FDR with 47 features
0:57:51.556765 INFO: Decoy channel: -1
0:57:51.556792 INFO: Competetive: True
0:57:52.136177 WARNING: dropped 174 target PSMs due to missing features
0:57:52.136298 WARNING: dropped 167 decoy PSMs due to missing features
0:58:09.354483 INFO: Test AUC: 0.549
0:58:09.354611 INFO: Train AUC: 0.581
0:58:09.354667 INFO: AUC difference: 5.50%
0:58:09.354696 WARNING: AUC difference > 5%. This may indicate overfitting.
0:58:09.563008 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
0:58:09.565088 PROGRESS: ============================= Precursor FDR =============================
0:58:09.565242 PROGRESS: Total precursors accumulated: 3,747
0:58:09.565320 PROGRESS: Target precursors: 3,414 (91.11%)
0:58:09.565389 PROGRESS: Decoy precursors: 333 (8.89%)
0:58:09.565452 PROGRESS: 
0:58:09.565514 PROGRESS: Precursor Summary:
0:58:09.568195 PROGRESS: Channel   0:	 0.05 FDR: 2,510; 0.01 FDR: 1,445; 0.001 FDR: 1,095
0:58:09.568340 PROGRESS: 
0:58:09.568415 PROGRESS: Protein Summary:
0:58:09.571907 PROGRESS: Channel   0:	 0.05 FDR: 2,068; 0.01 FDR: 1,186; 0.001 FDR:   919
0:58:09.572023 PROGRESS: =========================================================================
0:58:09.573642 PROGRESS: === Epoch 14, step 8, extracting elution groups 255000 to 511000 ===
0:58:09.876354 PROGRESS: Extracting batch of 505778 precursors
0:58:10.010383 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:58:10.010517 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:58:10.010561 INFO: FWHM in RT is 13.94 seconds, sigma is 0.51
0:58:10.010587 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:58:10.010853 INFO: Starting candidate selection
0:58:23.649941 INFO: Starting candidate scoring
0:58:29.732753 INFO: Finished candidate processing
0:58:29.732948 INFO: Collecting candidate features
0:58:33.342151 WARNING: intensity_correlation has 340 NaNs ( 0.07 % out of 465631)
0:58:33.374775 INFO: Collecting fragment features
0:58:34.382967 INFO: Finished candidate scoring
0:58:35.250871 PROGRESS: === Epoch 14, step 8, extracted 465631 precursors and 2127944 fragments ===
0:58:35.258079 INFO: performing precursor FDR with 47 features
0:58:35.258234 INFO: Decoy channel: -1
0:58:35.258323 INFO: Competetive: True
0:58:36.347639 WARNING: dropped 348 target PSMs due to missing features
0:58:36.347759 WARNING: dropped 333 decoy PSMs due to missing features
0:59:10.405187 INFO: Test AUC: 0.550
0:59:10.405335 INFO: Train AUC: 0.570
0:59:10.405376 INFO: AUC difference: 3.58%
0:59:10.641361 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
0:59:10.644046 PROGRESS: ============================= Precursor FDR =============================
0:59:10.644200 PROGRESS: Total precursors accumulated: 6,343
0:59:10.644277 PROGRESS: Target precursors: 5,783 (91.17%)
0:59:10.644343 PROGRESS: Decoy precursors: 560 (8.83%)
0:59:10.644418 PROGRESS: 
0:59:10.644480 PROGRESS: Precursor Summary:
0:59:10.647957 PROGRESS: Channel   0:	 0.05 FDR: 4,506; 0.01 FDR: 3,181; 0.001 FDR: 2,251
0:59:10.648099 PROGRESS: 
0:59:10.648171 PROGRESS: Protein Summary:
0:59:10.653162 PROGRESS: Channel   0:	 0.05 FDR: 3,222; 0.01 FDR: 2,238; 0.001 FDR: 1,645
0:59:10.653295 PROGRESS: =========================================================================
0:59:10.657405 INFO: calibration group: precursor, fitting rt estimator 
0:59:11.025336 INFO: calibration group: fragment, fitting mz estimator 
0:59:11.614935 INFO: === checking if epoch conditions were reached ===
0:59:11.615123 INFO: ✅ ms2_error      : 7.0000 <= 7
0:59:11.615213 INFO: ❌ rt_error       : 200.5218 > 100
0:59:11.615288 INFO: ✅ current_epoch  : 14 >= 3
0:59:11.615354 INFO: ==============================================
0:59:11.860267 INFO: calibration group: precursor, predicting mz
0:59:11.860532 WARNING: mz prediction was skipped as it has not been fitted yet
0:59:11.860574 INFO: calibration group: precursor, predicting rt
0:59:18.680135 INFO: calibration group: fragment, predicting mz
0:59:36.298124 PROGRESS: === Epoch 15, step 0, extracting elution groups 0 to 1000 ===
0:59:36.396312 PROGRESS: Extracting batch of 1979 precursors
0:59:36.398031 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:59:36.398108 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:59:36.398147 INFO: FWHM in RT is 13.89 seconds, sigma is 0.51
0:59:36.398194 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:59:36.398426 INFO: Starting candidate selection
0:59:40.338529 INFO: Starting candidate scoring
0:59:41.633179 INFO: Finished candidate processing
0:59:41.633272 INFO: Collecting candidate features
0:59:43.813016 INFO: Collecting fragment features
0:59:44.450798 INFO: Finished candidate scoring
0:59:44.790964 PROGRESS: === Epoch 15, step 0, extracted 1810 precursors and 8138 fragments ===
0:59:44.791279 INFO: performing precursor FDR with 47 features
0:59:44.791335 INFO: Decoy channel: -1
0:59:44.791362 INFO: Competetive: True
0:59:44.824384 INFO: Test AUC: 0.502
0:59:44.824489 INFO: Train AUC: 0.554
0:59:44.824534 INFO: AUC difference: 9.35%
0:59:44.824567 WARNING: AUC difference > 5%. This may indicate overfitting.
0:59:46.175687 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
0:59:46.176602 PROGRESS: ============================= Precursor FDR =============================
0:59:46.176730 PROGRESS: Total precursors accumulated: 4
0:59:46.176808 PROGRESS: Target precursors: 4 (100.00%)
0:59:46.176877 PROGRESS: Decoy precursors: 0 (0.00%)
0:59:46.176939 PROGRESS: 
0:59:46.177001 PROGRESS: Precursor Summary:
0:59:46.178689 PROGRESS: Channel   0:	 0.05 FDR:     4; 0.01 FDR:     4; 0.001 FDR:     4
0:59:46.178806 PROGRESS: 
0:59:46.178880 PROGRESS: Protein Summary:
0:59:46.180578 PROGRESS: Channel   0:	 0.05 FDR:     4; 0.01 FDR:     4; 0.001 FDR:     4
0:59:46.180692 PROGRESS: =========================================================================
0:59:46.181578 PROGRESS: === Epoch 15, step 1, extracting elution groups 1000 to 3000 ===
0:59:46.258715 PROGRESS: Extracting batch of 3947 precursors
0:59:46.260814 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:59:46.260874 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:59:46.260911 INFO: FWHM in RT is 13.89 seconds, sigma is 0.51
0:59:46.260955 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:59:46.261165 INFO: Starting candidate selection
0:59:49.884151 INFO: Starting candidate scoring
0:59:51.206403 INFO: Finished candidate processing
0:59:51.206492 INFO: Collecting candidate features
0:59:53.366154 WARNING: intensity_correlation has 2 NaNs ( 0.05 % out of 3638)
0:59:53.372217 INFO: Collecting fragment features
0:59:54.000124 INFO: Finished candidate scoring
0:59:54.277710 PROGRESS: === Epoch 15, step 1, extracted 3638 precursors and 16594 fragments ===
0:59:54.278008 INFO: performing precursor FDR with 47 features
0:59:54.278054 INFO: Decoy channel: -1
0:59:54.278079 INFO: Competetive: True
0:59:54.286195 WARNING: dropped 2 target PSMs due to missing features
0:59:54.323214 INFO: Test AUC: 0.544
0:59:54.323332 INFO: Train AUC: 0.535
0:59:54.323376 INFO: AUC difference: 1.75%
0:59:54.446688 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
0:59:54.447467 PROGRESS: ============================= Precursor FDR =============================
0:59:54.447588 PROGRESS: Total precursors accumulated: 20
0:59:54.447666 PROGRESS: Target precursors: 19 (95.00%)
0:59:54.447735 PROGRESS: Decoy precursors: 1 (5.00%)
0:59:54.447798 PROGRESS: 
0:59:54.447871 PROGRESS: Precursor Summary:
0:59:54.449277 PROGRESS: Channel   0:	 0.05 FDR:    19; 0.01 FDR:    19; 0.001 FDR:    19
0:59:54.449389 PROGRESS: 
0:59:54.449478 PROGRESS: Protein Summary:
0:59:54.451097 PROGRESS: Channel   0:	 0.05 FDR:    19; 0.01 FDR:    19; 0.001 FDR:    19
0:59:54.451225 PROGRESS: =========================================================================
0:59:54.452070 PROGRESS: === Epoch 15, step 2, extracting elution groups 3000 to 7000 ===
0:59:54.533993 PROGRESS: Extracting batch of 7910 precursors
0:59:54.537183 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
0:59:54.537243 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
0:59:54.537281 INFO: FWHM in RT is 13.89 seconds, sigma is 0.51
0:59:54.537326 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
0:59:54.537544 INFO: Starting candidate selection
0:59:58.244681 INFO: Starting candidate scoring
0:59:59.617087 INFO: Finished candidate processing
0:59:59.617271 INFO: Collecting candidate features
1:00:01.789561 WARNING: intensity_correlation has 1 NaNs ( 0.01 % out of 7274)
1:00:01.795169 INFO: Collecting fragment features
1:00:02.420654 INFO: Finished candidate scoring
1:00:02.702790 PROGRESS: === Epoch 15, step 2, extracted 7274 precursors and 33437 fragments ===
1:00:02.703105 INFO: performing precursor FDR with 47 features
1:00:02.703153 INFO: Decoy channel: -1
1:00:02.703189 INFO: Competetive: True
1:00:02.717385 WARNING: dropped 3 target PSMs due to missing features
1:00:03.001724 INFO: Test AUC: 0.537
1:00:03.001870 INFO: Train AUC: 0.583
1:00:03.001917 INFO: AUC difference: 7.89%
1:00:03.001951 WARNING: AUC difference > 5%. This may indicate overfitting.
1:00:03.124545 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
1:00:03.125396 PROGRESS: ============================= Precursor FDR =============================
1:00:03.125518 PROGRESS: Total precursors accumulated: 80
1:00:03.125596 PROGRESS: Target precursors: 73 (91.25%)
1:00:03.125665 PROGRESS: Decoy precursors: 7 (8.75%)
1:00:03.125730 PROGRESS: 
1:00:03.125801 PROGRESS: Precursor Summary:
1:00:03.127266 PROGRESS: Channel   0:	 0.05 FDR:    51; 0.01 FDR:    39; 0.001 FDR:    39
1:00:03.127397 PROGRESS: 
1:00:03.127470 PROGRESS: Protein Summary:
1:00:03.129124 PROGRESS: Channel   0:	 0.05 FDR:    51; 0.01 FDR:    39; 0.001 FDR:    39
1:00:03.129238 PROGRESS: =========================================================================
1:00:03.130141 PROGRESS: === Epoch 15, step 3, extracting elution groups 7000 to 15000 ===
1:00:03.222311 PROGRESS: Extracting batch of 15802 precursors
1:00:03.227876 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:00:03.227943 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:00:03.227978 INFO: FWHM in RT is 13.89 seconds, sigma is 0.51
1:00:03.228021 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:00:03.228246 INFO: Starting candidate selection
1:00:07.071531 INFO: Starting candidate scoring
1:00:08.495932 INFO: Finished candidate processing
1:00:08.496083 INFO: Collecting candidate features
1:00:10.694660 WARNING: intensity_correlation has 10 NaNs ( 0.07 % out of 14463)
1:00:10.702052 INFO: Collecting fragment features
1:00:11.332281 INFO: Finished candidate scoring
1:00:11.623077 PROGRESS: === Epoch 15, step 3, extracted 14463 precursors and 66149 fragments ===
1:00:11.623397 INFO: performing precursor FDR with 47 features
1:00:11.623445 INFO: Decoy channel: -1
1:00:11.623472 INFO: Competetive: True
1:00:11.651303 WARNING: dropped 8 target PSMs due to missing features
1:00:11.651436 WARNING: dropped 5 decoy PSMs due to missing features
1:00:12.304138 INFO: Test AUC: 0.552
1:00:12.304305 INFO: Train AUC: 0.606
1:00:12.304362 INFO: AUC difference: 8.82%
1:00:12.304397 WARNING: AUC difference > 5%. This may indicate overfitting.
1:00:12.432892 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
1:00:12.433836 PROGRESS: ============================= Precursor FDR =============================
1:00:12.433962 PROGRESS: Total precursors accumulated: 245
1:00:12.434039 PROGRESS: Target precursors: 223 (91.02%)
1:00:12.434107 PROGRESS: Decoy precursors: 22 (8.98%)
1:00:12.434170 PROGRESS: 
1:00:12.434232 PROGRESS: Precursor Summary:
1:00:12.435763 PROGRESS: Channel   0:	 0.05 FDR:   155; 0.01 FDR:   114; 0.001 FDR:    88
1:00:12.435891 PROGRESS: 
1:00:12.435966 PROGRESS: Protein Summary:
1:00:12.437717 PROGRESS: Channel   0:	 0.05 FDR:   152; 0.01 FDR:   111; 0.001 FDR:    86
1:00:12.437839 PROGRESS: =========================================================================
1:00:12.438748 PROGRESS: === Epoch 15, step 4, extracting elution groups 15000 to 31000 ===
1:00:12.546252 PROGRESS: Extracting batch of 31624 precursors
1:00:12.556608 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:00:12.556722 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:00:12.556765 INFO: FWHM in RT is 13.89 seconds, sigma is 0.51
1:00:12.556793 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:00:12.557033 INFO: Starting candidate selection
1:00:16.733061 INFO: Starting candidate scoring
1:00:18.311475 INFO: Finished candidate processing
1:00:18.311669 INFO: Collecting candidate features
1:00:20.563602 WARNING: intensity_correlation has 19 NaNs ( 0.07 % out of 28928)
1:00:20.563937 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 28928)
1:00:20.570598 INFO: Collecting fragment features
1:00:21.219737 INFO: Finished candidate scoring
1:00:21.526086 PROGRESS: === Epoch 15, step 4, extracted 28928 precursors and 131827 fragments ===
1:00:21.526421 INFO: performing precursor FDR with 47 features
1:00:21.526470 INFO: Decoy channel: -1
1:00:21.526497 INFO: Competetive: True
1:00:21.583210 WARNING: dropped 15 target PSMs due to missing features
1:00:21.583335 WARNING: dropped 17 decoy PSMs due to missing features
1:00:23.387698 INFO: Test AUC: 0.542
1:00:23.387844 INFO: Train AUC: 0.610
1:00:23.394791 INFO: AUC difference: 11.10%
1:00:23.394952 WARNING: AUC difference > 5%. This may indicate overfitting.
1:00:23.525347 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
1:00:23.526411 PROGRESS: ============================= Precursor FDR =============================
1:00:23.526544 PROGRESS: Total precursors accumulated: 588
1:00:23.526623 PROGRESS: Target precursors: 535 (90.99%)
1:00:23.526692 PROGRESS: Decoy precursors: 53 (9.01%)
1:00:23.526754 PROGRESS: 
1:00:23.526815 PROGRESS: Precursor Summary:
1:00:23.528483 PROGRESS: Channel   0:	 0.05 FDR:   335; 0.01 FDR:   219; 0.001 FDR:   215
1:00:23.528613 PROGRESS: 
1:00:23.528687 PROGRESS: Protein Summary:
1:00:23.530658 PROGRESS: Channel   0:	 0.05 FDR:   328; 0.01 FDR:   213; 0.001 FDR:   210
1:00:23.530771 PROGRESS: =========================================================================
1:00:23.531769 PROGRESS: === Epoch 15, step 5, extracting elution groups 31000 to 63000 ===
1:00:23.667820 PROGRESS: Extracting batch of 63258 precursors
1:00:23.687307 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:00:23.687421 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:00:23.687459 INFO: FWHM in RT is 13.89 seconds, sigma is 0.51
1:00:23.687487 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:00:23.687734 INFO: Starting candidate selection
1:00:28.502276 INFO: Starting candidate scoring
1:00:30.384354 INFO: Finished candidate processing
1:00:30.384444 INFO: Collecting candidate features
1:00:32.749935 WARNING: intensity_correlation has 51 NaNs ( 0.09 % out of 58212)
1:00:32.758803 INFO: Collecting fragment features
1:00:33.448034 INFO: Finished candidate scoring
1:00:33.793192 PROGRESS: === Epoch 15, step 5, extracted 58212 precursors and 265362 fragments ===
1:00:33.794411 INFO: performing precursor FDR with 47 features
1:00:33.794541 INFO: Decoy channel: -1
1:00:33.794626 INFO: Competetive: True
1:00:33.925366 WARNING: dropped 39 target PSMs due to missing features
1:00:33.925480 WARNING: dropped 44 decoy PSMs due to missing features
1:00:37.930396 INFO: Test AUC: 0.551
1:00:37.930533 INFO: Train AUC: 0.604
1:00:37.930573 INFO: AUC difference: 8.82%
1:00:37.930602 WARNING: AUC difference > 5%. This may indicate overfitting.
1:00:38.062068 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
1:00:38.063459 PROGRESS: ============================= Precursor FDR =============================
1:00:38.063600 PROGRESS: Total precursors accumulated: 1,442
1:00:38.063678 PROGRESS: Target precursors: 1,314 (91.12%)
1:00:38.063746 PROGRESS: Decoy precursors: 128 (8.88%)
1:00:38.063812 PROGRESS: 
1:00:38.063874 PROGRESS: Precursor Summary:
1:00:38.065750 PROGRESS: Channel   0:	 0.05 FDR:   882; 0.01 FDR:   371; 0.001 FDR:   224
1:00:38.065898 PROGRESS: 
1:00:38.065973 PROGRESS: Protein Summary:
1:00:38.068200 PROGRESS: Channel   0:	 0.05 FDR:   847; 0.01 FDR:   356; 0.001 FDR:   214
1:00:38.068311 PROGRESS: =========================================================================
1:00:38.069409 PROGRESS: === Epoch 15, step 6, extracting elution groups 63000 to 127000 ===
1:00:38.245809 PROGRESS: Extracting batch of 126492 precursors
1:00:38.283739 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:00:38.283867 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:00:38.283907 INFO: FWHM in RT is 13.89 seconds, sigma is 0.51
1:00:38.283934 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:00:38.284201 INFO: Starting candidate selection
1:00:44.331422 INFO: Starting candidate scoring
1:00:46.763095 INFO: Finished candidate processing
1:00:46.763186 INFO: Collecting candidate features
1:00:49.290553 WARNING: intensity_correlation has 76 NaNs ( 0.07 % out of 116184)
1:00:49.303321 INFO: Collecting fragment features
1:00:50.039801 INFO: Finished candidate scoring
1:00:50.458447 PROGRESS: === Epoch 15, step 6, extracted 116184 precursors and 530199 fragments ===
1:00:50.458786 INFO: performing precursor FDR with 47 features
1:00:50.458832 INFO: Decoy channel: -1
1:00:50.458858 INFO: Competetive: True
1:00:50.723854 WARNING: dropped 79 target PSMs due to missing features
1:00:50.723969 WARNING: dropped 80 decoy PSMs due to missing features
1:00:58.881719 INFO: Test AUC: 0.551
1:00:58.881876 INFO: Train AUC: 0.594
1:00:58.881918 INFO: AUC difference: 7.20%
1:00:58.881946 WARNING: AUC difference > 5%. This may indicate overfitting.
1:00:59.035393 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
1:00:59.037038 PROGRESS: ============================= Precursor FDR =============================
1:00:59.037189 PROGRESS: Total precursors accumulated: 2,330
1:00:59.037269 PROGRESS: Target precursors: 2,122 (91.07%)
1:00:59.037337 PROGRESS: Decoy precursors: 208 (8.93%)
1:00:59.037400 PROGRESS: 
1:00:59.037462 PROGRESS: Precursor Summary:
1:00:59.039670 PROGRESS: Channel   0:	 0.05 FDR: 1,352; 0.01 FDR:   784; 0.001 FDR:   660
1:00:59.039810 PROGRESS: 
1:00:59.039885 PROGRESS: Protein Summary:
1:00:59.042632 PROGRESS: Channel   0:	 0.05 FDR: 1,220; 0.01 FDR:   713; 0.001 FDR:   605
1:00:59.042747 PROGRESS: =========================================================================
1:00:59.044094 PROGRESS: === Epoch 15, step 7, extracting elution groups 127000 to 255000 ===
1:00:59.268203 PROGRESS: Extracting batch of 253005 precursors
1:00:59.340356 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:00:59.340474 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:00:59.340512 INFO: FWHM in RT is 13.89 seconds, sigma is 0.51
1:00:59.340555 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:00:59.340814 INFO: Starting candidate selection
1:01:07.980554 INFO: Starting candidate scoring
1:01:11.619145 INFO: Finished candidate processing
1:01:11.619235 INFO: Collecting candidate features
1:01:14.533520 WARNING: intensity_correlation has 174 NaNs ( 0.07 % out of 232300)
1:01:14.553331 INFO: Collecting fragment features
1:01:15.383742 INFO: Finished candidate scoring
1:01:15.957606 PROGRESS: === Epoch 15, step 7, extracted 232300 precursors and 1060766 fragments ===
1:01:15.957946 INFO: performing precursor FDR with 47 features
1:01:15.957994 INFO: Decoy channel: -1
1:01:15.958021 INFO: Competetive: True
1:01:16.533719 WARNING: dropped 177 target PSMs due to missing features
1:01:16.533869 WARNING: dropped 156 decoy PSMs due to missing features
1:01:32.696365 INFO: Test AUC: 0.550
1:01:32.696496 INFO: Train AUC: 0.579
1:01:32.696552 INFO: AUC difference: 5.03%
1:01:32.696580 WARNING: AUC difference > 5%. This may indicate overfitting.
1:01:32.885337 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
1:01:32.887378 PROGRESS: ============================= Precursor FDR =============================
1:01:32.887516 PROGRESS: Total precursors accumulated: 3,596
1:01:32.887596 PROGRESS: Target precursors: 3,279 (91.18%)
1:01:32.887664 PROGRESS: Decoy precursors: 317 (8.82%)
1:01:32.887725 PROGRESS: 
1:01:32.887785 PROGRESS: Precursor Summary:
1:01:32.890486 PROGRESS: Channel   0:	 0.05 FDR: 2,463; 0.01 FDR: 1,688; 0.001 FDR: 1,251
1:01:32.890618 PROGRESS: 
1:01:32.890692 PROGRESS: Protein Summary:
1:01:32.894238 PROGRESS: Channel   0:	 0.05 FDR: 2,014; 0.01 FDR: 1,366; 0.001 FDR: 1,020
1:01:32.894352 PROGRESS: =========================================================================
1:01:32.896091 PROGRESS: === Epoch 15, step 8, extracting elution groups 255000 to 511000 ===
1:01:33.197646 PROGRESS: Extracting batch of 505821 precursors
1:01:33.329806 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:01:33.329937 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:01:33.329981 INFO: FWHM in RT is 13.89 seconds, sigma is 0.51
1:01:33.330009 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:01:33.330273 INFO: Starting candidate selection
1:01:46.998554 INFO: Starting candidate scoring
1:01:52.982042 INFO: Finished candidate processing
1:01:52.982149 INFO: Collecting candidate features
1:01:56.583601 WARNING: intensity_correlation has 299 NaNs ( 0.06 % out of 464363)
1:01:56.616427 INFO: Collecting fragment features
1:01:57.631526 INFO: Finished candidate scoring
1:01:58.498202 PROGRESS: === Epoch 15, step 8, extracted 464363 precursors and 2120475 fragments ===
1:01:58.505458 INFO: performing precursor FDR with 47 features
1:01:58.505623 INFO: Decoy channel: -1
1:01:58.505653 INFO: Competetive: True
1:01:59.601571 WARNING: dropped 328 target PSMs due to missing features
1:01:59.601706 WARNING: dropped 304 decoy PSMs due to missing features
1:02:33.687730 INFO: Test AUC: 0.551
1:02:33.687858 INFO: Train AUC: 0.569
1:02:33.687915 INFO: AUC difference: 3.06%
1:02:33.924342 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
1:02:33.926989 PROGRESS: ============================= Precursor FDR =============================
1:02:33.927155 PROGRESS: Total precursors accumulated: 6,073
1:02:33.927235 PROGRESS: Target precursors: 5,536 (91.16%)
1:02:33.927301 PROGRESS: Decoy precursors: 537 (8.84%)
1:02:33.927364 PROGRESS: 
1:02:33.927425 PROGRESS: Precursor Summary:
1:02:33.930866 PROGRESS: Channel   0:	 0.05 FDR: 4,371; 0.01 FDR: 3,168; 0.001 FDR: 2,456
1:02:33.931018 PROGRESS: 
1:02:33.931089 PROGRESS: Protein Summary:
1:02:33.936026 PROGRESS: Channel   0:	 0.05 FDR: 3,102; 0.01 FDR: 2,198; 0.001 FDR: 1,760
1:02:33.936144 PROGRESS: =========================================================================
1:02:33.938605 PROGRESS: === Epoch 15, step 9, extracting elution groups 511000 to 1023000 ===
1:02:34.362961 PROGRESS: Extracting batch of 1011706 precursors
1:02:34.637080 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:02:34.637190 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:02:34.637229 INFO: FWHM in RT is 13.89 seconds, sigma is 0.51
1:02:34.637272 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:02:34.637538 INFO: Starting candidate selection
1:02:58.435702 INFO: Starting candidate scoring
1:03:09.443838 INFO: Finished candidate processing
1:03:09.444028 INFO: Collecting candidate features
1:03:14.429254 WARNING: intensity_correlation has 623 NaNs ( 0.07 % out of 928478)
1:03:14.488425 INFO: Collecting fragment features
1:03:16.151724 INFO: Finished candidate scoring
1:03:17.720126 PROGRESS: === Epoch 15, step 9, extracted 928478 precursors and 4240988 fragments ===
1:03:17.720469 INFO: performing precursor FDR with 47 features
1:03:17.720516 INFO: Decoy channel: -1
1:03:17.720543 INFO: Competetive: True
1:03:20.001932 WARNING: dropped 631 target PSMs due to missing features
1:03:20.002055 WARNING: dropped 624 decoy PSMs due to missing features
1:04:29.621142 INFO: Test AUC: 0.552
1:04:29.621266 INFO: Train AUC: 0.561
1:04:29.621300 INFO: AUC difference: 1.73%
1:04:29.967746 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
1:04:29.971452 PROGRESS: ============================= Precursor FDR =============================
1:04:29.971640 PROGRESS: Total precursors accumulated: 10,704
1:04:29.971723 PROGRESS: Target precursors: 9,768 (91.26%)
1:04:29.971794 PROGRESS: Decoy precursors: 936 (8.74%)
1:04:29.971856 PROGRESS: 
1:04:29.971915 PROGRESS: Precursor Summary:
1:04:29.977144 PROGRESS: Channel   0:	 0.05 FDR: 8,306; 0.01 FDR: 6,481; 0.001 FDR: 4,271
1:04:29.977325 PROGRESS: 
1:04:29.977399 PROGRESS: Protein Summary:
1:04:29.984960 PROGRESS: Channel   0:	 0.05 FDR: 4,571; 0.01 FDR: 3,524; 0.001 FDR: 2,507
1:04:29.985119 PROGRESS: =========================================================================
1:04:29.991635 INFO: calibration group: precursor, fitting rt estimator 
1:04:30.969860 INFO: calibration group: fragment, fitting mz estimator 
1:04:31.569434 INFO: === checking if epoch conditions were reached ===
1:04:31.569633 INFO: ✅ ms2_error      : 7.0000 <= 7
1:04:31.569712 INFO: ❌ rt_error       : 199.4093 > 100
1:04:31.569783 INFO: ✅ current_epoch  : 15 >= 3
1:04:31.569844 INFO: ==============================================
1:04:31.778700 INFO: calibration group: precursor, predicting mz
1:04:31.778959 WARNING: mz prediction was skipped as it has not been fitted yet
1:04:31.778999 INFO: calibration group: precursor, predicting rt
1:04:38.603315 INFO: calibration group: fragment, predicting mz
1:04:56.495922 PROGRESS: === Epoch 16, step 0, extracting elution groups 0 to 1000 ===
1:04:56.617011 PROGRESS: Extracting batch of 1974 precursors
1:04:56.618742 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:04:56.618839 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:04:56.618881 INFO: FWHM in RT is 13.94 seconds, sigma is 0.51
1:04:56.618911 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:04:56.619141 INFO: Starting candidate selection
1:05:00.627471 INFO: Starting candidate scoring
1:05:01.936669 INFO: Finished candidate processing
1:05:01.936763 INFO: Collecting candidate features
1:05:04.105735 WARNING: intensity_correlation has 2 NaNs ( 0.11 % out of 1778)
1:05:04.111713 INFO: Collecting fragment features
1:05:04.749760 INFO: Finished candidate scoring
1:05:05.145827 PROGRESS: === Epoch 16, step 0, extracted 1778 precursors and 8145 fragments ===
1:05:05.146133 INFO: performing precursor FDR with 47 features
1:05:05.146176 INFO: Decoy channel: -1
1:05:05.146204 INFO: Competetive: True
1:05:05.150650 WARNING: dropped 2 decoy PSMs due to missing features
1:05:05.179123 INFO: Test AUC: 0.514
1:05:05.179215 INFO: Train AUC: 0.546
1:05:05.179259 INFO: AUC difference: 5.82%
1:05:05.179293 WARNING: AUC difference > 5%. This may indicate overfitting.
1:05:05.300881 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
1:05:05.301646 PROGRESS: ============================= Precursor FDR =============================
1:05:05.301759 PROGRESS: Total precursors accumulated: 12
1:05:05.301874 PROGRESS: Target precursors: 12 (100.00%)
1:05:05.301945 PROGRESS: Decoy precursors: 0 (0.00%)
1:05:05.302008 PROGRESS: 
1:05:05.302069 PROGRESS: Precursor Summary:
1:05:05.303553 PROGRESS: Channel   0:	 0.05 FDR:    12; 0.01 FDR:    12; 0.001 FDR:    12
1:05:05.303660 PROGRESS: 
1:05:05.303740 PROGRESS: Protein Summary:
1:05:05.305398 PROGRESS: Channel   0:	 0.05 FDR:    12; 0.01 FDR:    12; 0.001 FDR:    12
1:05:05.305504 PROGRESS: =========================================================================
1:05:05.306385 PROGRESS: === Epoch 16, step 1, extracting elution groups 1000 to 3000 ===
1:05:05.383881 PROGRESS: Extracting batch of 3951 precursors
1:05:05.385974 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:05:05.386034 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:05:05.386076 INFO: FWHM in RT is 13.94 seconds, sigma is 0.51
1:05:05.386107 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:05:05.386320 INFO: Starting candidate selection
1:05:08.991045 INFO: Starting candidate scoring
1:05:10.305183 INFO: Finished candidate processing
1:05:10.305273 INFO: Collecting candidate features
1:05:12.459355 WARNING: intensity_correlation has 4 NaNs ( 0.11 % out of 3640)
1:05:12.465409 INFO: Collecting fragment features
1:05:13.074956 INFO: Finished candidate scoring
1:05:13.351943 PROGRESS: === Epoch 16, step 1, extracted 3640 precursors and 16985 fragments ===
1:05:13.352238 INFO: performing precursor FDR with 47 features
1:05:13.352286 INFO: Decoy channel: -1
1:05:13.352313 INFO: Competetive: True
1:05:13.360577 WARNING: dropped 1 target PSMs due to missing features
1:05:13.360667 WARNING: dropped 5 decoy PSMs due to missing features
1:05:13.397324 INFO: Test AUC: 0.534
1:05:13.397461 INFO: Train AUC: 0.538
1:05:13.397507 INFO: AUC difference: 0.75%
1:05:13.516399 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
1:05:13.517158 PROGRESS: ============================= Precursor FDR =============================
1:05:13.517281 PROGRESS: Total precursors accumulated: 37
1:05:13.517358 PROGRESS: Target precursors: 35 (94.59%)
1:05:13.517424 PROGRESS: Decoy precursors: 2 (5.41%)
1:05:13.517483 PROGRESS: 
1:05:13.517542 PROGRESS: Precursor Summary:
1:05:13.518991 PROGRESS: Channel   0:	 0.05 FDR:    27; 0.01 FDR:    26; 0.001 FDR:    26
1:05:13.519105 PROGRESS: 
1:05:13.519189 PROGRESS: Protein Summary:
1:05:13.520775 PROGRESS: Channel   0:	 0.05 FDR:    27; 0.01 FDR:    26; 0.001 FDR:    26
1:05:13.520883 PROGRESS: =========================================================================
1:05:13.521726 PROGRESS: === Epoch 16, step 2, extracting elution groups 3000 to 7000 ===
1:05:13.603610 PROGRESS: Extracting batch of 7896 precursors
1:05:13.606807 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:05:13.606880 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:05:13.606918 INFO: FWHM in RT is 13.94 seconds, sigma is 0.51
1:05:13.606963 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:05:13.607178 INFO: Starting candidate selection
1:05:17.263324 INFO: Starting candidate scoring
1:05:18.601432 INFO: Finished candidate processing
1:05:18.601518 INFO: Collecting candidate features
1:05:20.763503 WARNING: intensity_correlation has 2 NaNs ( 0.03 % out of 7200)
1:05:20.769067 INFO: Collecting fragment features
1:05:21.384353 INFO: Finished candidate scoring
1:05:21.666716 PROGRESS: === Epoch 16, step 2, extracted 7200 precursors and 32704 fragments ===
1:05:21.667049 INFO: performing precursor FDR with 47 features
1:05:21.667094 INFO: Decoy channel: -1
1:05:21.667120 INFO: Competetive: True
1:05:21.681682 WARNING: dropped 1 target PSMs due to missing features
1:05:21.681806 WARNING: dropped 7 decoy PSMs due to missing features
1:05:21.904818 INFO: Test AUC: 0.556
1:05:21.904944 INFO: Train AUC: 0.581
1:05:21.904990 INFO: AUC difference: 4.26%
1:05:22.027265 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
1:05:22.028093 PROGRESS: ============================= Precursor FDR =============================
1:05:22.028214 PROGRESS: Total precursors accumulated: 104
1:05:22.028293 PROGRESS: Target precursors: 96 (92.31%)
1:05:22.028361 PROGRESS: Decoy precursors: 8 (7.69%)
1:05:22.028424 PROGRESS: 
1:05:22.028485 PROGRESS: Precursor Summary:
1:05:22.029973 PROGRESS: Channel   0:	 0.05 FDR:    70; 0.01 FDR:    52; 0.001 FDR:    52
1:05:22.030087 PROGRESS: 
1:05:22.030160 PROGRESS: Protein Summary:
1:05:22.031819 PROGRESS: Channel   0:	 0.05 FDR:    70; 0.01 FDR:    52; 0.001 FDR:    52
1:05:22.031928 PROGRESS: =========================================================================
1:05:22.032799 PROGRESS: === Epoch 16, step 3, extracting elution groups 7000 to 15000 ===
1:05:22.124730 PROGRESS: Extracting batch of 15811 precursors
1:05:22.130107 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:05:22.130171 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:05:22.130223 INFO: FWHM in RT is 13.94 seconds, sigma is 0.51
1:05:22.130250 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:05:22.130463 INFO: Starting candidate selection
1:05:25.966986 INFO: Starting candidate scoring
1:05:27.381061 INFO: Finished candidate processing
1:05:27.381203 INFO: Collecting candidate features
1:05:29.573130 WARNING: intensity_correlation has 17 NaNs ( 0.12 % out of 14499)
1:05:29.579179 INFO: Collecting fragment features
1:05:30.209097 INFO: Finished candidate scoring
1:05:30.498934 PROGRESS: === Epoch 16, step 3, extracted 14499 precursors and 66641 fragments ===
1:05:30.499239 INFO: performing precursor FDR with 47 features
1:05:30.499285 INFO: Decoy channel: -1
1:05:30.499315 INFO: Competetive: True
1:05:30.526958 WARNING: dropped 10 target PSMs due to missing features
1:05:30.527087 WARNING: dropped 15 decoy PSMs due to missing features
1:05:31.315218 INFO: Test AUC: 0.558
1:05:31.315368 INFO: Train AUC: 0.602
1:05:31.315415 INFO: AUC difference: 7.35%
1:05:31.315449 WARNING: AUC difference > 5%. This may indicate overfitting.
1:05:31.442873 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
1:05:31.443810 PROGRESS: ============================= Precursor FDR =============================
1:05:31.443937 PROGRESS: Total precursors accumulated: 267
1:05:31.444015 PROGRESS: Target precursors: 245 (91.76%)
1:05:31.444084 PROGRESS: Decoy precursors: 22 (8.24%)
1:05:31.444148 PROGRESS: 
1:05:31.444210 PROGRESS: Precursor Summary:
1:05:31.445755 PROGRESS: Channel   0:	 0.05 FDR:   190; 0.01 FDR:   117; 0.001 FDR:    86
1:05:31.445897 PROGRESS: 
1:05:31.445972 PROGRESS: Protein Summary:
1:05:31.447765 PROGRESS: Channel   0:	 0.05 FDR:   187; 0.01 FDR:   115; 0.001 FDR:    85
1:05:31.447879 PROGRESS: =========================================================================
1:05:31.448805 PROGRESS: === Epoch 16, step 4, extracting elution groups 15000 to 31000 ===
1:05:31.556765 PROGRESS: Extracting batch of 31625 precursors
1:05:31.567350 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:05:31.567465 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:05:31.567506 INFO: FWHM in RT is 13.94 seconds, sigma is 0.51
1:05:31.567534 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:05:31.567771 INFO: Starting candidate selection
1:05:35.742669 INFO: Starting candidate scoring
1:05:37.308911 INFO: Finished candidate processing
1:05:37.309007 INFO: Collecting candidate features
1:05:39.566643 WARNING: intensity_correlation has 22 NaNs ( 0.08 % out of 29007)
1:05:39.574657 INFO: Collecting fragment features
1:05:40.220333 INFO: Finished candidate scoring
1:05:40.526398 PROGRESS: === Epoch 16, step 4, extracted 29007 precursors and 131952 fragments ===
1:05:40.526724 INFO: performing precursor FDR with 47 features
1:05:40.526771 INFO: Decoy channel: -1
1:05:40.526798 INFO: Competetive: True
1:05:40.583126 WARNING: dropped 20 target PSMs due to missing features
1:05:40.583236 WARNING: dropped 27 decoy PSMs due to missing features
1:05:42.171646 INFO: Test AUC: 0.551
1:05:42.171803 INFO: Train AUC: 0.607
1:05:42.171850 INFO: AUC difference: 9.24%
1:05:42.171885 WARNING: AUC difference > 5%. This may indicate overfitting.
1:05:42.301592 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
1:05:42.302608 PROGRESS: ============================= Precursor FDR =============================
1:05:42.302737 PROGRESS: Total precursors accumulated: 461
1:05:42.302815 PROGRESS: Target precursors: 421 (91.32%)
1:05:42.302894 PROGRESS: Decoy precursors: 40 (8.68%)
1:05:42.302969 PROGRESS: 
1:05:42.303029 PROGRESS: Precursor Summary:
1:05:42.304666 PROGRESS: Channel   0:	 0.05 FDR:   353; 0.01 FDR:   208; 0.001 FDR:   168
1:05:42.304775 PROGRESS: 
1:05:42.304847 PROGRESS: Protein Summary:
1:05:42.306764 PROGRESS: Channel   0:	 0.05 FDR:   343; 0.01 FDR:   198; 0.001 FDR:   160
1:05:42.306875 PROGRESS: =========================================================================
1:05:42.307844 PROGRESS: === Epoch 16, step 5, extracting elution groups 31000 to 63000 ===
1:05:42.444058 PROGRESS: Extracting batch of 63218 precursors
1:05:42.463744 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:05:42.463851 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:05:42.463888 INFO: FWHM in RT is 13.94 seconds, sigma is 0.51
1:05:42.463932 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:05:42.464176 INFO: Starting candidate selection
1:05:47.257326 INFO: Starting candidate scoring
1:05:49.121151 INFO: Finished candidate processing
1:05:49.121263 INFO: Collecting candidate features
1:05:51.454268 WARNING: intensity_correlation has 40 NaNs ( 0.07 % out of 58016)
1:05:51.463028 INFO: Collecting fragment features
1:05:52.156054 INFO: Finished candidate scoring
1:05:52.499832 PROGRESS: === Epoch 16, step 5, extracted 58016 precursors and 265227 fragments ===
1:05:52.500167 INFO: performing precursor FDR with 47 features
1:05:52.500209 INFO: Decoy channel: -1
1:05:52.500235 INFO: Competetive: True
1:05:52.626435 WARNING: dropped 44 target PSMs due to missing features
1:05:52.626550 WARNING: dropped 43 decoy PSMs due to missing features
1:05:56.451790 INFO: Test AUC: 0.548
1:05:56.451921 INFO: Train AUC: 0.606
1:05:56.451967 INFO: AUC difference: 9.61%
1:05:56.452000 WARNING: AUC difference > 5%. This may indicate overfitting.
1:05:56.591337 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
1:05:56.592517 PROGRESS: ============================= Precursor FDR =============================
1:05:56.592640 PROGRESS: Total precursors accumulated: 927
1:05:56.592716 PROGRESS: Target precursors: 843 (90.94%)
1:05:56.592784 PROGRESS: Decoy precursors: 84 (9.06%)
1:05:56.592846 PROGRESS: 
1:05:56.592907 PROGRESS: Precursor Summary:
1:05:56.594733 PROGRESS: Channel   0:	 0.05 FDR:   610; 0.01 FDR:   434; 0.001 FDR:   306
1:05:56.594848 PROGRESS: 
1:05:56.594923 PROGRESS: Protein Summary:
1:05:56.597073 PROGRESS: Channel   0:	 0.05 FDR:   571; 0.01 FDR:   399; 0.001 FDR:   284
1:05:56.597180 PROGRESS: =========================================================================
1:05:56.598300 PROGRESS: === Epoch 16, step 6, extracting elution groups 63000 to 127000 ===
1:05:56.785086 PROGRESS: Extracting batch of 126455 precursors
1:05:56.822766 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:05:56.822899 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:05:56.822948 INFO: FWHM in RT is 13.94 seconds, sigma is 0.51
1:05:56.822992 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:05:56.823251 INFO: Starting candidate selection
1:06:02.942179 INFO: Starting candidate scoring
1:06:05.404409 INFO: Finished candidate processing
1:06:05.404591 INFO: Collecting candidate features
1:06:07.925306 WARNING: intensity_correlation has 95 NaNs ( 0.08 % out of 116067)
1:06:07.937873 INFO: Collecting fragment features
1:06:08.666779 INFO: Finished candidate scoring
1:06:09.084951 PROGRESS: === Epoch 16, step 6, extracted 116067 precursors and 531241 fragments ===
1:06:09.085281 INFO: performing precursor FDR with 47 features
1:06:09.085326 INFO: Decoy channel: -1
1:06:09.085352 INFO: Competetive: True
1:06:09.350039 WARNING: dropped 85 target PSMs due to missing features
1:06:09.350154 WARNING: dropped 97 decoy PSMs due to missing features
1:06:17.596012 INFO: Test AUC: 0.555
1:06:17.596143 INFO: Train AUC: 0.596
1:06:17.596199 INFO: AUC difference: 6.91%
1:06:17.596227 WARNING: AUC difference > 5%. This may indicate overfitting.
1:06:17.747275 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
1:06:17.748738 PROGRESS: ============================= Precursor FDR =============================
1:06:17.748885 PROGRESS: Total precursors accumulated: 1,779
1:06:17.748963 PROGRESS: Target precursors: 1,622 (91.17%)
1:06:17.749031 PROGRESS: Decoy precursors: 157 (8.83%)
1:06:17.749094 PROGRESS: 
1:06:17.749156 PROGRESS: Precursor Summary:
1:06:17.751248 PROGRESS: Channel   0:	 0.05 FDR: 1,143; 0.01 FDR:   842; 0.001 FDR:   560
1:06:17.751380 PROGRESS: 
1:06:17.751454 PROGRESS: Protein Summary:
1:06:17.754035 PROGRESS: Channel   0:	 0.05 FDR: 1,018; 0.01 FDR:   742; 0.001 FDR:   500
1:06:17.754148 PROGRESS: =========================================================================
1:06:17.755494 PROGRESS: === Epoch 16, step 7, extracting elution groups 127000 to 255000 ===
1:06:17.978998 PROGRESS: Extracting batch of 252808 precursors
1:06:18.050891 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:06:18.051003 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:06:18.051045 INFO: FWHM in RT is 13.94 seconds, sigma is 0.51
1:06:18.051072 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:06:18.051332 INFO: Starting candidate selection
1:06:26.671922 INFO: Starting candidate scoring
1:06:30.314409 INFO: Finished candidate processing
1:06:30.314516 INFO: Collecting candidate features
1:06:33.219492 WARNING: intensity_correlation has 157 NaNs ( 0.07 % out of 231660)
1:06:33.239386 INFO: Collecting fragment features
1:06:34.065711 INFO: Finished candidate scoring
1:06:34.637281 PROGRESS: === Epoch 16, step 7, extracted 231660 precursors and 1058021 fragments ===
1:06:34.637624 INFO: performing precursor FDR with 47 features
1:06:34.637669 INFO: Decoy channel: -1
1:06:34.637696 INFO: Competetive: True
1:06:35.213562 WARNING: dropped 175 target PSMs due to missing features
1:06:35.213683 WARNING: dropped 164 decoy PSMs due to missing features
1:06:51.711753 INFO: Test AUC: 0.550
1:06:51.711885 INFO: Train AUC: 0.585
1:06:51.711927 INFO: AUC difference: 5.94%
1:06:51.711956 WARNING: AUC difference > 5%. This may indicate overfitting.
1:06:51.894088 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
1:06:51.895992 PROGRESS: ============================= Precursor FDR =============================
1:06:51.896120 PROGRESS: Total precursors accumulated: 3,202
1:06:51.896215 PROGRESS: Target precursors: 2,920 (91.19%)
1:06:51.896283 PROGRESS: Decoy precursors: 282 (8.81%)
1:06:51.896348 PROGRESS: 
1:06:51.896409 PROGRESS: Precursor Summary:
1:06:51.898973 PROGRESS: Channel   0:	 0.05 FDR: 2,265; 0.01 FDR: 1,640; 0.001 FDR:   560
1:06:51.899104 PROGRESS: 
1:06:51.899178 PROGRESS: Protein Summary:
1:06:51.902387 PROGRESS: Channel   0:	 0.05 FDR: 1,857; 0.01 FDR: 1,323; 0.001 FDR:   484
1:06:51.902506 PROGRESS: =========================================================================
1:06:51.904241 PROGRESS: === Epoch 16, step 8, extracting elution groups 255000 to 511000 ===
1:06:52.210883 PROGRESS: Extracting batch of 505989 precursors
1:06:52.345680 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:06:52.345825 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:06:52.345872 INFO: FWHM in RT is 13.94 seconds, sigma is 0.51
1:06:52.345899 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:06:52.346162 INFO: Starting candidate selection
1:07:06.005173 INFO: Starting candidate scoring
1:07:12.003020 INFO: Finished candidate processing
1:07:12.003209 INFO: Collecting candidate features
1:07:15.624079 WARNING: intensity_correlation has 283 NaNs ( 0.06 % out of 463447)
1:07:15.656654 INFO: Collecting fragment features
1:07:16.667508 INFO: Finished candidate scoring
1:07:17.535277 PROGRESS: === Epoch 16, step 8, extracted 463447 precursors and 2115894 fragments ===
1:07:17.542529 INFO: performing precursor FDR with 47 features
1:07:17.542630 INFO: Decoy channel: -1
1:07:17.542669 INFO: Competetive: True
1:07:18.639791 WARNING: dropped 311 target PSMs due to missing features
1:07:18.639914 WARNING: dropped 311 decoy PSMs due to missing features
1:07:52.281911 INFO: Test AUC: 0.550
1:07:52.282036 INFO: Train AUC: 0.574
1:07:52.282072 INFO: AUC difference: 4.12%
1:07:52.518015 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
1:07:52.520570 PROGRESS: ============================= Precursor FDR =============================
1:07:52.520706 PROGRESS: Total precursors accumulated: 5,838
1:07:52.520780 PROGRESS: Target precursors: 5,320 (91.13%)
1:07:52.520855 PROGRESS: Decoy precursors: 518 (8.87%)
1:07:52.520917 PROGRESS: 
1:07:52.520974 PROGRESS: Precursor Summary:
1:07:52.524211 PROGRESS: Channel   0:	 0.05 FDR: 4,356; 0.01 FDR: 3,031; 0.001 FDR: 1,366
1:07:52.524332 PROGRESS: 
1:07:52.524401 PROGRESS: Protein Summary:
1:07:52.528934 PROGRESS: Channel   0:	 0.05 FDR: 3,075; 0.01 FDR: 2,111; 0.001 FDR: 1,065
1:07:52.529050 PROGRESS: =========================================================================
1:07:52.531479 PROGRESS: === Epoch 16, step 9, extracting elution groups 511000 to 1023000 ===
1:07:52.964841 PROGRESS: Extracting batch of 1011624 precursors
1:07:53.243513 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:07:53.243626 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:07:53.243693 INFO: FWHM in RT is 13.94 seconds, sigma is 0.51
1:07:53.243722 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:07:53.243988 INFO: Starting candidate selection
1:08:17.012815 INFO: Starting candidate scoring
1:08:27.957232 INFO: Finished candidate processing
1:08:27.957427 INFO: Collecting candidate features
1:08:32.792844 WARNING: intensity_correlation has 651 NaNs ( 0.07 % out of 927280)
1:08:32.794598 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 927280)
1:08:32.851876 INFO: Collecting fragment features
1:08:34.472058 INFO: Finished candidate scoring
1:08:36.013709 PROGRESS: === Epoch 16, step 9, extracted 927280 precursors and 4239848 fragments ===
1:08:36.014057 INFO: performing precursor FDR with 47 features
1:08:36.014101 INFO: Decoy channel: -1
1:08:36.014128 INFO: Competetive: True
1:08:38.247957 WARNING: dropped 661 target PSMs due to missing features
1:08:38.248081 WARNING: dropped 612 decoy PSMs due to missing features
1:09:48.118764 INFO: Test AUC: 0.551
1:09:48.118907 INFO: Train AUC: 0.564
1:09:48.118944 INFO: AUC difference: 2.24%
1:09:48.463237 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
1:09:48.467010 PROGRESS: ============================= Precursor FDR =============================
1:09:48.467195 PROGRESS: Total precursors accumulated: 10,864
1:09:48.467276 PROGRESS: Target precursors: 9,908 (91.20%)
1:09:48.467343 PROGRESS: Decoy precursors: 956 (8.80%)
1:09:48.467407 PROGRESS: 
1:09:48.467468 PROGRESS: Precursor Summary:
1:09:48.472437 PROGRESS: Channel   0:	 0.05 FDR: 8,328; 0.01 FDR: 6,427; 0.001 FDR: 4,156
1:09:48.472594 PROGRESS: 
1:09:48.472667 PROGRESS: Protein Summary:
1:09:48.480098 PROGRESS: Channel   0:	 0.05 FDR: 4,583; 0.01 FDR: 3,522; 0.001 FDR: 2,482
1:09:48.480247 PROGRESS: =========================================================================
1:09:48.486590 INFO: calibration group: precursor, fitting rt estimator 
1:09:50.767774 INFO: calibration group: fragment, fitting mz estimator 
1:09:51.365405 INFO: === checking if epoch conditions were reached ===
1:09:51.365574 INFO: ✅ ms2_error      : 7.0000 <= 7
1:09:51.365701 INFO: ❌ rt_error       : 200.5982 > 100
1:09:51.365767 INFO: ✅ current_epoch  : 16 >= 3
1:09:51.365836 INFO: ==============================================
1:09:51.585488 INFO: calibration group: precursor, predicting mz
1:09:51.585797 WARNING: mz prediction was skipped as it has not been fitted yet
1:09:51.585842 INFO: calibration group: precursor, predicting rt
1:09:58.435972 INFO: calibration group: fragment, predicting mz
1:10:16.455012 PROGRESS: === Epoch 17, step 0, extracting elution groups 0 to 1000 ===
1:10:16.575686 PROGRESS: Extracting batch of 1979 precursors
1:10:16.577494 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:10:16.577569 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:10:16.577607 INFO: FWHM in RT is 14.04 seconds, sigma is 0.51
1:10:16.577652 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:10:16.577895 INFO: Starting candidate selection
1:10:20.557021 INFO: Starting candidate scoring
1:10:21.842045 INFO: Finished candidate processing
1:10:21.842145 INFO: Collecting candidate features
1:10:23.995028 INFO: Collecting fragment features
1:10:24.629520 INFO: Finished candidate scoring
1:10:25.021958 PROGRESS: === Epoch 17, step 0, extracted 1817 precursors and 8410 fragments ===
1:10:25.022369 INFO: performing precursor FDR with 47 features
1:10:25.022415 INFO: Decoy channel: -1
1:10:25.022441 INFO: Competetive: True
1:10:25.054746 INFO: Test AUC: 0.585
1:10:25.054847 INFO: Train AUC: 0.528
1:10:25.054891 INFO: AUC difference: 10.79%
1:10:25.054924 WARNING: AUC difference > 5%. This may indicate overfitting.
1:10:25.180929 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
1:10:25.181659 PROGRESS: ============================= Precursor FDR =============================
1:10:25.181783 PROGRESS: Total precursors accumulated: 19
1:10:25.181880 PROGRESS: Target precursors: 18 (94.74%)
1:10:25.181961 PROGRESS: Decoy precursors: 1 (5.26%)
1:10:25.182029 PROGRESS: 
1:10:25.182092 PROGRESS: Precursor Summary:
1:10:25.183488 PROGRESS: Channel   0:	 0.05 FDR:    16; 0.01 FDR:    16; 0.001 FDR:    16
1:10:25.183598 PROGRESS: 
1:10:25.183669 PROGRESS: Protein Summary:
1:10:25.185220 PROGRESS: Channel   0:	 0.05 FDR:    16; 0.01 FDR:    16; 0.001 FDR:    16
1:10:25.185325 PROGRESS: =========================================================================
1:10:25.186162 PROGRESS: === Epoch 17, step 1, extracting elution groups 1000 to 3000 ===
1:10:25.263175 PROGRESS: Extracting batch of 3958 precursors
1:10:25.265313 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:10:25.265375 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:10:25.265413 INFO: FWHM in RT is 14.04 seconds, sigma is 0.51
1:10:25.265439 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:10:25.265675 INFO: Starting candidate selection
1:10:28.888747 INFO: Starting candidate scoring
1:10:30.200612 INFO: Finished candidate processing
1:10:30.200705 INFO: Collecting candidate features
1:10:32.359807 INFO: Collecting fragment features
1:10:32.993022 INFO: Finished candidate scoring
1:10:33.270506 PROGRESS: === Epoch 17, step 1, extracted 3658 precursors and 16700 fragments ===
1:10:33.270773 INFO: performing precursor FDR with 47 features
1:10:33.270821 INFO: Decoy channel: -1
1:10:33.270847 INFO: Competetive: True
1:10:33.315934 INFO: Test AUC: 0.565
1:10:33.316055 INFO: Train AUC: 0.559
1:10:33.316100 INFO: AUC difference: 1.07%
1:10:33.438246 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
1:10:33.439031 PROGRESS: ============================= Precursor FDR =============================
1:10:33.439154 PROGRESS: Total precursors accumulated: 40
1:10:33.439233 PROGRESS: Target precursors: 37 (92.50%)
1:10:33.439301 PROGRESS: Decoy precursors: 3 (7.50%)
1:10:33.439364 PROGRESS: 
1:10:33.439426 PROGRESS: Precursor Summary:
1:10:33.440839 PROGRESS: Channel   0:	 0.05 FDR:    35; 0.01 FDR:    23; 0.001 FDR:    23
1:10:33.440967 PROGRESS: 
1:10:33.441040 PROGRESS: Protein Summary:
1:10:33.442657 PROGRESS: Channel   0:	 0.05 FDR:    35; 0.01 FDR:    23; 0.001 FDR:    23
1:10:33.442780 PROGRESS: =========================================================================
1:10:33.443630 PROGRESS: === Epoch 17, step 2, extracting elution groups 3000 to 7000 ===
1:10:33.526550 PROGRESS: Extracting batch of 7902 precursors
1:10:33.529784 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:10:33.529868 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:10:33.529907 INFO: FWHM in RT is 14.04 seconds, sigma is 0.51
1:10:33.529954 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:10:33.530177 INFO: Starting candidate selection
1:10:37.269530 INFO: Starting candidate scoring
1:10:38.642224 INFO: Finished candidate processing
1:10:38.642422 INFO: Collecting candidate features
1:10:40.835285 WARNING: intensity_correlation has 5 NaNs ( 0.07 % out of 7266)
1:10:40.840816 INFO: Collecting fragment features
1:10:41.490016 INFO: Finished candidate scoring
1:10:41.773483 PROGRESS: === Epoch 17, step 2, extracted 7266 precursors and 33464 fragments ===
1:10:41.773808 INFO: performing precursor FDR with 47 features
1:10:41.773856 INFO: Decoy channel: -1
1:10:41.773883 INFO: Competetive: True
1:10:41.788627 WARNING: dropped 5 target PSMs due to missing features
1:10:42.045521 INFO: Test AUC: 0.543
1:10:42.045653 INFO: Train AUC: 0.590
1:10:42.045699 INFO: AUC difference: 7.89%
1:10:42.045732 WARNING: AUC difference > 5%. This may indicate overfitting.
1:10:42.168957 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
1:10:42.169819 PROGRESS: ============================= Precursor FDR =============================
1:10:42.169940 PROGRESS: Total precursors accumulated: 85
1:10:42.170017 PROGRESS: Target precursors: 78 (91.76%)
1:10:42.170084 PROGRESS: Decoy precursors: 7 (8.24%)
1:10:42.170147 PROGRESS: 
1:10:42.170221 PROGRESS: Precursor Summary:
1:10:42.171691 PROGRESS: Channel   0:	 0.05 FDR:    73; 0.01 FDR:    58; 0.001 FDR:    58
1:10:42.171819 PROGRESS: 
1:10:42.171892 PROGRESS: Protein Summary:
1:10:42.173570 PROGRESS: Channel   0:	 0.05 FDR:    72; 0.01 FDR:    58; 0.001 FDR:    58
1:10:42.173681 PROGRESS: =========================================================================
1:10:42.174574 PROGRESS: === Epoch 17, step 3, extracting elution groups 7000 to 15000 ===
1:10:42.265806 PROGRESS: Extracting batch of 15818 precursors
1:10:42.271150 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:10:42.271220 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:10:42.271254 INFO: FWHM in RT is 14.04 seconds, sigma is 0.51
1:10:42.271296 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:10:42.271517 INFO: Starting candidate selection
1:10:46.170794 INFO: Starting candidate scoring
1:10:47.627840 INFO: Finished candidate processing
1:10:47.627933 INFO: Collecting candidate features
1:10:49.851777 WARNING: intensity_correlation has 13 NaNs ( 0.09 % out of 14507)
1:10:49.857894 INFO: Collecting fragment features
1:10:50.516860 INFO: Finished candidate scoring
1:10:50.809865 PROGRESS: === Epoch 17, step 3, extracted 14507 precursors and 66115 fragments ===
1:10:50.810191 INFO: performing precursor FDR with 47 features
1:10:50.810238 INFO: Decoy channel: -1
1:10:50.810263 INFO: Competetive: True
1:10:50.838484 WARNING: dropped 13 target PSMs due to missing features
1:10:50.838598 WARNING: dropped 5 decoy PSMs due to missing features
1:10:51.576054 INFO: Test AUC: 0.538
1:10:51.577091 INFO: Train AUC: 0.607
1:10:51.577137 INFO: AUC difference: 11.32%
1:10:51.577168 WARNING: AUC difference > 5%. This may indicate overfitting.
1:10:51.703039 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
1:10:51.703977 PROGRESS: ============================= Precursor FDR =============================
1:10:51.704118 PROGRESS: Total precursors accumulated: 236
1:10:51.704203 PROGRESS: Target precursors: 216 (91.53%)
1:10:51.704275 PROGRESS: Decoy precursors: 20 (8.47%)
1:10:51.704342 PROGRESS: 
1:10:51.704403 PROGRESS: Precursor Summary:
1:10:51.706033 PROGRESS: Channel   0:	 0.05 FDR:   166; 0.01 FDR:   120; 0.001 FDR:   118
1:10:51.706150 PROGRESS: 
1:10:51.706224 PROGRESS: Protein Summary:
1:10:51.708053 PROGRESS: Channel   0:	 0.05 FDR:   165; 0.01 FDR:   119; 0.001 FDR:   117
1:10:51.708165 PROGRESS: =========================================================================
1:10:51.709111 PROGRESS: === Epoch 17, step 4, extracting elution groups 15000 to 31000 ===
1:10:51.818967 PROGRESS: Extracting batch of 31596 precursors
1:10:51.829526 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:10:51.829640 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:10:51.829681 INFO: FWHM in RT is 14.04 seconds, sigma is 0.51
1:10:51.829708 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:10:51.829957 INFO: Starting candidate selection
1:10:56.012254 INFO: Starting candidate scoring
1:10:57.575112 INFO: Finished candidate processing
1:10:57.575210 INFO: Collecting candidate features
1:10:59.816051 WARNING: intensity_correlation has 19 NaNs ( 0.07 % out of 28931)
1:10:59.824353 INFO: Collecting fragment features
1:11:00.495528 INFO: Finished candidate scoring
1:11:00.802531 PROGRESS: === Epoch 17, step 4, extracted 28931 precursors and 132037 fragments ===
1:11:00.802872 INFO: performing precursor FDR with 47 features
1:11:00.802920 INFO: Decoy channel: -1
1:11:00.802946 INFO: Competetive: True
1:11:00.860252 WARNING: dropped 23 target PSMs due to missing features
1:11:00.860360 WARNING: dropped 14 decoy PSMs due to missing features
1:11:02.347154 INFO: Test AUC: 0.552
1:11:02.347305 INFO: Train AUC: 0.613
1:11:02.354158 INFO: AUC difference: 9.93%
1:11:02.354313 WARNING: AUC difference > 5%. This may indicate overfitting.
1:11:02.491936 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
1:11:02.492949 PROGRESS: ============================= Precursor FDR =============================
1:11:02.493081 PROGRESS: Total precursors accumulated: 461
1:11:02.493159 PROGRESS: Target precursors: 420 (91.11%)
1:11:02.493227 PROGRESS: Decoy precursors: 41 (8.89%)
1:11:02.493291 PROGRESS: 
1:11:02.493358 PROGRESS: Precursor Summary:
1:11:02.495054 PROGRESS: Channel   0:	 0.05 FDR:   323; 0.01 FDR:   220; 0.001 FDR:   203
1:11:02.495189 PROGRESS: 
1:11:02.495262 PROGRESS: Protein Summary:
1:11:02.497206 PROGRESS: Channel   0:	 0.05 FDR:   315; 0.01 FDR:   216; 0.001 FDR:   200
1:11:02.497319 PROGRESS: =========================================================================
1:11:02.498330 PROGRESS: === Epoch 17, step 5, extracting elution groups 31000 to 63000 ===
1:11:02.635267 PROGRESS: Extracting batch of 63191 precursors
1:11:02.655203 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:11:02.655308 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:11:02.655348 INFO: FWHM in RT is 14.04 seconds, sigma is 0.51
1:11:02.655395 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:11:02.655651 INFO: Starting candidate selection
1:11:07.533385 INFO: Starting candidate scoring
1:11:09.416765 INFO: Finished candidate processing
1:11:09.416865 INFO: Collecting candidate features
1:11:11.775618 WARNING: intensity_correlation has 55 NaNs ( 0.09 % out of 58010)
1:11:11.784614 INFO: Collecting fragment features
1:11:12.492594 INFO: Finished candidate scoring
1:11:12.837148 PROGRESS: === Epoch 17, step 5, extracted 58010 precursors and 265640 fragments ===
1:11:12.838361 INFO: performing precursor FDR with 47 features
1:11:12.838467 INFO: Decoy channel: -1
1:11:12.838494 INFO: Competetive: True
1:11:12.966455 WARNING: dropped 51 target PSMs due to missing features
1:11:12.966573 WARNING: dropped 41 decoy PSMs due to missing features
1:11:17.082283 INFO: Test AUC: 0.557
1:11:17.082427 INFO: Train AUC: 0.610
1:11:17.082468 INFO: AUC difference: 8.60%
1:11:17.082498 WARNING: AUC difference > 5%. This may indicate overfitting.
1:11:17.219806 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
1:11:17.221046 PROGRESS: ============================= Precursor FDR =============================
1:11:17.221179 PROGRESS: Total precursors accumulated: 1,036
1:11:17.221258 PROGRESS: Target precursors: 945 (91.22%)
1:11:17.221327 PROGRESS: Decoy precursors: 91 (8.78%)
1:11:17.221390 PROGRESS: 
1:11:17.221450 PROGRESS: Precursor Summary:
1:11:17.223361 PROGRESS: Channel   0:	 0.05 FDR:   712; 0.01 FDR:   437; 0.001 FDR:   373
1:11:17.223502 PROGRESS: 
1:11:17.223575 PROGRESS: Protein Summary:
1:11:17.225855 PROGRESS: Channel   0:	 0.05 FDR:   684; 0.01 FDR:   419; 0.001 FDR:   356
1:11:17.225971 PROGRESS: =========================================================================
1:11:17.227121 PROGRESS: === Epoch 17, step 6, extracting elution groups 63000 to 127000 ===
1:11:17.403460 PROGRESS: Extracting batch of 126517 precursors
1:11:17.442005 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:11:17.442122 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:11:17.442161 INFO: FWHM in RT is 14.04 seconds, sigma is 0.51
1:11:17.442203 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:11:17.442465 INFO: Starting candidate selection
1:11:23.526940 INFO: Starting candidate scoring
1:11:25.977502 INFO: Finished candidate processing
1:11:25.977669 INFO: Collecting candidate features
1:11:28.493423 WARNING: intensity_correlation has 94 NaNs ( 0.08 % out of 116302)
1:11:28.506265 INFO: Collecting fragment features
1:11:29.261354 INFO: Finished candidate scoring
1:11:29.678160 PROGRESS: === Epoch 17, step 6, extracted 116302 precursors and 531855 fragments ===
1:11:29.678510 INFO: performing precursor FDR with 47 features
1:11:29.678555 INFO: Decoy channel: -1
1:11:29.678581 INFO: Competetive: True
1:11:29.943931 WARNING: dropped 102 target PSMs due to missing features
1:11:29.944047 WARNING: dropped 84 decoy PSMs due to missing features
1:11:38.363073 INFO: Test AUC: 0.555
1:11:38.363232 INFO: Train AUC: 0.601
1:11:38.363276 INFO: AUC difference: 7.57%
1:11:38.363305 WARNING: AUC difference > 5%. This may indicate overfitting.
1:11:38.525141 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
1:11:38.526640 PROGRESS: ============================= Precursor FDR =============================
1:11:38.526776 PROGRESS: Total precursors accumulated: 1,744
1:11:38.526855 PROGRESS: Target precursors: 1,593 (91.34%)
1:11:38.526923 PROGRESS: Decoy precursors: 151 (8.66%)
1:11:38.526986 PROGRESS: 
1:11:38.527046 PROGRESS: Precursor Summary:
1:11:38.529271 PROGRESS: Channel   0:	 0.05 FDR: 1,306; 0.01 FDR:   918; 0.001 FDR:   746
1:11:38.529417 PROGRESS: 
1:11:38.529491 PROGRESS: Protein Summary:
1:11:38.532311 PROGRESS: Channel   0:	 0.05 FDR: 1,183; 0.01 FDR:   834; 0.001 FDR:   679
1:11:38.532443 PROGRESS: =========================================================================
1:11:38.533875 PROGRESS: === Epoch 17, step 7, extracting elution groups 127000 to 255000 ===
1:11:38.759783 PROGRESS: Extracting batch of 252973 precursors
1:11:38.832942 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:11:38.833068 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:11:38.833124 INFO: FWHM in RT is 14.04 seconds, sigma is 0.51
1:11:38.833152 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:11:38.833421 INFO: Starting candidate selection
1:11:47.453948 INFO: Starting candidate scoring
1:11:51.129764 INFO: Finished candidate processing
1:11:51.129975 INFO: Collecting candidate features
1:11:54.082768 WARNING: intensity_correlation has 182 NaNs ( 0.08 % out of 232314)
1:11:54.083515 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 232314)
1:11:54.103376 INFO: Collecting fragment features
1:11:54.963156 INFO: Finished candidate scoring
1:11:55.543997 PROGRESS: === Epoch 17, step 7, extracted 232314 precursors and 1062977 fragments ===
1:11:55.544337 INFO: performing precursor FDR with 47 features
1:11:55.544385 INFO: Decoy channel: -1
1:11:55.544412 INFO: Competetive: True
1:11:56.134943 WARNING: dropped 189 target PSMs due to missing features
1:11:56.135066 WARNING: dropped 179 decoy PSMs due to missing features
1:12:13.130952 INFO: Test AUC: 0.552
1:12:13.131078 INFO: Train AUC: 0.586
1:12:13.131133 INFO: AUC difference: 5.68%
1:12:13.131161 WARNING: AUC difference > 5%. This may indicate overfitting.
1:12:13.345328 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
1:12:13.347321 PROGRESS: ============================= Precursor FDR =============================
1:12:13.347474 PROGRESS: Total precursors accumulated: 3,275
1:12:13.347555 PROGRESS: Target precursors: 2,987 (91.21%)
1:12:13.347624 PROGRESS: Decoy precursors: 288 (8.79%)
1:12:13.347688 PROGRESS: 
1:12:13.347749 PROGRESS: Precursor Summary:
1:12:13.350368 PROGRESS: Channel   0:	 0.05 FDR: 2,381; 0.01 FDR: 1,723; 0.001 FDR:   558
1:12:13.350507 PROGRESS: 
1:12:13.350582 PROGRESS: Protein Summary:
1:12:13.353986 PROGRESS: Channel   0:	 0.05 FDR: 1,961; 0.01 FDR: 1,417; 0.001 FDR:   501
1:12:13.354101 PROGRESS: =========================================================================
1:12:13.355917 PROGRESS: === Epoch 17, step 8, extracting elution groups 255000 to 511000 ===
1:12:13.662675 PROGRESS: Extracting batch of 505927 precursors
1:12:13.797187 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:12:13.797303 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:12:13.797359 INFO: FWHM in RT is 14.04 seconds, sigma is 0.51
1:12:13.797386 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:12:13.797673 INFO: Starting candidate selection
1:12:27.514844 INFO: Starting candidate scoring
1:12:33.616125 INFO: Finished candidate processing
1:12:33.616320 INFO: Collecting candidate features
1:12:37.223468 WARNING: intensity_correlation has 379 NaNs ( 0.08 % out of 464696)
1:12:37.224513 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 464696)
1:12:37.256536 INFO: Collecting fragment features
1:12:38.305707 INFO: Finished candidate scoring
1:12:39.185742 PROGRESS: === Epoch 17, step 8, extracted 464696 precursors and 2125927 fragments ===
1:12:39.186105 INFO: performing precursor FDR with 47 features
1:12:39.186151 INFO: Decoy channel: -1
1:12:39.186176 INFO: Competetive: True
1:12:40.281580 WARNING: dropped 377 target PSMs due to missing features
1:12:40.281708 WARNING: dropped 370 decoy PSMs due to missing features
1:13:14.902866 INFO: Test AUC: 0.551
1:13:14.902995 INFO: Train AUC: 0.573
1:13:14.903051 INFO: AUC difference: 3.90%
1:13:15.146630 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
1:13:15.149326 PROGRESS: ============================= Precursor FDR =============================
1:13:15.149480 PROGRESS: Total precursors accumulated: 5,804
1:13:15.149558 PROGRESS: Target precursors: 5,297 (91.26%)
1:13:15.149641 PROGRESS: Decoy precursors: 507 (8.74%)
1:13:15.149704 PROGRESS: 
1:13:15.149766 PROGRESS: Precursor Summary:
1:13:15.153104 PROGRESS: Channel   0:	 0.05 FDR: 4,360; 0.01 FDR: 3,268; 0.001 FDR: 1,541
1:13:15.153241 PROGRESS: 
1:13:15.153312 PROGRESS: Protein Summary:
1:13:15.157979 PROGRESS: Channel   0:	 0.05 FDR: 3,015; 0.01 FDR: 2,249; 0.001 FDR: 1,205
1:13:15.158109 PROGRESS: =========================================================================
1:13:15.160665 PROGRESS: === Epoch 17, step 9, extracting elution groups 511000 to 1023000 ===
1:13:15.589109 PROGRESS: Extracting batch of 1011827 precursors
1:13:15.864128 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:13:15.864240 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:13:15.864295 INFO: FWHM in RT is 14.04 seconds, sigma is 0.51
1:13:15.864322 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:13:15.864583 INFO: Starting candidate selection
1:13:39.746531 INFO: Starting candidate scoring
1:13:50.669359 INFO: Finished candidate processing
1:13:50.669551 INFO: Collecting candidate features
1:13:55.513695 WARNING: intensity_correlation has 746 NaNs ( 0.08 % out of 929291)
1:13:55.571928 INFO: Collecting fragment features
1:13:57.184258 INFO: Finished candidate scoring
1:13:58.731213 PROGRESS: === Epoch 17, step 9, extracted 929291 precursors and 4249345 fragments ===
1:13:58.731557 INFO: performing precursor FDR with 47 features
1:13:58.731603 INFO: Decoy channel: -1
1:13:58.731631 INFO: Competetive: True
1:14:00.963876 WARNING: dropped 742 target PSMs due to missing features
1:14:00.963999 WARNING: dropped 751 decoy PSMs due to missing features
1:15:10.884289 INFO: Test AUC: 0.552
1:15:10.884415 INFO: Train AUC: 0.565
1:15:10.884451 INFO: AUC difference: 2.22%
1:15:11.230811 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
1:15:11.234561 PROGRESS: ============================= Precursor FDR =============================
1:15:11.234734 PROGRESS: Total precursors accumulated: 10,817
1:15:11.234811 PROGRESS: Target precursors: 9,866 (91.21%)
1:15:11.234877 PROGRESS: Decoy precursors: 951 (8.79%)
1:15:11.234939 PROGRESS: 
1:15:11.234998 PROGRESS: Precursor Summary:
1:15:11.240042 PROGRESS: Channel   0:	 0.05 FDR: 8,545; 0.01 FDR: 6,537; 0.001 FDR: 3,585
1:15:11.240219 PROGRESS: 
1:15:11.240292 PROGRESS: Protein Summary:
1:15:11.247685 PROGRESS: Channel   0:	 0.05 FDR: 4,689; 0.01 FDR: 3,585; 0.001 FDR: 2,253
1:15:11.247844 PROGRESS: =========================================================================
1:15:11.254346 INFO: calibration group: precursor, fitting rt estimator 
1:15:12.224560 INFO: calibration group: fragment, fitting mz estimator 
1:15:12.818555 INFO: === checking if epoch conditions were reached ===
1:15:12.818739 INFO: ✅ ms2_error      : 7.0000 <= 7
1:15:12.818817 INFO: ❌ rt_error       : 199.9882 > 100
1:15:12.818880 INFO: ✅ current_epoch  : 17 >= 3
1:15:12.818936 INFO: ==============================================
1:15:13.035118 INFO: calibration group: precursor, predicting mz
1:15:13.035403 WARNING: mz prediction was skipped as it has not been fitted yet
1:15:13.035458 INFO: calibration group: precursor, predicting rt
1:15:19.840794 INFO: calibration group: fragment, predicting mz
1:15:37.412110 PROGRESS: === Epoch 18, step 0, extracting elution groups 0 to 1000 ===
1:15:37.532311 PROGRESS: Extracting batch of 1966 precursors
1:15:37.534048 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:15:37.534144 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:15:37.534189 INFO: FWHM in RT is 14.01 seconds, sigma is 0.51
1:15:37.534218 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:15:37.534445 INFO: Starting candidate selection
1:15:41.475240 INFO: Starting candidate scoring
1:15:42.760694 INFO: Finished candidate processing
1:15:42.760821 INFO: Collecting candidate features
1:15:44.904728 WARNING: intensity_correlation has 2 NaNs ( 0.11 % out of 1822)
1:15:44.910844 INFO: Collecting fragment features
1:15:45.518518 INFO: Finished candidate scoring
1:15:45.911569 PROGRESS: === Epoch 18, step 0, extracted 1822 precursors and 8330 fragments ===
1:15:45.911892 INFO: performing precursor FDR with 47 features
1:15:45.911949 INFO: Decoy channel: -1
1:15:45.911994 INFO: Competetive: True
1:15:45.916486 WARNING: dropped 2 target PSMs due to missing features
1:15:45.944464 INFO: Test AUC: 0.556
1:15:45.944555 INFO: Train AUC: 0.564
1:15:45.944600 INFO: AUC difference: 1.45%
1:15:46.063156 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
1:15:46.063951 PROGRESS: ============================= Precursor FDR =============================
1:15:46.064072 PROGRESS: Total precursors accumulated: 7
1:15:46.064154 PROGRESS: Target precursors: 7 (100.00%)
1:15:46.064223 PROGRESS: Decoy precursors: 0 (0.00%)
1:15:46.064286 PROGRESS: 
1:15:46.064347 PROGRESS: Precursor Summary:
1:15:46.065839 PROGRESS: Channel   0:	 0.05 FDR:     7; 0.01 FDR:     7; 0.001 FDR:     7
1:15:46.065962 PROGRESS: 
1:15:46.066038 PROGRESS: Protein Summary:
1:15:46.067722 PROGRESS: Channel   0:	 0.05 FDR:     7; 0.01 FDR:     7; 0.001 FDR:     7
1:15:46.067831 PROGRESS: =========================================================================
1:15:46.068717 PROGRESS: === Epoch 18, step 1, extracting elution groups 1000 to 3000 ===
1:15:46.146394 PROGRESS: Extracting batch of 3945 precursors
1:15:46.148508 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:15:46.148567 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:15:46.148605 INFO: FWHM in RT is 14.01 seconds, sigma is 0.51
1:15:46.148651 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:15:46.148859 INFO: Starting candidate selection
1:15:49.812054 INFO: Starting candidate scoring
1:15:51.147112 INFO: Finished candidate processing
1:15:51.147204 INFO: Collecting candidate features
1:15:53.330020 WARNING: intensity_correlation has 3 NaNs ( 0.08 % out of 3662)
1:15:53.336292 INFO: Collecting fragment features
1:15:53.952992 INFO: Finished candidate scoring
1:15:54.231192 PROGRESS: === Epoch 18, step 1, extracted 3662 precursors and 16477 fragments ===
1:15:54.231475 INFO: performing precursor FDR with 47 features
1:15:54.231522 INFO: Decoy channel: -1
1:15:54.231549 INFO: Competetive: True
1:15:54.239853 WARNING: dropped 5 target PSMs due to missing features
1:15:54.277184 INFO: Test AUC: 0.555
1:15:54.277304 INFO: Train AUC: 0.566
1:15:54.277350 INFO: AUC difference: 1.78%
1:15:54.400682 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
1:15:54.401457 PROGRESS: ============================= Precursor FDR =============================
1:15:54.401578 PROGRESS: Total precursors accumulated: 18
1:15:54.401657 PROGRESS: Target precursors: 17 (94.44%)
1:15:54.401725 PROGRESS: Decoy precursors: 1 (5.56%)
1:15:54.401799 PROGRESS: 
1:15:54.401863 PROGRESS: Precursor Summary:
1:15:54.403277 PROGRESS: Channel   0:	 0.05 FDR:    17; 0.01 FDR:    17; 0.001 FDR:    17
1:15:54.403392 PROGRESS: 
1:15:54.403467 PROGRESS: Protein Summary:
1:15:54.405073 PROGRESS: Channel   0:	 0.05 FDR:    17; 0.01 FDR:    17; 0.001 FDR:    17
1:15:54.405185 PROGRESS: =========================================================================
1:15:54.406072 PROGRESS: === Epoch 18, step 2, extracting elution groups 3000 to 7000 ===
1:15:54.487932 PROGRESS: Extracting batch of 7899 precursors
1:15:54.491240 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:15:54.491304 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:15:54.491343 INFO: FWHM in RT is 14.01 seconds, sigma is 0.51
1:15:54.491389 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:15:54.491606 INFO: Starting candidate selection
1:15:58.208036 INFO: Starting candidate scoring
1:15:59.552434 INFO: Finished candidate processing
1:15:59.552528 INFO: Collecting candidate features
1:16:01.750888 WARNING: intensity_correlation has 5 NaNs ( 0.07 % out of 7252)
1:16:01.756563 INFO: Collecting fragment features
1:16:02.386848 INFO: Finished candidate scoring
1:16:02.670681 PROGRESS: === Epoch 18, step 2, extracted 7252 precursors and 32919 fragments ===
1:16:02.670996 INFO: performing precursor FDR with 47 features
1:16:02.671042 INFO: Decoy channel: -1
1:16:02.671070 INFO: Competetive: True
1:16:02.685918 WARNING: dropped 7 target PSMs due to missing features
1:16:02.686033 WARNING: dropped 3 decoy PSMs due to missing features
1:16:02.926460 INFO: Test AUC: 0.541
1:16:02.926591 INFO: Train AUC: 0.587
1:16:02.926662 INFO: AUC difference: 7.83%
1:16:02.926714 WARNING: AUC difference > 5%. This may indicate overfitting.
1:16:03.055785 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
1:16:03.056635 PROGRESS: ============================= Precursor FDR =============================
1:16:03.056755 PROGRESS: Total precursors accumulated: 63
1:16:03.056836 PROGRESS: Target precursors: 58 (92.06%)
1:16:03.056908 PROGRESS: Decoy precursors: 5 (7.94%)
1:16:03.056971 PROGRESS: 
1:16:03.057032 PROGRESS: Precursor Summary:
1:16:03.058769 PROGRESS: Channel   0:	 0.05 FDR:    52; 0.01 FDR:    50; 0.001 FDR:    50
1:16:03.058897 PROGRESS: 
1:16:03.058979 PROGRESS: Protein Summary:
1:16:03.060778 PROGRESS: Channel   0:	 0.05 FDR:    51; 0.01 FDR:    49; 0.001 FDR:    49
1:16:03.060899 PROGRESS: =========================================================================
1:16:03.061857 PROGRESS: === Epoch 18, step 3, extracting elution groups 7000 to 15000 ===
1:16:03.154150 PROGRESS: Extracting batch of 15786 precursors
1:16:03.159568 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:16:03.159633 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:16:03.159668 INFO: FWHM in RT is 14.01 seconds, sigma is 0.51
1:16:03.159711 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:16:03.159927 INFO: Starting candidate selection
1:16:07.072830 INFO: Starting candidate scoring
1:16:08.525043 INFO: Finished candidate processing
1:16:08.525228 INFO: Collecting candidate features
1:16:10.721233 WARNING: intensity_correlation has 7 NaNs ( 0.05 % out of 14454)
1:16:10.728349 INFO: Collecting fragment features
1:16:11.353261 INFO: Finished candidate scoring
1:16:11.644307 PROGRESS: === Epoch 18, step 3, extracted 14454 precursors and 65699 fragments ===
1:16:11.644604 INFO: performing precursor FDR with 47 features
1:16:11.644666 INFO: Decoy channel: -1
1:16:11.644692 INFO: Competetive: True
1:16:11.672765 WARNING: dropped 12 target PSMs due to missing features
1:16:11.672876 WARNING: dropped 5 decoy PSMs due to missing features
1:16:12.401653 INFO: Test AUC: 0.544
1:16:12.401813 INFO: Train AUC: 0.607
1:16:12.401862 INFO: AUC difference: 10.46%
1:16:12.401897 WARNING: AUC difference > 5%. This may indicate overfitting.
1:16:12.527254 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
1:16:12.528171 PROGRESS: ============================= Precursor FDR =============================
1:16:12.528293 PROGRESS: Total precursors accumulated: 204
1:16:12.528382 PROGRESS: Target precursors: 186 (91.18%)
1:16:12.528452 PROGRESS: Decoy precursors: 18 (8.82%)
1:16:12.528516 PROGRESS: 
1:16:12.528575 PROGRESS: Precursor Summary:
1:16:12.530107 PROGRESS: Channel   0:	 0.05 FDR:   121; 0.01 FDR:    86; 0.001 FDR:    86
1:16:12.530220 PROGRESS: 
1:16:12.530293 PROGRESS: Protein Summary:
1:16:12.532016 PROGRESS: Channel   0:	 0.05 FDR:   120; 0.01 FDR:    85; 0.001 FDR:    85
1:16:12.532142 PROGRESS: =========================================================================
1:16:12.533036 PROGRESS: === Epoch 18, step 4, extracting elution groups 15000 to 31000 ===
1:16:12.640748 PROGRESS: Extracting batch of 31621 precursors
1:16:12.651061 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:16:12.651156 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:16:12.651210 INFO: FWHM in RT is 14.01 seconds, sigma is 0.51
1:16:12.651237 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:16:12.651473 INFO: Starting candidate selection
1:16:16.805246 INFO: Starting candidate scoring
1:16:18.369244 INFO: Finished candidate processing
1:16:18.369456 INFO: Collecting candidate features
1:16:20.646081 WARNING: intensity_correlation has 24 NaNs ( 0.08 % out of 29021)
1:16:20.653035 INFO: Collecting fragment features
1:16:21.306061 INFO: Finished candidate scoring
1:16:21.615068 PROGRESS: === Epoch 18, step 4, extracted 29021 precursors and 132950 fragments ===
1:16:21.615399 INFO: performing precursor FDR with 47 features
1:16:21.615461 INFO: Decoy channel: -1
1:16:21.615510 INFO: Competetive: True
1:16:21.672799 WARNING: dropped 26 target PSMs due to missing features
1:16:21.672916 WARNING: dropped 15 decoy PSMs due to missing features
1:16:23.398822 INFO: Test AUC: 0.554
1:16:23.398970 INFO: Train AUC: 0.613
1:16:23.399038 INFO: AUC difference: 9.65%
1:16:23.399088 WARNING: AUC difference > 5%. This may indicate overfitting.
1:16:23.524204 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
1:16:23.525168 PROGRESS: ============================= Precursor FDR =============================
1:16:23.525295 PROGRESS: Total precursors accumulated: 319
1:16:23.525373 PROGRESS: Target precursors: 291 (91.22%)
1:16:23.525442 PROGRESS: Decoy precursors: 28 (8.78%)
1:16:23.525505 PROGRESS: 
1:16:23.525567 PROGRESS: Precursor Summary:
1:16:23.527157 PROGRESS: Channel   0:	 0.05 FDR:   203; 0.01 FDR:   152; 0.001 FDR:   115
1:16:23.527281 PROGRESS: 
1:16:23.527372 PROGRESS: Protein Summary:
1:16:23.529204 PROGRESS: Channel   0:	 0.05 FDR:   201; 0.01 FDR:   150; 0.001 FDR:   115
1:16:23.529318 PROGRESS: =========================================================================
1:16:23.530290 PROGRESS: === Epoch 18, step 5, extracting elution groups 31000 to 63000 ===
1:16:23.667816 PROGRESS: Extracting batch of 63189 precursors
1:16:23.687816 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:16:23.687924 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:16:23.687962 INFO: FWHM in RT is 14.01 seconds, sigma is 0.51
1:16:23.688007 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:16:23.688259 INFO: Starting candidate selection
1:16:28.481862 INFO: Starting candidate scoring
1:16:30.336095 INFO: Finished candidate processing
1:16:30.336200 INFO: Collecting candidate features
1:16:32.666571 WARNING: intensity_correlation has 52 NaNs ( 0.09 % out of 58063)
1:16:32.675397 INFO: Collecting fragment features
1:16:33.350566 INFO: Finished candidate scoring
1:16:33.693161 PROGRESS: === Epoch 18, step 5, extracted 58063 precursors and 264694 fragments ===
1:16:33.700449 INFO: performing precursor FDR with 47 features
1:16:33.700607 INFO: Decoy channel: -1
1:16:33.700702 INFO: Competetive: True
1:16:33.827349 WARNING: dropped 55 target PSMs due to missing features
1:16:33.827460 WARNING: dropped 38 decoy PSMs due to missing features
1:16:37.796372 INFO: Test AUC: 0.556
1:16:37.796497 INFO: Train AUC: 0.611
1:16:37.796551 INFO: AUC difference: 9.12%
1:16:37.796580 WARNING: AUC difference > 5%. This may indicate overfitting.
1:16:37.931438 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
1:16:37.932552 PROGRESS: ============================= Precursor FDR =============================
1:16:37.932688 PROGRESS: Total precursors accumulated: 734
1:16:37.932766 PROGRESS: Target precursors: 669 (91.14%)
1:16:37.932834 PROGRESS: Decoy precursors: 65 (8.86%)
1:16:37.932897 PROGRESS: 
1:16:37.932959 PROGRESS: Precursor Summary:
1:16:37.934739 PROGRESS: Channel   0:	 0.05 FDR:   509; 0.01 FDR:   383; 0.001 FDR:   264
1:16:37.934856 PROGRESS: 
1:16:37.934930 PROGRESS: Protein Summary:
1:16:37.937026 PROGRESS: Channel   0:	 0.05 FDR:   483; 0.01 FDR:   362; 0.001 FDR:   253
1:16:37.937137 PROGRESS: =========================================================================
1:16:37.938247 PROGRESS: === Epoch 18, step 6, extracting elution groups 63000 to 127000 ===
1:16:38.114243 PROGRESS: Extracting batch of 126480 precursors
1:16:38.152625 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:16:38.152737 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:16:38.152775 INFO: FWHM in RT is 14.01 seconds, sigma is 0.51
1:16:38.152817 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:16:38.153071 INFO: Starting candidate selection
1:16:44.255755 INFO: Starting candidate scoring
1:16:46.710065 INFO: Finished candidate processing
1:16:46.710165 INFO: Collecting candidate features
1:16:49.249953 WARNING: intensity_correlation has 113 NaNs ( 0.10 % out of 116023)
1:16:49.263176 INFO: Collecting fragment features
1:16:50.008948 INFO: Finished candidate scoring
1:16:50.431319 PROGRESS: === Epoch 18, step 6, extracted 116023 precursors and 530221 fragments ===
1:16:50.431658 INFO: performing precursor FDR with 47 features
1:16:50.431702 INFO: Decoy channel: -1
1:16:50.431728 INFO: Competetive: True
1:16:50.699183 WARNING: dropped 113 target PSMs due to missing features
1:16:50.699301 WARNING: dropped 93 decoy PSMs due to missing features
1:16:58.460162 INFO: Test AUC: 0.553
1:16:58.460285 INFO: Train AUC: 0.598
1:16:58.460339 INFO: AUC difference: 7.51%
1:16:58.460367 WARNING: AUC difference > 5%. This may indicate overfitting.
1:16:58.623966 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
1:16:58.625376 PROGRESS: ============================= Precursor FDR =============================
1:16:58.625522 PROGRESS: Total precursors accumulated: 1,599
1:16:58.625601 PROGRESS: Target precursors: 1,457 (91.12%)
1:16:58.625669 PROGRESS: Decoy precursors: 142 (8.88%)
1:16:58.625732 PROGRESS: 
1:16:58.625804 PROGRESS: Precursor Summary:
1:16:58.627892 PROGRESS: Channel   0:	 0.05 FDR: 1,085; 0.01 FDR:   758; 0.001 FDR:   593
1:16:58.628030 PROGRESS: 
1:16:58.628105 PROGRESS: Protein Summary:
1:16:58.630704 PROGRESS: Channel   0:	 0.05 FDR:   978; 0.01 FDR:   685; 0.001 FDR:   537
1:16:58.630821 PROGRESS: =========================================================================
1:16:58.632146 PROGRESS: === Epoch 18, step 7, extracting elution groups 127000 to 255000 ===
1:16:58.858479 PROGRESS: Extracting batch of 252951 precursors
1:16:58.932366 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:16:58.932479 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:16:58.932538 INFO: FWHM in RT is 14.01 seconds, sigma is 0.51
1:16:58.932566 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:16:58.932843 INFO: Starting candidate selection
1:17:07.565833 INFO: Starting candidate scoring
1:17:11.202133 INFO: Finished candidate processing
1:17:11.202311 INFO: Collecting candidate features
1:17:14.121426 WARNING: intensity_correlation has 184 NaNs ( 0.08 % out of 232461)
1:17:14.141490 INFO: Collecting fragment features
1:17:14.973604 INFO: Finished candidate scoring
1:17:15.544530 PROGRESS: === Epoch 18, step 7, extracted 232461 precursors and 1063037 fragments ===
1:17:15.544905 INFO: performing precursor FDR with 47 features
1:17:15.544970 INFO: Decoy channel: -1
1:17:15.545017 INFO: Competetive: True
1:17:16.126453 WARNING: dropped 217 target PSMs due to missing features
1:17:16.126591 WARNING: dropped 173 decoy PSMs due to missing features
1:17:32.800958 INFO: Test AUC: 0.550
1:17:32.801103 INFO: Train AUC: 0.585
1:17:32.801161 INFO: AUC difference: 5.99%
1:17:32.801188 WARNING: AUC difference > 5%. This may indicate overfitting.
1:17:32.999485 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
1:17:33.001322 PROGRESS: ============================= Precursor FDR =============================
1:17:33.001471 PROGRESS: Total precursors accumulated: 2,931
1:17:33.001561 PROGRESS: Target precursors: 2,671 (91.13%)
1:17:33.001631 PROGRESS: Decoy precursors: 260 (8.87%)
1:17:33.001694 PROGRESS: 
1:17:33.001755 PROGRESS: Precursor Summary:
1:17:33.004226 PROGRESS: Channel   0:	 0.05 FDR: 2,104; 0.01 FDR: 1,532; 0.001 FDR:   727
1:17:33.004364 PROGRESS: 
1:17:33.004438 PROGRESS: Protein Summary:
1:17:33.007647 PROGRESS: Channel   0:	 0.05 FDR: 1,716; 0.01 FDR: 1,251; 0.001 FDR:   642
1:17:33.007754 PROGRESS: =========================================================================
1:17:33.009440 PROGRESS: === Epoch 18, step 8, extracting elution groups 255000 to 511000 ===
1:17:33.314724 PROGRESS: Extracting batch of 505828 precursors
1:17:33.449221 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:17:33.449337 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:17:33.449376 INFO: FWHM in RT is 14.01 seconds, sigma is 0.51
1:17:33.449420 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:17:33.449681 INFO: Starting candidate selection
1:17:47.149500 INFO: Starting candidate scoring
1:17:53.225926 INFO: Finished candidate processing
1:17:53.226118 INFO: Collecting candidate features
1:17:56.841712 WARNING: intensity_correlation has 363 NaNs ( 0.08 % out of 464968)
1:17:56.874520 INFO: Collecting fragment features
1:17:57.892177 INFO: Finished candidate scoring
1:17:58.764889 PROGRESS: === Epoch 18, step 8, extracted 464968 precursors and 2128318 fragments ===
1:17:58.765240 INFO: performing precursor FDR with 47 features
1:17:58.765287 INFO: Decoy channel: -1
1:17:58.765315 INFO: Competetive: True
1:17:59.856536 WARNING: dropped 397 target PSMs due to missing features
1:17:59.856656 WARNING: dropped 356 decoy PSMs due to missing features
1:18:34.415181 INFO: Test AUC: 0.551
1:18:34.415312 INFO: Train AUC: 0.573
1:18:34.415369 INFO: AUC difference: 3.85%
1:18:34.651995 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
1:18:34.654493 PROGRESS: ============================= Precursor FDR =============================
1:18:34.654638 PROGRESS: Total precursors accumulated: 5,312
1:18:34.654716 PROGRESS: Target precursors: 4,852 (91.34%)
1:18:34.654782 PROGRESS: Decoy precursors: 460 (8.66%)
1:18:34.654843 PROGRESS: 
1:18:34.654903 PROGRESS: Precursor Summary:
1:18:34.658271 PROGRESS: Channel   0:	 0.05 FDR: 4,120; 0.01 FDR: 3,151; 0.001 FDR: 2,144
1:18:34.658400 PROGRESS: 
1:18:34.658482 PROGRESS: Protein Summary:
1:18:34.663176 PROGRESS: Channel   0:	 0.05 FDR: 2,883; 0.01 FDR: 2,190; 0.001 FDR: 1,568
1:18:34.663307 PROGRESS: =========================================================================
1:18:34.665764 PROGRESS: === Epoch 18, step 9, extracting elution groups 511000 to 1023000 ===
1:18:35.097748 PROGRESS: Extracting batch of 1011985 precursors
1:18:35.377113 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:18:35.377239 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:18:35.377281 INFO: FWHM in RT is 14.01 seconds, sigma is 0.51
1:18:35.377309 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:18:35.377574 INFO: Starting candidate selection
1:18:59.158106 INFO: Starting candidate scoring
1:19:10.074691 INFO: Finished candidate processing
1:19:10.074880 INFO: Collecting candidate features
1:19:14.903273 WARNING: intensity_correlation has 699 NaNs ( 0.08 % out of 929452)
1:19:14.961383 INFO: Collecting fragment features
1:19:16.568852 INFO: Finished candidate scoring
1:19:18.115311 PROGRESS: === Epoch 18, step 9, extracted 929452 precursors and 4248102 fragments ===
1:19:18.115654 INFO: performing precursor FDR with 47 features
1:19:18.115699 INFO: Decoy channel: -1
1:19:18.115734 INFO: Competetive: True
1:19:20.296692 WARNING: dropped 783 target PSMs due to missing features
1:19:20.296813 WARNING: dropped 669 decoy PSMs due to missing features
1:20:29.868866 INFO: Test AUC: 0.552
1:20:29.868991 INFO: Train AUC: 0.565
1:20:29.869044 INFO: AUC difference: 2.22%
1:20:30.214281 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
1:20:30.217939 PROGRESS: ============================= Precursor FDR =============================
1:20:30.218101 PROGRESS: Total precursors accumulated: 10,352
1:20:30.218194 PROGRESS: Target precursors: 9,452 (91.31%)
1:20:30.218261 PROGRESS: Decoy precursors: 900 (8.69%)
1:20:30.218324 PROGRESS: 
1:20:30.218385 PROGRESS: Precursor Summary:
1:20:30.223318 PROGRESS: Channel   0:	 0.05 FDR: 8,133; 0.01 FDR: 6,346; 0.001 FDR: 3,149
1:20:30.223478 PROGRESS: 
1:20:30.223550 PROGRESS: Protein Summary:
1:20:30.230808 PROGRESS: Channel   0:	 0.05 FDR: 4,378; 0.01 FDR: 3,424; 0.001 FDR: 2,033
1:20:30.230971 PROGRESS: =========================================================================
1:20:30.237301 INFO: calibration group: precursor, fitting rt estimator 
1:20:31.139653 INFO: calibration group: fragment, fitting mz estimator 
1:20:31.728451 INFO: === checking if epoch conditions were reached ===
1:20:31.728645 INFO: ✅ ms2_error      : 7.0000 <= 7
1:20:31.728726 INFO: ❌ rt_error       : 202.3677 > 100
1:20:31.728791 INFO: ✅ current_epoch  : 18 >= 3
1:20:31.728848 INFO: ==============================================
1:20:31.947884 INFO: calibration group: precursor, predicting mz
1:20:31.948160 WARNING: mz prediction was skipped as it has not been fitted yet
1:20:31.948201 INFO: calibration group: precursor, predicting rt
1:20:38.772863 INFO: calibration group: fragment, predicting mz
1:20:56.841250 PROGRESS: === Epoch 19, step 0, extracting elution groups 0 to 1000 ===
1:20:56.962210 PROGRESS: Extracting batch of 1979 precursors
1:20:56.963921 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:20:56.964001 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:20:56.964042 INFO: FWHM in RT is 14.06 seconds, sigma is 0.51
1:20:56.964072 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:20:56.964304 INFO: Starting candidate selection
1:21:00.958599 INFO: Starting candidate scoring
1:21:02.247788 INFO: Finished candidate processing
1:21:02.247904 INFO: Collecting candidate features
1:21:04.417729 INFO: Collecting fragment features
1:21:05.049481 INFO: Finished candidate scoring
1:21:05.445337 PROGRESS: === Epoch 19, step 0, extracted 1830 precursors and 8332 fragments ===
1:21:05.445658 INFO: performing precursor FDR with 47 features
1:21:05.445703 INFO: Decoy channel: -1
1:21:05.445730 INFO: Competetive: True
1:21:05.478084 INFO: Test AUC: 0.542
1:21:05.478191 INFO: Train AUC: 0.570
1:21:05.478236 INFO: AUC difference: 4.93%
1:21:07.056114 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
1:21:07.056966 PROGRESS: ============================= Precursor FDR =============================
1:21:07.057092 PROGRESS: Total precursors accumulated: 15
1:21:07.057170 PROGRESS: Target precursors: 14 (93.33%)
1:21:07.057239 PROGRESS: Decoy precursors: 1 (6.67%)
1:21:07.057303 PROGRESS: 
1:21:07.057365 PROGRESS: Precursor Summary:
1:21:07.058806 PROGRESS: Channel   0:	 0.05 FDR:    11; 0.01 FDR:    11; 0.001 FDR:    11
1:21:07.058922 PROGRESS: 
1:21:07.058998 PROGRESS: Protein Summary:
1:21:07.060618 PROGRESS: Channel   0:	 0.05 FDR:    11; 0.01 FDR:    11; 0.001 FDR:    11
1:21:07.060746 PROGRESS: =========================================================================
1:21:07.061602 PROGRESS: === Epoch 19, step 1, extracting elution groups 1000 to 3000 ===
1:21:07.139399 PROGRESS: Extracting batch of 3957 precursors
1:21:07.141623 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:21:07.141685 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:21:07.141723 INFO: FWHM in RT is 14.06 seconds, sigma is 0.51
1:21:07.141791 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:21:07.142028 INFO: Starting candidate selection
1:21:10.809864 INFO: Starting candidate scoring
1:21:12.118040 INFO: Finished candidate processing
1:21:12.118131 INFO: Collecting candidate features
1:21:14.265475 WARNING: intensity_correlation has 4 NaNs ( 0.11 % out of 3600)
1:21:14.271521 INFO: Collecting fragment features
1:21:14.915868 INFO: Finished candidate scoring
1:21:15.193524 PROGRESS: === Epoch 19, step 1, extracted 3600 precursors and 16504 fragments ===
1:21:15.193824 INFO: performing precursor FDR with 47 features
1:21:15.193875 INFO: Decoy channel: -1
1:21:15.193902 INFO: Competetive: True
1:21:15.202588 WARNING: dropped 2 target PSMs due to missing features
1:21:15.202680 WARNING: dropped 2 decoy PSMs due to missing features
1:21:15.239658 INFO: Test AUC: 0.535
1:21:15.239787 INFO: Train AUC: 0.561
1:21:15.239847 INFO: AUC difference: 4.69%
1:21:15.386023 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
1:21:15.386812 PROGRESS: ============================= Precursor FDR =============================
1:21:15.386933 PROGRESS: Total precursors accumulated: 39
1:21:15.387011 PROGRESS: Target precursors: 36 (92.31%)
1:21:15.387079 PROGRESS: Decoy precursors: 3 (7.69%)
1:21:15.387142 PROGRESS: 
1:21:15.387203 PROGRESS: Precursor Summary:
1:21:15.388632 PROGRESS: Channel   0:	 0.05 FDR:    31; 0.01 FDR:    31; 0.001 FDR:    31
1:21:15.388762 PROGRESS: 
1:21:15.388836 PROGRESS: Protein Summary:
1:21:15.390468 PROGRESS: Channel   0:	 0.05 FDR:    31; 0.01 FDR:    31; 0.001 FDR:    31
1:21:15.390582 PROGRESS: =========================================================================
1:21:15.391447 PROGRESS: === Epoch 19, step 2, extracting elution groups 3000 to 7000 ===
1:21:15.474220 PROGRESS: Extracting batch of 7900 precursors
1:21:15.477524 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:21:15.477589 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:21:15.477643 INFO: FWHM in RT is 14.06 seconds, sigma is 0.51
1:21:15.477674 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:21:15.477910 INFO: Starting candidate selection
1:21:19.209510 INFO: Starting candidate scoring
1:21:20.552421 INFO: Finished candidate processing
1:21:20.552510 INFO: Collecting candidate features
1:21:22.718698 WARNING: intensity_correlation has 10 NaNs ( 0.14 % out of 7278)
1:21:22.725422 INFO: Collecting fragment features
1:21:23.366819 INFO: Finished candidate scoring
1:21:23.650704 PROGRESS: === Epoch 19, step 2, extracted 7278 precursors and 33409 fragments ===
1:21:23.651054 INFO: performing precursor FDR with 47 features
1:21:23.651107 INFO: Decoy channel: -1
1:21:23.651133 INFO: Competetive: True
1:21:23.666075 WARNING: dropped 7 target PSMs due to missing features
1:21:23.666193 WARNING: dropped 7 decoy PSMs due to missing features
1:21:23.955408 INFO: Test AUC: 0.544
1:21:23.955540 INFO: Train AUC: 0.588
1:21:23.955609 INFO: AUC difference: 7.47%
1:21:23.955644 WARNING: AUC difference > 5%. This may indicate overfitting.
1:21:24.080885 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
1:21:24.081753 PROGRESS: ============================= Precursor FDR =============================
1:21:24.081882 PROGRESS: Total precursors accumulated: 107
1:21:24.081959 PROGRESS: Target precursors: 99 (92.52%)
1:21:24.082026 PROGRESS: Decoy precursors: 8 (7.48%)
1:21:24.082088 PROGRESS: 
1:21:24.082149 PROGRESS: Precursor Summary:
1:21:24.083637 PROGRESS: Channel   0:	 0.05 FDR:    78; 0.01 FDR:    75; 0.001 FDR:    75
1:21:24.083770 PROGRESS: 
1:21:24.083844 PROGRESS: Protein Summary:
1:21:24.085542 PROGRESS: Channel   0:	 0.05 FDR:    78; 0.01 FDR:    75; 0.001 FDR:    75
1:21:24.085652 PROGRESS: =========================================================================
1:21:24.086558 PROGRESS: === Epoch 19, step 3, extracting elution groups 7000 to 15000 ===
1:21:24.177795 PROGRESS: Extracting batch of 15802 precursors
1:21:24.183285 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:21:24.183386 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:21:24.183427 INFO: FWHM in RT is 14.06 seconds, sigma is 0.51
1:21:24.183454 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:21:24.183689 INFO: Starting candidate selection
1:21:28.055216 INFO: Starting candidate scoring
1:21:29.468151 INFO: Finished candidate processing
1:21:29.468242 INFO: Collecting candidate features
1:21:31.689329 WARNING: intensity_correlation has 8 NaNs ( 0.05 % out of 14563)
1:21:31.695355 INFO: Collecting fragment features
1:21:32.355836 INFO: Finished candidate scoring
1:21:32.650299 PROGRESS: === Epoch 19, step 3, extracted 14563 precursors and 66568 fragments ===
1:21:32.650623 INFO: performing precursor FDR with 47 features
1:21:32.650672 INFO: Decoy channel: -1
1:21:32.650699 INFO: Competetive: True
1:21:32.679163 WARNING: dropped 11 target PSMs due to missing features
1:21:32.679276 WARNING: dropped 11 decoy PSMs due to missing features
1:21:33.434064 INFO: Test AUC: 0.567
1:21:33.434227 INFO: Train AUC: 0.608
1:21:33.434283 INFO: AUC difference: 6.69%
1:21:33.434318 WARNING: AUC difference > 5%. This may indicate overfitting.
1:21:33.560725 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
1:21:33.561663 PROGRESS: ============================= Precursor FDR =============================
1:21:33.561797 PROGRESS: Total precursors accumulated: 247
1:21:33.561876 PROGRESS: Target precursors: 225 (91.09%)
1:21:33.561945 PROGRESS: Decoy precursors: 22 (8.91%)
1:21:33.562018 PROGRESS: 
1:21:33.562081 PROGRESS: Precursor Summary:
1:21:33.563630 PROGRESS: Channel   0:	 0.05 FDR:   174; 0.01 FDR:   128; 0.001 FDR:    99
1:21:33.563765 PROGRESS: 
1:21:33.563840 PROGRESS: Protein Summary:
1:21:33.565638 PROGRESS: Channel   0:	 0.05 FDR:   171; 0.01 FDR:   125; 0.001 FDR:    96
1:21:33.565749 PROGRESS: =========================================================================
1:21:33.566698 PROGRESS: === Epoch 19, step 4, extracting elution groups 15000 to 31000 ===
1:21:33.675380 PROGRESS: Extracting batch of 31606 precursors
1:21:33.686125 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:21:33.686221 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:21:33.686259 INFO: FWHM in RT is 14.06 seconds, sigma is 0.51
1:21:33.686286 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:21:33.686526 INFO: Starting candidate selection
1:21:37.908750 INFO: Starting candidate scoring
1:21:39.473323 INFO: Finished candidate processing
1:21:39.473415 INFO: Collecting candidate features
1:21:41.742114 WARNING: intensity_correlation has 33 NaNs ( 0.11 % out of 28966)
1:21:41.749085 INFO: Collecting fragment features
1:21:42.429119 INFO: Finished candidate scoring
1:21:42.739268 PROGRESS: === Epoch 19, step 4, extracted 28966 precursors and 132780 fragments ===
1:21:42.739610 INFO: performing precursor FDR with 47 features
1:21:42.739676 INFO: Decoy channel: -1
1:21:42.739724 INFO: Competetive: True
1:21:42.799414 WARNING: dropped 28 target PSMs due to missing features
1:21:42.799527 WARNING: dropped 27 decoy PSMs due to missing features
1:21:44.549366 INFO: Test AUC: 0.557
1:21:44.549526 INFO: Train AUC: 0.612
1:21:44.549600 INFO: AUC difference: 9.05%
1:21:44.549657 WARNING: AUC difference > 5%. This may indicate overfitting.
1:21:44.677785 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
1:21:44.678808 PROGRESS: ============================= Precursor FDR =============================
1:21:44.678943 PROGRESS: Total precursors accumulated: 374
1:21:44.679034 PROGRESS: Target precursors: 341 (91.18%)
1:21:44.679120 PROGRESS: Decoy precursors: 33 (8.82%)
1:21:44.679210 PROGRESS: 
1:21:44.679298 PROGRESS: Precursor Summary:
1:21:44.681456 PROGRESS: Channel   0:	 0.05 FDR:   270; 0.01 FDR:   192; 0.001 FDR:   186
1:21:44.681589 PROGRESS: 
1:21:44.681688 PROGRESS: Protein Summary:
1:21:44.683655 PROGRESS: Channel   0:	 0.05 FDR:   263; 0.01 FDR:   187; 0.001 FDR:   182
1:21:44.683790 PROGRESS: =========================================================================
1:21:44.685123 PROGRESS: === Epoch 19, step 5, extracting elution groups 31000 to 63000 ===
1:21:44.821030 PROGRESS: Extracting batch of 63259 precursors
1:21:44.840979 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:21:44.841097 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:21:44.841143 INFO: FWHM in RT is 14.06 seconds, sigma is 0.51
1:21:44.841172 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:21:44.841429 INFO: Starting candidate selection
1:21:49.709052 INFO: Starting candidate scoring
1:21:51.579244 INFO: Finished candidate processing
1:21:51.579342 INFO: Collecting candidate features
1:21:53.912531 WARNING: intensity_correlation has 53 NaNs ( 0.09 % out of 58085)
1:21:53.921490 INFO: Collecting fragment features
1:21:54.623930 INFO: Finished candidate scoring
1:21:54.967481 PROGRESS: === Epoch 19, step 5, extracted 58085 precursors and 266644 fragments ===
1:21:54.974773 INFO: performing precursor FDR with 47 features
1:21:54.974927 INFO: Decoy channel: -1
1:21:54.975017 INFO: Competetive: True
1:21:55.102159 WARNING: dropped 46 target PSMs due to missing features
1:21:55.102275 WARNING: dropped 62 decoy PSMs due to missing features
1:21:58.925278 INFO: Test AUC: 0.553
1:21:58.925398 INFO: Train AUC: 0.615
1:21:58.925435 INFO: AUC difference: 9.97%
1:21:58.925479 WARNING: AUC difference > 5%. This may indicate overfitting.
1:21:59.067647 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
1:21:59.068835 PROGRESS: ============================= Precursor FDR =============================
1:21:59.068967 PROGRESS: Total precursors accumulated: 742
1:21:59.069046 PROGRESS: Target precursors: 675 (90.97%)
1:21:59.069114 PROGRESS: Decoy precursors: 67 (9.03%)
1:21:59.069176 PROGRESS: 
1:21:59.069237 PROGRESS: Precursor Summary:
1:21:59.071090 PROGRESS: Channel   0:	 0.05 FDR:   545; 0.01 FDR:   468; 0.001 FDR:   182
1:21:59.071230 PROGRESS: 
1:21:59.071305 PROGRESS: Protein Summary:
1:21:59.073451 PROGRESS: Channel   0:	 0.05 FDR:   519; 0.01 FDR:   444; 0.001 FDR:   175
1:21:59.073578 PROGRESS: =========================================================================
1:21:59.074751 PROGRESS: === Epoch 19, step 6, extracting elution groups 63000 to 127000 ===
1:21:59.251047 PROGRESS: Extracting batch of 126432 precursors
1:21:59.289647 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:21:59.289762 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:21:59.289833 INFO: FWHM in RT is 14.06 seconds, sigma is 0.51
1:21:59.289861 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:21:59.290130 INFO: Starting candidate selection
1:22:05.395629 INFO: Starting candidate scoring
1:22:07.846406 INFO: Finished candidate processing
1:22:07.846590 INFO: Collecting candidate features
1:22:10.388331 WARNING: intensity_correlation has 113 NaNs ( 0.10 % out of 115916)
1:22:10.401160 INFO: Collecting fragment features
1:22:11.167661 INFO: Finished candidate scoring
1:22:11.588244 PROGRESS: === Epoch 19, step 6, extracted 115916 precursors and 531366 fragments ===
1:22:11.588577 INFO: performing precursor FDR with 47 features
1:22:11.588622 INFO: Decoy channel: -1
1:22:11.588648 INFO: Competetive: True
1:22:11.856657 WARNING: dropped 105 target PSMs due to missing features
1:22:11.856774 WARNING: dropped 116 decoy PSMs due to missing features
1:22:19.873785 INFO: Test AUC: 0.551
1:22:19.873929 INFO: Train AUC: 0.600
1:22:19.873971 INFO: AUC difference: 8.22%
1:22:19.873998 WARNING: AUC difference > 5%. This may indicate overfitting.
1:22:20.026190 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
1:22:20.027547 PROGRESS: ============================= Precursor FDR =============================
1:22:20.027681 PROGRESS: Total precursors accumulated: 1,390
1:22:20.027760 PROGRESS: Target precursors: 1,270 (91.37%)
1:22:20.027827 PROGRESS: Decoy precursors: 120 (8.63%)
1:22:20.027890 PROGRESS: 
1:22:20.027959 PROGRESS: Precursor Summary:
1:22:20.030064 PROGRESS: Channel   0:	 0.05 FDR: 1,078; 0.01 FDR:   856; 0.001 FDR:   373
1:22:20.030189 PROGRESS: 
1:22:20.030264 PROGRESS: Protein Summary:
1:22:20.032827 PROGRESS: Channel   0:	 0.05 FDR:   975; 0.01 FDR:   770; 0.001 FDR:   341
1:22:20.032943 PROGRESS: =========================================================================
1:22:20.034338 PROGRESS: === Epoch 19, step 7, extracting elution groups 127000 to 255000 ===
1:22:20.260892 PROGRESS: Extracting batch of 252864 precursors
1:22:20.334399 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:22:20.334529 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:22:20.334569 INFO: FWHM in RT is 14.06 seconds, sigma is 0.51
1:22:20.334597 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:22:20.334882 INFO: Starting candidate selection
1:22:28.977145 INFO: Starting candidate scoring
1:22:32.621074 INFO: Finished candidate processing
1:22:32.621250 INFO: Collecting candidate features
1:22:35.531542 WARNING: intensity_correlation has 194 NaNs ( 0.08 % out of 232211)
1:22:35.551641 INFO: Collecting fragment features
1:22:36.402896 INFO: Finished candidate scoring
1:22:36.975728 PROGRESS: === Epoch 19, step 7, extracted 232211 precursors and 1061580 fragments ===
1:22:36.976065 INFO: performing precursor FDR with 47 features
1:22:36.976112 INFO: Decoy channel: -1
1:22:36.976139 INFO: Competetive: True
1:22:37.552340 WARNING: dropped 189 target PSMs due to missing features
1:22:37.552461 WARNING: dropped 226 decoy PSMs due to missing features
1:22:54.653337 INFO: Test AUC: 0.555
1:22:54.653470 INFO: Train AUC: 0.587
1:22:54.653528 INFO: AUC difference: 5.48%
1:22:54.653557 WARNING: AUC difference > 5%. This may indicate overfitting.
1:22:54.843864 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
1:22:54.845703 PROGRESS: ============================= Precursor FDR =============================
1:22:54.845857 PROGRESS: Total precursors accumulated: 2,839
1:22:54.845938 PROGRESS: Target precursors: 2,588 (91.16%)
1:22:54.846005 PROGRESS: Decoy precursors: 251 (8.84%)
1:22:54.846069 PROGRESS: 
1:22:54.846141 PROGRESS: Precursor Summary:
1:22:54.848697 PROGRESS: Channel   0:	 0.05 FDR: 2,114; 0.01 FDR: 1,650; 0.001 FDR:   839
1:22:54.848834 PROGRESS: 
1:22:54.848908 PROGRESS: Protein Summary:
1:22:54.852179 PROGRESS: Channel   0:	 0.05 FDR: 1,707; 0.01 FDR: 1,328; 0.001 FDR:   716
1:22:54.852285 PROGRESS: =========================================================================
1:22:54.854131 PROGRESS: === Epoch 19, step 8, extracting elution groups 255000 to 511000 ===
1:22:55.157449 PROGRESS: Extracting batch of 505904 precursors
1:22:55.291477 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:22:55.291595 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:22:55.291633 INFO: FWHM in RT is 14.06 seconds, sigma is 0.51
1:22:55.291675 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:22:55.291955 INFO: Starting candidate selection
1:23:09.022994 INFO: Starting candidate scoring
1:23:15.036597 INFO: Finished candidate processing
1:23:15.036792 INFO: Collecting candidate features
1:23:18.653953 WARNING: intensity_correlation has 453 NaNs ( 0.10 % out of 464464)
1:23:18.686927 INFO: Collecting fragment features
1:23:19.721861 INFO: Finished candidate scoring
1:23:20.600822 PROGRESS: === Epoch 19, step 8, extracted 464464 precursors and 2126333 fragments ===
1:23:20.601163 INFO: performing precursor FDR with 47 features
1:23:20.601207 INFO: Decoy channel: -1
1:23:20.601233 INFO: Competetive: True
1:23:21.695228 WARNING: dropped 410 target PSMs due to missing features
1:23:21.695352 WARNING: dropped 458 decoy PSMs due to missing features
1:23:56.085180 INFO: Test AUC: 0.552
1:23:56.085312 INFO: Train AUC: 0.573
1:23:56.085359 INFO: AUC difference: 3.69%
1:23:56.323354 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
1:23:56.325831 PROGRESS: ============================= Precursor FDR =============================
1:23:56.325998 PROGRESS: Total precursors accumulated: 5,340
1:23:56.326078 PROGRESS: Target precursors: 4,875 (91.29%)
1:23:56.326161 PROGRESS: Decoy precursors: 465 (8.71%)
1:23:56.326227 PROGRESS: 
1:23:56.326289 PROGRESS: Precursor Summary:
1:23:56.329307 PROGRESS: Channel   0:	 0.05 FDR: 4,203; 0.01 FDR: 3,144; 0.001 FDR:     0
1:23:56.329424 PROGRESS: 
1:23:56.329495 PROGRESS: Protein Summary:
1:23:56.333599 PROGRESS: Channel   0:	 0.05 FDR: 2,884; 0.01 FDR: 2,186; 0.001 FDR:     0
1:23:56.333729 PROGRESS: =========================================================================
1:23:56.336240 PROGRESS: === Epoch 19, step 9, extracting elution groups 511000 to 1023000 ===
1:23:56.762389 PROGRESS: Extracting batch of 1011572 precursors
1:23:57.036661 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:23:57.036780 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:23:57.036819 INFO: FWHM in RT is 14.06 seconds, sigma is 0.51
1:23:57.036862 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:23:57.037134 INFO: Starting candidate selection
1:24:20.835764 INFO: Starting candidate scoring
1:24:31.708000 INFO: Finished candidate processing
1:24:31.708192 INFO: Collecting candidate features
1:24:36.553842 WARNING: intensity_correlation has 807 NaNs ( 0.09 % out of 928367)
1:24:36.555599 WARNING: height_correlation has 2 NaNs ( 0.00 % out of 928367)
1:24:36.614058 INFO: Collecting fragment features
1:24:38.220600 INFO: Finished candidate scoring
1:24:39.770587 PROGRESS: === Epoch 19, step 9, extracted 928367 precursors and 4247724 fragments ===
1:24:39.770922 INFO: performing precursor FDR with 47 features
1:24:39.770968 INFO: Decoy channel: -1
1:24:39.770995 INFO: Competetive: True
1:24:41.998726 WARNING: dropped 827 target PSMs due to missing features
1:24:41.998852 WARNING: dropped 848 decoy PSMs due to missing features
1:25:52.437278 INFO: Test AUC: 0.552
1:25:52.437415 INFO: Train AUC: 0.566
1:25:52.437459 INFO: AUC difference: 2.48%
1:25:52.787258 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
1:25:52.791075 PROGRESS: ============================= Precursor FDR =============================
1:25:52.791255 PROGRESS: Total precursors accumulated: 10,475
1:25:52.791363 PROGRESS: Target precursors: 9,563 (91.29%)
1:25:52.791448 PROGRESS: Decoy precursors: 912 (8.71%)
1:25:52.791537 PROGRESS: 
1:25:52.791623 PROGRESS: Precursor Summary:
1:25:52.797634 PROGRESS: Channel   0:	 0.05 FDR: 8,307; 0.01 FDR: 6,313; 0.001 FDR: 3,093
1:25:52.797846 PROGRESS: 
1:25:52.797938 PROGRESS: Protein Summary:
1:25:52.805216 PROGRESS: Channel   0:	 0.05 FDR: 4,510; 0.01 FDR: 3,410; 0.001 FDR: 1,980
1:25:52.805381 PROGRESS: =========================================================================
1:25:52.812873 INFO: calibration group: precursor, fitting rt estimator 
1:25:53.714832 INFO: calibration group: fragment, fitting mz estimator 
1:25:54.494097 INFO: calibration group: precursor, predicting mz
1:25:54.494710 WARNING: mz prediction was skipped as it has not been fitted yet
1:25:54.494761 INFO: calibration group: precursor, predicting rt
1:26:01.326757 INFO: calibration group: fragment, predicting mz
1:26:18.965313 PROGRESS: Extracting batch of 9950763 precursors
1:26:21.614830 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
1:26:21.614954 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:26:21.614993 INFO: FWHM in RT is 14.11 seconds, sigma is 0.51
1:26:21.615041 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:26:21.615310 INFO: Starting candidate selection
1:29:30.608850 INFO: Applying score cutoff of 49.03050296020508
1:29:30.772900 INFO: Removed 7062111 precursors with score below cutoff
1:29:33.221181 INFO: Starting candidate scoring
1:30:03.428999 INFO: Finished candidate processing
1:30:03.429234 INFO: Collecting candidate features
1:30:12.198645 WARNING: intensity_correlation has 19 NaNs ( 0.00 % out of 2570721)
1:30:12.343885 INFO: Collecting fragment features
1:30:15.978377 INFO: Finished candidate scoring
1:30:18.708371 INFO: performing precursor FDR with 47 features
1:30:18.708483 INFO: Decoy channel: -1
1:30:18.708510 INFO: Competetive: True
1:30:20.940656 WARNING: dropped 10 target PSMs due to missing features
1:30:20.940777 WARNING: dropped 9 decoy PSMs due to missing features
1:31:57.558297 INFO: Test AUC: 0.567
1:31:57.558425 INFO: Train AUC: 0.575
1:31:57.558463 INFO: AUC difference: 1.43%
1:31:57.954191 INFO: Removing fragments below FDR threshold
1:31:58.185743 PROGRESS: ============================= Precursor FDR =============================
1:31:58.186021 PROGRESS: Total precursors accumulated: 21,811
1:31:58.186110 PROGRESS: Target precursors: 21,596 (99.01%)
1:31:58.186197 PROGRESS: Decoy precursors: 215 (0.99%)
1:31:58.186262 PROGRESS: 
1:31:58.186324 PROGRESS: Precursor Summary:
1:31:58.200735 PROGRESS: Channel   0:	 0.05 FDR: 21,596; 0.01 FDR: 21,596; 0.001 FDR: 15,531
1:31:58.200972 PROGRESS: 
1:31:58.201047 PROGRESS: Protein Summary:
1:31:58.220012 PROGRESS: Channel   0:	 0.05 FDR: 6,374; 0.01 FDR: 6,374; 0.001 FDR: 5,032
1:31:58.220248 PROGRESS: =========================================================================
1:31:58.592582 INFO: Finished workflow for LFQ_Orbitrap_AIF_Condition_B_Sample_Alpha_03
1:31:59.106884 PROGRESS: Loading raw file 2/6: LFQ_Orbitrap_AIF_Condition_A_Sample_Alpha_01
1:31:59.107073 INFO: Creating workflow folder for LFQ_Orbitrap_AIF_Condition_A_Sample_Alpha_01 at output/.progress/LFQ_Orbitrap_AIF_Condition_A_Sample_Alpha_01
1:32:29.184823 INFO: Determining DIA cycle
1:32:29.198782 WARNING: Failed to determine DIA cycle, will retry without MS1 spectra.
1:32:29.204776 INFO: Determining DIA cycle
1:32:29.222639 INFO: Found cycle with start 0.00 min and length 151.
1:32:29.375927 INFO: ============ Raw file stats ============
1:32:29.376316 INFO: RT (min)            : 0.0 - 150.0
1:32:29.376397 INFO: RT duration (sec)   : 8999.7
1:32:29.376428 INFO: RT duration (min)   : 150.0
1:32:29.376541 INFO: Cycle len (scans)   : 151
1:32:29.376580 INFO: Cycle len (sec)     : 5.83
1:32:29.376608 INFO: Number of cycles    : 1542
1:32:29.376667 INFO: MS2 range (m/z)     : 396.4 - 1004.7
1:32:29.376699 INFO: ========================================
1:32:31.650735 INFO: Initializing CalibrationManager
1:32:31.650990 INFO: Loading calibration config
1:32:31.651779 INFO: Calibration config: [{'name': 'fragment', 'estimators': [{'name': 'mz', 'model': 'LOESSRegression', 'model_args': {'n_kernels': 2}, 'input_columns': ['mz_library'], 'target_columns': ['mz_observed'], 'output_columns': ['mz_calibrated'], 'transform_deviation': '1e6', 'function': LOESSRegression(n_kernels=2)}]}, {'name': 'precursor', 'estimators': [{'name': 'mz', 'model': 'LOESSRegression', 'model_args': {'n_kernels': 2}, 'input_columns': ['mz_library'], 'target_columns': ['mz_observed'], 'output_columns': ['mz_calibrated'], 'transform_deviation': '1e6', 'function': LOESSRegression(n_kernels=2)}, {'name': 'rt', 'model': 'LOESSRegression', 'model_args': {'n_kernels': 6}, 'input_columns': ['rt_library'], 'target_columns': ['rt_observed'], 'output_columns': ['rt_calibrated'], 'function': LOESSRegression()}, {'name': 'mobility', 'model': 'LOESSRegression', 'model_args': {'n_kernels': 2}, 'input_columns': ['mobility_library'], 'target_columns': ['mobility_observed'], 'output_columns': ['mobility_calibrated'], 'function': LOESSRegression(n_kernels=2)}]}]
1:32:31.651913 INFO: Calibration group :fragment, found 1 estimator(s)
1:32:31.651999 INFO: Calibration group :precursor, found 3 estimator(s)
1:32:31.652085 INFO: Disabling ion mobility calibration
1:32:31.652119 INFO: removed mobility estimator from group precursor
1:32:31.652200 INFO: Initializing OptimizationManager
1:32:31.652292 INFO: initial parameter: fwhm_rt = 5
1:32:31.652349 INFO: initial parameter: fwhm_mobility = 0.01
1:32:31.652404 INFO: initial parameter: score_cutoff = 0
1:32:31.652496 PROGRESS: Initializing workflow LFQ_Orbitrap_AIF_Condition_A_Sample_Alpha_01
1:32:31.652565 INFO: Initializing OptimizationManager
1:32:31.652595 INFO: initial parameter: current_epoch = 0
1:32:31.652623 INFO: initial parameter: current_step = 0
1:32:31.652646 INFO: initial parameter: ms1_error = 10
1:32:31.652667 INFO: initial parameter: ms2_error = 10
1:32:31.652688 INFO: initial parameter: rt_error = 240
1:32:31.652709 INFO: initial parameter: mobility_error = 0.08
1:32:31.652729 INFO: initial parameter: column_type = library
1:32:31.652748 INFO: initial parameter: num_candidates = 1
1:32:31.652769 INFO: initial parameter: recalibration_target = 200
1:32:31.652791 INFO: initial parameter: accumulated_precursors = 0
1:32:31.652813 INFO: initial parameter: accumulated_precursors_01FDR = 0
1:32:31.652834 INFO: initial parameter: accumulated_precursors_001FDR = 0
1:32:31.652866 INFO: Initializing FDRManager
1:32:31.652897 INFO: Loading classifier store from /home/alphadia/miniconda3/envs/alphadia172/lib/python3.11/site-packages/alphadia/constants/classifier
1:32:31.655590 PROGRESS: Applying channel filter using only: [0]
1:32:33.655796 PROGRESS: 4,989,882 target precursors potentially observable (188,089 removed)
1:32:37.222274 INFO: === checking if epoch conditions were reached ===
1:32:37.222558 INFO: ❌ ms2_error      : 10.0000 > 7
1:32:37.222643 INFO: ❌ rt_error       : 240.0000 > 100
1:32:37.222707 INFO: ❌ current_epoch  : 0 < 3
1:32:37.222764 INFO: ==============================================
1:32:37.428408 INFO: calibration group: precursor, predicting mz
1:32:37.428695 WARNING: mz prediction was skipped as it has not been fitted yet
1:32:37.428737 INFO: calibration group: precursor, predicting rt
1:32:37.428797 WARNING: rt prediction was skipped as it has not been fitted yet
1:32:37.428832 INFO: calibration group: fragment, predicting mz
1:32:37.428887 WARNING: mz prediction was skipped as it has not been fitted yet
1:32:37.428923 PROGRESS: === Epoch 0, step 0, extracting elution groups 0 to 1000 ===
1:32:37.501893 PROGRESS: Extracting batch of 1970 precursors
1:32:37.503638 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:32:37.503731 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:32:37.503788 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
1:32:37.503817 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
1:32:37.504055 INFO: Starting candidate selection
1:32:40.689038 INFO: Starting candidate scoring
1:32:41.790658 INFO: Finished candidate processing
1:32:41.790742 INFO: Collecting candidate features
1:32:43.935647 INFO: Collecting fragment features
1:32:44.550074 INFO: Finished candidate scoring
1:32:44.826551 PROGRESS: === Epoch 0, step 0, extracted 1672 precursors and 8340 fragments ===
1:32:44.826813 INFO: performing precursor FDR with 47 features
1:32:44.826858 INFO: Decoy channel: -1
1:32:44.826884 INFO: Competetive: True
1:32:44.863065 INFO: Test AUC: 0.545
1:32:44.863175 INFO: Train AUC: 0.529
1:32:44.863221 INFO: AUC difference: 3.01%
1:32:44.982213 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
1:32:44.983266 PROGRESS: ============================= Precursor FDR =============================
1:32:44.983394 PROGRESS: Total precursors accumulated: 871
1:32:44.983472 PROGRESS: Target precursors: 465 (53.39%)
1:32:44.983541 PROGRESS: Decoy precursors: 406 (46.61%)
1:32:44.983604 PROGRESS: 
1:32:44.983676 PROGRESS: Precursor Summary:
1:32:44.985107 PROGRESS: Channel   0:	 0.05 FDR:     0; 0.01 FDR:     0; 0.001 FDR:     0
1:32:44.985240 PROGRESS: 
1:32:44.985314 PROGRESS: Protein Summary:
1:32:44.987588 PROGRESS: Channel   0:	 0.05 FDR:     0; 0.01 FDR:     0; 0.001 FDR:     0
1:32:44.987752 PROGRESS: =========================================================================
1:32:44.988976 PROGRESS: === Epoch 0, step 1, extracting elution groups 1000 to 3000 ===
1:32:45.068380 PROGRESS: Extracting batch of 3962 precursors
1:32:45.070670 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:32:45.070735 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:32:45.070776 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
1:32:45.070806 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
1:32:45.071046 INFO: Starting candidate selection
1:32:48.246844 INFO: Starting candidate scoring
1:32:49.339187 INFO: Finished candidate processing
1:32:49.339277 INFO: Collecting candidate features
1:32:51.489903 INFO: Collecting fragment features
1:32:52.113820 INFO: Finished candidate scoring
1:32:52.393537 PROGRESS: === Epoch 0, step 1, extracted 3405 precursors and 17395 fragments ===
1:32:52.393827 INFO: performing precursor FDR with 47 features
1:32:52.393879 INFO: Decoy channel: -1
1:32:52.393907 INFO: Competetive: True
1:32:52.459973 INFO: Test AUC: 0.520
1:32:52.460093 INFO: Train AUC: 0.502
1:32:52.460140 INFO: AUC difference: 3.51%
1:32:52.577152 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
1:32:52.578803 PROGRESS: ============================= Precursor FDR =============================
1:32:52.578974 PROGRESS: Total precursors accumulated: 2,625
1:32:52.579068 PROGRESS: Target precursors: 1,336 (50.90%)
1:32:52.579136 PROGRESS: Decoy precursors: 1,289 (49.10%)
1:32:52.579199 PROGRESS: 
1:32:52.579260 PROGRESS: Precursor Summary:
1:32:52.580705 PROGRESS: Channel   0:	 0.05 FDR:     0; 0.01 FDR:     0; 0.001 FDR:     0
1:32:52.580838 PROGRESS: 
1:32:52.580913 PROGRESS: Protein Summary:
1:32:52.582525 PROGRESS: Channel   0:	 0.05 FDR:     0; 0.01 FDR:     0; 0.001 FDR:     0
1:32:52.582647 PROGRESS: =========================================================================
1:32:52.583496 PROGRESS: === Epoch 0, step 2, extracting elution groups 3000 to 7000 ===
1:32:52.666027 PROGRESS: Extracting batch of 7886 precursors
1:32:52.669174 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:32:52.669238 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:32:52.669277 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
1:32:52.669322 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
1:32:52.669544 INFO: Starting candidate selection
1:32:55.986190 INFO: Starting candidate scoring
1:32:57.137624 INFO: Finished candidate processing
1:32:57.137738 INFO: Collecting candidate features
1:32:59.325446 INFO: Collecting fragment features
1:32:59.953106 INFO: Finished candidate scoring
1:33:00.240743 PROGRESS: === Epoch 0, step 2, extracted 6803 precursors and 33886 fragments ===
1:33:00.241060 INFO: performing precursor FDR with 47 features
1:33:00.241107 INFO: Decoy channel: -1
1:33:00.241134 INFO: Competetive: True
1:33:00.306907 INFO: Test AUC: 0.495
1:33:00.307060 INFO: Train AUC: 0.512
1:33:00.307109 INFO: AUC difference: 3.26%
1:33:00.429152 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
1:33:00.430028 PROGRESS: ============================= Precursor FDR =============================
1:33:00.430151 PROGRESS: Total precursors accumulated: 3
1:33:00.430229 PROGRESS: Target precursors: 3 (100.00%)
1:33:00.430298 PROGRESS: Decoy precursors: 0 (0.00%)
1:33:00.430362 PROGRESS: 
1:33:00.430424 PROGRESS: Precursor Summary:
1:33:00.431908 PROGRESS: Channel   0:	 0.05 FDR:     3; 0.01 FDR:     3; 0.001 FDR:     3
1:33:00.432016 PROGRESS: 
1:33:00.432089 PROGRESS: Protein Summary:
1:33:00.433782 PROGRESS: Channel   0:	 0.05 FDR:     3; 0.01 FDR:     3; 0.001 FDR:     3
1:33:00.433908 PROGRESS: =========================================================================
1:33:00.434783 PROGRESS: === Epoch 0, step 3, extracting elution groups 7000 to 15000 ===
1:33:00.526045 PROGRESS: Extracting batch of 15822 precursors
1:33:00.531396 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:33:00.531464 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:33:00.531499 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
1:33:00.531540 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
1:33:00.531757 INFO: Starting candidate selection
1:33:03.965693 INFO: Starting candidate scoring
1:33:05.165316 INFO: Finished candidate processing
1:33:05.165476 INFO: Collecting candidate features
1:33:07.356884 INFO: Collecting fragment features
1:33:07.988229 INFO: Finished candidate scoring
1:33:08.280195 PROGRESS: === Epoch 0, step 3, extracted 13659 precursors and 68670 fragments ===
1:33:08.280508 INFO: performing precursor FDR with 47 features
1:33:08.280563 INFO: Decoy channel: -1
1:33:08.280608 INFO: Competetive: True
1:33:09.023837 INFO: Test AUC: 0.521
1:33:09.023980 INFO: Train AUC: 0.531
1:33:09.024025 INFO: AUC difference: 1.78%
1:33:09.147143 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
1:33:09.148058 PROGRESS: ============================= Precursor FDR =============================
1:33:09.148181 PROGRESS: Total precursors accumulated: 1
1:33:09.148259 PROGRESS: Target precursors: 1 (100.00%)
1:33:09.148328 PROGRESS: Decoy precursors: 0 (0.00%)
1:33:09.148390 PROGRESS: 
1:33:09.148452 PROGRESS: Precursor Summary:
1:33:09.149969 PROGRESS: Channel   0:	 0.05 FDR:     1; 0.01 FDR:     1; 0.001 FDR:     1
1:33:09.150083 PROGRESS: 
1:33:09.150176 PROGRESS: Protein Summary:
1:33:09.151989 PROGRESS: Channel   0:	 0.05 FDR:     1; 0.01 FDR:     1; 0.001 FDR:     1
1:33:09.152100 PROGRESS: =========================================================================
1:33:09.152989 PROGRESS: === Epoch 0, step 4, extracting elution groups 15000 to 31000 ===
1:33:09.268120 PROGRESS: Extracting batch of 31585 precursors
1:33:09.278502 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:33:09.278598 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:33:09.278644 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
1:33:09.278683 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
1:33:09.278968 INFO: Starting candidate selection
1:33:13.072641 INFO: Starting candidate scoring
1:33:14.406017 INFO: Finished candidate processing
1:33:14.406110 INFO: Collecting candidate features
1:33:16.633665 WARNING: intensity_correlation has 2 NaNs ( 0.01 % out of 27319)
1:33:16.640382 INFO: Collecting fragment features
1:33:17.288608 INFO: Finished candidate scoring
1:33:17.596313 PROGRESS: === Epoch 0, step 4, extracted 27319 precursors and 136889 fragments ===
1:33:17.596642 INFO: performing precursor FDR with 47 features
1:33:17.596690 INFO: Decoy channel: -1
1:33:17.596717 INFO: Competetive: True
1:33:17.647419 WARNING: dropped 2 target PSMs due to missing features
1:33:19.272128 INFO: Test AUC: 0.535
1:33:19.272272 INFO: Train AUC: 0.541
1:33:19.272333 INFO: AUC difference: 1.16%
1:33:19.399333 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
1:33:19.400244 PROGRESS: ============================= Precursor FDR =============================
1:33:19.400363 PROGRESS: Total precursors accumulated: 2
1:33:19.400441 PROGRESS: Target precursors: 2 (100.00%)
1:33:19.400509 PROGRESS: Decoy precursors: 0 (0.00%)
1:33:19.400571 PROGRESS: 
1:33:19.400633 PROGRESS: Precursor Summary:
1:33:19.402171 PROGRESS: Channel   0:	 0.05 FDR:     2; 0.01 FDR:     2; 0.001 FDR:     2
1:33:19.402283 PROGRESS: 
1:33:19.402356 PROGRESS: Protein Summary:
1:33:19.404047 PROGRESS: Channel   0:	 0.05 FDR:     2; 0.01 FDR:     2; 0.001 FDR:     2
1:33:19.404155 PROGRESS: =========================================================================
1:33:19.405037 PROGRESS: === Epoch 0, step 5, extracting elution groups 31000 to 63000 ===
1:33:19.541321 PROGRESS: Extracting batch of 63273 precursors
1:33:19.560945 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:33:19.561056 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:33:19.561093 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
1:33:19.561135 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
1:33:19.561385 INFO: Starting candidate selection
1:33:24.031473 INFO: Starting candidate scoring
1:33:25.649998 INFO: Finished candidate processing
1:33:25.650113 INFO: Collecting candidate features
1:33:27.998755 WARNING: intensity_correlation has 3 NaNs ( 0.01 % out of 54706)
1:33:28.007090 INFO: Collecting fragment features
1:33:28.687650 INFO: Finished candidate scoring
1:33:29.029531 PROGRESS: === Epoch 0, step 5, extracted 54706 precursors and 274005 fragments ===
1:33:29.029881 INFO: performing precursor FDR with 47 features
1:33:29.029931 INFO: Decoy channel: -1
1:33:29.029957 INFO: Competetive: True
1:33:29.145273 WARNING: dropped 5 target PSMs due to missing features
1:33:32.705937 INFO: Test AUC: 0.536
1:33:32.706053 INFO: Train AUC: 0.547
1:33:32.706091 INFO: AUC difference: 2.17%
1:33:32.835572 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
1:33:32.836540 PROGRESS: ============================= Precursor FDR =============================
1:33:32.836666 PROGRESS: Total precursors accumulated: 266
1:33:32.836745 PROGRESS: Target precursors: 242 (90.98%)
1:33:32.836815 PROGRESS: Decoy precursors: 24 (9.02%)
1:33:32.836878 PROGRESS: 
1:33:32.836940 PROGRESS: Precursor Summary:
1:33:32.838509 PROGRESS: Channel   0:	 0.05 FDR:   202; 0.01 FDR:   134; 0.001 FDR:   111
1:33:32.838621 PROGRESS: 
1:33:32.838696 PROGRESS: Protein Summary:
1:33:32.840490 PROGRESS: Channel   0:	 0.05 FDR:   197; 0.01 FDR:   132; 0.001 FDR:   109
1:33:32.840599 PROGRESS: =========================================================================
1:33:32.841542 PROGRESS: === Epoch 0, step 6, extracting elution groups 63000 to 127000 ===
1:33:33.015534 PROGRESS: Extracting batch of 126454 precursors
1:33:33.054002 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:33:33.054136 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:33:33.054178 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
1:33:33.054206 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
1:33:33.054479 INFO: Starting candidate selection
1:33:38.916550 INFO: Starting candidate scoring
1:33:41.093395 INFO: Finished candidate processing
1:33:41.093578 INFO: Collecting candidate features
1:33:43.605478 WARNING: intensity_correlation has 4 NaNs ( 0.00 % out of 108954)
1:33:43.618362 INFO: Collecting fragment features
1:33:44.359814 INFO: Finished candidate scoring
1:33:44.775679 PROGRESS: === Epoch 0, step 6, extracted 108954 precursors and 545409 fragments ===
1:33:44.776018 INFO: performing precursor FDR with 47 features
1:33:44.776063 INFO: Decoy channel: -1
1:33:44.776089 INFO: Competetive: True
1:33:45.029912 WARNING: dropped 5 target PSMs due to missing features
1:33:45.030041 WARNING: dropped 4 decoy PSMs due to missing features
1:33:52.329710 INFO: Test AUC: 0.542
1:33:52.329860 INFO: Train AUC: 0.551
1:33:52.329919 INFO: AUC difference: 1.65%
1:33:52.479729 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
1:33:52.480829 PROGRESS: ============================= Precursor FDR =============================
1:33:52.480954 PROGRESS: Total precursors accumulated: 737
1:33:52.481032 PROGRESS: Target precursors: 673 (91.32%)
1:33:52.481099 PROGRESS: Decoy precursors: 64 (8.68%)
1:33:52.481163 PROGRESS: 
1:33:52.481224 PROGRESS: Precursor Summary:
1:33:52.483014 PROGRESS: Channel   0:	 0.05 FDR:   555; 0.01 FDR:   392; 0.001 FDR:   302
1:33:52.483128 PROGRESS: 
1:33:52.483217 PROGRESS: Protein Summary:
1:33:52.485330 PROGRESS: Channel   0:	 0.05 FDR:   517; 0.01 FDR:   370; 0.001 FDR:   288
1:33:52.485455 PROGRESS: =========================================================================
1:33:52.487252 INFO: calibration group: precursor, fitting rt estimator 
1:33:52.603734 INFO: calibration group: fragment, fitting mz estimator 
1:33:53.105089 INFO: === checking if epoch conditions were reached ===
1:33:53.105229 INFO: ✅ ms2_error      : 7.0000 <= 7
1:33:53.105316 INFO: ❌ rt_error       : 240.3198 > 100
1:33:53.105398 INFO: ❌ current_epoch  : 0 < 3
1:33:53.105465 INFO: ==============================================
1:33:53.329488 INFO: calibration group: precursor, predicting mz
1:33:53.329737 WARNING: mz prediction was skipped as it has not been fitted yet
1:33:53.329786 INFO: calibration group: precursor, predicting rt
1:34:00.442141 INFO: calibration group: fragment, predicting mz
1:34:17.932799 PROGRESS: === Epoch 1, step 0, extracting elution groups 0 to 1000 ===
1:34:18.013272 PROGRESS: Extracting batch of 1976 precursors
1:34:18.014997 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:34:18.015089 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:34:18.015146 INFO: FWHM in RT is 16.66 seconds, sigma is 0.61
1:34:18.015177 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:34:18.015409 INFO: Starting candidate selection
1:34:22.064066 INFO: Starting candidate scoring
1:34:23.379370 INFO: Finished candidate processing
1:34:23.379458 INFO: Collecting candidate features
1:34:25.562654 WARNING: intensity_correlation has 4 NaNs ( 0.23 % out of 1727)
1:34:25.568471 INFO: Collecting fragment features
1:34:26.213528 INFO: Finished candidate scoring
1:34:26.504649 PROGRESS: === Epoch 1, step 0, extracted 1727 precursors and 8648 fragments ===
1:34:26.504945 INFO: performing precursor FDR with 47 features
1:34:26.504986 INFO: Decoy channel: -1
1:34:26.505013 INFO: Competetive: True
1:34:26.509591 WARNING: dropped 2 target PSMs due to missing features
1:34:26.509665 WARNING: dropped 2 decoy PSMs due to missing features
1:34:26.537202 INFO: Test AUC: 0.511
1:34:26.537307 INFO: Train AUC: 0.542
1:34:26.537375 INFO: AUC difference: 5.84%
1:34:26.537424 WARNING: AUC difference > 5%. This may indicate overfitting.
1:34:26.681818 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
1:34:26.682614 PROGRESS: ============================= Precursor FDR =============================
1:34:26.682735 PROGRESS: Total precursors accumulated: 5
1:34:26.682813 PROGRESS: Target precursors: 5 (100.00%)
1:34:26.682882 PROGRESS: Decoy precursors: 0 (0.00%)
1:34:26.682945 PROGRESS: 
1:34:26.683007 PROGRESS: Precursor Summary:
1:34:26.684498 PROGRESS: Channel   0:	 0.05 FDR:     5; 0.01 FDR:     5; 0.001 FDR:     5
1:34:26.684615 PROGRESS: 
1:34:26.684689 PROGRESS: Protein Summary:
1:34:26.686400 PROGRESS: Channel   0:	 0.05 FDR:     5; 0.01 FDR:     5; 0.001 FDR:     5
1:34:26.686514 PROGRESS: =========================================================================
1:34:26.687403 PROGRESS: === Epoch 1, step 1, extracting elution groups 1000 to 3000 ===
1:34:26.765440 PROGRESS: Extracting batch of 3960 precursors
1:34:26.767635 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:34:26.767711 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:34:26.767750 INFO: FWHM in RT is 16.66 seconds, sigma is 0.61
1:34:26.767781 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:34:26.768010 INFO: Starting candidate selection
1:34:30.438864 INFO: Starting candidate scoring
1:34:31.738718 INFO: Finished candidate processing
1:34:31.738809 INFO: Collecting candidate features
1:34:33.943306 WARNING: intensity_correlation has 12 NaNs ( 0.35 % out of 3395)
1:34:33.949296 INFO: Collecting fragment features
1:34:34.603094 INFO: Finished candidate scoring
1:34:34.882493 PROGRESS: === Epoch 1, step 1, extracted 3395 precursors and 17103 fragments ===
1:34:34.882762 INFO: performing precursor FDR with 47 features
1:34:34.882807 INFO: Decoy channel: -1
1:34:34.882835 INFO: Competetive: True
1:34:34.891025 WARNING: dropped 7 target PSMs due to missing features
1:34:34.891113 WARNING: dropped 9 decoy PSMs due to missing features
1:34:34.927157 INFO: Test AUC: 0.558
1:34:34.927283 INFO: Train AUC: 0.534
1:34:34.927338 INFO: AUC difference: 4.44%
1:34:35.048398 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
1:34:35.049186 PROGRESS: ============================= Precursor FDR =============================
1:34:35.049320 PROGRESS: Total precursors accumulated: 17
1:34:35.049411 PROGRESS: Target precursors: 16 (94.12%)
1:34:35.049490 PROGRESS: Decoy precursors: 1 (5.88%)
1:34:35.049577 PROGRESS: 
1:34:35.049664 PROGRESS: Precursor Summary:
1:34:35.051602 PROGRESS: Channel   0:	 0.05 FDR:    15; 0.01 FDR:    15; 0.001 FDR:    15
1:34:35.051747 PROGRESS: 
1:34:35.051838 PROGRESS: Protein Summary:
1:34:35.053448 PROGRESS: Channel   0:	 0.05 FDR:    15; 0.01 FDR:    15; 0.001 FDR:    15
1:34:35.053598 PROGRESS: =========================================================================
1:34:35.054766 PROGRESS: === Epoch 1, step 2, extracting elution groups 3000 to 7000 ===
1:34:35.137301 PROGRESS: Extracting batch of 7907 precursors
1:34:35.140521 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:34:35.140589 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:34:35.140634 INFO: FWHM in RT is 16.66 seconds, sigma is 0.61
1:34:35.140668 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:34:35.140912 INFO: Starting candidate selection
1:34:38.938630 INFO: Starting candidate scoring
1:34:40.296567 INFO: Finished candidate processing
1:34:40.296660 INFO: Collecting candidate features
1:34:42.493217 WARNING: intensity_correlation has 14 NaNs ( 0.21 % out of 6816)
1:34:42.500648 INFO: Collecting fragment features
1:34:43.154125 INFO: Finished candidate scoring
1:34:43.440814 PROGRESS: === Epoch 1, step 2, extracted 6816 precursors and 33904 fragments ===
1:34:43.441118 INFO: performing precursor FDR with 47 features
1:34:43.441166 INFO: Decoy channel: -1
1:34:43.441193 INFO: Competetive: True
1:34:43.455094 WARNING: dropped 15 target PSMs due to missing features
1:34:43.455190 WARNING: dropped 15 decoy PSMs due to missing features
1:34:43.510037 INFO: Test AUC: 0.551
1:34:43.510170 INFO: Train AUC: 0.538
1:34:43.510240 INFO: AUC difference: 2.42%
1:34:43.671361 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
1:34:43.672205 PROGRESS: ============================= Precursor FDR =============================
1:34:43.672327 PROGRESS: Total precursors accumulated: 37
1:34:43.672417 PROGRESS: Target precursors: 34 (91.89%)
1:34:43.672489 PROGRESS: Decoy precursors: 3 (8.11%)
1:34:43.672553 PROGRESS: 
1:34:43.672616 PROGRESS: Precursor Summary:
1:34:43.674074 PROGRESS: Channel   0:	 0.05 FDR:    28; 0.01 FDR:    24; 0.001 FDR:    24
1:34:43.674190 PROGRESS: 
1:34:43.674264 PROGRESS: Protein Summary:
1:34:43.675913 PROGRESS: Channel   0:	 0.05 FDR:    28; 0.01 FDR:    24; 0.001 FDR:    24
1:34:43.676023 PROGRESS: =========================================================================
1:34:43.676909 PROGRESS: === Epoch 1, step 3, extracting elution groups 7000 to 15000 ===
1:34:43.769310 PROGRESS: Extracting batch of 15816 precursors
1:34:43.774885 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:34:43.774955 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:34:43.774992 INFO: FWHM in RT is 16.66 seconds, sigma is 0.61
1:34:43.775034 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:34:43.775253 INFO: Starting candidate selection
1:34:47.716995 INFO: Starting candidate scoring
1:34:49.128628 INFO: Finished candidate processing
1:34:49.128720 INFO: Collecting candidate features
1:34:51.324575 WARNING: intensity_correlation has 40 NaNs ( 0.29 % out of 13572)
1:34:51.330557 INFO: Collecting fragment features
1:34:51.987604 INFO: Finished candidate scoring
1:34:52.279160 PROGRESS: === Epoch 1, step 3, extracted 13572 precursors and 67648 fragments ===
1:34:52.279483 INFO: performing precursor FDR with 47 features
1:34:52.279530 INFO: Decoy channel: -1
1:34:52.279557 INFO: Competetive: True
1:34:52.305167 WARNING: dropped 39 target PSMs due to missing features
1:34:52.305281 WARNING: dropped 31 decoy PSMs due to missing features
1:34:52.983886 INFO: Test AUC: 0.533
1:34:52.984058 INFO: Train AUC: 0.561
1:34:52.984121 INFO: AUC difference: 4.90%
1:34:53.111258 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
1:34:53.112118 PROGRESS: ============================= Precursor FDR =============================
1:34:53.112243 PROGRESS: Total precursors accumulated: 98
1:34:53.112320 PROGRESS: Target precursors: 90 (91.84%)
1:34:53.112388 PROGRESS: Decoy precursors: 8 (8.16%)
1:34:53.112450 PROGRESS: 
1:34:53.112511 PROGRESS: Precursor Summary:
1:34:53.113990 PROGRESS: Channel   0:	 0.05 FDR:    85; 0.01 FDR:    53; 0.001 FDR:    53
1:34:53.114114 PROGRESS: 
1:34:53.114189 PROGRESS: Protein Summary:
1:34:53.115865 PROGRESS: Channel   0:	 0.05 FDR:    84; 0.01 FDR:    53; 0.001 FDR:    53
1:34:53.115998 PROGRESS: =========================================================================
1:34:53.116877 PROGRESS: === Epoch 1, step 4, extracting elution groups 15000 to 31000 ===
1:34:53.224971 PROGRESS: Extracting batch of 31646 precursors
1:34:53.235394 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:34:53.235502 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:34:53.235542 INFO: FWHM in RT is 16.66 seconds, sigma is 0.61
1:34:53.235569 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:34:53.235809 INFO: Starting candidate selection
1:34:57.565150 INFO: Starting candidate scoring
1:34:59.141903 INFO: Finished candidate processing
1:34:59.142011 INFO: Collecting candidate features
1:35:01.391673 WARNING: intensity_correlation has 79 NaNs ( 0.29 % out of 27429)
1:35:01.398542 INFO: Collecting fragment features
1:35:02.078899 INFO: Finished candidate scoring
1:35:02.388313 PROGRESS: === Epoch 1, step 4, extracted 27429 precursors and 136821 fragments ===
1:35:02.388642 INFO: performing precursor FDR with 47 features
1:35:02.388690 INFO: Decoy channel: -1
1:35:02.388717 INFO: Competetive: True
1:35:02.441229 WARNING: dropped 82 target PSMs due to missing features
1:35:02.441337 WARNING: dropped 67 decoy PSMs due to missing features
1:35:04.039881 INFO: Test AUC: 0.547
1:35:04.040040 INFO: Train AUC: 0.562
1:35:04.040114 INFO: AUC difference: 2.70%
1:35:04.173459 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
1:35:04.174393 PROGRESS: ============================= Precursor FDR =============================
1:35:04.174519 PROGRESS: Total precursors accumulated: 204
1:35:04.174596 PROGRESS: Target precursors: 186 (91.18%)
1:35:04.174663 PROGRESS: Decoy precursors: 18 (8.82%)
1:35:04.174725 PROGRESS: 
1:35:04.174786 PROGRESS: Precursor Summary:
1:35:04.176311 PROGRESS: Channel   0:	 0.05 FDR:   164; 0.01 FDR:   139; 0.001 FDR:   109
1:35:04.176426 PROGRESS: 
1:35:04.176501 PROGRESS: Protein Summary:
1:35:04.178448 PROGRESS: Channel   0:	 0.05 FDR:   161; 0.01 FDR:   136; 0.001 FDR:   107
1:35:04.178581 PROGRESS: =========================================================================
1:35:04.179824 PROGRESS: === Epoch 1, step 5, extracting elution groups 31000 to 63000 ===
1:35:04.316027 PROGRESS: Extracting batch of 63231 precursors
1:35:04.335949 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:35:04.336065 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:35:04.336110 INFO: FWHM in RT is 16.66 seconds, sigma is 0.61
1:35:04.336140 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:35:04.336418 INFO: Starting candidate selection
1:35:09.353250 INFO: Starting candidate scoring
1:35:11.219536 INFO: Finished candidate processing
1:35:11.219709 INFO: Collecting candidate features
1:35:13.587977 WARNING: intensity_correlation has 177 NaNs ( 0.32 % out of 54840)
1:35:13.596639 INFO: Collecting fragment features
1:35:14.311240 INFO: Finished candidate scoring
1:35:14.656558 PROGRESS: === Epoch 1, step 5, extracted 54840 precursors and 272815 fragments ===
1:35:14.656890 INFO: performing precursor FDR with 47 features
1:35:14.656937 INFO: Decoy channel: -1
1:35:14.656963 INFO: Competetive: True
1:35:14.776060 WARNING: dropped 178 target PSMs due to missing features
1:35:14.776175 WARNING: dropped 148 decoy PSMs due to missing features
1:35:18.347445 INFO: Test AUC: 0.543
1:35:18.347558 INFO: Train AUC: 0.561
1:35:18.347597 INFO: AUC difference: 3.18%
1:35:20.161601 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
1:35:20.170883 PROGRESS: ============================= Precursor FDR =============================
1:35:20.171205 PROGRESS: Total precursors accumulated: 576
1:35:20.171431 PROGRESS: Target precursors: 527 (91.49%)
1:35:20.171627 PROGRESS: Decoy precursors: 49 (8.51%)
1:35:20.171812 PROGRESS: 
1:35:20.171991 PROGRESS: Precursor Summary:
1:35:20.174813 PROGRESS: Channel   0:	 0.05 FDR:   449; 0.01 FDR:   314; 0.001 FDR:   137
1:35:20.174954 PROGRESS: 
1:35:20.175047 PROGRESS: Protein Summary:
1:35:20.177081 PROGRESS: Channel   0:	 0.05 FDR:   424; 0.01 FDR:   296; 0.001 FDR:   131
1:35:20.177191 PROGRESS: =========================================================================
1:35:20.179414 PROGRESS: === Epoch 1, step 6, extracting elution groups 63000 to 127000 ===
1:35:20.359003 PROGRESS: Extracting batch of 126476 precursors
1:35:20.397197 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:35:20.397310 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:35:20.397347 INFO: FWHM in RT is 16.66 seconds, sigma is 0.61
1:35:20.397390 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:35:20.397652 INFO: Starting candidate selection
1:35:26.808831 INFO: Starting candidate scoring
1:35:29.226534 INFO: Finished candidate processing
1:35:29.226635 INFO: Collecting candidate features
1:35:31.757724 WARNING: intensity_correlation has 354 NaNs ( 0.32 % out of 109387)
1:35:31.769874 INFO: Collecting fragment features
1:35:32.540559 INFO: Finished candidate scoring
1:35:32.959781 PROGRESS: === Epoch 1, step 6, extracted 109387 precursors and 543762 fragments ===
1:35:32.960144 INFO: performing precursor FDR with 47 features
1:35:32.960191 INFO: Decoy channel: -1
1:35:32.960218 INFO: Competetive: True
1:35:33.217055 WARNING: dropped 355 target PSMs due to missing features
1:35:33.217171 WARNING: dropped 325 decoy PSMs due to missing features
1:35:40.914319 INFO: Test AUC: 0.542
1:35:40.914448 INFO: Train AUC: 0.558
1:35:40.914510 INFO: AUC difference: 2.81%
1:35:41.064771 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
1:35:41.066098 PROGRESS: ============================= Precursor FDR =============================
1:35:41.066253 PROGRESS: Total precursors accumulated: 1,057
1:35:41.066364 PROGRESS: Target precursors: 966 (91.39%)
1:35:41.066470 PROGRESS: Decoy precursors: 91 (8.61%)
1:35:41.066562 PROGRESS: 
1:35:41.066649 PROGRESS: Precursor Summary:
1:35:41.068552 PROGRESS: Channel   0:	 0.05 FDR:   807; 0.01 FDR:   523; 0.001 FDR:    62
1:35:41.068692 PROGRESS: 
1:35:41.068795 PROGRESS: Protein Summary:
1:35:41.071814 PROGRESS: Channel   0:	 0.05 FDR:   725; 0.01 FDR:   473; 0.001 FDR:    58
1:35:41.071967 PROGRESS: =========================================================================
1:35:41.074027 INFO: calibration group: precursor, fitting rt estimator 
1:35:41.193352 INFO: calibration group: fragment, fitting mz estimator 
1:35:41.781607 INFO: === checking if epoch conditions were reached ===
1:35:41.781817 INFO: ✅ ms2_error      : 7.0000 <= 7
1:35:41.781938 INFO: ❌ rt_error       : 239.7436 > 100
1:35:41.782039 INFO: ❌ current_epoch  : 1 < 3
1:35:41.782131 INFO: ==============================================
1:35:41.998598 INFO: calibration group: precursor, predicting mz
1:35:41.998897 WARNING: mz prediction was skipped as it has not been fitted yet
1:35:41.998961 INFO: calibration group: precursor, predicting rt
1:35:49.053083 INFO: calibration group: fragment, predicting mz
1:36:06.392129 PROGRESS: === Epoch 2, step 0, extracting elution groups 0 to 1000 ===
1:36:06.473607 PROGRESS: Extracting batch of 1983 precursors
1:36:06.475375 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:36:06.475471 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:36:06.475511 INFO: FWHM in RT is 15.32 seconds, sigma is 0.56
1:36:06.475557 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:36:06.475792 INFO: Starting candidate selection
1:36:10.482296 INFO: Starting candidate scoring
1:36:11.779820 INFO: Finished candidate processing
1:36:11.779905 INFO: Collecting candidate features
1:36:13.937285 WARNING: intensity_correlation has 3 NaNs ( 0.17 % out of 1726)
1:36:13.943166 INFO: Collecting fragment features
1:36:14.552252 INFO: Finished candidate scoring
1:36:14.847957 PROGRESS: === Epoch 2, step 0, extracted 1726 precursors and 8414 fragments ===
1:36:14.848250 INFO: performing precursor FDR with 47 features
1:36:14.848306 INFO: Decoy channel: -1
1:36:14.848332 INFO: Competetive: True
1:36:14.853024 WARNING: dropped 2 target PSMs due to missing features
1:36:14.853098 WARNING: dropped 1 decoy PSMs due to missing features
1:36:14.882232 INFO: Test AUC: 0.546
1:36:14.882329 INFO: Train AUC: 0.564
1:36:14.882374 INFO: AUC difference: 3.17%
1:36:15.003167 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
1:36:15.003963 PROGRESS: ============================= Precursor FDR =============================
1:36:15.004086 PROGRESS: Total precursors accumulated: 5
1:36:15.004164 PROGRESS: Target precursors: 5 (100.00%)
1:36:15.004230 PROGRESS: Decoy precursors: 0 (0.00%)
1:36:15.004292 PROGRESS: 
1:36:15.004352 PROGRESS: Precursor Summary:
1:36:15.005837 PROGRESS: Channel   0:	 0.05 FDR:     5; 0.01 FDR:     5; 0.001 FDR:     5
1:36:15.005948 PROGRESS: 
1:36:15.006021 PROGRESS: Protein Summary:
1:36:15.007697 PROGRESS: Channel   0:	 0.05 FDR:     5; 0.01 FDR:     5; 0.001 FDR:     5
1:36:15.007807 PROGRESS: =========================================================================
1:36:15.008690 PROGRESS: === Epoch 2, step 1, extracting elution groups 1000 to 3000 ===
1:36:15.086038 PROGRESS: Extracting batch of 3954 precursors
1:36:15.088273 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:36:15.088333 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:36:15.088371 INFO: FWHM in RT is 15.32 seconds, sigma is 0.56
1:36:15.088416 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:36:15.088633 INFO: Starting candidate selection
1:36:18.796310 INFO: Starting candidate scoring
1:36:20.121354 INFO: Finished candidate processing
1:36:20.121448 INFO: Collecting candidate features
1:36:22.282328 WARNING: intensity_correlation has 13 NaNs ( 0.38 % out of 3420)
1:36:22.288486 INFO: Collecting fragment features
1:36:22.901720 INFO: Finished candidate scoring
1:36:23.182217 PROGRESS: === Epoch 2, step 1, extracted 3420 precursors and 16952 fragments ===
1:36:23.182500 INFO: performing precursor FDR with 47 features
1:36:23.182545 INFO: Decoy channel: -1
1:36:23.182572 INFO: Competetive: True
1:36:23.191007 WARNING: dropped 6 target PSMs due to missing features
1:36:23.191112 WARNING: dropped 10 decoy PSMs due to missing features
1:36:23.227205 INFO: Test AUC: 0.538
1:36:23.227322 INFO: Train AUC: 0.557
1:36:23.227367 INFO: AUC difference: 3.44%
1:36:23.348571 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
1:36:23.349349 PROGRESS: ============================= Precursor FDR =============================
1:36:23.349471 PROGRESS: Total precursors accumulated: 20
1:36:23.349548 PROGRESS: Target precursors: 19 (95.00%)
1:36:23.349627 PROGRESS: Decoy precursors: 1 (5.00%)
1:36:23.349693 PROGRESS: 
1:36:23.349755 PROGRESS: Precursor Summary:
1:36:23.351172 PROGRESS: Channel   0:	 0.05 FDR:    15; 0.01 FDR:    15; 0.001 FDR:    15
1:36:23.351285 PROGRESS: 
1:36:23.351358 PROGRESS: Protein Summary:
1:36:23.352946 PROGRESS: Channel   0:	 0.05 FDR:    15; 0.01 FDR:    15; 0.001 FDR:    15
1:36:23.353072 PROGRESS: =========================================================================
1:36:23.353931 PROGRESS: === Epoch 2, step 2, extracting elution groups 3000 to 7000 ===
1:36:23.435849 PROGRESS: Extracting batch of 7915 precursors
1:36:23.439324 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:36:23.439388 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:36:23.439425 INFO: FWHM in RT is 15.32 seconds, sigma is 0.56
1:36:23.439471 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:36:23.439692 INFO: Starting candidate selection
1:36:27.235882 INFO: Starting candidate scoring
1:36:28.600909 INFO: Finished candidate processing
1:36:28.601004 INFO: Collecting candidate features
1:36:30.803603 WARNING: intensity_correlation has 16 NaNs ( 0.23 % out of 6932)
1:36:30.809179 INFO: Collecting fragment features
1:36:31.435379 INFO: Finished candidate scoring
1:36:31.723031 PROGRESS: === Epoch 2, step 2, extracted 6932 precursors and 34604 fragments ===
1:36:31.723364 INFO: performing precursor FDR with 47 features
1:36:31.723414 INFO: Decoy channel: -1
1:36:31.723440 INFO: Competetive: True
1:36:31.737798 WARNING: dropped 12 target PSMs due to missing features
1:36:31.737914 WARNING: dropped 20 decoy PSMs due to missing features
1:36:31.794342 INFO: Test AUC: 0.551
1:36:31.794474 INFO: Train AUC: 0.548
1:36:31.794518 INFO: AUC difference: 0.54%
1:36:31.937910 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
1:36:31.938754 PROGRESS: ============================= Precursor FDR =============================
1:36:31.938895 PROGRESS: Total precursors accumulated: 58
1:36:31.938973 PROGRESS: Target precursors: 54 (93.10%)
1:36:31.939041 PROGRESS: Decoy precursors: 4 (6.90%)
1:36:31.939104 PROGRESS: 
1:36:31.939165 PROGRESS: Precursor Summary:
1:36:31.940615 PROGRESS: Channel   0:	 0.05 FDR:    47; 0.01 FDR:    29; 0.001 FDR:    29
1:36:31.940731 PROGRESS: 
1:36:31.940807 PROGRESS: Protein Summary:
1:36:31.942488 PROGRESS: Channel   0:	 0.05 FDR:    46; 0.01 FDR:    29; 0.001 FDR:    29
1:36:31.942602 PROGRESS: =========================================================================
1:36:31.943469 PROGRESS: === Epoch 2, step 3, extracting elution groups 7000 to 15000 ===
1:36:32.036383 PROGRESS: Extracting batch of 15812 precursors
1:36:32.041987 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:36:32.042079 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:36:32.042117 INFO: FWHM in RT is 15.32 seconds, sigma is 0.56
1:36:32.042144 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:36:32.042379 INFO: Starting candidate selection
1:36:36.023599 INFO: Starting candidate scoring
1:36:37.452459 INFO: Finished candidate processing
1:36:37.452552 INFO: Collecting candidate features
1:36:39.673751 WARNING: intensity_correlation has 39 NaNs ( 0.28 % out of 13808)
1:36:39.679873 INFO: Collecting fragment features
1:36:40.316223 INFO: Finished candidate scoring
1:36:40.612398 PROGRESS: === Epoch 2, step 3, extracted 13808 precursors and 68956 fragments ===
1:36:40.612754 INFO: performing precursor FDR with 47 features
1:36:40.612819 INFO: Decoy channel: -1
1:36:40.612870 INFO: Competetive: True
1:36:40.639742 WARNING: dropped 31 target PSMs due to missing features
1:36:40.639856 WARNING: dropped 40 decoy PSMs due to missing features
1:36:41.383121 INFO: Test AUC: 0.543
1:36:41.383297 INFO: Train AUC: 0.569
1:36:41.383347 INFO: AUC difference: 4.64%
1:36:41.506750 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
1:36:41.507661 PROGRESS: ============================= Precursor FDR =============================
1:36:41.507786 PROGRESS: Total precursors accumulated: 170
1:36:41.507865 PROGRESS: Target precursors: 155 (91.18%)
1:36:41.507934 PROGRESS: Decoy precursors: 15 (8.82%)
1:36:41.507997 PROGRESS: 
1:36:41.508060 PROGRESS: Precursor Summary:
1:36:41.509575 PROGRESS: Channel   0:	 0.05 FDR:   122; 0.01 FDR:    66; 0.001 FDR:    66
1:36:41.509691 PROGRESS: 
1:36:41.509764 PROGRESS: Protein Summary:
1:36:41.511495 PROGRESS: Channel   0:	 0.05 FDR:   120; 0.01 FDR:    65; 0.001 FDR:    65
1:36:41.511605 PROGRESS: =========================================================================
1:36:41.512497 PROGRESS: === Epoch 2, step 4, extracting elution groups 15000 to 31000 ===
1:36:41.620044 PROGRESS: Extracting batch of 31588 precursors
1:36:41.630461 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:36:41.630560 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:36:41.630599 INFO: FWHM in RT is 15.32 seconds, sigma is 0.56
1:36:41.630629 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:36:41.630871 INFO: Starting candidate selection
1:36:45.954613 INFO: Starting candidate scoring
1:36:47.541288 INFO: Finished candidate processing
1:36:47.541481 INFO: Collecting candidate features
1:36:49.815788 WARNING: intensity_correlation has 80 NaNs ( 0.29 % out of 27641)
1:36:49.824117 INFO: Collecting fragment features
1:36:50.491984 INFO: Finished candidate scoring
1:36:50.805943 PROGRESS: === Epoch 2, step 4, extracted 27641 precursors and 138049 fragments ===
1:36:50.806275 INFO: performing precursor FDR with 47 features
1:36:50.806326 INFO: Decoy channel: -1
1:36:50.806351 INFO: Competetive: True
1:36:50.861424 WARNING: dropped 60 target PSMs due to missing features
1:36:50.861534 WARNING: dropped 91 decoy PSMs due to missing features
1:36:52.536345 INFO: Test AUC: 0.542
1:36:52.536487 INFO: Train AUC: 0.571
1:36:52.536532 INFO: AUC difference: 5.03%
1:36:52.536566 WARNING: AUC difference > 5%. This may indicate overfitting.
1:36:52.663597 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
1:36:52.671354 PROGRESS: ============================= Precursor FDR =============================
1:36:52.671519 PROGRESS: Total precursors accumulated: 323
1:36:52.671598 PROGRESS: Target precursors: 294 (91.02%)
1:36:52.671667 PROGRESS: Decoy precursors: 29 (8.98%)
1:36:52.671730 PROGRESS: 
1:36:52.671792 PROGRESS: Precursor Summary:
1:36:52.673460 PROGRESS: Channel   0:	 0.05 FDR:   234; 0.01 FDR:   187; 0.001 FDR:   178
1:36:52.673592 PROGRESS: 
1:36:52.673667 PROGRESS: Protein Summary:
1:36:52.675589 PROGRESS: Channel   0:	 0.05 FDR:   227; 0.01 FDR:   181; 0.001 FDR:   173
1:36:52.675703 PROGRESS: =========================================================================
1:36:52.676700 PROGRESS: === Epoch 2, step 5, extracting elution groups 31000 to 63000 ===
1:36:52.812793 PROGRESS: Extracting batch of 63238 precursors
1:36:52.832891 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:36:52.832997 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:36:52.833035 INFO: FWHM in RT is 15.32 seconds, sigma is 0.56
1:36:52.833079 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:36:52.833330 INFO: Starting candidate selection
1:36:57.819296 INFO: Starting candidate scoring
1:36:59.673438 INFO: Finished candidate processing
1:36:59.673635 INFO: Collecting candidate features
1:37:02.038316 WARNING: intensity_correlation has 142 NaNs ( 0.26 % out of 55571)
1:37:02.038702 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 55571)
1:37:02.047314 INFO: Collecting fragment features
1:37:02.735294 INFO: Finished candidate scoring
1:37:03.082105 PROGRESS: === Epoch 2, step 5, extracted 55571 precursors and 277524 fragments ===
1:37:03.082438 INFO: performing precursor FDR with 47 features
1:37:03.082484 INFO: Decoy channel: -1
1:37:03.082511 INFO: Competetive: True
1:37:03.205044 WARNING: dropped 135 target PSMs due to missing features
1:37:03.205181 WARNING: dropped 158 decoy PSMs due to missing features
1:37:06.863674 INFO: Test AUC: 0.550
1:37:06.863801 INFO: Train AUC: 0.567
1:37:06.863849 INFO: AUC difference: 3.05%
1:37:06.998871 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
1:37:07.000033 PROGRESS: ============================= Precursor FDR =============================
1:37:07.000177 PROGRESS: Total precursors accumulated: 706
1:37:07.000268 PROGRESS: Target precursors: 643 (91.08%)
1:37:07.000357 PROGRESS: Decoy precursors: 63 (8.92%)
1:37:07.000459 PROGRESS: 
1:37:07.000549 PROGRESS: Precursor Summary:
1:37:07.002589 PROGRESS: Channel   0:	 0.05 FDR:   521; 0.01 FDR:   343; 0.001 FDR:   120
1:37:07.002717 PROGRESS: 
1:37:07.002811 PROGRESS: Protein Summary:
1:37:07.005549 PROGRESS: Channel   0:	 0.05 FDR:   492; 0.01 FDR:   329; 0.001 FDR:   117
1:37:07.005687 PROGRESS: =========================================================================
1:37:07.006800 PROGRESS: === Epoch 2, step 6, extracting elution groups 63000 to 127000 ===
1:37:07.184751 PROGRESS: Extracting batch of 126500 precursors
1:37:07.223815 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:37:07.223955 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:37:07.224005 INFO: FWHM in RT is 15.32 seconds, sigma is 0.56
1:37:07.224036 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:37:07.224324 INFO: Starting candidate selection
1:37:13.674907 INFO: Starting candidate scoring
1:37:16.119903 INFO: Finished candidate processing
1:37:16.120027 INFO: Collecting candidate features
1:37:18.625409 WARNING: intensity_correlation has 248 NaNs ( 0.22 % out of 110861)
1:37:18.637709 INFO: Collecting fragment features
1:37:19.400074 INFO: Finished candidate scoring
1:37:19.813733 PROGRESS: === Epoch 2, step 6, extracted 110861 precursors and 553505 fragments ===
1:37:19.814100 INFO: performing precursor FDR with 47 features
1:37:19.814143 INFO: Decoy channel: -1
1:37:19.814169 INFO: Competetive: True
1:37:20.068388 WARNING: dropped 242 target PSMs due to missing features
1:37:20.068505 WARNING: dropped 299 decoy PSMs due to missing features
1:37:28.012369 INFO: Test AUC: 0.551
1:37:28.012495 INFO: Train AUC: 0.565
1:37:28.012551 INFO: AUC difference: 2.42%
1:37:28.164218 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
1:37:28.165556 PROGRESS: ============================= Precursor FDR =============================
1:37:28.165688 PROGRESS: Total precursors accumulated: 1,304
1:37:28.165777 PROGRESS: Target precursors: 1,192 (91.41%)
1:37:28.165851 PROGRESS: Decoy precursors: 112 (8.59%)
1:37:28.165915 PROGRESS: 
1:37:28.165977 PROGRESS: Precursor Summary:
1:37:28.167981 PROGRESS: Channel   0:	 0.05 FDR:   950; 0.01 FDR:   721; 0.001 FDR:   334
1:37:28.168118 PROGRESS: 
1:37:28.168193 PROGRESS: Protein Summary:
1:37:28.170648 PROGRESS: Channel   0:	 0.05 FDR:   839; 0.01 FDR:   646; 0.001 FDR:   306
1:37:28.170774 PROGRESS: =========================================================================
1:37:28.172926 INFO: calibration group: precursor, fitting rt estimator 
1:37:28.305305 INFO: calibration group: fragment, fitting mz estimator 
1:37:28.904166 INFO: === checking if epoch conditions were reached ===
1:37:28.904325 INFO: ✅ ms2_error      : 7.0000 <= 7
1:37:28.904413 INFO: ❌ rt_error       : 246.4585 > 100
1:37:28.904488 INFO: ✅ current_epoch  : 2 >= 3
1:37:28.904553 INFO: ==============================================
1:37:29.123075 INFO: calibration group: precursor, predicting mz
1:37:29.123360 WARNING: mz prediction was skipped as it has not been fitted yet
1:37:29.123406 INFO: calibration group: precursor, predicting rt
1:37:36.027795 INFO: calibration group: fragment, predicting mz
1:37:54.059269 PROGRESS: === Epoch 3, step 0, extracting elution groups 0 to 1000 ===
1:37:54.140690 PROGRESS: Extracting batch of 1984 precursors
1:37:54.142470 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:37:54.142550 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:37:54.142590 INFO: FWHM in RT is 15.13 seconds, sigma is 0.55
1:37:54.142637 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:37:54.142872 INFO: Starting candidate selection
1:37:58.239158 INFO: Starting candidate scoring
1:37:59.551014 INFO: Finished candidate processing
1:37:59.551107 INFO: Collecting candidate features
1:38:01.729581 WARNING: intensity_correlation has 2 NaNs ( 0.11 % out of 1792)
1:38:01.735608 INFO: Collecting fragment features
1:38:02.378901 INFO: Finished candidate scoring
1:38:02.676445 PROGRESS: === Epoch 3, step 0, extracted 1792 precursors and 9014 fragments ===
1:38:02.676779 INFO: performing precursor FDR with 47 features
1:38:02.676832 INFO: Decoy channel: -1
1:38:02.676864 INFO: Competetive: True
1:38:02.681458 WARNING: dropped 1 target PSMs due to missing features
1:38:02.681537 WARNING: dropped 1 decoy PSMs due to missing features
1:38:02.709121 INFO: Test AUC: 0.560
1:38:02.709212 INFO: Train AUC: 0.537
1:38:02.709255 INFO: AUC difference: 4.34%
1:38:02.830009 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
1:38:02.830803 PROGRESS: ============================= Precursor FDR =============================
1:38:02.830919 PROGRESS: Total precursors accumulated: 5
1:38:02.830996 PROGRESS: Target precursors: 5 (100.00%)
1:38:02.831064 PROGRESS: Decoy precursors: 0 (0.00%)
1:38:02.831125 PROGRESS: 
1:38:02.831196 PROGRESS: Precursor Summary:
1:38:02.832683 PROGRESS: Channel   0:	 0.05 FDR:     5; 0.01 FDR:     5; 0.001 FDR:     5
1:38:02.832809 PROGRESS: 
1:38:02.832881 PROGRESS: Protein Summary:
1:38:02.834560 PROGRESS: Channel   0:	 0.05 FDR:     5; 0.01 FDR:     5; 0.001 FDR:     5
1:38:02.834669 PROGRESS: =========================================================================
1:38:02.835540 PROGRESS: === Epoch 3, step 1, extracting elution groups 1000 to 3000 ===
1:38:02.912948 PROGRESS: Extracting batch of 3946 precursors
1:38:02.915190 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:38:02.915260 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:38:02.915307 INFO: FWHM in RT is 15.13 seconds, sigma is 0.55
1:38:02.915342 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:38:02.915610 INFO: Starting candidate selection
1:38:06.630319 INFO: Starting candidate scoring
1:38:07.944529 INFO: Finished candidate processing
1:38:07.944623 INFO: Collecting candidate features
1:38:10.121449 WARNING: intensity_correlation has 6 NaNs ( 0.17 % out of 3617)
1:38:10.128289 INFO: Collecting fragment features
1:38:10.766082 INFO: Finished candidate scoring
1:38:11.045436 PROGRESS: === Epoch 3, step 1, extracted 3617 precursors and 18058 fragments ===
1:38:11.045718 INFO: performing precursor FDR with 47 features
1:38:11.045765 INFO: Decoy channel: -1
1:38:11.045800 INFO: Competetive: True
1:38:11.054266 WARNING: dropped 4 target PSMs due to missing features
1:38:11.054358 WARNING: dropped 4 decoy PSMs due to missing features
1:38:11.091356 INFO: Test AUC: 0.532
1:38:11.091473 INFO: Train AUC: 0.540
1:38:11.091517 INFO: AUC difference: 1.49%
1:38:11.229110 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
1:38:11.229923 PROGRESS: ============================= Precursor FDR =============================
1:38:11.230045 PROGRESS: Total precursors accumulated: 39
1:38:11.230123 PROGRESS: Target precursors: 36 (92.31%)
1:38:11.230192 PROGRESS: Decoy precursors: 3 (7.69%)
1:38:11.230255 PROGRESS: 
1:38:11.230316 PROGRESS: Precursor Summary:
1:38:11.231740 PROGRESS: Channel   0:	 0.05 FDR:    28; 0.01 FDR:    26; 0.001 FDR:    26
1:38:11.231867 PROGRESS: 
1:38:11.231940 PROGRESS: Protein Summary:
1:38:11.233546 PROGRESS: Channel   0:	 0.05 FDR:    28; 0.01 FDR:    26; 0.001 FDR:    26
1:38:11.233672 PROGRESS: =========================================================================
1:38:11.234558 PROGRESS: === Epoch 3, step 2, extracting elution groups 3000 to 7000 ===
1:38:11.318356 PROGRESS: Extracting batch of 7912 precursors
1:38:11.321692 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:38:11.321760 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:38:11.321810 INFO: FWHM in RT is 15.13 seconds, sigma is 0.55
1:38:11.321856 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:38:11.322107 INFO: Starting candidate selection
1:38:15.148004 INFO: Starting candidate scoring
1:38:16.526730 INFO: Finished candidate processing
1:38:16.526831 INFO: Collecting candidate features
1:38:18.710671 WARNING: intensity_correlation has 12 NaNs ( 0.17 % out of 7094)
1:38:18.716226 INFO: Collecting fragment features
1:38:19.363605 INFO: Finished candidate scoring
1:38:19.648974 PROGRESS: === Epoch 3, step 2, extracted 7094 precursors and 35645 fragments ===
1:38:19.649289 INFO: performing precursor FDR with 47 features
1:38:19.649338 INFO: Decoy channel: -1
1:38:19.649366 INFO: Competetive: True
1:38:19.663851 WARNING: dropped 9 target PSMs due to missing features
1:38:19.663952 WARNING: dropped 11 decoy PSMs due to missing features
1:38:19.722026 INFO: Test AUC: 0.545
1:38:19.722154 INFO: Train AUC: 0.543
1:38:19.722200 INFO: AUC difference: 0.32%
1:38:19.843400 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
1:38:19.844225 PROGRESS: ============================= Precursor FDR =============================
1:38:19.844349 PROGRESS: Total precursors accumulated: 70
1:38:19.844426 PROGRESS: Target precursors: 64 (91.43%)
1:38:19.844509 PROGRESS: Decoy precursors: 6 (8.57%)
1:38:19.844572 PROGRESS: 
1:38:19.844633 PROGRESS: Precursor Summary:
1:38:19.846119 PROGRESS: Channel   0:	 0.05 FDR:    50; 0.01 FDR:    44; 0.001 FDR:    44
1:38:19.846234 PROGRESS: 
1:38:19.846309 PROGRESS: Protein Summary:
1:38:19.847951 PROGRESS: Channel   0:	 0.05 FDR:    50; 0.01 FDR:    44; 0.001 FDR:    44
1:38:19.848063 PROGRESS: =========================================================================
1:38:19.848937 PROGRESS: === Epoch 3, step 3, extracting elution groups 7000 to 15000 ===
1:38:19.940516 PROGRESS: Extracting batch of 15800 precursors
1:38:19.945991 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:38:19.946060 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:38:19.946095 INFO: FWHM in RT is 15.13 seconds, sigma is 0.55
1:38:19.946121 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:38:19.946342 INFO: Starting candidate selection
1:38:23.906191 INFO: Starting candidate scoring
1:38:25.324075 INFO: Finished candidate processing
1:38:25.324257 INFO: Collecting candidate features
1:38:27.534919 WARNING: intensity_correlation has 32 NaNs ( 0.22 % out of 14255)
1:38:27.540887 INFO: Collecting fragment features
1:38:28.199342 INFO: Finished candidate scoring
1:38:28.492719 PROGRESS: === Epoch 3, step 3, extracted 14255 precursors and 71131 fragments ===
1:38:28.493043 INFO: performing precursor FDR with 47 features
1:38:28.493087 INFO: Decoy channel: -1
1:38:28.493112 INFO: Competetive: True
1:38:28.520535 WARNING: dropped 19 target PSMs due to missing features
1:38:28.520647 WARNING: dropped 33 decoy PSMs due to missing features
1:38:29.169307 INFO: Test AUC: 0.548
1:38:29.170300 INFO: Train AUC: 0.564
1:38:29.170362 INFO: AUC difference: 2.90%
1:38:29.296324 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
1:38:29.297220 PROGRESS: ============================= Precursor FDR =============================
1:38:29.297351 PROGRESS: Total precursors accumulated: 180
1:38:29.297428 PROGRESS: Target precursors: 164 (91.11%)
1:38:29.297494 PROGRESS: Decoy precursors: 16 (8.89%)
1:38:29.297557 PROGRESS: 
1:38:29.297620 PROGRESS: Precursor Summary:
1:38:29.299132 PROGRESS: Channel   0:	 0.05 FDR:   130; 0.01 FDR:   107; 0.001 FDR:    99
1:38:29.299260 PROGRESS: 
1:38:29.299335 PROGRESS: Protein Summary:
1:38:29.301055 PROGRESS: Channel   0:	 0.05 FDR:   128; 0.01 FDR:   105; 0.001 FDR:    97
1:38:29.301181 PROGRESS: =========================================================================
1:38:29.302109 PROGRESS: === Epoch 3, step 4, extracting elution groups 15000 to 31000 ===
1:38:29.410443 PROGRESS: Extracting batch of 31557 precursors
1:38:29.420840 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:38:29.420955 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:38:29.420995 INFO: FWHM in RT is 15.13 seconds, sigma is 0.55
1:38:29.421022 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:38:29.421264 INFO: Starting candidate selection
1:38:33.716627 INFO: Starting candidate scoring
1:38:35.282283 INFO: Finished candidate processing
1:38:35.282381 INFO: Collecting candidate features
1:38:37.528953 WARNING: intensity_correlation has 66 NaNs ( 0.23 % out of 28440)
1:38:37.536201 INFO: Collecting fragment features
1:38:38.210366 INFO: Finished candidate scoring
1:38:38.521428 PROGRESS: === Epoch 3, step 4, extracted 28440 precursors and 142343 fragments ===
1:38:38.521785 INFO: performing precursor FDR with 47 features
1:38:38.521837 INFO: Decoy channel: -1
1:38:38.521864 INFO: Competetive: True
1:38:38.577390 WARNING: dropped 59 target PSMs due to missing features
1:38:38.577497 WARNING: dropped 59 decoy PSMs due to missing features
1:38:40.167198 INFO: Test AUC: 0.544
1:38:40.167348 INFO: Train AUC: 0.570
1:38:40.174191 INFO: AUC difference: 4.59%
1:38:40.301915 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
1:38:40.302889 PROGRESS: ============================= Precursor FDR =============================
1:38:40.303018 PROGRESS: Total precursors accumulated: 428
1:38:40.303097 PROGRESS: Target precursors: 391 (91.36%)
1:38:40.303166 PROGRESS: Decoy precursors: 37 (8.64%)
1:38:40.303231 PROGRESS: 
1:38:40.303293 PROGRESS: Precursor Summary:
1:38:40.304930 PROGRESS: Channel   0:	 0.05 FDR:   327; 0.01 FDR:   234; 0.001 FDR:   147
1:38:40.305066 PROGRESS: 
1:38:40.305140 PROGRESS: Protein Summary:
1:38:40.307055 PROGRESS: Channel   0:	 0.05 FDR:   317; 0.01 FDR:   225; 0.001 FDR:   143
1:38:40.307165 PROGRESS: =========================================================================
1:38:40.308157 PROGRESS: === Epoch 3, step 5, extracting elution groups 31000 to 63000 ===
1:38:40.444683 PROGRESS: Extracting batch of 63209 precursors
1:38:40.464376 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:38:40.464483 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:38:40.464539 INFO: FWHM in RT is 15.13 seconds, sigma is 0.55
1:38:40.464566 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:38:40.464820 INFO: Starting candidate selection
1:38:45.467456 INFO: Starting candidate scoring
1:38:47.313402 INFO: Finished candidate processing
1:38:47.313506 INFO: Collecting candidate features
1:38:49.678040 WARNING: intensity_correlation has 120 NaNs ( 0.21 % out of 57079)
1:38:49.686891 INFO: Collecting fragment features
1:38:50.402812 INFO: Finished candidate scoring
1:38:50.749566 PROGRESS: === Epoch 3, step 5, extracted 57079 precursors and 286512 fragments ===
1:38:50.749931 INFO: performing precursor FDR with 47 features
1:38:50.749984 INFO: Decoy channel: -1
1:38:50.750010 INFO: Competetive: True
1:38:50.877489 WARNING: dropped 124 target PSMs due to missing features
1:38:50.877604 WARNING: dropped 114 decoy PSMs due to missing features
1:38:54.512433 INFO: Test AUC: 0.542
1:38:54.512550 INFO: Train AUC: 0.572
1:38:54.512609 INFO: AUC difference: 5.11%
1:38:54.512638 WARNING: AUC difference > 5%. This may indicate overfitting.
1:38:54.675487 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
1:38:54.676635 PROGRESS: ============================= Precursor FDR =============================
1:38:54.676757 PROGRESS: Total precursors accumulated: 842
1:38:54.676833 PROGRESS: Target precursors: 770 (91.45%)
1:38:54.676901 PROGRESS: Decoy precursors: 72 (8.55%)
1:38:54.676964 PROGRESS: 
1:38:54.677024 PROGRESS: Precursor Summary:
1:38:54.678837 PROGRESS: Channel   0:	 0.05 FDR:   626; 0.01 FDR:   421; 0.001 FDR:   267
1:38:54.678952 PROGRESS: 
1:38:54.679025 PROGRESS: Protein Summary:
1:38:54.681158 PROGRESS: Channel   0:	 0.05 FDR:   580; 0.01 FDR:   394; 0.001 FDR:   256
1:38:54.681268 PROGRESS: =========================================================================
1:38:54.682379 PROGRESS: === Epoch 3, step 6, extracting elution groups 63000 to 127000 ===
1:38:54.857295 PROGRESS: Extracting batch of 126486 precursors
1:38:54.895506 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:38:54.895621 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:38:54.895663 INFO: FWHM in RT is 15.13 seconds, sigma is 0.55
1:38:54.895691 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:38:54.895948 INFO: Starting candidate selection
1:39:01.295979 INFO: Starting candidate scoring
1:39:03.745036 INFO: Finished candidate processing
1:39:03.745226 INFO: Collecting candidate features
1:39:06.309410 WARNING: intensity_correlation has 264 NaNs ( 0.23 % out of 114209)
1:39:06.322321 INFO: Collecting fragment features
1:39:07.093437 INFO: Finished candidate scoring
1:39:07.515188 PROGRESS: === Epoch 3, step 6, extracted 114209 precursors and 571455 fragments ===
1:39:07.515531 INFO: performing precursor FDR with 47 features
1:39:07.515577 INFO: Decoy channel: -1
1:39:07.515603 INFO: Competetive: True
1:39:07.781043 WARNING: dropped 253 target PSMs due to missing features
1:39:07.781174 WARNING: dropped 249 decoy PSMs due to missing features
1:39:15.869704 INFO: Test AUC: 0.551
1:39:15.869862 INFO: Train AUC: 0.568
1:39:15.869922 INFO: AUC difference: 2.92%
1:39:16.019990 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
1:39:16.021373 PROGRESS: ============================= Precursor FDR =============================
1:39:16.021526 PROGRESS: Total precursors accumulated: 1,657
1:39:16.021604 PROGRESS: Target precursors: 1,512 (91.25%)
1:39:16.021672 PROGRESS: Decoy precursors: 145 (8.75%)
1:39:16.021737 PROGRESS: 
1:39:16.021810 PROGRESS: Precursor Summary:
1:39:16.023877 PROGRESS: Channel   0:	 0.05 FDR: 1,176; 0.01 FDR:   812; 0.001 FDR:   577
1:39:16.024015 PROGRESS: 
1:39:16.024090 PROGRESS: Protein Summary:
1:39:16.026709 PROGRESS: Channel   0:	 0.05 FDR: 1,034; 0.01 FDR:   717; 0.001 FDR:   520
1:39:16.026824 PROGRESS: =========================================================================
1:39:16.029032 INFO: calibration group: precursor, fitting rt estimator 
1:39:16.165613 INFO: calibration group: fragment, fitting mz estimator 
1:39:16.754700 INFO: === checking if epoch conditions were reached ===
1:39:16.754854 INFO: ✅ ms2_error      : 7.0000 <= 7
1:39:16.754940 INFO: ❌ rt_error       : 237.0710 > 100
1:39:16.755012 INFO: ✅ current_epoch  : 3 >= 3
1:39:16.755084 INFO: ==============================================
1:39:16.972895 INFO: calibration group: precursor, predicting mz
1:39:16.973174 WARNING: mz prediction was skipped as it has not been fitted yet
1:39:16.973213 INFO: calibration group: precursor, predicting rt
1:39:23.801743 INFO: calibration group: fragment, predicting mz
1:39:41.565476 PROGRESS: === Epoch 4, step 0, extracting elution groups 0 to 1000 ===
1:39:41.646940 PROGRESS: Extracting batch of 1984 precursors
1:39:41.648644 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:39:41.648723 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:39:41.648763 INFO: FWHM in RT is 14.60 seconds, sigma is 0.53
1:39:41.648794 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:39:41.649025 INFO: Starting candidate selection
1:39:45.663141 INFO: Starting candidate scoring
1:39:46.955455 INFO: Finished candidate processing
1:39:46.955543 INFO: Collecting candidate features
1:39:49.110575 WARNING: intensity_correlation has 3 NaNs ( 0.16 % out of 1859)
1:39:49.116488 INFO: Collecting fragment features
1:39:49.726629 INFO: Finished candidate scoring
1:39:50.022316 PROGRESS: === Epoch 4, step 0, extracted 1859 precursors and 9294 fragments ===
1:39:50.022613 INFO: performing precursor FDR with 47 features
1:39:50.022654 INFO: Decoy channel: -1
1:39:50.022680 INFO: Competetive: True
1:39:50.027292 WARNING: dropped 2 target PSMs due to missing features
1:39:50.027363 WARNING: dropped 1 decoy PSMs due to missing features
1:39:50.055209 INFO: Test AUC: 0.567
1:39:50.055302 INFO: Train AUC: 0.527
1:39:50.055348 INFO: AUC difference: 7.58%
1:39:50.055383 WARNING: AUC difference > 5%. This may indicate overfitting.
1:39:50.173137 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
1:39:50.173963 PROGRESS: ============================= Precursor FDR =============================
1:39:50.174088 PROGRESS: Total precursors accumulated: 6
1:39:50.174168 PROGRESS: Target precursors: 6 (100.00%)
1:39:50.174236 PROGRESS: Decoy precursors: 0 (0.00%)
1:39:50.174299 PROGRESS: 
1:39:50.174361 PROGRESS: Precursor Summary:
1:39:50.175849 PROGRESS: Channel   0:	 0.05 FDR:     6; 0.01 FDR:     6; 0.001 FDR:     6
1:39:50.175974 PROGRESS: 
1:39:50.176047 PROGRESS: Protein Summary:
1:39:50.177721 PROGRESS: Channel   0:	 0.05 FDR:     6; 0.01 FDR:     6; 0.001 FDR:     6
1:39:50.177841 PROGRESS: =========================================================================
1:39:50.178729 PROGRESS: === Epoch 4, step 1, extracting elution groups 1000 to 3000 ===
1:39:50.255672 PROGRESS: Extracting batch of 3946 precursors
1:39:50.257804 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:39:50.257881 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:39:50.257921 INFO: FWHM in RT is 14.60 seconds, sigma is 0.53
1:39:50.257952 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:39:50.258190 INFO: Starting candidate selection
1:39:53.932726 INFO: Starting candidate scoring
1:39:55.239883 INFO: Finished candidate processing
1:39:55.240028 INFO: Collecting candidate features
1:39:57.402744 WARNING: intensity_correlation has 5 NaNs ( 0.14 % out of 3634)
1:39:57.408722 INFO: Collecting fragment features
1:39:58.021881 INFO: Finished candidate scoring
1:39:58.302341 PROGRESS: === Epoch 4, step 1, extracted 3634 precursors and 18180 fragments ===
1:39:58.302610 INFO: performing precursor FDR with 47 features
1:39:58.302656 INFO: Decoy channel: -1
1:39:58.302684 INFO: Competetive: True
1:39:58.311182 WARNING: dropped 4 target PSMs due to missing features
1:39:58.311269 WARNING: dropped 4 decoy PSMs due to missing features
1:39:58.348166 INFO: Test AUC: 0.525
1:39:58.348278 INFO: Train AUC: 0.534
1:39:58.348322 INFO: AUC difference: 1.74%
1:39:58.466284 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
1:39:58.467088 PROGRESS: ============================= Precursor FDR =============================
1:39:58.467217 PROGRESS: Total precursors accumulated: 35
1:39:58.467296 PROGRESS: Target precursors: 32 (91.43%)
1:39:58.467364 PROGRESS: Decoy precursors: 3 (8.57%)
1:39:58.467427 PROGRESS: 
1:39:58.467488 PROGRESS: Precursor Summary:
1:39:58.468918 PROGRESS: Channel   0:	 0.05 FDR:    31; 0.01 FDR:    29; 0.001 FDR:    29
1:39:58.469046 PROGRESS: 
1:39:58.469121 PROGRESS: Protein Summary:
1:39:58.470746 PROGRESS: Channel   0:	 0.05 FDR:    31; 0.01 FDR:    29; 0.001 FDR:    29
1:39:58.470857 PROGRESS: =========================================================================
1:39:58.471714 PROGRESS: === Epoch 4, step 2, extracting elution groups 3000 to 7000 ===
1:39:58.553767 PROGRESS: Extracting batch of 7902 precursors
1:39:58.556934 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:39:58.556995 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:39:58.557032 INFO: FWHM in RT is 14.60 seconds, sigma is 0.53
1:39:58.557077 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:39:58.557293 INFO: Starting candidate selection
1:40:02.391624 INFO: Starting candidate scoring
1:40:03.776038 INFO: Finished candidate processing
1:40:03.776131 INFO: Collecting candidate features
1:40:05.950461 WARNING: intensity_correlation has 14 NaNs ( 0.19 % out of 7303)
1:40:05.956030 INFO: Collecting fragment features
1:40:06.575057 INFO: Finished candidate scoring
1:40:06.859150 PROGRESS: === Epoch 4, step 2, extracted 7303 precursors and 36499 fragments ===
1:40:06.859462 INFO: performing precursor FDR with 47 features
1:40:06.859507 INFO: Decoy channel: -1
1:40:06.859534 INFO: Competetive: True
1:40:06.874084 WARNING: dropped 12 target PSMs due to missing features
1:40:06.874179 WARNING: dropped 10 decoy PSMs due to missing features
1:40:07.129611 INFO: Test AUC: 0.529
1:40:07.129741 INFO: Train AUC: 0.567
1:40:07.129796 INFO: AUC difference: 6.70%
1:40:07.129833 WARNING: AUC difference > 5%. This may indicate overfitting.
1:40:07.251731 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
1:40:07.252582 PROGRESS: ============================= Precursor FDR =============================
1:40:07.252706 PROGRESS: Total precursors accumulated: 90
1:40:07.252796 PROGRESS: Target precursors: 85 (94.44%)
1:40:07.252866 PROGRESS: Decoy precursors: 5 (5.56%)
1:40:07.252929 PROGRESS: 
1:40:07.252991 PROGRESS: Precursor Summary:
1:40:07.254461 PROGRESS: Channel   0:	 0.05 FDR:    75; 0.01 FDR:    53; 0.001 FDR:    53
1:40:07.254575 PROGRESS: 
1:40:07.254649 PROGRESS: Protein Summary:
1:40:07.256305 PROGRESS: Channel   0:	 0.05 FDR:    75; 0.01 FDR:    53; 0.001 FDR:    53
1:40:07.256417 PROGRESS: =========================================================================
1:40:07.257290 PROGRESS: === Epoch 4, step 3, extracting elution groups 7000 to 15000 ===
1:40:07.349918 PROGRESS: Extracting batch of 15836 precursors
1:40:07.355463 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:40:07.355566 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:40:07.355606 INFO: FWHM in RT is 14.60 seconds, sigma is 0.53
1:40:07.355634 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:40:07.355861 INFO: Starting candidate selection
1:40:11.328521 INFO: Starting candidate scoring
1:40:12.761002 INFO: Finished candidate processing
1:40:12.761116 INFO: Collecting candidate features
1:40:14.991997 WARNING: intensity_correlation has 22 NaNs ( 0.15 % out of 14639)
1:40:14.999225 INFO: Collecting fragment features
1:40:15.638451 INFO: Finished candidate scoring
1:40:15.934606 PROGRESS: === Epoch 4, step 3, extracted 14639 precursors and 73148 fragments ===
1:40:15.934909 INFO: performing precursor FDR with 47 features
1:40:15.934957 INFO: Decoy channel: -1
1:40:15.934986 INFO: Competetive: True
1:40:15.963396 WARNING: dropped 21 target PSMs due to missing features
1:40:15.963529 WARNING: dropped 23 decoy PSMs due to missing features
1:40:16.762169 INFO: Test AUC: 0.542
1:40:16.762316 INFO: Train AUC: 0.576
1:40:16.762375 INFO: AUC difference: 5.79%
1:40:16.762410 WARNING: AUC difference > 5%. This may indicate overfitting.
1:40:16.887678 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
1:40:16.888618 PROGRESS: ============================= Precursor FDR =============================
1:40:16.888742 PROGRESS: Total precursors accumulated: 262
1:40:16.888821 PROGRESS: Target precursors: 241 (91.98%)
1:40:16.888889 PROGRESS: Decoy precursors: 21 (8.02%)
1:40:16.888952 PROGRESS: 
1:40:16.889013 PROGRESS: Precursor Summary:
1:40:16.890585 PROGRESS: Channel   0:	 0.05 FDR:   188; 0.01 FDR:   141; 0.001 FDR:   120
1:40:16.890702 PROGRESS: 
1:40:16.890787 PROGRESS: Protein Summary:
1:40:16.892584 PROGRESS: Channel   0:	 0.05 FDR:   184; 0.01 FDR:   138; 0.001 FDR:   118
1:40:16.892697 PROGRESS: =========================================================================
1:40:16.893641 PROGRESS: === Epoch 4, step 4, extracting elution groups 15000 to 31000 ===
1:40:17.001855 PROGRESS: Extracting batch of 31645 precursors
1:40:17.012356 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:40:17.012468 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:40:17.012511 INFO: FWHM in RT is 14.60 seconds, sigma is 0.53
1:40:17.012538 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:40:17.012777 INFO: Starting candidate selection
1:40:21.319200 INFO: Starting candidate scoring
1:40:22.884374 INFO: Finished candidate processing
1:40:22.884500 INFO: Collecting candidate features
1:40:25.135067 WARNING: intensity_correlation has 42 NaNs ( 0.14 % out of 29328)
1:40:25.141985 INFO: Collecting fragment features
1:40:25.795551 INFO: Finished candidate scoring
1:40:26.107083 PROGRESS: === Epoch 4, step 4, extracted 29328 precursors and 146882 fragments ===
1:40:26.107426 INFO: performing precursor FDR with 47 features
1:40:26.107473 INFO: Decoy channel: -1
1:40:26.107501 INFO: Competetive: True
1:40:26.165092 WARNING: dropped 41 target PSMs due to missing features
1:40:26.165200 WARNING: dropped 45 decoy PSMs due to missing features
1:40:28.082444 INFO: Test AUC: 0.542
1:40:28.082597 INFO: Train AUC: 0.580
1:40:28.082652 INFO: AUC difference: 6.50%
1:40:28.082716 WARNING: AUC difference > 5%. This may indicate overfitting.
1:40:28.213779 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
1:40:28.214842 PROGRESS: ============================= Precursor FDR =============================
1:40:28.214972 PROGRESS: Total precursors accumulated: 497
1:40:28.215068 PROGRESS: Target precursors: 457 (91.95%)
1:40:28.215168 PROGRESS: Decoy precursors: 40 (8.05%)
1:40:28.215242 PROGRESS: 
1:40:28.215330 PROGRESS: Precursor Summary:
1:40:28.217029 PROGRESS: Channel   0:	 0.05 FDR:   373; 0.01 FDR:   291; 0.001 FDR:   209
1:40:28.217162 PROGRESS: 
1:40:28.217239 PROGRESS: Protein Summary:
1:40:28.219932 PROGRESS: Channel   0:	 0.05 FDR:   352; 0.01 FDR:   278; 0.001 FDR:   200
1:40:28.220076 PROGRESS: =========================================================================
1:40:28.221176 PROGRESS: === Epoch 4, step 5, extracting elution groups 31000 to 63000 ===
1:40:28.357696 PROGRESS: Extracting batch of 63179 precursors
1:40:28.378034 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:40:28.378145 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:40:28.378185 INFO: FWHM in RT is 14.60 seconds, sigma is 0.53
1:40:28.378212 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:40:28.378505 INFO: Starting candidate selection
1:40:33.412626 INFO: Starting candidate scoring
1:40:35.279505 INFO: Finished candidate processing
1:40:35.279591 INFO: Collecting candidate features
1:40:37.649979 WARNING: intensity_correlation has 83 NaNs ( 0.14 % out of 58574)
1:40:37.658988 INFO: Collecting fragment features
1:40:38.356710 INFO: Finished candidate scoring
1:40:38.702972 PROGRESS: === Epoch 4, step 5, extracted 58574 precursors and 293039 fragments ===
1:40:38.703323 INFO: performing precursor FDR with 47 features
1:40:38.703372 INFO: Decoy channel: -1
1:40:38.703400 INFO: Competetive: True
1:40:38.830779 WARNING: dropped 81 target PSMs due to missing features
1:40:38.830894 WARNING: dropped 88 decoy PSMs due to missing features
1:40:42.849514 INFO: Test AUC: 0.548
1:40:42.849627 INFO: Train AUC: 0.578
1:40:42.849684 INFO: AUC difference: 5.19%
1:40:42.849713 WARNING: AUC difference > 5%. This may indicate overfitting.
1:40:42.988587 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
1:40:42.989765 PROGRESS: ============================= Precursor FDR =============================
1:40:42.989902 PROGRESS: Total precursors accumulated: 890
1:40:42.989979 PROGRESS: Target precursors: 812 (91.24%)
1:40:42.990046 PROGRESS: Decoy precursors: 78 (8.76%)
1:40:42.990109 PROGRESS: 
1:40:42.990170 PROGRESS: Precursor Summary:
1:40:42.992001 PROGRESS: Channel   0:	 0.05 FDR:   730; 0.01 FDR:   506; 0.001 FDR:   242
1:40:42.992121 PROGRESS: 
1:40:42.992196 PROGRESS: Protein Summary:
1:40:42.994417 PROGRESS: Channel   0:	 0.05 FDR:   666; 0.01 FDR:   467; 0.001 FDR:   231
1:40:42.994530 PROGRESS: =========================================================================
1:40:42.995702 PROGRESS: === Epoch 4, step 6, extracting elution groups 63000 to 127000 ===
1:40:43.171001 PROGRESS: Extracting batch of 126456 precursors
1:40:43.209472 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:40:43.209586 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:40:43.209643 INFO: FWHM in RT is 14.60 seconds, sigma is 0.53
1:40:43.209671 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:40:43.209939 INFO: Starting candidate selection
1:40:49.655014 INFO: Starting candidate scoring
1:40:52.143022 INFO: Finished candidate processing
1:40:52.143201 INFO: Collecting candidate features
1:40:54.696770 WARNING: intensity_correlation has 146 NaNs ( 0.12 % out of 116931)
1:40:54.709448 INFO: Collecting fragment features
1:40:55.456011 INFO: Finished candidate scoring
1:40:55.884030 PROGRESS: === Epoch 4, step 6, extracted 116931 precursors and 585649 fragments ===
1:40:55.884367 INFO: performing precursor FDR with 47 features
1:40:55.884413 INFO: Decoy channel: -1
1:40:55.884440 INFO: Competetive: True
1:40:56.152694 WARNING: dropped 158 target PSMs due to missing features
1:40:56.152807 WARNING: dropped 157 decoy PSMs due to missing features
1:41:04.647452 INFO: Test AUC: 0.543
1:41:04.647581 INFO: Train AUC: 0.573
1:41:04.647640 INFO: AUC difference: 5.22%
1:41:04.647669 WARNING: AUC difference > 5%. This may indicate overfitting.
1:41:04.799626 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
1:41:04.801029 PROGRESS: ============================= Precursor FDR =============================
1:41:04.801183 PROGRESS: Total precursors accumulated: 1,720
1:41:04.801262 PROGRESS: Target precursors: 1,571 (91.34%)
1:41:04.801342 PROGRESS: Decoy precursors: 149 (8.66%)
1:41:04.801407 PROGRESS: 
1:41:04.801468 PROGRESS: Precursor Summary:
1:41:04.803600 PROGRESS: Channel   0:	 0.05 FDR: 1,310; 0.01 FDR:   908; 0.001 FDR:   496
1:41:04.803733 PROGRESS: 
1:41:04.803807 PROGRESS: Protein Summary:
1:41:04.806509 PROGRESS: Channel   0:	 0.05 FDR: 1,132; 0.01 FDR:   797; 0.001 FDR:   450
1:41:04.806622 PROGRESS: =========================================================================
1:41:04.808011 PROGRESS: === Epoch 4, step 7, extracting elution groups 127000 to 255000 ===
1:41:05.035935 PROGRESS: Extracting batch of 252961 precursors
1:41:05.108579 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:41:05.108692 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:41:05.108732 INFO: FWHM in RT is 14.60 seconds, sigma is 0.53
1:41:05.108776 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:41:05.109042 INFO: Starting candidate selection
1:41:14.388068 INFO: Starting candidate scoring
1:41:18.110286 INFO: Finished candidate processing
1:41:18.110438 INFO: Collecting candidate features
1:41:21.044228 WARNING: intensity_correlation has 324 NaNs ( 0.14 % out of 234385)
1:41:21.064397 INFO: Collecting fragment features
1:41:21.903175 INFO: Finished candidate scoring
1:41:22.482035 PROGRESS: === Epoch 4, step 7, extracted 234385 precursors and 1170572 fragments ===
1:41:22.482372 INFO: performing precursor FDR with 47 features
1:41:22.482417 INFO: Decoy channel: -1
1:41:22.482443 INFO: Competetive: True
1:41:23.067079 WARNING: dropped 344 target PSMs due to missing features
1:41:23.067197 WARNING: dropped 295 decoy PSMs due to missing features
1:41:39.734175 INFO: Test AUC: 0.546
1:41:39.734323 INFO: Train AUC: 0.569
1:41:39.734364 INFO: AUC difference: 4.01%
1:41:39.915454 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
1:41:39.917364 PROGRESS: ============================= Precursor FDR =============================
1:41:39.917516 PROGRESS: Total precursors accumulated: 3,289
1:41:39.917595 PROGRESS: Target precursors: 3,001 (91.24%)
1:41:39.917663 PROGRESS: Decoy precursors: 288 (8.76%)
1:41:39.917727 PROGRESS: 
1:41:39.917805 PROGRESS: Precursor Summary:
1:41:39.920552 PROGRESS: Channel   0:	 0.05 FDR: 2,544; 0.01 FDR: 1,971; 0.001 FDR: 1,113
1:41:39.920684 PROGRESS: 
1:41:39.920775 PROGRESS: Protein Summary:
1:41:39.924425 PROGRESS: Channel   0:	 0.05 FDR: 1,962; 0.01 FDR: 1,524; 0.001 FDR:   907
1:41:39.924542 PROGRESS: =========================================================================
1:41:39.927796 INFO: calibration group: precursor, fitting rt estimator 
1:41:40.203231 INFO: calibration group: fragment, fitting mz estimator 
1:41:40.788113 INFO: === checking if epoch conditions were reached ===
1:41:40.788306 INFO: ✅ ms2_error      : 7.0000 <= 7
1:41:40.788395 INFO: ❌ rt_error       : 237.2766 > 100
1:41:40.788469 INFO: ✅ current_epoch  : 4 >= 3
1:41:40.788532 INFO: ==============================================
1:41:41.006925 INFO: calibration group: precursor, predicting mz
1:41:41.007209 WARNING: mz prediction was skipped as it has not been fitted yet
1:41:41.007253 INFO: calibration group: precursor, predicting rt
1:41:47.801144 INFO: calibration group: fragment, predicting mz
1:42:06.056284 PROGRESS: === Epoch 5, step 0, extracting elution groups 0 to 1000 ===
1:42:06.143431 PROGRESS: Extracting batch of 1979 precursors
1:42:06.145162 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:42:06.145237 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:42:06.145277 INFO: FWHM in RT is 14.49 seconds, sigma is 0.53
1:42:06.145324 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:42:06.145551 INFO: Starting candidate selection
1:42:10.228313 INFO: Starting candidate scoring
1:42:11.527982 INFO: Finished candidate processing
1:42:11.528075 INFO: Collecting candidate features
1:42:13.677102 WARNING: intensity_correlation has 1 NaNs ( 0.05 % out of 1859)
1:42:13.682914 INFO: Collecting fragment features
1:42:14.313570 INFO: Finished candidate scoring
1:42:14.627255 PROGRESS: === Epoch 5, step 0, extracted 1859 precursors and 9323 fragments ===
1:42:14.627595 INFO: performing precursor FDR with 47 features
1:42:14.627637 INFO: Decoy channel: -1
1:42:14.627663 INFO: Competetive: True
1:42:14.632086 WARNING: dropped 1 target PSMs due to missing features
1:42:14.659224 INFO: Test AUC: 0.519
1:42:14.659319 INFO: Train AUC: 0.549
1:42:14.659363 INFO: AUC difference: 5.45%
1:42:14.659396 WARNING: AUC difference > 5%. This may indicate overfitting.
1:42:16.521157 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
1:42:16.522018 PROGRESS: ============================= Precursor FDR =============================
1:42:16.522148 PROGRESS: Total precursors accumulated: 16
1:42:16.522229 PROGRESS: Target precursors: 15 (93.75%)
1:42:16.522297 PROGRESS: Decoy precursors: 1 (6.25%)
1:42:16.522372 PROGRESS: 
1:42:16.522435 PROGRESS: Precursor Summary:
1:42:16.523861 PROGRESS: Channel   0:	 0.05 FDR:    15; 0.01 FDR:    15; 0.001 FDR:    15
1:42:16.523990 PROGRESS: 
1:42:16.524062 PROGRESS: Protein Summary:
1:42:16.525656 PROGRESS: Channel   0:	 0.05 FDR:    15; 0.01 FDR:    15; 0.001 FDR:    15
1:42:16.525787 PROGRESS: =========================================================================
1:42:16.526637 PROGRESS: === Epoch 5, step 1, extracting elution groups 1000 to 3000 ===
1:42:16.614796 PROGRESS: Extracting batch of 3957 precursors
1:42:16.617046 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:42:16.617118 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:42:16.617159 INFO: FWHM in RT is 14.49 seconds, sigma is 0.53
1:42:16.617204 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:42:16.617422 INFO: Starting candidate selection
1:42:20.381107 INFO: Starting candidate scoring
1:42:21.712560 INFO: Finished candidate processing
1:42:21.712652 INFO: Collecting candidate features
1:42:23.903522 WARNING: intensity_correlation has 3 NaNs ( 0.08 % out of 3726)
1:42:23.909464 INFO: Collecting fragment features
1:42:24.556124 INFO: Finished candidate scoring
1:42:24.839882 PROGRESS: === Epoch 5, step 1, extracted 3726 precursors and 18769 fragments ===
1:42:24.840219 INFO: performing precursor FDR with 47 features
1:42:24.840263 INFO: Decoy channel: -1
1:42:24.840290 INFO: Competetive: True
1:42:24.848966 WARNING: dropped 4 target PSMs due to missing features
1:42:24.886767 INFO: Test AUC: 0.556
1:42:24.886886 INFO: Train AUC: 0.549
1:42:24.886933 INFO: AUC difference: 1.21%
1:42:25.008381 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
1:42:25.009187 PROGRESS: ============================= Precursor FDR =============================
1:42:25.009310 PROGRESS: Total precursors accumulated: 41
1:42:25.009388 PROGRESS: Target precursors: 38 (92.68%)
1:42:25.009456 PROGRESS: Decoy precursors: 3 (7.32%)
1:42:25.009519 PROGRESS: 
1:42:25.009581 PROGRESS: Precursor Summary:
1:42:25.011043 PROGRESS: Channel   0:	 0.05 FDR:    34; 0.01 FDR:    32; 0.001 FDR:    32
1:42:25.011177 PROGRESS: 
1:42:25.011251 PROGRESS: Protein Summary:
1:42:25.012884 PROGRESS: Channel   0:	 0.05 FDR:    34; 0.01 FDR:    32; 0.001 FDR:    32
1:42:25.013025 PROGRESS: =========================================================================
1:42:25.013912 PROGRESS: === Epoch 5, step 2, extracting elution groups 3000 to 7000 ===
1:42:25.096132 PROGRESS: Extracting batch of 7894 precursors
1:42:25.099622 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:42:25.099685 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:42:25.099724 INFO: FWHM in RT is 14.49 seconds, sigma is 0.53
1:42:25.099769 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:42:25.100002 INFO: Starting candidate selection
1:42:28.887216 INFO: Starting candidate scoring
1:42:30.222474 INFO: Finished candidate processing
1:42:30.222569 INFO: Collecting candidate features
1:42:32.399791 WARNING: intensity_correlation has 8 NaNs ( 0.11 % out of 7412)
1:42:32.405487 INFO: Collecting fragment features
1:42:33.051234 INFO: Finished candidate scoring
1:42:33.337185 PROGRESS: === Epoch 5, step 2, extracted 7412 precursors and 37041 fragments ===
1:42:33.337538 INFO: performing precursor FDR with 47 features
1:42:33.337597 INFO: Decoy channel: -1
1:42:33.337645 INFO: Competetive: True
1:42:33.352820 WARNING: dropped 10 target PSMs due to missing features
1:42:33.352914 WARNING: dropped 2 decoy PSMs due to missing features
1:42:33.583108 INFO: Test AUC: 0.544
1:42:33.583243 INFO: Train AUC: 0.572
1:42:33.583287 INFO: AUC difference: 4.86%
1:42:33.707902 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
1:42:33.708759 PROGRESS: ============================= Precursor FDR =============================
1:42:33.708878 PROGRESS: Total precursors accumulated: 86
1:42:33.708957 PROGRESS: Target precursors: 79 (91.86%)
1:42:33.709026 PROGRESS: Decoy precursors: 7 (8.14%)
1:42:33.709091 PROGRESS: 
1:42:33.709153 PROGRESS: Precursor Summary:
1:42:33.710639 PROGRESS: Channel   0:	 0.05 FDR:    70; 0.01 FDR:    46; 0.001 FDR:    46
1:42:33.710753 PROGRESS: 
1:42:33.710829 PROGRESS: Protein Summary:
1:42:33.712488 PROGRESS: Channel   0:	 0.05 FDR:    70; 0.01 FDR:    46; 0.001 FDR:    46
1:42:33.712597 PROGRESS: =========================================================================
1:42:33.713469 PROGRESS: === Epoch 5, step 3, extracting elution groups 7000 to 15000 ===
1:42:33.804421 PROGRESS: Extracting batch of 15819 precursors
1:42:33.810093 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:42:33.810178 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:42:33.810215 INFO: FWHM in RT is 14.49 seconds, sigma is 0.53
1:42:33.810242 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:42:33.810471 INFO: Starting candidate selection
1:42:37.786107 INFO: Starting candidate scoring
1:42:39.218672 INFO: Finished candidate processing
1:42:39.218858 INFO: Collecting candidate features
1:42:41.449667 WARNING: intensity_correlation has 16 NaNs ( 0.11 % out of 14912)
1:42:41.455750 INFO: Collecting fragment features
1:42:42.119641 INFO: Finished candidate scoring
1:42:42.417571 PROGRESS: === Epoch 5, step 3, extracted 14912 precursors and 75228 fragments ===
1:42:42.417907 INFO: performing precursor FDR with 47 features
1:42:42.417953 INFO: Decoy channel: -1
1:42:42.417980 INFO: Competetive: True
1:42:42.447291 WARNING: dropped 18 target PSMs due to missing features
1:42:42.447404 WARNING: dropped 10 decoy PSMs due to missing features
1:42:43.173626 INFO: Test AUC: 0.534
1:42:43.173765 INFO: Train AUC: 0.588
1:42:43.173819 INFO: AUC difference: 9.20%
1:42:43.173853 WARNING: AUC difference > 5%. This may indicate overfitting.
1:42:43.301529 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
1:42:43.302506 PROGRESS: ============================= Precursor FDR =============================
1:42:43.302635 PROGRESS: Total precursors accumulated: 230
1:42:43.302713 PROGRESS: Target precursors: 211 (91.74%)
1:42:43.302780 PROGRESS: Decoy precursors: 19 (8.26%)
1:42:43.302842 PROGRESS: 
1:42:43.302902 PROGRESS: Precursor Summary:
1:42:43.304451 PROGRESS: Channel   0:	 0.05 FDR:   184; 0.01 FDR:   128; 0.001 FDR:    96
1:42:43.304570 PROGRESS: 
1:42:43.304643 PROGRESS: Protein Summary:
1:42:43.306429 PROGRESS: Channel   0:	 0.05 FDR:   183; 0.01 FDR:   128; 0.001 FDR:    96
1:42:43.306544 PROGRESS: =========================================================================
1:42:43.307460 PROGRESS: === Epoch 5, step 4, extracting elution groups 15000 to 31000 ===
1:42:43.415443 PROGRESS: Extracting batch of 31621 precursors
1:42:43.426185 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:42:43.426281 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:42:43.426320 INFO: FWHM in RT is 14.49 seconds, sigma is 0.53
1:42:43.426348 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:42:43.426593 INFO: Starting candidate selection
1:42:47.760628 INFO: Starting candidate scoring
1:42:49.355719 INFO: Finished candidate processing
1:42:49.355907 INFO: Collecting candidate features
1:42:51.626168 WARNING: intensity_correlation has 31 NaNs ( 0.10 % out of 29776)
1:42:51.634398 INFO: Collecting fragment features
1:42:52.321047 INFO: Finished candidate scoring
1:42:52.635226 PROGRESS: === Epoch 5, step 4, extracted 29776 precursors and 150768 fragments ===
1:42:52.635571 INFO: performing precursor FDR with 47 features
1:42:52.635619 INFO: Decoy channel: -1
1:42:52.635645 INFO: Competetive: True
1:42:52.694188 WARNING: dropped 34 target PSMs due to missing features
1:42:52.694301 WARNING: dropped 25 decoy PSMs due to missing features
1:42:54.532494 INFO: Test AUC: 0.546
1:42:54.532638 INFO: Train AUC: 0.588
1:42:54.532682 INFO: AUC difference: 7.28%
1:42:54.532715 WARNING: AUC difference > 5%. This may indicate overfitting.
1:42:54.659004 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
1:42:54.660074 PROGRESS: ============================= Precursor FDR =============================
1:42:54.660199 PROGRESS: Total precursors accumulated: 523
1:42:54.660279 PROGRESS: Target precursors: 480 (91.78%)
1:42:54.660347 PROGRESS: Decoy precursors: 43 (8.22%)
1:42:54.660410 PROGRESS: 
1:42:54.660472 PROGRESS: Precursor Summary:
1:42:54.662172 PROGRESS: Channel   0:	 0.05 FDR:   416; 0.01 FDR:   271; 0.001 FDR:    81
1:42:54.662287 PROGRESS: 
1:42:54.662361 PROGRESS: Protein Summary:
1:42:54.664310 PROGRESS: Channel   0:	 0.05 FDR:   396; 0.01 FDR:   257; 0.001 FDR:    79
1:42:54.664436 PROGRESS: =========================================================================
1:42:54.665469 PROGRESS: === Epoch 5, step 5, extracting elution groups 31000 to 63000 ===
1:42:54.801728 PROGRESS: Extracting batch of 63213 precursors
1:42:54.821599 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:42:54.821709 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:42:54.821746 INFO: FWHM in RT is 14.49 seconds, sigma is 0.53
1:42:54.821800 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:42:54.822055 INFO: Starting candidate selection
1:42:59.900897 INFO: Starting candidate scoring
1:43:01.812623 INFO: Finished candidate processing
1:43:01.812812 INFO: Collecting candidate features
1:43:04.189569 WARNING: intensity_correlation has 69 NaNs ( 0.12 % out of 59715)
1:43:04.198599 INFO: Collecting fragment features
1:43:04.917103 INFO: Finished candidate scoring
1:43:05.269173 PROGRESS: === Epoch 5, step 5, extracted 59715 precursors and 301671 fragments ===
1:43:05.269527 INFO: performing precursor FDR with 47 features
1:43:05.269574 INFO: Decoy channel: -1
1:43:05.269601 INFO: Competetive: True
1:43:05.404008 WARNING: dropped 69 target PSMs due to missing features
1:43:05.404122 WARNING: dropped 59 decoy PSMs due to missing features
1:43:09.036102 INFO: Test AUC: 0.549
1:43:09.036240 INFO: Train AUC: 0.587
1:43:09.036283 INFO: AUC difference: 6.45%
1:43:09.036312 WARNING: AUC difference > 5%. This may indicate overfitting.
1:43:09.188173 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
1:43:09.189431 PROGRESS: ============================= Precursor FDR =============================
1:43:09.189562 PROGRESS: Total precursors accumulated: 1,024
1:43:09.189642 PROGRESS: Target precursors: 938 (91.60%)
1:43:09.189712 PROGRESS: Decoy precursors: 86 (8.40%)
1:43:09.189783 PROGRESS: 
1:43:09.189850 PROGRESS: Precursor Summary:
1:43:09.191762 PROGRESS: Channel   0:	 0.05 FDR:   782; 0.01 FDR:   505; 0.001 FDR:   220
1:43:09.191886 PROGRESS: 
1:43:09.191962 PROGRESS: Protein Summary:
1:43:09.194269 PROGRESS: Channel   0:	 0.05 FDR:   725; 0.01 FDR:   472; 0.001 FDR:   208
1:43:09.194386 PROGRESS: =========================================================================
1:43:09.195594 PROGRESS: === Epoch 5, step 6, extracting elution groups 63000 to 127000 ===
1:43:09.374005 PROGRESS: Extracting batch of 126417 precursors
1:43:09.412925 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:43:09.413032 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:43:09.413072 INFO: FWHM in RT is 14.49 seconds, sigma is 0.53
1:43:09.413133 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:43:09.413394 INFO: Starting candidate selection
1:43:15.888783 INFO: Starting candidate scoring
1:43:18.404509 INFO: Finished candidate processing
1:43:18.404694 INFO: Collecting candidate features
1:43:20.930778 WARNING: intensity_correlation has 144 NaNs ( 0.12 % out of 119222)
1:43:20.943764 INFO: Collecting fragment features
1:43:21.709744 INFO: Finished candidate scoring
1:43:22.133527 PROGRESS: === Epoch 5, step 6, extracted 119222 precursors and 601108 fragments ===
1:43:22.133875 INFO: performing precursor FDR with 47 features
1:43:22.133923 INFO: Decoy channel: -1
1:43:22.133950 INFO: Competetive: True
1:43:22.406003 WARNING: dropped 137 target PSMs due to missing features
1:43:22.406137 WARNING: dropped 135 decoy PSMs due to missing features
1:43:30.736142 INFO: Test AUC: 0.550
1:43:30.736274 INFO: Train AUC: 0.580
1:43:30.736331 INFO: AUC difference: 5.18%
1:43:30.736359 WARNING: AUC difference > 5%. This may indicate overfitting.
1:43:30.920857 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
1:43:30.922374 PROGRESS: ============================= Precursor FDR =============================
1:43:30.922511 PROGRESS: Total precursors accumulated: 1,843
1:43:30.922591 PROGRESS: Target precursors: 1,684 (91.37%)
1:43:30.922659 PROGRESS: Decoy precursors: 159 (8.63%)
1:43:30.922724 PROGRESS: 
1:43:30.922785 PROGRESS: Precursor Summary:
1:43:30.924998 PROGRESS: Channel   0:	 0.05 FDR: 1,421; 0.01 FDR:   958; 0.001 FDR:   429
1:43:30.925144 PROGRESS: 
1:43:30.925219 PROGRESS: Protein Summary:
1:43:30.930118 PROGRESS: Channel   0:	 0.05 FDR: 1,226; 0.01 FDR:   840; 0.001 FDR:   396
1:43:30.930369 PROGRESS: =========================================================================
1:43:30.932649 PROGRESS: === Epoch 5, step 7, extracting elution groups 127000 to 255000 ===
1:43:31.157104 PROGRESS: Extracting batch of 252922 precursors
1:43:31.229089 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:43:31.229211 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:43:31.229261 INFO: FWHM in RT is 14.49 seconds, sigma is 0.53
1:43:31.229292 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:43:31.229588 INFO: Starting candidate selection
1:43:40.542186 INFO: Starting candidate scoring
1:43:44.297639 INFO: Finished candidate processing
1:43:44.297852 INFO: Collecting candidate features
1:43:47.275934 WARNING: intensity_correlation has 273 NaNs ( 0.11 % out of 238209)
1:43:47.296957 INFO: Collecting fragment features
1:43:48.183984 INFO: Finished candidate scoring
1:43:48.768602 PROGRESS: === Epoch 5, step 7, extracted 238209 precursors and 1200555 fragments ===
1:43:48.768944 INFO: performing precursor FDR with 47 features
1:43:48.768990 INFO: Decoy channel: -1
1:43:48.769017 INFO: Competetive: True
1:43:49.373512 WARNING: dropped 266 target PSMs due to missing features
1:43:49.373635 WARNING: dropped 279 decoy PSMs due to missing features
1:44:06.535786 INFO: Test AUC: 0.552
1:44:06.535918 INFO: Train AUC: 0.573
1:44:06.535975 INFO: AUC difference: 3.54%
1:44:06.745905 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
1:44:06.747965 PROGRESS: ============================= Precursor FDR =============================
1:44:06.748138 PROGRESS: Total precursors accumulated: 3,706
1:44:06.748222 PROGRESS: Target precursors: 3,399 (91.72%)
1:44:06.748290 PROGRESS: Decoy precursors: 307 (8.28%)
1:44:06.748353 PROGRESS: 
1:44:06.748414 PROGRESS: Precursor Summary:
1:44:06.751186 PROGRESS: Channel   0:	 0.05 FDR: 2,887; 0.01 FDR: 1,941; 0.001 FDR:   221
1:44:06.751335 PROGRESS: 
1:44:06.751407 PROGRESS: Protein Summary:
1:44:06.755008 PROGRESS: Channel   0:	 0.05 FDR: 2,198; 0.01 FDR: 1,487; 0.001 FDR:   213
1:44:06.755137 PROGRESS: =========================================================================
1:44:06.758422 INFO: calibration group: precursor, fitting rt estimator 
1:44:07.015311 INFO: calibration group: fragment, fitting mz estimator 
1:44:07.600593 INFO: === checking if epoch conditions were reached ===
1:44:07.600812 INFO: ✅ ms2_error      : 7.0000 <= 7
1:44:07.600904 INFO: ❌ rt_error       : 237.4611 > 100
1:44:07.600979 INFO: ✅ current_epoch  : 5 >= 3
1:44:07.601044 INFO: ==============================================
1:44:07.820843 INFO: calibration group: precursor, predicting mz
1:44:07.821134 WARNING: mz prediction was skipped as it has not been fitted yet
1:44:07.821176 INFO: calibration group: precursor, predicting rt
1:44:14.667992 INFO: calibration group: fragment, predicting mz
1:44:32.723755 PROGRESS: === Epoch 6, step 0, extracting elution groups 0 to 1000 ===
1:44:32.811005 PROGRESS: Extracting batch of 1978 precursors
1:44:32.812751 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:44:32.812842 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:44:32.812882 INFO: FWHM in RT is 14.70 seconds, sigma is 0.54
1:44:32.812927 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:44:32.813156 INFO: Starting candidate selection
1:44:36.916219 INFO: Starting candidate scoring
1:44:38.228663 INFO: Finished candidate processing
1:44:38.228752 INFO: Collecting candidate features
1:44:40.406321 WARNING: intensity_correlation has 3 NaNs ( 0.16 % out of 1885)
1:44:40.412302 INFO: Collecting fragment features
1:44:41.051754 INFO: Finished candidate scoring
1:44:41.368974 PROGRESS: === Epoch 6, step 0, extracted 1885 precursors and 9508 fragments ===
1:44:41.369302 INFO: performing precursor FDR with 47 features
1:44:41.369344 INFO: Decoy channel: -1
1:44:41.369371 INFO: Competetive: True
1:44:41.374101 WARNING: dropped 3 target PSMs due to missing features
1:44:41.404179 INFO: Test AUC: 0.568
1:44:41.404282 INFO: Train AUC: 0.538
1:44:41.404326 INFO: AUC difference: 5.63%
1:44:41.404361 WARNING: AUC difference > 5%. This may indicate overfitting.
1:44:41.521952 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
1:44:41.522753 PROGRESS: ============================= Precursor FDR =============================
1:44:41.522878 PROGRESS: Total precursors accumulated: 2
1:44:41.522956 PROGRESS: Target precursors: 2 (100.00%)
1:44:41.523025 PROGRESS: Decoy precursors: 0 (0.00%)
1:44:41.523089 PROGRESS: 
1:44:41.523152 PROGRESS: Precursor Summary:
1:44:41.524646 PROGRESS: Channel   0:	 0.05 FDR:     2; 0.01 FDR:     2; 0.001 FDR:     2
1:44:41.524760 PROGRESS: 
1:44:41.524834 PROGRESS: Protein Summary:
1:44:41.526548 PROGRESS: Channel   0:	 0.05 FDR:     2; 0.01 FDR:     2; 0.001 FDR:     2
1:44:41.526663 PROGRESS: =========================================================================
1:44:41.527549 PROGRESS: === Epoch 6, step 1, extracting elution groups 1000 to 3000 ===
1:44:41.604849 PROGRESS: Extracting batch of 3959 precursors
1:44:41.607100 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:44:41.607161 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:44:41.607199 INFO: FWHM in RT is 14.70 seconds, sigma is 0.54
1:44:41.607244 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:44:41.607458 INFO: Starting candidate selection
1:44:45.311918 INFO: Starting candidate scoring
1:44:46.622551 INFO: Finished candidate processing
1:44:46.622642 INFO: Collecting candidate features
1:44:48.785226 WARNING: intensity_correlation has 6 NaNs ( 0.16 % out of 3737)
1:44:48.791490 INFO: Collecting fragment features
1:44:49.407475 INFO: Finished candidate scoring
1:44:49.687673 PROGRESS: === Epoch 6, step 1, extracted 3737 precursors and 18815 fragments ===
1:44:49.687959 INFO: performing precursor FDR with 47 features
1:44:49.688005 INFO: Decoy channel: -1
1:44:49.688031 INFO: Competetive: True
1:44:49.696859 WARNING: dropped 8 target PSMs due to missing features
1:44:49.696950 WARNING: dropped 1 decoy PSMs due to missing features
1:44:49.734527 INFO: Test AUC: 0.510
1:44:49.734642 INFO: Train AUC: 0.557
1:44:49.734687 INFO: AUC difference: 8.43%
1:44:49.734722 WARNING: AUC difference > 5%. This may indicate overfitting.
1:44:49.868740 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
1:44:49.869542 PROGRESS: ============================= Precursor FDR =============================
1:44:49.869665 PROGRESS: Total precursors accumulated: 27
1:44:49.869752 PROGRESS: Target precursors: 25 (92.59%)
1:44:49.869835 PROGRESS: Decoy precursors: 2 (7.41%)
1:44:49.869900 PROGRESS: 
1:44:49.869962 PROGRESS: Precursor Summary:
1:44:49.871382 PROGRESS: Channel   0:	 0.05 FDR:    15; 0.01 FDR:    15; 0.001 FDR:    15
1:44:49.871495 PROGRESS: 
1:44:49.871571 PROGRESS: Protein Summary:
1:44:49.873184 PROGRESS: Channel   0:	 0.05 FDR:    15; 0.01 FDR:    15; 0.001 FDR:    15
1:44:49.873294 PROGRESS: =========================================================================
1:44:49.874151 PROGRESS: === Epoch 6, step 2, extracting elution groups 3000 to 7000 ===
1:44:49.956526 PROGRESS: Extracting batch of 7913 precursors
1:44:49.959829 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:44:49.959892 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:44:49.959947 INFO: FWHM in RT is 14.70 seconds, sigma is 0.54
1:44:49.959977 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:44:49.960197 INFO: Starting candidate selection
1:44:53.745224 INFO: Starting candidate scoring
1:44:55.093193 INFO: Finished candidate processing
1:44:55.093372 INFO: Collecting candidate features
1:44:57.296506 WARNING: intensity_correlation has 5 NaNs ( 0.07 % out of 7494)
1:44:57.302191 INFO: Collecting fragment features
1:44:57.930705 INFO: Finished candidate scoring
1:44:58.218141 PROGRESS: === Epoch 6, step 2, extracted 7494 precursors and 38016 fragments ===
1:44:58.218460 INFO: performing precursor FDR with 47 features
1:44:58.218503 INFO: Decoy channel: -1
1:44:58.218529 INFO: Competetive: True
1:44:58.234113 WARNING: dropped 10 target PSMs due to missing features
1:44:58.234234 WARNING: dropped 4 decoy PSMs due to missing features
1:44:58.497008 INFO: Test AUC: 0.556
1:44:58.497138 INFO: Train AUC: 0.581
1:44:58.497195 INFO: AUC difference: 4.31%
1:44:58.618280 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
1:44:58.619112 PROGRESS: ============================= Precursor FDR =============================
1:44:58.619233 PROGRESS: Total precursors accumulated: 61
1:44:58.619311 PROGRESS: Target precursors: 56 (91.80%)
1:44:58.619379 PROGRESS: Decoy precursors: 5 (8.20%)
1:44:58.619441 PROGRESS: 
1:44:58.619503 PROGRESS: Precursor Summary:
1:44:58.620940 PROGRESS: Channel   0:	 0.05 FDR:    45; 0.01 FDR:    26; 0.001 FDR:    26
1:44:58.621064 PROGRESS: 
1:44:58.621139 PROGRESS: Protein Summary:
1:44:58.622783 PROGRESS: Channel   0:	 0.05 FDR:    44; 0.01 FDR:    26; 0.001 FDR:    26
1:44:58.622894 PROGRESS: =========================================================================
1:44:58.623750 PROGRESS: === Epoch 6, step 3, extracting elution groups 7000 to 15000 ===
1:44:58.715106 PROGRESS: Extracting batch of 15831 precursors
1:44:58.720694 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:44:58.720762 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:44:58.720796 INFO: FWHM in RT is 14.70 seconds, sigma is 0.54
1:44:58.720820 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:44:58.721058 INFO: Starting candidate selection
1:45:02.684568 INFO: Starting candidate scoring
1:45:04.111818 INFO: Finished candidate processing
1:45:04.111912 INFO: Collecting candidate features
1:45:06.328051 WARNING: intensity_correlation has 20 NaNs ( 0.13 % out of 15026)
1:45:06.334354 INFO: Collecting fragment features
1:45:06.973423 INFO: Finished candidate scoring
1:45:07.270577 PROGRESS: === Epoch 6, step 3, extracted 15026 precursors and 76381 fragments ===
1:45:07.270899 INFO: performing precursor FDR with 47 features
1:45:07.270944 INFO: Decoy channel: -1
1:45:07.270971 INFO: Competetive: True
1:45:07.300761 WARNING: dropped 19 target PSMs due to missing features
1:45:07.300878 WARNING: dropped 15 decoy PSMs due to missing features
1:45:08.119595 INFO: Test AUC: 0.541
1:45:08.119791 INFO: Train AUC: 0.593
1:45:08.119857 INFO: AUC difference: 8.77%
1:45:08.119909 WARNING: AUC difference > 5%. This may indicate overfitting.
1:45:08.244185 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
1:45:08.245086 PROGRESS: ============================= Precursor FDR =============================
1:45:08.245207 PROGRESS: Total precursors accumulated: 167
1:45:08.245284 PROGRESS: Target precursors: 152 (91.02%)
1:45:08.245352 PROGRESS: Decoy precursors: 15 (8.98%)
1:45:08.245414 PROGRESS: 
1:45:08.245477 PROGRESS: Precursor Summary:
1:45:08.247010 PROGRESS: Channel   0:	 0.05 FDR:   136; 0.01 FDR:    78; 0.001 FDR:    78
1:45:08.247154 PROGRESS: 
1:45:08.247229 PROGRESS: Protein Summary:
1:45:08.248950 PROGRESS: Channel   0:	 0.05 FDR:   128; 0.01 FDR:    74; 0.001 FDR:    74
1:45:08.249061 PROGRESS: =========================================================================
1:45:08.249969 PROGRESS: === Epoch 6, step 4, extracting elution groups 15000 to 31000 ===
1:45:08.358094 PROGRESS: Extracting batch of 31629 precursors
1:45:08.368847 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:45:08.368960 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:45:08.369004 INFO: FWHM in RT is 14.70 seconds, sigma is 0.54
1:45:08.369032 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:45:08.369275 INFO: Starting candidate selection
1:45:12.694175 INFO: Starting candidate scoring
1:45:14.263670 INFO: Finished candidate processing
1:45:14.263859 INFO: Collecting candidate features
1:45:16.527096 WARNING: intensity_correlation has 54 NaNs ( 0.18 % out of 29997)
1:45:16.535572 INFO: Collecting fragment features
1:45:17.185841 INFO: Finished candidate scoring
1:45:17.498478 PROGRESS: === Epoch 6, step 4, extracted 29997 precursors and 150989 fragments ===
1:45:17.498831 INFO: performing precursor FDR with 47 features
1:45:17.498879 INFO: Decoy channel: -1
1:45:17.498906 INFO: Competetive: True
1:45:17.557868 WARNING: dropped 44 target PSMs due to missing features
1:45:17.557994 WARNING: dropped 44 decoy PSMs due to missing features
1:45:19.458879 INFO: Test AUC: 0.545
1:45:19.459027 INFO: Train AUC: 0.598
1:45:19.459073 INFO: AUC difference: 8.71%
1:45:19.459108 WARNING: AUC difference > 5%. This may indicate overfitting.
1:45:19.590655 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
1:45:19.591668 PROGRESS: ============================= Precursor FDR =============================
1:45:19.591789 PROGRESS: Total precursors accumulated: 445
1:45:19.591866 PROGRESS: Target precursors: 406 (91.24%)
1:45:19.591934 PROGRESS: Decoy precursors: 39 (8.76%)
1:45:19.591998 PROGRESS: 
1:45:19.592060 PROGRESS: Precursor Summary:
1:45:19.593668 PROGRESS: Channel   0:	 0.05 FDR:   292; 0.01 FDR:   177; 0.001 FDR:   171
1:45:19.593788 PROGRESS: 
1:45:19.593865 PROGRESS: Protein Summary:
1:45:19.595748 PROGRESS: Channel   0:	 0.05 FDR:   277; 0.01 FDR:   167; 0.001 FDR:   161
1:45:19.595858 PROGRESS: =========================================================================
1:45:19.596828 PROGRESS: === Epoch 6, step 5, extracting elution groups 31000 to 63000 ===
1:45:19.732287 PROGRESS: Extracting batch of 63228 precursors
1:45:19.752119 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:45:19.752228 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:45:19.752264 INFO: FWHM in RT is 14.70 seconds, sigma is 0.54
1:45:19.752308 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:45:19.752565 INFO: Starting candidate selection
1:45:24.841142 INFO: Starting candidate scoring
1:45:26.770228 INFO: Finished candidate processing
1:45:26.770329 INFO: Collecting candidate features
1:45:29.120099 WARNING: intensity_correlation has 86 NaNs ( 0.14 % out of 59983)
1:45:29.129143 INFO: Collecting fragment features
1:45:29.814484 INFO: Finished candidate scoring
1:45:30.162688 PROGRESS: === Epoch 6, step 5, extracted 59983 precursors and 303962 fragments ===
1:45:30.163027 INFO: performing precursor FDR with 47 features
1:45:30.163091 INFO: Decoy channel: -1
1:45:30.163118 INFO: Competetive: True
1:45:30.295115 WARNING: dropped 88 target PSMs due to missing features
1:45:30.295226 WARNING: dropped 86 decoy PSMs due to missing features
1:45:34.189149 INFO: Test AUC: 0.549
1:45:34.189268 INFO: Train AUC: 0.589
1:45:34.189322 INFO: AUC difference: 6.84%
1:45:34.189350 WARNING: AUC difference > 5%. This may indicate overfitting.
1:45:34.324680 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
1:45:34.325850 PROGRESS: ============================= Precursor FDR =============================
1:45:34.325972 PROGRESS: Total precursors accumulated: 900
1:45:34.326049 PROGRESS: Target precursors: 820 (91.11%)
1:45:34.326131 PROGRESS: Decoy precursors: 80 (8.89%)
1:45:34.326196 PROGRESS: 
1:45:34.326259 PROGRESS: Precursor Summary:
1:45:34.328077 PROGRESS: Channel   0:	 0.05 FDR:   610; 0.01 FDR:   454; 0.001 FDR:   310
1:45:34.328192 PROGRESS: 
1:45:34.328280 PROGRESS: Protein Summary:
1:45:34.330445 PROGRESS: Channel   0:	 0.05 FDR:   559; 0.01 FDR:   419; 0.001 FDR:   290
1:45:34.330557 PROGRESS: =========================================================================
1:45:34.331674 PROGRESS: === Epoch 6, step 6, extracting elution groups 63000 to 127000 ===
1:45:34.507769 PROGRESS: Extracting batch of 126466 precursors
1:45:34.545477 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:45:34.545593 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:45:34.545630 INFO: FWHM in RT is 14.70 seconds, sigma is 0.54
1:45:34.545672 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:45:34.545940 INFO: Starting candidate selection
1:45:41.050346 INFO: Starting candidate scoring
1:45:43.571078 INFO: Finished candidate processing
1:45:43.571230 INFO: Collecting candidate features
1:45:46.130115 WARNING: intensity_correlation has 163 NaNs ( 0.14 % out of 119805)
1:45:46.143395 INFO: Collecting fragment features
1:45:46.892811 INFO: Finished candidate scoring
1:45:47.318471 PROGRESS: === Epoch 6, step 6, extracted 119805 precursors and 605610 fragments ===
1:45:47.318826 INFO: performing precursor FDR with 47 features
1:45:47.318872 INFO: Decoy channel: -1
1:45:47.318900 INFO: Competetive: True
1:45:47.596300 WARNING: dropped 162 target PSMs due to missing features
1:45:47.596419 WARNING: dropped 175 decoy PSMs due to missing features
1:45:55.942057 INFO: Test AUC: 0.548
1:45:55.942200 INFO: Train AUC: 0.583
1:45:55.942244 INFO: AUC difference: 5.91%
1:45:55.942272 WARNING: AUC difference > 5%. This may indicate overfitting.
1:45:56.109684 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
1:45:56.111192 PROGRESS: ============================= Precursor FDR =============================
1:45:56.111320 PROGRESS: Total precursors accumulated: 1,873
1:45:56.111398 PROGRESS: Target precursors: 1,709 (91.24%)
1:45:56.111467 PROGRESS: Decoy precursors: 164 (8.76%)
1:45:56.111531 PROGRESS: 
1:45:56.111603 PROGRESS: Precursor Summary:
1:45:56.113813 PROGRESS: Channel   0:	 0.05 FDR: 1,403; 0.01 FDR:   913; 0.001 FDR:   673
1:45:56.113931 PROGRESS: 
1:45:56.114005 PROGRESS: Protein Summary:
1:45:56.116745 PROGRESS: Channel   0:	 0.05 FDR: 1,209; 0.01 FDR:   791; 0.001 FDR:   593
1:45:56.116854 PROGRESS: =========================================================================
1:45:56.118263 PROGRESS: === Epoch 6, step 7, extracting elution groups 127000 to 255000 ===
1:45:56.341758 PROGRESS: Extracting batch of 252917 precursors
1:45:56.413754 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:45:56.413893 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:45:56.413935 INFO: FWHM in RT is 14.70 seconds, sigma is 0.54
1:45:56.413962 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:45:56.414242 INFO: Starting candidate selection
1:46:05.785822 INFO: Starting candidate scoring
1:46:09.565319 INFO: Finished candidate processing
1:46:09.565504 INFO: Collecting candidate features
1:46:12.507591 WARNING: intensity_correlation has 357 NaNs ( 0.15 % out of 239573)
1:46:12.508301 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 239573)
1:46:12.528198 INFO: Collecting fragment features
1:46:13.398591 INFO: Finished candidate scoring
1:46:13.982035 PROGRESS: === Epoch 6, step 7, extracted 239573 precursors and 1212530 fragments ===
1:46:13.982376 INFO: performing precursor FDR with 47 features
1:46:13.982424 INFO: Decoy channel: -1
1:46:13.982450 INFO: Competetive: True
1:46:14.580765 WARNING: dropped 342 target PSMs due to missing features
1:46:14.580886 WARNING: dropped 352 decoy PSMs due to missing features
1:46:32.047344 INFO: Test AUC: 0.551
1:46:32.047472 INFO: Train AUC: 0.574
1:46:32.047526 INFO: AUC difference: 4.02%
1:46:32.231484 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
1:46:32.233472 PROGRESS: ============================= Precursor FDR =============================
1:46:32.233608 PROGRESS: Total precursors accumulated: 3,573
1:46:32.233687 PROGRESS: Target precursors: 3,264 (91.35%)
1:46:32.233757 PROGRESS: Decoy precursors: 309 (8.65%)
1:46:32.233842 PROGRESS: 
1:46:32.233906 PROGRESS: Precursor Summary:
1:46:32.236766 PROGRESS: Channel   0:	 0.05 FDR: 2,809; 0.01 FDR: 2,147; 0.001 FDR: 1,663
1:46:32.236911 PROGRESS: 
1:46:32.236982 PROGRESS: Protein Summary:
1:46:32.240849 PROGRESS: Channel   0:	 0.05 FDR: 2,164; 0.01 FDR: 1,647; 0.001 FDR: 1,301
1:46:32.240957 PROGRESS: =========================================================================
1:46:32.244307 INFO: calibration group: precursor, fitting rt estimator 
1:46:32.531478 INFO: calibration group: fragment, fitting mz estimator 
1:46:33.114468 INFO: === checking if epoch conditions were reached ===
1:46:33.114673 INFO: ✅ ms2_error      : 7.0000 <= 7
1:46:33.114763 INFO: ❌ rt_error       : 240.0323 > 100
1:46:33.114836 INFO: ✅ current_epoch  : 6 >= 3
1:46:33.114900 INFO: ==============================================
1:46:33.333809 INFO: calibration group: precursor, predicting mz
1:46:33.334090 WARNING: mz prediction was skipped as it has not been fitted yet
1:46:33.334133 INFO: calibration group: precursor, predicting rt
1:46:40.123002 INFO: calibration group: fragment, predicting mz
1:46:58.278275 PROGRESS: === Epoch 7, step 0, extracting elution groups 0 to 1000 ===
1:46:58.365058 PROGRESS: Extracting batch of 1980 precursors
1:46:58.366780 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:46:58.366858 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:46:58.366896 INFO: FWHM in RT is 14.52 seconds, sigma is 0.53
1:46:58.366925 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:46:58.367167 INFO: Starting candidate selection
1:47:02.490622 INFO: Starting candidate scoring
1:47:03.804304 INFO: Finished candidate processing
1:47:03.804420 INFO: Collecting candidate features
1:47:05.984349 WARNING: intensity_correlation has 1 NaNs ( 0.05 % out of 1891)
1:47:05.990294 INFO: Collecting fragment features
1:47:06.638120 INFO: Finished candidate scoring
1:47:06.951225 PROGRESS: === Epoch 7, step 0, extracted 1891 precursors and 9564 fragments ===
1:47:06.951550 INFO: performing precursor FDR with 47 features
1:47:06.951594 INFO: Decoy channel: -1
1:47:06.951621 INFO: Competetive: True
1:47:06.956147 WARNING: dropped 1 target PSMs due to missing features
1:47:06.984060 INFO: Test AUC: 0.567
1:47:06.984151 INFO: Train AUC: 0.558
1:47:06.984196 INFO: AUC difference: 1.70%
1:47:07.104473 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
1:47:07.105230 PROGRESS: ============================= Precursor FDR =============================
1:47:07.105352 PROGRESS: Total precursors accumulated: 20
1:47:07.105430 PROGRESS: Target precursors: 19 (95.00%)
1:47:07.105499 PROGRESS: Decoy precursors: 1 (5.00%)
1:47:07.105563 PROGRESS: 
1:47:07.105624 PROGRESS: Precursor Summary:
1:47:07.107051 PROGRESS: Channel   0:	 0.05 FDR:    17; 0.01 FDR:    17; 0.001 FDR:    17
1:47:07.107177 PROGRESS: 
1:47:07.107251 PROGRESS: Protein Summary:
1:47:07.108861 PROGRESS: Channel   0:	 0.05 FDR:    17; 0.01 FDR:    17; 0.001 FDR:    17
1:47:07.108978 PROGRESS: =========================================================================
1:47:07.109837 PROGRESS: === Epoch 7, step 1, extracting elution groups 1000 to 3000 ===
1:47:07.186660 PROGRESS: Extracting batch of 3951 precursors
1:47:07.188790 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:47:07.188849 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:47:07.188886 INFO: FWHM in RT is 14.52 seconds, sigma is 0.53
1:47:07.188931 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:47:07.189145 INFO: Starting candidate selection
1:47:10.912537 INFO: Starting candidate scoring
1:47:12.219595 INFO: Finished candidate processing
1:47:12.219684 INFO: Collecting candidate features
1:47:14.391418 WARNING: intensity_correlation has 6 NaNs ( 0.16 % out of 3703)
1:47:14.397493 INFO: Collecting fragment features
1:47:15.037566 INFO: Finished candidate scoring
1:47:15.318581 PROGRESS: === Epoch 7, step 1, extracted 3703 precursors and 18448 fragments ===
1:47:15.318862 INFO: performing precursor FDR with 47 features
1:47:15.318905 INFO: Decoy channel: -1
1:47:15.318932 INFO: Competetive: True
1:47:15.327510 WARNING: dropped 5 target PSMs due to missing features
1:47:15.327601 WARNING: dropped 2 decoy PSMs due to missing features
1:47:15.365635 INFO: Test AUC: 0.565
1:47:15.365754 INFO: Train AUC: 0.549
1:47:15.365808 INFO: AUC difference: 2.92%
1:47:15.487180 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
1:47:15.487966 PROGRESS: ============================= Precursor FDR =============================
1:47:15.488088 PROGRESS: Total precursors accumulated: 51
1:47:15.488166 PROGRESS: Target precursors: 47 (92.16%)
1:47:15.488235 PROGRESS: Decoy precursors: 4 (7.84%)
1:47:15.488298 PROGRESS: 
1:47:15.488358 PROGRESS: Precursor Summary:
1:47:15.489801 PROGRESS: Channel   0:	 0.05 FDR:    37; 0.01 FDR:    37; 0.001 FDR:    37
1:47:15.489913 PROGRESS: 
1:47:15.489986 PROGRESS: Protein Summary:
1:47:15.491611 PROGRESS: Channel   0:	 0.05 FDR:    37; 0.01 FDR:    37; 0.001 FDR:    37
1:47:15.491721 PROGRESS: =========================================================================
1:47:15.492589 PROGRESS: === Epoch 7, step 2, extracting elution groups 3000 to 7000 ===
1:47:15.574345 PROGRESS: Extracting batch of 7903 precursors
1:47:15.577629 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:47:15.577692 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:47:15.577731 INFO: FWHM in RT is 14.52 seconds, sigma is 0.53
1:47:15.577787 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:47:15.578028 INFO: Starting candidate selection
1:47:19.368255 INFO: Starting candidate scoring
1:47:20.709739 INFO: Finished candidate processing
1:47:20.709844 INFO: Collecting candidate features
1:47:22.892259 WARNING: intensity_correlation has 12 NaNs ( 0.16 % out of 7502)
1:47:22.897760 INFO: Collecting fragment features
1:47:23.540224 INFO: Finished candidate scoring
1:47:23.824757 PROGRESS: === Epoch 7, step 2, extracted 7502 precursors and 37892 fragments ===
1:47:23.825083 INFO: performing precursor FDR with 47 features
1:47:23.825128 INFO: Decoy channel: -1
1:47:23.825153 INFO: Competetive: True
1:47:23.840144 WARNING: dropped 13 target PSMs due to missing features
1:47:23.840243 WARNING: dropped 6 decoy PSMs due to missing features
1:47:24.089029 INFO: Test AUC: 0.540
1:47:24.089244 INFO: Train AUC: 0.582
1:47:24.089317 INFO: AUC difference: 7.22%
1:47:24.089354 WARNING: AUC difference > 5%. This may indicate overfitting.
1:47:24.212580 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
1:47:24.213471 PROGRESS: ============================= Precursor FDR =============================
1:47:24.213622 PROGRESS: Total precursors accumulated: 115
1:47:24.213732 PROGRESS: Target precursors: 105 (91.30%)
1:47:24.213845 PROGRESS: Decoy precursors: 10 (8.70%)
1:47:24.213932 PROGRESS: 
1:47:24.214021 PROGRESS: Precursor Summary:
1:47:24.215518 PROGRESS: Channel   0:	 0.05 FDR:    84; 0.01 FDR:    76; 0.001 FDR:    76
1:47:24.215646 PROGRESS: 
1:47:24.215755 PROGRESS: Protein Summary:
1:47:24.218041 PROGRESS: Channel   0:	 0.05 FDR:    83; 0.01 FDR:    75; 0.001 FDR:    75
1:47:24.218167 PROGRESS: =========================================================================
1:47:24.219096 PROGRESS: === Epoch 7, step 3, extracting elution groups 7000 to 15000 ===
1:47:24.310373 PROGRESS: Extracting batch of 15807 precursors
1:47:24.315991 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:47:24.316056 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:47:24.316091 INFO: FWHM in RT is 14.52 seconds, sigma is 0.53
1:47:24.316117 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:47:24.316378 INFO: Starting candidate selection
1:47:28.334900 INFO: Starting candidate scoring
1:47:29.767712 INFO: Finished candidate processing
1:47:29.767806 INFO: Collecting candidate features
1:47:31.968663 WARNING: intensity_correlation has 23 NaNs ( 0.15 % out of 14869)
1:47:31.974775 INFO: Collecting fragment features
1:47:32.633134 INFO: Finished candidate scoring
1:47:32.927294 PROGRESS: === Epoch 7, step 3, extracted 14869 precursors and 74945 fragments ===
1:47:32.927625 INFO: performing precursor FDR with 47 features
1:47:32.927671 INFO: Decoy channel: -1
1:47:32.927701 INFO: Competetive: True
1:47:32.956314 WARNING: dropped 24 target PSMs due to missing features
1:47:32.956433 WARNING: dropped 18 decoy PSMs due to missing features
1:47:33.731151 INFO: Test AUC: 0.553
1:47:33.731300 INFO: Train AUC: 0.591
1:47:33.731347 INFO: AUC difference: 6.32%
1:47:33.731382 WARNING: AUC difference > 5%. This may indicate overfitting.
1:47:33.856824 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
1:47:33.857751 PROGRESS: ============================= Precursor FDR =============================
1:47:33.857882 PROGRESS: Total precursors accumulated: 245
1:47:33.857959 PROGRESS: Target precursors: 224 (91.43%)
1:47:33.858026 PROGRESS: Decoy precursors: 21 (8.57%)
1:47:33.858087 PROGRESS: 
1:47:33.858158 PROGRESS: Precursor Summary:
1:47:33.859673 PROGRESS: Channel   0:	 0.05 FDR:   167; 0.01 FDR:   134; 0.001 FDR:    98
1:47:33.859801 PROGRESS: 
1:47:33.859874 PROGRESS: Protein Summary:
1:47:33.861628 PROGRESS: Channel   0:	 0.05 FDR:   165; 0.01 FDR:   133; 0.001 FDR:    97
1:47:33.861736 PROGRESS: =========================================================================
1:47:33.862666 PROGRESS: === Epoch 7, step 4, extracting elution groups 15000 to 31000 ===
1:47:33.970081 PROGRESS: Extracting batch of 31607 precursors
1:47:33.980502 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:47:33.980593 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:47:33.980630 INFO: FWHM in RT is 14.52 seconds, sigma is 0.53
1:47:33.980672 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:47:33.980911 INFO: Starting candidate selection
1:47:38.377432 INFO: Starting candidate scoring
1:47:39.973607 INFO: Finished candidate processing
1:47:39.973706 INFO: Collecting candidate features
1:47:42.220417 WARNING: intensity_correlation has 30 NaNs ( 0.10 % out of 29907)
1:47:42.227290 INFO: Collecting fragment features
1:47:42.906970 INFO: Finished candidate scoring
1:47:43.217708 PROGRESS: === Epoch 7, step 4, extracted 29907 precursors and 151587 fragments ===
1:47:43.218060 INFO: performing precursor FDR with 47 features
1:47:43.218109 INFO: Decoy channel: -1
1:47:43.218135 INFO: Competetive: True
1:47:43.276805 WARNING: dropped 43 target PSMs due to missing features
1:47:43.276917 WARNING: dropped 29 decoy PSMs due to missing features
1:47:44.985568 INFO: Test AUC: 0.547
1:47:44.985717 INFO: Train AUC: 0.601
1:47:44.985763 INFO: AUC difference: 8.96%
1:47:44.985812 WARNING: AUC difference > 5%. This may indicate overfitting.
1:47:45.109625 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
1:47:45.110725 PROGRESS: ============================= Precursor FDR =============================
1:47:45.110853 PROGRESS: Total precursors accumulated: 694
1:47:45.110931 PROGRESS: Target precursors: 633 (91.21%)
1:47:45.110998 PROGRESS: Decoy precursors: 61 (8.79%)
1:47:45.111061 PROGRESS: 
1:47:45.111121 PROGRESS: Precursor Summary:
1:47:45.112781 PROGRESS: Channel   0:	 0.05 FDR:   429; 0.01 FDR:   228; 0.001 FDR:   201
1:47:45.112914 PROGRESS: 
1:47:45.112988 PROGRESS: Protein Summary:
1:47:45.114948 PROGRESS: Channel   0:	 0.05 FDR:   414; 0.01 FDR:   221; 0.001 FDR:   194
1:47:45.115059 PROGRESS: =========================================================================
1:47:45.116056 PROGRESS: === Epoch 7, step 5, extracting elution groups 31000 to 63000 ===
1:47:45.252772 PROGRESS: Extracting batch of 63313 precursors
1:47:45.272484 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:47:45.272590 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:47:45.272627 INFO: FWHM in RT is 14.52 seconds, sigma is 0.53
1:47:45.272670 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:47:45.272916 INFO: Starting candidate selection
1:47:50.319355 INFO: Starting candidate scoring
1:47:52.203447 INFO: Finished candidate processing
1:47:52.203551 INFO: Collecting candidate features
1:47:54.563788 WARNING: intensity_correlation has 72 NaNs ( 0.12 % out of 59849)
1:47:54.573570 INFO: Collecting fragment features
1:47:55.285065 INFO: Finished candidate scoring
1:47:55.631994 PROGRESS: === Epoch 7, step 5, extracted 59849 precursors and 302619 fragments ===
1:47:55.632347 INFO: performing precursor FDR with 47 features
1:47:55.632396 INFO: Decoy channel: -1
1:47:55.632427 INFO: Competetive: True
1:47:55.764012 WARNING: dropped 82 target PSMs due to missing features
1:47:55.764132 WARNING: dropped 62 decoy PSMs due to missing features
1:47:59.532864 INFO: Test AUC: 0.548
1:47:59.532983 INFO: Train AUC: 0.597
1:47:59.533022 INFO: AUC difference: 8.18%
1:47:59.533050 WARNING: AUC difference > 5%. This may indicate overfitting.
1:47:59.673346 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
1:47:59.674607 PROGRESS: ============================= Precursor FDR =============================
1:47:59.674731 PROGRESS: Total precursors accumulated: 1,212
1:47:59.674810 PROGRESS: Target precursors: 1,104 (91.09%)
1:47:59.674879 PROGRESS: Decoy precursors: 108 (8.91%)
1:47:59.674942 PROGRESS: 
1:47:59.675003 PROGRESS: Precursor Summary:
1:47:59.676853 PROGRESS: Channel   0:	 0.05 FDR:   817; 0.01 FDR:   551; 0.001 FDR:   231
1:47:59.676982 PROGRESS: 
1:47:59.677058 PROGRESS: Protein Summary:
1:47:59.679349 PROGRESS: Channel   0:	 0.05 FDR:   767; 0.01 FDR:   517; 0.001 FDR:   220
1:47:59.679474 PROGRESS: =========================================================================
1:47:59.680649 PROGRESS: === Epoch 7, step 6, extracting elution groups 63000 to 127000 ===
1:47:59.856284 PROGRESS: Extracting batch of 126478 precursors
1:47:59.894217 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:47:59.894345 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:47:59.894385 INFO: FWHM in RT is 14.52 seconds, sigma is 0.53
1:47:59.894412 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:47:59.894685 INFO: Starting candidate selection
1:48:06.357852 INFO: Starting candidate scoring
1:48:08.860712 INFO: Finished candidate processing
1:48:08.860892 INFO: Collecting candidate features
1:48:11.422416 WARNING: intensity_correlation has 166 NaNs ( 0.14 % out of 119506)
1:48:11.435636 INFO: Collecting fragment features
1:48:12.211758 INFO: Finished candidate scoring
1:48:12.638673 PROGRESS: === Epoch 7, step 6, extracted 119506 precursors and 603457 fragments ===
1:48:12.639033 INFO: performing precursor FDR with 47 features
1:48:12.639080 INFO: Decoy channel: -1
1:48:12.639107 INFO: Competetive: True
1:48:12.914447 WARNING: dropped 183 target PSMs due to missing features
1:48:12.914581 WARNING: dropped 127 decoy PSMs due to missing features
1:48:21.227530 INFO: Test AUC: 0.548
1:48:21.227664 INFO: Train AUC: 0.589
1:48:21.227722 INFO: AUC difference: 6.95%
1:48:21.227751 WARNING: AUC difference > 5%. This may indicate overfitting.
1:48:21.385067 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
1:48:21.386651 PROGRESS: ============================= Precursor FDR =============================
1:48:21.386783 PROGRESS: Total precursors accumulated: 2,233
1:48:21.386860 PROGRESS: Target precursors: 2,035 (91.13%)
1:48:21.386928 PROGRESS: Decoy precursors: 198 (8.87%)
1:48:21.386990 PROGRESS: 
1:48:21.387050 PROGRESS: Precursor Summary:
1:48:21.389249 PROGRESS: Channel   0:	 0.05 FDR: 1,535; 0.01 FDR: 1,076; 0.001 FDR:   507
1:48:21.389386 PROGRESS: 
1:48:21.389460 PROGRESS: Protein Summary:
1:48:21.392233 PROGRESS: Channel   0:	 0.05 FDR: 1,356; 0.01 FDR:   945; 0.001 FDR:   469
1:48:21.392343 PROGRESS: =========================================================================
1:48:21.393823 PROGRESS: === Epoch 7, step 7, extracting elution groups 127000 to 255000 ===
1:48:21.618975 PROGRESS: Extracting batch of 252897 precursors
1:48:21.694287 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:48:21.694407 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:48:21.694449 INFO: FWHM in RT is 14.52 seconds, sigma is 0.53
1:48:21.694476 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:48:21.694742 INFO: Starting candidate selection
1:48:30.975465 INFO: Starting candidate scoring
1:48:34.695802 INFO: Finished candidate processing
1:48:34.695894 INFO: Collecting candidate features
1:48:37.690696 WARNING: intensity_correlation has 276 NaNs ( 0.12 % out of 239062)
1:48:37.711649 INFO: Collecting fragment features
1:48:38.599502 INFO: Finished candidate scoring
1:48:39.177302 PROGRESS: === Epoch 7, step 7, extracted 239062 precursors and 1211701 fragments ===
1:48:39.177648 INFO: performing precursor FDR with 47 features
1:48:39.177696 INFO: Decoy channel: -1
1:48:39.177722 INFO: Competetive: True
1:48:39.775236 WARNING: dropped 331 target PSMs due to missing features
1:48:39.775366 WARNING: dropped 255 decoy PSMs due to missing features
1:48:56.998407 INFO: Test AUC: 0.552
1:48:56.998550 INFO: Train AUC: 0.577
1:48:56.998589 INFO: AUC difference: 4.34%
1:48:57.182462 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
1:48:57.184516 PROGRESS: ============================= Precursor FDR =============================
1:48:57.184682 PROGRESS: Total precursors accumulated: 3,845
1:48:57.184758 PROGRESS: Target precursors: 3,508 (91.24%)
1:48:57.184824 PROGRESS: Decoy precursors: 337 (8.76%)
1:48:57.184885 PROGRESS: 
1:48:57.184945 PROGRESS: Precursor Summary:
1:48:57.187799 PROGRESS: Channel   0:	 0.05 FDR: 2,832; 0.01 FDR: 2,082; 0.001 FDR: 1,374
1:48:57.187937 PROGRESS: 
1:48:57.188009 PROGRESS: Protein Summary:
1:48:57.191828 PROGRESS: Channel   0:	 0.05 FDR: 2,175; 0.01 FDR: 1,601; 0.001 FDR: 1,099
1:48:57.191936 PROGRESS: =========================================================================
1:48:57.195239 INFO: calibration group: precursor, fitting rt estimator 
1:48:57.477279 INFO: calibration group: fragment, fitting mz estimator 
1:48:58.077615 INFO: === checking if epoch conditions were reached ===
1:48:58.077810 INFO: ✅ ms2_error      : 7.0000 <= 7
1:48:58.077901 INFO: ❌ rt_error       : 237.1592 > 100
1:48:58.077974 INFO: ✅ current_epoch  : 7 >= 3
1:48:58.078040 INFO: ==============================================
1:48:58.298201 INFO: calibration group: precursor, predicting mz
1:48:58.298482 WARNING: mz prediction was skipped as it has not been fitted yet
1:48:58.298526 INFO: calibration group: precursor, predicting rt
1:49:05.108708 INFO: calibration group: fragment, predicting mz
1:49:23.128187 PROGRESS: === Epoch 8, step 0, extracting elution groups 0 to 1000 ===
1:49:23.215343 PROGRESS: Extracting batch of 1981 precursors
1:49:23.217065 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:49:23.217160 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:49:23.217214 INFO: FWHM in RT is 14.52 seconds, sigma is 0.53
1:49:23.217264 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:49:23.217498 INFO: Starting candidate selection
1:49:27.284767 INFO: Starting candidate scoring
1:49:28.571616 INFO: Finished candidate processing
1:49:28.571707 INFO: Collecting candidate features
1:49:30.757862 INFO: Collecting fragment features
1:49:31.394655 INFO: Finished candidate scoring
1:49:31.708548 PROGRESS: === Epoch 8, step 0, extracted 1867 precursors and 9596 fragments ===
1:49:31.708895 INFO: performing precursor FDR with 47 features
1:49:31.708937 INFO: Decoy channel: -1
1:49:31.708962 INFO: Competetive: True
1:49:31.740826 INFO: Test AUC: 0.534
1:49:31.740934 INFO: Train AUC: 0.556
1:49:31.740979 INFO: AUC difference: 4.00%
1:49:31.860212 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
1:49:31.861004 PROGRESS: ============================= Precursor FDR =============================
1:49:31.861163 PROGRESS: Total precursors accumulated: 25
1:49:31.861270 PROGRESS: Target precursors: 23 (92.00%)
1:49:31.861367 PROGRESS: Decoy precursors: 2 (8.00%)
1:49:31.861457 PROGRESS: 
1:49:31.861549 PROGRESS: Precursor Summary:
1:49:31.863042 PROGRESS: Channel   0:	 0.05 FDR:    22; 0.01 FDR:    19; 0.001 FDR:    19
1:49:31.863193 PROGRESS: 
1:49:31.863296 PROGRESS: Protein Summary:
1:49:31.865461 PROGRESS: Channel   0:	 0.05 FDR:    22; 0.01 FDR:    19; 0.001 FDR:    19
1:49:31.865600 PROGRESS: =========================================================================
1:49:31.866515 PROGRESS: === Epoch 8, step 1, extracting elution groups 1000 to 3000 ===
1:49:31.943888 PROGRESS: Extracting batch of 3946 precursors
1:49:31.946091 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:49:31.946167 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:49:31.946221 INFO: FWHM in RT is 14.52 seconds, sigma is 0.53
1:49:31.946280 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:49:31.946540 INFO: Starting candidate selection
1:49:35.721120 INFO: Starting candidate scoring
1:49:37.052241 INFO: Finished candidate processing
1:49:37.052336 INFO: Collecting candidate features
1:49:39.253758 WARNING: intensity_correlation has 5 NaNs ( 0.13 % out of 3729)
1:49:39.260790 INFO: Collecting fragment features
1:49:39.908132 INFO: Finished candidate scoring
1:49:40.190581 PROGRESS: === Epoch 8, step 1, extracted 3729 precursors and 18832 fragments ===
1:49:40.190846 INFO: performing precursor FDR with 47 features
1:49:40.190893 INFO: Decoy channel: -1
1:49:40.190920 INFO: Competetive: True
1:49:40.199731 WARNING: dropped 1 target PSMs due to missing features
1:49:40.199822 WARNING: dropped 4 decoy PSMs due to missing features
1:49:40.237520 INFO: Test AUC: 0.538
1:49:40.237642 INFO: Train AUC: 0.547
1:49:40.237689 INFO: AUC difference: 1.60%
1:49:40.357208 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
1:49:40.358006 PROGRESS: ============================= Precursor FDR =============================
1:49:40.358131 PROGRESS: Total precursors accumulated: 32
1:49:40.358209 PROGRESS: Target precursors: 30 (93.75%)
1:49:40.358278 PROGRESS: Decoy precursors: 2 (6.25%)
1:49:40.358340 PROGRESS: 
1:49:40.358400 PROGRESS: Precursor Summary:
1:49:40.359825 PROGRESS: Channel   0:	 0.05 FDR:    30; 0.01 FDR:    21; 0.001 FDR:    21
1:49:40.359952 PROGRESS: 
1:49:40.360027 PROGRESS: Protein Summary:
1:49:40.361635 PROGRESS: Channel   0:	 0.05 FDR:    30; 0.01 FDR:    21; 0.001 FDR:    21
1:49:40.361747 PROGRESS: =========================================================================
1:49:40.362608 PROGRESS: === Epoch 8, step 2, extracting elution groups 3000 to 7000 ===
1:49:40.444966 PROGRESS: Extracting batch of 7917 precursors
1:49:40.448286 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:49:40.448366 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:49:40.448407 INFO: FWHM in RT is 14.52 seconds, sigma is 0.53
1:49:40.448437 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:49:40.448689 INFO: Starting candidate selection
1:49:44.319257 INFO: Starting candidate scoring
1:49:45.689892 INFO: Finished candidate processing
1:49:45.689990 INFO: Collecting candidate features
1:49:47.891694 WARNING: intensity_correlation has 5 NaNs ( 0.07 % out of 7515)
1:49:47.897329 INFO: Collecting fragment features
1:49:48.552666 INFO: Finished candidate scoring
1:49:48.840091 PROGRESS: === Epoch 8, step 2, extracted 7515 precursors and 37795 fragments ===
1:49:48.840415 INFO: performing precursor FDR with 47 features
1:49:48.840463 INFO: Decoy channel: -1
1:49:48.840490 INFO: Competetive: True
1:49:48.855934 WARNING: dropped 5 target PSMs due to missing features
1:49:48.856034 WARNING: dropped 5 decoy PSMs due to missing features
1:49:49.118328 INFO: Test AUC: 0.518
1:49:49.118461 INFO: Train AUC: 0.588
1:49:49.118506 INFO: AUC difference: 11.90%
1:49:49.118540 WARNING: AUC difference > 5%. This may indicate overfitting.
1:49:49.240003 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
1:49:49.240844 PROGRESS: ============================= Precursor FDR =============================
1:49:49.240967 PROGRESS: Total precursors accumulated: 100
1:49:49.241045 PROGRESS: Target precursors: 91 (91.00%)
1:49:49.241113 PROGRESS: Decoy precursors: 9 (9.00%)
1:49:49.241175 PROGRESS: 
1:49:49.241236 PROGRESS: Precursor Summary:
1:49:49.242723 PROGRESS: Channel   0:	 0.05 FDR:    82; 0.01 FDR:    48; 0.001 FDR:    48
1:49:49.242841 PROGRESS: 
1:49:49.242915 PROGRESS: Protein Summary:
1:49:49.244596 PROGRESS: Channel   0:	 0.05 FDR:    80; 0.01 FDR:    48; 0.001 FDR:    48
1:49:49.244709 PROGRESS: =========================================================================
1:49:49.245588 PROGRESS: === Epoch 8, step 3, extracting elution groups 7000 to 15000 ===
1:49:49.337111 PROGRESS: Extracting batch of 15803 precursors
1:49:49.342625 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:49:49.342695 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:49:49.342732 INFO: FWHM in RT is 14.52 seconds, sigma is 0.53
1:49:49.342762 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:49:49.342981 INFO: Starting candidate selection
1:49:55.215006 INFO: Starting candidate scoring
1:49:56.633918 INFO: Finished candidate processing
1:49:56.634010 INFO: Collecting candidate features
1:49:58.856429 WARNING: intensity_correlation has 19 NaNs ( 0.13 % out of 14974)
1:49:58.862455 INFO: Collecting fragment features
1:49:59.499408 INFO: Finished candidate scoring
1:49:59.796344 PROGRESS: === Epoch 8, step 3, extracted 14974 precursors and 75899 fragments ===
1:49:59.796716 INFO: performing precursor FDR with 47 features
1:49:59.796764 INFO: Decoy channel: -1
1:49:59.796792 INFO: Competetive: True
1:49:59.825531 WARNING: dropped 17 target PSMs due to missing features
1:49:59.825648 WARNING: dropped 12 decoy PSMs due to missing features
1:50:00.491038 INFO: Test AUC: 0.536
1:50:00.491215 INFO: Train AUC: 0.599
1:50:00.491275 INFO: AUC difference: 10.54%
1:50:00.491317 WARNING: AUC difference > 5%. This may indicate overfitting.
1:50:00.618508 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
1:50:00.619445 PROGRESS: ============================= Precursor FDR =============================
1:50:00.619580 PROGRESS: Total precursors accumulated: 233
1:50:00.619669 PROGRESS: Target precursors: 212 (90.99%)
1:50:00.619754 PROGRESS: Decoy precursors: 21 (9.01%)
1:50:00.619844 PROGRESS: 
1:50:00.619931 PROGRESS: Precursor Summary:
1:50:00.622012 PROGRESS: Channel   0:	 0.05 FDR:   152; 0.01 FDR:   132; 0.001 FDR:    87
1:50:00.622148 PROGRESS: 
1:50:00.622246 PROGRESS: Protein Summary:
1:50:00.624605 PROGRESS: Channel   0:	 0.05 FDR:   148; 0.01 FDR:   128; 0.001 FDR:    84
1:50:00.624735 PROGRESS: =========================================================================
1:50:00.625939 PROGRESS: === Epoch 8, step 4, extracting elution groups 15000 to 31000 ===
1:50:00.733184 PROGRESS: Extracting batch of 31617 precursors
1:50:00.743757 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:50:00.743862 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:50:00.743906 INFO: FWHM in RT is 14.52 seconds, sigma is 0.53
1:50:00.743937 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:50:00.744205 INFO: Starting candidate selection
1:50:05.132572 INFO: Starting candidate scoring
1:50:06.722208 INFO: Finished candidate processing
1:50:06.722299 INFO: Collecting candidate features
1:50:08.972235 WARNING: intensity_correlation has 45 NaNs ( 0.15 % out of 29910)
1:50:08.979132 INFO: Collecting fragment features
1:50:09.646685 INFO: Finished candidate scoring
1:50:09.961038 PROGRESS: === Epoch 8, step 4, extracted 29910 precursors and 151813 fragments ===
1:50:09.961396 INFO: performing precursor FDR with 47 features
1:50:09.961446 INFO: Decoy channel: -1
1:50:09.961471 INFO: Competetive: True
1:50:10.019808 WARNING: dropped 39 target PSMs due to missing features
1:50:10.019917 WARNING: dropped 35 decoy PSMs due to missing features
1:50:12.057551 INFO: Test AUC: 0.553
1:50:12.057706 INFO: Train AUC: 0.601
1:50:12.057755 INFO: AUC difference: 8.03%
1:50:12.057798 WARNING: AUC difference > 5%. This may indicate overfitting.
1:50:12.182682 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
1:50:12.183817 PROGRESS: ============================= Precursor FDR =============================
1:50:12.183950 PROGRESS: Total precursors accumulated: 705
1:50:12.184041 PROGRESS: Target precursors: 643 (91.21%)
1:50:12.184110 PROGRESS: Decoy precursors: 62 (8.79%)
1:50:12.184172 PROGRESS: 
1:50:12.184233 PROGRESS: Precursor Summary:
1:50:12.185985 PROGRESS: Channel   0:	 0.05 FDR:   446; 0.01 FDR:   271; 0.001 FDR:   223
1:50:12.186110 PROGRESS: 
1:50:12.186185 PROGRESS: Protein Summary:
1:50:12.188254 PROGRESS: Channel   0:	 0.05 FDR:   428; 0.01 FDR:   259; 0.001 FDR:   213
1:50:12.188365 PROGRESS: =========================================================================
1:50:12.189416 PROGRESS: === Epoch 8, step 5, extracting elution groups 31000 to 63000 ===
1:50:12.331390 PROGRESS: Extracting batch of 63228 precursors
1:50:12.351346 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:50:12.351453 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:50:12.351509 INFO: FWHM in RT is 14.52 seconds, sigma is 0.53
1:50:12.351542 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:50:12.351837 INFO: Starting candidate selection
1:50:17.413886 INFO: Starting candidate scoring
1:50:19.302889 INFO: Finished candidate processing
1:50:19.302990 INFO: Collecting candidate features
1:50:21.653914 WARNING: intensity_correlation has 72 NaNs ( 0.12 % out of 59854)
1:50:21.662797 INFO: Collecting fragment features
1:50:22.347489 INFO: Finished candidate scoring
1:50:22.697322 PROGRESS: === Epoch 8, step 5, extracted 59854 precursors and 303383 fragments ===
1:50:22.697691 INFO: performing precursor FDR with 47 features
1:50:22.697741 INFO: Decoy channel: -1
1:50:22.697777 INFO: Competetive: True
1:50:22.830112 WARNING: dropped 84 target PSMs due to missing features
1:50:22.830245 WARNING: dropped 62 decoy PSMs due to missing features
1:50:26.819802 INFO: Test AUC: 0.554
1:50:26.819922 INFO: Train AUC: 0.595
1:50:26.819977 INFO: AUC difference: 6.84%
1:50:26.820006 WARNING: AUC difference > 5%. This may indicate overfitting.
1:50:26.952960 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
1:50:26.954350 PROGRESS: ============================= Precursor FDR =============================
1:50:26.954487 PROGRESS: Total precursors accumulated: 1,326
1:50:26.954566 PROGRESS: Target precursors: 1,210 (91.25%)
1:50:26.954634 PROGRESS: Decoy precursors: 116 (8.75%)
1:50:26.954697 PROGRESS: 
1:50:26.954757 PROGRESS: Precursor Summary:
1:50:26.956748 PROGRESS: Channel   0:	 0.05 FDR:   833; 0.01 FDR:   479; 0.001 FDR:   349
1:50:26.956890 PROGRESS: 
1:50:26.956966 PROGRESS: Protein Summary:
1:50:26.959345 PROGRESS: Channel   0:	 0.05 FDR:   770; 0.01 FDR:   439; 0.001 FDR:   325
1:50:26.959472 PROGRESS: =========================================================================
1:50:26.960651 PROGRESS: === Epoch 8, step 6, extracting elution groups 63000 to 127000 ===
1:50:27.139089 PROGRESS: Extracting batch of 126440 precursors
1:50:27.177572 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:50:27.177687 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:50:27.177724 INFO: FWHM in RT is 14.52 seconds, sigma is 0.53
1:50:27.177766 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:50:27.178053 INFO: Starting candidate selection
1:50:33.655921 INFO: Starting candidate scoring
1:50:36.147147 INFO: Finished candidate processing
1:50:36.147245 INFO: Collecting candidate features
1:50:38.714775 WARNING: intensity_correlation has 131 NaNs ( 0.11 % out of 119718)
1:50:38.727816 INFO: Collecting fragment features
1:50:39.501827 INFO: Finished candidate scoring
1:50:39.932951 PROGRESS: === Epoch 8, step 6, extracted 119718 precursors and 604999 fragments ===
1:50:39.933307 INFO: performing precursor FDR with 47 features
1:50:39.933352 INFO: Decoy channel: -1
1:50:39.933379 INFO: Competetive: True
1:50:40.211012 WARNING: dropped 151 target PSMs due to missing features
1:50:40.211127 WARNING: dropped 126 decoy PSMs due to missing features
1:50:48.449555 INFO: Test AUC: 0.551
1:50:48.449684 INFO: Train AUC: 0.587
1:50:48.449739 INFO: AUC difference: 6.18%
1:50:48.449777 WARNING: AUC difference > 5%. This may indicate overfitting.
1:50:48.607320 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
1:50:48.608976 PROGRESS: ============================= Precursor FDR =============================
1:50:48.609124 PROGRESS: Total precursors accumulated: 2,220
1:50:48.609203 PROGRESS: Target precursors: 2,021 (91.04%)
1:50:48.609272 PROGRESS: Decoy precursors: 199 (8.96%)
1:50:48.609335 PROGRESS: 
1:50:48.609397 PROGRESS: Precursor Summary:
1:50:48.611758 PROGRESS: Channel   0:	 0.05 FDR: 1,541; 0.01 FDR: 1,041; 0.001 FDR:   679
1:50:48.611906 PROGRESS: 
1:50:48.611980 PROGRESS: Protein Summary:
1:50:48.614979 PROGRESS: Channel   0:	 0.05 FDR: 1,356; 0.01 FDR:   900; 0.001 FDR:   599
1:50:48.615112 PROGRESS: =========================================================================
1:50:48.616614 PROGRESS: === Epoch 8, step 7, extracting elution groups 127000 to 255000 ===
1:50:48.842249 PROGRESS: Extracting batch of 252874 precursors
1:50:48.915310 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:50:48.915445 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:50:48.915485 INFO: FWHM in RT is 14.52 seconds, sigma is 0.53
1:50:48.915513 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:50:48.915791 INFO: Starting candidate selection
1:50:58.274452 INFO: Starting candidate scoring
1:51:02.047784 INFO: Finished candidate processing
1:51:02.047978 INFO: Collecting candidate features
1:51:04.995354 WARNING: intensity_correlation has 279 NaNs ( 0.12 % out of 239162)
1:51:05.015959 INFO: Collecting fragment features
1:51:05.885313 INFO: Finished candidate scoring
1:51:06.466638 PROGRESS: === Epoch 8, step 7, extracted 239162 precursors and 1210131 fragments ===
1:51:06.466989 INFO: performing precursor FDR with 47 features
1:51:06.467036 INFO: Decoy channel: -1
1:51:06.467063 INFO: Competetive: True
1:51:07.065559 WARNING: dropped 306 target PSMs due to missing features
1:51:07.065687 WARNING: dropped 250 decoy PSMs due to missing features
1:51:24.391837 INFO: Test AUC: 0.548
1:51:24.391975 INFO: Train AUC: 0.577
1:51:24.392015 INFO: AUC difference: 4.96%
1:51:24.590515 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
1:51:24.592754 PROGRESS: ============================= Precursor FDR =============================
1:51:24.592938 PROGRESS: Total precursors accumulated: 4,117
1:51:24.593016 PROGRESS: Target precursors: 3,751 (91.11%)
1:51:24.593081 PROGRESS: Decoy precursors: 366 (8.89%)
1:51:24.593141 PROGRESS: 
1:51:24.593213 PROGRESS: Precursor Summary:
1:51:24.596089 PROGRESS: Channel   0:	 0.05 FDR: 2,892; 0.01 FDR: 2,016; 0.001 FDR:   310
1:51:24.596243 PROGRESS: 
1:51:24.596318 PROGRESS: Protein Summary:
1:51:24.599982 PROGRESS: Channel   0:	 0.05 FDR: 2,239; 0.01 FDR: 1,542; 0.001 FDR:   288
1:51:24.600118 PROGRESS: =========================================================================
1:51:24.603479 INFO: calibration group: precursor, fitting rt estimator 
1:51:24.839719 INFO: calibration group: fragment, fitting mz estimator 
1:51:25.435696 INFO: === checking if epoch conditions were reached ===
1:51:25.435894 INFO: ✅ ms2_error      : 7.0000 <= 7
1:51:25.435982 INFO: ❌ rt_error       : 237.6473 > 100
1:51:25.436053 INFO: ✅ current_epoch  : 8 >= 3
1:51:25.436118 INFO: ==============================================
1:51:25.654836 INFO: calibration group: precursor, predicting mz
1:51:25.655117 WARNING: mz prediction was skipped as it has not been fitted yet
1:51:25.655159 INFO: calibration group: precursor, predicting rt
1:51:32.506561 INFO: calibration group: fragment, predicting mz
1:51:50.464203 PROGRESS: === Epoch 9, step 0, extracting elution groups 0 to 1000 ===
1:51:50.551547 PROGRESS: Extracting batch of 1971 precursors
1:51:50.553343 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:51:50.553417 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:51:50.553457 INFO: FWHM in RT is 14.50 seconds, sigma is 0.53
1:51:50.553503 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:51:50.553751 INFO: Starting candidate selection
1:51:54.674354 INFO: Starting candidate scoring
1:51:55.987070 INFO: Finished candidate processing
1:51:55.987184 INFO: Collecting candidate features
1:51:58.171277 WARNING: intensity_correlation has 4 NaNs ( 0.22 % out of 1837)
1:51:58.177369 INFO: Collecting fragment features
1:51:58.825201 INFO: Finished candidate scoring
1:51:59.142538 PROGRESS: === Epoch 9, step 0, extracted 1837 precursors and 9239 fragments ===
1:51:59.142858 INFO: performing precursor FDR with 47 features
1:51:59.142901 INFO: Decoy channel: -1
1:51:59.142928 INFO: Competetive: True
1:51:59.147853 WARNING: dropped 2 target PSMs due to missing features
1:51:59.147923 WARNING: dropped 2 decoy PSMs due to missing features
1:51:59.176006 INFO: Test AUC: 0.580
1:51:59.176101 INFO: Train AUC: 0.548
1:51:59.176144 INFO: AUC difference: 5.91%
1:51:59.176178 WARNING: AUC difference > 5%. This may indicate overfitting.
1:51:59.298126 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
1:51:59.298893 PROGRESS: ============================= Precursor FDR =============================
1:51:59.299014 PROGRESS: Total precursors accumulated: 12
1:51:59.299092 PROGRESS: Target precursors: 11 (91.67%)
1:51:59.299162 PROGRESS: Decoy precursors: 1 (8.33%)
1:51:59.299224 PROGRESS: 
1:51:59.299285 PROGRESS: Precursor Summary:
1:51:59.300682 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
1:51:59.300797 PROGRESS: 
1:51:59.300869 PROGRESS: Protein Summary:
1:51:59.302474 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
1:51:59.302589 PROGRESS: =========================================================================
1:51:59.303433 PROGRESS: === Epoch 9, step 1, extracting elution groups 1000 to 3000 ===
1:51:59.381192 PROGRESS: Extracting batch of 3952 precursors
1:51:59.383520 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:51:59.383582 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:51:59.383620 INFO: FWHM in RT is 14.50 seconds, sigma is 0.53
1:51:59.383666 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:51:59.383905 INFO: Starting candidate selection
1:52:03.133941 INFO: Starting candidate scoring
1:52:04.444541 INFO: Finished candidate processing
1:52:04.444634 INFO: Collecting candidate features
1:52:06.632727 WARNING: intensity_correlation has 3 NaNs ( 0.08 % out of 3723)
1:52:06.639384 INFO: Collecting fragment features
1:52:07.287196 INFO: Finished candidate scoring
1:52:07.570139 PROGRESS: === Epoch 9, step 1, extracted 3723 precursors and 18720 fragments ===
1:52:07.570426 INFO: performing precursor FDR with 47 features
1:52:07.570471 INFO: Decoy channel: -1
1:52:07.570498 INFO: Competetive: True
1:52:07.579393 WARNING: dropped 3 target PSMs due to missing features
1:52:07.579484 WARNING: dropped 4 decoy PSMs due to missing features
1:52:07.617319 INFO: Test AUC: 0.535
1:52:07.617441 INFO: Train AUC: 0.558
1:52:07.617487 INFO: AUC difference: 4.19%
1:52:07.742367 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
1:52:07.743148 PROGRESS: ============================= Precursor FDR =============================
1:52:07.743273 PROGRESS: Total precursors accumulated: 36
1:52:07.743351 PROGRESS: Target precursors: 33 (91.67%)
1:52:07.743419 PROGRESS: Decoy precursors: 3 (8.33%)
1:52:07.743482 PROGRESS: 
1:52:07.743543 PROGRESS: Precursor Summary:
1:52:07.744969 PROGRESS: Channel   0:	 0.05 FDR:    16; 0.01 FDR:    16; 0.001 FDR:    16
1:52:07.745082 PROGRESS: 
1:52:07.745156 PROGRESS: Protein Summary:
1:52:07.746778 PROGRESS: Channel   0:	 0.05 FDR:    15; 0.01 FDR:    15; 0.001 FDR:    15
1:52:07.746892 PROGRESS: =========================================================================
1:52:07.747769 PROGRESS: === Epoch 9, step 2, extracting elution groups 3000 to 7000 ===
1:52:07.830315 PROGRESS: Extracting batch of 7891 precursors
1:52:07.833756 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:52:07.833866 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:52:07.833909 INFO: FWHM in RT is 14.50 seconds, sigma is 0.53
1:52:07.833940 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:52:07.834166 INFO: Starting candidate selection
1:52:11.680944 INFO: Starting candidate scoring
1:52:13.027995 INFO: Finished candidate processing
1:52:13.028088 INFO: Collecting candidate features
1:52:15.230748 WARNING: intensity_correlation has 13 NaNs ( 0.18 % out of 7403)
1:52:15.236545 INFO: Collecting fragment features
1:52:15.890491 INFO: Finished candidate scoring
1:52:16.178327 PROGRESS: === Epoch 9, step 2, extracted 7403 precursors and 37496 fragments ===
1:52:16.178660 INFO: performing precursor FDR with 47 features
1:52:16.178705 INFO: Decoy channel: -1
1:52:16.178732 INFO: Competetive: True
1:52:16.194053 WARNING: dropped 11 target PSMs due to missing features
1:52:16.194167 WARNING: dropped 9 decoy PSMs due to missing features
1:52:16.640250 INFO: Test AUC: 0.539
1:52:16.640379 INFO: Train AUC: 0.583
1:52:16.640424 INFO: AUC difference: 7.54%
1:52:16.640460 WARNING: AUC difference > 5%. This may indicate overfitting.
1:52:16.761541 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
1:52:16.762406 PROGRESS: ============================= Precursor FDR =============================
1:52:16.762531 PROGRESS: Total precursors accumulated: 73
1:52:16.762611 PROGRESS: Target precursors: 67 (91.78%)
1:52:16.762694 PROGRESS: Decoy precursors: 6 (8.22%)
1:52:16.762760 PROGRESS: 
1:52:16.762821 PROGRESS: Precursor Summary:
1:52:16.764298 PROGRESS: Channel   0:	 0.05 FDR:    61; 0.01 FDR:    29; 0.001 FDR:    29
1:52:16.764427 PROGRESS: 
1:52:16.764500 PROGRESS: Protein Summary:
1:52:16.766174 PROGRESS: Channel   0:	 0.05 FDR:    60; 0.01 FDR:    28; 0.001 FDR:    28
1:52:16.766287 PROGRESS: =========================================================================
1:52:16.767156 PROGRESS: === Epoch 9, step 3, extracting elution groups 7000 to 15000 ===
1:52:16.858602 PROGRESS: Extracting batch of 15801 precursors
1:52:16.864284 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:52:16.864354 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:52:16.864388 INFO: FWHM in RT is 14.50 seconds, sigma is 0.53
1:52:16.864429 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:52:16.864651 INFO: Starting candidate selection
1:52:20.897479 INFO: Starting candidate scoring
1:52:22.318243 INFO: Finished candidate processing
1:52:22.318335 INFO: Collecting candidate features
1:52:24.518632 WARNING: intensity_correlation has 17 NaNs ( 0.11 % out of 14890)
1:52:24.524779 INFO: Collecting fragment features
1:52:25.181301 INFO: Finished candidate scoring
1:52:25.477689 PROGRESS: === Epoch 9, step 3, extracted 14890 precursors and 75803 fragments ===
1:52:25.478020 INFO: performing precursor FDR with 47 features
1:52:25.478068 INFO: Decoy channel: -1
1:52:25.478094 INFO: Competetive: True
1:52:25.507430 WARNING: dropped 21 target PSMs due to missing features
1:52:25.507559 WARNING: dropped 16 decoy PSMs due to missing features
1:52:26.298374 INFO: Test AUC: 0.553
1:52:26.298517 INFO: Train AUC: 0.591
1:52:26.298563 INFO: AUC difference: 6.56%
1:52:26.298596 WARNING: AUC difference > 5%. This may indicate overfitting.
1:52:26.442381 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
1:52:26.443348 PROGRESS: ============================= Precursor FDR =============================
1:52:26.443484 PROGRESS: Total precursors accumulated: 226
1:52:26.443594 PROGRESS: Target precursors: 206 (91.15%)
1:52:26.443686 PROGRESS: Decoy precursors: 20 (8.85%)
1:52:26.443773 PROGRESS: 
1:52:26.443859 PROGRESS: Precursor Summary:
1:52:26.445431 PROGRESS: Channel   0:	 0.05 FDR:   138; 0.01 FDR:   120; 0.001 FDR:   100
1:52:26.445545 PROGRESS: 
1:52:26.445637 PROGRESS: Protein Summary:
1:52:26.448019 PROGRESS: Channel   0:	 0.05 FDR:   136; 0.01 FDR:   118; 0.001 FDR:    98
1:52:26.448163 PROGRESS: =========================================================================
1:52:26.449136 PROGRESS: === Epoch 9, step 4, extracting elution groups 15000 to 31000 ===
1:52:26.558045 PROGRESS: Extracting batch of 31617 precursors
1:52:26.568697 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:52:26.568810 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:52:26.568851 INFO: FWHM in RT is 14.50 seconds, sigma is 0.53
1:52:26.568878 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:52:26.569159 INFO: Starting candidate selection
1:52:30.950189 INFO: Starting candidate scoring
1:52:32.524120 INFO: Finished candidate processing
1:52:32.524218 INFO: Collecting candidate features
1:52:34.774080 WARNING: intensity_correlation has 36 NaNs ( 0.12 % out of 29994)
1:52:34.781139 INFO: Collecting fragment features
1:52:35.457049 INFO: Finished candidate scoring
1:52:35.768826 PROGRESS: === Epoch 9, step 4, extracted 29994 precursors and 151084 fragments ===
1:52:35.769163 INFO: performing precursor FDR with 47 features
1:52:35.769211 INFO: Decoy channel: -1
1:52:35.769238 INFO: Competetive: True
1:52:35.827834 WARNING: dropped 40 target PSMs due to missing features
1:52:35.827962 WARNING: dropped 33 decoy PSMs due to missing features
1:52:37.708441 INFO: Test AUC: 0.546
1:52:37.708596 INFO: Train AUC: 0.603
1:52:37.708643 INFO: AUC difference: 9.49%
1:52:37.708679 WARNING: AUC difference > 5%. This may indicate overfitting.
1:52:37.837363 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
1:52:37.838497 PROGRESS: ============================= Precursor FDR =============================
1:52:37.838629 PROGRESS: Total precursors accumulated: 675
1:52:37.838712 PROGRESS: Target precursors: 614 (90.96%)
1:52:37.838784 PROGRESS: Decoy precursors: 61 (9.04%)
1:52:37.838851 PROGRESS: 
1:52:37.838915 PROGRESS: Precursor Summary:
1:52:37.840612 PROGRESS: Channel   0:	 0.05 FDR:   333; 0.01 FDR:   227; 0.001 FDR:   216
1:52:37.840750 PROGRESS: 
1:52:37.840824 PROGRESS: Protein Summary:
1:52:37.842804 PROGRESS: Channel   0:	 0.05 FDR:   319; 0.01 FDR:   216; 0.001 FDR:   205
1:52:37.842920 PROGRESS: =========================================================================
1:52:37.843940 PROGRESS: === Epoch 9, step 5, extracting elution groups 31000 to 63000 ===
1:52:37.981641 PROGRESS: Extracting batch of 63251 precursors
1:52:38.001845 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:52:38.001972 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:52:38.002015 INFO: FWHM in RT is 14.50 seconds, sigma is 0.53
1:52:38.002057 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:52:38.002315 INFO: Starting candidate selection
1:52:43.100338 INFO: Starting candidate scoring
1:52:44.999509 INFO: Finished candidate processing
1:52:44.999691 INFO: Collecting candidate features
1:52:47.356069 WARNING: intensity_correlation has 84 NaNs ( 0.14 % out of 59760)
1:52:47.365246 INFO: Collecting fragment features
1:52:48.073748 INFO: Finished candidate scoring
1:52:48.423927 PROGRESS: === Epoch 9, step 5, extracted 59760 precursors and 302522 fragments ===
1:52:48.424292 INFO: performing precursor FDR with 47 features
1:52:48.424341 INFO: Decoy channel: -1
1:52:48.424368 INFO: Competetive: True
1:52:48.555778 WARNING: dropped 80 target PSMs due to missing features
1:52:48.555893 WARNING: dropped 77 decoy PSMs due to missing features
1:52:52.448742 INFO: Test AUC: 0.557
1:52:52.448862 INFO: Train AUC: 0.595
1:52:52.448917 INFO: AUC difference: 6.47%
1:52:52.448945 WARNING: AUC difference > 5%. This may indicate overfitting.
1:52:52.612896 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
1:52:52.614281 PROGRESS: ============================= Precursor FDR =============================
1:52:52.614411 PROGRESS: Total precursors accumulated: 1,475
1:52:52.614488 PROGRESS: Target precursors: 1,343 (91.05%)
1:52:52.614556 PROGRESS: Decoy precursors: 132 (8.95%)
1:52:52.614621 PROGRESS: 
1:52:52.614683 PROGRESS: Precursor Summary:
1:52:52.616630 PROGRESS: Channel   0:	 0.05 FDR:   931; 0.01 FDR:   525; 0.001 FDR:   409
1:52:52.616764 PROGRESS: 
1:52:52.616838 PROGRESS: Protein Summary:
1:52:52.619215 PROGRESS: Channel   0:	 0.05 FDR:   881; 0.01 FDR:   499; 0.001 FDR:   394
1:52:52.619347 PROGRESS: =========================================================================
1:52:52.620523 PROGRESS: === Epoch 9, step 6, extracting elution groups 63000 to 127000 ===
1:52:52.796233 PROGRESS: Extracting batch of 126434 precursors
1:52:52.834441 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:52:52.834570 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:52:52.834610 INFO: FWHM in RT is 14.50 seconds, sigma is 0.53
1:52:52.834638 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:52:52.834922 INFO: Starting candidate selection
1:52:59.323474 INFO: Starting candidate scoring
1:53:01.817340 INFO: Finished candidate processing
1:53:01.817473 INFO: Collecting candidate features
1:53:04.338805 WARNING: intensity_correlation has 124 NaNs ( 0.10 % out of 119391)
1:53:04.353586 INFO: Collecting fragment features
1:53:05.116641 INFO: Finished candidate scoring
1:53:05.542935 PROGRESS: === Epoch 9, step 6, extracted 119391 precursors and 606326 fragments ===
1:53:05.543260 INFO: performing precursor FDR with 47 features
1:53:05.543320 INFO: Decoy channel: -1
1:53:05.543348 INFO: Competetive: True
1:53:05.816459 WARNING: dropped 155 target PSMs due to missing features
1:53:05.816576 WARNING: dropped 126 decoy PSMs due to missing features
1:53:14.163533 INFO: Test AUC: 0.556
1:53:14.163659 INFO: Train AUC: 0.584
1:53:14.163715 INFO: AUC difference: 4.77%
1:53:14.318470 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
1:53:14.320253 PROGRESS: ============================= Precursor FDR =============================
1:53:14.320390 PROGRESS: Total precursors accumulated: 2,688
1:53:14.320468 PROGRESS: Target precursors: 2,447 (91.03%)
1:53:14.320535 PROGRESS: Decoy precursors: 241 (8.97%)
1:53:14.320608 PROGRESS: 
1:53:14.320673 PROGRESS: Precursor Summary:
1:53:14.322967 PROGRESS: Channel   0:	 0.05 FDR: 1,670; 0.01 FDR:   972; 0.001 FDR:   853
1:53:14.323096 PROGRESS: 
1:53:14.323170 PROGRESS: Protein Summary:
1:53:14.326122 PROGRESS: Channel   0:	 0.05 FDR: 1,489; 0.01 FDR:   856; 0.001 FDR:   747
1:53:14.326242 PROGRESS: =========================================================================
1:53:14.327660 PROGRESS: === Epoch 9, step 7, extracting elution groups 127000 to 255000 ===
1:53:14.551666 PROGRESS: Extracting batch of 252967 precursors
1:53:14.624172 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:53:14.624286 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:53:14.624324 INFO: FWHM in RT is 14.50 seconds, sigma is 0.53
1:53:14.624368 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:53:14.624634 INFO: Starting candidate selection
1:53:24.018631 INFO: Starting candidate scoring
1:53:27.821537 INFO: Finished candidate processing
1:53:27.821723 INFO: Collecting candidate features
1:53:30.778218 WARNING: intensity_correlation has 294 NaNs ( 0.12 % out of 239022)
1:53:30.799004 INFO: Collecting fragment features
1:53:31.673949 INFO: Finished candidate scoring
1:53:32.256459 PROGRESS: === Epoch 9, step 7, extracted 239022 precursors and 1210310 fragments ===
1:53:32.256813 INFO: performing precursor FDR with 47 features
1:53:32.256856 INFO: Decoy channel: -1
1:53:32.256881 INFO: Competetive: True
1:53:32.853699 WARNING: dropped 305 target PSMs due to missing features
1:53:32.853845 WARNING: dropped 270 decoy PSMs due to missing features
1:53:50.178266 INFO: Test AUC: 0.552
1:53:50.178410 INFO: Train AUC: 0.575
1:53:50.178450 INFO: AUC difference: 4.00%
1:53:50.386692 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
1:53:50.389007 PROGRESS: ============================= Precursor FDR =============================
1:53:50.389157 PROGRESS: Total precursors accumulated: 4,473
1:53:50.389234 PROGRESS: Target precursors: 4,077 (91.15%)
1:53:50.389316 PROGRESS: Decoy precursors: 396 (8.85%)
1:53:50.389384 PROGRESS: 
1:53:50.389447 PROGRESS: Precursor Summary:
1:53:50.392421 PROGRESS: Channel   0:	 0.05 FDR: 3,131; 0.01 FDR: 2,126; 0.001 FDR: 1,651
1:53:50.392563 PROGRESS: 
1:53:50.392635 PROGRESS: Protein Summary:
1:53:50.396734 PROGRESS: Channel   0:	 0.05 FDR: 2,489; 0.01 FDR: 1,659; 0.001 FDR: 1,299
1:53:50.396876 PROGRESS: =========================================================================
1:53:50.400366 INFO: calibration group: precursor, fitting rt estimator 
1:53:50.667413 INFO: calibration group: fragment, fitting mz estimator 
1:53:51.254790 INFO: === checking if epoch conditions were reached ===
1:53:51.254994 INFO: ✅ ms2_error      : 7.0000 <= 7
1:53:51.255083 INFO: ❌ rt_error       : 237.7454 > 100
1:53:51.255158 INFO: ✅ current_epoch  : 9 >= 3
1:53:51.255222 INFO: ==============================================
1:53:51.475865 INFO: calibration group: precursor, predicting mz
1:53:51.476154 WARNING: mz prediction was skipped as it has not been fitted yet
1:53:51.476200 INFO: calibration group: precursor, predicting rt
1:53:58.214782 INFO: calibration group: fragment, predicting mz
1:54:16.021951 PROGRESS: === Epoch 10, step 0, extracting elution groups 0 to 1000 ===
1:54:16.108967 PROGRESS: Extracting batch of 1980 precursors
1:54:16.110726 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:54:16.110819 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:54:16.110898 INFO: FWHM in RT is 14.24 seconds, sigma is 0.52
1:54:16.110927 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:54:16.111153 INFO: Starting candidate selection
1:54:20.173902 INFO: Starting candidate scoring
1:54:21.457624 INFO: Finished candidate processing
1:54:21.457715 INFO: Collecting candidate features
1:54:23.645131 INFO: Collecting fragment features
1:54:24.286975 INFO: Finished candidate scoring
1:54:24.604076 PROGRESS: === Epoch 10, step 0, extracted 1872 precursors and 9258 fragments ===
1:54:24.604402 INFO: performing precursor FDR with 47 features
1:54:24.604446 INFO: Decoy channel: -1
1:54:24.604473 INFO: Competetive: True
1:54:24.636583 INFO: Test AUC: 0.607
1:54:24.636689 INFO: Train AUC: 0.537
1:54:24.636734 INFO: AUC difference: 12.89%
1:54:24.636768 WARNING: AUC difference > 5%. This may indicate overfitting.
1:54:24.758812 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
1:54:24.759667 PROGRESS: ============================= Precursor FDR =============================
1:54:24.759800 PROGRESS: Total precursors accumulated: 7
1:54:24.759880 PROGRESS: Target precursors: 7 (100.00%)
1:54:24.759948 PROGRESS: Decoy precursors: 0 (0.00%)
1:54:24.760013 PROGRESS: 
1:54:24.760082 PROGRESS: Precursor Summary:
1:54:24.761589 PROGRESS: Channel   0:	 0.05 FDR:     7; 0.01 FDR:     7; 0.001 FDR:     7
1:54:24.761701 PROGRESS: 
1:54:24.761785 PROGRESS: Protein Summary:
1:54:24.763491 PROGRESS: Channel   0:	 0.05 FDR:     7; 0.01 FDR:     7; 0.001 FDR:     7
1:54:24.763629 PROGRESS: =========================================================================
1:54:24.764521 PROGRESS: === Epoch 10, step 1, extracting elution groups 1000 to 3000 ===
1:54:24.841914 PROGRESS: Extracting batch of 3960 precursors
1:54:24.844112 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:54:24.844172 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:54:24.844211 INFO: FWHM in RT is 14.24 seconds, sigma is 0.52
1:54:24.844258 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:54:24.844475 INFO: Starting candidate selection
1:54:28.597259 INFO: Starting candidate scoring
1:54:29.909292 INFO: Finished candidate processing
1:54:29.909381 INFO: Collecting candidate features
1:54:32.071893 WARNING: intensity_correlation has 1 NaNs ( 0.03 % out of 3755)
1:54:32.079150 INFO: Collecting fragment features
1:54:32.694021 INFO: Finished candidate scoring
1:54:32.972485 PROGRESS: === Epoch 10, step 1, extracted 3755 precursors and 18928 fragments ===
1:54:32.972763 INFO: performing precursor FDR with 47 features
1:54:32.972808 INFO: Decoy channel: -1
1:54:32.972833 INFO: Competetive: True
1:54:32.981088 WARNING: dropped 1 target PSMs due to missing features
1:54:33.018671 INFO: Test AUC: 0.541
1:54:33.018789 INFO: Train AUC: 0.546
1:54:33.018835 INFO: AUC difference: 0.98%
1:54:33.151632 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
1:54:33.152434 PROGRESS: ============================= Precursor FDR =============================
1:54:33.152559 PROGRESS: Total precursors accumulated: 24
1:54:33.152637 PROGRESS: Target precursors: 22 (91.67%)
1:54:33.152705 PROGRESS: Decoy precursors: 2 (8.33%)
1:54:33.152768 PROGRESS: 
1:54:33.152829 PROGRESS: Precursor Summary:
1:54:33.154250 PROGRESS: Channel   0:	 0.05 FDR:    19; 0.01 FDR:    19; 0.001 FDR:    19
1:54:33.154365 PROGRESS: 
1:54:33.154439 PROGRESS: Protein Summary:
1:54:33.156046 PROGRESS: Channel   0:	 0.05 FDR:    19; 0.01 FDR:    19; 0.001 FDR:    19
1:54:33.156173 PROGRESS: =========================================================================
1:54:33.157034 PROGRESS: === Epoch 10, step 2, extracting elution groups 3000 to 7000 ===
1:54:33.240314 PROGRESS: Extracting batch of 7915 precursors
1:54:33.243686 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:54:33.243752 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:54:33.243792 INFO: FWHM in RT is 14.24 seconds, sigma is 0.52
1:54:33.243835 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:54:33.244060 INFO: Starting candidate selection
1:54:37.073021 INFO: Starting candidate scoring
1:54:38.414993 INFO: Finished candidate processing
1:54:38.415164 INFO: Collecting candidate features
1:54:40.618928 WARNING: intensity_correlation has 5 NaNs ( 0.07 % out of 7474)
1:54:40.624663 INFO: Collecting fragment features
1:54:41.257580 INFO: Finished candidate scoring
1:54:41.545519 PROGRESS: === Epoch 10, step 2, extracted 7474 precursors and 37896 fragments ===
1:54:41.545848 INFO: performing precursor FDR with 47 features
1:54:41.545897 INFO: Decoy channel: -1
1:54:41.545926 INFO: Competetive: True
1:54:41.561213 WARNING: dropped 5 target PSMs due to missing features
1:54:41.561313 WARNING: dropped 1 decoy PSMs due to missing features
1:54:41.785646 INFO: Test AUC: 0.545
1:54:41.785790 INFO: Train AUC: 0.568
1:54:41.785859 INFO: AUC difference: 4.07%
1:54:41.908086 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
1:54:41.908975 PROGRESS: ============================= Precursor FDR =============================
1:54:41.909134 PROGRESS: Total precursors accumulated: 151
1:54:41.909235 PROGRESS: Target precursors: 138 (91.39%)
1:54:41.909341 PROGRESS: Decoy precursors: 13 (8.61%)
1:54:41.909441 PROGRESS: 
1:54:41.909539 PROGRESS: Precursor Summary:
1:54:41.911080 PROGRESS: Channel   0:	 0.05 FDR:   125; 0.01 FDR:    57; 0.001 FDR:    57
1:54:41.911209 PROGRESS: 
1:54:41.911308 PROGRESS: Protein Summary:
1:54:41.913024 PROGRESS: Channel   0:	 0.05 FDR:   125; 0.01 FDR:    57; 0.001 FDR:    57
1:54:41.913153 PROGRESS: =========================================================================
1:54:41.914082 PROGRESS: === Epoch 10, step 3, extracting elution groups 7000 to 15000 ===
1:54:42.006039 PROGRESS: Extracting batch of 15815 precursors
1:54:42.011683 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:54:42.011753 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:54:42.011788 INFO: FWHM in RT is 14.24 seconds, sigma is 0.52
1:54:42.011831 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:54:42.012078 INFO: Starting candidate selection
1:54:46.058480 INFO: Starting candidate scoring
1:54:47.496736 INFO: Finished candidate processing
1:54:47.496829 INFO: Collecting candidate features
1:54:49.722587 WARNING: intensity_correlation has 12 NaNs ( 0.08 % out of 14936)
1:54:49.728776 INFO: Collecting fragment features
1:54:50.366479 INFO: Finished candidate scoring
1:54:50.663736 PROGRESS: === Epoch 10, step 3, extracted 14936 precursors and 75798 fragments ===
1:54:50.664104 INFO: performing precursor FDR with 47 features
1:54:50.664153 INFO: Decoy channel: -1
1:54:50.664180 INFO: Competetive: True
1:54:50.693868 WARNING: dropped 15 target PSMs due to missing features
1:54:50.693994 WARNING: dropped 3 decoy PSMs due to missing features
1:54:51.460757 INFO: Test AUC: 0.550
1:54:51.460904 INFO: Train AUC: 0.584
1:54:51.460951 INFO: AUC difference: 5.87%
1:54:51.460986 WARNING: AUC difference > 5%. This may indicate overfitting.
1:54:51.601084 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
1:54:51.602096 PROGRESS: ============================= Precursor FDR =============================
1:54:51.602224 PROGRESS: Total precursors accumulated: 369
1:54:51.602303 PROGRESS: Target precursors: 337 (91.33%)
1:54:51.602372 PROGRESS: Decoy precursors: 32 (8.67%)
1:54:51.602435 PROGRESS: 
1:54:51.602496 PROGRESS: Precursor Summary:
1:54:51.604069 PROGRESS: Channel   0:	 0.05 FDR:   241; 0.01 FDR:   122; 0.001 FDR:   115
1:54:51.604184 PROGRESS: 
1:54:51.604257 PROGRESS: Protein Summary:
1:54:51.606093 PROGRESS: Channel   0:	 0.05 FDR:   240; 0.01 FDR:   122; 0.001 FDR:   115
1:54:51.606207 PROGRESS: =========================================================================
1:54:51.607146 PROGRESS: === Epoch 10, step 4, extracting elution groups 15000 to 31000 ===
1:54:51.716052 PROGRESS: Extracting batch of 31611 precursors
1:54:51.726902 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:54:51.727022 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:54:51.727062 INFO: FWHM in RT is 14.24 seconds, sigma is 0.52
1:54:51.727089 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:54:51.727330 INFO: Starting candidate selection
1:54:56.113514 INFO: Starting candidate scoring
1:54:57.703623 INFO: Finished candidate processing
1:54:57.703717 INFO: Collecting candidate features
1:54:59.955746 WARNING: intensity_correlation has 18 NaNs ( 0.06 % out of 29709)
1:54:59.962788 INFO: Collecting fragment features
1:55:00.611080 INFO: Finished candidate scoring
1:55:00.921271 PROGRESS: === Epoch 10, step 4, extracted 29709 precursors and 150158 fragments ===
1:55:00.921618 INFO: performing precursor FDR with 47 features
1:55:00.921669 INFO: Decoy channel: -1
1:55:00.921699 INFO: Competetive: True
1:55:00.979733 WARNING: dropped 28 target PSMs due to missing features
1:55:00.979845 WARNING: dropped 8 decoy PSMs due to missing features
1:55:02.849522 INFO: Test AUC: 0.546
1:55:02.849676 INFO: Train AUC: 0.594
1:55:02.849757 INFO: AUC difference: 8.12%
1:55:02.849803 WARNING: AUC difference > 5%. This may indicate overfitting.
1:55:02.974734 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
1:55:02.975936 PROGRESS: ============================= Precursor FDR =============================
1:55:02.976064 PROGRESS: Total precursors accumulated: 1,053
1:55:02.976142 PROGRESS: Target precursors: 958 (90.98%)
1:55:02.976210 PROGRESS: Decoy precursors: 95 (9.02%)
1:55:02.976275 PROGRESS: 
1:55:02.976352 PROGRESS: Precursor Summary:
1:55:02.978094 PROGRESS: Channel   0:	 0.05 FDR:   484; 0.01 FDR:   266; 0.001 FDR:   244
1:55:02.978215 PROGRESS: 
1:55:02.978289 PROGRESS: Protein Summary:
1:55:02.980322 PROGRESS: Channel   0:	 0.05 FDR:   470; 0.01 FDR:   259; 0.001 FDR:   237
1:55:02.980434 PROGRESS: =========================================================================
1:55:02.981465 PROGRESS: === Epoch 10, step 5, extracting elution groups 31000 to 63000 ===
1:55:03.118924 PROGRESS: Extracting batch of 63229 precursors
1:55:03.138816 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:55:03.138952 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:55:03.138994 INFO: FWHM in RT is 14.24 seconds, sigma is 0.52
1:55:03.139022 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:55:03.139276 INFO: Starting candidate selection
1:55:08.247927 INFO: Starting candidate scoring
1:55:10.143534 INFO: Finished candidate processing
1:55:10.143626 INFO: Collecting candidate features
1:55:12.485861 WARNING: intensity_correlation has 51 NaNs ( 0.09 % out of 59615)
1:55:12.495651 INFO: Collecting fragment features
1:55:13.180795 INFO: Finished candidate scoring
1:55:13.528472 PROGRESS: === Epoch 10, step 5, extracted 59615 precursors and 300715 fragments ===
1:55:13.528811 INFO: performing precursor FDR with 47 features
1:55:13.528858 INFO: Decoy channel: -1
1:55:13.528884 INFO: Competetive: True
1:55:13.660989 WARNING: dropped 56 target PSMs due to missing features
1:55:13.661103 WARNING: dropped 31 decoy PSMs due to missing features
1:55:17.637154 INFO: Test AUC: 0.552
1:55:17.637270 INFO: Train AUC: 0.590
1:55:17.637328 INFO: AUC difference: 6.51%
1:55:17.637356 WARNING: AUC difference > 5%. This may indicate overfitting.
1:55:17.771830 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
1:55:17.773380 PROGRESS: ============================= Precursor FDR =============================
1:55:17.773525 PROGRESS: Total precursors accumulated: 2,035
1:55:17.773603 PROGRESS: Target precursors: 1,855 (91.15%)
1:55:17.773670 PROGRESS: Decoy precursors: 180 (8.85%)
1:55:17.773733 PROGRESS: 
1:55:17.773813 PROGRESS: Precursor Summary:
1:55:17.775792 PROGRESS: Channel   0:	 0.05 FDR: 1,079; 0.01 FDR:   511; 0.001 FDR:   413
1:55:17.775925 PROGRESS: 
1:55:17.775998 PROGRESS: Protein Summary:
1:55:17.778410 PROGRESS: Channel   0:	 0.05 FDR: 1,017; 0.01 FDR:   479; 0.001 FDR:   389
1:55:17.778523 PROGRESS: =========================================================================
1:55:17.779692 PROGRESS: === Epoch 10, step 6, extracting elution groups 63000 to 127000 ===
1:55:17.955074 PROGRESS: Extracting batch of 126514 precursors
1:55:17.993596 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:55:17.993712 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:55:17.993749 INFO: FWHM in RT is 14.24 seconds, sigma is 0.52
1:55:17.993800 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:55:17.994076 INFO: Starting candidate selection
1:55:24.484958 INFO: Starting candidate scoring
1:55:26.975922 INFO: Finished candidate processing
1:55:26.976110 INFO: Collecting candidate features
1:55:29.535437 WARNING: intensity_correlation has 117 NaNs ( 0.10 % out of 119347)
1:55:29.548123 INFO: Collecting fragment features
1:55:30.285353 INFO: Finished candidate scoring
1:55:30.708876 PROGRESS: === Epoch 10, step 6, extracted 119347 precursors and 602992 fragments ===
1:55:30.709218 INFO: performing precursor FDR with 47 features
1:55:30.709276 INFO: Decoy channel: -1
1:55:30.709303 INFO: Competetive: True
1:55:30.981670 WARNING: dropped 123 target PSMs due to missing features
1:55:30.981793 WARNING: dropped 81 decoy PSMs due to missing features
1:55:39.435491 INFO: Test AUC: 0.548
1:55:39.435618 INFO: Train AUC: 0.581
1:55:39.435674 INFO: AUC difference: 5.78%
1:55:39.435701 WARNING: AUC difference > 5%. This may indicate overfitting.
1:55:39.592136 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
1:55:39.593929 PROGRESS: ============================= Precursor FDR =============================
1:55:39.594064 PROGRESS: Total precursors accumulated: 2,771
1:55:39.594142 PROGRESS: Target precursors: 2,533 (91.41%)
1:55:39.594211 PROGRESS: Decoy precursors: 238 (8.59%)
1:55:39.594274 PROGRESS: 
1:55:39.594336 PROGRESS: Precursor Summary:
1:55:39.596607 PROGRESS: Channel   0:	 0.05 FDR: 1,713; 0.01 FDR: 1,022; 0.001 FDR:   744
1:55:39.596744 PROGRESS: 
1:55:39.596818 PROGRESS: Protein Summary:
1:55:39.599754 PROGRESS: Channel   0:	 0.05 FDR: 1,541; 0.01 FDR:   914; 0.001 FDR:   673
1:55:39.599866 PROGRESS: =========================================================================
1:55:39.601320 PROGRESS: === Epoch 10, step 7, extracting elution groups 127000 to 255000 ===
1:55:39.824916 PROGRESS: Extracting batch of 252893 precursors
1:55:39.897346 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:55:39.897462 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:55:39.897503 INFO: FWHM in RT is 14.24 seconds, sigma is 0.52
1:55:39.897546 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:55:39.897837 INFO: Starting candidate selection
1:55:49.195235 INFO: Starting candidate scoring
1:55:52.937688 INFO: Finished candidate processing
1:55:52.937894 INFO: Collecting candidate features
1:55:55.921311 WARNING: intensity_correlation has 212 NaNs ( 0.09 % out of 238334)
1:55:55.942326 INFO: Collecting fragment features
1:55:56.823727 INFO: Finished candidate scoring
1:55:57.413596 PROGRESS: === Epoch 10, step 7, extracted 238334 precursors and 1205796 fragments ===
1:55:57.413954 INFO: performing precursor FDR with 47 features
1:55:57.414002 INFO: Decoy channel: -1
1:55:57.414028 INFO: Competetive: True
1:55:58.018912 WARNING: dropped 241 target PSMs due to missing features
1:55:58.019034 WARNING: dropped 175 decoy PSMs due to missing features
1:56:15.421021 INFO: Test AUC: 0.549
1:56:15.421151 INFO: Train AUC: 0.572
1:56:15.421207 INFO: AUC difference: 4.17%
1:56:15.637873 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
1:56:15.640129 PROGRESS: ============================= Precursor FDR =============================
1:56:15.640287 PROGRESS: Total precursors accumulated: 4,547
1:56:15.640366 PROGRESS: Target precursors: 4,149 (91.25%)
1:56:15.640449 PROGRESS: Decoy precursors: 398 (8.75%)
1:56:15.640513 PROGRESS: 
1:56:15.640575 PROGRESS: Precursor Summary:
1:56:15.643528 PROGRESS: Channel   0:	 0.05 FDR: 3,013; 0.01 FDR: 2,141; 0.001 FDR: 1,582
1:56:15.643663 PROGRESS: 
1:56:15.643734 PROGRESS: Protein Summary:
1:56:15.647700 PROGRESS: Channel   0:	 0.05 FDR: 2,387; 0.01 FDR: 1,668; 0.001 FDR: 1,251
1:56:15.647824 PROGRESS: =========================================================================
1:56:15.649856 PROGRESS: === Epoch 10, step 8, extracting elution groups 255000 to 511000 ===
1:56:15.952687 PROGRESS: Extracting batch of 505934 precursors
1:56:16.085541 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:56:16.085651 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:56:16.085689 INFO: FWHM in RT is 14.24 seconds, sigma is 0.52
1:56:16.085732 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:56:16.086023 INFO: Starting candidate selection
1:56:31.043871 INFO: Starting candidate scoring
1:56:37.255785 INFO: Finished candidate processing
1:56:37.255972 INFO: Collecting candidate features
1:56:40.950857 WARNING: intensity_correlation has 412 NaNs ( 0.09 % out of 476612)
1:56:40.985068 INFO: Collecting fragment features
1:56:42.037811 INFO: Finished candidate scoring
1:56:42.926522 PROGRESS: === Epoch 10, step 8, extracted 476612 precursors and 2414733 fragments ===
1:56:42.926884 INFO: performing precursor FDR with 47 features
1:56:42.926930 INFO: Decoy channel: -1
1:56:42.926955 INFO: Competetive: True
1:56:44.101485 WARNING: dropped 459 target PSMs due to missing features
1:56:44.101615 WARNING: dropped 369 decoy PSMs due to missing features
1:57:19.187800 INFO: Test AUC: 0.551
1:57:19.187939 INFO: Train AUC: 0.566
1:57:19.188000 INFO: AUC difference: 2.68%
1:57:19.432348 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
1:57:19.435505 PROGRESS: ============================= Precursor FDR =============================
1:57:19.435652 PROGRESS: Total precursors accumulated: 7,882
1:57:19.435755 PROGRESS: Target precursors: 7,188 (91.20%)
1:57:19.435836 PROGRESS: Decoy precursors: 694 (8.80%)
1:57:19.435920 PROGRESS: 
1:57:19.436007 PROGRESS: Precursor Summary:
1:57:19.440824 PROGRESS: Channel   0:	 0.05 FDR: 5,785; 0.01 FDR: 3,918; 0.001 FDR: 2,664
1:57:19.440979 PROGRESS: 
1:57:19.441066 PROGRESS: Protein Summary:
1:57:19.446703 PROGRESS: Channel   0:	 0.05 FDR: 3,884; 0.01 FDR: 2,528; 0.001 FDR: 1,813
1:57:19.446833 PROGRESS: =========================================================================
1:57:19.453766 INFO: calibration group: precursor, fitting rt estimator 
1:57:19.938177 INFO: calibration group: fragment, fitting mz estimator 
1:57:20.547054 INFO: === checking if epoch conditions were reached ===
1:57:20.547256 INFO: ✅ ms2_error      : 7.0000 <= 7
1:57:20.547343 INFO: ❌ rt_error       : 237.4172 > 100
1:57:20.547416 INFO: ✅ current_epoch  : 10 >= 3
1:57:20.547480 INFO: ==============================================
1:57:20.788189 INFO: calibration group: precursor, predicting mz
1:57:20.788476 WARNING: mz prediction was skipped as it has not been fitted yet
1:57:20.788517 INFO: calibration group: precursor, predicting rt
1:57:27.511933 INFO: calibration group: fragment, predicting mz
1:57:45.097676 PROGRESS: === Epoch 11, step 0, extracting elution groups 0 to 1000 ===
1:57:45.196382 PROGRESS: Extracting batch of 1974 precursors
1:57:45.198092 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:57:45.198172 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:57:45.198214 INFO: FWHM in RT is 14.22 seconds, sigma is 0.52
1:57:45.198245 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:57:45.198478 INFO: Starting candidate selection
1:57:49.303221 INFO: Starting candidate scoring
1:57:50.595265 INFO: Finished candidate processing
1:57:50.595358 INFO: Collecting candidate features
1:57:52.775777 WARNING: intensity_correlation has 1 NaNs ( 0.05 % out of 1854)
1:57:52.781669 INFO: Collecting fragment features
1:57:53.423843 INFO: Finished candidate scoring
1:57:53.769362 PROGRESS: === Epoch 11, step 0, extracted 1854 precursors and 9417 fragments ===
1:57:53.769692 INFO: performing precursor FDR with 47 features
1:57:53.769736 INFO: Decoy channel: -1
1:57:53.769762 INFO: Competetive: True
1:57:53.774331 WARNING: dropped 1 decoy PSMs due to missing features
1:57:53.802804 INFO: Test AUC: 0.571
1:57:53.802899 INFO: Train AUC: 0.556
1:57:53.802945 INFO: AUC difference: 2.65%
1:57:53.947391 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
1:57:53.948182 PROGRESS: ============================= Precursor FDR =============================
1:57:53.948316 PROGRESS: Total precursors accumulated: 5
1:57:53.948396 PROGRESS: Target precursors: 5 (100.00%)
1:57:53.948464 PROGRESS: Decoy precursors: 0 (0.00%)
1:57:53.948526 PROGRESS: 
1:57:53.948587 PROGRESS: Precursor Summary:
1:57:53.950079 PROGRESS: Channel   0:	 0.05 FDR:     5; 0.01 FDR:     5; 0.001 FDR:     5
1:57:53.950194 PROGRESS: 
1:57:53.950267 PROGRESS: Protein Summary:
1:57:53.951952 PROGRESS: Channel   0:	 0.05 FDR:     5; 0.01 FDR:     5; 0.001 FDR:     5
1:57:53.952064 PROGRESS: =========================================================================
1:57:53.952957 PROGRESS: === Epoch 11, step 1, extracting elution groups 1000 to 3000 ===
1:57:54.030740 PROGRESS: Extracting batch of 3957 precursors
1:57:54.032865 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:57:54.032942 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:57:54.033014 INFO: FWHM in RT is 14.22 seconds, sigma is 0.52
1:57:54.033045 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:57:54.033258 INFO: Starting candidate selection
1:57:57.815789 INFO: Starting candidate scoring
1:57:59.126558 INFO: Finished candidate processing
1:57:59.126671 INFO: Collecting candidate features
1:58:01.317696 WARNING: intensity_correlation has 4 NaNs ( 0.11 % out of 3733)
1:58:01.324130 INFO: Collecting fragment features
1:58:01.977715 INFO: Finished candidate scoring
1:58:02.259549 PROGRESS: === Epoch 11, step 1, extracted 3733 precursors and 18954 fragments ===
1:58:02.259831 INFO: performing precursor FDR with 47 features
1:58:02.259876 INFO: Decoy channel: -1
1:58:02.259903 INFO: Competetive: True
1:58:02.268534 WARNING: dropped 3 target PSMs due to missing features
1:58:02.268629 WARNING: dropped 2 decoy PSMs due to missing features
1:58:02.306996 INFO: Test AUC: 0.526
1:58:02.307116 INFO: Train AUC: 0.555
1:58:02.307162 INFO: AUC difference: 5.25%
1:58:02.307197 WARNING: AUC difference > 5%. This may indicate overfitting.
1:58:02.445907 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
1:58:02.446728 PROGRESS: ============================= Precursor FDR =============================
1:58:02.446868 PROGRESS: Total precursors accumulated: 29
1:58:02.446968 PROGRESS: Target precursors: 27 (93.10%)
1:58:02.447058 PROGRESS: Decoy precursors: 2 (6.90%)
1:58:02.447145 PROGRESS: 
1:58:02.447229 PROGRESS: Precursor Summary:
1:58:02.448682 PROGRESS: Channel   0:	 0.05 FDR:    26; 0.01 FDR:    25; 0.001 FDR:    25
1:58:02.448821 PROGRESS: 
1:58:02.448916 PROGRESS: Protein Summary:
1:58:02.451115 PROGRESS: Channel   0:	 0.05 FDR:    26; 0.01 FDR:    25; 0.001 FDR:    25
1:58:02.451253 PROGRESS: =========================================================================
1:58:02.452142 PROGRESS: === Epoch 11, step 2, extracting elution groups 3000 to 7000 ===
1:58:02.534800 PROGRESS: Extracting batch of 7898 precursors
1:58:02.538075 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:58:02.538139 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:58:02.538178 INFO: FWHM in RT is 14.22 seconds, sigma is 0.52
1:58:02.538226 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:58:02.538478 INFO: Starting candidate selection
1:58:06.387648 INFO: Starting candidate scoring
1:58:07.726658 INFO: Finished candidate processing
1:58:07.726751 INFO: Collecting candidate features
1:58:09.930047 WARNING: intensity_correlation has 5 NaNs ( 0.07 % out of 7472)
1:58:09.935653 INFO: Collecting fragment features
1:58:10.594054 INFO: Finished candidate scoring
1:58:10.881998 PROGRESS: === Epoch 11, step 2, extracted 7472 precursors and 38005 fragments ===
1:58:10.882307 INFO: performing precursor FDR with 47 features
1:58:10.882353 INFO: Decoy channel: -1
1:58:10.882380 INFO: Competetive: True
1:58:10.898044 WARNING: dropped 7 target PSMs due to missing features
1:58:10.898162 WARNING: dropped 3 decoy PSMs due to missing features
1:58:11.196959 INFO: Test AUC: 0.546
1:58:11.197093 INFO: Train AUC: 0.578
1:58:11.197152 INFO: AUC difference: 5.48%
1:58:11.197188 WARNING: AUC difference > 5%. This may indicate overfitting.
1:58:11.321722 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
1:58:11.322582 PROGRESS: ============================= Precursor FDR =============================
1:58:11.322702 PROGRESS: Total precursors accumulated: 102
1:58:11.322779 PROGRESS: Target precursors: 93 (91.18%)
1:58:11.322847 PROGRESS: Decoy precursors: 9 (8.82%)
1:58:11.322910 PROGRESS: 
1:58:11.322972 PROGRESS: Precursor Summary:
1:58:11.324445 PROGRESS: Channel   0:	 0.05 FDR:    78; 0.01 FDR:    65; 0.001 FDR:    65
1:58:11.324568 PROGRESS: 
1:58:11.324641 PROGRESS: Protein Summary:
1:58:11.326350 PROGRESS: Channel   0:	 0.05 FDR:    78; 0.01 FDR:    65; 0.001 FDR:    65
1:58:11.326462 PROGRESS: =========================================================================
1:58:11.327348 PROGRESS: === Epoch 11, step 3, extracting elution groups 7000 to 15000 ===
1:58:11.419423 PROGRESS: Extracting batch of 15798 precursors
1:58:11.425623 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:58:11.425715 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:58:11.425767 INFO: FWHM in RT is 14.22 seconds, sigma is 0.52
1:58:11.425817 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:58:11.426078 INFO: Starting candidate selection
1:58:15.453112 INFO: Starting candidate scoring
1:58:16.867888 INFO: Finished candidate processing
1:58:16.867984 INFO: Collecting candidate features
1:58:19.099827 WARNING: intensity_correlation has 15 NaNs ( 0.10 % out of 14899)
1:58:19.106058 INFO: Collecting fragment features
1:58:19.772312 INFO: Finished candidate scoring
1:58:20.069133 PROGRESS: === Epoch 11, step 3, extracted 14899 precursors and 75228 fragments ===
1:58:20.069469 INFO: performing precursor FDR with 47 features
1:58:20.069517 INFO: Decoy channel: -1
1:58:20.069543 INFO: Competetive: True
1:58:20.098956 WARNING: dropped 13 target PSMs due to missing features
1:58:20.099083 WARNING: dropped 12 decoy PSMs due to missing features
1:58:20.960408 INFO: Test AUC: 0.554
1:58:20.960557 INFO: Train AUC: 0.586
1:58:20.967404 INFO: AUC difference: 5.51%
1:58:20.967505 WARNING: AUC difference > 5%. This may indicate overfitting.
1:58:21.092013 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
1:58:21.092926 PROGRESS: ============================= Precursor FDR =============================
1:58:21.093048 PROGRESS: Total precursors accumulated: 272
1:58:21.093124 PROGRESS: Target precursors: 248 (91.18%)
1:58:21.093190 PROGRESS: Decoy precursors: 24 (8.82%)
1:58:21.093252 PROGRESS: 
1:58:21.093313 PROGRESS: Precursor Summary:
1:58:21.094867 PROGRESS: Channel   0:	 0.05 FDR:   186; 0.01 FDR:   122; 0.001 FDR:   121
1:58:21.094993 PROGRESS: 
1:58:21.095065 PROGRESS: Protein Summary:
1:58:21.096853 PROGRESS: Channel   0:	 0.05 FDR:   184; 0.01 FDR:   120; 0.001 FDR:   119
1:58:21.096961 PROGRESS: =========================================================================
1:58:21.097902 PROGRESS: === Epoch 11, step 4, extracting elution groups 15000 to 31000 ===
1:58:21.206117 PROGRESS: Extracting batch of 31604 precursors
1:58:21.216730 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:58:21.216839 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:58:21.216878 INFO: FWHM in RT is 14.22 seconds, sigma is 0.52
1:58:21.216906 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:58:21.217148 INFO: Starting candidate selection
1:58:25.584472 INFO: Starting candidate scoring
1:58:27.155385 INFO: Finished candidate processing
1:58:27.155513 INFO: Collecting candidate features
1:58:29.410461 WARNING: intensity_correlation has 31 NaNs ( 0.10 % out of 29908)
1:58:29.417395 INFO: Collecting fragment features
1:58:30.095447 INFO: Finished candidate scoring
1:58:30.406179 PROGRESS: === Epoch 11, step 4, extracted 29908 precursors and 151082 fragments ===
1:58:30.406524 INFO: performing precursor FDR with 47 features
1:58:30.406572 INFO: Decoy channel: -1
1:58:30.406598 INFO: Competetive: True
1:58:30.465168 WARNING: dropped 27 target PSMs due to missing features
1:58:30.465281 WARNING: dropped 29 decoy PSMs due to missing features
1:58:32.360806 INFO: Test AUC: 0.555
1:58:32.360962 INFO: Train AUC: 0.595
1:58:32.361008 INFO: AUC difference: 6.70%
1:58:32.361047 WARNING: AUC difference > 5%. This may indicate overfitting.
1:58:32.501154 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
1:58:32.502255 PROGRESS: ============================= Precursor FDR =============================
1:58:32.502393 PROGRESS: Total precursors accumulated: 654
1:58:32.502480 PROGRESS: Target precursors: 597 (91.28%)
1:58:32.502550 PROGRESS: Decoy precursors: 57 (8.72%)
1:58:32.502613 PROGRESS: 
1:58:32.502674 PROGRESS: Precursor Summary:
1:58:32.504331 PROGRESS: Channel   0:	 0.05 FDR:   385; 0.01 FDR:   231; 0.001 FDR:   200
1:58:32.504474 PROGRESS: 
1:58:32.504548 PROGRESS: Protein Summary:
1:58:32.506511 PROGRESS: Channel   0:	 0.05 FDR:   372; 0.01 FDR:   223; 0.001 FDR:   194
1:58:32.506625 PROGRESS: =========================================================================
1:58:32.507619 PROGRESS: === Epoch 11, step 5, extracting elution groups 31000 to 63000 ===
1:58:32.644952 PROGRESS: Extracting batch of 63231 precursors
1:58:32.665637 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:58:32.665743 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:58:32.665787 INFO: FWHM in RT is 14.22 seconds, sigma is 0.52
1:58:32.665833 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:58:32.666086 INFO: Starting candidate selection
1:58:37.747588 INFO: Starting candidate scoring
1:58:39.634359 INFO: Finished candidate processing
1:58:39.634600 INFO: Collecting candidate features
1:58:41.987910 WARNING: intensity_correlation has 54 NaNs ( 0.09 % out of 59737)
1:58:41.996817 INFO: Collecting fragment features
1:58:42.708199 INFO: Finished candidate scoring
1:58:43.055155 PROGRESS: === Epoch 11, step 5, extracted 59737 precursors and 301258 fragments ===
1:58:43.055523 INFO: performing precursor FDR with 47 features
1:58:43.055586 INFO: Decoy channel: -1
1:58:43.055635 INFO: Competetive: True
1:58:43.187209 WARNING: dropped 49 target PSMs due to missing features
1:58:43.187321 WARNING: dropped 61 decoy PSMs due to missing features
1:58:46.943185 INFO: Test AUC: 0.550
1:58:46.943319 INFO: Train AUC: 0.592
1:58:46.943357 INFO: AUC difference: 7.04%
1:58:46.943385 WARNING: AUC difference > 5%. This may indicate overfitting.
1:58:47.074848 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
1:58:47.076202 PROGRESS: ============================= Precursor FDR =============================
1:58:47.076329 PROGRESS: Total precursors accumulated: 1,444
1:58:47.076407 PROGRESS: Target precursors: 1,318 (91.27%)
1:58:47.076474 PROGRESS: Decoy precursors: 126 (8.73%)
1:58:47.076538 PROGRESS: 
1:58:47.076598 PROGRESS: Precursor Summary:
1:58:47.078542 PROGRESS: Channel   0:	 0.05 FDR:   865; 0.01 FDR:   577; 0.001 FDR:   426
1:58:47.078674 PROGRESS: 
1:58:47.078748 PROGRESS: Protein Summary:
1:58:47.081091 PROGRESS: Channel   0:	 0.05 FDR:   807; 0.01 FDR:   540; 0.001 FDR:   404
1:58:47.081219 PROGRESS: =========================================================================
1:58:47.082433 PROGRESS: === Epoch 11, step 6, extracting elution groups 63000 to 127000 ===
1:58:47.259431 PROGRESS: Extracting batch of 126445 precursors
1:58:47.297533 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:58:47.297650 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:58:47.297686 INFO: FWHM in RT is 14.22 seconds, sigma is 0.52
1:58:47.297729 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:58:47.298022 INFO: Starting candidate selection
1:58:53.844806 INFO: Starting candidate scoring
1:58:56.351778 INFO: Finished candidate processing
1:58:56.352045 INFO: Collecting candidate features
1:58:58.888503 WARNING: intensity_correlation has 103 NaNs ( 0.09 % out of 119407)
1:58:58.901840 INFO: Collecting fragment features
1:58:59.671926 INFO: Finished candidate scoring
1:59:00.094057 PROGRESS: === Epoch 11, step 6, extracted 119407 precursors and 602720 fragments ===
1:59:00.094416 INFO: performing precursor FDR with 47 features
1:59:00.094471 INFO: Decoy channel: -1
1:59:00.094498 INFO: Competetive: True
1:59:00.366446 WARNING: dropped 95 target PSMs due to missing features
1:59:00.366576 WARNING: dropped 118 decoy PSMs due to missing features
1:59:08.268819 INFO: Test AUC: 0.555
1:59:08.268946 INFO: Train AUC: 0.583
1:59:08.269004 INFO: AUC difference: 4.78%
1:59:08.418564 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
1:59:08.420340 PROGRESS: ============================= Precursor FDR =============================
1:59:08.420512 PROGRESS: Total precursors accumulated: 2,787
1:59:08.420622 PROGRESS: Target precursors: 2,540 (91.14%)
1:59:08.420718 PROGRESS: Decoy precursors: 247 (8.86%)
1:59:08.420808 PROGRESS: 
1:59:08.420896 PROGRESS: Precursor Summary:
1:59:08.423265 PROGRESS: Channel   0:	 0.05 FDR: 1,741; 0.01 FDR: 1,172; 0.001 FDR:   802
1:59:08.423422 PROGRESS: 
1:59:08.423526 PROGRESS: Protein Summary:
1:59:08.427103 PROGRESS: Channel   0:	 0.05 FDR: 1,519; 0.01 FDR: 1,019; 0.001 FDR:   702
1:59:08.427248 PROGRESS: =========================================================================
1:59:08.428792 PROGRESS: === Epoch 11, step 7, extracting elution groups 127000 to 255000 ===
1:59:08.652682 PROGRESS: Extracting batch of 252880 precursors
1:59:08.724595 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:59:08.724715 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:59:08.724755 INFO: FWHM in RT is 14.22 seconds, sigma is 0.52
1:59:08.724798 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:59:08.725108 INFO: Starting candidate selection
1:59:18.083863 INFO: Starting candidate scoring
1:59:21.826143 INFO: Finished candidate processing
1:59:21.826334 INFO: Collecting candidate features
1:59:24.812602 WARNING: intensity_correlation has 187 NaNs ( 0.08 % out of 238438)
1:59:24.834405 INFO: Collecting fragment features
1:59:25.716839 INFO: Finished candidate scoring
1:59:26.305278 PROGRESS: === Epoch 11, step 7, extracted 238438 precursors and 1205692 fragments ===
1:59:26.305622 INFO: performing precursor FDR with 47 features
1:59:26.305670 INFO: Decoy channel: -1
1:59:26.305697 INFO: Competetive: True
1:59:26.908437 WARNING: dropped 190 target PSMs due to missing features
1:59:26.908558 WARNING: dropped 210 decoy PSMs due to missing features
1:59:44.118871 INFO: Test AUC: 0.552
1:59:44.119010 INFO: Train AUC: 0.574
1:59:44.119065 INFO: AUC difference: 3.94%
1:59:46.313262 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
1:59:46.315696 PROGRESS: ============================= Precursor FDR =============================
1:59:46.315859 PROGRESS: Total precursors accumulated: 4,753
1:59:46.315939 PROGRESS: Target precursors: 4,340 (91.31%)
1:59:46.316024 PROGRESS: Decoy precursors: 413 (8.69%)
1:59:46.316086 PROGRESS: 
1:59:46.316148 PROGRESS: Precursor Summary:
1:59:46.319239 PROGRESS: Channel   0:	 0.05 FDR: 3,213; 0.01 FDR: 2,167; 0.001 FDR: 1,613
1:59:46.319389 PROGRESS: 
1:59:46.319463 PROGRESS: Protein Summary:
1:59:46.323655 PROGRESS: Channel   0:	 0.05 FDR: 2,559; 0.01 FDR: 1,685; 0.001 FDR: 1,264
1:59:46.323797 PROGRESS: =========================================================================
1:59:46.325871 PROGRESS: === Epoch 11, step 8, extracting elution groups 255000 to 511000 ===
1:59:46.629419 PROGRESS: Extracting batch of 505823 precursors
1:59:46.762558 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
1:59:46.762691 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
1:59:46.762733 INFO: FWHM in RT is 14.22 seconds, sigma is 0.52
1:59:46.762761 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
1:59:46.763044 INFO: Starting candidate selection
2:00:01.829720 INFO: Starting candidate scoring
2:00:08.106991 INFO: Finished candidate processing
2:00:08.107155 INFO: Collecting candidate features
2:00:11.762483 WARNING: intensity_correlation has 438 NaNs ( 0.09 % out of 477345)
2:00:11.796452 INFO: Collecting fragment features
2:00:12.859149 INFO: Finished candidate scoring
2:00:13.744583 PROGRESS: === Epoch 11, step 8, extracted 477345 precursors and 2410612 fragments ===
2:00:13.745011 INFO: performing precursor FDR with 47 features
2:00:13.745056 INFO: Decoy channel: -1
2:00:13.745082 INFO: Competetive: True
2:00:14.901020 WARNING: dropped 416 target PSMs due to missing features
2:00:14.901146 WARNING: dropped 422 decoy PSMs due to missing features
2:00:51.471268 INFO: Test AUC: 0.551
2:00:51.471415 INFO: Train AUC: 0.568
2:00:51.471473 INFO: AUC difference: 3.04%
2:00:51.719065 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
2:00:51.722514 PROGRESS: ============================= Precursor FDR =============================
2:00:51.722695 PROGRESS: Total precursors accumulated: 8,055
2:00:51.722789 PROGRESS: Target precursors: 7,357 (91.33%)
2:00:51.722860 PROGRESS: Decoy precursors: 698 (8.67%)
2:00:51.722934 PROGRESS: 
2:00:51.723011 PROGRESS: Precursor Summary:
2:00:51.727340 PROGRESS: Channel   0:	 0.05 FDR: 5,976; 0.01 FDR: 4,270; 0.001 FDR: 3,205
2:00:51.727516 PROGRESS: 
2:00:51.727590 PROGRESS: Protein Summary:
2:00:51.733913 PROGRESS: Channel   0:	 0.05 FDR: 3,978; 0.01 FDR: 2,743; 0.001 FDR: 2,100
2:00:51.734047 PROGRESS: =========================================================================
2:00:51.739230 INFO: calibration group: precursor, fitting rt estimator 
2:00:52.270808 INFO: calibration group: fragment, fitting mz estimator 
2:00:52.853245 INFO: === checking if epoch conditions were reached ===
2:00:52.853470 INFO: ✅ ms2_error      : 7.0000 <= 7
2:00:52.853560 INFO: ❌ rt_error       : 237.2246 > 100
2:00:52.853631 INFO: ✅ current_epoch  : 11 >= 3
2:00:52.853696 INFO: ==============================================
2:00:53.077284 INFO: calibration group: precursor, predicting mz
2:00:53.077570 WARNING: mz prediction was skipped as it has not been fitted yet
2:00:53.077609 INFO: calibration group: precursor, predicting rt
2:00:59.807564 INFO: calibration group: fragment, predicting mz
2:01:17.467162 PROGRESS: === Epoch 12, step 0, extracting elution groups 0 to 1000 ===
2:01:17.567193 PROGRESS: Extracting batch of 1976 precursors
2:01:17.568991 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:01:17.569080 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:01:17.569138 INFO: FWHM in RT is 14.31 seconds, sigma is 0.52
2:01:17.569169 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:01:17.569410 INFO: Starting candidate selection
2:01:21.669408 INFO: Starting candidate scoring
2:01:22.964603 INFO: Finished candidate processing
2:01:22.964694 INFO: Collecting candidate features
2:01:25.114482 WARNING: intensity_correlation has 1 NaNs ( 0.05 % out of 1868)
2:01:25.120424 INFO: Collecting fragment features
2:01:25.753027 INFO: Finished candidate scoring
2:01:26.096840 PROGRESS: === Epoch 12, step 0, extracted 1868 precursors and 9476 fragments ===
2:01:26.097185 INFO: performing precursor FDR with 47 features
2:01:26.097230 INFO: Decoy channel: -1
2:01:26.097257 INFO: Competetive: True
2:01:26.101963 WARNING: dropped 1 target PSMs due to missing features
2:01:26.130346 INFO: Test AUC: 0.536
2:01:26.130444 INFO: Train AUC: 0.571
2:01:26.130488 INFO: AUC difference: 6.02%
2:01:26.130522 WARNING: AUC difference > 5%. This may indicate overfitting.
2:01:26.252916 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
2:01:26.253705 PROGRESS: ============================= Precursor FDR =============================
2:01:26.253864 PROGRESS: Total precursors accumulated: 13
2:01:26.253971 PROGRESS: Target precursors: 12 (92.31%)
2:01:26.254069 PROGRESS: Decoy precursors: 1 (7.69%)
2:01:26.254161 PROGRESS: 
2:01:26.254249 PROGRESS: Precursor Summary:
2:01:26.255660 PROGRESS: Channel   0:	 0.05 FDR:     9; 0.01 FDR:     9; 0.001 FDR:     9
2:01:26.255793 PROGRESS: 
2:01:26.255898 PROGRESS: Protein Summary:
2:01:26.258044 PROGRESS: Channel   0:	 0.05 FDR:     9; 0.01 FDR:     9; 0.001 FDR:     9
2:01:26.258182 PROGRESS: =========================================================================
2:01:26.259059 PROGRESS: === Epoch 12, step 1, extracting elution groups 1000 to 3000 ===
2:01:26.336272 PROGRESS: Extracting batch of 3956 precursors
2:01:26.338571 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:01:26.338631 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:01:26.338687 INFO: FWHM in RT is 14.31 seconds, sigma is 0.52
2:01:26.338737 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:01:26.339016 INFO: Starting candidate selection
2:01:30.130838 INFO: Starting candidate scoring
2:01:31.450556 INFO: Finished candidate processing
2:01:31.450734 INFO: Collecting candidate features
2:01:33.613193 WARNING: intensity_correlation has 2 NaNs ( 0.05 % out of 3733)
2:01:33.619304 INFO: Collecting fragment features
2:01:34.260776 INFO: Finished candidate scoring
2:01:34.541732 PROGRESS: === Epoch 12, step 1, extracted 3733 precursors and 18961 fragments ===
2:01:34.542014 INFO: performing precursor FDR with 47 features
2:01:34.542060 INFO: Decoy channel: -1
2:01:34.542086 INFO: Competetive: True
2:01:34.550574 WARNING: dropped 3 target PSMs due to missing features
2:01:34.588221 INFO: Test AUC: 0.565
2:01:34.588340 INFO: Train AUC: 0.550
2:01:34.588386 INFO: AUC difference: 2.59%
2:01:34.709990 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
2:01:34.710777 PROGRESS: ============================= Precursor FDR =============================
2:01:34.710905 PROGRESS: Total precursors accumulated: 36
2:01:34.710983 PROGRESS: Target precursors: 34 (94.44%)
2:01:34.711066 PROGRESS: Decoy precursors: 2 (5.56%)
2:01:34.711130 PROGRESS: 
2:01:34.711191 PROGRESS: Precursor Summary:
2:01:34.712609 PROGRESS: Channel   0:	 0.05 FDR:    33; 0.01 FDR:    29; 0.001 FDR:    29
2:01:34.712724 PROGRESS: 
2:01:34.712796 PROGRESS: Protein Summary:
2:01:34.714435 PROGRESS: Channel   0:	 0.05 FDR:    33; 0.01 FDR:    29; 0.001 FDR:    29
2:01:34.714547 PROGRESS: =========================================================================
2:01:34.715394 PROGRESS: === Epoch 12, step 2, extracting elution groups 3000 to 7000 ===
2:01:34.797095 PROGRESS: Extracting batch of 7908 precursors
2:01:34.800583 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:01:34.800644 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:01:34.800682 INFO: FWHM in RT is 14.31 seconds, sigma is 0.52
2:01:34.800727 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:01:34.800951 INFO: Starting candidate selection
2:01:38.672203 INFO: Starting candidate scoring
2:01:40.019532 INFO: Finished candidate processing
2:01:40.019628 INFO: Collecting candidate features
2:01:42.222010 WARNING: intensity_correlation has 9 NaNs ( 0.12 % out of 7400)
2:01:42.228742 INFO: Collecting fragment features
2:01:42.881889 INFO: Finished candidate scoring
2:01:43.170274 PROGRESS: === Epoch 12, step 2, extracted 7400 precursors and 37541 fragments ===
2:01:43.170586 INFO: performing precursor FDR with 47 features
2:01:43.170634 INFO: Decoy channel: -1
2:01:43.170660 INFO: Competetive: True
2:01:43.186144 WARNING: dropped 11 target PSMs due to missing features
2:01:43.186249 WARNING: dropped 1 decoy PSMs due to missing features
2:01:43.452698 INFO: Test AUC: 0.546
2:01:43.452832 INFO: Train AUC: 0.577
2:01:43.452899 INFO: AUC difference: 5.48%
2:01:43.452934 WARNING: AUC difference > 5%. This may indicate overfitting.
2:01:43.576998 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
2:01:43.577870 PROGRESS: ============================= Precursor FDR =============================
2:01:43.577992 PROGRESS: Total precursors accumulated: 115
2:01:43.578069 PROGRESS: Target precursors: 106 (92.17%)
2:01:43.578136 PROGRESS: Decoy precursors: 9 (7.83%)
2:01:43.578199 PROGRESS: 
2:01:43.578260 PROGRESS: Precursor Summary:
2:01:43.579729 PROGRESS: Channel   0:	 0.05 FDR:    68; 0.01 FDR:    46; 0.001 FDR:    46
2:01:43.579843 PROGRESS: 
2:01:43.579917 PROGRESS: Protein Summary:
2:01:43.581594 PROGRESS: Channel   0:	 0.05 FDR:    68; 0.01 FDR:    46; 0.001 FDR:    46
2:01:43.581704 PROGRESS: =========================================================================
2:01:43.582582 PROGRESS: === Epoch 12, step 3, extracting elution groups 7000 to 15000 ===
2:01:43.673722 PROGRESS: Extracting batch of 15811 precursors
2:01:43.679430 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:01:43.679510 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:01:43.679544 INFO: FWHM in RT is 14.31 seconds, sigma is 0.52
2:01:43.679585 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:01:43.679808 INFO: Starting candidate selection
2:01:47.735902 INFO: Starting candidate scoring
2:01:49.160937 INFO: Finished candidate processing
2:01:49.161034 INFO: Collecting candidate features
2:01:51.377155 WARNING: intensity_correlation has 18 NaNs ( 0.12 % out of 14965)
2:01:51.383259 INFO: Collecting fragment features
2:01:52.039726 INFO: Finished candidate scoring
2:01:52.334453 PROGRESS: === Epoch 12, step 3, extracted 14965 precursors and 75592 fragments ===
2:01:52.334774 INFO: performing precursor FDR with 47 features
2:01:52.334821 INFO: Decoy channel: -1
2:01:52.334847 INFO: Competetive: True
2:01:52.364221 WARNING: dropped 22 target PSMs due to missing features
2:01:52.364340 WARNING: dropped 8 decoy PSMs due to missing features
2:01:53.085237 INFO: Test AUC: 0.557
2:01:53.085400 INFO: Train AUC: 0.587
2:01:53.085447 INFO: AUC difference: 5.07%
2:01:53.085482 WARNING: AUC difference > 5%. This may indicate overfitting.
2:01:53.227447 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
2:01:53.228433 PROGRESS: ============================= Precursor FDR =============================
2:01:53.228558 PROGRESS: Total precursors accumulated: 340
2:01:53.228636 PROGRESS: Target precursors: 312 (91.76%)
2:01:53.228704 PROGRESS: Decoy precursors: 28 (8.24%)
2:01:53.228766 PROGRESS: 
2:01:53.228826 PROGRESS: Precursor Summary:
2:01:53.230406 PROGRESS: Channel   0:	 0.05 FDR:   182; 0.01 FDR:   116; 0.001 FDR:    74
2:01:53.230535 PROGRESS: 
2:01:53.230610 PROGRESS: Protein Summary:
2:01:53.232402 PROGRESS: Channel   0:	 0.05 FDR:   179; 0.01 FDR:   113; 0.001 FDR:    72
2:01:53.232512 PROGRESS: =========================================================================
2:01:53.233438 PROGRESS: === Epoch 12, step 4, extracting elution groups 15000 to 31000 ===
2:01:53.341524 PROGRESS: Extracting batch of 31631 precursors
2:01:53.352495 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:01:53.352589 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:01:53.352627 INFO: FWHM in RT is 14.31 seconds, sigma is 0.52
2:01:53.352670 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:01:53.352912 INFO: Starting candidate selection
2:01:57.797118 INFO: Starting candidate scoring
2:01:59.404739 INFO: Finished candidate processing
2:01:59.404838 INFO: Collecting candidate features
2:02:01.700434 WARNING: intensity_correlation has 29 NaNs ( 0.10 % out of 29888)
2:02:01.707983 INFO: Collecting fragment features
2:02:02.394983 INFO: Finished candidate scoring
2:02:02.710535 PROGRESS: === Epoch 12, step 4, extracted 29888 precursors and 150685 fragments ===
2:02:02.710888 INFO: performing precursor FDR with 47 features
2:02:02.710941 INFO: Decoy channel: -1
2:02:02.710968 INFO: Competetive: True
2:02:02.771071 WARNING: dropped 32 target PSMs due to missing features
2:02:02.771180 WARNING: dropped 27 decoy PSMs due to missing features
2:02:04.495131 INFO: Test AUC: 0.557
2:02:04.495296 INFO: Train AUC: 0.596
2:02:04.495354 INFO: AUC difference: 6.44%
2:02:04.495395 WARNING: AUC difference > 5%. This may indicate overfitting.
2:02:04.620344 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
2:02:04.621583 PROGRESS: ============================= Precursor FDR =============================
2:02:04.621724 PROGRESS: Total precursors accumulated: 911
2:02:04.621836 PROGRESS: Target precursors: 831 (91.22%)
2:02:04.621940 PROGRESS: Decoy precursors: 80 (8.78%)
2:02:04.622023 PROGRESS: 
2:02:04.622111 PROGRESS: Precursor Summary:
2:02:04.623873 PROGRESS: Channel   0:	 0.05 FDR:   485; 0.01 FDR:   262; 0.001 FDR:   220
2:02:04.624008 PROGRESS: 
2:02:04.624088 PROGRESS: Protein Summary:
2:02:04.626856 PROGRESS: Channel   0:	 0.05 FDR:   471; 0.01 FDR:   248; 0.001 FDR:   209
2:02:04.627012 PROGRESS: =========================================================================
2:02:04.628084 PROGRESS: === Epoch 12, step 5, extracting elution groups 31000 to 63000 ===
2:02:04.764545 PROGRESS: Extracting batch of 63229 precursors
2:02:04.784666 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:02:04.784774 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:02:04.784812 INFO: FWHM in RT is 14.31 seconds, sigma is 0.52
2:02:04.784838 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:02:04.785110 INFO: Starting candidate selection
2:02:09.925393 INFO: Starting candidate scoring
2:02:11.832115 INFO: Finished candidate processing
2:02:11.832214 INFO: Collecting candidate features
2:02:14.181657 WARNING: intensity_correlation has 56 NaNs ( 0.09 % out of 59508)
2:02:14.190694 INFO: Collecting fragment features
2:02:14.900012 INFO: Finished candidate scoring
2:02:15.247674 PROGRESS: === Epoch 12, step 5, extracted 59508 precursors and 300581 fragments ===
2:02:15.248023 INFO: performing precursor FDR with 47 features
2:02:15.248090 INFO: Decoy channel: -1
2:02:15.248133 INFO: Competetive: True
2:02:15.380131 WARNING: dropped 58 target PSMs due to missing features
2:02:15.380237 WARNING: dropped 57 decoy PSMs due to missing features
2:02:19.251286 INFO: Test AUC: 0.554
2:02:19.251410 INFO: Train AUC: 0.591
2:02:19.251464 INFO: AUC difference: 6.34%
2:02:19.251496 WARNING: AUC difference > 5%. This may indicate overfitting.
2:02:19.386105 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
2:02:19.387607 PROGRESS: ============================= Precursor FDR =============================
2:02:19.387765 PROGRESS: Total precursors accumulated: 1,734
2:02:19.387844 PROGRESS: Target precursors: 1,583 (91.29%)
2:02:19.387913 PROGRESS: Decoy precursors: 151 (8.71%)
2:02:19.387989 PROGRESS: 
2:02:19.388052 PROGRESS: Precursor Summary:
2:02:19.390214 PROGRESS: Channel   0:	 0.05 FDR:   915; 0.01 FDR:   516; 0.001 FDR:   427
2:02:19.390368 PROGRESS: 
2:02:19.390454 PROGRESS: Protein Summary:
2:02:19.393153 PROGRESS: Channel   0:	 0.05 FDR:   858; 0.01 FDR:   477; 0.001 FDR:   393
2:02:19.393274 PROGRESS: =========================================================================
2:02:19.394452 PROGRESS: === Epoch 12, step 6, extracting elution groups 63000 to 127000 ===
2:02:19.570017 PROGRESS: Extracting batch of 126474 precursors
2:02:19.608354 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:02:19.608468 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:02:19.608524 INFO: FWHM in RT is 14.31 seconds, sigma is 0.52
2:02:19.608553 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:02:19.608827 INFO: Starting candidate selection
2:02:26.193329 INFO: Starting candidate scoring
2:02:28.722155 INFO: Finished candidate processing
2:02:28.722245 INFO: Collecting candidate features
2:02:31.277874 WARNING: intensity_correlation has 115 NaNs ( 0.10 % out of 118834)
2:02:31.291012 INFO: Collecting fragment features
2:02:32.067685 INFO: Finished candidate scoring
2:02:32.495332 PROGRESS: === Epoch 12, step 6, extracted 118834 precursors and 599264 fragments ===
2:02:32.495675 INFO: performing precursor FDR with 47 features
2:02:32.495720 INFO: Decoy channel: -1
2:02:32.495746 INFO: Competetive: True
2:02:32.771173 WARNING: dropped 117 target PSMs due to missing features
2:02:32.771290 WARNING: dropped 113 decoy PSMs due to missing features
2:02:40.903651 INFO: Test AUC: 0.550
2:02:40.903781 INFO: Train AUC: 0.584
2:02:40.903838 INFO: AUC difference: 5.87%
2:02:40.903876 WARNING: AUC difference > 5%. This may indicate overfitting.
2:02:41.058041 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
2:02:41.059988 PROGRESS: ============================= Precursor FDR =============================
2:02:41.060138 PROGRESS: Total precursors accumulated: 3,181
2:02:41.060269 PROGRESS: Target precursors: 2,909 (91.45%)
2:02:41.060366 PROGRESS: Decoy precursors: 272 (8.55%)
2:02:41.060457 PROGRESS: 
2:02:41.060556 PROGRESS: Precursor Summary:
2:02:41.062945 PROGRESS: Channel   0:	 0.05 FDR: 1,718; 0.01 FDR: 1,011; 0.001 FDR:   704
2:02:41.063108 PROGRESS: 
2:02:41.063214 PROGRESS: Protein Summary:
2:02:41.066888 PROGRESS: Channel   0:	 0.05 FDR: 1,523; 0.01 FDR:   883; 0.001 FDR:   624
2:02:41.067032 PROGRESS: =========================================================================
2:02:41.068570 PROGRESS: === Epoch 12, step 7, extracting elution groups 127000 to 255000 ===
2:02:41.293912 PROGRESS: Extracting batch of 252919 precursors
2:02:41.366176 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:02:41.366290 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:02:41.366337 INFO: FWHM in RT is 14.31 seconds, sigma is 0.52
2:02:41.366377 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:02:41.366670 INFO: Starting candidate selection
2:02:50.714618 INFO: Starting candidate scoring
2:02:54.493683 INFO: Finished candidate processing
2:02:54.493936 INFO: Collecting candidate features
2:02:57.470315 WARNING: intensity_correlation has 212 NaNs ( 0.09 % out of 238157)
2:02:57.491679 INFO: Collecting fragment features
2:02:58.365186 INFO: Finished candidate scoring
2:02:58.948824 PROGRESS: === Epoch 12, step 7, extracted 238157 precursors and 1205182 fragments ===
2:02:58.949189 INFO: performing precursor FDR with 47 features
2:02:58.949235 INFO: Decoy channel: -1
2:02:58.949261 INFO: Competetive: True
2:02:59.553140 WARNING: dropped 225 target PSMs due to missing features
2:02:59.553262 WARNING: dropped 217 decoy PSMs due to missing features
2:03:17.299613 INFO: Test AUC: 0.552
2:03:17.299743 INFO: Train AUC: 0.574
2:03:17.299800 INFO: AUC difference: 3.74%
2:03:17.485794 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
2:03:17.488165 PROGRESS: ============================= Precursor FDR =============================
2:03:17.488320 PROGRESS: Total precursors accumulated: 4,692
2:03:17.488397 PROGRESS: Target precursors: 4,282 (91.26%)
2:03:17.488464 PROGRESS: Decoy precursors: 410 (8.74%)
2:03:17.488542 PROGRESS: 
2:03:17.488604 PROGRESS: Precursor Summary:
2:03:17.491547 PROGRESS: Channel   0:	 0.05 FDR: 3,095; 0.01 FDR: 1,929; 0.001 FDR: 1,351
2:03:17.491698 PROGRESS: 
2:03:17.491771 PROGRESS: Protein Summary:
2:03:17.495754 PROGRESS: Channel   0:	 0.05 FDR: 2,438; 0.01 FDR: 1,496; 0.001 FDR: 1,074
2:03:17.495883 PROGRESS: =========================================================================
2:03:17.497838 PROGRESS: === Epoch 12, step 8, extracting elution groups 255000 to 511000 ===
2:03:17.800095 PROGRESS: Extracting batch of 505831 precursors
2:03:17.932934 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:03:17.933050 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:03:17.933090 INFO: FWHM in RT is 14.31 seconds, sigma is 0.52
2:03:17.933135 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:03:17.933406 INFO: Starting candidate selection
2:03:32.910527 INFO: Starting candidate scoring
2:03:39.123661 INFO: Finished candidate processing
2:03:39.123860 INFO: Collecting candidate features
2:03:42.801493 WARNING: intensity_correlation has 469 NaNs ( 0.10 % out of 476428)
2:03:42.835824 INFO: Collecting fragment features
2:03:43.905407 INFO: Finished candidate scoring
2:03:44.807263 PROGRESS: === Epoch 12, step 8, extracted 476428 precursors and 2408391 fragments ===
2:03:44.807628 INFO: performing precursor FDR with 47 features
2:03:44.807677 INFO: Decoy channel: -1
2:03:44.807703 INFO: Competetive: True
2:03:45.962407 WARNING: dropped 463 target PSMs due to missing features
2:03:45.962532 WARNING: dropped 448 decoy PSMs due to missing features
2:04:21.308854 INFO: Test AUC: 0.552
2:04:21.308986 INFO: Train AUC: 0.567
2:04:21.309036 INFO: AUC difference: 2.66%
2:04:21.554905 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
2:04:21.558125 PROGRESS: ============================= Precursor FDR =============================
2:04:21.558290 PROGRESS: Total precursors accumulated: 7,892
2:04:21.558383 PROGRESS: Target precursors: 7,208 (91.33%)
2:04:21.558450 PROGRESS: Decoy precursors: 684 (8.67%)
2:04:21.558513 PROGRESS: 
2:04:21.558573 PROGRESS: Precursor Summary:
2:04:21.562599 PROGRESS: Channel   0:	 0.05 FDR: 5,727; 0.01 FDR: 4,206; 0.001 FDR: 2,244
2:04:21.562735 PROGRESS: 
2:04:21.562807 PROGRESS: Protein Summary:
2:04:21.568481 PROGRESS: Channel   0:	 0.05 FDR: 3,721; 0.01 FDR: 2,710; 0.001 FDR: 1,605
2:04:21.568616 PROGRESS: =========================================================================
2:04:21.573491 INFO: calibration group: precursor, fitting rt estimator 
2:04:22.081791 INFO: calibration group: fragment, fitting mz estimator 
2:04:22.689407 INFO: === checking if epoch conditions were reached ===
2:04:22.689628 INFO: ✅ ms2_error      : 7.0000 <= 7
2:04:22.689717 INFO: ❌ rt_error       : 237.2682 > 100
2:04:22.689800 INFO: ✅ current_epoch  : 12 >= 3
2:04:22.689868 INFO: ==============================================
2:04:22.906439 INFO: calibration group: precursor, predicting mz
2:04:22.906716 WARNING: mz prediction was skipped as it has not been fitted yet
2:04:22.906760 INFO: calibration group: precursor, predicting rt
2:04:29.720707 INFO: calibration group: fragment, predicting mz
2:04:47.555756 PROGRESS: === Epoch 13, step 0, extracting elution groups 0 to 1000 ===
2:04:47.654620 PROGRESS: Extracting batch of 1970 precursors
2:04:47.656381 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:04:47.656471 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:04:47.656528 INFO: FWHM in RT is 14.37 seconds, sigma is 0.52
2:04:47.656559 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:04:47.656789 INFO: Starting candidate selection
2:04:51.750283 INFO: Starting candidate scoring
2:04:53.029018 INFO: Finished candidate processing
2:04:53.029125 INFO: Collecting candidate features
2:04:55.179233 WARNING: intensity_correlation has 4 NaNs ( 0.21 % out of 1880)
2:04:55.185317 INFO: Collecting fragment features
2:04:55.821196 INFO: Finished candidate scoring
2:04:56.165144 PROGRESS: === Epoch 13, step 0, extracted 1880 precursors and 9320 fragments ===
2:04:56.165471 INFO: performing precursor FDR with 47 features
2:04:56.165514 INFO: Decoy channel: -1
2:04:56.165540 INFO: Competetive: True
2:04:56.170386 WARNING: dropped 3 target PSMs due to missing features
2:04:56.170482 WARNING: dropped 1 decoy PSMs due to missing features
2:04:56.198776 INFO: Test AUC: 0.561
2:04:56.198874 INFO: Train AUC: 0.564
2:04:56.198919 INFO: AUC difference: 0.48%
2:04:56.318782 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
2:04:56.319624 PROGRESS: ============================= Precursor FDR =============================
2:04:56.319747 PROGRESS: Total precursors accumulated: 7
2:04:56.319826 PROGRESS: Target precursors: 7 (100.00%)
2:04:56.319895 PROGRESS: Decoy precursors: 0 (0.00%)
2:04:56.319960 PROGRESS: 
2:04:56.320022 PROGRESS: Precursor Summary:
2:04:56.321500 PROGRESS: Channel   0:	 0.05 FDR:     7; 0.01 FDR:     7; 0.001 FDR:     7
2:04:56.321610 PROGRESS: 
2:04:56.321684 PROGRESS: Protein Summary:
2:04:56.323368 PROGRESS: Channel   0:	 0.05 FDR:     7; 0.01 FDR:     7; 0.001 FDR:     7
2:04:56.323479 PROGRESS: =========================================================================
2:04:56.324363 PROGRESS: === Epoch 13, step 1, extracting elution groups 1000 to 3000 ===
2:04:56.401914 PROGRESS: Extracting batch of 3956 precursors
2:04:56.404098 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:04:56.404157 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:04:56.404195 INFO: FWHM in RT is 14.37 seconds, sigma is 0.52
2:04:56.404227 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:04:56.404453 INFO: Starting candidate selection
2:05:00.178994 INFO: Starting candidate scoring
2:05:01.482561 INFO: Finished candidate processing
2:05:01.482742 INFO: Collecting candidate features
2:05:03.692010 WARNING: intensity_correlation has 4 NaNs ( 0.11 % out of 3742)
2:05:03.698747 INFO: Collecting fragment features
2:05:04.345135 INFO: Finished candidate scoring
2:05:04.626475 PROGRESS: === Epoch 13, step 1, extracted 3742 precursors and 18689 fragments ===
2:05:04.626762 INFO: performing precursor FDR with 47 features
2:05:04.626810 INFO: Decoy channel: -1
2:05:04.626837 INFO: Competetive: True
2:05:04.635578 WARNING: dropped 4 target PSMs due to missing features
2:05:04.635667 WARNING: dropped 4 decoy PSMs due to missing features
2:05:04.673623 INFO: Test AUC: 0.540
2:05:04.673741 INFO: Train AUC: 0.544
2:05:04.673795 INFO: AUC difference: 0.87%
2:05:04.815751 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
2:05:04.816569 PROGRESS: ============================= Precursor FDR =============================
2:05:04.816692 PROGRESS: Total precursors accumulated: 41
2:05:04.816769 PROGRESS: Target precursors: 38 (92.68%)
2:05:04.816838 PROGRESS: Decoy precursors: 3 (7.32%)
2:05:04.816901 PROGRESS: 
2:05:04.816962 PROGRESS: Precursor Summary:
2:05:04.819154 PROGRESS: Channel   0:	 0.05 FDR:    32; 0.01 FDR:    24; 0.001 FDR:    24
2:05:04.819366 PROGRESS: 
2:05:04.819590 PROGRESS: Protein Summary:
2:05:04.821450 PROGRESS: Channel   0:	 0.05 FDR:    32; 0.01 FDR:    24; 0.001 FDR:    24
2:05:04.821576 PROGRESS: =========================================================================
2:05:04.822470 PROGRESS: === Epoch 13, step 2, extracting elution groups 3000 to 7000 ===
2:05:04.905540 PROGRESS: Extracting batch of 7908 precursors
2:05:04.908979 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:05:04.909043 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:05:04.909081 INFO: FWHM in RT is 14.37 seconds, sigma is 0.52
2:05:04.909127 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:05:04.909375 INFO: Starting candidate selection
2:05:08.754971 INFO: Starting candidate scoring
2:05:10.097524 INFO: Finished candidate processing
2:05:10.097685 INFO: Collecting candidate features
2:05:12.296857 WARNING: intensity_correlation has 4 NaNs ( 0.05 % out of 7523)
2:05:12.304003 INFO: Collecting fragment features
2:05:12.957460 INFO: Finished candidate scoring
2:05:13.245286 PROGRESS: === Epoch 13, step 2, extracted 7523 precursors and 38382 fragments ===
2:05:13.245609 INFO: performing precursor FDR with 47 features
2:05:13.245668 INFO: Decoy channel: -1
2:05:13.245715 INFO: Competetive: True
2:05:13.261324 WARNING: dropped 6 target PSMs due to missing features
2:05:13.261430 WARNING: dropped 6 decoy PSMs due to missing features
2:05:13.566162 INFO: Test AUC: 0.529
2:05:13.566299 INFO: Train AUC: 0.576
2:05:13.566347 INFO: AUC difference: 8.10%
2:05:13.566382 WARNING: AUC difference > 5%. This may indicate overfitting.
2:05:13.688577 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
2:05:13.689425 PROGRESS: ============================= Precursor FDR =============================
2:05:13.689545 PROGRESS: Total precursors accumulated: 80
2:05:13.689621 PROGRESS: Target precursors: 75 (93.75%)
2:05:13.689690 PROGRESS: Decoy precursors: 5 (6.25%)
2:05:13.689754 PROGRESS: 
2:05:13.689840 PROGRESS: Precursor Summary:
2:05:13.691313 PROGRESS: Channel   0:	 0.05 FDR:    67; 0.01 FDR:    63; 0.001 FDR:    63
2:05:13.691441 PROGRESS: 
2:05:13.691514 PROGRESS: Protein Summary:
2:05:13.693187 PROGRESS: Channel   0:	 0.05 FDR:    65; 0.01 FDR:    61; 0.001 FDR:    61
2:05:13.693312 PROGRESS: =========================================================================
2:05:13.694206 PROGRESS: === Epoch 13, step 3, extracting elution groups 7000 to 15000 ===
2:05:13.785356 PROGRESS: Extracting batch of 15814 precursors
2:05:13.790934 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:05:13.791001 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:05:13.791036 INFO: FWHM in RT is 14.37 seconds, sigma is 0.52
2:05:13.791079 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:05:13.791301 INFO: Starting candidate selection
2:05:17.877351 INFO: Starting candidate scoring
2:05:19.316214 INFO: Finished candidate processing
2:05:19.316306 INFO: Collecting candidate features
2:05:21.538164 WARNING: intensity_correlation has 9 NaNs ( 0.06 % out of 14968)
2:05:21.544367 INFO: Collecting fragment features
2:05:22.209064 INFO: Finished candidate scoring
2:05:22.504997 PROGRESS: === Epoch 13, step 3, extracted 14968 precursors and 76013 fragments ===
2:05:22.505343 INFO: performing precursor FDR with 47 features
2:05:22.505392 INFO: Decoy channel: -1
2:05:22.505418 INFO: Competetive: True
2:05:22.534695 WARNING: dropped 13 target PSMs due to missing features
2:05:22.534821 WARNING: dropped 8 decoy PSMs due to missing features
2:05:23.226197 INFO: Test AUC: 0.562
2:05:23.226345 INFO: Train AUC: 0.589
2:05:23.226415 INFO: AUC difference: 4.66%
2:05:23.359118 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
2:05:23.360082 PROGRESS: ============================= Precursor FDR =============================
2:05:23.360208 PROGRESS: Total precursors accumulated: 275
2:05:23.360285 PROGRESS: Target precursors: 251 (91.27%)
2:05:23.360352 PROGRESS: Decoy precursors: 24 (8.73%)
2:05:23.360413 PROGRESS: 
2:05:23.360474 PROGRESS: Precursor Summary:
2:05:23.362041 PROGRESS: Channel   0:	 0.05 FDR:   170; 0.01 FDR:   127; 0.001 FDR:    84
2:05:23.362157 PROGRESS: 
2:05:23.362231 PROGRESS: Protein Summary:
2:05:23.364013 PROGRESS: Channel   0:	 0.05 FDR:   165; 0.01 FDR:   124; 0.001 FDR:    81
2:05:23.364141 PROGRESS: =========================================================================
2:05:23.365093 PROGRESS: === Epoch 13, step 4, extracting elution groups 15000 to 31000 ===
2:05:23.473485 PROGRESS: Extracting batch of 31593 precursors
2:05:23.484214 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:05:23.484313 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:05:23.484349 INFO: FWHM in RT is 14.37 seconds, sigma is 0.52
2:05:23.484393 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:05:23.484639 INFO: Starting candidate selection
2:05:27.883505 INFO: Starting candidate scoring
2:05:29.469684 INFO: Finished candidate processing
2:05:29.469934 INFO: Collecting candidate features
2:05:31.746441 WARNING: intensity_correlation has 28 NaNs ( 0.09 % out of 29895)
2:05:31.753496 INFO: Collecting fragment features
2:05:32.436207 INFO: Finished candidate scoring
2:05:32.751248 PROGRESS: === Epoch 13, step 4, extracted 29895 precursors and 151395 fragments ===
2:05:32.751588 INFO: performing precursor FDR with 47 features
2:05:32.751635 INFO: Decoy channel: -1
2:05:32.751661 INFO: Competetive: True
2:05:32.812585 WARNING: dropped 31 target PSMs due to missing features
2:05:32.812697 WARNING: dropped 18 decoy PSMs due to missing features
2:05:34.646126 INFO: Test AUC: 0.543
2:05:34.646333 INFO: Train AUC: 0.598
2:05:34.646383 INFO: AUC difference: 9.30%
2:05:34.646416 WARNING: AUC difference > 5%. This may indicate overfitting.
2:05:34.773434 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
2:05:34.774595 PROGRESS: ============================= Precursor FDR =============================
2:05:34.774720 PROGRESS: Total precursors accumulated: 918
2:05:34.774798 PROGRESS: Target precursors: 841 (91.61%)
2:05:34.774866 PROGRESS: Decoy precursors: 77 (8.39%)
2:05:34.774929 PROGRESS: 
2:05:34.774990 PROGRESS: Precursor Summary:
2:05:34.776700 PROGRESS: Channel   0:	 0.05 FDR:   486; 0.01 FDR:   276; 0.001 FDR:   228
2:05:34.776817 PROGRESS: 
2:05:34.776890 PROGRESS: Protein Summary:
2:05:34.778952 PROGRESS: Channel   0:	 0.05 FDR:   473; 0.01 FDR:   268; 0.001 FDR:   223
2:05:34.779078 PROGRESS: =========================================================================
2:05:34.780108 PROGRESS: === Epoch 13, step 5, extracting elution groups 31000 to 63000 ===
2:05:34.915834 PROGRESS: Extracting batch of 63207 precursors
2:05:34.935570 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:05:34.935676 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:05:34.935729 INFO: FWHM in RT is 14.37 seconds, sigma is 0.52
2:05:34.935772 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:05:34.936027 INFO: Starting candidate selection
2:05:40.060878 INFO: Starting candidate scoring
2:05:41.962706 INFO: Finished candidate processing
2:05:41.962836 INFO: Collecting candidate features
2:05:44.316112 WARNING: intensity_correlation has 57 NaNs ( 0.09 % out of 60008)
2:05:44.324959 INFO: Collecting fragment features
2:05:45.034871 INFO: Finished candidate scoring
2:05:45.382519 PROGRESS: === Epoch 13, step 5, extracted 60008 precursors and 304734 fragments ===
2:05:45.382854 INFO: performing precursor FDR with 47 features
2:05:45.382900 INFO: Decoy channel: -1
2:05:45.382927 INFO: Competetive: True
2:05:45.515605 WARNING: dropped 65 target PSMs due to missing features
2:05:45.515723 WARNING: dropped 41 decoy PSMs due to missing features
2:05:49.410249 INFO: Test AUC: 0.552
2:05:49.410372 INFO: Train AUC: 0.595
2:05:49.410417 INFO: AUC difference: 7.12%
2:05:49.410446 WARNING: AUC difference > 5%. This may indicate overfitting.
2:05:49.543989 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
2:05:49.545415 PROGRESS: ============================= Precursor FDR =============================
2:05:49.545559 PROGRESS: Total precursors accumulated: 1,608
2:05:49.545639 PROGRESS: Target precursors: 1,469 (91.36%)
2:05:49.545707 PROGRESS: Decoy precursors: 139 (8.64%)
2:05:49.545778 PROGRESS: 
2:05:49.545844 PROGRESS: Precursor Summary:
2:05:49.547804 PROGRESS: Channel   0:	 0.05 FDR:   816; 0.01 FDR:   610; 0.001 FDR:   433
2:05:49.547940 PROGRESS: 
2:05:49.548014 PROGRESS: Protein Summary:
2:05:49.550425 PROGRESS: Channel   0:	 0.05 FDR:   763; 0.01 FDR:   563; 0.001 FDR:   404
2:05:49.550542 PROGRESS: =========================================================================
2:05:49.551789 PROGRESS: === Epoch 13, step 6, extracting elution groups 63000 to 127000 ===
2:05:49.730413 PROGRESS: Extracting batch of 126411 precursors
2:05:49.773185 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:05:49.773299 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:05:49.773337 INFO: FWHM in RT is 14.37 seconds, sigma is 0.52
2:05:49.773381 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:05:49.773639 INFO: Starting candidate selection
2:05:56.330135 INFO: Starting candidate scoring
2:05:58.845991 INFO: Finished candidate processing
2:05:58.846182 INFO: Collecting candidate features
2:06:01.376785 WARNING: intensity_correlation has 141 NaNs ( 0.12 % out of 119974)
2:06:01.389733 INFO: Collecting fragment features
2:06:02.156899 INFO: Finished candidate scoring
2:06:02.584507 PROGRESS: === Epoch 13, step 6, extracted 119974 precursors and 607700 fragments ===
2:06:02.584861 INFO: performing precursor FDR with 47 features
2:06:02.584908 INFO: Decoy channel: -1
2:06:02.584934 INFO: Competetive: True
2:06:02.859507 WARNING: dropped 125 target PSMs due to missing features
2:06:02.859624 WARNING: dropped 122 decoy PSMs due to missing features
2:06:11.424275 INFO: Test AUC: 0.553
2:06:11.424407 INFO: Train AUC: 0.586
2:06:11.424461 INFO: AUC difference: 5.61%
2:06:11.424489 WARNING: AUC difference > 5%. This may indicate overfitting.
2:06:11.579260 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
2:06:11.581209 PROGRESS: ============================= Precursor FDR =============================
2:06:11.581357 PROGRESS: Total precursors accumulated: 3,232
2:06:11.581437 PROGRESS: Target precursors: 2,948 (91.21%)
2:06:11.581505 PROGRESS: Decoy precursors: 284 (8.79%)
2:06:11.581568 PROGRESS: 
2:06:11.581631 PROGRESS: Precursor Summary:
2:06:11.583981 PROGRESS: Channel   0:	 0.05 FDR: 1,862; 0.01 FDR: 1,013; 0.001 FDR:   716
2:06:11.584106 PROGRESS: 
2:06:11.584182 PROGRESS: Protein Summary:
2:06:11.587209 PROGRESS: Channel   0:	 0.05 FDR: 1,664; 0.01 FDR:   901; 0.001 FDR:   641
2:06:11.587340 PROGRESS: =========================================================================
2:06:11.588803 PROGRESS: === Epoch 13, step 7, extracting elution groups 127000 to 255000 ===
2:06:11.816031 PROGRESS: Extracting batch of 252909 precursors
2:06:11.889224 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:06:11.889338 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:06:11.889377 INFO: FWHM in RT is 14.37 seconds, sigma is 0.52
2:06:11.889421 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:06:11.889690 INFO: Starting candidate selection
2:06:21.292311 INFO: Starting candidate scoring
2:06:25.078555 INFO: Finished candidate processing
2:06:25.078783 INFO: Collecting candidate features
2:06:28.031104 WARNING: intensity_correlation has 260 NaNs ( 0.11 % out of 239688)
2:06:28.052006 INFO: Collecting fragment features
2:06:28.930656 INFO: Finished candidate scoring
2:06:29.514524 PROGRESS: === Epoch 13, step 7, extracted 239688 precursors and 1211119 fragments ===
2:06:29.514866 INFO: performing precursor FDR with 47 features
2:06:29.514911 INFO: Decoy channel: -1
2:06:29.514937 INFO: Competetive: True
2:06:30.110595 WARNING: dropped 249 target PSMs due to missing features
2:06:30.110722 WARNING: dropped 258 decoy PSMs due to missing features
2:06:47.529245 INFO: Test AUC: 0.550
2:06:47.529374 INFO: Train AUC: 0.574
2:06:47.529430 INFO: AUC difference: 4.25%
2:06:47.714662 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
2:06:47.717036 PROGRESS: ============================= Precursor FDR =============================
2:06:47.717191 PROGRESS: Total precursors accumulated: 4,749
2:06:47.717268 PROGRESS: Target precursors: 4,332 (91.22%)
2:06:47.717335 PROGRESS: Decoy precursors: 417 (8.78%)
2:06:47.717397 PROGRESS: 
2:06:47.717475 PROGRESS: Precursor Summary:
2:06:47.720491 PROGRESS: Channel   0:	 0.05 FDR: 3,174; 0.01 FDR: 2,026; 0.001 FDR: 1,511
2:06:47.720624 PROGRESS: 
2:06:47.720725 PROGRESS: Protein Summary:
2:06:47.724674 PROGRESS: Channel   0:	 0.05 FDR: 2,502; 0.01 FDR: 1,556; 0.001 FDR: 1,178
2:06:47.724788 PROGRESS: =========================================================================
2:06:47.726800 PROGRESS: === Epoch 13, step 8, extracting elution groups 255000 to 511000 ===
2:06:48.033783 PROGRESS: Extracting batch of 505893 precursors
2:06:48.168596 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:06:48.168715 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:06:48.168750 INFO: FWHM in RT is 14.37 seconds, sigma is 0.52
2:06:48.168794 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:06:48.169058 INFO: Starting candidate selection
2:07:03.237228 INFO: Starting candidate scoring
2:07:09.558715 INFO: Finished candidate processing
2:07:09.558910 INFO: Collecting candidate features
2:07:13.215932 WARNING: intensity_correlation has 502 NaNs ( 0.10 % out of 479963)
2:07:13.217003 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 479963)
2:07:13.250271 INFO: Collecting fragment features
2:07:14.310616 INFO: Finished candidate scoring
2:07:15.201657 PROGRESS: === Epoch 13, step 8, extracted 479963 precursors and 2428044 fragments ===
2:07:15.208899 INFO: performing precursor FDR with 47 features
2:07:15.209002 INFO: Decoy channel: -1
2:07:15.209030 INFO: Competetive: True
2:07:16.367511 WARNING: dropped 488 target PSMs due to missing features
2:07:16.367636 WARNING: dropped 521 decoy PSMs due to missing features
2:07:51.830872 INFO: Test AUC: 0.552
2:07:51.831005 INFO: Train AUC: 0.568
2:07:51.831060 INFO: AUC difference: 2.91%
2:07:52.076330 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
2:07:52.079522 PROGRESS: ============================= Precursor FDR =============================
2:07:52.079687 PROGRESS: Total precursors accumulated: 7,754
2:07:52.079767 PROGRESS: Target precursors: 7,080 (91.31%)
2:07:52.079834 PROGRESS: Decoy precursors: 674 (8.69%)
2:07:52.079898 PROGRESS: 
2:07:52.079961 PROGRESS: Precursor Summary:
2:07:52.083964 PROGRESS: Channel   0:	 0.05 FDR: 5,746; 0.01 FDR: 4,096; 0.001 FDR: 2,300
2:07:52.084116 PROGRESS: 
2:07:52.084190 PROGRESS: Protein Summary:
2:07:52.089852 PROGRESS: Channel   0:	 0.05 FDR: 3,814; 0.01 FDR: 2,628; 0.001 FDR: 1,619
2:07:52.089991 PROGRESS: =========================================================================
2:07:52.094721 INFO: calibration group: precursor, fitting rt estimator 
2:07:52.607433 INFO: calibration group: fragment, fitting mz estimator 
2:07:53.223104 INFO: === checking if epoch conditions were reached ===
2:07:53.223273 INFO: ✅ ms2_error      : 7.0000 <= 7
2:07:53.223398 INFO: ❌ rt_error       : 234.5809 > 100
2:07:53.223473 INFO: ✅ current_epoch  : 13 >= 3
2:07:53.223546 INFO: ==============================================
2:07:53.444939 INFO: calibration group: precursor, predicting mz
2:07:53.445217 WARNING: mz prediction was skipped as it has not been fitted yet
2:07:53.445257 INFO: calibration group: precursor, predicting rt
2:08:00.173571 INFO: calibration group: fragment, predicting mz
2:08:17.961040 PROGRESS: === Epoch 14, step 0, extracting elution groups 0 to 1000 ===
2:08:18.059218 PROGRESS: Extracting batch of 1977 precursors
2:08:18.060965 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:08:18.061057 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:08:18.061097 INFO: FWHM in RT is 14.43 seconds, sigma is 0.53
2:08:18.061126 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:08:18.061376 INFO: Starting candidate selection
2:08:22.184357 INFO: Starting candidate scoring
2:08:23.473432 INFO: Finished candidate processing
2:08:23.473524 INFO: Collecting candidate features
2:08:25.647426 WARNING: intensity_correlation has 1 NaNs ( 0.05 % out of 1872)
2:08:25.653316 INFO: Collecting fragment features
2:08:26.289834 INFO: Finished candidate scoring
2:08:26.632853 PROGRESS: === Epoch 14, step 0, extracted 1872 precursors and 9178 fragments ===
2:08:26.633182 INFO: performing precursor FDR with 47 features
2:08:26.633226 INFO: Decoy channel: -1
2:08:26.633252 INFO: Competetive: True
2:08:26.637716 WARNING: dropped 1 decoy PSMs due to missing features
2:08:26.666857 INFO: Test AUC: 0.559
2:08:26.666951 INFO: Train AUC: 0.531
2:08:26.666996 INFO: AUC difference: 5.17%
2:08:26.667030 WARNING: AUC difference > 5%. This may indicate overfitting.
2:08:26.784717 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
2:08:26.785520 PROGRESS: ============================= Precursor FDR =============================
2:08:26.785643 PROGRESS: Total precursors accumulated: 6
2:08:26.785721 PROGRESS: Target precursors: 6 (100.00%)
2:08:26.785805 PROGRESS: Decoy precursors: 0 (0.00%)
2:08:26.785870 PROGRESS: 
2:08:26.785931 PROGRESS: Precursor Summary:
2:08:26.787405 PROGRESS: Channel   0:	 0.05 FDR:     6; 0.01 FDR:     6; 0.001 FDR:     6
2:08:26.787515 PROGRESS: 
2:08:26.787590 PROGRESS: Protein Summary:
2:08:26.789269 PROGRESS: Channel   0:	 0.05 FDR:     6; 0.01 FDR:     6; 0.001 FDR:     6
2:08:26.789378 PROGRESS: =========================================================================
2:08:26.790271 PROGRESS: === Epoch 14, step 1, extracting elution groups 1000 to 3000 ===
2:08:26.867817 PROGRESS: Extracting batch of 3947 precursors
2:08:26.870019 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:08:26.870109 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:08:26.870152 INFO: FWHM in RT is 14.43 seconds, sigma is 0.53
2:08:26.870183 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:08:26.870401 INFO: Starting candidate selection
2:08:30.643715 INFO: Starting candidate scoring
2:08:31.952429 INFO: Finished candidate processing
2:08:31.952520 INFO: Collecting candidate features
2:08:34.138623 WARNING: intensity_correlation has 7 NaNs ( 0.19 % out of 3712)
2:08:34.144735 INFO: Collecting fragment features
2:08:34.792140 INFO: Finished candidate scoring
2:08:35.074099 PROGRESS: === Epoch 14, step 1, extracted 3712 precursors and 18609 fragments ===
2:08:35.074389 INFO: performing precursor FDR with 47 features
2:08:35.074434 INFO: Decoy channel: -1
2:08:35.074461 INFO: Competetive: True
2:08:35.083127 WARNING: dropped 2 target PSMs due to missing features
2:08:35.083214 WARNING: dropped 6 decoy PSMs due to missing features
2:08:35.120644 INFO: Test AUC: 0.512
2:08:35.120763 INFO: Train AUC: 0.553
2:08:35.120808 INFO: AUC difference: 7.31%
2:08:35.120843 WARNING: AUC difference > 5%. This may indicate overfitting.
2:08:35.248766 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
2:08:35.249546 PROGRESS: ============================= Precursor FDR =============================
2:08:35.249666 PROGRESS: Total precursors accumulated: 28
2:08:35.249744 PROGRESS: Target precursors: 26 (92.86%)
2:08:35.249822 PROGRESS: Decoy precursors: 2 (7.14%)
2:08:35.249885 PROGRESS: 
2:08:35.249946 PROGRESS: Precursor Summary:
2:08:35.251377 PROGRESS: Channel   0:	 0.05 FDR:    25; 0.01 FDR:    21; 0.001 FDR:    21
2:08:35.251504 PROGRESS: 
2:08:35.251578 PROGRESS: Protein Summary:
2:08:35.253184 PROGRESS: Channel   0:	 0.05 FDR:    25; 0.01 FDR:    21; 0.001 FDR:    21
2:08:35.253294 PROGRESS: =========================================================================
2:08:35.254164 PROGRESS: === Epoch 14, step 2, extracting elution groups 3000 to 7000 ===
2:08:35.336712 PROGRESS: Extracting batch of 7896 precursors
2:08:35.340010 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:08:35.340073 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:08:35.340129 INFO: FWHM in RT is 14.43 seconds, sigma is 0.53
2:08:35.340159 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:08:35.340397 INFO: Starting candidate selection
2:08:39.242974 INFO: Starting candidate scoring
2:08:40.601748 INFO: Finished candidate processing
2:08:40.601877 INFO: Collecting candidate features
2:08:42.801653 WARNING: intensity_correlation has 16 NaNs ( 0.21 % out of 7499)
2:08:42.808194 INFO: Collecting fragment features
2:08:43.462551 INFO: Finished candidate scoring
2:08:43.750941 PROGRESS: === Epoch 14, step 2, extracted 7499 precursors and 37442 fragments ===
2:08:43.751274 INFO: performing precursor FDR with 47 features
2:08:43.751318 INFO: Decoy channel: -1
2:08:43.751345 INFO: Competetive: True
2:08:43.766962 WARNING: dropped 5 target PSMs due to missing features
2:08:43.767060 WARNING: dropped 19 decoy PSMs due to missing features
2:08:44.070170 INFO: Test AUC: 0.545
2:08:44.070326 INFO: Train AUC: 0.578
2:08:44.070390 INFO: AUC difference: 5.64%
2:08:44.070438 WARNING: AUC difference > 5%. This may indicate overfitting.
2:08:44.192800 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
2:08:44.193629 PROGRESS: ============================= Precursor FDR =============================
2:08:44.193750 PROGRESS: Total precursors accumulated: 105
2:08:44.193863 PROGRESS: Target precursors: 99 (94.29%)
2:08:44.193936 PROGRESS: Decoy precursors: 6 (5.71%)
2:08:44.194000 PROGRESS: 
2:08:44.194062 PROGRESS: Precursor Summary:
2:08:44.195533 PROGRESS: Channel   0:	 0.05 FDR:    94; 0.01 FDR:    48; 0.001 FDR:    48
2:08:44.195646 PROGRESS: 
2:08:44.195721 PROGRESS: Protein Summary:
2:08:44.197396 PROGRESS: Channel   0:	 0.05 FDR:    94; 0.01 FDR:    48; 0.001 FDR:    48
2:08:44.197507 PROGRESS: =========================================================================
2:08:44.198394 PROGRESS: === Epoch 14, step 3, extracting elution groups 7000 to 15000 ===
2:08:44.290420 PROGRESS: Extracting batch of 15818 precursors
2:08:44.296140 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:08:44.296212 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:08:44.296247 INFO: FWHM in RT is 14.43 seconds, sigma is 0.53
2:08:44.296289 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:08:44.296510 INFO: Starting candidate selection
2:08:48.409781 INFO: Starting candidate scoring
2:08:49.850867 INFO: Finished candidate processing
2:08:49.850977 INFO: Collecting candidate features
2:08:52.075502 WARNING: intensity_correlation has 13 NaNs ( 0.09 % out of 14912)
2:08:52.081485 INFO: Collecting fragment features
2:08:52.746196 INFO: Finished candidate scoring
2:08:53.042270 PROGRESS: === Epoch 14, step 3, extracted 14912 precursors and 74927 fragments ===
2:08:53.042589 INFO: performing precursor FDR with 47 features
2:08:53.042637 INFO: Decoy channel: -1
2:08:53.042663 INFO: Competetive: True
2:08:53.072456 WARNING: dropped 13 target PSMs due to missing features
2:08:53.072592 WARNING: dropped 24 decoy PSMs due to missing features
2:08:53.795880 INFO: Test AUC: 0.545
2:08:53.796024 INFO: Train AUC: 0.588
2:08:53.796068 INFO: AUC difference: 7.37%
2:08:53.796102 WARNING: AUC difference > 5%. This may indicate overfitting.
2:08:53.920423 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
2:08:53.921342 PROGRESS: ============================= Precursor FDR =============================
2:08:53.921468 PROGRESS: Total precursors accumulated: 276
2:08:53.921546 PROGRESS: Target precursors: 254 (92.03%)
2:08:53.921614 PROGRESS: Decoy precursors: 22 (7.97%)
2:08:53.921678 PROGRESS: 
2:08:53.921738 PROGRESS: Precursor Summary:
2:08:53.923285 PROGRESS: Channel   0:	 0.05 FDR:   170; 0.01 FDR:   137; 0.001 FDR:   118
2:08:53.923414 PROGRESS: 
2:08:53.923499 PROGRESS: Protein Summary:
2:08:53.925281 PROGRESS: Channel   0:	 0.05 FDR:   167; 0.01 FDR:   135; 0.001 FDR:   117
2:08:53.925391 PROGRESS: =========================================================================
2:08:53.926340 PROGRESS: === Epoch 14, step 4, extracting elution groups 15000 to 31000 ===
2:08:54.033775 PROGRESS: Extracting batch of 31615 precursors
2:08:54.044480 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:08:54.044590 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:08:54.044628 INFO: FWHM in RT is 14.43 seconds, sigma is 0.53
2:08:54.044655 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:08:54.044893 INFO: Starting candidate selection
2:08:58.433473 INFO: Starting candidate scoring
2:09:00.007716 INFO: Finished candidate processing
2:09:00.007812 INFO: Collecting candidate features
2:09:02.258565 WARNING: intensity_correlation has 32 NaNs ( 0.11 % out of 29751)
2:09:02.265499 INFO: Collecting fragment features
2:09:02.939034 INFO: Finished candidate scoring
2:09:03.249916 PROGRESS: === Epoch 14, step 4, extracted 29751 precursors and 148743 fragments ===
2:09:03.250268 INFO: performing precursor FDR with 47 features
2:09:03.250313 INFO: Decoy channel: -1
2:09:03.250340 INFO: Competetive: True
2:09:03.308638 WARNING: dropped 23 target PSMs due to missing features
2:09:03.308750 WARNING: dropped 46 decoy PSMs due to missing features
2:09:05.343117 INFO: Test AUC: 0.554
2:09:05.343257 INFO: Train AUC: 0.601
2:09:05.343304 INFO: AUC difference: 7.82%
2:09:05.343337 WARNING: AUC difference > 5%. This may indicate overfitting.
2:09:05.473331 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
2:09:05.474357 PROGRESS: ============================= Precursor FDR =============================
2:09:05.474486 PROGRESS: Total precursors accumulated: 537
2:09:05.474564 PROGRESS: Target precursors: 491 (91.43%)
2:09:05.474633 PROGRESS: Decoy precursors: 46 (8.57%)
2:09:05.474697 PROGRESS: 
2:09:05.474760 PROGRESS: Precursor Summary:
2:09:05.476407 PROGRESS: Channel   0:	 0.05 FDR:   351; 0.01 FDR:   246; 0.001 FDR:   198
2:09:05.476521 PROGRESS: 
2:09:05.476595 PROGRESS: Protein Summary:
2:09:05.478533 PROGRESS: Channel   0:	 0.05 FDR:   338; 0.01 FDR:   238; 0.001 FDR:   192
2:09:05.478646 PROGRESS: =========================================================================
2:09:05.479644 PROGRESS: === Epoch 14, step 5, extracting elution groups 31000 to 63000 ===
2:09:05.617073 PROGRESS: Extracting batch of 63209 precursors
2:09:05.637211 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:09:05.637318 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:09:05.637356 INFO: FWHM in RT is 14.43 seconds, sigma is 0.53
2:09:05.637399 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:09:05.637645 INFO: Starting candidate selection
2:09:10.773484 INFO: Starting candidate scoring
2:09:12.688022 INFO: Finished candidate processing
2:09:12.688149 INFO: Collecting candidate features
2:09:15.059395 WARNING: intensity_correlation has 56 NaNs ( 0.09 % out of 59643)
2:09:15.068260 INFO: Collecting fragment features
2:09:15.784457 INFO: Finished candidate scoring
2:09:16.134366 PROGRESS: === Epoch 14, step 5, extracted 59643 precursors and 298731 fragments ===
2:09:16.134754 INFO: performing precursor FDR with 47 features
2:09:16.134822 INFO: Decoy channel: -1
2:09:16.134868 INFO: Competetive: True
2:09:16.266945 WARNING: dropped 54 target PSMs due to missing features
2:09:16.267062 WARNING: dropped 71 decoy PSMs due to missing features
2:09:20.241212 INFO: Test AUC: 0.561
2:09:20.241330 INFO: Train AUC: 0.595
2:09:20.241385 INFO: AUC difference: 5.69%
2:09:20.241413 WARNING: AUC difference > 5%. This may indicate overfitting.
2:09:20.400512 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
2:09:20.402020 PROGRESS: ============================= Precursor FDR =============================
2:09:20.402196 PROGRESS: Total precursors accumulated: 1,418
2:09:20.402311 PROGRESS: Target precursors: 1,295 (91.33%)
2:09:20.402411 PROGRESS: Decoy precursors: 123 (8.67%)
2:09:20.402503 PROGRESS: 
2:09:20.402592 PROGRESS: Precursor Summary:
2:09:20.404708 PROGRESS: Channel   0:	 0.05 FDR:   814; 0.01 FDR:   467; 0.001 FDR:   288
2:09:20.404843 PROGRESS: 
2:09:20.404917 PROGRESS: Protein Summary:
2:09:20.407167 PROGRESS: Channel   0:	 0.05 FDR:   765; 0.01 FDR:   438; 0.001 FDR:   272
2:09:20.407293 PROGRESS: =========================================================================
2:09:20.408426 PROGRESS: === Epoch 14, step 6, extracting elution groups 63000 to 127000 ===
2:09:20.584111 PROGRESS: Extracting batch of 126516 precursors
2:09:20.622462 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:09:20.622573 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:09:20.622612 INFO: FWHM in RT is 14.43 seconds, sigma is 0.53
2:09:20.622655 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:09:20.622919 INFO: Starting candidate selection
2:09:27.117525 INFO: Starting candidate scoring
2:09:29.624283 INFO: Finished candidate processing
2:09:29.624387 INFO: Collecting candidate features
2:09:32.164568 WARNING: intensity_correlation has 121 NaNs ( 0.10 % out of 119580)
2:09:32.177280 INFO: Collecting fragment features
2:09:32.949966 INFO: Finished candidate scoring
2:09:33.371552 PROGRESS: === Epoch 14, step 6, extracted 119580 precursors and 600426 fragments ===
2:09:33.371911 INFO: performing precursor FDR with 47 features
2:09:33.371958 INFO: Decoy channel: -1
2:09:33.371985 INFO: Competetive: True
2:09:33.643712 WARNING: dropped 119 target PSMs due to missing features
2:09:33.643830 WARNING: dropped 127 decoy PSMs due to missing features
2:09:42.390213 INFO: Test AUC: 0.558
2:09:42.390361 INFO: Train AUC: 0.584
2:09:42.390403 INFO: AUC difference: 4.47%
2:09:42.545962 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
2:09:42.547715 PROGRESS: ============================= Precursor FDR =============================
2:09:42.547859 PROGRESS: Total precursors accumulated: 2,795
2:09:42.547937 PROGRESS: Target precursors: 2,553 (91.34%)
2:09:42.548016 PROGRESS: Decoy precursors: 242 (8.66%)
2:09:42.548080 PROGRESS: 
2:09:42.548143 PROGRESS: Precursor Summary:
2:09:42.550429 PROGRESS: Channel   0:	 0.05 FDR: 1,719; 0.01 FDR: 1,119; 0.001 FDR:   531
2:09:42.550564 PROGRESS: 
2:09:42.550637 PROGRESS: Protein Summary:
2:09:42.553509 PROGRESS: Channel   0:	 0.05 FDR: 1,528; 0.01 FDR:   981; 0.001 FDR:   481
2:09:42.553636 PROGRESS: =========================================================================
2:09:42.555132 PROGRESS: === Epoch 14, step 7, extracting elution groups 127000 to 255000 ===
2:09:42.778440 PROGRESS: Extracting batch of 253021 precursors
2:09:42.849662 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:09:42.849783 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:09:42.849857 INFO: FWHM in RT is 14.43 seconds, sigma is 0.53
2:09:42.849885 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:09:42.850147 INFO: Starting candidate selection
2:09:52.131292 INFO: Starting candidate scoring
2:09:55.920917 INFO: Finished candidate processing
2:09:55.921008 INFO: Collecting candidate features
2:09:58.901214 WARNING: intensity_correlation has 287 NaNs ( 0.12 % out of 238881)
2:09:58.922321 INFO: Collecting fragment features
2:09:59.796865 INFO: Finished candidate scoring
2:10:00.384662 PROGRESS: === Epoch 14, step 7, extracted 238881 precursors and 1196974 fragments ===
2:10:00.384990 INFO: performing precursor FDR with 47 features
2:10:00.385034 INFO: Decoy channel: -1
2:10:00.385061 INFO: Competetive: True
2:10:00.990088 WARNING: dropped 270 target PSMs due to missing features
2:10:00.990222 WARNING: dropped 263 decoy PSMs due to missing features
2:10:17.937926 INFO: Test AUC: 0.550
2:10:17.938071 INFO: Train AUC: 0.576
2:10:17.938112 INFO: AUC difference: 4.45%
2:10:18.125056 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
2:10:18.127349 PROGRESS: ============================= Precursor FDR =============================
2:10:18.127506 PROGRESS: Total precursors accumulated: 4,522
2:10:18.127585 PROGRESS: Target precursors: 4,128 (91.29%)
2:10:18.127653 PROGRESS: Decoy precursors: 394 (8.71%)
2:10:18.127717 PROGRESS: 
2:10:18.127780 PROGRESS: Precursor Summary:
2:10:18.130828 PROGRESS: Channel   0:	 0.05 FDR: 3,223; 0.01 FDR: 2,044; 0.001 FDR: 1,489
2:10:18.130970 PROGRESS: 
2:10:18.131055 PROGRESS: Protein Summary:
2:10:18.135083 PROGRESS: Channel   0:	 0.05 FDR: 2,570; 0.01 FDR: 1,593; 0.001 FDR: 1,179
2:10:18.135215 PROGRESS: =========================================================================
2:10:18.137162 PROGRESS: === Epoch 14, step 8, extracting elution groups 255000 to 511000 ===
2:10:18.442922 PROGRESS: Extracting batch of 505889 precursors
2:10:18.577054 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:10:18.577172 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:10:18.577211 INFO: FWHM in RT is 14.43 seconds, sigma is 0.53
2:10:18.577254 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:10:18.577527 INFO: Starting candidate selection
2:10:33.326180 INFO: Starting candidate scoring
2:10:39.558289 INFO: Finished candidate processing
2:10:39.558485 INFO: Collecting candidate features
2:10:43.247532 WARNING: intensity_correlation has 545 NaNs ( 0.11 % out of 477570)
2:10:43.248635 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 477570)
2:10:43.283281 INFO: Collecting fragment features
2:10:44.351462 INFO: Finished candidate scoring
2:10:45.254210 PROGRESS: === Epoch 14, step 8, extracted 477570 precursors and 2390438 fragments ===
2:10:45.261461 INFO: performing precursor FDR with 47 features
2:10:45.261614 INFO: Decoy channel: -1
2:10:45.261702 INFO: Competetive: True
2:10:46.419109 WARNING: dropped 550 target PSMs due to missing features
2:10:46.419236 WARNING: dropped 528 decoy PSMs due to missing features
2:11:22.211448 INFO: Test AUC: 0.553
2:11:22.211579 INFO: Train AUC: 0.567
2:11:22.211634 INFO: AUC difference: 2.52%
2:11:22.471370 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
2:11:22.474499 PROGRESS: ============================= Precursor FDR =============================
2:11:22.474646 PROGRESS: Total precursors accumulated: 7,784
2:11:22.474725 PROGRESS: Target precursors: 7,105 (91.28%)
2:11:22.474793 PROGRESS: Decoy precursors: 679 (8.72%)
2:11:22.474859 PROGRESS: 
2:11:22.474924 PROGRESS: Precursor Summary:
2:11:22.478987 PROGRESS: Channel   0:	 0.05 FDR: 5,661; 0.01 FDR: 4,170; 0.001 FDR: 3,393
2:11:22.479142 PROGRESS: 
2:11:22.479214 PROGRESS: Protein Summary:
2:11:22.485090 PROGRESS: Channel   0:	 0.05 FDR: 3,805; 0.01 FDR: 2,691; 0.001 FDR: 2,203
2:11:22.485228 PROGRESS: =========================================================================
2:11:22.489961 INFO: calibration group: precursor, fitting rt estimator 
2:11:22.988663 INFO: calibration group: fragment, fitting mz estimator 
2:11:23.585589 INFO: === checking if epoch conditions were reached ===
2:11:23.585796 INFO: ✅ ms2_error      : 7.0000 <= 7
2:11:23.585888 INFO: ❌ rt_error       : 224.5178 > 100
2:11:23.585963 INFO: ✅ current_epoch  : 14 >= 3
2:11:23.586028 INFO: ==============================================
2:11:23.832933 INFO: calibration group: precursor, predicting mz
2:11:23.833210 WARNING: mz prediction was skipped as it has not been fitted yet
2:11:23.833253 INFO: calibration group: precursor, predicting rt
2:11:30.598164 INFO: calibration group: fragment, predicting mz
2:11:48.468733 PROGRESS: === Epoch 15, step 0, extracting elution groups 0 to 1000 ===
2:11:48.567336 PROGRESS: Extracting batch of 1971 precursors
2:11:48.569069 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:11:48.569161 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:11:48.569205 INFO: FWHM in RT is 14.50 seconds, sigma is 0.53
2:11:48.569252 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:11:48.569510 INFO: Starting candidate selection
2:11:52.697808 INFO: Starting candidate scoring
2:11:53.994587 INFO: Finished candidate processing
2:11:53.994677 INFO: Collecting candidate features
2:11:56.142362 WARNING: intensity_correlation has 1 NaNs ( 0.05 % out of 1856)
2:11:56.148242 INFO: Collecting fragment features
2:11:56.785601 INFO: Finished candidate scoring
2:11:57.109144 PROGRESS: === Epoch 15, step 0, extracted 1856 precursors and 9108 fragments ===
2:11:57.109453 INFO: performing precursor FDR with 47 features
2:11:57.109497 INFO: Decoy channel: -1
2:11:57.109535 INFO: Competetive: True
2:11:57.114094 WARNING: dropped 1 decoy PSMs due to missing features
2:11:57.141448 INFO: Test AUC: 0.571
2:11:57.141546 INFO: Train AUC: 0.562
2:11:57.141590 INFO: AUC difference: 1.64%
2:11:57.263630 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
2:11:57.264416 PROGRESS: ============================= Precursor FDR =============================
2:11:57.264535 PROGRESS: Total precursors accumulated: 14
2:11:57.264613 PROGRESS: Target precursors: 13 (92.86%)
2:11:57.264681 PROGRESS: Decoy precursors: 1 (7.14%)
2:11:57.264745 PROGRESS: 
2:11:57.264807 PROGRESS: Precursor Summary:
2:11:57.266229 PROGRESS: Channel   0:	 0.05 FDR:    12; 0.01 FDR:    12; 0.001 FDR:    12
2:11:57.266345 PROGRESS: 
2:11:57.266419 PROGRESS: Protein Summary:
2:11:57.268028 PROGRESS: Channel   0:	 0.05 FDR:    12; 0.01 FDR:    12; 0.001 FDR:    12
2:11:57.268154 PROGRESS: =========================================================================
2:11:57.269000 PROGRESS: === Epoch 15, step 1, extracting elution groups 1000 to 3000 ===
2:11:57.346604 PROGRESS: Extracting batch of 3965 precursors
2:11:57.348817 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:11:57.348877 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:11:57.348916 INFO: FWHM in RT is 14.50 seconds, sigma is 0.53
2:11:57.348945 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:11:57.349173 INFO: Starting candidate selection
2:12:01.202476 INFO: Starting candidate scoring
2:12:02.515180 INFO: Finished candidate processing
2:12:02.515275 INFO: Collecting candidate features
2:12:04.692002 WARNING: intensity_correlation has 6 NaNs ( 0.16 % out of 3701)
2:12:04.698053 INFO: Collecting fragment features
2:12:05.337333 INFO: Finished candidate scoring
2:12:05.617188 PROGRESS: === Epoch 15, step 1, extracted 3701 precursors and 18476 fragments ===
2:12:05.617471 INFO: performing precursor FDR with 47 features
2:12:05.617521 INFO: Decoy channel: -1
2:12:05.617548 INFO: Competetive: True
2:12:05.626112 WARNING: dropped 3 target PSMs due to missing features
2:12:05.626203 WARNING: dropped 4 decoy PSMs due to missing features
2:12:05.662887 INFO: Test AUC: 0.542
2:12:05.663009 INFO: Train AUC: 0.558
2:12:05.663054 INFO: AUC difference: 2.82%
2:12:05.782546 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
2:12:05.783371 PROGRESS: ============================= Precursor FDR =============================
2:12:05.783494 PROGRESS: Total precursors accumulated: 32
2:12:05.783571 PROGRESS: Target precursors: 30 (93.75%)
2:12:05.783639 PROGRESS: Decoy precursors: 2 (6.25%)
2:12:05.783704 PROGRESS: 
2:12:05.783765 PROGRESS: Precursor Summary:
2:12:05.785189 PROGRESS: Channel   0:	 0.05 FDR:    27; 0.01 FDR:    27; 0.001 FDR:    27
2:12:05.785299 PROGRESS: 
2:12:05.785372 PROGRESS: Protein Summary:
2:12:05.787003 PROGRESS: Channel   0:	 0.05 FDR:    27; 0.01 FDR:    27; 0.001 FDR:    27
2:12:05.787115 PROGRESS: =========================================================================
2:12:05.787974 PROGRESS: === Epoch 15, step 2, extracting elution groups 3000 to 7000 ===
2:12:05.870396 PROGRESS: Extracting batch of 7914 precursors
2:12:05.873739 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:12:05.873848 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:12:05.873892 INFO: FWHM in RT is 14.50 seconds, sigma is 0.53
2:12:05.873924 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:12:05.874151 INFO: Starting candidate selection
2:12:09.745342 INFO: Starting candidate scoring
2:12:11.092180 INFO: Finished candidate processing
2:12:11.092275 INFO: Collecting candidate features
2:12:13.260240 WARNING: intensity_correlation has 16 NaNs ( 0.21 % out of 7502)
2:12:13.266806 INFO: Collecting fragment features
2:12:13.926466 INFO: Finished candidate scoring
2:12:14.209986 PROGRESS: === Epoch 15, step 2, extracted 7502 precursors and 37055 fragments ===
2:12:14.210322 INFO: performing precursor FDR with 47 features
2:12:14.210368 INFO: Decoy channel: -1
2:12:14.210395 INFO: Competetive: True
2:12:14.225332 WARNING: dropped 12 target PSMs due to missing features
2:12:14.225452 WARNING: dropped 11 decoy PSMs due to missing features
2:12:14.463165 INFO: Test AUC: 0.550
2:12:14.463300 INFO: Train AUC: 0.581
2:12:14.463375 INFO: AUC difference: 5.42%
2:12:14.463425 WARNING: AUC difference > 5%. This may indicate overfitting.
2:12:14.587006 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
2:12:14.587875 PROGRESS: ============================= Precursor FDR =============================
2:12:14.588010 PROGRESS: Total precursors accumulated: 89
2:12:14.588100 PROGRESS: Target precursors: 81 (91.01%)
2:12:14.588181 PROGRESS: Decoy precursors: 8 (8.99%)
2:12:14.588271 PROGRESS: 
2:12:14.588360 PROGRESS: Precursor Summary:
2:12:14.590375 PROGRESS: Channel   0:	 0.05 FDR:    66; 0.01 FDR:    50; 0.001 FDR:    50
2:12:14.590513 PROGRESS: 
2:12:14.590610 PROGRESS: Protein Summary:
2:12:14.592314 PROGRESS: Channel   0:	 0.05 FDR:    65; 0.01 FDR:    50; 0.001 FDR:    50
2:12:14.592451 PROGRESS: =========================================================================
2:12:14.593627 PROGRESS: === Epoch 15, step 3, extracting elution groups 7000 to 15000 ===
2:12:14.685868 PROGRESS: Extracting batch of 15811 precursors
2:12:14.691591 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:12:14.691684 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:12:14.691729 INFO: FWHM in RT is 14.50 seconds, sigma is 0.53
2:12:14.691761 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:12:14.691994 INFO: Starting candidate selection
2:12:18.737452 INFO: Starting candidate scoring
2:12:20.158062 INFO: Finished candidate processing
2:12:20.158159 INFO: Collecting candidate features
2:12:22.380051 WARNING: intensity_correlation has 19 NaNs ( 0.13 % out of 14779)
2:12:22.386224 INFO: Collecting fragment features
2:12:23.042237 INFO: Finished candidate scoring
2:12:23.334988 PROGRESS: === Epoch 15, step 3, extracted 14779 precursors and 73062 fragments ===
2:12:23.335319 INFO: performing precursor FDR with 47 features
2:12:23.335367 INFO: Decoy channel: -1
2:12:23.335393 INFO: Competetive: True
2:12:23.364079 WARNING: dropped 21 target PSMs due to missing features
2:12:23.364210 WARNING: dropped 21 decoy PSMs due to missing features
2:12:24.100864 INFO: Test AUC: 0.548
2:12:24.101011 INFO: Train AUC: 0.592
2:12:24.101058 INFO: AUC difference: 7.47%
2:12:24.101092 WARNING: AUC difference > 5%. This may indicate overfitting.
2:12:26.415466 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
2:12:26.416452 PROGRESS: ============================= Precursor FDR =============================
2:12:26.416583 PROGRESS: Total precursors accumulated: 358
2:12:26.416661 PROGRESS: Target precursors: 328 (91.62%)
2:12:26.416729 PROGRESS: Decoy precursors: 30 (8.38%)
2:12:26.416804 PROGRESS: 
2:12:26.416867 PROGRESS: Precursor Summary:
2:12:26.418458 PROGRESS: Channel   0:	 0.05 FDR:   186; 0.01 FDR:   123; 0.001 FDR:   105
2:12:26.418573 PROGRESS: 
2:12:26.418646 PROGRESS: Protein Summary:
2:12:26.420451 PROGRESS: Channel   0:	 0.05 FDR:   184; 0.01 FDR:   122; 0.001 FDR:   104
2:12:26.420564 PROGRESS: =========================================================================
2:12:26.421499 PROGRESS: === Epoch 15, step 4, extracting elution groups 15000 to 31000 ===
2:12:26.528313 PROGRESS: Extracting batch of 31624 precursors
2:12:26.538844 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:12:26.538940 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:12:26.538978 INFO: FWHM in RT is 14.50 seconds, sigma is 0.53
2:12:26.539005 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:12:26.539247 INFO: Starting candidate selection
2:12:30.916488 INFO: Starting candidate scoring
2:12:32.493324 INFO: Finished candidate processing
2:12:32.493510 INFO: Collecting candidate features
2:12:34.756777 WARNING: intensity_correlation has 40 NaNs ( 0.14 % out of 29554)
2:12:34.763709 INFO: Collecting fragment features
2:12:35.438197 INFO: Finished candidate scoring
2:12:35.754340 PROGRESS: === Epoch 15, step 4, extracted 29554 precursors and 146689 fragments ===
2:12:35.754692 INFO: performing precursor FDR with 47 features
2:12:35.754741 INFO: Decoy channel: -1
2:12:35.754767 INFO: Competetive: True
2:12:35.813533 WARNING: dropped 38 target PSMs due to missing features
2:12:35.813642 WARNING: dropped 44 decoy PSMs due to missing features
2:12:37.580480 INFO: Test AUC: 0.552
2:12:37.580661 INFO: Train AUC: 0.605
2:12:37.580714 INFO: AUC difference: 8.69%
2:12:37.580749 WARNING: AUC difference > 5%. This may indicate overfitting.
2:12:37.708635 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
2:12:37.709806 PROGRESS: ============================= Precursor FDR =============================
2:12:37.709947 PROGRESS: Total precursors accumulated: 828
2:12:37.710026 PROGRESS: Target precursors: 756 (91.30%)
2:12:37.710093 PROGRESS: Decoy precursors: 72 (8.70%)
2:12:37.710156 PROGRESS: 
2:12:37.710217 PROGRESS: Precursor Summary:
2:12:37.711910 PROGRESS: Channel   0:	 0.05 FDR:   434; 0.01 FDR:   142; 0.001 FDR:   141
2:12:37.712030 PROGRESS: 
2:12:37.712105 PROGRESS: Protein Summary:
2:12:37.714084 PROGRESS: Channel   0:	 0.05 FDR:   423; 0.01 FDR:   137; 0.001 FDR:   136
2:12:37.714211 PROGRESS: =========================================================================
2:12:37.715180 PROGRESS: === Epoch 15, step 5, extracting elution groups 31000 to 63000 ===
2:12:37.853006 PROGRESS: Extracting batch of 63247 precursors
2:12:37.873524 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:12:37.873636 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:12:37.873693 INFO: FWHM in RT is 14.50 seconds, sigma is 0.53
2:12:37.873721 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:12:37.873996 INFO: Starting candidate selection
2:12:42.896686 INFO: Starting candidate scoring
2:12:44.769001 INFO: Finished candidate processing
2:12:44.769110 INFO: Collecting candidate features
2:12:47.136447 WARNING: intensity_correlation has 88 NaNs ( 0.15 % out of 59546)
2:12:47.145475 INFO: Collecting fragment features
2:12:47.861319 INFO: Finished candidate scoring
2:12:48.214470 PROGRESS: === Epoch 15, step 5, extracted 59546 precursors and 295030 fragments ===
2:12:48.214833 INFO: performing precursor FDR with 47 features
2:12:48.214880 INFO: Decoy channel: -1
2:12:48.214910 INFO: Competetive: True
2:12:48.348331 WARNING: dropped 85 target PSMs due to missing features
2:12:48.348450 WARNING: dropped 85 decoy PSMs due to missing features
2:12:52.321143 INFO: Test AUC: 0.560
2:12:52.321259 INFO: Train AUC: 0.598
2:12:52.321317 INFO: AUC difference: 6.33%
2:12:52.321347 WARNING: AUC difference > 5%. This may indicate overfitting.
2:12:52.457272 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
2:12:52.458808 PROGRESS: ============================= Precursor FDR =============================
2:12:52.458948 PROGRESS: Total precursors accumulated: 1,676
2:12:52.459028 PROGRESS: Target precursors: 1,530 (91.29%)
2:12:52.459096 PROGRESS: Decoy precursors: 146 (8.71%)
2:12:52.459158 PROGRESS: 
2:12:52.459218 PROGRESS: Precursor Summary:
2:12:52.461138 PROGRESS: Channel   0:	 0.05 FDR:   865; 0.01 FDR:   409; 0.001 FDR:   316
2:12:52.461292 PROGRESS: 
2:12:52.461367 PROGRESS: Protein Summary:
2:12:52.463699 PROGRESS: Channel   0:	 0.05 FDR:   816; 0.01 FDR:   383; 0.001 FDR:   301
2:12:52.463839 PROGRESS: =========================================================================
2:12:52.464977 PROGRESS: === Epoch 15, step 6, extracting elution groups 63000 to 127000 ===
2:12:52.641583 PROGRESS: Extracting batch of 126445 precursors
2:12:52.680298 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:12:52.680430 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:12:52.680474 INFO: FWHM in RT is 14.50 seconds, sigma is 0.53
2:12:52.680501 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:12:52.680797 INFO: Starting candidate selection
2:12:59.004895 INFO: Starting candidate scoring
2:13:01.491710 INFO: Finished candidate processing
2:13:01.491832 INFO: Collecting candidate features
2:13:04.048206 WARNING: intensity_correlation has 171 NaNs ( 0.14 % out of 118645)
2:13:04.061141 INFO: Collecting fragment features
2:13:04.836419 INFO: Finished candidate scoring
2:13:05.265296 PROGRESS: === Epoch 15, step 6, extracted 118645 precursors and 587540 fragments ===
2:13:05.265669 INFO: performing precursor FDR with 47 features
2:13:05.265713 INFO: Decoy channel: -1
2:13:05.265740 INFO: Competetive: True
2:13:05.542270 WARNING: dropped 171 target PSMs due to missing features
2:13:05.542404 WARNING: dropped 170 decoy PSMs due to missing features
2:13:13.850948 INFO: Test AUC: 0.552
2:13:13.851076 INFO: Train AUC: 0.589
2:13:13.851133 INFO: AUC difference: 6.37%
2:13:13.851161 WARNING: AUC difference > 5%. This may indicate overfitting.
2:13:14.006174 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
2:13:14.008071 PROGRESS: ============================= Precursor FDR =============================
2:13:14.008228 PROGRESS: Total precursors accumulated: 2,766
2:13:14.008307 PROGRESS: Target precursors: 2,524 (91.25%)
2:13:14.008374 PROGRESS: Decoy precursors: 242 (8.75%)
2:13:14.008438 PROGRESS: 
2:13:14.008499 PROGRESS: Precursor Summary:
2:13:14.010882 PROGRESS: Channel   0:	 0.05 FDR: 1,645; 0.01 FDR: 1,018; 0.001 FDR:   583
2:13:14.011032 PROGRESS: 
2:13:14.011111 PROGRESS: Protein Summary:
2:13:14.014125 PROGRESS: Channel   0:	 0.05 FDR: 1,462; 0.01 FDR:   896; 0.001 FDR:   530
2:13:14.014243 PROGRESS: =========================================================================
2:13:14.015746 PROGRESS: === Epoch 15, step 7, extracting elution groups 127000 to 255000 ===
2:13:14.241899 PROGRESS: Extracting batch of 252842 precursors
2:13:14.315077 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:13:14.315192 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:13:14.315230 INFO: FWHM in RT is 14.50 seconds, sigma is 0.53
2:13:14.315272 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:13:14.315545 INFO: Starting candidate selection
2:13:23.218418 INFO: Starting candidate scoring
2:13:26.950353 INFO: Finished candidate processing
2:13:26.950450 INFO: Collecting candidate features
2:13:29.886748 WARNING: intensity_correlation has 348 NaNs ( 0.15 % out of 237382)
2:13:29.887439 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 237382)
2:13:29.907500 INFO: Collecting fragment features
2:13:30.768820 INFO: Finished candidate scoring
2:13:31.346970 PROGRESS: === Epoch 15, step 7, extracted 237382 precursors and 1177328 fragments ===
2:13:31.347332 INFO: performing precursor FDR with 47 features
2:13:31.347378 INFO: Decoy channel: -1
2:13:31.347404 INFO: Competetive: True
2:13:31.940501 WARNING: dropped 356 target PSMs due to missing features
2:13:31.940620 WARNING: dropped 333 decoy PSMs due to missing features
2:13:49.075629 INFO: Test AUC: 0.555
2:13:49.075763 INFO: Train AUC: 0.576
2:13:49.075821 INFO: AUC difference: 3.70%
2:13:49.259263 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
2:13:49.261634 PROGRESS: ============================= Precursor FDR =============================
2:13:49.261816 PROGRESS: Total precursors accumulated: 4,316
2:13:49.261899 PROGRESS: Target precursors: 3,937 (91.22%)
2:13:49.261968 PROGRESS: Decoy precursors: 379 (8.78%)
2:13:49.262033 PROGRESS: 
2:13:49.262107 PROGRESS: Precursor Summary:
2:13:49.265009 PROGRESS: Channel   0:	 0.05 FDR: 2,938; 0.01 FDR: 1,708; 0.001 FDR: 1,217
2:13:49.265159 PROGRESS: 
2:13:49.265231 PROGRESS: Protein Summary:
2:13:49.269114 PROGRESS: Channel   0:	 0.05 FDR: 2,375; 0.01 FDR: 1,362; 0.001 FDR: 1,009
2:13:49.269248 PROGRESS: =========================================================================
2:13:49.271141 PROGRESS: === Epoch 15, step 8, extracting elution groups 255000 to 511000 ===
2:13:49.578533 PROGRESS: Extracting batch of 505837 precursors
2:13:49.713936 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:13:49.714072 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:13:49.714113 INFO: FWHM in RT is 14.50 seconds, sigma is 0.53
2:13:49.714141 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:13:49.714418 INFO: Starting candidate selection
2:14:03.720740 INFO: Starting candidate scoring
2:14:09.850856 INFO: Finished candidate processing
2:14:09.851051 INFO: Collecting candidate features
2:14:13.535166 WARNING: intensity_correlation has 654 NaNs ( 0.14 % out of 474193)
2:14:13.536250 WARNING: height_correlation has 2 NaNs ( 0.00 % out of 474193)
2:14:13.570559 INFO: Collecting fragment features
2:14:14.637258 INFO: Finished candidate scoring
2:14:15.525470 PROGRESS: === Epoch 15, step 8, extracted 474193 precursors and 2348574 fragments ===
2:14:15.525845 INFO: performing precursor FDR with 47 features
2:14:15.525895 INFO: Decoy channel: -1
2:14:15.525921 INFO: Competetive: True
2:14:16.692710 WARNING: dropped 691 target PSMs due to missing features
2:14:16.692835 WARNING: dropped 652 decoy PSMs due to missing features
2:14:50.801967 INFO: Test AUC: 0.554
2:14:50.802097 INFO: Train AUC: 0.569
2:14:50.802142 INFO: AUC difference: 2.74%
2:14:51.042518 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
2:14:51.045557 PROGRESS: ============================= Precursor FDR =============================
2:14:51.045716 PROGRESS: Total precursors accumulated: 7,319
2:14:51.045821 PROGRESS: Target precursors: 6,683 (91.31%)
2:14:51.045892 PROGRESS: Decoy precursors: 636 (8.69%)
2:14:51.045957 PROGRESS: 
2:14:51.046019 PROGRESS: Precursor Summary:
2:14:51.049856 PROGRESS: Channel   0:	 0.05 FDR: 5,422; 0.01 FDR: 3,830; 0.001 FDR: 2,132
2:14:51.050002 PROGRESS: 
2:14:51.050074 PROGRESS: Protein Summary:
2:14:51.055725 PROGRESS: Channel   0:	 0.05 FDR: 3,619; 0.01 FDR: 2,503; 0.001 FDR: 1,545
2:14:51.055871 PROGRESS: =========================================================================
2:14:51.060507 INFO: calibration group: precursor, fitting rt estimator 
2:14:51.515090 INFO: calibration group: fragment, fitting mz estimator 
2:14:52.103302 INFO: === checking if epoch conditions were reached ===
2:14:52.103517 INFO: ✅ ms2_error      : 7.0000 <= 7
2:14:52.103605 INFO: ❌ rt_error       : 201.8863 > 100
2:14:52.103688 INFO: ✅ current_epoch  : 15 >= 3
2:14:52.103756 INFO: ==============================================
2:14:52.346656 INFO: calibration group: precursor, predicting mz
2:14:52.346923 WARNING: mz prediction was skipped as it has not been fitted yet
2:14:52.346965 INFO: calibration group: precursor, predicting rt
2:14:59.071298 INFO: calibration group: fragment, predicting mz
2:15:16.964057 PROGRESS: === Epoch 16, step 0, extracting elution groups 0 to 1000 ===
2:15:17.063496 PROGRESS: Extracting batch of 1971 precursors
2:15:17.065271 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:15:17.065367 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:15:17.065409 INFO: FWHM in RT is 14.42 seconds, sigma is 0.52
2:15:17.065440 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:15:17.065675 INFO: Starting candidate selection
2:15:21.200513 INFO: Starting candidate scoring
2:15:22.486133 INFO: Finished candidate processing
2:15:22.486223 INFO: Collecting candidate features
2:15:24.660497 WARNING: intensity_correlation has 2 NaNs ( 0.11 % out of 1862)
2:15:24.666549 INFO: Collecting fragment features
2:15:25.314755 INFO: Finished candidate scoring
2:15:25.640723 PROGRESS: === Epoch 16, step 0, extracted 1862 precursors and 9224 fragments ===
2:15:25.641047 INFO: performing precursor FDR with 47 features
2:15:25.641088 INFO: Decoy channel: -1
2:15:25.641114 INFO: Competetive: True
2:15:25.646123 WARNING: dropped 1 target PSMs due to missing features
2:15:25.646215 WARNING: dropped 1 decoy PSMs due to missing features
2:15:25.675036 INFO: Test AUC: 0.567
2:15:25.675134 INFO: Train AUC: 0.507
2:15:25.675180 INFO: AUC difference: 11.71%
2:15:25.675215 WARNING: AUC difference > 5%. This may indicate overfitting.
2:15:25.806338 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
2:15:25.807135 PROGRESS: ============================= Precursor FDR =============================
2:15:25.807253 PROGRESS: Total precursors accumulated: 10
2:15:25.807331 PROGRESS: Target precursors: 10 (100.00%)
2:15:25.807399 PROGRESS: Decoy precursors: 0 (0.00%)
2:15:25.807461 PROGRESS: 
2:15:25.807523 PROGRESS: Precursor Summary:
2:15:25.809011 PROGRESS: Channel   0:	 0.05 FDR:    10; 0.01 FDR:    10; 0.001 FDR:    10
2:15:25.809120 PROGRESS: 
2:15:25.809192 PROGRESS: Protein Summary:
2:15:25.810881 PROGRESS: Channel   0:	 0.05 FDR:    10; 0.01 FDR:    10; 0.001 FDR:    10
2:15:25.810992 PROGRESS: =========================================================================
2:15:25.811874 PROGRESS: === Epoch 16, step 1, extracting elution groups 1000 to 3000 ===
2:15:25.890124 PROGRESS: Extracting batch of 3945 precursors
2:15:25.892417 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:15:25.892480 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:15:25.892520 INFO: FWHM in RT is 14.42 seconds, sigma is 0.52
2:15:25.892568 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:15:25.892790 INFO: Starting candidate selection
2:15:29.747831 INFO: Starting candidate scoring
2:15:31.083372 INFO: Finished candidate processing
2:15:31.083550 INFO: Collecting candidate features
2:15:33.272522 WARNING: intensity_correlation has 6 NaNs ( 0.16 % out of 3686)
2:15:33.278724 INFO: Collecting fragment features
2:15:33.927065 INFO: Finished candidate scoring
2:15:34.209802 PROGRESS: === Epoch 16, step 1, extracted 3686 precursors and 18270 fragments ===
2:15:34.210090 INFO: performing precursor FDR with 47 features
2:15:34.210133 INFO: Decoy channel: -1
2:15:34.210160 INFO: Competetive: True
2:15:34.219103 WARNING: dropped 4 target PSMs due to missing features
2:15:34.219191 WARNING: dropped 4 decoy PSMs due to missing features
2:15:34.257246 INFO: Test AUC: 0.536
2:15:34.257367 INFO: Train AUC: 0.552
2:15:34.257414 INFO: AUC difference: 2.90%
2:15:34.384592 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
2:15:34.385396 PROGRESS: ============================= Precursor FDR =============================
2:15:34.385536 PROGRESS: Total precursors accumulated: 28
2:15:34.385641 PROGRESS: Target precursors: 27 (96.43%)
2:15:34.385730 PROGRESS: Decoy precursors: 1 (3.57%)
2:15:34.385822 PROGRESS: 
2:15:34.385889 PROGRESS: Precursor Summary:
2:15:34.387349 PROGRESS: Channel   0:	 0.05 FDR:    27; 0.01 FDR:    25; 0.001 FDR:    25
2:15:34.387477 PROGRESS: 
2:15:34.387551 PROGRESS: Protein Summary:
2:15:34.389187 PROGRESS: Channel   0:	 0.05 FDR:    26; 0.01 FDR:    24; 0.001 FDR:    24
2:15:34.389313 PROGRESS: =========================================================================
2:15:34.390206 PROGRESS: === Epoch 16, step 2, extracting elution groups 3000 to 7000 ===
2:15:34.472367 PROGRESS: Extracting batch of 7907 precursors
2:15:34.475888 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:15:34.475953 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:15:34.475991 INFO: FWHM in RT is 14.42 seconds, sigma is 0.52
2:15:34.476037 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:15:34.476290 INFO: Starting candidate selection
2:15:38.365135 INFO: Starting candidate scoring
2:15:39.703433 INFO: Finished candidate processing
2:15:39.703558 INFO: Collecting candidate features
2:15:41.901235 WARNING: intensity_correlation has 13 NaNs ( 0.17 % out of 7430)
2:15:41.907024 INFO: Collecting fragment features
2:15:42.560788 INFO: Finished candidate scoring
2:15:42.849146 PROGRESS: === Epoch 16, step 2, extracted 7430 precursors and 36885 fragments ===
2:15:42.849470 INFO: performing precursor FDR with 47 features
2:15:42.849516 INFO: Decoy channel: -1
2:15:42.849543 INFO: Competetive: True
2:15:42.864903 WARNING: dropped 11 target PSMs due to missing features
2:15:42.865003 WARNING: dropped 10 decoy PSMs due to missing features
2:15:43.113250 INFO: Test AUC: 0.539
2:15:43.113387 INFO: Train AUC: 0.576
2:15:43.113432 INFO: AUC difference: 6.42%
2:15:43.113481 WARNING: AUC difference > 5%. This may indicate overfitting.
2:15:43.233361 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
2:15:43.234243 PROGRESS: ============================= Precursor FDR =============================
2:15:43.234374 PROGRESS: Total precursors accumulated: 126
2:15:43.234452 PROGRESS: Target precursors: 116 (92.06%)
2:15:43.234521 PROGRESS: Decoy precursors: 10 (7.94%)
2:15:43.234585 PROGRESS: 
2:15:43.234646 PROGRESS: Precursor Summary:
2:15:43.236150 PROGRESS: Channel   0:	 0.05 FDR:    91; 0.01 FDR:    81; 0.001 FDR:    81
2:15:43.236271 PROGRESS: 
2:15:43.236346 PROGRESS: Protein Summary:
2:15:43.238098 PROGRESS: Channel   0:	 0.05 FDR:    90; 0.01 FDR:    80; 0.001 FDR:    80
2:15:43.238212 PROGRESS: =========================================================================
2:15:43.239123 PROGRESS: === Epoch 16, step 3, extracting elution groups 7000 to 15000 ===
2:15:43.330592 PROGRESS: Extracting batch of 15812 precursors
2:15:43.336201 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:15:43.336267 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:15:43.336302 INFO: FWHM in RT is 14.42 seconds, sigma is 0.52
2:15:43.336343 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:15:43.336563 INFO: Starting candidate selection
2:15:47.390095 INFO: Starting candidate scoring
2:15:48.818081 INFO: Finished candidate processing
2:15:48.818255 INFO: Collecting candidate features
2:15:51.018646 WARNING: intensity_correlation has 17 NaNs ( 0.11 % out of 14810)
2:15:51.024736 INFO: Collecting fragment features
2:15:51.680691 INFO: Finished candidate scoring
2:15:51.975599 PROGRESS: === Epoch 16, step 3, extracted 14810 precursors and 73808 fragments ===
2:15:51.975938 INFO: performing precursor FDR with 47 features
2:15:51.976000 INFO: Decoy channel: -1
2:15:51.976047 INFO: Competetive: True
2:15:52.005050 WARNING: dropped 17 target PSMs due to missing features
2:15:52.005163 WARNING: dropped 21 decoy PSMs due to missing features
2:15:52.768350 INFO: Test AUC: 0.546
2:15:52.768505 INFO: Train AUC: 0.593
2:15:52.768553 INFO: AUC difference: 7.85%
2:15:52.768604 WARNING: AUC difference > 5%. This may indicate overfitting.
2:15:52.896536 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
2:15:52.897494 PROGRESS: ============================= Precursor FDR =============================
2:15:52.897629 PROGRESS: Total precursors accumulated: 287
2:15:52.897708 PROGRESS: Target precursors: 262 (91.29%)
2:15:52.897784 PROGRESS: Decoy precursors: 25 (8.71%)
2:15:52.897851 PROGRESS: 
2:15:52.897912 PROGRESS: Precursor Summary:
2:15:52.899478 PROGRESS: Channel   0:	 0.05 FDR:   163; 0.01 FDR:   123; 0.001 FDR:   123
2:15:52.899592 PROGRESS: 
2:15:52.899667 PROGRESS: Protein Summary:
2:15:52.901488 PROGRESS: Channel   0:	 0.05 FDR:   161; 0.01 FDR:   122; 0.001 FDR:   122
2:15:52.901616 PROGRESS: =========================================================================
2:15:52.902575 PROGRESS: === Epoch 16, step 4, extracting elution groups 15000 to 31000 ===
2:15:53.012815 PROGRESS: Extracting batch of 31601 precursors
2:15:53.023545 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:15:53.023644 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:15:53.023684 INFO: FWHM in RT is 14.42 seconds, sigma is 0.52
2:15:53.023711 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:15:53.023954 INFO: Starting candidate selection
2:15:57.446376 INFO: Starting candidate scoring
2:15:59.045185 INFO: Finished candidate processing
2:15:59.045284 INFO: Collecting candidate features
2:16:01.324779 WARNING: intensity_correlation has 40 NaNs ( 0.13 % out of 29692)
2:16:01.331883 INFO: Collecting fragment features
2:16:02.014612 INFO: Finished candidate scoring
2:16:02.329854 PROGRESS: === Epoch 16, step 4, extracted 29692 precursors and 147900 fragments ===
2:16:02.330184 INFO: performing precursor FDR with 47 features
2:16:02.330233 INFO: Decoy channel: -1
2:16:02.330260 INFO: Competetive: True
2:16:02.389939 WARNING: dropped 39 target PSMs due to missing features
2:16:02.390067 WARNING: dropped 39 decoy PSMs due to missing features
2:16:04.385731 INFO: Test AUC: 0.558
2:16:04.385900 INFO: Train AUC: 0.604
2:16:04.385974 INFO: AUC difference: 7.54%
2:16:04.386030 WARNING: AUC difference > 5%. This may indicate overfitting.
2:16:04.514940 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
2:16:04.516098 PROGRESS: ============================= Precursor FDR =============================
2:16:04.516240 PROGRESS: Total precursors accumulated: 806
2:16:04.516330 PROGRESS: Target precursors: 735 (91.19%)
2:16:04.516419 PROGRESS: Decoy precursors: 71 (8.81%)
2:16:04.516510 PROGRESS: 
2:16:04.516598 PROGRESS: Precursor Summary:
2:16:04.518612 PROGRESS: Channel   0:	 0.05 FDR:   467; 0.01 FDR:   255; 0.001 FDR:   225
2:16:04.518755 PROGRESS: 
2:16:04.518849 PROGRESS: Protein Summary:
2:16:04.521549 PROGRESS: Channel   0:	 0.05 FDR:   450; 0.01 FDR:   245; 0.001 FDR:   217
2:16:04.521684 PROGRESS: =========================================================================
2:16:04.523060 PROGRESS: === Epoch 16, step 5, extracting elution groups 31000 to 63000 ===
2:16:04.659861 PROGRESS: Extracting batch of 63260 precursors
2:16:04.680108 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:16:04.680227 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:16:04.680273 INFO: FWHM in RT is 14.42 seconds, sigma is 0.52
2:16:04.680305 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:16:04.680585 INFO: Starting candidate selection
2:16:09.732762 INFO: Starting candidate scoring
2:16:11.625277 INFO: Finished candidate processing
2:16:11.625364 INFO: Collecting candidate features
2:16:13.980171 WARNING: intensity_correlation has 81 NaNs ( 0.14 % out of 59285)
2:16:13.989535 INFO: Collecting fragment features
2:16:14.697512 INFO: Finished candidate scoring
2:16:15.044625 PROGRESS: === Epoch 16, step 5, extracted 59285 precursors and 293278 fragments ===
2:16:15.044981 INFO: performing precursor FDR with 47 features
2:16:15.045031 INFO: Decoy channel: -1
2:16:15.045069 INFO: Competetive: True
2:16:15.175361 WARNING: dropped 82 target PSMs due to missing features
2:16:15.175474 WARNING: dropped 77 decoy PSMs due to missing features
2:16:18.842641 INFO: Test AUC: 0.548
2:16:18.842777 INFO: Train AUC: 0.599
2:16:18.842816 INFO: AUC difference: 8.58%
2:16:18.842844 WARNING: AUC difference > 5%. This may indicate overfitting.
2:16:18.976553 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
2:16:18.977971 PROGRESS: ============================= Precursor FDR =============================
2:16:18.978106 PROGRESS: Total precursors accumulated: 1,481
2:16:18.978185 PROGRESS: Target precursors: 1,351 (91.22%)
2:16:18.978254 PROGRESS: Decoy precursors: 130 (8.78%)
2:16:18.978318 PROGRESS: 
2:16:18.978379 PROGRESS: Precursor Summary:
2:16:18.980400 PROGRESS: Channel   0:	 0.05 FDR:   902; 0.01 FDR:   591; 0.001 FDR:   436
2:16:18.980549 PROGRESS: 
2:16:18.980624 PROGRESS: Protein Summary:
2:16:18.983078 PROGRESS: Channel   0:	 0.05 FDR:   851; 0.01 FDR:   554; 0.001 FDR:   410
2:16:18.983217 PROGRESS: =========================================================================
2:16:18.984463 PROGRESS: === Epoch 16, step 6, extracting elution groups 63000 to 127000 ===
2:16:19.161638 PROGRESS: Extracting batch of 126474 precursors
2:16:19.200524 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:16:19.200658 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:16:19.200699 INFO: FWHM in RT is 14.42 seconds, sigma is 0.52
2:16:19.200726 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:16:19.201000 INFO: Starting candidate selection
2:16:25.568373 INFO: Starting candidate scoring
2:16:28.088450 INFO: Finished candidate processing
2:16:28.088633 INFO: Collecting candidate features
2:16:30.639620 WARNING: intensity_correlation has 138 NaNs ( 0.12 % out of 118565)
2:16:30.652647 INFO: Collecting fragment features
2:16:31.430100 INFO: Finished candidate scoring
2:16:31.859462 PROGRESS: === Epoch 16, step 6, extracted 118565 precursors and 588509 fragments ===
2:16:31.859844 INFO: performing precursor FDR with 47 features
2:16:31.859889 INFO: Decoy channel: -1
2:16:31.859917 INFO: Competetive: True
2:16:32.135111 WARNING: dropped 144 target PSMs due to missing features
2:16:32.135226 WARNING: dropped 153 decoy PSMs due to missing features
2:16:40.388896 INFO: Test AUC: 0.555
2:16:40.389020 INFO: Train AUC: 0.588
2:16:40.389076 INFO: AUC difference: 5.65%
2:16:40.389105 WARNING: AUC difference > 5%. This may indicate overfitting.
2:16:40.550310 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
2:16:40.552031 PROGRESS: ============================= Precursor FDR =============================
2:16:40.552186 PROGRESS: Total precursors accumulated: 2,476
2:16:40.552265 PROGRESS: Target precursors: 2,258 (91.20%)
2:16:40.552335 PROGRESS: Decoy precursors: 218 (8.80%)
2:16:40.552400 PROGRESS: 
2:16:40.552463 PROGRESS: Precursor Summary:
2:16:40.554787 PROGRESS: Channel   0:	 0.05 FDR: 1,524; 0.01 FDR:   905; 0.001 FDR:   790
2:16:40.554926 PROGRESS: 
2:16:40.555017 PROGRESS: Protein Summary:
2:16:40.557962 PROGRESS: Channel   0:	 0.05 FDR: 1,361; 0.01 FDR:   799; 0.001 FDR:   697
2:16:40.558083 PROGRESS: =========================================================================
2:16:40.559501 PROGRESS: === Epoch 16, step 7, extracting elution groups 127000 to 255000 ===
2:16:40.785959 PROGRESS: Extracting batch of 252958 precursors
2:16:40.857656 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:16:40.857776 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:16:40.857835 INFO: FWHM in RT is 14.42 seconds, sigma is 0.52
2:16:40.857864 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:16:40.858127 INFO: Starting candidate selection
2:16:49.686904 INFO: Starting candidate scoring
2:16:53.401647 INFO: Finished candidate processing
2:16:53.401845 INFO: Collecting candidate features
2:16:56.340079 WARNING: intensity_correlation has 324 NaNs ( 0.14 % out of 237183)
2:16:56.362587 INFO: Collecting fragment features
2:16:57.224352 INFO: Finished candidate scoring
2:16:57.801343 PROGRESS: === Epoch 16, step 7, extracted 237183 precursors and 1177930 fragments ===
2:16:57.801698 INFO: performing precursor FDR with 47 features
2:16:57.801746 INFO: Decoy channel: -1
2:16:57.801783 INFO: Competetive: True
2:16:58.395385 WARNING: dropped 317 target PSMs due to missing features
2:16:58.395504 WARNING: dropped 304 decoy PSMs due to missing features
2:17:15.667179 INFO: Test AUC: 0.554
2:17:15.667308 INFO: Train AUC: 0.576
2:17:15.667364 INFO: AUC difference: 3.72%
2:17:15.870527 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
2:17:15.872887 PROGRESS: ============================= Precursor FDR =============================
2:17:15.873045 PROGRESS: Total precursors accumulated: 4,365
2:17:15.873191 PROGRESS: Target precursors: 3,977 (91.11%)
2:17:15.873294 PROGRESS: Decoy precursors: 388 (8.89%)
2:17:15.873387 PROGRESS: 
2:17:15.873476 PROGRESS: Precursor Summary:
2:17:15.877181 PROGRESS: Channel   0:	 0.05 FDR: 3,012; 0.01 FDR: 2,170; 0.001 FDR: 1,519
2:17:15.877345 PROGRESS: 
2:17:15.877448 PROGRESS: Protein Summary:
2:17:15.881513 PROGRESS: Channel   0:	 0.05 FDR: 2,379; 0.01 FDR: 1,683; 0.001 FDR: 1,195
2:17:15.881638 PROGRESS: =========================================================================
2:17:15.883762 PROGRESS: === Epoch 16, step 8, extracting elution groups 255000 to 511000 ===
2:17:16.192113 PROGRESS: Extracting batch of 505830 precursors
2:17:16.327086 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:17:16.327218 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:17:16.327278 INFO: FWHM in RT is 14.42 seconds, sigma is 0.52
2:17:16.327317 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:17:16.327616 INFO: Starting candidate selection
2:17:30.432143 INFO: Starting candidate scoring
2:17:36.577412 INFO: Finished candidate processing
2:17:36.577665 INFO: Collecting candidate features
2:17:40.212190 WARNING: intensity_correlation has 567 NaNs ( 0.12 % out of 474135)
2:17:40.213260 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 474135)
2:17:40.247806 INFO: Collecting fragment features
2:17:41.302402 INFO: Finished candidate scoring
2:17:42.196425 PROGRESS: === Epoch 16, step 8, extracted 474135 precursors and 2350929 fragments ===
2:17:42.203654 INFO: performing precursor FDR with 47 features
2:17:42.203712 INFO: Decoy channel: -1
2:17:42.203756 INFO: Competetive: True
2:17:43.334266 WARNING: dropped 586 target PSMs due to missing features
2:17:43.334393 WARNING: dropped 602 decoy PSMs due to missing features
2:18:19.087916 INFO: Test AUC: 0.552
2:18:19.088067 INFO: Train AUC: 0.568
2:18:19.088135 INFO: AUC difference: 2.80%
2:18:19.327028 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
2:18:19.330129 PROGRESS: ============================= Precursor FDR =============================
2:18:19.330304 PROGRESS: Total precursors accumulated: 7,517
2:18:19.330384 PROGRESS: Target precursors: 6,862 (91.29%)
2:18:19.330453 PROGRESS: Decoy precursors: 655 (8.71%)
2:18:19.330517 PROGRESS: 
2:18:19.330579 PROGRESS: Precursor Summary:
2:18:19.334651 PROGRESS: Channel   0:	 0.05 FDR: 5,605; 0.01 FDR: 3,813; 0.001 FDR: 2,741
2:18:19.334818 PROGRESS: 
2:18:19.334894 PROGRESS: Protein Summary:
2:18:19.340680 PROGRESS: Channel   0:	 0.05 FDR: 3,759; 0.01 FDR: 2,497; 0.001 FDR: 1,880
2:18:19.340821 PROGRESS: =========================================================================
2:18:19.345427 INFO: calibration group: precursor, fitting rt estimator 
2:18:19.795363 INFO: calibration group: fragment, fitting mz estimator 
2:18:20.395331 INFO: === checking if epoch conditions were reached ===
2:18:20.395533 INFO: ✅ ms2_error      : 7.0000 <= 7
2:18:20.395620 INFO: ❌ rt_error       : 200.6350 > 100
2:18:20.395694 INFO: ✅ current_epoch  : 16 >= 3
2:18:20.395759 INFO: ==============================================
2:18:20.612502 INFO: calibration group: precursor, predicting mz
2:18:20.612787 WARNING: mz prediction was skipped as it has not been fitted yet
2:18:20.612831 INFO: calibration group: precursor, predicting rt
2:18:27.350047 INFO: calibration group: fragment, predicting mz
2:18:45.205379 PROGRESS: === Epoch 17, step 0, extracting elution groups 0 to 1000 ===
2:18:45.304511 PROGRESS: Extracting batch of 1981 precursors
2:18:45.306288 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:18:45.306379 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:18:45.306420 INFO: FWHM in RT is 14.45 seconds, sigma is 0.53
2:18:45.306450 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:18:45.306680 INFO: Starting candidate selection
2:18:49.522328 INFO: Starting candidate scoring
2:18:50.840011 INFO: Finished candidate processing
2:18:50.840104 INFO: Collecting candidate features
2:18:53.013149 WARNING: intensity_correlation has 2 NaNs ( 0.11 % out of 1859)
2:18:53.019146 INFO: Collecting fragment features
2:18:53.657564 INFO: Finished candidate scoring
2:18:53.983278 PROGRESS: === Epoch 17, step 0, extracted 1859 precursors and 9348 fragments ===
2:18:53.983596 INFO: performing precursor FDR with 47 features
2:18:53.983642 INFO: Decoy channel: -1
2:18:53.983668 INFO: Competetive: True
2:18:53.988584 WARNING: dropped 1 target PSMs due to missing features
2:18:53.988662 WARNING: dropped 1 decoy PSMs due to missing features
2:18:54.017285 INFO: Test AUC: 0.593
2:18:54.017384 INFO: Train AUC: 0.542
2:18:54.017432 INFO: AUC difference: 9.48%
2:18:54.017467 WARNING: AUC difference > 5%. This may indicate overfitting.
2:18:54.142297 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
2:18:54.143054 PROGRESS: ============================= Precursor FDR =============================
2:18:54.143177 PROGRESS: Total precursors accumulated: 18
2:18:54.143268 PROGRESS: Target precursors: 17 (94.44%)
2:18:54.143338 PROGRESS: Decoy precursors: 1 (5.56%)
2:18:54.143402 PROGRESS: 
2:18:54.143463 PROGRESS: Precursor Summary:
2:18:54.144886 PROGRESS: Channel   0:	 0.05 FDR:    16; 0.01 FDR:    16; 0.001 FDR:    16
2:18:54.145002 PROGRESS: 
2:18:54.145075 PROGRESS: Protein Summary:
2:18:54.146690 PROGRESS: Channel   0:	 0.05 FDR:    16; 0.01 FDR:    16; 0.001 FDR:    16
2:18:54.146805 PROGRESS: =========================================================================
2:18:54.147660 PROGRESS: === Epoch 17, step 1, extracting elution groups 1000 to 3000 ===
2:18:54.224441 PROGRESS: Extracting batch of 3963 precursors
2:18:54.226689 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:18:54.226753 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:18:54.226794 INFO: FWHM in RT is 14.45 seconds, sigma is 0.53
2:18:54.226825 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:18:54.227039 INFO: Starting candidate selection
2:18:58.054421 INFO: Starting candidate scoring
2:18:59.368830 INFO: Finished candidate processing
2:18:59.369012 INFO: Collecting candidate features
2:19:01.526648 WARNING: intensity_correlation has 6 NaNs ( 0.16 % out of 3713)
2:19:01.533286 INFO: Collecting fragment features
2:19:02.167939 INFO: Finished candidate scoring
2:19:02.447252 PROGRESS: === Epoch 17, step 1, extracted 3713 precursors and 18301 fragments ===
2:19:02.447536 INFO: performing precursor FDR with 47 features
2:19:02.447583 INFO: Decoy channel: -1
2:19:02.447610 INFO: Competetive: True
2:19:02.456148 WARNING: dropped 3 target PSMs due to missing features
2:19:02.456237 WARNING: dropped 5 decoy PSMs due to missing features
2:19:02.493688 INFO: Test AUC: 0.595
2:19:02.493813 INFO: Train AUC: 0.551
2:19:02.493863 INFO: AUC difference: 7.86%
2:19:02.493897 WARNING: AUC difference > 5%. This may indicate overfitting.
2:19:02.613224 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
2:19:02.614028 PROGRESS: ============================= Precursor FDR =============================
2:19:02.614151 PROGRESS: Total precursors accumulated: 49
2:19:02.614228 PROGRESS: Target precursors: 45 (91.84%)
2:19:02.614307 PROGRESS: Decoy precursors: 4 (8.16%)
2:19:02.614370 PROGRESS: 
2:19:02.614432 PROGRESS: Precursor Summary:
2:19:02.615858 PROGRESS: Channel   0:	 0.05 FDR:    37; 0.01 FDR:    36; 0.001 FDR:    36
2:19:02.615972 PROGRESS: 
2:19:02.616055 PROGRESS: Protein Summary:
2:19:02.617686 PROGRESS: Channel   0:	 0.05 FDR:    37; 0.01 FDR:    36; 0.001 FDR:    36
2:19:02.617806 PROGRESS: =========================================================================
2:19:02.618678 PROGRESS: === Epoch 17, step 2, extracting elution groups 3000 to 7000 ===
2:19:02.700472 PROGRESS: Extracting batch of 7897 precursors
2:19:02.703650 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:19:02.703713 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:19:02.703751 INFO: FWHM in RT is 14.45 seconds, sigma is 0.53
2:19:02.703796 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:19:02.704029 INFO: Starting candidate selection
2:19:06.598406 INFO: Starting candidate scoring
2:19:07.951581 INFO: Finished candidate processing
2:19:07.951677 INFO: Collecting candidate features
2:19:10.126293 WARNING: intensity_correlation has 14 NaNs ( 0.19 % out of 7378)
2:19:10.131990 INFO: Collecting fragment features
2:19:10.772711 INFO: Finished candidate scoring
2:19:11.056517 PROGRESS: === Epoch 17, step 2, extracted 7378 precursors and 36532 fragments ===
2:19:11.056834 INFO: performing precursor FDR with 47 features
2:19:11.056882 INFO: Decoy channel: -1
2:19:11.056909 INFO: Competetive: True
2:19:11.071712 WARNING: dropped 9 target PSMs due to missing features
2:19:11.071810 WARNING: dropped 13 decoy PSMs due to missing features
2:19:11.355427 INFO: Test AUC: 0.560
2:19:11.355562 INFO: Train AUC: 0.582
2:19:11.355607 INFO: AUC difference: 3.70%
2:19:11.475688 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
2:19:11.476551 PROGRESS: ============================= Precursor FDR =============================
2:19:11.476676 PROGRESS: Total precursors accumulated: 123
2:19:11.476753 PROGRESS: Target precursors: 112 (91.06%)
2:19:11.476821 PROGRESS: Decoy precursors: 11 (8.94%)
2:19:11.476884 PROGRESS: 
2:19:11.476946 PROGRESS: Precursor Summary:
2:19:11.478444 PROGRESS: Channel   0:	 0.05 FDR:    97; 0.01 FDR:    66; 0.001 FDR:    66
2:19:11.478558 PROGRESS: 
2:19:11.478632 PROGRESS: Protein Summary:
2:19:11.480321 PROGRESS: Channel   0:	 0.05 FDR:    97; 0.01 FDR:    66; 0.001 FDR:    66
2:19:11.480433 PROGRESS: =========================================================================
2:19:11.481323 PROGRESS: === Epoch 17, step 3, extracting elution groups 7000 to 15000 ===
2:19:11.573309 PROGRESS: Extracting batch of 15821 precursors
2:19:11.578874 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:19:11.578942 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:19:11.578977 INFO: FWHM in RT is 14.45 seconds, sigma is 0.53
2:19:11.579018 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:19:11.579240 INFO: Starting candidate selection
2:19:15.684057 INFO: Starting candidate scoring
2:19:17.129197 INFO: Finished candidate processing
2:19:17.129295 INFO: Collecting candidate features
2:19:19.349853 WARNING: intensity_correlation has 24 NaNs ( 0.16 % out of 14807)
2:19:19.356019 INFO: Collecting fragment features
2:19:20.016014 INFO: Finished candidate scoring
2:19:20.312019 PROGRESS: === Epoch 17, step 3, extracted 14807 precursors and 73802 fragments ===
2:19:20.312349 INFO: performing precursor FDR with 47 features
2:19:20.312396 INFO: Decoy channel: -1
2:19:20.312423 INFO: Competetive: True
2:19:20.341166 WARNING: dropped 20 target PSMs due to missing features
2:19:20.341280 WARNING: dropped 26 decoy PSMs due to missing features
2:19:21.029804 INFO: Test AUC: 0.562
2:19:21.029969 INFO: Train AUC: 0.591
2:19:21.030018 INFO: AUC difference: 5.05%
2:19:21.030054 WARNING: AUC difference > 5%. This may indicate overfitting.
2:19:21.154297 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
2:19:21.155288 PROGRESS: ============================= Precursor FDR =============================
2:19:21.155414 PROGRESS: Total precursors accumulated: 384
2:19:21.155493 PROGRESS: Target precursors: 350 (91.15%)
2:19:21.155560 PROGRESS: Decoy precursors: 34 (8.85%)
2:19:21.155624 PROGRESS: 
2:19:21.155684 PROGRESS: Precursor Summary:
2:19:21.157279 PROGRESS: Channel   0:	 0.05 FDR:   246; 0.01 FDR:   158; 0.001 FDR:   144
2:19:21.157412 PROGRESS: 
2:19:21.157486 PROGRESS: Protein Summary:
2:19:21.159363 PROGRESS: Channel   0:	 0.05 FDR:   241; 0.01 FDR:   154; 0.001 FDR:   140
2:19:21.159492 PROGRESS: =========================================================================
2:19:21.160456 PROGRESS: === Epoch 17, step 4, extracting elution groups 15000 to 31000 ===
2:19:21.268852 PROGRESS: Extracting batch of 31592 precursors
2:19:21.279709 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:19:21.279820 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:19:21.279865 INFO: FWHM in RT is 14.45 seconds, sigma is 0.53
2:19:21.279893 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:19:21.280135 INFO: Starting candidate selection
2:19:25.718959 INFO: Starting candidate scoring
2:19:27.316010 INFO: Finished candidate processing
2:19:27.316196 INFO: Collecting candidate features
2:19:29.561725 WARNING: intensity_correlation has 41 NaNs ( 0.14 % out of 29760)
2:19:29.569153 INFO: Collecting fragment features
2:19:30.252004 INFO: Finished candidate scoring
2:19:30.564438 PROGRESS: === Epoch 17, step 4, extracted 29760 precursors and 147741 fragments ===
2:19:30.564772 INFO: performing precursor FDR with 47 features
2:19:30.564819 INFO: Decoy channel: -1
2:19:30.564846 INFO: Competetive: True
2:19:30.623085 WARNING: dropped 43 target PSMs due to missing features
2:19:30.623200 WARNING: dropped 44 decoy PSMs due to missing features
2:19:32.536516 INFO: Test AUC: 0.563
2:19:32.536671 INFO: Train AUC: 0.599
2:19:32.536719 INFO: AUC difference: 5.92%
2:19:32.536754 WARNING: AUC difference > 5%. This may indicate overfitting.
2:19:32.661867 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
2:19:32.663035 PROGRESS: ============================= Precursor FDR =============================
2:19:32.663163 PROGRESS: Total precursors accumulated: 947
2:19:32.663240 PROGRESS: Target precursors: 864 (91.24%)
2:19:32.663327 PROGRESS: Decoy precursors: 83 (8.76%)
2:19:32.663391 PROGRESS: 
2:19:32.663450 PROGRESS: Precursor Summary:
2:19:32.665157 PROGRESS: Channel   0:	 0.05 FDR:   524; 0.01 FDR:   346; 0.001 FDR:   159
2:19:32.665269 PROGRESS: 
2:19:32.665342 PROGRESS: Protein Summary:
2:19:32.667390 PROGRESS: Channel   0:	 0.05 FDR:   514; 0.01 FDR:   338; 0.001 FDR:   158
2:19:32.667501 PROGRESS: =========================================================================
2:19:32.668568 PROGRESS: === Epoch 17, step 5, extracting elution groups 31000 to 63000 ===
2:19:32.812196 PROGRESS: Extracting batch of 63219 precursors
2:19:32.832269 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:19:32.832379 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:19:32.832417 INFO: FWHM in RT is 14.45 seconds, sigma is 0.53
2:19:32.832461 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:19:32.832717 INFO: Starting candidate selection
2:19:37.886408 INFO: Starting candidate scoring
2:19:39.764487 INFO: Finished candidate processing
2:19:39.764625 INFO: Collecting candidate features
2:19:42.142764 WARNING: intensity_correlation has 64 NaNs ( 0.11 % out of 59252)
2:19:42.152927 INFO: Collecting fragment features
2:19:42.864639 INFO: Finished candidate scoring
2:19:43.214259 PROGRESS: === Epoch 17, step 5, extracted 59252 precursors and 293455 fragments ===
2:19:43.214591 INFO: performing precursor FDR with 47 features
2:19:43.214637 INFO: Decoy channel: -1
2:19:43.214663 INFO: Competetive: True
2:19:43.347120 WARNING: dropped 78 target PSMs due to missing features
2:19:43.347236 WARNING: dropped 73 decoy PSMs due to missing features
2:19:47.398764 INFO: Test AUC: 0.552
2:19:47.398912 INFO: Train AUC: 0.597
2:19:47.398967 INFO: AUC difference: 7.38%
2:19:47.398994 WARNING: AUC difference > 5%. This may indicate overfitting.
2:19:47.587732 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
2:19:47.589138 PROGRESS: ============================= Precursor FDR =============================
2:19:47.589267 PROGRESS: Total precursors accumulated: 1,536
2:19:47.589345 PROGRESS: Target precursors: 1,400 (91.15%)
2:19:47.589411 PROGRESS: Decoy precursors: 136 (8.85%)
2:19:47.589474 PROGRESS: 
2:19:47.589534 PROGRESS: Precursor Summary:
2:19:47.591504 PROGRESS: Channel   0:	 0.05 FDR:   928; 0.01 FDR:   533; 0.001 FDR:   385
2:19:47.591619 PROGRESS: 
2:19:47.591693 PROGRESS: Protein Summary:
2:19:47.594102 PROGRESS: Channel   0:	 0.05 FDR:   879; 0.01 FDR:   509; 0.001 FDR:   370
2:19:47.594214 PROGRESS: =========================================================================
2:19:47.595424 PROGRESS: === Epoch 17, step 6, extracting elution groups 63000 to 127000 ===
2:19:47.771339 PROGRESS: Extracting batch of 126398 precursors
2:19:47.810040 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:19:47.810175 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:19:47.810217 INFO: FWHM in RT is 14.45 seconds, sigma is 0.53
2:19:47.810246 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:19:47.810523 INFO: Starting candidate selection
2:19:54.127332 INFO: Starting candidate scoring
2:19:56.629496 INFO: Finished candidate processing
2:19:56.629680 INFO: Collecting candidate features
2:19:59.157214 WARNING: intensity_correlation has 138 NaNs ( 0.12 % out of 118652)
2:19:59.171079 INFO: Collecting fragment features
2:19:59.932375 INFO: Finished candidate scoring
2:20:00.355219 PROGRESS: === Epoch 17, step 6, extracted 118652 precursors and 589465 fragments ===
2:20:00.355560 INFO: performing precursor FDR with 47 features
2:20:00.355605 INFO: Decoy channel: -1
2:20:00.355631 INFO: Competetive: True
2:20:00.628022 WARNING: dropped 149 target PSMs due to missing features
2:20:00.628142 WARNING: dropped 140 decoy PSMs due to missing features
2:20:09.003435 INFO: Test AUC: 0.551
2:20:09.003566 INFO: Train AUC: 0.588
2:20:09.003623 INFO: AUC difference: 6.29%
2:20:09.003651 WARNING: AUC difference > 5%. This may indicate overfitting.
2:20:09.155684 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
2:20:09.157409 PROGRESS: ============================= Precursor FDR =============================
2:20:09.157561 PROGRESS: Total precursors accumulated: 2,533
2:20:09.157639 PROGRESS: Target precursors: 2,309 (91.16%)
2:20:09.157706 PROGRESS: Decoy precursors: 224 (8.84%)
2:20:09.157780 PROGRESS: 
2:20:09.157844 PROGRESS: Precursor Summary:
2:20:09.160115 PROGRESS: Channel   0:	 0.05 FDR: 1,596; 0.01 FDR:   950; 0.001 FDR:   698
2:20:09.160254 PROGRESS: 
2:20:09.160328 PROGRESS: Protein Summary:
2:20:09.163252 PROGRESS: Channel   0:	 0.05 FDR: 1,426; 0.01 FDR:   836; 0.001 FDR:   628
2:20:09.163364 PROGRESS: =========================================================================
2:20:09.164811 PROGRESS: === Epoch 17, step 7, extracting elution groups 127000 to 255000 ===
2:20:09.390669 PROGRESS: Extracting batch of 252893 precursors
2:20:09.463499 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:20:09.463620 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:20:09.463658 INFO: FWHM in RT is 14.45 seconds, sigma is 0.53
2:20:09.463701 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:20:09.463969 INFO: Starting candidate selection
2:20:18.405234 INFO: Starting candidate scoring
2:20:22.146118 INFO: Finished candidate processing
2:20:22.146221 INFO: Collecting candidate features
2:20:25.070961 WARNING: intensity_correlation has 313 NaNs ( 0.13 % out of 236885)
2:20:25.091444 INFO: Collecting fragment features
2:20:25.947137 INFO: Finished candidate scoring
2:20:26.525809 PROGRESS: === Epoch 17, step 7, extracted 236885 precursors and 1175122 fragments ===
2:20:26.526169 INFO: performing precursor FDR with 47 features
2:20:26.526216 INFO: Decoy channel: -1
2:20:26.526243 INFO: Competetive: True
2:20:27.117435 WARNING: dropped 305 target PSMs due to missing features
2:20:27.117559 WARNING: dropped 297 decoy PSMs due to missing features
2:20:44.575407 INFO: Test AUC: 0.551
2:20:44.575533 INFO: Train AUC: 0.576
2:20:44.575574 INFO: AUC difference: 4.40%
2:20:44.757611 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
2:20:44.760405 PROGRESS: ============================= Precursor FDR =============================
2:20:44.760555 PROGRESS: Total precursors accumulated: 4,260
2:20:44.760633 PROGRESS: Target precursors: 3,888 (91.27%)
2:20:44.760700 PROGRESS: Decoy precursors: 372 (8.73%)
2:20:44.760761 PROGRESS: 
2:20:44.760821 PROGRESS: Precursor Summary:
2:20:44.763727 PROGRESS: Channel   0:	 0.05 FDR: 2,820; 0.01 FDR: 2,005; 0.001 FDR: 1,291
2:20:44.763874 PROGRESS: 
2:20:44.763946 PROGRESS: Protein Summary:
2:20:44.767838 PROGRESS: Channel   0:	 0.05 FDR: 2,291; 0.01 FDR: 1,591; 0.001 FDR: 1,060
2:20:44.767972 PROGRESS: =========================================================================
2:20:44.769969 PROGRESS: === Epoch 17, step 8, extracting elution groups 255000 to 511000 ===
2:20:45.076540 PROGRESS: Extracting batch of 505904 precursors
2:20:45.211405 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:20:45.211520 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:20:45.211560 INFO: FWHM in RT is 14.45 seconds, sigma is 0.53
2:20:45.211603 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:20:45.211868 INFO: Starting candidate selection
2:20:59.275127 INFO: Starting candidate scoring
2:21:05.480757 INFO: Finished candidate processing
2:21:05.480951 INFO: Collecting candidate features
2:21:09.157160 WARNING: intensity_correlation has 603 NaNs ( 0.13 % out of 474219)
2:21:09.158256 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 474219)
2:21:09.191345 INFO: Collecting fragment features
2:21:10.255368 INFO: Finished candidate scoring
2:21:11.155000 PROGRESS: === Epoch 17, step 8, extracted 474219 precursors and 2354033 fragments ===
2:21:11.162215 INFO: performing precursor FDR with 47 features
2:21:11.162308 INFO: Decoy channel: -1
2:21:11.162339 INFO: Competetive: True
2:21:12.326639 WARNING: dropped 621 target PSMs due to missing features
2:21:12.326769 WARNING: dropped 584 decoy PSMs due to missing features
2:21:47.899732 INFO: Test AUC: 0.552
2:21:47.899862 INFO: Train AUC: 0.568
2:21:47.899919 INFO: AUC difference: 2.81%
2:21:48.163243 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
2:21:48.166240 PROGRESS: ============================= Precursor FDR =============================
2:21:48.166410 PROGRESS: Total precursors accumulated: 7,255
2:21:48.166511 PROGRESS: Target precursors: 6,619 (91.23%)
2:21:48.166617 PROGRESS: Decoy precursors: 636 (8.77%)
2:21:48.166719 PROGRESS: 
2:21:48.166810 PROGRESS: Precursor Summary:
2:21:48.170859 PROGRESS: Channel   0:	 0.05 FDR: 5,337; 0.01 FDR: 4,038; 0.001 FDR: 3,212
2:21:48.171033 PROGRESS: 
2:21:48.171136 PROGRESS: Protein Summary:
2:21:48.176969 PROGRESS: Channel   0:	 0.05 FDR: 3,617; 0.01 FDR: 2,659; 0.001 FDR: 2,151
2:21:48.177107 PROGRESS: =========================================================================
2:21:48.181944 INFO: calibration group: precursor, fitting rt estimator 
2:21:48.662108 INFO: calibration group: fragment, fitting mz estimator 
2:21:49.253384 INFO: === checking if epoch conditions were reached ===
2:21:49.253597 INFO: ✅ ms2_error      : 7.0000 <= 7
2:21:49.253689 INFO: ❌ rt_error       : 201.4891 > 100
2:21:49.253799 INFO: ✅ current_epoch  : 17 >= 3
2:21:49.253880 INFO: ==============================================
2:21:49.498409 INFO: calibration group: precursor, predicting mz
2:21:49.498684 WARNING: mz prediction was skipped as it has not been fitted yet
2:21:49.498724 INFO: calibration group: precursor, predicting rt
2:21:56.260841 INFO: calibration group: fragment, predicting mz
2:22:14.343230 PROGRESS: === Epoch 18, step 0, extracting elution groups 0 to 1000 ===
2:22:14.441814 PROGRESS: Extracting batch of 1979 precursors
2:22:14.443562 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:22:14.443635 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:22:14.443690 INFO: FWHM in RT is 14.27 seconds, sigma is 0.52
2:22:14.443721 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:22:14.443953 INFO: Starting candidate selection
2:22:18.683644 INFO: Starting candidate scoring
2:22:19.991655 INFO: Finished candidate processing
2:22:19.991783 INFO: Collecting candidate features
2:22:22.172286 WARNING: intensity_correlation has 2 NaNs ( 0.11 % out of 1885)
2:22:22.178459 INFO: Collecting fragment features
2:22:22.821669 INFO: Finished candidate scoring
2:22:23.167226 PROGRESS: === Epoch 18, step 0, extracted 1885 precursors and 9131 fragments ===
2:22:23.167580 INFO: performing precursor FDR with 47 features
2:22:23.167639 INFO: Decoy channel: -1
2:22:23.167687 INFO: Competetive: True
2:22:23.172479 WARNING: dropped 1 target PSMs due to missing features
2:22:23.172547 WARNING: dropped 1 decoy PSMs due to missing features
2:22:23.220633 INFO: Test AUC: 0.547
2:22:23.220732 INFO: Train AUC: 0.550
2:22:23.220777 INFO: AUC difference: 0.49%
2:22:23.343403 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
2:22:23.344228 PROGRESS: ============================= Precursor FDR =============================
2:22:23.344349 PROGRESS: Total precursors accumulated: 9
2:22:23.344425 PROGRESS: Target precursors: 9 (100.00%)
2:22:23.344494 PROGRESS: Decoy precursors: 0 (0.00%)
2:22:23.344556 PROGRESS: 
2:22:23.344616 PROGRESS: Precursor Summary:
2:22:23.346122 PROGRESS: Channel   0:	 0.05 FDR:     9; 0.01 FDR:     9; 0.001 FDR:     9
2:22:23.346235 PROGRESS: 
2:22:23.346308 PROGRESS: Protein Summary:
2:22:23.347991 PROGRESS: Channel   0:	 0.05 FDR:     9; 0.01 FDR:     9; 0.001 FDR:     9
2:22:23.348103 PROGRESS: =========================================================================
2:22:23.348987 PROGRESS: === Epoch 18, step 1, extracting elution groups 1000 to 3000 ===
2:22:23.425907 PROGRESS: Extracting batch of 3943 precursors
2:22:23.428068 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:22:23.428146 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:22:23.428186 INFO: FWHM in RT is 14.27 seconds, sigma is 0.52
2:22:23.428217 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:22:23.428453 INFO: Starting candidate selection
2:22:27.291847 INFO: Starting candidate scoring
2:22:28.624850 INFO: Finished candidate processing
2:22:28.624942 INFO: Collecting candidate features
2:22:30.809763 WARNING: intensity_correlation has 3 NaNs ( 0.08 % out of 3704)
2:22:30.816754 INFO: Collecting fragment features
2:22:31.461272 INFO: Finished candidate scoring
2:22:31.742860 PROGRESS: === Epoch 18, step 1, extracted 3704 precursors and 18031 fragments ===
2:22:31.743142 INFO: performing precursor FDR with 47 features
2:22:31.743186 INFO: Decoy channel: -1
2:22:31.743212 INFO: Competetive: True
2:22:31.751797 WARNING: dropped 3 target PSMs due to missing features
2:22:31.751884 WARNING: dropped 2 decoy PSMs due to missing features
2:22:31.789732 INFO: Test AUC: 0.530
2:22:31.789863 INFO: Train AUC: 0.545
2:22:31.789909 INFO: AUC difference: 2.85%
2:22:31.908707 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
2:22:31.909509 PROGRESS: ============================= Precursor FDR =============================
2:22:31.909634 PROGRESS: Total precursors accumulated: 48
2:22:31.909712 PROGRESS: Target precursors: 44 (91.67%)
2:22:31.909799 PROGRESS: Decoy precursors: 4 (8.33%)
2:22:31.909873 PROGRESS: 
2:22:31.909946 PROGRESS: Precursor Summary:
2:22:31.911396 PROGRESS: Channel   0:	 0.05 FDR:    36; 0.01 FDR:    35; 0.001 FDR:    35
2:22:31.911514 PROGRESS: 
2:22:31.911590 PROGRESS: Protein Summary:
2:22:31.913226 PROGRESS: Channel   0:	 0.05 FDR:    36; 0.01 FDR:    35; 0.001 FDR:    35
2:22:31.913346 PROGRESS: =========================================================================
2:22:31.914228 PROGRESS: === Epoch 18, step 2, extracting elution groups 3000 to 7000 ===
2:22:31.996220 PROGRESS: Extracting batch of 7904 precursors
2:22:31.999652 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:22:31.999715 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:22:31.999754 INFO: FWHM in RT is 14.27 seconds, sigma is 0.52
2:22:31.999800 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:22:32.000022 INFO: Starting candidate selection
2:22:35.940739 INFO: Starting candidate scoring
2:22:37.295485 INFO: Finished candidate processing
2:22:37.295583 INFO: Collecting candidate features
2:22:39.465611 WARNING: intensity_correlation has 10 NaNs ( 0.13 % out of 7449)
2:22:39.471230 INFO: Collecting fragment features
2:22:40.119733 INFO: Finished candidate scoring
2:22:40.404530 PROGRESS: === Epoch 18, step 2, extracted 7449 precursors and 36752 fragments ===
2:22:40.404845 INFO: performing precursor FDR with 47 features
2:22:40.404890 INFO: Decoy channel: -1
2:22:40.404917 INFO: Competetive: True
2:22:40.419968 WARNING: dropped 10 target PSMs due to missing features
2:22:40.420084 WARNING: dropped 5 decoy PSMs due to missing features
2:22:40.706105 INFO: Test AUC: 0.551
2:22:40.706234 INFO: Train AUC: 0.564
2:22:40.706294 INFO: AUC difference: 2.28%
2:22:40.828639 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
2:22:40.829497 PROGRESS: ============================= Precursor FDR =============================
2:22:40.829616 PROGRESS: Total precursors accumulated: 145
2:22:40.829693 PROGRESS: Target precursors: 133 (91.72%)
2:22:40.829761 PROGRESS: Decoy precursors: 12 (8.28%)
2:22:40.829837 PROGRESS: 
2:22:40.829898 PROGRESS: Precursor Summary:
2:22:40.831378 PROGRESS: Channel   0:	 0.05 FDR:   122; 0.01 FDR:    70; 0.001 FDR:    70
2:22:40.831491 PROGRESS: 
2:22:40.831565 PROGRESS: Protein Summary:
2:22:40.833246 PROGRESS: Channel   0:	 0.05 FDR:   122; 0.01 FDR:    70; 0.001 FDR:    70
2:22:40.833358 PROGRESS: =========================================================================
2:22:40.834265 PROGRESS: === Epoch 18, step 3, extracting elution groups 7000 to 15000 ===
2:22:40.925691 PROGRESS: Extracting batch of 15813 precursors
2:22:40.931224 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:22:40.931289 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:22:40.931325 INFO: FWHM in RT is 14.27 seconds, sigma is 0.52
2:22:40.931368 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:22:40.931587 INFO: Starting candidate selection
2:22:44.988371 INFO: Starting candidate scoring
2:22:46.404057 INFO: Finished candidate processing
2:22:46.404147 INFO: Collecting candidate features
2:22:48.602641 WARNING: intensity_correlation has 12 NaNs ( 0.08 % out of 14807)
2:22:48.608644 INFO: Collecting fragment features
2:22:49.265239 INFO: Finished candidate scoring
2:22:49.558306 PROGRESS: === Epoch 18, step 3, extracted 14807 precursors and 73582 fragments ===
2:22:49.558643 INFO: performing precursor FDR with 47 features
2:22:49.558690 INFO: Decoy channel: -1
2:22:49.558716 INFO: Competetive: True
2:22:49.587270 WARNING: dropped 17 target PSMs due to missing features
2:22:49.587384 WARNING: dropped 10 decoy PSMs due to missing features
2:22:50.346221 INFO: Test AUC: 0.538
2:22:50.346398 INFO: Train AUC: 0.589
2:22:50.346452 INFO: AUC difference: 8.68%
2:22:50.346493 WARNING: AUC difference > 5%. This may indicate overfitting.
2:22:50.467013 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
2:22:50.467998 PROGRESS: ============================= Precursor FDR =============================
2:22:50.468152 PROGRESS: Total precursors accumulated: 309
2:22:50.468256 PROGRESS: Target precursors: 283 (91.59%)
2:22:50.468353 PROGRESS: Decoy precursors: 26 (8.41%)
2:22:50.468442 PROGRESS: 
2:22:50.468529 PROGRESS: Precursor Summary:
2:22:50.470145 PROGRESS: Channel   0:	 0.05 FDR:   205; 0.01 FDR:   139; 0.001 FDR:   136
2:22:50.470281 PROGRESS: 
2:22:50.470385 PROGRESS: Protein Summary:
2:22:50.472816 PROGRESS: Channel   0:	 0.05 FDR:   199; 0.01 FDR:   137; 0.001 FDR:   134
2:22:50.472951 PROGRESS: =========================================================================
2:22:50.473936 PROGRESS: === Epoch 18, step 4, extracting elution groups 15000 to 31000 ===
2:22:50.581557 PROGRESS: Extracting batch of 31631 precursors
2:22:50.592130 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:22:50.592224 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:22:50.592264 INFO: FWHM in RT is 14.27 seconds, sigma is 0.52
2:22:50.592302 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:22:50.592581 INFO: Starting candidate selection
2:22:54.979584 INFO: Starting candidate scoring
2:22:56.549058 INFO: Finished candidate processing
2:22:56.549243 INFO: Collecting candidate features
2:22:58.803989 WARNING: intensity_correlation has 28 NaNs ( 0.09 % out of 29616)
2:22:58.810880 INFO: Collecting fragment features
2:22:59.485312 INFO: Finished candidate scoring
2:22:59.795252 PROGRESS: === Epoch 18, step 4, extracted 29616 precursors and 146691 fragments ===
2:22:59.795585 INFO: performing precursor FDR with 47 features
2:22:59.795632 INFO: Decoy channel: -1
2:22:59.795659 INFO: Competetive: True
2:22:59.853482 WARNING: dropped 29 target PSMs due to missing features
2:22:59.853606 WARNING: dropped 26 decoy PSMs due to missing features
2:23:01.589271 INFO: Test AUC: 0.554
2:23:01.589429 INFO: Train AUC: 0.593
2:23:01.596330 INFO: AUC difference: 6.56%
2:23:01.596402 WARNING: AUC difference > 5%. This may indicate overfitting.
2:23:01.722856 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
2:23:01.723957 PROGRESS: ============================= Precursor FDR =============================
2:23:01.724077 PROGRESS: Total precursors accumulated: 758
2:23:01.724155 PROGRESS: Target precursors: 692 (91.29%)
2:23:01.724223 PROGRESS: Decoy precursors: 66 (8.71%)
2:23:01.724287 PROGRESS: 
2:23:01.724348 PROGRESS: Precursor Summary:
2:23:01.726025 PROGRESS: Channel   0:	 0.05 FDR:   423; 0.01 FDR:   223; 0.001 FDR:   178
2:23:01.726137 PROGRESS: 
2:23:01.726211 PROGRESS: Protein Summary:
2:23:01.728136 PROGRESS: Channel   0:	 0.05 FDR:   415; 0.01 FDR:   218; 0.001 FDR:   174
2:23:01.728247 PROGRESS: =========================================================================
2:23:01.729226 PROGRESS: === Epoch 18, step 5, extracting elution groups 31000 to 63000 ===
2:23:01.866247 PROGRESS: Extracting batch of 63206 precursors
2:23:01.886100 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:23:01.886226 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:23:01.886267 INFO: FWHM in RT is 14.27 seconds, sigma is 0.52
2:23:01.886297 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:23:01.886553 INFO: Starting candidate selection
2:23:06.929852 INFO: Starting candidate scoring
2:23:08.815599 INFO: Finished candidate processing
2:23:08.815708 INFO: Collecting candidate features
2:23:11.159144 WARNING: intensity_correlation has 57 NaNs ( 0.10 % out of 59130)
2:23:11.168947 INFO: Collecting fragment features
2:23:11.876272 INFO: Finished candidate scoring
2:23:12.222191 PROGRESS: === Epoch 18, step 5, extracted 59130 precursors and 293586 fragments ===
2:23:12.229440 INFO: performing precursor FDR with 47 features
2:23:12.229514 INFO: Decoy channel: -1
2:23:12.229543 INFO: Competetive: True
2:23:12.359749 WARNING: dropped 56 target PSMs due to missing features
2:23:12.359863 WARNING: dropped 56 decoy PSMs due to missing features
2:23:16.419020 INFO: Test AUC: 0.555
2:23:16.419146 INFO: Train AUC: 0.594
2:23:16.419201 INFO: AUC difference: 6.61%
2:23:16.419228 WARNING: AUC difference > 5%. This may indicate overfitting.
2:23:16.554271 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
2:23:16.555600 PROGRESS: ============================= Precursor FDR =============================
2:23:16.555746 PROGRESS: Total precursors accumulated: 1,367
2:23:16.555826 PROGRESS: Target precursors: 1,246 (91.15%)
2:23:16.555895 PROGRESS: Decoy precursors: 121 (8.85%)
2:23:16.555958 PROGRESS: 
2:23:16.556020 PROGRESS: Precursor Summary:
2:23:16.557974 PROGRESS: Channel   0:	 0.05 FDR:   832; 0.01 FDR:   523; 0.001 FDR:   404
2:23:16.558094 PROGRESS: 
2:23:16.558168 PROGRESS: Protein Summary:
2:23:16.560470 PROGRESS: Channel   0:	 0.05 FDR:   779; 0.01 FDR:   490; 0.001 FDR:   379
2:23:16.560599 PROGRESS: =========================================================================
2:23:16.561781 PROGRESS: === Epoch 18, step 6, extracting elution groups 63000 to 127000 ===
2:23:16.739537 PROGRESS: Extracting batch of 126566 precursors
2:23:16.778666 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:23:16.778788 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:23:16.778829 INFO: FWHM in RT is 14.27 seconds, sigma is 0.52
2:23:16.778856 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:23:16.779115 INFO: Starting candidate selection
2:23:23.147255 INFO: Starting candidate scoring
2:23:25.644996 INFO: Finished candidate processing
2:23:25.645228 INFO: Collecting candidate features
2:23:28.176299 WARNING: intensity_correlation has 121 NaNs ( 0.10 % out of 118439)
2:23:28.189081 INFO: Collecting fragment features
2:23:28.955159 INFO: Finished candidate scoring
2:23:29.377759 PROGRESS: === Epoch 18, step 6, extracted 118439 precursors and 586724 fragments ===
2:23:29.378105 INFO: performing precursor FDR with 47 features
2:23:29.378154 INFO: Decoy channel: -1
2:23:29.378181 INFO: Competetive: True
2:23:29.646093 WARNING: dropped 119 target PSMs due to missing features
2:23:29.646227 WARNING: dropped 114 decoy PSMs due to missing features
2:23:38.117949 INFO: Test AUC: 0.556
2:23:38.118074 INFO: Train AUC: 0.583
2:23:38.118131 INFO: AUC difference: 4.64%
2:23:38.270442 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
2:23:38.271994 PROGRESS: ============================= Precursor FDR =============================
2:23:38.272144 PROGRESS: Total precursors accumulated: 2,061
2:23:38.272224 PROGRESS: Target precursors: 1,880 (91.22%)
2:23:38.272292 PROGRESS: Decoy precursors: 181 (8.78%)
2:23:38.272356 PROGRESS: 
2:23:38.272416 PROGRESS: Precursor Summary:
2:23:38.274524 PROGRESS: Channel   0:	 0.05 FDR: 1,289; 0.01 FDR:   765; 0.001 FDR:   445
2:23:38.274643 PROGRESS: 
2:23:38.274716 PROGRESS: Protein Summary:
2:23:38.277291 PROGRESS: Channel   0:	 0.05 FDR: 1,155; 0.01 FDR:   689; 0.001 FDR:   404
2:23:38.277401 PROGRESS: =========================================================================
2:23:38.278754 PROGRESS: === Epoch 18, step 7, extracting elution groups 127000 to 255000 ===
2:23:38.506747 PROGRESS: Extracting batch of 252925 precursors
2:23:38.578737 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:23:38.578872 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:23:38.578945 INFO: FWHM in RT is 14.27 seconds, sigma is 0.52
2:23:38.578974 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:23:38.579242 INFO: Starting candidate selection
2:23:47.493288 INFO: Starting candidate scoring
2:23:51.207593 INFO: Finished candidate processing
2:23:51.207787 INFO: Collecting candidate features
2:23:54.184177 WARNING: intensity_correlation has 260 NaNs ( 0.11 % out of 237181)
2:23:54.204726 INFO: Collecting fragment features
2:23:55.065254 INFO: Finished candidate scoring
2:23:55.645884 PROGRESS: === Epoch 18, step 7, extracted 237181 precursors and 1173674 fragments ===
2:23:55.646229 INFO: performing precursor FDR with 47 features
2:23:55.646273 INFO: Decoy channel: -1
2:23:55.646300 INFO: Competetive: True
2:23:56.236480 WARNING: dropped 260 target PSMs due to missing features
2:23:56.236623 WARNING: dropped 233 decoy PSMs due to missing features
2:24:13.857202 INFO: Test AUC: 0.552
2:24:13.857333 INFO: Train AUC: 0.574
2:24:13.857371 INFO: AUC difference: 3.87%
2:24:14.035722 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
2:24:14.037863 PROGRESS: ============================= Precursor FDR =============================
2:24:14.038000 PROGRESS: Total precursors accumulated: 4,058
2:24:14.038081 PROGRESS: Target precursors: 3,697 (91.10%)
2:24:14.038151 PROGRESS: Decoy precursors: 361 (8.90%)
2:24:14.038214 PROGRESS: 
2:24:14.038276 PROGRESS: Precursor Summary:
2:24:14.040995 PROGRESS: Channel   0:	 0.05 FDR: 2,863; 0.01 FDR: 1,968; 0.001 FDR: 1,175
2:24:14.041130 PROGRESS: 
2:24:14.041201 PROGRESS: Protein Summary:
2:24:14.044879 PROGRESS: Channel   0:	 0.05 FDR: 2,298; 0.01 FDR: 1,553; 0.001 FDR:   965
2:24:14.045005 PROGRESS: =========================================================================
2:24:14.046935 PROGRESS: === Epoch 18, step 8, extracting elution groups 255000 to 511000 ===
2:24:14.348361 PROGRESS: Extracting batch of 505839 precursors
2:24:14.480077 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:24:14.480191 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:24:14.480229 INFO: FWHM in RT is 14.27 seconds, sigma is 0.52
2:24:14.480272 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:24:14.480536 INFO: Starting candidate selection
2:24:28.518484 INFO: Starting candidate scoring
2:24:34.721893 INFO: Finished candidate processing
2:24:34.722152 INFO: Collecting candidate features
2:24:38.370410 WARNING: intensity_correlation has 449 NaNs ( 0.09 % out of 473894)
2:24:38.371463 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 473894)
2:24:38.403921 INFO: Collecting fragment features
2:24:39.456299 INFO: Finished candidate scoring
2:24:40.346337 PROGRESS: === Epoch 18, step 8, extracted 473894 precursors and 2347380 fragments ===
2:24:40.353605 INFO: performing precursor FDR with 47 features
2:24:40.353763 INFO: Decoy channel: -1
2:24:40.353864 INFO: Competetive: True
2:24:41.484825 WARNING: dropped 493 target PSMs due to missing features
2:24:41.484943 WARNING: dropped 449 decoy PSMs due to missing features
2:25:16.950135 INFO: Test AUC: 0.552
2:25:16.950280 INFO: Train AUC: 0.567
2:25:16.950322 INFO: AUC difference: 2.60%
2:25:17.182138 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
2:25:17.185017 PROGRESS: ============================= Precursor FDR =============================
2:25:17.185189 PROGRESS: Total precursors accumulated: 7,104
2:25:17.185267 PROGRESS: Target precursors: 6,487 (91.31%)
2:25:17.185333 PROGRESS: Decoy precursors: 617 (8.69%)
2:25:17.185394 PROGRESS: 
2:25:17.185453 PROGRESS: Precursor Summary:
2:25:17.189075 PROGRESS: Channel   0:	 0.05 FDR: 5,235; 0.01 FDR: 3,837; 0.001 FDR: 1,889
2:25:17.189214 PROGRESS: 
2:25:17.189286 PROGRESS: Protein Summary:
2:25:17.194490 PROGRESS: Channel   0:	 0.05 FDR: 3,462; 0.01 FDR: 2,490; 0.001 FDR: 1,362
2:25:17.194606 PROGRESS: =========================================================================
2:25:17.199204 INFO: calibration group: precursor, fitting rt estimator 
2:25:17.654306 INFO: calibration group: fragment, fitting mz estimator 
2:25:18.250532 INFO: === checking if epoch conditions were reached ===
2:25:18.250722 INFO: ✅ ms2_error      : 7.0000 <= 7
2:25:18.250804 INFO: ❌ rt_error       : 203.5477 > 100
2:25:18.250867 INFO: ✅ current_epoch  : 18 >= 3
2:25:18.250924 INFO: ==============================================
2:25:18.467236 INFO: calibration group: precursor, predicting mz
2:25:18.467517 WARNING: mz prediction was skipped as it has not been fitted yet
2:25:18.467562 INFO: calibration group: precursor, predicting rt
2:25:25.258645 INFO: calibration group: fragment, predicting mz
2:25:42.979098 PROGRESS: === Epoch 19, step 0, extracting elution groups 0 to 1000 ===
2:25:43.078022 PROGRESS: Extracting batch of 1978 precursors
2:25:43.079740 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:25:43.079831 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:25:43.079872 INFO: FWHM in RT is 14.43 seconds, sigma is 0.53
2:25:43.079911 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:25:43.080166 INFO: Starting candidate selection
2:25:47.258376 INFO: Starting candidate scoring
2:25:48.552808 INFO: Finished candidate processing
2:25:48.553064 INFO: Collecting candidate features
2:25:50.708206 INFO: Collecting fragment features
2:25:51.337608 INFO: Finished candidate scoring
2:25:51.678979 PROGRESS: === Epoch 19, step 0, extracted 1860 precursors and 9400 fragments ===
2:25:51.679296 INFO: performing precursor FDR with 47 features
2:25:51.679338 INFO: Decoy channel: -1
2:25:51.679364 INFO: Competetive: True
2:25:51.710989 INFO: Test AUC: 0.504
2:25:51.711091 INFO: Train AUC: 0.576
2:25:51.711136 INFO: AUC difference: 12.62%
2:25:51.711170 WARNING: AUC difference > 5%. This may indicate overfitting.
2:25:51.831030 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
2:25:51.831790 PROGRESS: ============================= Precursor FDR =============================
2:25:51.831912 PROGRESS: Total precursors accumulated: 15
2:25:51.831990 PROGRESS: Target precursors: 14 (93.33%)
2:25:51.832057 PROGRESS: Decoy precursors: 1 (6.67%)
2:25:51.832121 PROGRESS: 
2:25:51.832182 PROGRESS: Precursor Summary:
2:25:51.833582 PROGRESS: Channel   0:	 0.05 FDR:     9; 0.01 FDR:     9; 0.001 FDR:     9
2:25:51.833695 PROGRESS: 
2:25:51.833781 PROGRESS: Protein Summary:
2:25:51.835362 PROGRESS: Channel   0:	 0.05 FDR:     9; 0.01 FDR:     9; 0.001 FDR:     9
2:25:51.835471 PROGRESS: =========================================================================
2:25:51.836327 PROGRESS: === Epoch 19, step 1, extracting elution groups 1000 to 3000 ===
2:25:51.914191 PROGRESS: Extracting batch of 3955 precursors
2:25:51.916308 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:25:51.916367 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:25:51.916405 INFO: FWHM in RT is 14.43 seconds, sigma is 0.53
2:25:51.916450 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:25:51.916662 INFO: Starting candidate selection
2:25:55.733781 INFO: Starting candidate scoring
2:25:57.042605 INFO: Finished candidate processing
2:25:57.042783 INFO: Collecting candidate features
2:25:59.232757 WARNING: intensity_correlation has 6 NaNs ( 0.16 % out of 3715)
2:25:59.238840 INFO: Collecting fragment features
2:25:59.881459 INFO: Finished candidate scoring
2:26:00.163291 PROGRESS: === Epoch 19, step 1, extracted 3715 precursors and 18462 fragments ===
2:26:00.163575 INFO: performing precursor FDR with 47 features
2:26:00.163623 INFO: Decoy channel: -1
2:26:00.163651 INFO: Competetive: True
2:26:00.172226 WARNING: dropped 1 target PSMs due to missing features
2:26:00.172315 WARNING: dropped 5 decoy PSMs due to missing features
2:26:00.210676 INFO: Test AUC: 0.539
2:26:00.210792 INFO: Train AUC: 0.560
2:26:00.210840 INFO: AUC difference: 3.79%
2:26:00.332765 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
2:26:00.333594 PROGRESS: ============================= Precursor FDR =============================
2:26:00.333729 PROGRESS: Total precursors accumulated: 37
2:26:00.333817 PROGRESS: Target precursors: 34 (91.89%)
2:26:00.333888 PROGRESS: Decoy precursors: 3 (8.11%)
2:26:00.333952 PROGRESS: 
2:26:00.334015 PROGRESS: Precursor Summary:
2:26:00.335462 PROGRESS: Channel   0:	 0.05 FDR:    29; 0.01 FDR:    29; 0.001 FDR:    29
2:26:00.335576 PROGRESS: 
2:26:00.335650 PROGRESS: Protein Summary:
2:26:00.337268 PROGRESS: Channel   0:	 0.05 FDR:    29; 0.01 FDR:    29; 0.001 FDR:    29
2:26:00.337381 PROGRESS: =========================================================================
2:26:00.338258 PROGRESS: === Epoch 19, step 2, extracting elution groups 3000 to 7000 ===
2:26:00.420499 PROGRESS: Extracting batch of 7909 precursors
2:26:00.423870 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:26:00.423935 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:26:00.423973 INFO: FWHM in RT is 14.43 seconds, sigma is 0.53
2:26:00.424001 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:26:00.424253 INFO: Starting candidate selection
2:26:04.395096 INFO: Starting candidate scoring
2:26:05.763840 INFO: Finished candidate processing
2:26:05.763982 INFO: Collecting candidate features
2:26:07.957409 WARNING: intensity_correlation has 10 NaNs ( 0.13 % out of 7458)
2:26:07.963084 INFO: Collecting fragment features
2:26:08.610748 INFO: Finished candidate scoring
2:26:08.898188 PROGRESS: === Epoch 19, step 2, extracted 7458 precursors and 36883 fragments ===
2:26:08.898513 INFO: performing precursor FDR with 47 features
2:26:08.898560 INFO: Decoy channel: -1
2:26:08.898586 INFO: Competetive: True
2:26:08.913766 WARNING: dropped 5 target PSMs due to missing features
2:26:08.913910 WARNING: dropped 11 decoy PSMs due to missing features
2:26:09.201588 INFO: Test AUC: 0.545
2:26:09.201726 INFO: Train AUC: 0.577
2:26:09.201780 INFO: AUC difference: 5.59%
2:26:09.201818 WARNING: AUC difference > 5%. This may indicate overfitting.
2:26:11.763390 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
2:26:11.764259 PROGRESS: ============================= Precursor FDR =============================
2:26:11.764390 PROGRESS: Total precursors accumulated: 93
2:26:11.764469 PROGRESS: Target precursors: 85 (91.40%)
2:26:11.764538 PROGRESS: Decoy precursors: 8 (8.60%)
2:26:11.764602 PROGRESS: 
2:26:11.764665 PROGRESS: Precursor Summary:
2:26:11.766139 PROGRESS: Channel   0:	 0.05 FDR:    53; 0.01 FDR:    44; 0.001 FDR:    44
2:26:11.766268 PROGRESS: 
2:26:11.766345 PROGRESS: Protein Summary:
2:26:11.768005 PROGRESS: Channel   0:	 0.05 FDR:    53; 0.01 FDR:    44; 0.001 FDR:    44
2:26:11.768118 PROGRESS: =========================================================================
2:26:11.768998 PROGRESS: === Epoch 19, step 3, extracting elution groups 7000 to 15000 ===
2:26:11.860284 PROGRESS: Extracting batch of 15811 precursors
2:26:11.865811 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:26:11.865895 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:26:11.865932 INFO: FWHM in RT is 14.43 seconds, sigma is 0.53
2:26:11.865958 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:26:11.866200 INFO: Starting candidate selection
2:26:16.016902 INFO: Starting candidate scoring
2:26:17.466113 INFO: Finished candidate processing
2:26:17.466208 INFO: Collecting candidate features
2:26:19.662875 WARNING: intensity_correlation has 26 NaNs ( 0.18 % out of 14756)
2:26:19.668838 INFO: Collecting fragment features
2:26:20.326846 INFO: Finished candidate scoring
2:26:20.624703 PROGRESS: === Epoch 19, step 3, extracted 14756 precursors and 72836 fragments ===
2:26:20.625077 INFO: performing precursor FDR with 47 features
2:26:20.625125 INFO: Decoy channel: -1
2:26:20.625150 INFO: Competetive: True
2:26:20.654252 WARNING: dropped 15 target PSMs due to missing features
2:26:20.654366 WARNING: dropped 27 decoy PSMs due to missing features
2:26:21.314670 INFO: Test AUC: 0.548
2:26:21.314820 INFO: Train AUC: 0.588
2:26:21.314866 INFO: AUC difference: 6.76%
2:26:21.314900 WARNING: AUC difference > 5%. This may indicate overfitting.
2:26:21.440003 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
2:26:21.440935 PROGRESS: ============================= Precursor FDR =============================
2:26:21.441054 PROGRESS: Total precursors accumulated: 199
2:26:21.441130 PROGRESS: Target precursors: 181 (90.95%)
2:26:21.441199 PROGRESS: Decoy precursors: 18 (9.05%)
2:26:21.441262 PROGRESS: 
2:26:21.441326 PROGRESS: Precursor Summary:
2:26:21.442864 PROGRESS: Channel   0:	 0.05 FDR:   126; 0.01 FDR:   110; 0.001 FDR:   107
2:26:21.442978 PROGRESS: 
2:26:21.443050 PROGRESS: Protein Summary:
2:26:21.444788 PROGRESS: Channel   0:	 0.05 FDR:   124; 0.01 FDR:   108; 0.001 FDR:   105
2:26:21.444897 PROGRESS: =========================================================================
2:26:21.445837 PROGRESS: === Epoch 19, step 4, extracting elution groups 15000 to 31000 ===
2:26:21.553308 PROGRESS: Extracting batch of 31606 precursors
2:26:21.563806 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:26:21.563914 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:26:21.563954 INFO: FWHM in RT is 14.43 seconds, sigma is 0.53
2:26:21.563981 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:26:21.564225 INFO: Starting candidate selection
2:26:25.992994 INFO: Starting candidate scoring
2:26:27.575462 INFO: Finished candidate processing
2:26:27.575558 INFO: Collecting candidate features
2:26:29.846081 WARNING: intensity_correlation has 42 NaNs ( 0.14 % out of 29639)
2:26:29.853253 INFO: Collecting fragment features
2:26:30.529083 INFO: Finished candidate scoring
2:26:30.847435 PROGRESS: === Epoch 19, step 4, extracted 29639 precursors and 147318 fragments ===
2:26:30.847779 INFO: performing precursor FDR with 47 features
2:26:30.847826 INFO: Decoy channel: -1
2:26:30.847852 INFO: Competetive: True
2:26:30.907847 WARNING: dropped 37 target PSMs due to missing features
2:26:30.907959 WARNING: dropped 47 decoy PSMs due to missing features
2:26:32.766314 INFO: Test AUC: 0.555
2:26:32.766468 INFO: Train AUC: 0.593
2:26:32.766516 INFO: AUC difference: 6.52%
2:26:32.766551 WARNING: AUC difference > 5%. This may indicate overfitting.
2:26:32.894674 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
2:26:32.895839 PROGRESS: ============================= Precursor FDR =============================
2:26:32.895981 PROGRESS: Total precursors accumulated: 692
2:26:32.896060 PROGRESS: Target precursors: 631 (91.18%)
2:26:32.896129 PROGRESS: Decoy precursors: 61 (8.82%)
2:26:32.896192 PROGRESS: 
2:26:32.896253 PROGRESS: Precursor Summary:
2:26:32.897962 PROGRESS: Channel   0:	 0.05 FDR:   264; 0.01 FDR:   222; 0.001 FDR:   169
2:26:32.898098 PROGRESS: 
2:26:32.898173 PROGRESS: Protein Summary:
2:26:32.900115 PROGRESS: Channel   0:	 0.05 FDR:   258; 0.01 FDR:   218; 0.001 FDR:   167
2:26:32.900229 PROGRESS: =========================================================================
2:26:32.901254 PROGRESS: === Epoch 19, step 5, extracting elution groups 31000 to 63000 ===
2:26:33.037449 PROGRESS: Extracting batch of 63265 precursors
2:26:33.057552 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:26:33.057677 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:26:33.057719 INFO: FWHM in RT is 14.43 seconds, sigma is 0.53
2:26:33.057747 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:26:33.058019 INFO: Starting candidate selection
2:26:38.159187 INFO: Starting candidate scoring
2:26:40.048215 INFO: Finished candidate processing
2:26:40.048322 INFO: Collecting candidate features
2:26:42.390171 WARNING: intensity_correlation has 65 NaNs ( 0.11 % out of 59149)
2:26:42.399000 INFO: Collecting fragment features
2:26:43.100182 INFO: Finished candidate scoring
2:26:43.450861 PROGRESS: === Epoch 19, step 5, extracted 59149 precursors and 293423 fragments ===
2:26:43.451235 INFO: performing precursor FDR with 47 features
2:26:43.451284 INFO: Decoy channel: -1
2:26:43.451310 INFO: Competetive: True
2:26:43.582569 WARNING: dropped 68 target PSMs due to missing features
2:26:43.582699 WARNING: dropped 81 decoy PSMs due to missing features
2:26:47.526601 INFO: Test AUC: 0.553
2:26:47.526728 INFO: Train AUC: 0.591
2:26:47.526767 INFO: AUC difference: 6.46%
2:26:47.526796 WARNING: AUC difference > 5%. This may indicate overfitting.
2:26:47.665413 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
2:26:47.666744 PROGRESS: ============================= Precursor FDR =============================
2:26:47.666876 PROGRESS: Total precursors accumulated: 1,155
2:26:47.666972 PROGRESS: Target precursors: 1,055 (91.34%)
2:26:47.667044 PROGRESS: Decoy precursors: 100 (8.66%)
2:26:47.667109 PROGRESS: 
2:26:47.667171 PROGRESS: Precursor Summary:
2:26:47.669118 PROGRESS: Channel   0:	 0.05 FDR:   771; 0.01 FDR:   475; 0.001 FDR:   320
2:26:47.669258 PROGRESS: 
2:26:47.669332 PROGRESS: Protein Summary:
2:26:47.671664 PROGRESS: Channel   0:	 0.05 FDR:   721; 0.01 FDR:   447; 0.001 FDR:   303
2:26:47.671779 PROGRESS: =========================================================================
2:26:47.672937 PROGRESS: === Epoch 19, step 6, extracting elution groups 63000 to 127000 ===
2:26:47.848302 PROGRESS: Extracting batch of 126512 precursors
2:26:47.887159 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:26:47.887275 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:26:47.887313 INFO: FWHM in RT is 14.43 seconds, sigma is 0.53
2:26:47.887357 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:26:47.887624 INFO: Starting candidate selection
2:26:54.306116 INFO: Starting candidate scoring
2:26:56.810010 INFO: Finished candidate processing
2:26:56.810106 INFO: Collecting candidate features
2:26:59.363724 WARNING: intensity_correlation has 131 NaNs ( 0.11 % out of 118362)
2:26:59.376698 INFO: Collecting fragment features
2:27:00.145112 INFO: Finished candidate scoring
2:27:00.574428 PROGRESS: === Epoch 19, step 6, extracted 118362 precursors and 586609 fragments ===
2:27:00.574808 INFO: performing precursor FDR with 47 features
2:27:00.574854 INFO: Decoy channel: -1
2:27:00.574881 INFO: Competetive: True
2:27:00.849634 WARNING: dropped 136 target PSMs due to missing features
2:27:00.849747 WARNING: dropped 144 decoy PSMs due to missing features
2:27:09.231311 INFO: Test AUC: 0.554
2:27:09.231437 INFO: Train AUC: 0.582
2:27:09.231493 INFO: AUC difference: 4.82%
2:27:09.382260 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
2:27:09.383957 PROGRESS: ============================= Precursor FDR =============================
2:27:09.384110 PROGRESS: Total precursors accumulated: 2,384
2:27:09.384189 PROGRESS: Target precursors: 2,174 (91.19%)
2:27:09.384256 PROGRESS: Decoy precursors: 210 (8.81%)
2:27:09.384318 PROGRESS: 
2:27:09.384380 PROGRESS: Precursor Summary:
2:27:09.386752 PROGRESS: Channel   0:	 0.05 FDR: 1,568; 0.01 FDR: 1,080; 0.001 FDR:   534
2:27:09.386886 PROGRESS: 
2:27:09.386971 PROGRESS: Protein Summary:
2:27:09.389936 PROGRESS: Channel   0:	 0.05 FDR: 1,399; 0.01 FDR:   952; 0.001 FDR:   488
2:27:09.390053 PROGRESS: =========================================================================
2:27:09.391586 PROGRESS: === Epoch 19, step 7, extracting elution groups 127000 to 255000 ===
2:27:09.615803 PROGRESS: Extracting batch of 252856 precursors
2:27:09.688385 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:27:09.688497 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:27:09.688534 INFO: FWHM in RT is 14.43 seconds, sigma is 0.53
2:27:09.688578 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:27:09.688856 INFO: Starting candidate selection
2:27:18.637606 INFO: Starting candidate scoring
2:27:22.358167 INFO: Finished candidate processing
2:27:22.358351 INFO: Collecting candidate features
2:27:25.318904 WARNING: intensity_correlation has 325 NaNs ( 0.14 % out of 236185)
2:27:25.339890 INFO: Collecting fragment features
2:27:26.204170 INFO: Finished candidate scoring
2:27:26.791345 PROGRESS: === Epoch 19, step 7, extracted 236185 precursors and 1169059 fragments ===
2:27:26.791717 INFO: performing precursor FDR with 47 features
2:27:26.791765 INFO: Decoy channel: -1
2:27:26.791792 INFO: Competetive: True
2:27:27.396131 WARNING: dropped 317 target PSMs due to missing features
2:27:27.396253 WARNING: dropped 288 decoy PSMs due to missing features
2:27:44.128187 INFO: Test AUC: 0.549
2:27:44.128317 INFO: Train AUC: 0.574
2:27:44.128356 INFO: AUC difference: 4.35%
2:27:44.330933 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
2:27:44.333164 PROGRESS: ============================= Precursor FDR =============================
2:27:44.333318 PROGRESS: Total precursors accumulated: 4,045
2:27:44.333397 PROGRESS: Target precursors: 3,686 (91.12%)
2:27:44.333466 PROGRESS: Decoy precursors: 359 (8.88%)
2:27:44.333532 PROGRESS: 
2:27:44.333611 PROGRESS: Precursor Summary:
2:27:44.336515 PROGRESS: Channel   0:	 0.05 FDR: 2,892; 0.01 FDR: 2,012; 0.001 FDR: 1,323
2:27:44.336658 PROGRESS: 
2:27:44.336730 PROGRESS: Protein Summary:
2:27:44.340653 PROGRESS: Channel   0:	 0.05 FDR: 2,300; 0.01 FDR: 1,573; 0.001 FDR: 1,058
2:27:44.340795 PROGRESS: =========================================================================
2:27:44.342814 PROGRESS: === Epoch 19, step 8, extracting elution groups 255000 to 511000 ===
2:27:44.645057 PROGRESS: Extracting batch of 505839 precursors
2:27:44.777966 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:27:44.778100 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:27:44.778141 INFO: FWHM in RT is 14.43 seconds, sigma is 0.53
2:27:44.778168 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:27:44.778435 INFO: Starting candidate selection
2:27:58.811470 INFO: Starting candidate scoring
2:28:04.945257 INFO: Finished candidate processing
2:28:04.945449 INFO: Collecting candidate features
2:28:08.562405 WARNING: intensity_correlation has 608 NaNs ( 0.13 % out of 473141)
2:28:08.596694 INFO: Collecting fragment features
2:28:09.646743 INFO: Finished candidate scoring
2:28:10.539335 PROGRESS: === Epoch 19, step 8, extracted 473141 precursors and 2344827 fragments ===
2:28:10.539705 INFO: performing precursor FDR with 47 features
2:28:10.539753 INFO: Decoy channel: -1
2:28:10.539780 INFO: Competetive: True
2:28:11.681175 WARNING: dropped 643 target PSMs due to missing features
2:28:11.681302 WARNING: dropped 570 decoy PSMs due to missing features
2:28:47.027593 INFO: Test AUC: 0.552
2:28:47.027718 INFO: Train AUC: 0.567
2:28:47.027769 INFO: AUC difference: 2.60%
2:28:47.264388 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
2:28:47.267497 PROGRESS: ============================= Precursor FDR =============================
2:28:47.267662 PROGRESS: Total precursors accumulated: 7,346
2:28:47.267739 PROGRESS: Target precursors: 6,699 (91.19%)
2:28:47.267805 PROGRESS: Decoy precursors: 647 (8.81%)
2:28:47.267866 PROGRESS: 
2:28:47.267941 PROGRESS: Precursor Summary:
2:28:47.272035 PROGRESS: Channel   0:	 0.05 FDR: 5,468; 0.01 FDR: 3,925; 0.001 FDR: 2,592
2:28:47.272193 PROGRESS: 
2:28:47.272284 PROGRESS: Protein Summary:
2:28:47.278084 PROGRESS: Channel   0:	 0.05 FDR: 3,672; 0.01 FDR: 2,591; 0.001 FDR: 1,786
2:28:47.278234 PROGRESS: =========================================================================
2:28:47.281119 PROGRESS: === Epoch 19, step 9, extracting elution groups 511000 to 1023000 ===
2:28:47.707030 PROGRESS: Extracting batch of 1011800 precursors
2:28:47.982247 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:28:47.982359 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:28:47.982401 INFO: FWHM in RT is 14.43 seconds, sigma is 0.53
2:28:47.982429 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:28:47.982711 INFO: Starting candidate selection
2:29:12.315071 INFO: Starting candidate scoring
2:29:23.580002 INFO: Finished candidate processing
2:29:23.580194 INFO: Collecting candidate features
2:29:28.533619 WARNING: intensity_correlation has 1198 NaNs ( 0.13 % out of 946130)
2:29:28.535443 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 946130)
2:29:28.595081 INFO: Collecting fragment features
2:29:30.252895 INFO: Finished candidate scoring
2:29:31.853467 PROGRESS: === Epoch 19, step 9, extracted 946130 precursors and 4685996 fragments ===
2:29:31.853809 INFO: performing precursor FDR with 47 features
2:29:31.853858 INFO: Decoy channel: -1
2:29:31.853883 INFO: Competetive: True
2:29:34.173941 WARNING: dropped 1249 target PSMs due to missing features
2:29:34.174070 WARNING: dropped 1162 decoy PSMs due to missing features
2:30:47.400495 INFO: Test AUC: 0.553
2:30:47.400623 INFO: Train AUC: 0.562
2:30:47.400675 INFO: AUC difference: 1.66%
2:30:47.749419 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
2:30:47.753905 PROGRESS: ============================= Precursor FDR =============================
2:30:47.754141 PROGRESS: Total precursors accumulated: 12,730
2:30:47.754240 PROGRESS: Target precursors: 11,643 (91.46%)
2:30:47.754318 PROGRESS: Decoy precursors: 1,087 (8.54%)
2:30:47.754384 PROGRESS: 
2:30:47.754446 PROGRESS: Precursor Summary:
2:30:47.760527 PROGRESS: Channel   0:	 0.05 FDR: 9,990; 0.01 FDR: 7,503; 0.001 FDR: 5,221
2:30:47.760740 PROGRESS: 
2:30:47.760815 PROGRESS: Protein Summary:
2:30:47.769563 PROGRESS: Channel   0:	 0.05 FDR: 5,041; 0.01 FDR: 3,814; 0.001 FDR: 2,809
2:30:47.769750 PROGRESS: =========================================================================
2:30:47.777129 INFO: calibration group: precursor, fitting rt estimator 
2:30:48.963313 INFO: calibration group: fragment, fitting mz estimator 
2:30:49.748310 INFO: calibration group: precursor, predicting mz
2:30:49.749141 WARNING: mz prediction was skipped as it has not been fitted yet
2:30:49.749190 INFO: calibration group: precursor, predicting rt
2:30:56.576435 INFO: calibration group: fragment, predicting mz
2:31:14.405193 PROGRESS: Extracting batch of 9950763 precursors
2:31:17.109532 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:31:17.109668 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:31:17.109712 INFO: FWHM in RT is 14.54 seconds, sigma is 0.53
2:31:17.109739 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:31:17.110024 INFO: Starting candidate selection
2:34:25.988212 INFO: Applying score cutoff of 56.05620537567139
2:34:26.140414 INFO: Removed 7310041 precursors with score below cutoff
2:34:28.595323 INFO: Starting candidate scoring
2:34:56.960781 INFO: Finished candidate processing
2:34:56.960901 INFO: Collecting candidate features
2:35:05.048628 WARNING: intensity_correlation has 20 NaNs ( 0.00 % out of 2352936)
2:35:05.183596 INFO: Collecting fragment features
2:35:08.647581 INFO: Finished candidate scoring
2:35:11.191977 INFO: performing precursor FDR with 47 features
2:35:11.192096 INFO: Decoy channel: -1
2:35:11.192123 INFO: Competetive: True
2:35:13.237904 WARNING: dropped 12 target PSMs due to missing features
2:35:13.238041 WARNING: dropped 8 decoy PSMs due to missing features
2:36:43.752255 INFO: Test AUC: 0.573
2:36:43.752385 INFO: Train AUC: 0.579
2:36:43.752436 INFO: AUC difference: 0.92%
2:36:44.126288 INFO: Removing fragments below FDR threshold
2:36:44.378978 PROGRESS: ============================= Precursor FDR =============================
2:36:44.379243 PROGRESS: Total precursors accumulated: 24,854
2:36:44.379336 PROGRESS: Target precursors: 24,608 (99.01%)
2:36:44.379403 PROGRESS: Decoy precursors: 246 (0.99%)
2:36:44.379481 PROGRESS: 
2:36:44.379555 PROGRESS: Precursor Summary:
2:36:44.394832 PROGRESS: Channel   0:	 0.05 FDR: 24,608; 0.01 FDR: 24,608; 0.001 FDR: 17,799
2:36:44.395087 PROGRESS: 
2:36:44.395167 PROGRESS: Protein Summary:
2:36:44.416034 PROGRESS: Channel   0:	 0.05 FDR: 6,752; 0.01 FDR: 6,752; 0.001 FDR: 5,372
2:36:44.416276 PROGRESS: =========================================================================
2:36:44.804827 INFO: Finished workflow for LFQ_Orbitrap_AIF_Condition_A_Sample_Alpha_01
2:36:45.327929 PROGRESS: Loading raw file 3/6: LFQ_Orbitrap_AIF_Condition_B_Sample_Alpha_01
2:36:45.328114 INFO: Creating workflow folder for LFQ_Orbitrap_AIF_Condition_B_Sample_Alpha_01 at output/.progress/LFQ_Orbitrap_AIF_Condition_B_Sample_Alpha_01
2:37:15.082045 INFO: Determining DIA cycle
2:37:15.096043 WARNING: Failed to determine DIA cycle, will retry without MS1 spectra.
2:37:15.102137 INFO: Determining DIA cycle
2:37:15.119869 INFO: Found cycle with start 0.00 min and length 151.
2:37:15.254198 INFO: ============ Raw file stats ============
2:37:15.254558 INFO: RT (min)            : 0.0 - 150.0
2:37:15.254641 INFO: RT duration (sec)   : 8999.7
2:37:15.254672 INFO: RT duration (min)   : 150.0
2:37:15.254774 INFO: Cycle len (scans)   : 151
2:37:15.254817 INFO: Cycle len (sec)     : 5.83
2:37:15.254845 INFO: Number of cycles    : 1542
2:37:15.254903 INFO: MS2 range (m/z)     : 396.4 - 1004.7
2:37:15.254938 INFO: ========================================
2:37:17.468745 INFO: Initializing CalibrationManager
2:37:17.469002 INFO: Loading calibration config
2:37:17.469447 INFO: Calibration config: [{'name': 'fragment', 'estimators': [{'name': 'mz', 'model': 'LOESSRegression', 'model_args': {'n_kernels': 2}, 'input_columns': ['mz_library'], 'target_columns': ['mz_observed'], 'output_columns': ['mz_calibrated'], 'transform_deviation': '1e6', 'function': LOESSRegression(n_kernels=2)}]}, {'name': 'precursor', 'estimators': [{'name': 'mz', 'model': 'LOESSRegression', 'model_args': {'n_kernels': 2}, 'input_columns': ['mz_library'], 'target_columns': ['mz_observed'], 'output_columns': ['mz_calibrated'], 'transform_deviation': '1e6', 'function': LOESSRegression(n_kernels=2)}, {'name': 'rt', 'model': 'LOESSRegression', 'model_args': {'n_kernels': 6}, 'input_columns': ['rt_library'], 'target_columns': ['rt_observed'], 'output_columns': ['rt_calibrated'], 'function': LOESSRegression()}, {'name': 'mobility', 'model': 'LOESSRegression', 'model_args': {'n_kernels': 2}, 'input_columns': ['mobility_library'], 'target_columns': ['mobility_observed'], 'output_columns': ['mobility_calibrated'], 'function': LOESSRegression(n_kernels=2)}]}]
2:37:17.469562 INFO: Calibration group :fragment, found 1 estimator(s)
2:37:17.469643 INFO: Calibration group :precursor, found 3 estimator(s)
2:37:17.469724 INFO: Disabling ion mobility calibration
2:37:17.469756 INFO: removed mobility estimator from group precursor
2:37:17.469885 INFO: Initializing OptimizationManager
2:37:17.469990 INFO: initial parameter: fwhm_rt = 5
2:37:17.470047 INFO: initial parameter: fwhm_mobility = 0.01
2:37:17.470100 INFO: initial parameter: score_cutoff = 0
2:37:17.470190 PROGRESS: Initializing workflow LFQ_Orbitrap_AIF_Condition_B_Sample_Alpha_01
2:37:17.470261 INFO: Initializing OptimizationManager
2:37:17.470290 INFO: initial parameter: current_epoch = 0
2:37:17.470312 INFO: initial parameter: current_step = 0
2:37:17.470334 INFO: initial parameter: ms1_error = 10
2:37:17.470355 INFO: initial parameter: ms2_error = 10
2:37:17.470376 INFO: initial parameter: rt_error = 240
2:37:17.470397 INFO: initial parameter: mobility_error = 0.08
2:37:17.470417 INFO: initial parameter: column_type = library
2:37:17.470438 INFO: initial parameter: num_candidates = 1
2:37:17.470459 INFO: initial parameter: recalibration_target = 200
2:37:17.470479 INFO: initial parameter: accumulated_precursors = 0
2:37:17.470500 INFO: initial parameter: accumulated_precursors_01FDR = 0
2:37:17.470520 INFO: initial parameter: accumulated_precursors_001FDR = 0
2:37:17.470548 INFO: Initializing FDRManager
2:37:17.470579 INFO: Loading classifier store from /home/alphadia/miniconda3/envs/alphadia172/lib/python3.11/site-packages/alphadia/constants/classifier
2:37:17.473337 PROGRESS: Applying channel filter using only: [0]
2:37:19.438749 PROGRESS: 4,989,882 target precursors potentially observable (188,089 removed)
2:37:22.946683 INFO: === checking if epoch conditions were reached ===
2:37:22.946941 INFO: ❌ ms2_error      : 10.0000 > 7
2:37:22.947024 INFO: ❌ rt_error       : 240.0000 > 100
2:37:22.947088 INFO: ❌ current_epoch  : 0 < 3
2:37:22.947145 INFO: ==============================================
2:37:23.151234 INFO: calibration group: precursor, predicting mz
2:37:23.151524 WARNING: mz prediction was skipped as it has not been fitted yet
2:37:23.151567 INFO: calibration group: precursor, predicting rt
2:37:23.151627 WARNING: rt prediction was skipped as it has not been fitted yet
2:37:23.151661 INFO: calibration group: fragment, predicting mz
2:37:23.151715 WARNING: mz prediction was skipped as it has not been fitted yet
2:37:23.151750 PROGRESS: === Epoch 0, step 0, extracting elution groups 0 to 1000 ===
2:37:23.225120 PROGRESS: Extracting batch of 1982 precursors
2:37:23.226879 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:37:23.226971 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:37:23.227027 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
2:37:23.227057 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
2:37:23.227305 INFO: Starting candidate selection
2:37:26.632801 INFO: Starting candidate scoring
2:37:27.735207 INFO: Finished candidate processing
2:37:27.735293 INFO: Collecting candidate features
2:37:29.903933 INFO: Collecting fragment features
2:37:30.521352 INFO: Finished candidate scoring
2:37:30.800903 PROGRESS: === Epoch 0, step 0, extracted 1718 precursors and 8469 fragments ===
2:37:30.801193 INFO: performing precursor FDR with 47 features
2:37:30.801240 INFO: Decoy channel: -1
2:37:30.801268 INFO: Competetive: True
2:37:30.834075 INFO: Test AUC: 0.451
2:37:30.834181 INFO: Train AUC: 0.478
2:37:30.834227 INFO: AUC difference: 5.61%
2:37:30.834262 WARNING: AUC difference > 5%. This may indicate overfitting.
2:37:30.955864 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
2:37:30.956661 PROGRESS: ============================= Precursor FDR =============================
2:37:30.956790 PROGRESS: Total precursors accumulated: 5
2:37:30.956867 PROGRESS: Target precursors: 5 (100.00%)
2:37:30.956936 PROGRESS: Decoy precursors: 0 (0.00%)
2:37:30.956998 PROGRESS: 
2:37:30.957069 PROGRESS: Precursor Summary:
2:37:30.958579 PROGRESS: Channel   0:	 0.05 FDR:     5; 0.01 FDR:     5; 0.001 FDR:     5
2:37:30.958700 PROGRESS: 
2:37:30.958774 PROGRESS: Protein Summary:
2:37:30.960456 PROGRESS: Channel   0:	 0.05 FDR:     5; 0.01 FDR:     5; 0.001 FDR:     5
2:37:30.960568 PROGRESS: =========================================================================
2:37:30.961458 PROGRESS: === Epoch 0, step 1, extracting elution groups 1000 to 3000 ===
2:37:31.038950 PROGRESS: Extracting batch of 3956 precursors
2:37:31.041201 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:37:31.041261 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:37:31.041299 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
2:37:31.041343 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
2:37:31.041553 INFO: Starting candidate selection
2:37:34.451847 INFO: Starting candidate scoring
2:37:35.571325 INFO: Finished candidate processing
2:37:35.571420 INFO: Collecting candidate features
2:37:37.720950 INFO: Collecting fragment features
2:37:38.335288 INFO: Finished candidate scoring
2:37:38.617649 PROGRESS: === Epoch 0, step 1, extracted 3398 precursors and 16743 fragments ===
2:37:38.617954 INFO: performing precursor FDR with 47 features
2:37:38.618002 INFO: Decoy channel: -1
2:37:38.618028 INFO: Competetive: True
2:37:38.688598 INFO: Test AUC: 0.496
2:37:38.688727 INFO: Train AUC: 0.495
2:37:38.688772 INFO: AUC difference: 0.17%
2:37:38.823583 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
2:37:38.825330 PROGRESS: ============================= Precursor FDR =============================
2:37:38.825482 PROGRESS: Total precursors accumulated: 2,643
2:37:38.825561 PROGRESS: Target precursors: 1,319 (49.91%)
2:37:38.825628 PROGRESS: Decoy precursors: 1,324 (50.09%)
2:37:38.825690 PROGRESS: 
2:37:38.825751 PROGRESS: Precursor Summary:
2:37:38.827207 PROGRESS: Channel   0:	 0.05 FDR:     0; 0.01 FDR:     0; 0.001 FDR:     0
2:37:38.827330 PROGRESS: 
2:37:38.827404 PROGRESS: Protein Summary:
2:37:38.829014 PROGRESS: Channel   0:	 0.05 FDR:     0; 0.01 FDR:     0; 0.001 FDR:     0
2:37:38.829137 PROGRESS: =========================================================================
2:37:38.829998 PROGRESS: === Epoch 0, step 2, extracting elution groups 3000 to 7000 ===
2:37:38.912433 PROGRESS: Extracting batch of 7896 precursors
2:37:38.915712 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:37:38.915790 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:37:38.915831 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
2:37:38.915877 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
2:37:38.916101 INFO: Starting candidate selection
2:37:42.442992 INFO: Starting candidate scoring
2:37:43.596450 INFO: Finished candidate processing
2:37:43.596555 INFO: Collecting candidate features
2:37:45.777452 WARNING: intensity_correlation has 1 NaNs ( 0.02 % out of 6646)
2:37:45.783910 INFO: Collecting fragment features
2:37:46.409871 INFO: Finished candidate scoring
2:37:46.697559 PROGRESS: === Epoch 0, step 2, extracted 6646 precursors and 32331 fragments ===
2:37:46.697918 INFO: performing precursor FDR with 47 features
2:37:46.697968 INFO: Decoy channel: -1
2:37:46.697995 INFO: Competetive: True
2:37:46.711832 WARNING: dropped 1 decoy PSMs due to missing features
2:37:46.770200 INFO: Test AUC: 0.513
2:37:46.770335 INFO: Train AUC: 0.488
2:37:46.770381 INFO: AUC difference: 5.27%
2:37:46.770415 WARNING: AUC difference > 5%. This may indicate overfitting.
2:37:46.899572 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
2:37:46.900432 PROGRESS: ============================= Precursor FDR =============================
2:37:46.900557 PROGRESS: Total precursors accumulated: 2
2:37:46.900649 PROGRESS: Target precursors: 2 (100.00%)
2:37:46.900719 PROGRESS: Decoy precursors: 0 (0.00%)
2:37:46.900783 PROGRESS: 
2:37:46.900845 PROGRESS: Precursor Summary:
2:37:46.902383 PROGRESS: Channel   0:	 0.05 FDR:     2; 0.01 FDR:     2; 0.001 FDR:     2
2:37:46.902495 PROGRESS: 
2:37:46.902569 PROGRESS: Protein Summary:
2:37:46.904263 PROGRESS: Channel   0:	 0.05 FDR:     2; 0.01 FDR:     2; 0.001 FDR:     2
2:37:46.904373 PROGRESS: =========================================================================
2:37:46.905271 PROGRESS: === Epoch 0, step 3, extracting elution groups 7000 to 15000 ===
2:37:46.997231 PROGRESS: Extracting batch of 15802 precursors
2:37:47.002673 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:37:47.002755 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:37:47.002797 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
2:37:47.002826 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
2:37:47.003043 INFO: Starting candidate selection
2:37:50.654579 INFO: Starting candidate scoring
2:37:51.872079 INFO: Finished candidate processing
2:37:51.872234 INFO: Collecting candidate features
2:37:54.081450 WARNING: intensity_correlation has 1 NaNs ( 0.01 % out of 13393)
2:37:54.087274 INFO: Collecting fragment features
2:37:54.724665 INFO: Finished candidate scoring
2:37:55.022517 PROGRESS: === Epoch 0, step 3, extracted 13393 precursors and 65458 fragments ===
2:37:55.022851 INFO: performing precursor FDR with 47 features
2:37:55.022897 INFO: Decoy channel: -1
2:37:55.022924 INFO: Competetive: True
2:37:55.049414 WARNING: dropped 1 target PSMs due to missing features
2:37:55.049528 WARNING: dropped 1 decoy PSMs due to missing features
2:37:55.753083 INFO: Test AUC: 0.513
2:37:55.753229 INFO: Train AUC: 0.542
2:37:55.753276 INFO: AUC difference: 5.34%
2:37:55.753311 WARNING: AUC difference > 5%. This may indicate overfitting.
2:37:55.893556 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
2:37:55.894473 PROGRESS: ============================= Precursor FDR =============================
2:37:55.894603 PROGRESS: Total precursors accumulated: 2
2:37:55.894681 PROGRESS: Target precursors: 2 (100.00%)
2:37:55.894749 PROGRESS: Decoy precursors: 0 (0.00%)
2:37:55.894812 PROGRESS: 
2:37:55.894872 PROGRESS: Precursor Summary:
2:37:55.896379 PROGRESS: Channel   0:	 0.05 FDR:     2; 0.01 FDR:     2; 0.001 FDR:     2
2:37:55.896492 PROGRESS: 
2:37:55.896567 PROGRESS: Protein Summary:
2:37:55.898283 PROGRESS: Channel   0:	 0.05 FDR:     2; 0.01 FDR:     2; 0.001 FDR:     2
2:37:55.898395 PROGRESS: =========================================================================
2:37:55.899288 PROGRESS: === Epoch 0, step 4, extracting elution groups 15000 to 31000 ===
2:37:56.008245 PROGRESS: Extracting batch of 31631 precursors
2:37:56.020710 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:37:56.020804 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:37:56.020843 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
2:37:56.020885 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
2:37:56.021121 INFO: Starting candidate selection
2:38:00.045861 INFO: Starting candidate scoring
2:38:01.400653 INFO: Finished candidate processing
2:38:01.400754 INFO: Collecting candidate features
2:38:03.626595 WARNING: intensity_correlation has 1 NaNs ( 0.00 % out of 26952)
2:38:03.633449 INFO: Collecting fragment features
2:38:04.283908 INFO: Finished candidate scoring
2:38:04.594197 PROGRESS: === Epoch 0, step 4, extracted 26952 precursors and 131575 fragments ===
2:38:04.594538 INFO: performing precursor FDR with 47 features
2:38:04.594584 INFO: Decoy channel: -1
2:38:04.594611 INFO: Competetive: True
2:38:04.647264 WARNING: dropped 1 target PSMs due to missing features
2:38:04.647371 WARNING: dropped 2 decoy PSMs due to missing features
2:38:06.220482 INFO: Test AUC: 0.544
2:38:06.220634 INFO: Train AUC: 0.559
2:38:06.220681 INFO: AUC difference: 2.72%
2:38:06.353592 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
2:38:06.354483 PROGRESS: ============================= Precursor FDR =============================
2:38:06.354610 PROGRESS: Total precursors accumulated: 70
2:38:06.354688 PROGRESS: Target precursors: 64 (91.43%)
2:38:06.354756 PROGRESS: Decoy precursors: 6 (8.57%)
2:38:06.354820 PROGRESS: 
2:38:06.354882 PROGRESS: Precursor Summary:
2:38:06.356342 PROGRESS: Channel   0:	 0.05 FDR:     5; 0.01 FDR:     5; 0.001 FDR:     5
2:38:06.356472 PROGRESS: 
2:38:06.356545 PROGRESS: Protein Summary:
2:38:06.358173 PROGRESS: Channel   0:	 0.05 FDR:     5; 0.01 FDR:     5; 0.001 FDR:     5
2:38:06.358287 PROGRESS: =========================================================================
2:38:06.359144 PROGRESS: === Epoch 0, step 5, extracting elution groups 31000 to 63000 ===
2:38:06.495723 PROGRESS: Extracting batch of 63200 precursors
2:38:06.515798 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:38:06.515907 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:38:06.515966 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
2:38:06.515994 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
2:38:06.516245 INFO: Starting candidate selection
2:38:11.193448 INFO: Starting candidate scoring
2:38:12.795641 INFO: Finished candidate processing
2:38:12.795736 INFO: Collecting candidate features
2:38:15.116531 INFO: Collecting fragment features
2:38:15.801445 INFO: Finished candidate scoring
2:38:16.144743 PROGRESS: === Epoch 0, step 5, extracted 53994 precursors and 263205 fragments ===
2:38:16.145072 INFO: performing precursor FDR with 47 features
2:38:16.145118 INFO: Decoy channel: -1
2:38:16.145144 INFO: Competetive: True
2:38:16.262784 WARNING: dropped 1 target PSMs due to missing features
2:38:16.262897 WARNING: dropped 2 decoy PSMs due to missing features
2:38:19.835257 INFO: Test AUC: 0.534
2:38:19.835377 INFO: Train AUC: 0.566
2:38:19.835416 INFO: AUC difference: 5.66%
2:38:19.835462 WARNING: AUC difference > 5%. This may indicate overfitting.
2:38:19.971493 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
2:38:19.972421 PROGRESS: ============================= Precursor FDR =============================
2:38:19.972544 PROGRESS: Total precursors accumulated: 176
2:38:19.972620 PROGRESS: Target precursors: 161 (91.48%)
2:38:19.972688 PROGRESS: Decoy precursors: 15 (8.52%)
2:38:19.972749 PROGRESS: 
2:38:19.972810 PROGRESS: Precursor Summary:
2:38:19.975592 PROGRESS: Channel   0:	 0.05 FDR:   135; 0.01 FDR:    19; 0.001 FDR:    19
2:38:19.975898 PROGRESS: 
2:38:19.976114 PROGRESS: Protein Summary:
2:38:19.980939 PROGRESS: Channel   0:	 0.05 FDR:   133; 0.01 FDR:    19; 0.001 FDR:    19
2:38:19.981231 PROGRESS: =========================================================================
2:38:19.982380 PROGRESS: === Epoch 0, step 6, extracting elution groups 63000 to 127000 ===
2:38:20.157280 PROGRESS: Extracting batch of 126439 precursors
2:38:20.195961 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:38:20.196077 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:38:20.196117 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
2:38:20.196159 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
2:38:20.196436 INFO: Starting candidate selection
2:38:26.313855 INFO: Starting candidate scoring
2:38:28.491590 INFO: Finished candidate processing
2:38:28.491773 INFO: Collecting candidate features
2:38:30.985136 WARNING: intensity_correlation has 7 NaNs ( 0.01 % out of 107420)
2:38:30.998507 INFO: Collecting fragment features
2:38:31.731736 INFO: Finished candidate scoring
2:38:32.140516 PROGRESS: === Epoch 0, step 6, extracted 107420 precursors and 523803 fragments ===
2:38:32.140865 INFO: performing precursor FDR with 47 features
2:38:32.140912 INFO: Decoy channel: -1
2:38:32.140938 INFO: Competetive: True
2:38:32.388412 WARNING: dropped 5 target PSMs due to missing features
2:38:32.388525 WARNING: dropped 5 decoy PSMs due to missing features
2:38:39.986999 INFO: Test AUC: 0.546
2:38:39.987124 INFO: Train AUC: 0.567
2:38:39.987179 INFO: AUC difference: 3.64%
2:38:40.135982 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
2:38:40.137025 PROGRESS: ============================= Precursor FDR =============================
2:38:40.137148 PROGRESS: Total precursors accumulated: 521
2:38:40.137226 PROGRESS: Target precursors: 476 (91.36%)
2:38:40.137294 PROGRESS: Decoy precursors: 45 (8.64%)
2:38:40.137357 PROGRESS: 
2:38:40.137419 PROGRESS: Precursor Summary:
2:38:40.139153 PROGRESS: Channel   0:	 0.05 FDR:   406; 0.01 FDR:   279; 0.001 FDR:   178
2:38:40.139284 PROGRESS: 
2:38:40.139358 PROGRESS: Protein Summary:
2:38:40.141350 PROGRESS: Channel   0:	 0.05 FDR:   377; 0.01 FDR:   258; 0.001 FDR:   169
2:38:40.141476 PROGRESS: =========================================================================
2:38:40.143196 INFO: calibration group: precursor, fitting rt estimator 
2:38:40.250212 INFO: calibration group: fragment, fitting mz estimator 
2:38:40.610494 INFO: === checking if epoch conditions were reached ===
2:38:40.610636 INFO: ✅ ms2_error      : 7.0000 <= 7
2:38:40.610724 INFO: ❌ rt_error       : 222.8278 > 100
2:38:40.610800 INFO: ❌ current_epoch  : 0 < 3
2:38:40.610873 INFO: ==============================================
2:38:40.863799 INFO: calibration group: precursor, predicting mz
2:38:40.864078 WARNING: mz prediction was skipped as it has not been fitted yet
2:38:40.864121 INFO: calibration group: precursor, predicting rt
2:38:47.846335 INFO: calibration group: fragment, predicting mz
2:39:05.201810 PROGRESS: === Epoch 1, step 0, extracting elution groups 0 to 1000 ===
2:39:05.283283 PROGRESS: Extracting batch of 1973 precursors
2:39:05.285010 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:39:05.285097 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:39:05.285136 INFO: FWHM in RT is 16.98 seconds, sigma is 0.62
2:39:05.285166 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:39:05.285412 INFO: Starting candidate selection
2:39:09.497645 INFO: Starting candidate scoring
2:39:10.790224 INFO: Finished candidate processing
2:39:10.790420 INFO: Collecting candidate features
2:39:12.941534 WARNING: intensity_correlation has 1 NaNs ( 0.06 % out of 1635)
2:39:12.947408 INFO: Collecting fragment features
2:39:13.582861 INFO: Finished candidate scoring
2:39:13.872458 PROGRESS: === Epoch 1, step 0, extracted 1635 precursors and 7732 fragments ===
2:39:13.872759 INFO: performing precursor FDR with 47 features
2:39:13.872804 INFO: Decoy channel: -1
2:39:13.872831 INFO: Competetive: True
2:39:13.877193 WARNING: dropped 1 target PSMs due to missing features
2:39:13.905447 INFO: Test AUC: 0.559
2:39:13.905539 INFO: Train AUC: 0.523
2:39:13.905584 INFO: AUC difference: 6.75%
2:39:13.905618 WARNING: AUC difference > 5%. This may indicate overfitting.
2:39:14.027464 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
2:39:14.028266 PROGRESS: ============================= Precursor FDR =============================
2:39:14.028389 PROGRESS: Total precursors accumulated: 3
2:39:14.028469 PROGRESS: Target precursors: 3 (100.00%)
2:39:14.028538 PROGRESS: Decoy precursors: 0 (0.00%)
2:39:14.028614 PROGRESS: 
2:39:14.028677 PROGRESS: Precursor Summary:
2:39:14.030190 PROGRESS: Channel   0:	 0.05 FDR:     3; 0.01 FDR:     3; 0.001 FDR:     3
2:39:14.030305 PROGRESS: 
2:39:14.030378 PROGRESS: Protein Summary:
2:39:14.032073 PROGRESS: Channel   0:	 0.05 FDR:     3; 0.01 FDR:     3; 0.001 FDR:     3
2:39:14.032199 PROGRESS: =========================================================================
2:39:14.033088 PROGRESS: === Epoch 1, step 1, extracting elution groups 1000 to 3000 ===
2:39:14.111543 PROGRESS: Extracting batch of 3963 precursors
2:39:14.113833 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:39:14.113910 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:39:14.113952 INFO: FWHM in RT is 16.98 seconds, sigma is 0.62
2:39:14.113982 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:39:14.114202 INFO: Starting candidate selection
2:39:17.943874 INFO: Starting candidate scoring
2:39:19.247782 INFO: Finished candidate processing
2:39:19.247962 INFO: Collecting candidate features
2:39:21.416566 WARNING: intensity_correlation has 16 NaNs ( 0.48 % out of 3315)
2:39:21.422602 INFO: Collecting fragment features
2:39:22.042346 INFO: Finished candidate scoring
2:39:22.323120 PROGRESS: === Epoch 1, step 1, extracted 3315 precursors and 15633 fragments ===
2:39:22.323402 INFO: performing precursor FDR with 47 features
2:39:22.323446 INFO: Decoy channel: -1
2:39:22.323472 INFO: Competetive: True
2:39:22.331593 WARNING: dropped 8 target PSMs due to missing features
2:39:22.331682 WARNING: dropped 9 decoy PSMs due to missing features
2:39:22.367648 INFO: Test AUC: 0.565
2:39:22.367766 INFO: Train AUC: 0.527
2:39:22.367812 INFO: AUC difference: 7.16%
2:39:22.367847 WARNING: AUC difference > 5%. This may indicate overfitting.
2:39:22.486302 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
2:39:22.487078 PROGRESS: ============================= Precursor FDR =============================
2:39:22.487201 PROGRESS: Total precursors accumulated: 17
2:39:22.487278 PROGRESS: Target precursors: 16 (94.12%)
2:39:22.487348 PROGRESS: Decoy precursors: 1 (5.88%)
2:39:22.487413 PROGRESS: 
2:39:22.487475 PROGRESS: Precursor Summary:
2:39:22.488882 PROGRESS: Channel   0:	 0.05 FDR:     7; 0.01 FDR:     7; 0.001 FDR:     7
2:39:22.488995 PROGRESS: 
2:39:22.489069 PROGRESS: Protein Summary:
2:39:22.490671 PROGRESS: Channel   0:	 0.05 FDR:     7; 0.01 FDR:     7; 0.001 FDR:     7
2:39:22.490783 PROGRESS: =========================================================================
2:39:22.491630 PROGRESS: === Epoch 1, step 2, extracting elution groups 3000 to 7000 ===
2:39:22.573337 PROGRESS: Extracting batch of 7915 precursors
2:39:22.576610 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:39:22.576672 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:39:22.576710 INFO: FWHM in RT is 16.98 seconds, sigma is 0.62
2:39:22.576754 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:39:22.576972 INFO: Starting candidate selection
2:39:26.465758 INFO: Starting candidate scoring
2:39:27.792757 INFO: Finished candidate processing
2:39:27.792853 INFO: Collecting candidate features
2:39:29.998128 WARNING: intensity_correlation has 30 NaNs ( 0.45 % out of 6595)
2:39:30.004784 INFO: Collecting fragment features
2:39:30.636836 INFO: Finished candidate scoring
2:39:30.924616 PROGRESS: === Epoch 1, step 2, extracted 6595 precursors and 31048 fragments ===
2:39:30.924947 INFO: performing precursor FDR with 47 features
2:39:30.924995 INFO: Decoy channel: -1
2:39:30.925021 INFO: Competetive: True
2:39:30.939333 WARNING: dropped 23 target PSMs due to missing features
2:39:30.939450 WARNING: dropped 24 decoy PSMs due to missing features
2:39:30.994137 INFO: Test AUC: 0.528
2:39:30.994270 INFO: Train AUC: 0.539
2:39:30.994317 INFO: AUC difference: 2.05%
2:39:31.141315 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
2:39:31.142155 PROGRESS: ============================= Precursor FDR =============================
2:39:31.142287 PROGRESS: Total precursors accumulated: 30
2:39:31.142373 PROGRESS: Target precursors: 28 (93.33%)
2:39:31.142441 PROGRESS: Decoy precursors: 2 (6.67%)
2:39:31.142504 PROGRESS: 
2:39:31.142565 PROGRESS: Precursor Summary:
2:39:31.143989 PROGRESS: Channel   0:	 0.05 FDR:    28; 0.01 FDR:     8; 0.001 FDR:     8
2:39:31.144099 PROGRESS: 
2:39:31.144172 PROGRESS: Protein Summary:
2:39:31.145784 PROGRESS: Channel   0:	 0.05 FDR:    28; 0.01 FDR:     8; 0.001 FDR:     8
2:39:31.145895 PROGRESS: =========================================================================
2:39:31.146747 PROGRESS: === Epoch 1, step 3, extracting elution groups 7000 to 15000 ===
2:39:31.238778 PROGRESS: Extracting batch of 15807 precursors
2:39:31.244497 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:39:31.244564 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:39:31.244599 INFO: FWHM in RT is 16.98 seconds, sigma is 0.62
2:39:31.244642 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:39:31.244859 INFO: Starting candidate selection
2:39:35.339673 INFO: Starting candidate scoring
2:39:36.761711 INFO: Finished candidate processing
2:39:36.761806 INFO: Collecting candidate features
2:39:38.994952 WARNING: intensity_correlation has 49 NaNs ( 0.37 % out of 13109)
2:39:39.000999 INFO: Collecting fragment features
2:39:39.641120 INFO: Finished candidate scoring
2:39:39.936944 PROGRESS: === Epoch 1, step 3, extracted 13109 precursors and 62281 fragments ===
2:39:39.937286 INFO: performing precursor FDR with 47 features
2:39:39.937332 INFO: Decoy channel: -1
2:39:39.937358 INFO: Competetive: True
2:39:39.963487 WARNING: dropped 52 target PSMs due to missing features
2:39:39.963617 WARNING: dropped 44 decoy PSMs due to missing features
2:39:40.492266 INFO: Test AUC: 0.530
2:39:40.499181 INFO: Train AUC: 0.567
2:39:40.499244 INFO: AUC difference: 6.63%
2:39:40.499271 WARNING: AUC difference > 5%. This may indicate overfitting.
2:39:40.621805 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
2:39:40.622663 PROGRESS: ============================= Precursor FDR =============================
2:39:40.622784 PROGRESS: Total precursors accumulated: 71
2:39:40.622862 PROGRESS: Target precursors: 66 (92.96%)
2:39:40.622931 PROGRESS: Decoy precursors: 5 (7.04%)
2:39:40.622998 PROGRESS: 
2:39:40.623060 PROGRESS: Precursor Summary:
2:39:40.624525 PROGRESS: Channel   0:	 0.05 FDR:    58; 0.01 FDR:    51; 0.001 FDR:    51
2:39:40.624666 PROGRESS: 
2:39:40.624741 PROGRESS: Protein Summary:
2:39:40.626424 PROGRESS: Channel   0:	 0.05 FDR:    57; 0.01 FDR:    50; 0.001 FDR:    50
2:39:40.626538 PROGRESS: =========================================================================
2:39:40.627419 PROGRESS: === Epoch 1, step 4, extracting elution groups 15000 to 31000 ===
2:39:40.735728 PROGRESS: Extracting batch of 31613 precursors
2:39:40.746422 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:39:40.746520 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:39:40.746558 INFO: FWHM in RT is 16.98 seconds, sigma is 0.62
2:39:40.746585 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:39:40.746829 INFO: Starting candidate selection
2:39:45.113498 INFO: Starting candidate scoring
2:39:46.641592 INFO: Finished candidate processing
2:39:46.641689 INFO: Collecting candidate features
2:39:48.883733 WARNING: intensity_correlation has 114 NaNs ( 0.44 % out of 26181)
2:39:48.890516 INFO: Collecting fragment features
2:39:49.542864 INFO: Finished candidate scoring
2:39:49.850700 PROGRESS: === Epoch 1, step 4, extracted 26181 precursors and 124585 fragments ===
2:39:49.851027 INFO: performing precursor FDR with 47 features
2:39:49.851077 INFO: Decoy channel: -1
2:39:49.851103 INFO: Competetive: True
2:39:49.902763 WARNING: dropped 103 target PSMs due to missing features
2:39:49.902877 WARNING: dropped 107 decoy PSMs due to missing features
2:39:51.635206 INFO: Test AUC: 0.535
2:39:51.635355 INFO: Train AUC: 0.585
2:39:51.635419 INFO: AUC difference: 8.54%
2:39:51.635455 WARNING: AUC difference > 5%. This may indicate overfitting.
2:39:51.761349 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
2:39:51.762282 PROGRESS: ============================= Precursor FDR =============================
2:39:51.762414 PROGRESS: Total precursors accumulated: 181
2:39:51.762492 PROGRESS: Target precursors: 165 (91.16%)
2:39:51.762561 PROGRESS: Decoy precursors: 16 (8.84%)
2:39:51.762624 PROGRESS: 
2:39:51.762685 PROGRESS: Precursor Summary:
2:39:51.764195 PROGRESS: Channel   0:	 0.05 FDR:   127; 0.01 FDR:   102; 0.001 FDR:    91
2:39:51.764326 PROGRESS: 
2:39:51.764400 PROGRESS: Protein Summary:
2:39:51.766143 PROGRESS: Channel   0:	 0.05 FDR:   125; 0.01 FDR:   102; 0.001 FDR:    91
2:39:51.766258 PROGRESS: =========================================================================
2:39:51.767173 PROGRESS: === Epoch 1, step 5, extracting elution groups 31000 to 63000 ===
2:39:51.904160 PROGRESS: Extracting batch of 63201 precursors
2:39:51.924923 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:39:51.925030 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:39:51.925068 INFO: FWHM in RT is 16.98 seconds, sigma is 0.62
2:39:51.925111 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:39:51.925365 INFO: Starting candidate selection
2:39:56.972493 INFO: Starting candidate scoring
2:39:58.801950 INFO: Finished candidate processing
2:39:58.802046 INFO: Collecting candidate features
2:40:01.128293 WARNING: intensity_correlation has 208 NaNs ( 0.39 % out of 52660)
2:40:01.136843 INFO: Collecting fragment features
2:40:01.817354 INFO: Finished candidate scoring
2:40:02.158459 PROGRESS: === Epoch 1, step 5, extracted 52660 precursors and 249012 fragments ===
2:40:02.159688 INFO: performing precursor FDR with 47 features
2:40:02.159816 INFO: Decoy channel: -1
2:40:02.159903 INFO: Competetive: True
2:40:02.273856 WARNING: dropped 208 target PSMs due to missing features
2:40:02.273988 WARNING: dropped 210 decoy PSMs due to missing features
2:40:05.837564 INFO: Test AUC: 0.548
2:40:05.837689 INFO: Train AUC: 0.583
2:40:05.837745 INFO: AUC difference: 5.91%
2:40:05.837784 WARNING: AUC difference > 5%. This may indicate overfitting.
2:40:05.968699 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
2:40:05.969672 PROGRESS: ============================= Precursor FDR =============================
2:40:05.969812 PROGRESS: Total precursors accumulated: 321
2:40:05.969896 PROGRESS: Target precursors: 292 (90.97%)
2:40:05.969966 PROGRESS: Decoy precursors: 29 (9.03%)
2:40:05.970030 PROGRESS: 
2:40:05.970091 PROGRESS: Precursor Summary:
2:40:05.971703 PROGRESS: Channel   0:	 0.05 FDR:   244; 0.01 FDR:   175; 0.001 FDR:   168
2:40:05.971837 PROGRESS: 
2:40:05.971912 PROGRESS: Protein Summary:
2:40:05.973797 PROGRESS: Channel   0:	 0.05 FDR:   233; 0.01 FDR:   169; 0.001 FDR:   162
2:40:05.973912 PROGRESS: =========================================================================
2:40:05.974884 PROGRESS: === Epoch 1, step 6, extracting elution groups 63000 to 127000 ===
2:40:06.152855 PROGRESS: Extracting batch of 126515 precursors
2:40:06.192444 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:40:06.192577 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:40:06.192617 INFO: FWHM in RT is 16.98 seconds, sigma is 0.62
2:40:06.192643 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:40:06.192920 INFO: Starting candidate selection
2:40:12.485693 INFO: Starting candidate scoring
2:40:14.852566 INFO: Finished candidate processing
2:40:14.852748 INFO: Collecting candidate features
2:40:17.341873 WARNING: intensity_correlation has 473 NaNs ( 0.45 % out of 105134)
2:40:17.354926 INFO: Collecting fragment features
2:40:18.087100 INFO: Finished candidate scoring
2:40:18.490974 PROGRESS: === Epoch 1, step 6, extracted 105134 precursors and 498720 fragments ===
2:40:18.491327 INFO: performing precursor FDR with 47 features
2:40:18.491375 INFO: Decoy channel: -1
2:40:18.491415 INFO: Competetive: True
2:40:18.733701 WARNING: dropped 455 target PSMs due to missing features
2:40:18.733822 WARNING: dropped 436 decoy PSMs due to missing features
2:40:26.107040 INFO: Test AUC: 0.544
2:40:26.107163 INFO: Train AUC: 0.579
2:40:26.107220 INFO: AUC difference: 6.06%
2:40:26.107249 WARNING: AUC difference > 5%. This may indicate overfitting.
2:40:26.254392 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
2:40:26.255511 PROGRESS: ============================= Precursor FDR =============================
2:40:26.255637 PROGRESS: Total precursors accumulated: 671
2:40:26.255716 PROGRESS: Target precursors: 613 (91.36%)
2:40:26.255796 PROGRESS: Decoy precursors: 58 (8.64%)
2:40:26.255861 PROGRESS: 
2:40:26.255923 PROGRESS: Precursor Summary:
2:40:26.257735 PROGRESS: Channel   0:	 0.05 FDR:   538; 0.01 FDR:   444; 0.001 FDR:   352
2:40:26.257863 PROGRESS: 
2:40:26.257939 PROGRESS: Protein Summary:
2:40:26.260119 PROGRESS: Channel   0:	 0.05 FDR:   500; 0.01 FDR:   418; 0.001 FDR:   331
2:40:26.260233 PROGRESS: =========================================================================
2:40:26.262144 INFO: calibration group: precursor, fitting rt estimator 
2:40:26.381148 INFO: calibration group: fragment, fitting mz estimator 
2:40:26.919952 INFO: === checking if epoch conditions were reached ===
2:40:26.920095 INFO: ✅ ms2_error      : 7.0000 <= 7
2:40:26.920182 INFO: ❌ rt_error       : 208.4100 > 100
2:40:26.920255 INFO: ❌ current_epoch  : 1 < 3
2:40:26.920321 INFO: ==============================================
2:40:27.140596 INFO: calibration group: precursor, predicting mz
2:40:27.140883 WARNING: mz prediction was skipped as it has not been fitted yet
2:40:27.140926 INFO: calibration group: precursor, predicting rt
2:40:34.262080 INFO: calibration group: fragment, predicting mz
2:40:52.127692 PROGRESS: === Epoch 2, step 0, extracting elution groups 0 to 1000 ===
2:40:52.211103 PROGRESS: Extracting batch of 1976 precursors
2:40:52.212855 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:40:52.212951 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:40:52.212996 INFO: FWHM in RT is 15.40 seconds, sigma is 0.56
2:40:52.213025 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:40:52.213273 INFO: Starting candidate selection
2:40:56.493623 INFO: Starting candidate scoring
2:40:57.808923 INFO: Finished candidate processing
2:40:57.809047 INFO: Collecting candidate features
2:40:59.987675 WARNING: intensity_correlation has 8 NaNs ( 0.49 % out of 1629)
2:40:59.993564 INFO: Collecting fragment features
2:41:00.633151 INFO: Finished candidate scoring
2:41:00.925526 PROGRESS: === Epoch 2, step 0, extracted 1629 precursors and 7554 fragments ===
2:41:00.925864 INFO: performing precursor FDR with 47 features
2:41:00.925914 INFO: Decoy channel: -1
2:41:00.925939 INFO: Competetive: True
2:41:00.930533 WARNING: dropped 6 target PSMs due to missing features
2:41:00.930625 WARNING: dropped 2 decoy PSMs due to missing features
2:41:00.958854 INFO: Test AUC: 0.515
2:41:00.958949 INFO: Train AUC: 0.541
2:41:00.958994 INFO: AUC difference: 4.92%
2:41:01.079389 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
2:41:01.080185 PROGRESS: ============================= Precursor FDR =============================
2:41:01.080313 PROGRESS: Total precursors accumulated: 4
2:41:01.080389 PROGRESS: Target precursors: 4 (100.00%)
2:41:01.080457 PROGRESS: Decoy precursors: 0 (0.00%)
2:41:01.080520 PROGRESS: 
2:41:01.080581 PROGRESS: Precursor Summary:
2:41:01.082079 PROGRESS: Channel   0:	 0.05 FDR:     4; 0.01 FDR:     4; 0.001 FDR:     4
2:41:01.082195 PROGRESS: 
2:41:01.082268 PROGRESS: Protein Summary:
2:41:01.083953 PROGRESS: Channel   0:	 0.05 FDR:     4; 0.01 FDR:     4; 0.001 FDR:     4
2:41:01.084065 PROGRESS: =========================================================================
2:41:01.084956 PROGRESS: === Epoch 2, step 1, extracting elution groups 1000 to 3000 ===
2:41:01.163312 PROGRESS: Extracting batch of 3951 precursors
2:41:01.165509 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:41:01.165570 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:41:01.165609 INFO: FWHM in RT is 15.40 seconds, sigma is 0.56
2:41:01.165654 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:41:01.165904 INFO: Starting candidate selection
2:41:05.038821 INFO: Starting candidate scoring
2:41:06.343081 INFO: Finished candidate processing
2:41:06.343169 INFO: Collecting candidate features
2:41:08.507749 WARNING: intensity_correlation has 12 NaNs ( 0.37 % out of 3219)
2:41:08.513782 INFO: Collecting fragment features
2:41:09.153763 INFO: Finished candidate scoring
2:41:09.434422 PROGRESS: === Epoch 2, step 1, extracted 3219 precursors and 15167 fragments ===
2:41:09.434702 INFO: performing precursor FDR with 47 features
2:41:09.434750 INFO: Decoy channel: -1
2:41:09.434777 INFO: Competetive: True
2:41:09.442813 WARNING: dropped 12 target PSMs due to missing features
2:41:09.442911 WARNING: dropped 8 decoy PSMs due to missing features
2:41:09.478141 INFO: Test AUC: 0.517
2:41:09.478260 INFO: Train AUC: 0.547
2:41:09.478307 INFO: AUC difference: 5.51%
2:41:09.478341 WARNING: AUC difference > 5%. This may indicate overfitting.
2:41:09.614017 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
2:41:09.614812 PROGRESS: ============================= Precursor FDR =============================
2:41:09.614935 PROGRESS: Total precursors accumulated: 13
2:41:09.615015 PROGRESS: Target precursors: 12 (92.31%)
2:41:09.615084 PROGRESS: Decoy precursors: 1 (7.69%)
2:41:09.615158 PROGRESS: 
2:41:09.615221 PROGRESS: Precursor Summary:
2:41:09.616633 PROGRESS: Channel   0:	 0.05 FDR:    12; 0.01 FDR:    12; 0.001 FDR:    12
2:41:09.616747 PROGRESS: 
2:41:09.616821 PROGRESS: Protein Summary:
2:41:09.618436 PROGRESS: Channel   0:	 0.05 FDR:    12; 0.01 FDR:    12; 0.001 FDR:    12
2:41:09.618550 PROGRESS: =========================================================================
2:41:09.619406 PROGRESS: === Epoch 2, step 2, extracting elution groups 3000 to 7000 ===
2:41:09.702245 PROGRESS: Extracting batch of 7907 precursors
2:41:09.705613 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:41:09.705677 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:41:09.705714 INFO: FWHM in RT is 15.40 seconds, sigma is 0.56
2:41:09.705759 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:41:09.706007 INFO: Starting candidate selection
2:41:13.699254 INFO: Starting candidate scoring
2:41:15.062788 INFO: Finished candidate processing
2:41:15.062881 INFO: Collecting candidate features
2:41:17.261154 WARNING: intensity_correlation has 22 NaNs ( 0.34 % out of 6502)
2:41:17.268312 INFO: Collecting fragment features
2:41:17.920297 INFO: Finished candidate scoring
2:41:18.208635 PROGRESS: === Epoch 2, step 2, extracted 6502 precursors and 31019 fragments ===
2:41:18.208959 INFO: performing precursor FDR with 47 features
2:41:18.209003 INFO: Decoy channel: -1
2:41:18.209028 INFO: Competetive: True
2:41:18.222861 WARNING: dropped 22 target PSMs due to missing features
2:41:18.222961 WARNING: dropped 20 decoy PSMs due to missing features
2:41:18.275608 INFO: Test AUC: 0.540
2:41:18.275743 INFO: Train AUC: 0.534
2:41:18.275791 INFO: AUC difference: 1.13%
2:41:18.414629 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
2:41:18.415450 PROGRESS: ============================= Precursor FDR =============================
2:41:18.415572 PROGRESS: Total precursors accumulated: 34
2:41:18.415649 PROGRESS: Target precursors: 31 (91.18%)
2:41:18.415718 PROGRESS: Decoy precursors: 3 (8.82%)
2:41:18.415782 PROGRESS: 
2:41:18.415844 PROGRESS: Precursor Summary:
2:41:18.417275 PROGRESS: Channel   0:	 0.05 FDR:    29; 0.01 FDR:    16; 0.001 FDR:    16
2:41:18.417389 PROGRESS: 
2:41:18.417464 PROGRESS: Protein Summary:
2:41:18.419117 PROGRESS: Channel   0:	 0.05 FDR:    29; 0.01 FDR:    16; 0.001 FDR:    16
2:41:18.419238 PROGRESS: =========================================================================
2:41:18.420096 PROGRESS: === Epoch 2, step 3, extracting elution groups 7000 to 15000 ===
2:41:18.511992 PROGRESS: Extracting batch of 15820 precursors
2:41:18.517526 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:41:18.517592 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:41:18.517626 INFO: FWHM in RT is 15.40 seconds, sigma is 0.56
2:41:18.517668 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:41:18.517891 INFO: Starting candidate selection
2:41:22.662940 INFO: Starting candidate scoring
2:41:24.087451 INFO: Finished candidate processing
2:41:24.087644 INFO: Collecting candidate features
2:41:26.309275 WARNING: intensity_correlation has 49 NaNs ( 0.38 % out of 12932)
2:41:26.315127 INFO: Collecting fragment features
2:41:26.975114 INFO: Finished candidate scoring
2:41:27.271034 PROGRESS: === Epoch 2, step 3, extracted 12932 precursors and 61446 fragments ===
2:41:27.271384 INFO: performing precursor FDR with 47 features
2:41:27.271447 INFO: Decoy channel: -1
2:41:27.271495 INFO: Competetive: True
2:41:27.300097 WARNING: dropped 47 target PSMs due to missing features
2:41:27.300207 WARNING: dropped 44 decoy PSMs due to missing features
2:41:27.815410 INFO: Test AUC: 0.534
2:41:27.815645 INFO: Train AUC: 0.573
2:41:27.815698 INFO: AUC difference: 6.80%
2:41:27.815733 WARNING: AUC difference > 5%. This may indicate overfitting.
2:41:27.940618 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
2:41:27.941450 PROGRESS: ============================= Precursor FDR =============================
2:41:27.941572 PROGRESS: Total precursors accumulated: 56
2:41:27.941651 PROGRESS: Target precursors: 51 (91.07%)
2:41:27.941720 PROGRESS: Decoy precursors: 5 (8.93%)
2:41:27.941797 PROGRESS: 
2:41:27.941862 PROGRESS: Precursor Summary:
2:41:27.943316 PROGRESS: Channel   0:	 0.05 FDR:    39; 0.01 FDR:    38; 0.001 FDR:    38
2:41:27.943431 PROGRESS: 
2:41:27.943505 PROGRESS: Protein Summary:
2:41:27.945156 PROGRESS: Channel   0:	 0.05 FDR:    39; 0.01 FDR:    38; 0.001 FDR:    38
2:41:27.945269 PROGRESS: =========================================================================
2:41:27.946157 PROGRESS: === Epoch 2, step 4, extracting elution groups 15000 to 31000 ===
2:41:28.054458 PROGRESS: Extracting batch of 31663 precursors
2:41:28.065142 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:41:28.065258 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:41:28.065298 INFO: FWHM in RT is 15.40 seconds, sigma is 0.56
2:41:28.065326 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:41:28.065566 INFO: Starting candidate selection
2:41:32.459255 INFO: Starting candidate scoring
2:41:33.995404 INFO: Finished candidate processing
2:41:33.995501 INFO: Collecting candidate features
2:41:36.237980 WARNING: intensity_correlation has 81 NaNs ( 0.31 % out of 26091)
2:41:36.244724 INFO: Collecting fragment features
2:41:36.915169 INFO: Finished candidate scoring
2:41:37.224217 PROGRESS: === Epoch 2, step 4, extracted 26091 precursors and 124296 fragments ===
2:41:37.224569 INFO: performing precursor FDR with 47 features
2:41:37.224615 INFO: Decoy channel: -1
2:41:37.224641 INFO: Competetive: True
2:41:37.275645 WARNING: dropped 90 target PSMs due to missing features
2:41:37.275754 WARNING: dropped 82 decoy PSMs due to missing features
2:41:38.900450 INFO: Test AUC: 0.538
2:41:38.900601 INFO: Train AUC: 0.596
2:41:38.900648 INFO: AUC difference: 9.75%
2:41:38.900684 WARNING: AUC difference > 5%. This may indicate overfitting.
2:41:39.030739 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
2:41:39.038513 PROGRESS: ============================= Precursor FDR =============================
2:41:39.038646 PROGRESS: Total precursors accumulated: 182
2:41:39.038727 PROGRESS: Target precursors: 167 (91.76%)
2:41:39.038796 PROGRESS: Decoy precursors: 15 (8.24%)
2:41:39.038861 PROGRESS: 
2:41:39.038924 PROGRESS: Precursor Summary:
2:41:39.040477 PROGRESS: Channel   0:	 0.05 FDR:   145; 0.01 FDR:   125; 0.001 FDR:   119
2:41:39.040592 PROGRESS: 
2:41:39.040665 PROGRESS: Protein Summary:
2:41:39.042449 PROGRESS: Channel   0:	 0.05 FDR:   145; 0.01 FDR:   125; 0.001 FDR:   119
2:41:39.042564 PROGRESS: =========================================================================
2:41:39.043492 PROGRESS: === Epoch 2, step 5, extracting elution groups 31000 to 63000 ===
2:41:39.180496 PROGRESS: Extracting batch of 63206 precursors
2:41:39.201203 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:41:39.201310 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:41:39.201348 INFO: FWHM in RT is 15.40 seconds, sigma is 0.56
2:41:39.201390 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:41:39.201637 INFO: Starting candidate selection
2:41:44.200653 INFO: Starting candidate scoring
2:41:46.003527 INFO: Finished candidate processing
2:41:46.003627 INFO: Collecting candidate features
2:41:48.324021 WARNING: intensity_correlation has 164 NaNs ( 0.32 % out of 51887)
2:41:48.332422 INFO: Collecting fragment features
2:41:49.035852 INFO: Finished candidate scoring
2:41:49.376437 PROGRESS: === Epoch 2, step 5, extracted 51887 precursors and 246458 fragments ===
2:41:49.376801 INFO: performing precursor FDR with 47 features
2:41:49.376845 INFO: Decoy channel: -1
2:41:49.376871 INFO: Competetive: True
2:41:49.488367 WARNING: dropped 175 target PSMs due to missing features
2:41:49.488497 WARNING: dropped 161 decoy PSMs due to missing features
2:41:52.928518 INFO: Test AUC: 0.539
2:41:52.928640 INFO: Train AUC: 0.594
2:41:52.928696 INFO: AUC difference: 9.29%
2:41:52.928725 WARNING: AUC difference > 5%. This may indicate overfitting.
2:41:53.076852 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
2:41:53.077853 PROGRESS: ============================= Precursor FDR =============================
2:41:53.077977 PROGRESS: Total precursors accumulated: 399
2:41:53.078056 PROGRESS: Target precursors: 368 (92.23%)
2:41:53.078123 PROGRESS: Decoy precursors: 31 (7.77%)
2:41:53.078198 PROGRESS: 
2:41:53.078262 PROGRESS: Precursor Summary:
2:41:53.079902 PROGRESS: Channel   0:	 0.05 FDR:   316; 0.01 FDR:   298; 0.001 FDR:   171
2:41:53.080015 PROGRESS: 
2:41:53.080088 PROGRESS: Protein Summary:
2:41:53.082032 PROGRESS: Channel   0:	 0.05 FDR:   306; 0.01 FDR:   288; 0.001 FDR:   167
2:41:53.082145 PROGRESS: =========================================================================
2:41:53.083181 PROGRESS: === Epoch 2, step 6, extracting elution groups 63000 to 127000 ===
2:41:53.259448 PROGRESS: Extracting batch of 126435 precursors
2:41:53.299467 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:41:53.299718 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:41:53.299764 INFO: FWHM in RT is 15.40 seconds, sigma is 0.56
2:41:53.299791 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:41:53.300056 INFO: Starting candidate selection
2:41:59.484437 INFO: Starting candidate scoring
2:42:01.829829 INFO: Finished candidate processing
2:42:01.830018 INFO: Collecting candidate features
2:42:04.354012 WARNING: intensity_correlation has 309 NaNs ( 0.30 % out of 103926)
2:42:04.366031 INFO: Collecting fragment features
2:42:05.128116 INFO: Finished candidate scoring
2:42:05.534215 PROGRESS: === Epoch 2, step 6, extracted 103926 precursors and 492833 fragments ===
2:42:05.534550 INFO: performing precursor FDR with 47 features
2:42:05.534597 INFO: Decoy channel: -1
2:42:05.534624 INFO: Competetive: True
2:42:05.779044 WARNING: dropped 346 target PSMs due to missing features
2:42:05.779157 WARNING: dropped 299 decoy PSMs due to missing features
2:42:13.158940 INFO: Test AUC: 0.545
2:42:13.159084 INFO: Train AUC: 0.583
2:42:13.159127 INFO: AUC difference: 6.58%
2:42:13.159156 WARNING: AUC difference > 5%. This may indicate overfitting.
2:42:13.318282 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
2:42:13.319462 PROGRESS: ============================= Precursor FDR =============================
2:42:13.319601 PROGRESS: Total precursors accumulated: 890
2:42:13.319681 PROGRESS: Target precursors: 815 (91.57%)
2:42:13.319750 PROGRESS: Decoy precursors: 75 (8.43%)
2:42:13.319814 PROGRESS: 
2:42:13.319875 PROGRESS: Precursor Summary:
2:42:13.321722 PROGRESS: Channel   0:	 0.05 FDR:   650; 0.01 FDR:   516; 0.001 FDR:   376
2:42:13.321870 PROGRESS: 
2:42:13.321945 PROGRESS: Protein Summary:
2:42:13.324181 PROGRESS: Channel   0:	 0.05 FDR:   602; 0.01 FDR:   482; 0.001 FDR:   351
2:42:13.324302 PROGRESS: =========================================================================
2:42:13.325475 PROGRESS: === Epoch 2, step 7, extracting elution groups 127000 to 255000 ===
2:42:13.552390 PROGRESS: Extracting batch of 253009 precursors
2:42:13.626672 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:42:13.626804 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:42:13.626847 INFO: FWHM in RT is 15.40 seconds, sigma is 0.56
2:42:13.626875 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:42:13.627138 INFO: Starting candidate selection
2:42:22.216912 INFO: Starting candidate scoring
2:42:25.652764 INFO: Finished candidate processing
2:42:25.652911 INFO: Collecting candidate features
2:42:28.524413 WARNING: intensity_correlation has 711 NaNs ( 0.34 % out of 208221)
2:42:28.543694 INFO: Collecting fragment features
2:42:29.392166 INFO: Finished candidate scoring
2:42:29.943033 PROGRESS: === Epoch 2, step 7, extracted 208221 precursors and 986959 fragments ===
2:42:29.943385 INFO: performing precursor FDR with 47 features
2:42:29.943431 INFO: Decoy channel: -1
2:42:29.943457 INFO: Competetive: True
2:42:30.482416 WARNING: dropped 713 target PSMs due to missing features
2:42:30.482542 WARNING: dropped 643 decoy PSMs due to missing features
2:42:45.427427 INFO: Test AUC: 0.545
2:42:45.427553 INFO: Train AUC: 0.573
2:42:45.427610 INFO: AUC difference: 4.94%
2:42:45.602648 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
2:42:45.604167 PROGRESS: ============================= Precursor FDR =============================
2:42:45.604311 PROGRESS: Total precursors accumulated: 1,877
2:42:45.604389 PROGRESS: Target precursors: 1,711 (91.16%)
2:42:45.604457 PROGRESS: Decoy precursors: 166 (8.84%)
2:42:45.604520 PROGRESS: 
2:42:45.604582 PROGRESS: Precursor Summary:
2:42:45.606859 PROGRESS: Channel   0:	 0.05 FDR: 1,406; 0.01 FDR: 1,007; 0.001 FDR:   716
2:42:45.607001 PROGRESS: 
2:42:45.607076 PROGRESS: Protein Summary:
2:42:45.609911 PROGRESS: Channel   0:	 0.05 FDR: 1,204; 0.01 FDR:   865; 0.001 FDR:   623
2:42:45.610027 PROGRESS: =========================================================================
2:42:45.612401 INFO: calibration group: precursor, fitting rt estimator 
2:42:45.773704 INFO: calibration group: fragment, fitting mz estimator 
2:42:46.359954 INFO: === checking if epoch conditions were reached ===
2:42:46.360119 INFO: ✅ ms2_error      : 7.0000 <= 7
2:42:46.360214 INFO: ❌ rt_error       : 199.3566 > 100
2:42:46.360289 INFO: ✅ current_epoch  : 2 >= 3
2:42:46.360354 INFO: ==============================================
2:42:46.578925 INFO: calibration group: precursor, predicting mz
2:42:46.579211 WARNING: mz prediction was skipped as it has not been fitted yet
2:42:46.579256 INFO: calibration group: precursor, predicting rt
2:42:53.653007 INFO: calibration group: fragment, predicting mz
2:43:11.376322 PROGRESS: === Epoch 3, step 0, extracting elution groups 0 to 1000 ===
2:43:11.463794 PROGRESS: Extracting batch of 1982 precursors
2:43:11.465476 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:43:11.465566 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:43:11.465609 INFO: FWHM in RT is 15.18 seconds, sigma is 0.55
2:43:11.465655 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:43:11.465900 INFO: Starting candidate selection
2:43:15.706901 INFO: Starting candidate scoring
2:43:17.018108 INFO: Finished candidate processing
2:43:17.018214 INFO: Collecting candidate features
2:43:19.212178 WARNING: intensity_correlation has 4 NaNs ( 0.24 % out of 1695)
2:43:19.218077 INFO: Collecting fragment features
2:43:19.835893 INFO: Finished candidate scoring
2:43:20.150004 PROGRESS: === Epoch 3, step 0, extracted 1695 precursors and 7891 fragments ===
2:43:20.150331 INFO: performing precursor FDR with 47 features
2:43:20.150376 INFO: Decoy channel: -1
2:43:20.150403 INFO: Competetive: True
2:43:20.154874 WARNING: dropped 4 target PSMs due to missing features
2:43:20.183012 INFO: Test AUC: 0.559
2:43:20.183103 INFO: Train AUC: 0.535
2:43:20.183146 INFO: AUC difference: 4.44%
2:43:20.303270 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
2:43:20.304047 PROGRESS: ============================= Precursor FDR =============================
2:43:20.304166 PROGRESS: Total precursors accumulated: 7
2:43:20.304245 PROGRESS: Target precursors: 7 (100.00%)
2:43:20.304313 PROGRESS: Decoy precursors: 0 (0.00%)
2:43:20.304377 PROGRESS: 
2:43:20.304439 PROGRESS: Precursor Summary:
2:43:20.305934 PROGRESS: Channel   0:	 0.05 FDR:     7; 0.01 FDR:     7; 0.001 FDR:     7
2:43:20.306046 PROGRESS: 
2:43:20.306120 PROGRESS: Protein Summary:
2:43:20.307789 PROGRESS: Channel   0:	 0.05 FDR:     7; 0.01 FDR:     7; 0.001 FDR:     7
2:43:20.307899 PROGRESS: =========================================================================
2:43:20.308788 PROGRESS: === Epoch 3, step 1, extracting elution groups 1000 to 3000 ===
2:43:20.387542 PROGRESS: Extracting batch of 3948 precursors
2:43:20.389891 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:43:20.389956 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:43:20.389998 INFO: FWHM in RT is 15.18 seconds, sigma is 0.55
2:43:20.390029 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:43:20.390245 INFO: Starting candidate selection
2:43:24.305019 INFO: Starting candidate scoring
2:43:25.634057 INFO: Finished candidate processing
2:43:25.634143 INFO: Collecting candidate features
2:43:27.818400 WARNING: intensity_correlation has 5 NaNs ( 0.15 % out of 3325)
2:43:27.824441 INFO: Collecting fragment features
2:43:28.446629 INFO: Finished candidate scoring
2:43:28.729033 PROGRESS: === Epoch 3, step 1, extracted 3325 precursors and 15939 fragments ===
2:43:28.729318 INFO: performing precursor FDR with 47 features
2:43:28.729363 INFO: Decoy channel: -1
2:43:28.729390 INFO: Competetive: True
2:43:28.737590 WARNING: dropped 5 target PSMs due to missing features
2:43:28.737696 WARNING: dropped 4 decoy PSMs due to missing features
2:43:28.773402 INFO: Test AUC: 0.526
2:43:28.773518 INFO: Train AUC: 0.538
2:43:28.773563 INFO: AUC difference: 2.29%
2:43:28.894162 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
2:43:28.894927 PROGRESS: ============================= Precursor FDR =============================
2:43:28.895052 PROGRESS: Total precursors accumulated: 18
2:43:28.895129 PROGRESS: Target precursors: 17 (94.44%)
2:43:28.895196 PROGRESS: Decoy precursors: 1 (5.56%)
2:43:28.895258 PROGRESS: 
2:43:28.895320 PROGRESS: Precursor Summary:
2:43:28.896744 PROGRESS: Channel   0:	 0.05 FDR:    17; 0.01 FDR:    17; 0.001 FDR:    17
2:43:28.896860 PROGRESS: 
2:43:28.896934 PROGRESS: Protein Summary:
2:43:28.898556 PROGRESS: Channel   0:	 0.05 FDR:    17; 0.01 FDR:    17; 0.001 FDR:    17
2:43:28.898671 PROGRESS: =========================================================================
2:43:28.899533 PROGRESS: === Epoch 3, step 2, extracting elution groups 3000 to 7000 ===
2:43:28.982126 PROGRESS: Extracting batch of 7912 precursors
2:43:28.985394 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:43:28.985456 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:43:28.985495 INFO: FWHM in RT is 15.18 seconds, sigma is 0.55
2:43:28.985523 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:43:28.985758 INFO: Starting candidate selection
2:43:32.980140 INFO: Starting candidate scoring
2:43:34.338572 INFO: Finished candidate processing
2:43:34.338675 INFO: Collecting candidate features
2:43:36.539448 WARNING: intensity_correlation has 16 NaNs ( 0.24 % out of 6706)
2:43:36.545940 INFO: Collecting fragment features
2:43:37.173928 INFO: Finished candidate scoring
2:43:37.461595 PROGRESS: === Epoch 3, step 2, extracted 6706 precursors and 31971 fragments ===
2:43:37.461930 INFO: performing precursor FDR with 47 features
2:43:37.461977 INFO: Decoy channel: -1
2:43:37.462003 INFO: Competetive: True
2:43:37.476159 WARNING: dropped 13 target PSMs due to missing features
2:43:37.476253 WARNING: dropped 12 decoy PSMs due to missing features
2:43:37.530097 INFO: Test AUC: 0.541
2:43:37.530231 INFO: Train AUC: 0.536
2:43:37.530273 INFO: AUC difference: 1.03%
2:43:37.651229 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
2:43:37.652096 PROGRESS: ============================= Precursor FDR =============================
2:43:37.652253 PROGRESS: Total precursors accumulated: 57
2:43:37.652360 PROGRESS: Target precursors: 52 (91.23%)
2:43:37.652457 PROGRESS: Decoy precursors: 5 (8.77%)
2:43:37.652548 PROGRESS: 
2:43:37.652634 PROGRESS: Precursor Summary:
2:43:37.654136 PROGRESS: Channel   0:	 0.05 FDR:    50; 0.01 FDR:    31; 0.001 FDR:    31
2:43:37.654273 PROGRESS: 
2:43:37.654377 PROGRESS: Protein Summary:
2:43:37.656584 PROGRESS: Channel   0:	 0.05 FDR:    50; 0.01 FDR:    31; 0.001 FDR:    31
2:43:37.656719 PROGRESS: =========================================================================
2:43:37.657634 PROGRESS: === Epoch 3, step 3, extracting elution groups 7000 to 15000 ===
2:43:37.749130 PROGRESS: Extracting batch of 15836 precursors
2:43:37.754480 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:43:37.754563 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:43:37.754618 INFO: FWHM in RT is 15.18 seconds, sigma is 0.55
2:43:37.754668 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:43:37.754909 INFO: Starting candidate selection
2:43:41.877070 INFO: Starting candidate scoring
2:43:43.295600 INFO: Finished candidate processing
2:43:43.295781 INFO: Collecting candidate features
2:43:45.498927 WARNING: intensity_correlation has 35 NaNs ( 0.26 % out of 13210)
2:43:45.504838 INFO: Collecting fragment features
2:43:46.134267 INFO: Finished candidate scoring
2:43:46.427531 PROGRESS: === Epoch 3, step 3, extracted 13210 precursors and 62934 fragments ===
2:43:46.427867 INFO: performing precursor FDR with 47 features
2:43:46.427912 INFO: Decoy channel: -1
2:43:46.427938 INFO: Competetive: True
2:43:46.453865 WARNING: dropped 33 target PSMs due to missing features
2:43:46.453991 WARNING: dropped 27 decoy PSMs due to missing features
2:43:46.988878 INFO: Test AUC: 0.521
2:43:46.989024 INFO: Train AUC: 0.579
2:43:46.995817 INFO: AUC difference: 10.06%
2:43:46.995857 WARNING: AUC difference > 5%. This may indicate overfitting.
2:43:47.117264 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
2:43:47.118143 PROGRESS: ============================= Precursor FDR =============================
2:43:47.118266 PROGRESS: Total precursors accumulated: 119
2:43:47.118343 PROGRESS: Target precursors: 109 (91.60%)
2:43:47.118412 PROGRESS: Decoy precursors: 10 (8.40%)
2:43:47.118475 PROGRESS: 
2:43:47.118537 PROGRESS: Precursor Summary:
2:43:47.119998 PROGRESS: Channel   0:	 0.05 FDR:    78; 0.01 FDR:    55; 0.001 FDR:    55
2:43:47.120119 PROGRESS: 
2:43:47.120194 PROGRESS: Protein Summary:
2:43:47.121870 PROGRESS: Channel   0:	 0.05 FDR:    78; 0.01 FDR:    55; 0.001 FDR:    55
2:43:47.121983 PROGRESS: =========================================================================
2:43:47.122856 PROGRESS: === Epoch 3, step 4, extracting elution groups 15000 to 31000 ===
2:43:47.230319 PROGRESS: Extracting batch of 31592 precursors
2:43:47.240667 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:43:47.240780 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:43:47.240820 INFO: FWHM in RT is 15.18 seconds, sigma is 0.55
2:43:47.240861 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:43:47.241099 INFO: Starting candidate selection
2:43:51.632553 INFO: Starting candidate scoring
2:43:53.169243 INFO: Finished candidate processing
2:43:53.169341 INFO: Collecting candidate features
2:43:55.412171 WARNING: intensity_correlation has 79 NaNs ( 0.30 % out of 26631)
2:43:55.418967 INFO: Collecting fragment features
2:43:56.067312 INFO: Finished candidate scoring
2:43:56.376726 PROGRESS: === Epoch 3, step 4, extracted 26631 precursors and 128112 fragments ===
2:43:56.377062 INFO: performing precursor FDR with 47 features
2:43:56.377110 INFO: Decoy channel: -1
2:43:56.377137 INFO: Competetive: True
2:43:56.428634 WARNING: dropped 68 target PSMs due to missing features
2:43:56.428742 WARNING: dropped 71 decoy PSMs due to missing features
2:43:58.152842 INFO: Test AUC: 0.538
2:43:58.152985 INFO: Train AUC: 0.601
2:43:58.153030 INFO: AUC difference: 10.37%
2:43:58.153065 WARNING: AUC difference > 5%. This may indicate overfitting.
2:43:58.278960 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
2:43:58.279921 PROGRESS: ============================= Precursor FDR =============================
2:43:58.280045 PROGRESS: Total precursors accumulated: 335
2:43:58.280123 PROGRESS: Target precursors: 305 (91.04%)
2:43:58.280190 PROGRESS: Decoy precursors: 30 (8.96%)
2:43:58.280252 PROGRESS: 
2:43:58.280313 PROGRESS: Precursor Summary:
2:43:58.281906 PROGRESS: Channel   0:	 0.05 FDR:   217; 0.01 FDR:   193; 0.001 FDR:   191
2:43:58.282019 PROGRESS: 
2:43:58.282093 PROGRESS: Protein Summary:
2:43:58.283938 PROGRESS: Channel   0:	 0.05 FDR:   215; 0.01 FDR:   191; 0.001 FDR:   189
2:43:58.284049 PROGRESS: =========================================================================
2:43:58.285013 PROGRESS: === Epoch 3, step 5, extracting elution groups 31000 to 63000 ===
2:43:58.421637 PROGRESS: Extracting batch of 63244 precursors
2:43:58.441842 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:43:58.441947 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:43:58.441986 INFO: FWHM in RT is 15.18 seconds, sigma is 0.55
2:43:58.442014 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:43:58.442259 INFO: Starting candidate selection
2:44:03.484530 INFO: Starting candidate scoring
2:44:05.309726 INFO: Finished candidate processing
2:44:05.309928 INFO: Collecting candidate features
2:44:07.667463 WARNING: intensity_correlation has 164 NaNs ( 0.31 % out of 53358)
2:44:07.676140 INFO: Collecting fragment features
2:44:08.371209 INFO: Finished candidate scoring
2:44:08.715172 PROGRESS: === Epoch 3, step 5, extracted 53358 precursors and 254712 fragments ===
2:44:08.715518 INFO: performing precursor FDR with 47 features
2:44:08.716208 INFO: Decoy channel: -1
2:44:08.716236 INFO: Competetive: True
2:44:08.831626 WARNING: dropped 157 target PSMs due to missing features
2:44:08.831742 WARNING: dropped 146 decoy PSMs due to missing features
2:44:12.262089 INFO: Test AUC: 0.552
2:44:12.262223 INFO: Train AUC: 0.599
2:44:12.262262 INFO: AUC difference: 7.85%
2:44:12.262289 WARNING: AUC difference > 5%. This may indicate overfitting.
2:44:12.398953 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
2:44:12.400004 PROGRESS: ============================= Precursor FDR =============================
2:44:12.400127 PROGRESS: Total precursors accumulated: 524
2:44:12.400205 PROGRESS: Target precursors: 479 (91.41%)
2:44:12.400273 PROGRESS: Decoy precursors: 45 (8.59%)
2:44:12.400335 PROGRESS: 
2:44:12.400396 PROGRESS: Precursor Summary:
2:44:12.402092 PROGRESS: Channel   0:	 0.05 FDR:   398; 0.01 FDR:   308; 0.001 FDR:   282
2:44:12.402206 PROGRESS: 
2:44:12.402281 PROGRESS: Protein Summary:
2:44:12.404276 PROGRESS: Channel   0:	 0.05 FDR:   383; 0.01 FDR:   297; 0.001 FDR:   271
2:44:12.404404 PROGRESS: =========================================================================
2:44:12.405439 PROGRESS: === Epoch 3, step 6, extracting elution groups 63000 to 127000 ===
2:44:12.580753 PROGRESS: Extracting batch of 126482 precursors
2:44:12.618764 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:44:12.618896 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:44:12.618963 INFO: FWHM in RT is 15.18 seconds, sigma is 0.55
2:44:12.618989 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:44:12.619242 INFO: Starting candidate selection
2:44:18.881571 INFO: Starting candidate scoring
2:44:21.252513 INFO: Finished candidate processing
2:44:21.252643 INFO: Collecting candidate features
2:44:23.776484 WARNING: intensity_correlation has 295 NaNs ( 0.28 % out of 106536)
2:44:23.788599 INFO: Collecting fragment features
2:44:24.527919 INFO: Finished candidate scoring
2:44:24.937711 PROGRESS: === Epoch 3, step 6, extracted 106536 precursors and 507768 fragments ===
2:44:24.938066 INFO: performing precursor FDR with 47 features
2:44:24.938111 INFO: Decoy channel: -1
2:44:24.938138 INFO: Competetive: True
2:44:25.188617 WARNING: dropped 307 target PSMs due to missing features
2:44:25.188729 WARNING: dropped 291 decoy PSMs due to missing features
2:44:32.560256 INFO: Test AUC: 0.549
2:44:32.560379 INFO: Train AUC: 0.589
2:44:32.560436 INFO: AUC difference: 6.68%
2:44:32.560477 WARNING: AUC difference > 5%. This may indicate overfitting.
2:44:32.705573 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
2:44:32.706842 PROGRESS: ============================= Precursor FDR =============================
2:44:32.707003 PROGRESS: Total precursors accumulated: 1,104
2:44:32.707121 PROGRESS: Target precursors: 1,007 (91.21%)
2:44:32.707220 PROGRESS: Decoy precursors: 97 (8.79%)
2:44:32.707311 PROGRESS: 
2:44:32.707399 PROGRESS: Precursor Summary:
2:44:32.709412 PROGRESS: Channel   0:	 0.05 FDR:   882; 0.01 FDR:   713; 0.001 FDR:   493
2:44:32.709570 PROGRESS: 
2:44:32.709680 PROGRESS: Protein Summary:
2:44:32.712178 PROGRESS: Channel   0:	 0.05 FDR:   795; 0.01 FDR:   639; 0.001 FDR:   446
2:44:32.712314 PROGRESS: =========================================================================
2:44:32.713629 PROGRESS: === Epoch 3, step 7, extracting elution groups 127000 to 255000 ===
2:44:32.940547 PROGRESS: Extracting batch of 252859 precursors
2:44:33.012962 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:44:33.013075 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:44:33.013120 INFO: FWHM in RT is 15.18 seconds, sigma is 0.55
2:44:33.013159 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:44:33.013466 INFO: Starting candidate selection
2:44:41.851952 INFO: Starting candidate scoring
2:44:45.346989 INFO: Finished candidate processing
2:44:45.347179 INFO: Collecting candidate features
2:44:48.202908 WARNING: intensity_correlation has 671 NaNs ( 0.31 % out of 213279)
2:44:48.222739 INFO: Collecting fragment features
2:44:49.065619 INFO: Finished candidate scoring
2:44:49.621618 PROGRESS: === Epoch 3, step 7, extracted 213279 precursors and 1018232 fragments ===
2:44:49.621976 INFO: performing precursor FDR with 47 features
2:44:49.622023 INFO: Decoy channel: -1
2:44:49.622049 INFO: Competetive: True
2:44:50.150373 WARNING: dropped 653 target PSMs due to missing features
2:44:50.150494 WARNING: dropped 616 decoy PSMs due to missing features
2:45:05.194221 INFO: Test AUC: 0.547
2:45:05.194346 INFO: Train AUC: 0.578
2:45:05.194403 INFO: AUC difference: 5.43%
2:45:05.194431 WARNING: AUC difference > 5%. This may indicate overfitting.
2:45:05.374329 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
2:45:05.375891 PROGRESS: ============================= Precursor FDR =============================
2:45:05.376051 PROGRESS: Total precursors accumulated: 2,092
2:45:05.376129 PROGRESS: Target precursors: 1,906 (91.11%)
2:45:05.376199 PROGRESS: Decoy precursors: 186 (8.89%)
2:45:05.376263 PROGRESS: 
2:45:05.376324 PROGRESS: Precursor Summary:
2:45:05.378609 PROGRESS: Channel   0:	 0.05 FDR: 1,605; 0.01 FDR: 1,139; 0.001 FDR:   833
2:45:05.378743 PROGRESS: 
2:45:05.378819 PROGRESS: Protein Summary:
2:45:05.381696 PROGRESS: Channel   0:	 0.05 FDR: 1,375; 0.01 FDR:   971; 0.001 FDR:   722
2:45:05.381850 PROGRESS: =========================================================================
2:45:05.384356 INFO: calibration group: precursor, fitting rt estimator 
2:45:05.555446 INFO: calibration group: fragment, fitting mz estimator 
2:45:06.138900 INFO: === checking if epoch conditions were reached ===
2:45:06.139055 INFO: ✅ ms2_error      : 7.0000 <= 7
2:45:06.139142 INFO: ❌ rt_error       : 198.7602 > 100
2:45:06.139213 INFO: ✅ current_epoch  : 3 >= 3
2:45:06.139277 INFO: ==============================================
2:45:06.356689 INFO: calibration group: precursor, predicting mz
2:45:06.356962 WARNING: mz prediction was skipped as it has not been fitted yet
2:45:06.357003 INFO: calibration group: precursor, predicting rt
2:45:13.298632 INFO: calibration group: fragment, predicting mz
2:45:30.933090 PROGRESS: === Epoch 4, step 0, extracting elution groups 0 to 1000 ===
2:45:31.020222 PROGRESS: Extracting batch of 1980 precursors
2:45:31.021917 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:45:31.021990 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:45:31.022030 INFO: FWHM in RT is 14.70 seconds, sigma is 0.54
2:45:31.022076 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:45:31.022303 INFO: Starting candidate selection
2:45:37.870445 INFO: Starting candidate scoring
2:45:39.153996 INFO: Finished candidate processing
2:45:39.154191 INFO: Collecting candidate features
2:45:41.338720 WARNING: intensity_correlation has 3 NaNs ( 0.17 % out of 1728)
2:45:41.344716 INFO: Collecting fragment features
2:45:41.990972 INFO: Finished candidate scoring
2:45:42.307876 PROGRESS: === Epoch 4, step 0, extracted 1728 precursors and 8260 fragments ===
2:45:42.308266 INFO: performing precursor FDR with 47 features
2:45:42.308333 INFO: Decoy channel: -1
2:45:42.308361 INFO: Competetive: True
2:45:42.313157 WARNING: dropped 2 target PSMs due to missing features
2:45:42.313229 WARNING: dropped 1 decoy PSMs due to missing features
2:45:42.341256 INFO: Test AUC: 0.520
2:45:42.341353 INFO: Train AUC: 0.541
2:45:42.341399 INFO: AUC difference: 3.85%
2:45:42.461391 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
2:45:42.462209 PROGRESS: ============================= Precursor FDR =============================
2:45:42.462360 PROGRESS: Total precursors accumulated: 14
2:45:42.462476 PROGRESS: Target precursors: 13 (92.86%)
2:45:42.462564 PROGRESS: Decoy precursors: 1 (7.14%)
2:45:42.462649 PROGRESS: 
2:45:42.462737 PROGRESS: Precursor Summary:
2:45:42.464653 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
2:45:42.464792 PROGRESS: 
2:45:42.464916 PROGRESS: Protein Summary:
2:45:42.466731 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
2:45:42.466863 PROGRESS: =========================================================================
2:45:42.467738 PROGRESS: === Epoch 4, step 1, extracting elution groups 1000 to 3000 ===
2:45:42.545737 PROGRESS: Extracting batch of 3942 precursors
2:45:42.548129 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:45:42.548218 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:45:42.548259 INFO: FWHM in RT is 14.70 seconds, sigma is 0.54
2:45:42.548295 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:45:42.548574 INFO: Starting candidate selection
2:45:46.464491 INFO: Starting candidate scoring
2:45:47.769614 INFO: Finished candidate processing
2:45:47.769701 INFO: Collecting candidate features
2:45:49.934673 WARNING: intensity_correlation has 6 NaNs ( 0.18 % out of 3421)
2:45:49.940671 INFO: Collecting fragment features
2:45:50.592397 INFO: Finished candidate scoring
2:45:50.875331 PROGRESS: === Epoch 4, step 1, extracted 3421 precursors and 16396 fragments ===
2:45:50.875633 INFO: performing precursor FDR with 47 features
2:45:50.875678 INFO: Decoy channel: -1
2:45:50.875705 INFO: Competetive: True
2:45:50.884194 WARNING: dropped 7 target PSMs due to missing features
2:45:50.884286 WARNING: dropped 2 decoy PSMs due to missing features
2:45:50.920571 INFO: Test AUC: 0.554
2:45:50.920688 INFO: Train AUC: 0.540
2:45:50.920736 INFO: AUC difference: 2.69%
2:45:51.041217 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
2:45:51.042031 PROGRESS: ============================= Precursor FDR =============================
2:45:51.042159 PROGRESS: Total precursors accumulated: 23
2:45:51.042239 PROGRESS: Target precursors: 21 (91.30%)
2:45:51.042307 PROGRESS: Decoy precursors: 2 (8.70%)
2:45:51.042369 PROGRESS: 
2:45:51.042430 PROGRESS: Precursor Summary:
2:45:51.043848 PROGRESS: Channel   0:	 0.05 FDR:    16; 0.01 FDR:    16; 0.001 FDR:    16
2:45:51.043965 PROGRESS: 
2:45:51.044050 PROGRESS: Protein Summary:
2:45:51.045670 PROGRESS: Channel   0:	 0.05 FDR:    16; 0.01 FDR:    16; 0.001 FDR:    16
2:45:51.045789 PROGRESS: =========================================================================
2:45:51.046653 PROGRESS: === Epoch 4, step 2, extracting elution groups 3000 to 7000 ===
2:45:51.129195 PROGRESS: Extracting batch of 7910 precursors
2:45:51.132623 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:45:51.132689 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:45:51.132729 INFO: FWHM in RT is 14.70 seconds, sigma is 0.54
2:45:51.132775 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:45:51.132999 INFO: Starting candidate selection
2:45:55.126492 INFO: Starting candidate scoring
2:45:56.475277 INFO: Finished candidate processing
2:45:56.475464 INFO: Collecting candidate features
2:45:58.681767 WARNING: intensity_correlation has 14 NaNs ( 0.20 % out of 6866)
2:45:58.687384 INFO: Collecting fragment features
2:45:59.339625 INFO: Finished candidate scoring
2:45:59.630349 PROGRESS: === Epoch 4, step 2, extracted 6866 precursors and 33045 fragments ===
2:45:59.630689 INFO: performing precursor FDR with 47 features
2:45:59.630738 INFO: Decoy channel: -1
2:45:59.630763 INFO: Competetive: True
2:45:59.645657 WARNING: dropped 12 target PSMs due to missing features
2:45:59.645754 WARNING: dropped 11 decoy PSMs due to missing features
2:45:59.702017 INFO: Test AUC: 0.520
2:45:59.702145 INFO: Train AUC: 0.542
2:45:59.702189 INFO: AUC difference: 3.94%
2:45:59.821062 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
2:45:59.821902 PROGRESS: ============================= Precursor FDR =============================
2:45:59.822026 PROGRESS: Total precursors accumulated: 50
2:45:59.822105 PROGRESS: Target precursors: 46 (92.00%)
2:45:59.822173 PROGRESS: Decoy precursors: 4 (8.00%)
2:45:59.822237 PROGRESS: 
2:45:59.822297 PROGRESS: Precursor Summary:
2:45:59.823728 PROGRESS: Channel   0:	 0.05 FDR:    45; 0.01 FDR:    36; 0.001 FDR:    36
2:45:59.823841 PROGRESS: 
2:45:59.823914 PROGRESS: Protein Summary:
2:45:59.825549 PROGRESS: Channel   0:	 0.05 FDR:    45; 0.01 FDR:    36; 0.001 FDR:    36
2:45:59.825660 PROGRESS: =========================================================================
2:45:59.826531 PROGRESS: === Epoch 4, step 3, extracting elution groups 7000 to 15000 ===
2:45:59.918259 PROGRESS: Extracting batch of 15815 precursors
2:45:59.923959 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:45:59.924026 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:45:59.924060 INFO: FWHM in RT is 14.70 seconds, sigma is 0.54
2:45:59.924103 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:45:59.924322 INFO: Starting candidate selection
2:46:04.069973 INFO: Starting candidate scoring
2:46:05.487406 INFO: Finished candidate processing
2:46:05.487493 INFO: Collecting candidate features
2:46:07.717054 WARNING: intensity_correlation has 30 NaNs ( 0.22 % out of 13661)
2:46:07.724163 INFO: Collecting fragment features
2:46:08.385751 INFO: Finished candidate scoring
2:46:08.684554 PROGRESS: === Epoch 4, step 3, extracted 13661 precursors and 65555 fragments ===
2:46:08.684910 INFO: performing precursor FDR with 47 features
2:46:08.684963 INFO: Decoy channel: -1
2:46:08.684990 INFO: Competetive: True
2:46:08.712444 WARNING: dropped 27 target PSMs due to missing features
2:46:08.712559 WARNING: dropped 26 decoy PSMs due to missing features
2:46:09.438963 INFO: Test AUC: 0.530
2:46:09.439110 INFO: Train AUC: 0.606
2:46:09.439158 INFO: AUC difference: 12.62%
2:46:09.439197 WARNING: AUC difference > 5%. This may indicate overfitting.
2:46:09.563721 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
2:46:09.564647 PROGRESS: ============================= Precursor FDR =============================
2:46:09.564770 PROGRESS: Total precursors accumulated: 157
2:46:09.564847 PROGRESS: Target precursors: 143 (91.08%)
2:46:09.564915 PROGRESS: Decoy precursors: 14 (8.92%)
2:46:09.564978 PROGRESS: 
2:46:09.565040 PROGRESS: Precursor Summary:
2:46:09.566560 PROGRESS: Channel   0:	 0.05 FDR:   113; 0.01 FDR:    77; 0.001 FDR:    77
2:46:09.566682 PROGRESS: 
2:46:09.566757 PROGRESS: Protein Summary:
2:46:09.568475 PROGRESS: Channel   0:	 0.05 FDR:   112; 0.01 FDR:    76; 0.001 FDR:    76
2:46:09.568588 PROGRESS: =========================================================================
2:46:09.569486 PROGRESS: === Epoch 4, step 4, extracting elution groups 15000 to 31000 ===
2:46:09.677762 PROGRESS: Extracting batch of 31617 precursors
2:46:09.688431 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:46:09.688548 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:46:09.688591 INFO: FWHM in RT is 14.70 seconds, sigma is 0.54
2:46:09.688618 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:46:09.688869 INFO: Starting candidate selection
2:46:14.176048 INFO: Starting candidate scoring
2:46:15.750187 INFO: Finished candidate processing
2:46:15.750281 INFO: Collecting candidate features
2:46:17.992250 WARNING: intensity_correlation has 45 NaNs ( 0.16 % out of 27375)
2:46:17.999169 INFO: Collecting fragment features
2:46:18.673558 INFO: Finished candidate scoring
2:46:18.987378 PROGRESS: === Epoch 4, step 4, extracted 27375 precursors and 131303 fragments ===
2:46:18.987726 INFO: performing precursor FDR with 47 features
2:46:18.987773 INFO: Decoy channel: -1
2:46:18.987800 INFO: Competetive: True
2:46:19.041959 WARNING: dropped 47 target PSMs due to missing features
2:46:19.042084 WARNING: dropped 51 decoy PSMs due to missing features
2:46:20.660993 INFO: Test AUC: 0.544
2:46:20.661128 INFO: Train AUC: 0.611
2:46:20.661172 INFO: AUC difference: 10.96%
2:46:20.661204 WARNING: AUC difference > 5%. This may indicate overfitting.
2:46:20.809927 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
2:46:20.817740 PROGRESS: ============================= Precursor FDR =============================
2:46:20.817895 PROGRESS: Total precursors accumulated: 302
2:46:20.817976 PROGRESS: Target precursors: 275 (91.06%)
2:46:20.818046 PROGRESS: Decoy precursors: 27 (8.94%)
2:46:20.818122 PROGRESS: 
2:46:20.818185 PROGRESS: Precursor Summary:
2:46:20.819839 PROGRESS: Channel   0:	 0.05 FDR:   236; 0.01 FDR:   189; 0.001 FDR:   107
2:46:20.819956 PROGRESS: 
2:46:20.820029 PROGRESS: Protein Summary:
2:46:20.821940 PROGRESS: Channel   0:	 0.05 FDR:   234; 0.01 FDR:   188; 0.001 FDR:   106
2:46:20.822054 PROGRESS: =========================================================================
2:46:20.823062 PROGRESS: === Epoch 4, step 5, extracting elution groups 31000 to 63000 ===
2:46:20.961622 PROGRESS: Extracting batch of 63219 precursors
2:46:20.981927 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:46:20.982051 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:46:20.982093 INFO: FWHM in RT is 14.70 seconds, sigma is 0.54
2:46:20.982121 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:46:20.982378 INFO: Starting candidate selection
2:46:26.054489 INFO: Starting candidate scoring
2:46:27.883276 INFO: Finished candidate processing
2:46:27.883465 INFO: Collecting candidate features
2:46:30.214040 WARNING: intensity_correlation has 128 NaNs ( 0.23 % out of 54491)
2:46:30.222785 INFO: Collecting fragment features
2:46:30.926219 INFO: Finished candidate scoring
2:46:31.273122 PROGRESS: === Epoch 4, step 5, extracted 54491 precursors and 260850 fragments ===
2:46:31.273475 INFO: performing precursor FDR with 47 features
2:46:31.273523 INFO: Decoy channel: -1
2:46:31.273550 INFO: Competetive: True
2:46:31.393244 WARNING: dropped 105 target PSMs due to missing features
2:46:31.393359 WARNING: dropped 121 decoy PSMs due to missing features
2:46:34.903958 INFO: Test AUC: 0.553
2:46:34.904086 INFO: Train AUC: 0.602
2:46:34.904141 INFO: AUC difference: 8.19%
2:46:34.904169 WARNING: AUC difference > 5%. This may indicate overfitting.
2:46:35.036249 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
2:46:35.037425 PROGRESS: ============================= Precursor FDR =============================
2:46:35.037560 PROGRESS: Total precursors accumulated: 673
2:46:35.037637 PROGRESS: Target precursors: 614 (91.23%)
2:46:35.037706 PROGRESS: Decoy precursors: 59 (8.77%)
2:46:35.037778 PROGRESS: 
2:46:35.037844 PROGRESS: Precursor Summary:
2:46:35.039699 PROGRESS: Channel   0:	 0.05 FDR:   496; 0.01 FDR:   359; 0.001 FDR:   302
2:46:35.039833 PROGRESS: 
2:46:35.039908 PROGRESS: Protein Summary:
2:46:35.042071 PROGRESS: Channel   0:	 0.05 FDR:   475; 0.01 FDR:   344; 0.001 FDR:   291
2:46:35.042199 PROGRESS: =========================================================================
2:46:35.043312 PROGRESS: === Epoch 4, step 6, extracting elution groups 63000 to 127000 ===
2:46:35.220256 PROGRESS: Extracting batch of 126451 precursors
2:46:35.259795 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:46:35.259911 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:46:35.259965 INFO: FWHM in RT is 14.70 seconds, sigma is 0.54
2:46:35.259993 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:46:35.260274 INFO: Starting candidate selection
2:46:41.609404 INFO: Starting candidate scoring
2:46:44.004229 INFO: Finished candidate processing
2:46:44.004413 INFO: Collecting candidate features
2:46:46.533541 WARNING: intensity_correlation has 208 NaNs ( 0.19 % out of 109228)
2:46:46.534039 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 109228)
2:46:46.545830 INFO: Collecting fragment features
2:46:47.312177 INFO: Finished candidate scoring
2:46:47.732511 PROGRESS: === Epoch 4, step 6, extracted 109228 precursors and 523503 fragments ===
2:46:47.732909 INFO: performing precursor FDR with 47 features
2:46:47.732957 INFO: Decoy channel: -1
2:46:47.732983 INFO: Competetive: True
2:46:47.987149 WARNING: dropped 217 target PSMs due to missing features
2:46:47.987267 WARNING: dropped 217 decoy PSMs due to missing features
2:46:56.103417 INFO: Test AUC: 0.546
2:46:56.103543 INFO: Train AUC: 0.591
2:46:56.103599 INFO: AUC difference: 7.63%
2:46:56.103627 WARNING: AUC difference > 5%. This may indicate overfitting.
2:46:56.251080 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
2:46:56.252458 PROGRESS: ============================= Precursor FDR =============================
2:46:56.252593 PROGRESS: Total precursors accumulated: 1,254
2:46:56.252669 PROGRESS: Target precursors: 1,144 (91.23%)
2:46:56.252737 PROGRESS: Decoy precursors: 110 (8.77%)
2:46:56.252798 PROGRESS: 
2:46:56.252859 PROGRESS: Precursor Summary:
2:46:56.254897 PROGRESS: Channel   0:	 0.05 FDR:   873; 0.01 FDR:   673; 0.001 FDR:   188
2:46:56.255039 PROGRESS: 
2:46:56.255114 PROGRESS: Protein Summary:
2:46:56.257530 PROGRESS: Channel   0:	 0.05 FDR:   795; 0.01 FDR:   616; 0.001 FDR:   183
2:46:56.257658 PROGRESS: =========================================================================
2:46:56.258988 PROGRESS: === Epoch 4, step 7, extracting elution groups 127000 to 255000 ===
2:46:56.485281 PROGRESS: Extracting batch of 252821 precursors
2:46:56.558733 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:46:56.558864 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:46:56.558948 INFO: FWHM in RT is 14.70 seconds, sigma is 0.54
2:46:56.558976 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:46:56.559243 INFO: Starting candidate selection
2:47:05.453653 INFO: Starting candidate scoring
2:47:08.991691 INFO: Finished candidate processing
2:47:08.991876 INFO: Collecting candidate features
2:47:11.867093 WARNING: intensity_correlation has 470 NaNs ( 0.22 % out of 218216)
2:47:11.886471 INFO: Collecting fragment features
2:47:12.737896 INFO: Finished candidate scoring
2:47:13.298736 PROGRESS: === Epoch 4, step 7, extracted 218216 precursors and 1046043 fragments ===
2:47:13.299134 INFO: performing precursor FDR with 47 features
2:47:13.299181 INFO: Decoy channel: -1
2:47:13.299206 INFO: Competetive: True
2:47:13.852499 WARNING: dropped 453 target PSMs due to missing features
2:47:13.852639 WARNING: dropped 451 decoy PSMs due to missing features
2:47:30.027010 INFO: Test AUC: 0.548
2:47:30.027144 INFO: Train AUC: 0.577
2:47:30.027200 INFO: AUC difference: 5.08%
2:47:30.027229 WARNING: AUC difference > 5%. This may indicate overfitting.
2:47:30.207713 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
2:47:30.209515 PROGRESS: ============================= Precursor FDR =============================
2:47:30.209679 PROGRESS: Total precursors accumulated: 2,375
2:47:30.209762 PROGRESS: Target precursors: 2,163 (91.07%)
2:47:30.209841 PROGRESS: Decoy precursors: 212 (8.93%)
2:47:30.209905 PROGRESS: 
2:47:30.209967 PROGRESS: Precursor Summary:
2:47:30.212593 PROGRESS: Channel   0:	 0.05 FDR: 1,759; 0.01 FDR: 1,340; 0.001 FDR: 1,080
2:47:30.212738 PROGRESS: 
2:47:30.212813 PROGRESS: Protein Summary:
2:47:30.216152 PROGRESS: Channel   0:	 0.05 FDR: 1,478; 0.01 FDR: 1,111; 0.001 FDR:   902
2:47:30.216270 PROGRESS: =========================================================================
2:47:30.219100 INFO: calibration group: precursor, fitting rt estimator 
2:47:30.423640 INFO: calibration group: fragment, fitting mz estimator 
2:47:31.012180 INFO: === checking if epoch conditions were reached ===
2:47:31.012368 INFO: ✅ ms2_error      : 7.0000 <= 7
2:47:31.012458 INFO: ❌ rt_error       : 207.2403 > 100
2:47:31.012532 INFO: ✅ current_epoch  : 4 >= 3
2:47:31.012597 INFO: ==============================================
2:47:31.232434 INFO: calibration group: precursor, predicting mz
2:47:31.232680 WARNING: mz prediction was skipped as it has not been fitted yet
2:47:31.232736 INFO: calibration group: precursor, predicting rt
2:47:38.156621 INFO: calibration group: fragment, predicting mz
2:47:56.093928 PROGRESS: === Epoch 5, step 0, extracting elution groups 0 to 1000 ===
2:47:56.181819 PROGRESS: Extracting batch of 1975 precursors
2:47:56.183633 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:47:56.183721 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:47:56.183763 INFO: FWHM in RT is 15.22 seconds, sigma is 0.55
2:47:56.183793 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:47:56.184036 INFO: Starting candidate selection
2:48:00.410736 INFO: Starting candidate scoring
2:48:01.695157 INFO: Finished candidate processing
2:48:01.695248 INFO: Collecting candidate features
2:48:03.849806 WARNING: intensity_correlation has 5 NaNs ( 0.28 % out of 1762)
2:48:03.855972 INFO: Collecting fragment features
2:48:04.465130 INFO: Finished candidate scoring
2:48:04.778668 PROGRESS: === Epoch 5, step 0, extracted 1762 precursors and 8440 fragments ===
2:48:04.779031 INFO: performing precursor FDR with 47 features
2:48:04.779088 INFO: Decoy channel: -1
2:48:04.779126 INFO: Competetive: True
2:48:04.783905 WARNING: dropped 3 target PSMs due to missing features
2:48:04.783981 WARNING: dropped 2 decoy PSMs due to missing features
2:48:04.813594 INFO: Test AUC: 0.513
2:48:04.813697 INFO: Train AUC: 0.521
2:48:04.813775 INFO: AUC difference: 1.50%
2:48:04.936248 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
2:48:04.937056 PROGRESS: ============================= Precursor FDR =============================
2:48:04.937198 PROGRESS: Total precursors accumulated: 9
2:48:04.937277 PROGRESS: Target precursors: 9 (100.00%)
2:48:04.937346 PROGRESS: Decoy precursors: 0 (0.00%)
2:48:04.937409 PROGRESS: 
2:48:04.937472 PROGRESS: Precursor Summary:
2:48:04.938979 PROGRESS: Channel   0:	 0.05 FDR:     9; 0.01 FDR:     9; 0.001 FDR:     9
2:48:04.939117 PROGRESS: 
2:48:04.939189 PROGRESS: Protein Summary:
2:48:04.940871 PROGRESS: Channel   0:	 0.05 FDR:     9; 0.01 FDR:     9; 0.001 FDR:     9
2:48:04.940978 PROGRESS: =========================================================================
2:48:04.941895 PROGRESS: === Epoch 5, step 1, extracting elution groups 1000 to 3000 ===
2:48:05.019320 PROGRESS: Extracting batch of 3960 precursors
2:48:05.021566 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:48:05.021625 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:48:05.021663 INFO: FWHM in RT is 15.22 seconds, sigma is 0.55
2:48:05.021709 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:48:05.021954 INFO: Starting candidate selection
2:48:08.955739 INFO: Starting candidate scoring
2:48:10.300910 INFO: Finished candidate processing
2:48:10.301045 INFO: Collecting candidate features
2:48:12.490876 WARNING: intensity_correlation has 14 NaNs ( 0.40 % out of 3480)
2:48:12.497058 INFO: Collecting fragment features
2:48:13.116701 INFO: Finished candidate scoring
2:48:13.401426 PROGRESS: === Epoch 5, step 1, extracted 3480 precursors and 16610 fragments ===
2:48:13.401720 INFO: performing precursor FDR with 47 features
2:48:13.401767 INFO: Decoy channel: -1
2:48:13.401802 INFO: Competetive: True
2:48:13.410547 WARNING: dropped 9 target PSMs due to missing features
2:48:13.410640 WARNING: dropped 10 decoy PSMs due to missing features
2:48:13.447785 INFO: Test AUC: 0.527
2:48:13.447905 INFO: Train AUC: 0.554
2:48:13.447951 INFO: AUC difference: 4.88%
2:48:13.569969 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
2:48:13.570772 PROGRESS: ============================= Precursor FDR =============================
2:48:13.570894 PROGRESS: Total precursors accumulated: 21
2:48:13.570972 PROGRESS: Target precursors: 20 (95.24%)
2:48:13.571040 PROGRESS: Decoy precursors: 1 (4.76%)
2:48:13.571102 PROGRESS: 
2:48:13.571164 PROGRESS: Precursor Summary:
2:48:13.572573 PROGRESS: Channel   0:	 0.05 FDR:    19; 0.01 FDR:    19; 0.001 FDR:    19
2:48:13.572686 PROGRESS: 
2:48:13.572759 PROGRESS: Protein Summary:
2:48:13.574376 PROGRESS: Channel   0:	 0.05 FDR:    19; 0.01 FDR:    19; 0.001 FDR:    19
2:48:13.574486 PROGRESS: =========================================================================
2:48:13.575338 PROGRESS: === Epoch 5, step 2, extracting elution groups 3000 to 7000 ===
2:48:13.657506 PROGRESS: Extracting batch of 7892 precursors
2:48:13.660988 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:48:13.661051 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:48:13.661089 INFO: FWHM in RT is 15.22 seconds, sigma is 0.55
2:48:13.661134 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:48:13.661352 INFO: Starting candidate selection
2:48:17.656511 INFO: Starting candidate scoring
2:48:19.022229 INFO: Finished candidate processing
2:48:19.022418 INFO: Collecting candidate features
2:48:21.229213 WARNING: intensity_correlation has 23 NaNs ( 0.33 % out of 6905)
2:48:21.235637 INFO: Collecting fragment features
2:48:21.862325 INFO: Finished candidate scoring
2:48:22.148726 PROGRESS: === Epoch 5, step 2, extracted 6905 precursors and 33305 fragments ===
2:48:22.149060 INFO: performing precursor FDR with 47 features
2:48:22.149103 INFO: Decoy channel: -1
2:48:22.149130 INFO: Competetive: True
2:48:22.163658 WARNING: dropped 22 target PSMs due to missing features
2:48:22.163756 WARNING: dropped 20 decoy PSMs due to missing features
2:48:22.219880 INFO: Test AUC: 0.516
2:48:22.220007 INFO: Train AUC: 0.542
2:48:22.220054 INFO: AUC difference: 4.81%
2:48:22.342429 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
2:48:22.343277 PROGRESS: ============================= Precursor FDR =============================
2:48:22.343399 PROGRESS: Total precursors accumulated: 52
2:48:22.343477 PROGRESS: Target precursors: 48 (92.31%)
2:48:22.343545 PROGRESS: Decoy precursors: 4 (7.69%)
2:48:22.343608 PROGRESS: 
2:48:22.343669 PROGRESS: Precursor Summary:
2:48:22.345127 PROGRESS: Channel   0:	 0.05 FDR:    48; 0.01 FDR:    39; 0.001 FDR:    39
2:48:22.345238 PROGRESS: 
2:48:22.345311 PROGRESS: Protein Summary:
2:48:22.346958 PROGRESS: Channel   0:	 0.05 FDR:    48; 0.01 FDR:    39; 0.001 FDR:    39
2:48:22.347068 PROGRESS: =========================================================================
2:48:22.347933 PROGRESS: === Epoch 5, step 3, extracting elution groups 7000 to 15000 ===
2:48:22.439243 PROGRESS: Extracting batch of 15821 precursors
2:48:22.444853 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:48:22.444918 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:48:22.444953 INFO: FWHM in RT is 15.22 seconds, sigma is 0.55
2:48:22.444994 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:48:22.445219 INFO: Starting candidate selection
2:48:26.628913 INFO: Starting candidate scoring
2:48:28.068525 INFO: Finished candidate processing
2:48:28.068632 INFO: Collecting candidate features
2:48:30.305464 WARNING: intensity_correlation has 31 NaNs ( 0.22 % out of 13909)
2:48:30.311499 INFO: Collecting fragment features
2:48:30.952513 INFO: Finished candidate scoring
2:48:31.249125 PROGRESS: === Epoch 5, step 3, extracted 13909 precursors and 66994 fragments ===
2:48:31.249463 INFO: performing precursor FDR with 47 features
2:48:31.249509 INFO: Decoy channel: -1
2:48:31.249535 INFO: Competetive: True
2:48:31.277373 WARNING: dropped 32 target PSMs due to missing features
2:48:31.277506 WARNING: dropped 41 decoy PSMs due to missing features
2:48:31.979238 INFO: Test AUC: 0.538
2:48:31.979408 INFO: Train AUC: 0.599
2:48:31.979469 INFO: AUC difference: 10.14%
2:48:31.979508 WARNING: AUC difference > 5%. This may indicate overfitting.
2:48:32.132623 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
2:48:32.133548 PROGRESS: ============================= Precursor FDR =============================
2:48:32.133674 PROGRESS: Total precursors accumulated: 188
2:48:32.133751 PROGRESS: Target precursors: 171 (90.96%)
2:48:32.133830 PROGRESS: Decoy precursors: 17 (9.04%)
2:48:32.133893 PROGRESS: 
2:48:32.133955 PROGRESS: Precursor Summary:
2:48:32.135472 PROGRESS: Channel   0:	 0.05 FDR:   146; 0.01 FDR:    67; 0.001 FDR:    67
2:48:32.135589 PROGRESS: 
2:48:32.135663 PROGRESS: Protein Summary:
2:48:32.137405 PROGRESS: Channel   0:	 0.05 FDR:   145; 0.01 FDR:    66; 0.001 FDR:    66
2:48:32.137518 PROGRESS: =========================================================================
2:48:32.138443 PROGRESS: === Epoch 5, step 4, extracting elution groups 15000 to 31000 ===
2:48:32.247110 PROGRESS: Extracting batch of 31605 precursors
2:48:32.257872 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:48:32.257970 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:48:32.258010 INFO: FWHM in RT is 15.22 seconds, sigma is 0.55
2:48:32.258037 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:48:32.258280 INFO: Starting candidate selection
2:48:36.692312 INFO: Starting candidate scoring
2:48:38.234718 INFO: Finished candidate processing
2:48:38.234811 INFO: Collecting candidate features
2:48:40.485240 WARNING: intensity_correlation has 82 NaNs ( 0.29 % out of 27824)
2:48:40.492195 INFO: Collecting fragment features
2:48:41.142542 INFO: Finished candidate scoring
2:48:41.455891 PROGRESS: === Epoch 5, step 4, extracted 27824 precursors and 133329 fragments ===
2:48:41.456231 INFO: performing precursor FDR with 47 features
2:48:41.456280 INFO: Decoy channel: -1
2:48:41.456306 INFO: Competetive: True
2:48:41.511419 WARNING: dropped 64 target PSMs due to missing features
2:48:41.511529 WARNING: dropped 91 decoy PSMs due to missing features
2:48:43.216539 INFO: Test AUC: 0.552
2:48:43.216689 INFO: Train AUC: 0.608
2:48:43.216735 INFO: AUC difference: 9.18%
2:48:43.216770 WARNING: AUC difference > 5%. This may indicate overfitting.
2:48:43.361914 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
2:48:43.362917 PROGRESS: ============================= Precursor FDR =============================
2:48:43.363044 PROGRESS: Total precursors accumulated: 379
2:48:43.363124 PROGRESS: Target precursors: 348 (91.82%)
2:48:43.363193 PROGRESS: Decoy precursors: 31 (8.18%)
2:48:43.363256 PROGRESS: 
2:48:43.363318 PROGRESS: Precursor Summary:
2:48:43.364952 PROGRESS: Channel   0:	 0.05 FDR:   253; 0.01 FDR:   183; 0.001 FDR:   165
2:48:43.365090 PROGRESS: 
2:48:43.365165 PROGRESS: Protein Summary:
2:48:43.367405 PROGRESS: Channel   0:	 0.05 FDR:   248; 0.01 FDR:   179; 0.001 FDR:   161
2:48:43.367539 PROGRESS: =========================================================================
2:48:43.368660 PROGRESS: === Epoch 5, step 5, extracting elution groups 31000 to 63000 ===
2:48:43.505782 PROGRESS: Extracting batch of 63224 precursors
2:48:43.526350 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:48:43.526472 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:48:43.526515 INFO: FWHM in RT is 15.22 seconds, sigma is 0.55
2:48:43.526547 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:48:43.526802 INFO: Starting candidate selection
2:48:48.575511 INFO: Starting candidate scoring
2:48:50.406270 INFO: Finished candidate processing
2:48:50.406365 INFO: Collecting candidate features
2:48:52.771503 WARNING: intensity_correlation has 165 NaNs ( 0.30 % out of 55610)
2:48:52.781739 INFO: Collecting fragment features
2:48:53.470137 INFO: Finished candidate scoring
2:48:53.820336 PROGRESS: === Epoch 5, step 5, extracted 55610 precursors and 267543 fragments ===
2:48:53.820684 INFO: performing precursor FDR with 47 features
2:48:53.820731 INFO: Decoy channel: -1
2:48:53.820758 INFO: Competetive: True
2:48:53.944853 WARNING: dropped 148 target PSMs due to missing features
2:48:53.944972 WARNING: dropped 172 decoy PSMs due to missing features
2:48:57.731780 INFO: Test AUC: 0.551
2:48:57.731908 INFO: Train AUC: 0.604
2:48:57.731965 INFO: AUC difference: 8.67%
2:48:57.731994 WARNING: AUC difference > 5%. This may indicate overfitting.
2:48:57.866853 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
2:48:57.867994 PROGRESS: ============================= Precursor FDR =============================
2:48:57.868132 PROGRESS: Total precursors accumulated: 710
2:48:57.868212 PROGRESS: Target precursors: 647 (91.13%)
2:48:57.868281 PROGRESS: Decoy precursors: 63 (8.87%)
2:48:57.868344 PROGRESS: 
2:48:57.868405 PROGRESS: Precursor Summary:
2:48:57.870151 PROGRESS: Channel   0:	 0.05 FDR:   462; 0.01 FDR:   287; 0.001 FDR:   115
2:48:57.870269 PROGRESS: 
2:48:57.870342 PROGRESS: Protein Summary:
2:48:57.872358 PROGRESS: Channel   0:	 0.05 FDR:   438; 0.01 FDR:   274; 0.001 FDR:   112
2:48:57.872471 PROGRESS: =========================================================================
2:48:57.873526 PROGRESS: === Epoch 5, step 6, extracting elution groups 63000 to 127000 ===
2:48:58.049987 PROGRESS: Extracting batch of 126503 precursors
2:48:58.088965 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:48:58.089082 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:48:58.089123 INFO: FWHM in RT is 15.22 seconds, sigma is 0.55
2:48:58.089151 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:48:58.089409 INFO: Starting candidate selection
2:49:04.498844 INFO: Starting candidate scoring
2:49:06.948008 INFO: Finished candidate processing
2:49:06.948123 INFO: Collecting candidate features
2:49:09.489931 WARNING: intensity_correlation has 318 NaNs ( 0.29 % out of 111351)
2:49:09.502430 INFO: Collecting fragment features
2:49:10.244297 INFO: Finished candidate scoring
2:49:10.668619 PROGRESS: === Epoch 5, step 6, extracted 111351 precursors and 536042 fragments ===
2:49:10.668974 INFO: performing precursor FDR with 47 features
2:49:10.669018 INFO: Decoy channel: -1
2:49:10.669044 INFO: Competetive: True
2:49:10.928481 WARNING: dropped 304 target PSMs due to missing features
2:49:10.928598 WARNING: dropped 334 decoy PSMs due to missing features
2:49:18.920505 INFO: Test AUC: 0.548
2:49:18.920630 INFO: Train AUC: 0.592
2:49:18.920685 INFO: AUC difference: 7.51%
2:49:18.920713 WARNING: AUC difference > 5%. This may indicate overfitting.
2:49:19.071949 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
2:49:19.073348 PROGRESS: ============================= Precursor FDR =============================
2:49:19.073483 PROGRESS: Total precursors accumulated: 1,357
2:49:19.073562 PROGRESS: Target precursors: 1,237 (91.16%)
2:49:19.073630 PROGRESS: Decoy precursors: 120 (8.84%)
2:49:19.073693 PROGRESS: 
2:49:19.073754 PROGRESS: Precursor Summary:
2:49:19.075777 PROGRESS: Channel   0:	 0.05 FDR:   943; 0.01 FDR:   637; 0.001 FDR:   322
2:49:19.075926 PROGRESS: 
2:49:19.076004 PROGRESS: Protein Summary:
2:49:19.078475 PROGRESS: Channel   0:	 0.05 FDR:   854; 0.01 FDR:   574; 0.001 FDR:   298
2:49:19.078589 PROGRESS: =========================================================================
2:49:19.079858 PROGRESS: === Epoch 5, step 7, extracting elution groups 127000 to 255000 ===
2:49:19.305738 PROGRESS: Extracting batch of 252997 precursors
2:49:19.379499 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:49:19.379615 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:49:19.379674 INFO: FWHM in RT is 15.22 seconds, sigma is 0.55
2:49:19.379702 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:49:19.379967 INFO: Starting candidate selection
2:49:28.345734 INFO: Starting candidate scoring
2:49:31.985278 INFO: Finished candidate processing
2:49:31.985473 INFO: Collecting candidate features
2:49:34.872010 WARNING: intensity_correlation has 667 NaNs ( 0.30 % out of 222593)
2:49:34.891622 INFO: Collecting fragment features
2:49:35.715883 INFO: Finished candidate scoring
2:49:36.281652 PROGRESS: === Epoch 5, step 7, extracted 222593 precursors and 1071129 fragments ===
2:49:36.282028 INFO: performing precursor FDR with 47 features
2:49:36.282075 INFO: Decoy channel: -1
2:49:36.282102 INFO: Competetive: True
2:49:36.839290 WARNING: dropped 658 target PSMs due to missing features
2:49:36.839413 WARNING: dropped 647 decoy PSMs due to missing features
2:49:53.323990 INFO: Test AUC: 0.546
2:49:53.324125 INFO: Train AUC: 0.577
2:49:53.324181 INFO: AUC difference: 5.39%
2:49:53.324209 WARNING: AUC difference > 5%. This may indicate overfitting.
2:49:53.507551 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
2:49:53.509431 PROGRESS: ============================= Precursor FDR =============================
2:49:53.509565 PROGRESS: Total precursors accumulated: 2,834
2:49:53.509661 PROGRESS: Target precursors: 2,580 (91.04%)
2:49:53.509729 PROGRESS: Decoy precursors: 254 (8.96%)
2:49:53.509809 PROGRESS: 
2:49:53.509872 PROGRESS: Precursor Summary:
2:49:53.512312 PROGRESS: Channel   0:	 0.05 FDR: 1,946; 0.01 FDR: 1,395; 0.001 FDR:   572
2:49:53.512450 PROGRESS: 
2:49:53.512524 PROGRESS: Protein Summary:
2:49:53.515659 PROGRESS: Channel   0:	 0.05 FDR: 1,597; 0.01 FDR: 1,134; 0.001 FDR:   511
2:49:53.515792 PROGRESS: =========================================================================
2:49:53.518599 INFO: calibration group: precursor, fitting rt estimator 
2:49:53.721004 INFO: calibration group: fragment, fitting mz estimator 
2:49:54.307443 INFO: === checking if epoch conditions were reached ===
2:49:54.307608 INFO: ✅ ms2_error      : 7.0000 <= 7
2:49:54.307695 INFO: ❌ rt_error       : 202.8303 > 100
2:49:54.307768 INFO: ✅ current_epoch  : 5 >= 3
2:49:54.307833 INFO: ==============================================
2:49:54.527171 INFO: calibration group: precursor, predicting mz
2:49:54.527449 WARNING: mz prediction was skipped as it has not been fitted yet
2:49:54.527503 INFO: calibration group: precursor, predicting rt
2:50:01.425843 INFO: calibration group: fragment, predicting mz
2:50:19.328003 PROGRESS: === Epoch 6, step 0, extracting elution groups 0 to 1000 ===
2:50:19.416511 PROGRESS: Extracting batch of 1972 precursors
2:50:19.418283 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:50:19.418377 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:50:19.418420 INFO: FWHM in RT is 14.85 seconds, sigma is 0.54
2:50:19.418452 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:50:19.418683 INFO: Starting candidate selection
2:50:23.662199 INFO: Starting candidate scoring
2:50:24.947971 INFO: Finished candidate processing
2:50:24.948066 INFO: Collecting candidate features
2:50:27.098939 WARNING: intensity_correlation has 4 NaNs ( 0.22 % out of 1837)
2:50:27.105000 INFO: Collecting fragment features
2:50:27.740018 INFO: Finished candidate scoring
2:50:28.052727 PROGRESS: === Epoch 6, step 0, extracted 1837 precursors and 8936 fragments ===
2:50:28.053057 INFO: performing precursor FDR with 47 features
2:50:28.053098 INFO: Decoy channel: -1
2:50:28.053124 INFO: Competetive: True
2:50:28.057649 WARNING: dropped 4 target PSMs due to missing features
2:50:28.086520 INFO: Test AUC: 0.568
2:50:28.086618 INFO: Train AUC: 0.520
2:50:28.086665 INFO: AUC difference: 9.28%
2:50:28.086699 WARNING: AUC difference > 5%. This may indicate overfitting.
2:50:28.205379 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
2:50:28.206185 PROGRESS: ============================= Precursor FDR =============================
2:50:28.206306 PROGRESS: Total precursors accumulated: 8
2:50:28.206385 PROGRESS: Target precursors: 8 (100.00%)
2:50:28.206456 PROGRESS: Decoy precursors: 0 (0.00%)
2:50:28.206520 PROGRESS: 
2:50:28.206582 PROGRESS: Precursor Summary:
2:50:28.208075 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
2:50:28.208204 PROGRESS: 
2:50:28.208289 PROGRESS: Protein Summary:
2:50:28.209988 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
2:50:28.210099 PROGRESS: =========================================================================
2:50:28.210979 PROGRESS: === Epoch 6, step 1, extracting elution groups 1000 to 3000 ===
2:50:28.289013 PROGRESS: Extracting batch of 3952 precursors
2:50:28.291248 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:50:28.291312 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:50:28.291350 INFO: FWHM in RT is 14.85 seconds, sigma is 0.54
2:50:28.291381 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:50:28.291634 INFO: Starting candidate selection
2:50:32.201229 INFO: Starting candidate scoring
2:50:33.522509 INFO: Finished candidate processing
2:50:33.522620 INFO: Collecting candidate features
2:50:35.711979 WARNING: intensity_correlation has 9 NaNs ( 0.25 % out of 3579)
2:50:35.719452 INFO: Collecting fragment features
2:50:36.367910 INFO: Finished candidate scoring
2:50:36.652176 PROGRESS: === Epoch 6, step 1, extracted 3579 precursors and 17245 fragments ===
2:50:36.652463 INFO: performing precursor FDR with 47 features
2:50:36.652508 INFO: Decoy channel: -1
2:50:36.652535 INFO: Competetive: True
2:50:36.661353 WARNING: dropped 8 target PSMs due to missing features
2:50:36.661443 WARNING: dropped 5 decoy PSMs due to missing features
2:50:36.698639 INFO: Test AUC: 0.544
2:50:36.698759 INFO: Train AUC: 0.533
2:50:36.698805 INFO: AUC difference: 2.01%
2:50:36.817865 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
2:50:36.818659 PROGRESS: ============================= Precursor FDR =============================
2:50:36.818785 PROGRESS: Total precursors accumulated: 26
2:50:36.818864 PROGRESS: Target precursors: 24 (92.31%)
2:50:36.818933 PROGRESS: Decoy precursors: 2 (7.69%)
2:50:36.818996 PROGRESS: 
2:50:36.819057 PROGRESS: Precursor Summary:
2:50:36.820489 PROGRESS: Channel   0:	 0.05 FDR:    24; 0.01 FDR:    21; 0.001 FDR:    21
2:50:36.820618 PROGRESS: 
2:50:36.820704 PROGRESS: Protein Summary:
2:50:36.822344 PROGRESS: Channel   0:	 0.05 FDR:    24; 0.01 FDR:    21; 0.001 FDR:    21
2:50:36.822457 PROGRESS: =========================================================================
2:50:36.823318 PROGRESS: === Epoch 6, step 2, extracting elution groups 3000 to 7000 ===
2:50:36.905462 PROGRESS: Extracting batch of 7900 precursors
2:50:36.908953 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:50:36.909020 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:50:36.909058 INFO: FWHM in RT is 14.85 seconds, sigma is 0.54
2:50:36.909103 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:50:36.909326 INFO: Starting candidate selection
2:50:40.887126 INFO: Starting candidate scoring
2:50:42.232534 INFO: Finished candidate processing
2:50:42.232632 INFO: Collecting candidate features
2:50:44.405237 WARNING: intensity_correlation has 20 NaNs ( 0.28 % out of 7152)
2:50:44.411511 INFO: Collecting fragment features
2:50:45.056836 INFO: Finished candidate scoring
2:50:45.343765 PROGRESS: === Epoch 6, step 2, extracted 7152 precursors and 34230 fragments ===
2:50:45.344092 INFO: performing precursor FDR with 47 features
2:50:45.344135 INFO: Decoy channel: -1
2:50:45.344162 INFO: Competetive: True
2:50:45.359046 WARNING: dropped 21 target PSMs due to missing features
2:50:45.359141 WARNING: dropped 12 decoy PSMs due to missing features
2:50:45.626683 INFO: Test AUC: 0.518
2:50:45.626814 INFO: Train AUC: 0.588
2:50:45.626860 INFO: AUC difference: 11.87%
2:50:45.626894 WARNING: AUC difference > 5%. This may indicate overfitting.
2:50:45.745125 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
2:50:45.746002 PROGRESS: ============================= Precursor FDR =============================
2:50:45.746138 PROGRESS: Total precursors accumulated: 70
2:50:45.746229 PROGRESS: Target precursors: 64 (91.43%)
2:50:45.746314 PROGRESS: Decoy precursors: 6 (8.57%)
2:50:45.746405 PROGRESS: 
2:50:45.746493 PROGRESS: Precursor Summary:
2:50:45.748428 PROGRESS: Channel   0:	 0.05 FDR:    44; 0.01 FDR:    20; 0.001 FDR:    20
2:50:45.748557 PROGRESS: 
2:50:45.748656 PROGRESS: Protein Summary:
2:50:45.750588 PROGRESS: Channel   0:	 0.05 FDR:    44; 0.01 FDR:    20; 0.001 FDR:    20
2:50:45.750712 PROGRESS: =========================================================================
2:50:45.751850 PROGRESS: === Epoch 6, step 3, extracting elution groups 7000 to 15000 ===
2:50:45.843599 PROGRESS: Extracting batch of 15827 precursors
2:50:45.849279 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:50:45.849355 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:50:45.849397 INFO: FWHM in RT is 14.85 seconds, sigma is 0.54
2:50:45.849427 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:50:45.849679 INFO: Starting candidate selection
2:50:50.027648 INFO: Starting candidate scoring
2:50:51.451015 INFO: Finished candidate processing
2:50:51.451108 INFO: Collecting candidate features
2:50:53.671885 WARNING: intensity_correlation has 28 NaNs ( 0.19 % out of 14401)
2:50:53.677970 INFO: Collecting fragment features
2:50:54.343088 INFO: Finished candidate scoring
2:50:54.641165 PROGRESS: === Epoch 6, step 3, extracted 14401 precursors and 68570 fragments ===
2:50:54.641505 INFO: performing precursor FDR with 47 features
2:50:54.641550 INFO: Decoy channel: -1
2:50:54.641575 INFO: Competetive: True
2:50:54.669929 WARNING: dropped 36 target PSMs due to missing features
2:50:54.670046 WARNING: dropped 25 decoy PSMs due to missing features
2:50:55.410791 INFO: Test AUC: 0.546
2:50:55.417711 INFO: Train AUC: 0.596
2:50:55.417763 INFO: AUC difference: 8.49%
2:50:55.417794 WARNING: AUC difference > 5%. This may indicate overfitting.
2:50:55.539497 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
2:50:55.540389 PROGRESS: ============================= Precursor FDR =============================
2:50:55.540514 PROGRESS: Total precursors accumulated: 169
2:50:55.540614 PROGRESS: Target precursors: 154 (91.12%)
2:50:55.540689 PROGRESS: Decoy precursors: 15 (8.88%)
2:50:55.540756 PROGRESS: 
2:50:55.540817 PROGRESS: Precursor Summary:
2:50:55.542322 PROGRESS: Channel   0:	 0.05 FDR:   102; 0.01 FDR:    65; 0.001 FDR:    65
2:50:55.542437 PROGRESS: 
2:50:55.542511 PROGRESS: Protein Summary:
2:50:55.544204 PROGRESS: Channel   0:	 0.05 FDR:   101; 0.01 FDR:    65; 0.001 FDR:    65
2:50:55.544316 PROGRESS: =========================================================================
2:50:55.545205 PROGRESS: === Epoch 6, step 4, extracting elution groups 15000 to 31000 ===
2:50:55.653923 PROGRESS: Extracting batch of 31600 precursors
2:50:55.664864 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:50:55.664979 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:50:55.665023 INFO: FWHM in RT is 14.85 seconds, sigma is 0.54
2:50:55.665050 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:50:55.665292 INFO: Starting candidate selection
2:51:00.130502 INFO: Starting candidate scoring
2:51:01.683661 INFO: Finished candidate processing
2:51:01.683756 INFO: Collecting candidate features
2:51:03.961092 WARNING: intensity_correlation has 71 NaNs ( 0.25 % out of 28856)
2:51:03.967970 INFO: Collecting fragment features
2:51:04.649190 INFO: Finished candidate scoring
2:51:04.964594 PROGRESS: === Epoch 6, step 4, extracted 28856 precursors and 138306 fragments ===
2:51:04.964949 INFO: performing precursor FDR with 47 features
2:51:04.964996 INFO: Decoy channel: -1
2:51:04.965023 INFO: Competetive: True
2:51:05.022889 WARNING: dropped 75 target PSMs due to missing features
2:51:05.023000 WARNING: dropped 57 decoy PSMs due to missing features
2:51:06.690180 INFO: Test AUC: 0.543
2:51:06.690329 INFO: Train AUC: 0.607
2:51:06.690375 INFO: AUC difference: 10.57%
2:51:06.690407 WARNING: AUC difference > 5%. This may indicate overfitting.
2:51:06.814840 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
2:51:06.815880 PROGRESS: ============================= Precursor FDR =============================
2:51:06.816010 PROGRESS: Total precursors accumulated: 449
2:51:06.816088 PROGRESS: Target precursors: 409 (91.09%)
2:51:06.816156 PROGRESS: Decoy precursors: 40 (8.91%)
2:51:06.816218 PROGRESS: 
2:51:06.816278 PROGRESS: Precursor Summary:
2:51:06.817905 PROGRESS: Channel   0:	 0.05 FDR:   214; 0.01 FDR:   144; 0.001 FDR:   134
2:51:06.818027 PROGRESS: 
2:51:06.818101 PROGRESS: Protein Summary:
2:51:06.819956 PROGRESS: Channel   0:	 0.05 FDR:   208; 0.01 FDR:   139; 0.001 FDR:   129
2:51:06.820069 PROGRESS: =========================================================================
2:51:06.821025 PROGRESS: === Epoch 6, step 5, extracting elution groups 31000 to 63000 ===
2:51:06.958075 PROGRESS: Extracting batch of 63244 precursors
2:51:06.978350 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:51:06.978461 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:51:06.978501 INFO: FWHM in RT is 14.85 seconds, sigma is 0.54
2:51:06.978529 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:51:06.978781 INFO: Starting candidate selection
2:51:12.138656 INFO: Starting candidate scoring
2:51:14.027550 INFO: Finished candidate processing
2:51:14.027733 INFO: Collecting candidate features
2:51:16.390646 WARNING: intensity_correlation has 128 NaNs ( 0.22 % out of 57528)
2:51:16.399482 INFO: Collecting fragment features
2:51:17.104899 INFO: Finished candidate scoring
2:51:17.462890 PROGRESS: === Epoch 6, step 5, extracted 57528 precursors and 276786 fragments ===
2:51:17.463249 INFO: performing precursor FDR with 47 features
2:51:17.463943 INFO: Decoy channel: -1
2:51:17.464034 INFO: Competetive: True
2:51:17.592930 WARNING: dropped 140 target PSMs due to missing features
2:51:17.593045 WARNING: dropped 120 decoy PSMs due to missing features
2:51:21.814996 INFO: Test AUC: 0.546
2:51:21.815115 INFO: Train AUC: 0.604
2:51:21.815175 INFO: AUC difference: 9.52%
2:51:21.815203 WARNING: AUC difference > 5%. This may indicate overfitting.
2:51:21.949572 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
2:51:21.950815 PROGRESS: ============================= Precursor FDR =============================
2:51:21.950946 PROGRESS: Total precursors accumulated: 1,061
2:51:21.951025 PROGRESS: Target precursors: 967 (91.14%)
2:51:21.951095 PROGRESS: Decoy precursors: 94 (8.86%)
2:51:21.951159 PROGRESS: 
2:51:21.951220 PROGRESS: Precursor Summary:
2:51:21.953006 PROGRESS: Channel   0:	 0.05 FDR:   703; 0.01 FDR:   360; 0.001 FDR:   128
2:51:21.953136 PROGRESS: 
2:51:21.953211 PROGRESS: Protein Summary:
2:51:21.955344 PROGRESS: Channel   0:	 0.05 FDR:   665; 0.01 FDR:   342; 0.001 FDR:   122
2:51:21.955472 PROGRESS: =========================================================================
2:51:21.956550 PROGRESS: === Epoch 6, step 6, extracting elution groups 63000 to 127000 ===
2:51:22.132413 PROGRESS: Extracting batch of 126474 precursors
2:51:22.170944 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:51:22.171058 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:51:22.171095 INFO: FWHM in RT is 14.85 seconds, sigma is 0.54
2:51:22.171140 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:51:22.171400 INFO: Starting candidate selection
2:51:28.590097 INFO: Starting candidate scoring
2:51:31.054602 INFO: Finished candidate processing
2:51:31.054701 INFO: Collecting candidate features
2:51:33.567312 WARNING: intensity_correlation has 255 NaNs ( 0.22 % out of 114996)
2:51:33.581032 INFO: Collecting fragment features
2:51:34.344030 INFO: Finished candidate scoring
2:51:34.765049 PROGRESS: === Epoch 6, step 6, extracted 114996 precursors and 550779 fragments ===
2:51:34.765417 INFO: performing precursor FDR with 47 features
2:51:34.765465 INFO: Decoy channel: -1
2:51:34.765491 INFO: Competetive: True
2:51:35.028426 WARNING: dropped 284 target PSMs due to missing features
2:51:35.028559 WARNING: dropped 231 decoy PSMs due to missing features
2:51:43.245014 INFO: Test AUC: 0.549
2:51:43.245141 INFO: Train AUC: 0.591
2:51:43.245198 INFO: AUC difference: 7.18%
2:51:43.245226 WARNING: AUC difference > 5%. This may indicate overfitting.
2:51:43.403341 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
2:51:43.404891 PROGRESS: ============================= Precursor FDR =============================
2:51:43.405052 PROGRESS: Total precursors accumulated: 1,901
2:51:43.405131 PROGRESS: Target precursors: 1,733 (91.16%)
2:51:43.405199 PROGRESS: Decoy precursors: 168 (8.84%)
2:51:43.405263 PROGRESS: 
2:51:43.405324 PROGRESS: Precursor Summary:
2:51:43.410282 PROGRESS: Channel   0:	 0.05 FDR: 1,196; 0.01 FDR:   838; 0.001 FDR:   408
2:51:43.410625 PROGRESS: 
2:51:43.410894 PROGRESS: Protein Summary:
2:51:43.416100 PROGRESS: Channel   0:	 0.05 FDR: 1,089; 0.01 FDR:   752; 0.001 FDR:   375
2:51:43.416219 PROGRESS: =========================================================================
2:51:43.417598 PROGRESS: === Epoch 6, step 7, extracting elution groups 127000 to 255000 ===
2:51:43.641396 PROGRESS: Extracting batch of 252960 precursors
2:51:43.713431 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:51:43.713573 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:51:43.713632 INFO: FWHM in RT is 14.85 seconds, sigma is 0.54
2:51:43.713673 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:51:43.714001 INFO: Starting candidate selection
2:51:52.668530 INFO: Starting candidate scoring
2:51:56.324210 INFO: Finished candidate processing
2:51:56.324394 INFO: Collecting candidate features
2:51:59.252715 WARNING: intensity_correlation has 502 NaNs ( 0.22 % out of 230554)
2:51:59.272627 INFO: Collecting fragment features
2:52:00.129370 INFO: Finished candidate scoring
2:52:00.706318 PROGRESS: === Epoch 6, step 7, extracted 230554 precursors and 1105441 fragments ===
2:52:00.706710 INFO: performing precursor FDR with 47 features
2:52:00.706774 INFO: Decoy channel: -1
2:52:00.706824 INFO: Competetive: True
2:52:01.284189 WARNING: dropped 542 target PSMs due to missing features
2:52:01.284323 WARNING: dropped 475 decoy PSMs due to missing features
2:52:17.669161 INFO: Test AUC: 0.550
2:52:17.669290 INFO: Train AUC: 0.578
2:52:17.669328 INFO: AUC difference: 4.95%
2:52:17.848961 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
2:52:17.851006 PROGRESS: ============================= Precursor FDR =============================
2:52:17.851147 PROGRESS: Total precursors accumulated: 3,397
2:52:17.851226 PROGRESS: Target precursors: 3,095 (91.11%)
2:52:17.851294 PROGRESS: Decoy precursors: 302 (8.89%)
2:52:17.851386 PROGRESS: 
2:52:17.851451 PROGRESS: Precursor Summary:
2:52:17.853965 PROGRESS: Channel   0:	 0.05 FDR: 2,408; 0.01 FDR: 1,533; 0.001 FDR:   441
2:52:17.854087 PROGRESS: 
2:52:17.854161 PROGRESS: Protein Summary:
2:52:17.857331 PROGRESS: Channel   0:	 0.05 FDR: 1,969; 0.01 FDR: 1,251; 0.001 FDR:   397
2:52:17.857440 PROGRESS: =========================================================================
2:52:17.860304 INFO: calibration group: precursor, fitting rt estimator 
2:52:18.089676 INFO: calibration group: fragment, fitting mz estimator 
2:52:18.689637 INFO: === checking if epoch conditions were reached ===
2:52:18.689805 INFO: ✅ ms2_error      : 7.0000 <= 7
2:52:18.689896 INFO: ❌ rt_error       : 202.7713 > 100
2:52:18.689969 INFO: ✅ current_epoch  : 6 >= 3
2:52:18.690035 INFO: ==============================================
2:52:18.907865 INFO: calibration group: precursor, predicting mz
2:52:18.908122 WARNING: mz prediction was skipped as it has not been fitted yet
2:52:18.908166 INFO: calibration group: precursor, predicting rt
2:52:25.701525 INFO: calibration group: fragment, predicting mz
2:52:43.862571 PROGRESS: === Epoch 7, step 0, extracting elution groups 0 to 1000 ===
2:52:43.950135 PROGRESS: Extracting batch of 1974 precursors
2:52:43.951910 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:52:43.952001 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:52:43.952042 INFO: FWHM in RT is 14.68 seconds, sigma is 0.53
2:52:43.952088 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:52:43.952340 INFO: Starting candidate selection
2:52:48.219968 INFO: Starting candidate scoring
2:52:49.509761 INFO: Finished candidate processing
2:52:49.509870 INFO: Collecting candidate features
2:52:51.660984 WARNING: intensity_correlation has 1 NaNs ( 0.05 % out of 1866)
2:52:51.666966 INFO: Collecting fragment features
2:52:52.277838 INFO: Finished candidate scoring
2:52:52.590011 PROGRESS: === Epoch 7, step 0, extracted 1866 precursors and 8894 fragments ===
2:52:52.590343 INFO: performing precursor FDR with 47 features
2:52:52.590384 INFO: Decoy channel: -1
2:52:52.590410 INFO: Competetive: True
2:52:52.594919 WARNING: dropped 1 decoy PSMs due to missing features
2:52:52.623134 INFO: Test AUC: 0.511
2:52:52.623228 INFO: Train AUC: 0.534
2:52:52.623272 INFO: AUC difference: 4.40%
2:52:52.740115 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
2:52:52.740911 PROGRESS: ============================= Precursor FDR =============================
2:52:52.741035 PROGRESS: Total precursors accumulated: 6
2:52:52.741113 PROGRESS: Target precursors: 6 (100.00%)
2:52:52.741181 PROGRESS: Decoy precursors: 0 (0.00%)
2:52:52.741243 PROGRESS: 
2:52:52.741305 PROGRESS: Precursor Summary:
2:52:52.742807 PROGRESS: Channel   0:	 0.05 FDR:     6; 0.01 FDR:     6; 0.001 FDR:     6
2:52:52.742919 PROGRESS: 
2:52:52.742992 PROGRESS: Protein Summary:
2:52:52.744672 PROGRESS: Channel   0:	 0.05 FDR:     6; 0.01 FDR:     6; 0.001 FDR:     6
2:52:52.744798 PROGRESS: =========================================================================
2:52:52.745680 PROGRESS: === Epoch 7, step 1, extracting elution groups 1000 to 3000 ===
2:52:52.822733 PROGRESS: Extracting batch of 3943 precursors
2:52:52.824840 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:52:52.824915 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:52:52.824965 INFO: FWHM in RT is 14.68 seconds, sigma is 0.53
2:52:52.824996 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:52:52.825228 INFO: Starting candidate selection
2:52:56.775324 INFO: Starting candidate scoring
2:52:58.099199 INFO: Finished candidate processing
2:52:58.099285 INFO: Collecting candidate features
2:53:00.278567 WARNING: intensity_correlation has 10 NaNs ( 0.27 % out of 3659)
2:53:00.285005 INFO: Collecting fragment features
2:53:00.905409 INFO: Finished candidate scoring
2:53:01.190943 PROGRESS: === Epoch 7, step 1, extracted 3659 precursors and 17314 fragments ===
2:53:01.191223 INFO: performing precursor FDR with 47 features
2:53:01.191269 INFO: Decoy channel: -1
2:53:01.191296 INFO: Competetive: True
2:53:01.200019 WARNING: dropped 6 target PSMs due to missing features
2:53:01.200107 WARNING: dropped 5 decoy PSMs due to missing features
2:53:01.237053 INFO: Test AUC: 0.533
2:53:01.237173 INFO: Train AUC: 0.537
2:53:01.237218 INFO: AUC difference: 0.84%
2:53:01.359431 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
2:53:01.360212 PROGRESS: ============================= Precursor FDR =============================
2:53:01.360334 PROGRESS: Total precursors accumulated: 18
2:53:01.360413 PROGRESS: Target precursors: 17 (94.44%)
2:53:01.360481 PROGRESS: Decoy precursors: 1 (5.56%)
2:53:01.360545 PROGRESS: 
2:53:01.360625 PROGRESS: Precursor Summary:
2:53:01.362076 PROGRESS: Channel   0:	 0.05 FDR:    13; 0.01 FDR:    13; 0.001 FDR:    13
2:53:01.362190 PROGRESS: 
2:53:01.362264 PROGRESS: Protein Summary:
2:53:01.363873 PROGRESS: Channel   0:	 0.05 FDR:    13; 0.01 FDR:    13; 0.001 FDR:    13
2:53:01.363985 PROGRESS: =========================================================================
2:53:01.364843 PROGRESS: === Epoch 7, step 2, extracting elution groups 3000 to 7000 ===
2:53:01.446775 PROGRESS: Extracting batch of 7898 precursors
2:53:01.450185 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:53:01.450251 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:53:01.450291 INFO: FWHM in RT is 14.68 seconds, sigma is 0.53
2:53:01.450321 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:53:01.450543 INFO: Starting candidate selection
2:53:05.481380 INFO: Starting candidate scoring
2:53:06.849112 INFO: Finished candidate processing
2:53:06.849244 INFO: Collecting candidate features
2:53:09.025208 WARNING: intensity_correlation has 11 NaNs ( 0.15 % out of 7334)
2:53:09.031612 INFO: Collecting fragment features
2:53:09.659139 INFO: Finished candidate scoring
2:53:09.945921 PROGRESS: === Epoch 7, step 2, extracted 7334 precursors and 34975 fragments ===
2:53:09.946255 INFO: performing precursor FDR with 47 features
2:53:09.946302 INFO: Decoy channel: -1
2:53:09.946329 INFO: Competetive: True
2:53:09.961350 WARNING: dropped 11 target PSMs due to missing features
2:53:09.961459 WARNING: dropped 11 decoy PSMs due to missing features
2:53:10.289738 INFO: Test AUC: 0.548
2:53:10.289907 INFO: Train AUC: 0.579
2:53:10.289967 INFO: AUC difference: 5.39%
2:53:10.290017 WARNING: AUC difference > 5%. This may indicate overfitting.
2:53:10.411711 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
2:53:10.412556 PROGRESS: ============================= Precursor FDR =============================
2:53:10.412678 PROGRESS: Total precursors accumulated: 80
2:53:10.412756 PROGRESS: Target precursors: 74 (92.50%)
2:53:10.412823 PROGRESS: Decoy precursors: 6 (7.50%)
2:53:10.412886 PROGRESS: 
2:53:10.412949 PROGRESS: Precursor Summary:
2:53:10.414427 PROGRESS: Channel   0:	 0.05 FDR:    67; 0.01 FDR:    51; 0.001 FDR:    51
2:53:10.414543 PROGRESS: 
2:53:10.414617 PROGRESS: Protein Summary:
2:53:10.416282 PROGRESS: Channel   0:	 0.05 FDR:    67; 0.01 FDR:    51; 0.001 FDR:    51
2:53:10.416410 PROGRESS: =========================================================================
2:53:10.417301 PROGRESS: === Epoch 7, step 3, extracting elution groups 7000 to 15000 ===
2:53:10.508625 PROGRESS: Extracting batch of 15803 precursors
2:53:10.514191 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:53:10.514260 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:53:10.514312 INFO: FWHM in RT is 14.68 seconds, sigma is 0.53
2:53:10.514339 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:53:10.514581 INFO: Starting candidate selection
2:53:14.689343 INFO: Starting candidate scoring
2:53:16.118185 INFO: Finished candidate processing
2:53:16.118278 INFO: Collecting candidate features
2:53:18.318101 WARNING: intensity_correlation has 22 NaNs ( 0.15 % out of 14650)
2:53:18.324088 INFO: Collecting fragment features
2:53:18.951544 INFO: Finished candidate scoring
2:53:19.246075 PROGRESS: === Epoch 7, step 3, extracted 14650 precursors and 71161 fragments ===
2:53:19.246397 INFO: performing precursor FDR with 47 features
2:53:19.246444 INFO: Decoy channel: -1
2:53:19.246469 INFO: Competetive: True
2:53:19.274888 WARNING: dropped 24 target PSMs due to missing features
2:53:19.275007 WARNING: dropped 20 decoy PSMs due to missing features
2:53:20.053686 INFO: Test AUC: 0.558
2:53:20.053966 INFO: Train AUC: 0.601
2:53:20.060709 INFO: AUC difference: 7.13%
2:53:20.060806 WARNING: AUC difference > 5%. This may indicate overfitting.
2:53:20.184282 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
2:53:20.185200 PROGRESS: ============================= Precursor FDR =============================
2:53:20.185321 PROGRESS: Total precursors accumulated: 262
2:53:20.185400 PROGRESS: Target precursors: 240 (91.60%)
2:53:20.185469 PROGRESS: Decoy precursors: 22 (8.40%)
2:53:20.185532 PROGRESS: 
2:53:20.185593 PROGRESS: Precursor Summary:
2:53:20.187130 PROGRESS: Channel   0:	 0.05 FDR:   171; 0.01 FDR:   137; 0.001 FDR:    77
2:53:20.187243 PROGRESS: 
2:53:20.187316 PROGRESS: Protein Summary:
2:53:20.189083 PROGRESS: Channel   0:	 0.05 FDR:   171; 0.01 FDR:   137; 0.001 FDR:    77
2:53:20.189208 PROGRESS: =========================================================================
2:53:20.190153 PROGRESS: === Epoch 7, step 4, extracting elution groups 15000 to 31000 ===
2:53:20.304506 PROGRESS: Extracting batch of 31623 precursors
2:53:20.315272 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:53:20.315385 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:53:20.315424 INFO: FWHM in RT is 14.68 seconds, sigma is 0.53
2:53:20.315453 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:53:20.315688 INFO: Starting candidate selection
2:53:24.786045 INFO: Starting candidate scoring
2:53:26.359065 INFO: Finished candidate processing
2:53:26.359180 INFO: Collecting candidate features
2:53:28.636378 WARNING: intensity_correlation has 50 NaNs ( 0.17 % out of 29436)
2:53:28.643763 INFO: Collecting fragment features
2:53:29.300970 INFO: Finished candidate scoring
2:53:29.616110 PROGRESS: === Epoch 7, step 4, extracted 29436 precursors and 141728 fragments ===
2:53:29.616462 INFO: performing precursor FDR with 47 features
2:53:29.616511 INFO: Decoy channel: -1
2:53:29.616537 INFO: Competetive: True
2:53:29.675428 WARNING: dropped 53 target PSMs due to missing features
2:53:29.675540 WARNING: dropped 41 decoy PSMs due to missing features
2:53:31.456241 INFO: Test AUC: 0.546
2:53:31.456418 INFO: Train AUC: 0.612
2:53:31.456468 INFO: AUC difference: 10.91%
2:53:31.456502 WARNING: AUC difference > 5%. This may indicate overfitting.
2:53:31.584194 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
2:53:31.585371 PROGRESS: ============================= Precursor FDR =============================
2:53:31.585508 PROGRESS: Total precursors accumulated: 736
2:53:31.585591 PROGRESS: Target precursors: 671 (91.17%)
2:53:31.585663 PROGRESS: Decoy precursors: 65 (8.83%)
2:53:31.585731 PROGRESS: 
2:53:31.585804 PROGRESS: Precursor Summary:
2:53:31.587506 PROGRESS: Channel   0:	 0.05 FDR:   337; 0.01 FDR:   207; 0.001 FDR:   185
2:53:31.587623 PROGRESS: 
2:53:31.587698 PROGRESS: Protein Summary:
2:53:31.589637 PROGRESS: Channel   0:	 0.05 FDR:   325; 0.01 FDR:   200; 0.001 FDR:   178
2:53:31.589756 PROGRESS: =========================================================================
2:53:31.590782 PROGRESS: === Epoch 7, step 5, extracting elution groups 31000 to 63000 ===
2:53:31.729280 PROGRESS: Extracting batch of 63222 precursors
2:53:31.749255 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:53:31.749362 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:53:31.749417 INFO: FWHM in RT is 14.68 seconds, sigma is 0.53
2:53:31.749444 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:53:31.749711 INFO: Starting candidate selection
2:53:36.888778 INFO: Starting candidate scoring
2:53:38.781135 INFO: Finished candidate processing
2:53:38.781319 INFO: Collecting candidate features
2:53:41.127209 WARNING: intensity_correlation has 114 NaNs ( 0.19 % out of 58743)
2:53:41.136266 INFO: Collecting fragment features
2:53:41.818052 INFO: Finished candidate scoring
2:53:42.165458 PROGRESS: === Epoch 7, step 5, extracted 58743 precursors and 282676 fragments ===
2:53:42.165818 INFO: performing precursor FDR with 47 features
2:53:42.165863 INFO: Decoy channel: -1
2:53:42.165889 INFO: Competetive: True
2:53:42.294342 WARNING: dropped 113 target PSMs due to missing features
2:53:42.294458 WARNING: dropped 95 decoy PSMs due to missing features
2:53:46.222235 INFO: Test AUC: 0.549
2:53:46.222353 INFO: Train AUC: 0.605
2:53:46.222396 INFO: AUC difference: 9.30%
2:53:46.222425 WARNING: AUC difference > 5%. This may indicate overfitting.
2:53:46.358962 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
2:53:46.360246 PROGRESS: ============================= Precursor FDR =============================
2:53:46.360374 PROGRESS: Total precursors accumulated: 1,177
2:53:46.360452 PROGRESS: Target precursors: 1,075 (91.33%)
2:53:46.360520 PROGRESS: Decoy precursors: 102 (8.67%)
2:53:46.360583 PROGRESS: 
2:53:46.360645 PROGRESS: Precursor Summary:
2:53:46.362499 PROGRESS: Channel   0:	 0.05 FDR:   651; 0.01 FDR:   426; 0.001 FDR:   316
2:53:46.362618 PROGRESS: 
2:53:46.362691 PROGRESS: Protein Summary:
2:53:46.364871 PROGRESS: Channel   0:	 0.05 FDR:   616; 0.01 FDR:   396; 0.001 FDR:   294
2:53:46.364998 PROGRESS: =========================================================================
2:53:46.366143 PROGRESS: === Epoch 7, step 6, extracting elution groups 63000 to 127000 ===
2:53:46.542768 PROGRESS: Extracting batch of 126487 precursors
2:53:46.581005 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:53:46.581122 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:53:46.581162 INFO: FWHM in RT is 14.68 seconds, sigma is 0.53
2:53:46.581205 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:53:46.581468 INFO: Starting candidate selection
2:53:52.984963 INFO: Starting candidate scoring
2:53:55.463376 INFO: Finished candidate processing
2:53:55.463469 INFO: Collecting candidate features
2:53:58.014758 WARNING: intensity_correlation has 209 NaNs ( 0.18 % out of 117636)
2:53:58.027742 INFO: Collecting fragment features
2:53:58.777179 INFO: Finished candidate scoring
2:53:59.205126 PROGRESS: === Epoch 7, step 6, extracted 117636 precursors and 564602 fragments ===
2:53:59.205483 INFO: performing precursor FDR with 47 features
2:53:59.205531 INFO: Decoy channel: -1
2:53:59.205558 INFO: Competetive: True
2:53:59.478151 WARNING: dropped 219 target PSMs due to missing features
2:53:59.478287 WARNING: dropped 198 decoy PSMs due to missing features
2:54:07.689418 INFO: Test AUC: 0.549
2:54:07.689551 INFO: Train AUC: 0.591
2:54:07.689621 INFO: AUC difference: 7.03%
2:54:07.689662 WARNING: AUC difference > 5%. This may indicate overfitting.
2:54:07.845455 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
2:54:07.847053 PROGRESS: ============================= Precursor FDR =============================
2:54:07.847201 PROGRESS: Total precursors accumulated: 2,007
2:54:07.847281 PROGRESS: Target precursors: 1,829 (91.13%)
2:54:07.847350 PROGRESS: Decoy precursors: 178 (8.87%)
2:54:07.847426 PROGRESS: 
2:54:07.847489 PROGRESS: Precursor Summary:
2:54:07.849647 PROGRESS: Channel   0:	 0.05 FDR: 1,285; 0.01 FDR:   839; 0.001 FDR:   533
2:54:07.849767 PROGRESS: 
2:54:07.849869 PROGRESS: Protein Summary:
2:54:07.852534 PROGRESS: Channel   0:	 0.05 FDR: 1,170; 0.01 FDR:   753; 0.001 FDR:   488
2:54:07.852666 PROGRESS: =========================================================================
2:54:07.854051 PROGRESS: === Epoch 7, step 7, extracting elution groups 127000 to 255000 ===
2:54:08.079350 PROGRESS: Extracting batch of 252917 precursors
2:54:08.152894 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:54:08.153014 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:54:08.153053 INFO: FWHM in RT is 14.68 seconds, sigma is 0.53
2:54:08.153097 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:54:08.153368 INFO: Starting candidate selection
2:54:17.108950 INFO: Starting candidate scoring
2:54:20.778130 INFO: Finished candidate processing
2:54:20.778308 INFO: Collecting candidate features
2:54:23.743187 WARNING: intensity_correlation has 435 NaNs ( 0.19 % out of 234778)
2:54:23.764423 INFO: Collecting fragment features
2:54:24.607031 INFO: Finished candidate scoring
2:54:25.193256 PROGRESS: === Epoch 7, step 7, extracted 234778 precursors and 1129177 fragments ===
2:54:25.193596 INFO: performing precursor FDR with 47 features
2:54:25.193640 INFO: Decoy channel: -1
2:54:25.193666 INFO: Competetive: True
2:54:25.789056 WARNING: dropped 417 target PSMs due to missing features
2:54:25.789182 WARNING: dropped 435 decoy PSMs due to missing features
2:54:42.161971 INFO: Test AUC: 0.546
2:54:42.162103 INFO: Train AUC: 0.576
2:54:42.162161 INFO: AUC difference: 5.20%
2:54:42.162190 WARNING: AUC difference > 5%. This may indicate overfitting.
2:54:42.343878 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
2:54:42.345939 PROGRESS: ============================= Precursor FDR =============================
2:54:42.346078 PROGRESS: Total precursors accumulated: 3,534
2:54:42.346158 PROGRESS: Target precursors: 3,224 (91.23%)
2:54:42.346226 PROGRESS: Decoy precursors: 310 (8.77%)
2:54:42.346290 PROGRESS: 
2:54:42.346352 PROGRESS: Precursor Summary:
2:54:42.349092 PROGRESS: Channel   0:	 0.05 FDR: 2,542; 0.01 FDR: 1,704; 0.001 FDR: 1,230
2:54:42.349233 PROGRESS: 
2:54:42.349306 PROGRESS: Protein Summary:
2:54:42.352892 PROGRESS: Channel   0:	 0.05 FDR: 2,098; 0.01 FDR: 1,391; 0.001 FDR: 1,013
2:54:42.353021 PROGRESS: =========================================================================
2:54:42.356112 INFO: calibration group: precursor, fitting rt estimator 
2:54:42.583270 INFO: calibration group: fragment, fitting mz estimator 
2:54:43.183908 INFO: === checking if epoch conditions were reached ===
2:54:43.184067 INFO: ✅ ms2_error      : 7.0000 <= 7
2:54:43.184157 INFO: ❌ rt_error       : 201.5472 > 100
2:54:43.184230 INFO: ✅ current_epoch  : 7 >= 3
2:54:43.184303 INFO: ==============================================
2:54:43.404845 INFO: calibration group: precursor, predicting mz
2:54:43.405119 WARNING: mz prediction was skipped as it has not been fitted yet
2:54:43.405165 INFO: calibration group: precursor, predicting rt
2:54:50.234722 INFO: calibration group: fragment, predicting mz
2:55:08.487968 PROGRESS: === Epoch 8, step 0, extracting elution groups 0 to 1000 ===
2:55:08.575456 PROGRESS: Extracting batch of 1977 precursors
2:55:08.577155 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:55:08.577230 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:55:08.577271 INFO: FWHM in RT is 14.26 seconds, sigma is 0.52
2:55:08.577316 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:55:08.577584 INFO: Starting candidate selection
2:55:12.905777 INFO: Starting candidate scoring
2:55:14.209893 INFO: Finished candidate processing
2:55:14.210005 INFO: Collecting candidate features
2:55:16.386985 WARNING: intensity_correlation has 1 NaNs ( 0.05 % out of 1829)
2:55:16.393098 INFO: Collecting fragment features
2:55:17.028966 INFO: Finished candidate scoring
2:55:17.335568 PROGRESS: === Epoch 8, step 0, extracted 1829 precursors and 8642 fragments ===
2:55:17.335899 INFO: performing precursor FDR with 47 features
2:55:17.335938 INFO: Decoy channel: -1
2:55:17.335966 INFO: Competetive: True
2:55:17.340611 WARNING: dropped 1 target PSMs due to missing features
2:55:17.369308 INFO: Test AUC: 0.507
2:55:17.369405 INFO: Train AUC: 0.529
2:55:17.369447 INFO: AUC difference: 4.13%
2:55:17.492293 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
2:55:17.493094 PROGRESS: ============================= Precursor FDR =============================
2:55:17.493214 PROGRESS: Total precursors accumulated: 9
2:55:17.493293 PROGRESS: Target precursors: 9 (100.00%)
2:55:17.493362 PROGRESS: Decoy precursors: 0 (0.00%)
2:55:17.493426 PROGRESS: 
2:55:17.493488 PROGRESS: Precursor Summary:
2:55:17.495009 PROGRESS: Channel   0:	 0.05 FDR:     9; 0.01 FDR:     9; 0.001 FDR:     9
2:55:17.495123 PROGRESS: 
2:55:17.495198 PROGRESS: Protein Summary:
2:55:17.496890 PROGRESS: Channel   0:	 0.05 FDR:     9; 0.01 FDR:     9; 0.001 FDR:     9
2:55:17.497017 PROGRESS: =========================================================================
2:55:17.497918 PROGRESS: === Epoch 8, step 1, extracting elution groups 1000 to 3000 ===
2:55:17.575033 PROGRESS: Extracting batch of 3950 precursors
2:55:17.577466 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:55:17.577535 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:55:17.577585 INFO: FWHM in RT is 14.26 seconds, sigma is 0.52
2:55:17.577645 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:55:17.577945 INFO: Starting candidate selection
2:55:21.560366 INFO: Starting candidate scoring
2:55:22.913803 INFO: Finished candidate processing
2:55:22.913989 INFO: Collecting candidate features
2:55:25.115805 WARNING: intensity_correlation has 4 NaNs ( 0.11 % out of 3695)
2:55:25.121861 INFO: Collecting fragment features
2:55:25.771076 INFO: Finished candidate scoring
2:55:26.053519 PROGRESS: === Epoch 8, step 1, extracted 3695 precursors and 17906 fragments ===
2:55:26.053821 INFO: performing precursor FDR with 47 features
2:55:26.053873 INFO: Decoy channel: -1
2:55:26.053900 INFO: Competetive: True
2:55:26.062581 WARNING: dropped 4 target PSMs due to missing features
2:55:26.062689 WARNING: dropped 1 decoy PSMs due to missing features
2:55:26.100199 INFO: Test AUC: 0.505
2:55:26.100312 INFO: Train AUC: 0.532
2:55:26.100358 INFO: AUC difference: 4.96%
2:55:26.221554 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
2:55:26.222353 PROGRESS: ============================= Precursor FDR =============================
2:55:26.222481 PROGRESS: Total precursors accumulated: 26
2:55:26.222559 PROGRESS: Target precursors: 24 (92.31%)
2:55:26.222628 PROGRESS: Decoy precursors: 2 (7.69%)
2:55:26.222692 PROGRESS: 
2:55:26.222753 PROGRESS: Precursor Summary:
2:55:26.224181 PROGRESS: Channel   0:	 0.05 FDR:    18; 0.01 FDR:    18; 0.001 FDR:    18
2:55:26.224295 PROGRESS: 
2:55:26.224369 PROGRESS: Protein Summary:
2:55:26.225996 PROGRESS: Channel   0:	 0.05 FDR:    18; 0.01 FDR:    18; 0.001 FDR:    18
2:55:26.226112 PROGRESS: =========================================================================
2:55:26.226974 PROGRESS: === Epoch 8, step 2, extracting elution groups 3000 to 7000 ===
2:55:26.308703 PROGRESS: Extracting batch of 7904 precursors
2:55:26.312121 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:55:26.312187 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:55:26.312225 INFO: FWHM in RT is 14.26 seconds, sigma is 0.52
2:55:26.312270 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:55:26.312491 INFO: Starting candidate selection
2:55:30.324362 INFO: Starting candidate scoring
2:55:31.668443 INFO: Finished candidate processing
2:55:31.668545 INFO: Collecting candidate features
2:55:33.845186 WARNING: intensity_correlation has 5 NaNs ( 0.07 % out of 7377)
2:55:33.852422 INFO: Collecting fragment features
2:55:34.497377 INFO: Finished candidate scoring
2:55:34.783145 PROGRESS: === Epoch 8, step 2, extracted 7377 precursors and 35470 fragments ===
2:55:34.783476 INFO: performing precursor FDR with 47 features
2:55:34.783521 INFO: Decoy channel: -1
2:55:34.783548 INFO: Competetive: True
2:55:34.798559 WARNING: dropped 5 target PSMs due to missing features
2:55:34.798666 WARNING: dropped 5 decoy PSMs due to missing features
2:55:35.023142 INFO: Test AUC: 0.528
2:55:35.023278 INFO: Train AUC: 0.575
2:55:35.023322 INFO: AUC difference: 8.10%
2:55:35.023358 WARNING: AUC difference > 5%. This may indicate overfitting.
2:55:35.146225 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
2:55:35.147083 PROGRESS: ============================= Precursor FDR =============================
2:55:35.147206 PROGRESS: Total precursors accumulated: 132
2:55:35.147297 PROGRESS: Target precursors: 120 (90.91%)
2:55:35.147367 PROGRESS: Decoy precursors: 12 (9.09%)
2:55:35.147430 PROGRESS: 
2:55:35.147491 PROGRESS: Precursor Summary:
2:55:35.148957 PROGRESS: Channel   0:	 0.05 FDR:    67; 0.01 FDR:    53; 0.001 FDR:    53
2:55:35.149088 PROGRESS: 
2:55:35.149163 PROGRESS: Protein Summary:
2:55:35.150853 PROGRESS: Channel   0:	 0.05 FDR:    67; 0.01 FDR:    53; 0.001 FDR:    53
2:55:35.150967 PROGRESS: =========================================================================
2:55:35.151856 PROGRESS: === Epoch 8, step 3, extracting elution groups 7000 to 15000 ===
2:55:35.243804 PROGRESS: Extracting batch of 15812 precursors
2:55:35.249411 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:55:35.249481 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:55:35.249516 INFO: FWHM in RT is 14.26 seconds, sigma is 0.52
2:55:35.249559 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:55:35.249788 INFO: Starting candidate selection
2:55:39.449780 INFO: Starting candidate scoring
2:55:40.887354 INFO: Finished candidate processing
2:55:40.887446 INFO: Collecting candidate features
2:55:43.087912 WARNING: intensity_correlation has 18 NaNs ( 0.12 % out of 14842)
2:55:43.093882 INFO: Collecting fragment features
2:55:43.750288 INFO: Finished candidate scoring
2:55:44.044763 PROGRESS: === Epoch 8, step 3, extracted 14842 precursors and 71606 fragments ===
2:55:44.045094 INFO: performing precursor FDR with 47 features
2:55:44.045142 INFO: Decoy channel: -1
2:55:44.045169 INFO: Competetive: True
2:55:44.074077 WARNING: dropped 18 target PSMs due to missing features
2:55:44.074192 WARNING: dropped 10 decoy PSMs due to missing features
2:55:44.806075 INFO: Test AUC: 0.542
2:55:44.807093 INFO: Train AUC: 0.597
2:55:44.807147 INFO: AUC difference: 9.33%
2:55:44.807177 WARNING: AUC difference > 5%. This may indicate overfitting.
2:55:44.930454 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
2:55:44.931416 PROGRESS: ============================= Precursor FDR =============================
2:55:44.931542 PROGRESS: Total precursors accumulated: 304
2:55:44.931620 PROGRESS: Target precursors: 278 (91.45%)
2:55:44.931688 PROGRESS: Decoy precursors: 26 (8.55%)
2:55:44.931751 PROGRESS: 
2:55:44.931812 PROGRESS: Precursor Summary:
2:55:44.933371 PROGRESS: Channel   0:	 0.05 FDR:   214; 0.01 FDR:   137; 0.001 FDR:   110
2:55:44.933511 PROGRESS: 
2:55:44.933587 PROGRESS: Protein Summary:
2:55:44.935412 PROGRESS: Channel   0:	 0.05 FDR:   213; 0.01 FDR:   137; 0.001 FDR:   110
2:55:44.935541 PROGRESS: =========================================================================
2:55:44.936481 PROGRESS: === Epoch 8, step 4, extracting elution groups 15000 to 31000 ===
2:55:45.044244 PROGRESS: Extracting batch of 31598 precursors
2:55:45.055070 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:55:45.055171 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:55:45.055210 INFO: FWHM in RT is 14.26 seconds, sigma is 0.52
2:55:45.055237 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:55:45.055511 INFO: Starting candidate selection
2:55:49.557025 INFO: Starting candidate scoring
2:55:51.111234 INFO: Finished candidate processing
2:55:51.111335 INFO: Collecting candidate features
2:55:53.381427 WARNING: intensity_correlation has 37 NaNs ( 0.13 % out of 29538)
2:55:53.388554 INFO: Collecting fragment features
2:55:54.073960 INFO: Finished candidate scoring
2:55:54.389698 PROGRESS: === Epoch 8, step 4, extracted 29538 precursors and 142099 fragments ===
2:55:54.390058 INFO: performing precursor FDR with 47 features
2:55:54.390106 INFO: Decoy channel: -1
2:55:54.390132 INFO: Competetive: True
2:55:54.449439 WARNING: dropped 40 target PSMs due to missing features
2:55:54.449551 WARNING: dropped 25 decoy PSMs due to missing features
2:55:56.500890 INFO: Test AUC: 0.541
2:55:56.501042 INFO: Train AUC: 0.607
2:55:56.501089 INFO: AUC difference: 10.91%
2:55:56.501125 WARNING: AUC difference > 5%. This may indicate overfitting.
2:55:56.626585 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
2:55:56.627744 PROGRESS: ============================= Precursor FDR =============================
2:55:56.627873 PROGRESS: Total precursors accumulated: 800
2:55:56.627952 PROGRESS: Target precursors: 730 (91.25%)
2:55:56.628019 PROGRESS: Decoy precursors: 70 (8.75%)
2:55:56.628081 PROGRESS: 
2:55:56.628141 PROGRESS: Precursor Summary:
2:55:56.629844 PROGRESS: Channel   0:	 0.05 FDR:   411; 0.01 FDR:   232; 0.001 FDR:   195
2:55:56.629964 PROGRESS: 
2:55:56.630039 PROGRESS: Protein Summary:
2:55:56.632012 PROGRESS: Channel   0:	 0.05 FDR:   399; 0.01 FDR:   224; 0.001 FDR:   188
2:55:56.632127 PROGRESS: =========================================================================
2:55:56.633125 PROGRESS: === Epoch 8, step 5, extracting elution groups 31000 to 63000 ===
2:55:56.772441 PROGRESS: Extracting batch of 63264 precursors
2:55:56.793479 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:55:56.793590 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:55:56.793627 INFO: FWHM in RT is 14.26 seconds, sigma is 0.52
2:55:56.793670 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:55:56.793942 INFO: Starting candidate selection
2:56:01.950676 INFO: Starting candidate scoring
2:56:03.827935 INFO: Finished candidate processing
2:56:03.828115 INFO: Collecting candidate features
2:56:06.173174 WARNING: intensity_correlation has 65 NaNs ( 0.11 % out of 58994)
2:56:06.181995 INFO: Collecting fragment features
2:56:06.889069 INFO: Finished candidate scoring
2:56:07.236643 PROGRESS: === Epoch 8, step 5, extracted 58994 precursors and 284009 fragments ===
2:56:07.237017 INFO: performing precursor FDR with 47 features
2:56:07.237091 INFO: Decoy channel: -1
2:56:07.237123 INFO: Competetive: True
2:56:07.366956 WARNING: dropped 75 target PSMs due to missing features
2:56:07.367070 WARNING: dropped 55 decoy PSMs due to missing features
2:56:11.248253 INFO: Test AUC: 0.553
2:56:11.248365 INFO: Train AUC: 0.599
2:56:11.248421 INFO: AUC difference: 7.70%
2:56:11.248449 WARNING: AUC difference > 5%. This may indicate overfitting.
2:56:11.385198 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
2:56:11.386589 PROGRESS: ============================= Precursor FDR =============================
2:56:11.386721 PROGRESS: Total precursors accumulated: 1,413
2:56:11.386799 PROGRESS: Target precursors: 1,289 (91.22%)
2:56:11.386867 PROGRESS: Decoy precursors: 124 (8.78%)
2:56:11.386930 PROGRESS: 
2:56:11.386991 PROGRESS: Precursor Summary:
2:56:11.388871 PROGRESS: Channel   0:	 0.05 FDR:   780; 0.01 FDR:   413; 0.001 FDR:   335
2:56:11.389007 PROGRESS: 
2:56:11.389084 PROGRESS: Protein Summary:
2:56:11.391369 PROGRESS: Channel   0:	 0.05 FDR:   736; 0.01 FDR:   390; 0.001 FDR:   319
2:56:11.391500 PROGRESS: =========================================================================
2:56:11.392617 PROGRESS: === Epoch 8, step 6, extracting elution groups 63000 to 127000 ===
2:56:11.570436 PROGRESS: Extracting batch of 126473 precursors
2:56:11.609158 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:56:11.609272 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:56:11.609309 INFO: FWHM in RT is 14.26 seconds, sigma is 0.52
2:56:11.609351 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:56:11.609608 INFO: Starting candidate selection
2:56:18.027477 INFO: Starting candidate scoring
2:56:20.523391 INFO: Finished candidate processing
2:56:20.523572 INFO: Collecting candidate features
2:56:23.045968 WARNING: intensity_correlation has 133 NaNs ( 0.11 % out of 118365)
2:56:23.058695 INFO: Collecting fragment features
2:56:23.821584 INFO: Finished candidate scoring
2:56:24.246400 PROGRESS: === Epoch 8, step 6, extracted 118365 precursors and 569434 fragments ===
2:56:24.246766 INFO: performing precursor FDR with 47 features
2:56:24.246813 INFO: Decoy channel: -1
2:56:24.246840 INFO: Competetive: True
2:56:24.517038 WARNING: dropped 153 target PSMs due to missing features
2:56:24.517155 WARNING: dropped 110 decoy PSMs due to missing features
2:56:32.789882 INFO: Test AUC: 0.548
2:56:32.790028 INFO: Train AUC: 0.588
2:56:32.790069 INFO: AUC difference: 6.79%
2:56:32.790097 WARNING: AUC difference > 5%. This may indicate overfitting.
2:56:32.945268 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
2:56:32.946982 PROGRESS: ============================= Precursor FDR =============================
2:56:32.947118 PROGRESS: Total precursors accumulated: 2,498
2:56:32.947208 PROGRESS: Target precursors: 2,275 (91.07%)
2:56:32.947279 PROGRESS: Decoy precursors: 223 (8.93%)
2:56:32.947342 PROGRESS: 
2:56:32.947404 PROGRESS: Precursor Summary:
2:56:32.949546 PROGRESS: Channel   0:	 0.05 FDR: 1,513; 0.01 FDR:   849; 0.001 FDR:   459
2:56:32.949682 PROGRESS: 
2:56:32.949756 PROGRESS: Protein Summary:
2:56:32.952501 PROGRESS: Channel   0:	 0.05 FDR: 1,339; 0.01 FDR:   744; 0.001 FDR:   424
2:56:32.952614 PROGRESS: =========================================================================
2:56:32.953988 PROGRESS: === Epoch 8, step 7, extracting elution groups 127000 to 255000 ===
2:56:33.179726 PROGRESS: Extracting batch of 253082 precursors
2:56:33.253119 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:56:33.253235 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:56:33.253273 INFO: FWHM in RT is 14.26 seconds, sigma is 0.52
2:56:33.253316 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:56:33.253581 INFO: Starting candidate selection
2:56:42.275010 INFO: Starting candidate scoring
2:56:46.002623 INFO: Finished candidate processing
2:56:46.002810 INFO: Collecting candidate features
2:56:48.939318 WARNING: intensity_correlation has 269 NaNs ( 0.11 % out of 236465)
2:56:48.940014 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 236465)
2:56:48.959651 INFO: Collecting fragment features
2:56:49.829970 INFO: Finished candidate scoring
2:56:50.410068 PROGRESS: === Epoch 8, step 7, extracted 236465 precursors and 1136519 fragments ===
2:56:50.410427 INFO: performing precursor FDR with 47 features
2:56:50.410477 INFO: Decoy channel: -1
2:56:50.410504 INFO: Competetive: True
2:56:51.002840 WARNING: dropped 292 target PSMs due to missing features
2:56:51.002965 WARNING: dropped 240 decoy PSMs due to missing features
2:57:08.314748 INFO: Test AUC: 0.545
2:57:08.314905 INFO: Train AUC: 0.573
2:57:08.314960 INFO: AUC difference: 4.83%
2:57:08.497939 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
2:57:08.500122 PROGRESS: ============================= Precursor FDR =============================
2:57:08.500278 PROGRESS: Total precursors accumulated: 3,996
2:57:08.500359 PROGRESS: Target precursors: 3,640 (91.09%)
2:57:08.500428 PROGRESS: Decoy precursors: 356 (8.91%)
2:57:08.500492 PROGRESS: 
2:57:08.500558 PROGRESS: Precursor Summary:
2:57:08.503378 PROGRESS: Channel   0:	 0.05 FDR: 2,701; 0.01 FDR: 1,739; 0.001 FDR: 1,340
2:57:08.503524 PROGRESS: 
2:57:08.503608 PROGRESS: Protein Summary:
2:57:08.507399 PROGRESS: Channel   0:	 0.05 FDR: 2,217; 0.01 FDR: 1,391; 0.001 FDR: 1,098
2:57:08.507510 PROGRESS: =========================================================================
2:57:08.509363 PROGRESS: === Epoch 8, step 8, extracting elution groups 255000 to 511000 ===
2:57:08.817111 PROGRESS: Extracting batch of 505770 precursors
2:57:08.951626 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:57:08.951744 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:57:08.951800 INFO: FWHM in RT is 14.26 seconds, sigma is 0.52
2:57:08.951828 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:57:08.952096 INFO: Starting candidate selection
2:57:23.007140 INFO: Starting candidate scoring
2:57:29.111429 INFO: Finished candidate processing
2:57:29.111526 INFO: Collecting candidate features
2:57:32.736429 WARNING: intensity_correlation has 543 NaNs ( 0.11 % out of 472839)
2:57:32.737495 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 472839)
2:57:32.770936 INFO: Collecting fragment features
2:57:33.819993 INFO: Finished candidate scoring
2:57:34.697528 PROGRESS: === Epoch 8, step 8, extracted 472839 precursors and 2271392 fragments ===
2:57:34.697903 INFO: performing precursor FDR with 47 features
2:57:34.697954 INFO: Decoy channel: -1
2:57:34.697981 INFO: Competetive: True
2:57:35.841975 WARNING: dropped 572 target PSMs due to missing features
2:57:35.842104 WARNING: dropped 503 decoy PSMs due to missing features
2:58:11.298798 INFO: Test AUC: 0.546
2:58:11.298974 INFO: Train AUC: 0.565
2:58:11.299023 INFO: AUC difference: 3.44%
2:58:11.543568 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
2:58:11.546412 PROGRESS: ============================= Precursor FDR =============================
2:58:11.546559 PROGRESS: Total precursors accumulated: 6,461
2:58:11.546654 PROGRESS: Target precursors: 5,888 (91.13%)
2:58:11.546722 PROGRESS: Decoy precursors: 573 (8.87%)
2:58:11.546786 PROGRESS: 
2:58:11.546847 PROGRESS: Precursor Summary:
2:58:11.550479 PROGRESS: Channel   0:	 0.05 FDR: 4,699; 0.01 FDR: 3,443; 0.001 FDR: 2,356
2:58:11.550614 PROGRESS: 
2:58:11.550687 PROGRESS: Protein Summary:
2:58:11.555963 PROGRESS: Channel   0:	 0.05 FDR: 3,266; 0.01 FDR: 2,377; 0.001 FDR: 1,700
2:58:11.556080 PROGRESS: =========================================================================
2:58:11.560508 INFO: calibration group: precursor, fitting rt estimator 
2:58:11.960007 INFO: calibration group: fragment, fitting mz estimator 
2:58:12.544691 INFO: === checking if epoch conditions were reached ===
2:58:12.544879 INFO: ✅ ms2_error      : 7.0000 <= 7
2:58:12.544967 INFO: ❌ rt_error       : 201.2681 > 100
2:58:12.545041 INFO: ✅ current_epoch  : 8 >= 3
2:58:12.545106 INFO: ==============================================
2:58:12.790054 INFO: calibration group: precursor, predicting mz
2:58:12.790332 WARNING: mz prediction was skipped as it has not been fitted yet
2:58:12.790371 INFO: calibration group: precursor, predicting rt
2:58:19.623366 INFO: calibration group: fragment, predicting mz
2:58:37.803831 PROGRESS: === Epoch 9, step 0, extracting elution groups 0 to 1000 ===
2:58:37.902333 PROGRESS: Extracting batch of 1977 precursors
2:58:37.904032 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:58:37.904125 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:58:37.904183 INFO: FWHM in RT is 14.40 seconds, sigma is 0.52
2:58:37.904213 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:58:37.904444 INFO: Starting candidate selection
2:58:42.197361 INFO: Starting candidate scoring
2:58:43.484483 INFO: Finished candidate processing
2:58:43.484570 INFO: Collecting candidate features
2:58:45.638129 WARNING: intensity_correlation has 2 NaNs ( 0.11 % out of 1859)
2:58:45.643940 INFO: Collecting fragment features
2:58:46.278630 INFO: Finished candidate scoring
2:58:46.602223 PROGRESS: === Epoch 9, step 0, extracted 1859 precursors and 9047 fragments ===
2:58:46.602535 INFO: performing precursor FDR with 47 features
2:58:46.602577 INFO: Decoy channel: -1
2:58:46.602613 INFO: Competetive: True
2:58:46.607148 WARNING: dropped 2 decoy PSMs due to missing features
2:58:46.634869 INFO: Test AUC: 0.525
2:58:46.634963 INFO: Train AUC: 0.551
2:58:46.635007 INFO: AUC difference: 4.69%
2:58:49.539232 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
2:58:49.540121 PROGRESS: ============================= Precursor FDR =============================
2:58:49.540248 PROGRESS: Total precursors accumulated: 6
2:58:49.540327 PROGRESS: Target precursors: 6 (100.00%)
2:58:49.540397 PROGRESS: Decoy precursors: 0 (0.00%)
2:58:49.540461 PROGRESS: 
2:58:49.540523 PROGRESS: Precursor Summary:
2:58:49.542031 PROGRESS: Channel   0:	 0.05 FDR:     6; 0.01 FDR:     6; 0.001 FDR:     6
2:58:49.542144 PROGRESS: 
2:58:49.542217 PROGRESS: Protein Summary:
2:58:49.543911 PROGRESS: Channel   0:	 0.05 FDR:     6; 0.01 FDR:     6; 0.001 FDR:     6
2:58:49.544021 PROGRESS: =========================================================================
2:58:49.544903 PROGRESS: === Epoch 9, step 1, extracting elution groups 1000 to 3000 ===
2:58:49.623886 PROGRESS: Extracting batch of 3948 precursors
2:58:49.626266 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:58:49.626332 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:58:49.626374 INFO: FWHM in RT is 14.40 seconds, sigma is 0.52
2:58:49.626405 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:58:49.626650 INFO: Starting candidate selection
2:58:53.642440 INFO: Starting candidate scoring
2:58:54.984685 INFO: Finished candidate processing
2:58:54.984824 INFO: Collecting candidate features
2:58:57.188675 WARNING: intensity_correlation has 3 NaNs ( 0.08 % out of 3682)
2:58:57.194756 INFO: Collecting fragment features
2:58:57.855049 INFO: Finished candidate scoring
2:58:58.141320 PROGRESS: === Epoch 9, step 1, extracted 3682 precursors and 17597 fragments ===
2:58:58.141663 INFO: performing precursor FDR with 47 features
2:58:58.141711 INFO: Decoy channel: -1
2:58:58.141737 INFO: Competetive: True
2:58:58.150661 WARNING: dropped 1 target PSMs due to missing features
2:58:58.150753 WARNING: dropped 4 decoy PSMs due to missing features
2:58:58.188798 INFO: Test AUC: 0.540
2:58:58.188920 INFO: Train AUC: 0.542
2:58:58.188966 INFO: AUC difference: 0.44%
2:58:58.310328 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
2:58:58.311124 PROGRESS: ============================= Precursor FDR =============================
2:58:58.311248 PROGRESS: Total precursors accumulated: 28
2:58:58.311325 PROGRESS: Target precursors: 26 (92.86%)
2:58:58.311394 PROGRESS: Decoy precursors: 2 (7.14%)
2:58:58.311456 PROGRESS: 
2:58:58.311517 PROGRESS: Precursor Summary:
2:58:58.312930 PROGRESS: Channel   0:	 0.05 FDR:    22; 0.01 FDR:    16; 0.001 FDR:    16
2:58:58.313063 PROGRESS: 
2:58:58.313148 PROGRESS: Protein Summary:
2:58:58.314781 PROGRESS: Channel   0:	 0.05 FDR:    22; 0.01 FDR:    16; 0.001 FDR:    16
2:58:58.314921 PROGRESS: =========================================================================
2:58:58.315796 PROGRESS: === Epoch 9, step 2, extracting elution groups 3000 to 7000 ===
2:58:58.398385 PROGRESS: Extracting batch of 7906 precursors
2:58:58.401871 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:58:58.401955 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:58:58.401997 INFO: FWHM in RT is 14.40 seconds, sigma is 0.52
2:58:58.402028 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:58:58.402252 INFO: Starting candidate selection
2:59:02.490749 INFO: Starting candidate scoring
2:59:03.862839 INFO: Finished candidate processing
2:59:03.862931 INFO: Collecting candidate features
2:59:06.041437 WARNING: intensity_correlation has 11 NaNs ( 0.15 % out of 7364)
2:59:06.047193 INFO: Collecting fragment features
2:59:06.698569 INFO: Finished candidate scoring
2:59:06.986583 PROGRESS: === Epoch 9, step 2, extracted 7364 precursors and 35673 fragments ===
2:59:06.986942 INFO: performing precursor FDR with 47 features
2:59:06.986994 INFO: Decoy channel: -1
2:59:06.987021 INFO: Competetive: True
2:59:07.002506 WARNING: dropped 5 target PSMs due to missing features
2:59:07.002622 WARNING: dropped 11 decoy PSMs due to missing features
2:59:07.337860 INFO: Test AUC: 0.523
2:59:07.338109 INFO: Train AUC: 0.572
2:59:07.338213 INFO: AUC difference: 8.43%
2:59:07.338306 WARNING: AUC difference > 5%. This may indicate overfitting.
2:59:07.461006 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
2:59:07.461901 PROGRESS: ============================= Precursor FDR =============================
2:59:07.462018 PROGRESS: Total precursors accumulated: 68
2:59:07.462095 PROGRESS: Target precursors: 62 (91.18%)
2:59:07.462162 PROGRESS: Decoy precursors: 6 (8.82%)
2:59:07.462224 PROGRESS: 
2:59:07.462284 PROGRESS: Precursor Summary:
2:59:07.463741 PROGRESS: Channel   0:	 0.05 FDR:    51; 0.01 FDR:    48; 0.001 FDR:    48
2:59:07.463872 PROGRESS: 
2:59:07.463945 PROGRESS: Protein Summary:
2:59:07.465598 PROGRESS: Channel   0:	 0.05 FDR:    51; 0.01 FDR:    48; 0.001 FDR:    48
2:59:07.465708 PROGRESS: =========================================================================
2:59:07.466594 PROGRESS: === Epoch 9, step 3, extracting elution groups 7000 to 15000 ===
2:59:07.558212 PROGRESS: Extracting batch of 15798 precursors
2:59:07.570928 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:59:07.571022 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:59:07.571061 INFO: FWHM in RT is 14.40 seconds, sigma is 0.52
2:59:07.571088 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:59:07.571315 INFO: Starting candidate selection
2:59:11.787531 INFO: Starting candidate scoring
2:59:13.234099 INFO: Finished candidate processing
2:59:13.234282 INFO: Collecting candidate features
2:59:15.476461 WARNING: intensity_correlation has 22 NaNs ( 0.15 % out of 14749)
2:59:15.482467 INFO: Collecting fragment features
2:59:16.128381 INFO: Finished candidate scoring
2:59:16.428560 PROGRESS: === Epoch 9, step 3, extracted 14749 precursors and 70792 fragments ===
2:59:16.428903 INFO: performing precursor FDR with 47 features
2:59:16.428951 INFO: Decoy channel: -1
2:59:16.428977 INFO: Competetive: True
2:59:16.458773 WARNING: dropped 20 target PSMs due to missing features
2:59:16.458909 WARNING: dropped 18 decoy PSMs due to missing features
2:59:17.222742 INFO: Test AUC: 0.541
2:59:17.222888 INFO: Train AUC: 0.595
2:59:17.222950 INFO: AUC difference: 9.03%
2:59:17.222985 WARNING: AUC difference > 5%. This may indicate overfitting.
2:59:17.349350 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
2:59:17.350313 PROGRESS: ============================= Precursor FDR =============================
2:59:17.350435 PROGRESS: Total precursors accumulated: 202
2:59:17.350513 PROGRESS: Target precursors: 184 (91.09%)
2:59:17.350581 PROGRESS: Decoy precursors: 18 (8.91%)
2:59:17.350655 PROGRESS: 
2:59:17.350717 PROGRESS: Precursor Summary:
2:59:17.352264 PROGRESS: Channel   0:	 0.05 FDR:   128; 0.01 FDR:   115; 0.001 FDR:   100
2:59:17.352396 PROGRESS: 
2:59:17.352469 PROGRESS: Protein Summary:
2:59:17.354226 PROGRESS: Channel   0:	 0.05 FDR:   128; 0.01 FDR:   115; 0.001 FDR:   100
2:59:17.354337 PROGRESS: =========================================================================
2:59:17.355257 PROGRESS: === Epoch 9, step 4, extracting elution groups 15000 to 31000 ===
2:59:17.464365 PROGRESS: Extracting batch of 31611 precursors
2:59:17.475410 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:59:17.475508 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:59:17.475562 INFO: FWHM in RT is 14.40 seconds, sigma is 0.52
2:59:17.475590 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:59:17.475839 INFO: Starting candidate selection
2:59:22.005461 INFO: Starting candidate scoring
2:59:23.594038 INFO: Finished candidate processing
2:59:23.594223 INFO: Collecting candidate features
2:59:25.846852 WARNING: intensity_correlation has 38 NaNs ( 0.13 % out of 29535)
2:59:25.853827 INFO: Collecting fragment features
2:59:26.509248 INFO: Finished candidate scoring
2:59:26.826115 PROGRESS: === Epoch 9, step 4, extracted 29535 precursors and 142437 fragments ===
2:59:26.826460 INFO: performing precursor FDR with 47 features
2:59:26.826506 INFO: Decoy channel: -1
2:59:26.826532 INFO: Competetive: True
2:59:26.885312 WARNING: dropped 39 target PSMs due to missing features
2:59:26.885424 WARNING: dropped 37 decoy PSMs due to missing features
2:59:28.841233 INFO: Test AUC: 0.552
2:59:28.841400 INFO: Train AUC: 0.604
2:59:28.841473 INFO: AUC difference: 8.68%
2:59:28.841532 WARNING: AUC difference > 5%. This may indicate overfitting.
2:59:28.969045 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
2:59:28.970370 PROGRESS: ============================= Precursor FDR =============================
2:59:28.970511 PROGRESS: Total precursors accumulated: 996
2:59:28.970607 PROGRESS: Target precursors: 911 (91.47%)
2:59:28.970680 PROGRESS: Decoy precursors: 85 (8.53%)
2:59:28.970745 PROGRESS: 
2:59:28.970806 PROGRESS: Precursor Summary:
2:59:28.972566 PROGRESS: Channel   0:	 0.05 FDR:   498; 0.01 FDR:   239; 0.001 FDR:   213
2:59:28.972707 PROGRESS: 
2:59:28.972781 PROGRESS: Protein Summary:
2:59:28.974847 PROGRESS: Channel   0:	 0.05 FDR:   483; 0.01 FDR:   235; 0.001 FDR:   209
2:59:28.975000 PROGRESS: =========================================================================
2:59:28.976028 PROGRESS: === Epoch 9, step 5, extracting elution groups 31000 to 63000 ===
2:59:29.112563 PROGRESS: Extracting batch of 63269 precursors
2:59:29.132843 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:59:29.132954 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:59:29.132989 INFO: FWHM in RT is 14.40 seconds, sigma is 0.52
2:59:29.133033 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:59:29.133291 INFO: Starting candidate selection
2:59:34.268348 INFO: Starting candidate scoring
2:59:36.140513 INFO: Finished candidate processing
2:59:36.140614 INFO: Collecting candidate features
2:59:38.488119 WARNING: intensity_correlation has 86 NaNs ( 0.15 % out of 58999)
2:59:38.497374 INFO: Collecting fragment features
2:59:39.185342 INFO: Finished candidate scoring
2:59:39.536200 PROGRESS: === Epoch 9, step 5, extracted 58999 precursors and 284784 fragments ===
2:59:39.536576 INFO: performing precursor FDR with 47 features
2:59:39.536622 INFO: Decoy channel: -1
2:59:39.536648 INFO: Competetive: True
2:59:39.668597 WARNING: dropped 78 target PSMs due to missing features
2:59:39.668711 WARNING: dropped 84 decoy PSMs due to missing features
2:59:43.523812 INFO: Test AUC: 0.554
2:59:43.523923 INFO: Train AUC: 0.598
2:59:43.523984 INFO: AUC difference: 7.26%
2:59:43.524014 WARNING: AUC difference > 5%. This may indicate overfitting.
2:59:43.663769 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
2:59:43.665242 PROGRESS: ============================= Precursor FDR =============================
2:59:43.665388 PROGRESS: Total precursors accumulated: 1,381
2:59:43.665469 PROGRESS: Target precursors: 1,259 (91.17%)
2:59:43.665539 PROGRESS: Decoy precursors: 122 (8.83%)
2:59:43.665623 PROGRESS: 
2:59:43.665718 PROGRESS: Precursor Summary:
2:59:43.667784 PROGRESS: Channel   0:	 0.05 FDR:   772; 0.01 FDR:   507; 0.001 FDR:   346
2:59:43.667927 PROGRESS: 
2:59:43.668002 PROGRESS: Protein Summary:
2:59:43.670431 PROGRESS: Channel   0:	 0.05 FDR:   741; 0.01 FDR:   481; 0.001 FDR:   328
2:59:43.670552 PROGRESS: =========================================================================
2:59:43.671790 PROGRESS: === Epoch 9, step 6, extracting elution groups 63000 to 127000 ===
2:59:43.847086 PROGRESS: Extracting batch of 126447 precursors
2:59:43.886107 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
2:59:43.886239 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
2:59:43.886281 INFO: FWHM in RT is 14.40 seconds, sigma is 0.52
2:59:43.886308 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
2:59:43.886638 INFO: Starting candidate selection
2:59:50.283055 INFO: Starting candidate scoring
2:59:52.745000 INFO: Finished candidate processing
2:59:52.745108 INFO: Collecting candidate features
2:59:55.303502 WARNING: intensity_correlation has 134 NaNs ( 0.11 % out of 118018)
2:59:55.316438 INFO: Collecting fragment features
2:59:56.070602 INFO: Finished candidate scoring
2:59:56.501979 PROGRESS: === Epoch 9, step 6, extracted 118018 precursors and 568541 fragments ===
2:59:56.502353 INFO: performing precursor FDR with 47 features
2:59:56.502402 INFO: Decoy channel: -1
2:59:56.502432 INFO: Competetive: True
2:59:56.777341 WARNING: dropped 141 target PSMs due to missing features
2:59:56.777461 WARNING: dropped 155 decoy PSMs due to missing features
3:00:05.362190 INFO: Test AUC: 0.554
3:00:05.362316 INFO: Train AUC: 0.587
3:00:05.362374 INFO: AUC difference: 5.64%
3:00:05.362404 WARNING: AUC difference > 5%. This may indicate overfitting.
3:00:05.516281 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
3:00:05.518113 PROGRESS: ============================= Precursor FDR =============================
3:00:05.518255 PROGRESS: Total precursors accumulated: 2,531
3:00:05.518335 PROGRESS: Target precursors: 2,304 (91.03%)
3:00:05.518403 PROGRESS: Decoy precursors: 227 (8.97%)
3:00:05.518465 PROGRESS: 
3:00:05.518526 PROGRESS: Precursor Summary:
3:00:05.520859 PROGRESS: Channel   0:	 0.05 FDR: 1,594; 0.01 FDR:   966; 0.001 FDR:   616
3:00:05.521008 PROGRESS: 
3:00:05.521084 PROGRESS: Protein Summary:
3:00:05.524028 PROGRESS: Channel   0:	 0.05 FDR: 1,431; 0.01 FDR:   852; 0.001 FDR:   558
3:00:05.524162 PROGRESS: =========================================================================
3:00:05.525632 PROGRESS: === Epoch 9, step 7, extracting elution groups 127000 to 255000 ===
3:00:05.749504 PROGRESS: Extracting batch of 252872 precursors
3:00:05.821565 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:00:05.821683 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:00:05.821738 INFO: FWHM in RT is 14.40 seconds, sigma is 0.52
3:00:05.821766 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:00:05.822039 INFO: Starting candidate selection
3:00:14.807578 INFO: Starting candidate scoring
3:00:18.556326 INFO: Finished candidate processing
3:00:18.556517 INFO: Collecting candidate features
3:00:21.514725 WARNING: intensity_correlation has 316 NaNs ( 0.13 % out of 236070)
3:00:21.535079 INFO: Collecting fragment features
3:00:22.387881 INFO: Finished candidate scoring
3:00:22.969684 PROGRESS: === Epoch 9, step 7, extracted 236070 precursors and 1135781 fragments ===
3:00:22.970052 INFO: performing precursor FDR with 47 features
3:00:22.970097 INFO: Decoy channel: -1
3:00:22.970123 INFO: Competetive: True
3:00:23.560090 WARNING: dropped 306 target PSMs due to missing features
3:00:23.560214 WARNING: dropped 306 decoy PSMs due to missing features
3:00:41.188605 INFO: Test AUC: 0.551
3:00:41.188751 INFO: Train AUC: 0.573
3:00:41.188792 INFO: AUC difference: 3.87%
3:00:41.373912 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
3:00:41.376224 PROGRESS: ============================= Precursor FDR =============================
3:00:41.376390 PROGRESS: Total precursors accumulated: 3,972
3:00:41.376472 PROGRESS: Target precursors: 3,617 (91.06%)
3:00:41.376540 PROGRESS: Decoy precursors: 355 (8.94%)
3:00:41.376604 PROGRESS: 
3:00:41.376680 PROGRESS: Precursor Summary:
3:00:41.379642 PROGRESS: Channel   0:	 0.05 FDR: 2,471; 0.01 FDR: 1,760; 0.001 FDR: 1,479
3:00:41.379793 PROGRESS: 
3:00:41.379867 PROGRESS: Protein Summary:
3:00:41.383662 PROGRESS: Channel   0:	 0.05 FDR: 2,033; 0.01 FDR: 1,433; 0.001 FDR: 1,216
3:00:41.383802 PROGRESS: =========================================================================
3:00:41.385719 PROGRESS: === Epoch 9, step 8, extracting elution groups 255000 to 511000 ===
3:00:41.692865 PROGRESS: Extracting batch of 506017 precursors
3:00:41.826650 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:00:41.826803 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:00:41.826847 INFO: FWHM in RT is 14.40 seconds, sigma is 0.52
3:00:41.826874 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:00:41.827145 INFO: Starting candidate selection
3:00:55.932329 INFO: Starting candidate scoring
3:01:02.067770 INFO: Finished candidate processing
3:01:02.067968 INFO: Collecting candidate features
3:01:05.757068 WARNING: intensity_correlation has 589 NaNs ( 0.12 % out of 472044)
3:01:05.758173 WARNING: height_correlation has 2 NaNs ( 0.00 % out of 472044)
3:01:05.792108 INFO: Collecting fragment features
3:01:06.835012 INFO: Finished candidate scoring
3:01:07.727530 PROGRESS: === Epoch 9, step 8, extracted 472044 precursors and 2274734 fragments ===
3:01:07.727916 INFO: performing precursor FDR with 47 features
3:01:07.727968 INFO: Decoy channel: -1
3:01:07.727994 INFO: Competetive: True
3:01:08.875239 WARNING: dropped 583 target PSMs due to missing features
3:01:08.875362 WARNING: dropped 618 decoy PSMs due to missing features
3:01:44.241691 INFO: Test AUC: 0.547
3:01:44.241851 INFO: Train AUC: 0.566
3:01:44.241889 INFO: AUC difference: 3.41%
3:01:44.484370 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
3:01:44.487268 PROGRESS: ============================= Precursor FDR =============================
3:01:44.487430 PROGRESS: Total precursors accumulated: 6,472
3:01:44.487508 PROGRESS: Target precursors: 5,900 (91.16%)
3:01:44.487575 PROGRESS: Decoy precursors: 572 (8.84%)
3:01:44.487638 PROGRESS: 
3:01:44.487700 PROGRESS: Precursor Summary:
3:01:44.491651 PROGRESS: Channel   0:	 0.05 FDR: 4,813; 0.01 FDR: 3,553; 0.001 FDR: 2,623
3:01:44.491835 PROGRESS: 
3:01:44.491910 PROGRESS: Protein Summary:
3:01:44.497463 PROGRESS: Channel   0:	 0.05 FDR: 3,363; 0.01 FDR: 2,439; 0.001 FDR: 1,863
3:01:44.497632 PROGRESS: =========================================================================
3:01:44.502238 INFO: calibration group: precursor, fitting rt estimator 
3:01:44.915803 INFO: calibration group: fragment, fitting mz estimator 
3:01:45.514827 INFO: === checking if epoch conditions were reached ===
3:01:45.515057 INFO: ✅ ms2_error      : 7.0000 <= 7
3:01:45.515147 INFO: ❌ rt_error       : 201.6322 > 100
3:01:45.515222 INFO: ✅ current_epoch  : 9 >= 3
3:01:45.515288 INFO: ==============================================
3:01:45.735774 INFO: calibration group: precursor, predicting mz
3:01:45.736066 WARNING: mz prediction was skipped as it has not been fitted yet
3:01:45.736108 INFO: calibration group: precursor, predicting rt
3:01:52.557750 INFO: calibration group: fragment, predicting mz
3:02:10.635888 PROGRESS: === Epoch 10, step 0, extracting elution groups 0 to 1000 ===
3:02:10.735672 PROGRESS: Extracting batch of 1981 precursors
3:02:10.737482 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:02:10.737575 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:02:10.737617 INFO: FWHM in RT is 14.51 seconds, sigma is 0.53
3:02:10.737664 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:02:10.737919 INFO: Starting candidate selection
3:02:15.099423 INFO: Starting candidate scoring
3:02:16.409263 INFO: Finished candidate processing
3:02:16.409356 INFO: Collecting candidate features
3:02:18.583410 WARNING: intensity_correlation has 1 NaNs ( 0.05 % out of 1859)
3:02:18.589487 INFO: Collecting fragment features
3:02:19.231594 INFO: Finished candidate scoring
3:02:19.577372 PROGRESS: === Epoch 10, step 0, extracted 1859 precursors and 8876 fragments ===
3:02:19.577707 INFO: performing precursor FDR with 47 features
3:02:19.577748 INFO: Decoy channel: -1
3:02:19.577783 INFO: Competetive: True
3:02:19.582532 WARNING: dropped 1 decoy PSMs due to missing features
3:02:19.611166 INFO: Test AUC: 0.569
3:02:19.611268 INFO: Train AUC: 0.566
3:02:19.611313 INFO: AUC difference: 0.40%
3:02:19.733168 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
3:02:19.734000 PROGRESS: ============================= Precursor FDR =============================
3:02:19.734128 PROGRESS: Total precursors accumulated: 8
3:02:19.734206 PROGRESS: Target precursors: 8 (100.00%)
3:02:19.734275 PROGRESS: Decoy precursors: 0 (0.00%)
3:02:19.734339 PROGRESS: 
3:02:19.734401 PROGRESS: Precursor Summary:
3:02:19.735900 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
3:02:19.736030 PROGRESS: 
3:02:19.736104 PROGRESS: Protein Summary:
3:02:19.737814 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
3:02:19.737927 PROGRESS: =========================================================================
3:02:19.738816 PROGRESS: === Epoch 10, step 1, extracting elution groups 1000 to 3000 ===
3:02:19.816706 PROGRESS: Extracting batch of 3952 precursors
3:02:19.818996 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:02:19.819057 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:02:19.819096 INFO: FWHM in RT is 14.51 seconds, sigma is 0.53
3:02:19.819145 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:02:19.819358 INFO: Starting candidate selection
3:02:23.808976 INFO: Starting candidate scoring
3:02:25.131954 INFO: Finished candidate processing
3:02:25.132048 INFO: Collecting candidate features
3:02:27.324464 WARNING: intensity_correlation has 3 NaNs ( 0.08 % out of 3711)
3:02:27.330613 INFO: Collecting fragment features
3:02:27.980097 INFO: Finished candidate scoring
3:02:28.265233 PROGRESS: === Epoch 10, step 1, extracted 3711 precursors and 17743 fragments ===
3:02:28.265517 INFO: performing precursor FDR with 47 features
3:02:28.265562 INFO: Decoy channel: -1
3:02:28.265589 INFO: Competetive: True
3:02:28.274585 WARNING: dropped 2 target PSMs due to missing features
3:02:28.274676 WARNING: dropped 2 decoy PSMs due to missing features
3:02:28.312672 INFO: Test AUC: 0.568
3:02:28.312792 INFO: Train AUC: 0.549
3:02:28.312839 INFO: AUC difference: 3.61%
3:02:28.432508 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
3:02:28.433304 PROGRESS: ============================= Precursor FDR =============================
3:02:28.433430 PROGRESS: Total precursors accumulated: 23
3:02:28.433510 PROGRESS: Target precursors: 21 (91.30%)
3:02:28.433578 PROGRESS: Decoy precursors: 2 (8.70%)
3:02:28.433642 PROGRESS: 
3:02:28.433704 PROGRESS: Precursor Summary:
3:02:28.435141 PROGRESS: Channel   0:	 0.05 FDR:    21; 0.01 FDR:    20; 0.001 FDR:    20
3:02:28.435272 PROGRESS: 
3:02:28.435347 PROGRESS: Protein Summary:
3:02:28.436952 PROGRESS: Channel   0:	 0.05 FDR:    21; 0.01 FDR:    20; 0.001 FDR:    20
3:02:28.437064 PROGRESS: =========================================================================
3:02:28.437950 PROGRESS: === Epoch 10, step 2, extracting elution groups 3000 to 7000 ===
3:02:28.520031 PROGRESS: Extracting batch of 7903 precursors
3:02:28.523522 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:02:28.523588 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:02:28.523626 INFO: FWHM in RT is 14.51 seconds, sigma is 0.53
3:02:28.523672 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:02:28.523895 INFO: Starting candidate selection
3:02:32.560193 INFO: Starting candidate scoring
3:02:33.902616 INFO: Finished candidate processing
3:02:33.902708 INFO: Collecting candidate features
3:02:36.081976 WARNING: intensity_correlation has 10 NaNs ( 0.14 % out of 7407)
3:02:36.088918 INFO: Collecting fragment features
3:02:36.733713 INFO: Finished candidate scoring
3:02:37.020479 PROGRESS: === Epoch 10, step 2, extracted 7407 precursors and 35524 fragments ===
3:02:37.020816 INFO: performing precursor FDR with 47 features
3:02:37.020860 INFO: Decoy channel: -1
3:02:37.020886 INFO: Competetive: True
3:02:37.036211 WARNING: dropped 6 target PSMs due to missing features
3:02:37.036309 WARNING: dropped 8 decoy PSMs due to missing features
3:02:37.268265 INFO: Test AUC: 0.554
3:02:37.268402 INFO: Train AUC: 0.573
3:02:37.268449 INFO: AUC difference: 3.30%
3:02:37.391980 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
3:02:37.392872 PROGRESS: ============================= Precursor FDR =============================
3:02:37.392994 PROGRESS: Total precursors accumulated: 82
3:02:37.393072 PROGRESS: Target precursors: 75 (91.46%)
3:02:37.393140 PROGRESS: Decoy precursors: 7 (8.54%)
3:02:37.393204 PROGRESS: 
3:02:37.393265 PROGRESS: Precursor Summary:
3:02:37.394768 PROGRESS: Channel   0:	 0.05 FDR:    61; 0.01 FDR:    46; 0.001 FDR:    46
3:02:37.394892 PROGRESS: 
3:02:37.394968 PROGRESS: Protein Summary:
3:02:37.396660 PROGRESS: Channel   0:	 0.05 FDR:    59; 0.01 FDR:    46; 0.001 FDR:    46
3:02:37.396774 PROGRESS: =========================================================================
3:02:37.397667 PROGRESS: === Epoch 10, step 3, extracting elution groups 7000 to 15000 ===
3:02:37.490051 PROGRESS: Extracting batch of 15806 precursors
3:02:37.495839 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:02:37.495913 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:02:37.495947 INFO: FWHM in RT is 14.51 seconds, sigma is 0.53
3:02:37.495991 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:02:37.496216 INFO: Starting candidate selection
3:02:41.698411 INFO: Starting candidate scoring
3:02:43.125331 INFO: Finished candidate processing
3:02:43.125422 INFO: Collecting candidate features
3:02:45.354522 WARNING: intensity_correlation has 18 NaNs ( 0.12 % out of 14766)
3:02:45.360694 INFO: Collecting fragment features
3:02:46.025332 INFO: Finished candidate scoring
3:02:46.323271 PROGRESS: === Epoch 10, step 3, extracted 14766 precursors and 71123 fragments ===
3:02:46.323614 INFO: performing precursor FDR with 47 features
3:02:46.323661 INFO: Decoy channel: -1
3:02:46.323687 INFO: Competetive: True
3:02:46.353265 WARNING: dropped 16 target PSMs due to missing features
3:02:46.353394 WARNING: dropped 16 decoy PSMs due to missing features
3:02:47.137253 INFO: Test AUC: 0.544
3:02:47.137408 INFO: Train AUC: 0.593
3:02:47.137455 INFO: AUC difference: 8.25%
3:02:47.137491 WARNING: AUC difference > 5%. This may indicate overfitting.
3:02:47.264241 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
3:02:47.265212 PROGRESS: ============================= Precursor FDR =============================
3:02:47.265350 PROGRESS: Total precursors accumulated: 298
3:02:47.265431 PROGRESS: Target precursors: 273 (91.61%)
3:02:47.265500 PROGRESS: Decoy precursors: 25 (8.39%)
3:02:47.265564 PROGRESS: 
3:02:47.265625 PROGRESS: Precursor Summary:
3:02:47.267213 PROGRESS: Channel   0:	 0.05 FDR:   164; 0.01 FDR:   119; 0.001 FDR:   118
3:02:47.267332 PROGRESS: 
3:02:47.267406 PROGRESS: Protein Summary:
3:02:47.269205 PROGRESS: Channel   0:	 0.05 FDR:   161; 0.01 FDR:   117; 0.001 FDR:   116
3:02:47.269318 PROGRESS: =========================================================================
3:02:47.270270 PROGRESS: === Epoch 10, step 4, extracting elution groups 15000 to 31000 ===
3:02:47.378272 PROGRESS: Extracting batch of 31605 precursors
3:02:47.389122 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:02:47.389235 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:02:47.389279 INFO: FWHM in RT is 14.51 seconds, sigma is 0.53
3:02:47.389306 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:02:47.389547 INFO: Starting candidate selection
3:02:51.948037 INFO: Starting candidate scoring
3:02:53.546609 INFO: Finished candidate processing
3:02:53.546803 INFO: Collecting candidate features
3:02:55.824115 WARNING: intensity_correlation has 49 NaNs ( 0.17 % out of 29487)
3:02:55.831229 INFO: Collecting fragment features
3:02:56.518424 INFO: Finished candidate scoring
3:02:56.835043 PROGRESS: === Epoch 10, step 4, extracted 29487 precursors and 143197 fragments ===
3:02:56.835401 INFO: performing precursor FDR with 47 features
3:02:56.835449 INFO: Decoy channel: -1
3:02:56.835477 INFO: Competetive: True
3:02:56.895641 WARNING: dropped 41 target PSMs due to missing features
3:02:56.895786 WARNING: dropped 40 decoy PSMs due to missing features
3:02:58.706210 INFO: Test AUC: 0.552
3:02:58.706359 INFO: Train AUC: 0.603
3:02:58.706406 INFO: AUC difference: 8.56%
3:02:58.706444 WARNING: AUC difference > 5%. This may indicate overfitting.
3:02:58.836451 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
3:02:58.837619 PROGRESS: ============================= Precursor FDR =============================
3:02:58.837748 PROGRESS: Total precursors accumulated: 775
3:02:58.837837 PROGRESS: Target precursors: 705 (90.97%)
3:02:58.837907 PROGRESS: Decoy precursors: 70 (9.03%)
3:02:58.837970 PROGRESS: 
3:02:58.838032 PROGRESS: Precursor Summary:
3:02:58.839824 PROGRESS: Channel   0:	 0.05 FDR:   490; 0.01 FDR:   299; 0.001 FDR:   261
3:02:58.839960 PROGRESS: 
3:02:58.840034 PROGRESS: Protein Summary:
3:02:58.842127 PROGRESS: Channel   0:	 0.05 FDR:   474; 0.01 FDR:   287; 0.001 FDR:   250
3:02:58.842242 PROGRESS: =========================================================================
3:02:58.843306 PROGRESS: === Epoch 10, step 5, extracting elution groups 31000 to 63000 ===
3:02:58.980280 PROGRESS: Extracting batch of 63194 precursors
3:02:59.000423 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:02:59.000532 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:02:59.000573 INFO: FWHM in RT is 14.51 seconds, sigma is 0.53
3:02:59.000616 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:02:59.000860 INFO: Starting candidate selection
3:03:04.166976 INFO: Starting candidate scoring
3:03:06.036341 INFO: Finished candidate processing
3:03:06.036599 INFO: Collecting candidate features
3:03:08.408861 WARNING: intensity_correlation has 90 NaNs ( 0.15 % out of 59118)
3:03:08.417862 INFO: Collecting fragment features
3:03:09.136511 INFO: Finished candidate scoring
3:03:09.490990 PROGRESS: === Epoch 10, step 5, extracted 59118 precursors and 285384 fragments ===
3:03:09.491318 INFO: performing precursor FDR with 47 features
3:03:09.491381 INFO: Decoy channel: -1
3:03:09.491406 INFO: Competetive: True
3:03:09.623753 WARNING: dropped 83 target PSMs due to missing features
3:03:09.623875 WARNING: dropped 88 decoy PSMs due to missing features
3:03:13.468668 INFO: Test AUC: 0.552
3:03:13.468788 INFO: Train AUC: 0.596
3:03:13.468845 INFO: AUC difference: 7.38%
3:03:13.468881 WARNING: AUC difference > 5%. This may indicate overfitting.
3:03:13.603788 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
3:03:13.605228 PROGRESS: ============================= Precursor FDR =============================
3:03:13.605397 PROGRESS: Total precursors accumulated: 1,483
3:03:13.605476 PROGRESS: Target precursors: 1,350 (91.03%)
3:03:13.605543 PROGRESS: Decoy precursors: 133 (8.97%)
3:03:13.605608 PROGRESS: 
3:03:13.605671 PROGRESS: Precursor Summary:
3:03:13.607662 PROGRESS: Channel   0:	 0.05 FDR:   825; 0.01 FDR:   498; 0.001 FDR:   363
3:03:13.607790 PROGRESS: 
3:03:13.607865 PROGRESS: Protein Summary:
3:03:13.610250 PROGRESS: Channel   0:	 0.05 FDR:   783; 0.01 FDR:   470; 0.001 FDR:   344
3:03:13.610366 PROGRESS: =========================================================================
3:03:13.611560 PROGRESS: === Epoch 10, step 6, extracting elution groups 63000 to 127000 ===
3:03:13.787287 PROGRESS: Extracting batch of 126465 precursors
3:03:13.826281 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:03:13.826419 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:03:13.826458 INFO: FWHM in RT is 14.51 seconds, sigma is 0.53
3:03:13.826487 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:03:13.826751 INFO: Starting candidate selection
3:03:20.312314 INFO: Starting candidate scoring
3:03:22.834728 INFO: Finished candidate processing
3:03:22.834868 INFO: Collecting candidate features
3:03:25.363856 WARNING: intensity_correlation has 212 NaNs ( 0.18 % out of 118393)
3:03:25.377293 INFO: Collecting fragment features
3:03:26.142150 INFO: Finished candidate scoring
3:03:26.566379 PROGRESS: === Epoch 10, step 6, extracted 118393 precursors and 571219 fragments ===
3:03:26.566730 INFO: performing precursor FDR with 47 features
3:03:26.566776 INFO: Decoy channel: -1
3:03:26.566802 INFO: Competetive: True
3:03:26.838233 WARNING: dropped 181 target PSMs due to missing features
3:03:26.838367 WARNING: dropped 202 decoy PSMs due to missing features
3:03:35.553602 INFO: Test AUC: 0.553
3:03:35.553732 INFO: Train AUC: 0.586
3:03:35.553803 INFO: AUC difference: 5.56%
3:03:35.553834 WARNING: AUC difference > 5%. This may indicate overfitting.
3:03:35.709038 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
3:03:35.710679 PROGRESS: ============================= Precursor FDR =============================
3:03:35.710819 PROGRESS: Total precursors accumulated: 2,116
3:03:35.710900 PROGRESS: Target precursors: 1,925 (90.97%)
3:03:35.710968 PROGRESS: Decoy precursors: 191 (9.03%)
3:03:35.711032 PROGRESS: 
3:03:35.711094 PROGRESS: Precursor Summary:
3:03:35.713296 PROGRESS: Channel   0:	 0.05 FDR: 1,281; 0.01 FDR:   846; 0.001 FDR:   605
3:03:35.713437 PROGRESS: 
3:03:35.713513 PROGRESS: Protein Summary:
3:03:35.716293 PROGRESS: Channel   0:	 0.05 FDR: 1,168; 0.01 FDR:   771; 0.001 FDR:   552
3:03:35.716409 PROGRESS: =========================================================================
3:03:35.717798 PROGRESS: === Epoch 10, step 7, extracting elution groups 127000 to 255000 ===
3:03:35.943585 PROGRESS: Extracting batch of 252830 precursors
3:03:36.016442 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:03:36.016567 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:03:36.016606 INFO: FWHM in RT is 14.51 seconds, sigma is 0.53
3:03:36.016647 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:03:36.016911 INFO: Starting candidate selection
3:03:45.049902 INFO: Starting candidate scoring
3:03:48.765695 INFO: Finished candidate processing
3:03:48.765895 INFO: Collecting candidate features
3:03:51.707142 WARNING: intensity_correlation has 341 NaNs ( 0.14 % out of 236757)
3:03:51.728081 INFO: Collecting fragment features
3:03:52.595305 INFO: Finished candidate scoring
3:03:53.175206 PROGRESS: === Epoch 10, step 7, extracted 236757 precursors and 1144936 fragments ===
3:03:53.175587 INFO: performing precursor FDR with 47 features
3:03:53.175642 INFO: Decoy channel: -1
3:03:53.175674 INFO: Competetive: True
3:03:53.767292 WARNING: dropped 372 target PSMs due to missing features
3:03:53.767426 WARNING: dropped 352 decoy PSMs due to missing features
3:04:10.928416 INFO: Test AUC: 0.550
3:04:10.928547 INFO: Train AUC: 0.575
3:04:10.928603 INFO: AUC difference: 4.28%
3:04:11.113582 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
3:04:11.115785 PROGRESS: ============================= Precursor FDR =============================
3:04:11.115983 PROGRESS: Total precursors accumulated: 3,733
3:04:11.116065 PROGRESS: Target precursors: 3,401 (91.11%)
3:04:11.116133 PROGRESS: Decoy precursors: 332 (8.89%)
3:04:11.116197 PROGRESS: 
3:04:11.116260 PROGRESS: Precursor Summary:
3:04:11.119145 PROGRESS: Channel   0:	 0.05 FDR: 2,493; 0.01 FDR: 1,815; 0.001 FDR: 1,308
3:04:11.119298 PROGRESS: 
3:04:11.119371 PROGRESS: Protein Summary:
3:04:11.123138 PROGRESS: Channel   0:	 0.05 FDR: 2,058; 0.01 FDR: 1,470; 0.001 FDR: 1,079
3:04:11.123273 PROGRESS: =========================================================================
3:04:11.125171 PROGRESS: === Epoch 10, step 8, extracting elution groups 255000 to 511000 ===
3:04:11.431864 PROGRESS: Extracting batch of 505876 precursors
3:04:11.565877 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:04:11.565995 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:04:11.566036 INFO: FWHM in RT is 14.51 seconds, sigma is 0.53
3:04:11.566063 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:04:11.566331 INFO: Starting candidate selection
3:04:25.676993 INFO: Starting candidate scoring
3:04:31.842516 INFO: Finished candidate processing
3:04:31.842649 INFO: Collecting candidate features
3:04:35.521657 WARNING: intensity_correlation has 742 NaNs ( 0.16 % out of 473228)
3:04:35.557076 INFO: Collecting fragment features
3:04:36.620854 INFO: Finished candidate scoring
3:04:37.513217 PROGRESS: === Epoch 10, step 8, extracted 473228 precursors and 2288361 fragments ===
3:04:37.513579 INFO: performing precursor FDR with 47 features
3:04:37.513624 INFO: Decoy channel: -1
3:04:37.513650 INFO: Competetive: True
3:04:38.673199 WARNING: dropped 761 target PSMs due to missing features
3:04:38.673326 WARNING: dropped 705 decoy PSMs due to missing features
3:05:12.952080 INFO: Test AUC: 0.551
3:05:12.952212 INFO: Train AUC: 0.567
3:05:12.952268 INFO: AUC difference: 2.90%
3:05:13.194569 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
3:05:13.197439 PROGRESS: ============================= Precursor FDR =============================
3:05:13.197602 PROGRESS: Total precursors accumulated: 6,554
3:05:13.197679 PROGRESS: Target precursors: 5,983 (91.29%)
3:05:13.197745 PROGRESS: Decoy precursors: 571 (8.71%)
3:05:13.197837 PROGRESS: 
3:05:13.197899 PROGRESS: Precursor Summary:
3:05:13.201532 PROGRESS: Channel   0:	 0.05 FDR: 4,644; 0.01 FDR: 3,507; 0.001 FDR: 2,450
3:05:13.201703 PROGRESS: 
3:05:13.201789 PROGRESS: Protein Summary:
3:05:13.207072 PROGRESS: Channel   0:	 0.05 FDR: 3,233; 0.01 FDR: 2,393; 0.001 FDR: 1,750
3:05:13.207192 PROGRESS: =========================================================================
3:05:13.211657 INFO: calibration group: precursor, fitting rt estimator 
3:05:13.640294 INFO: calibration group: fragment, fitting mz estimator 
3:05:14.252751 INFO: === checking if epoch conditions were reached ===
3:05:14.252966 INFO: ✅ ms2_error      : 7.0000 <= 7
3:05:14.253058 INFO: ❌ rt_error       : 204.2718 > 100
3:05:14.253131 INFO: ✅ current_epoch  : 10 >= 3
3:05:14.253196 INFO: ==============================================
3:05:14.501288 INFO: calibration group: precursor, predicting mz
3:05:14.501568 WARNING: mz prediction was skipped as it has not been fitted yet
3:05:14.501611 INFO: calibration group: precursor, predicting rt
3:05:21.302740 INFO: calibration group: fragment, predicting mz
3:05:39.116662 PROGRESS: === Epoch 11, step 0, extracting elution groups 0 to 1000 ===
3:05:39.215208 PROGRESS: Extracting batch of 1978 precursors
3:05:39.216923 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:05:39.216998 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:05:39.217040 INFO: FWHM in RT is 14.47 seconds, sigma is 0.53
3:05:39.217070 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:05:39.217319 INFO: Starting candidate selection
3:05:43.489746 INFO: Starting candidate scoring
3:05:44.775196 INFO: Finished candidate processing
3:05:44.775287 INFO: Collecting candidate features
3:05:46.963026 WARNING: intensity_correlation has 2 NaNs ( 0.11 % out of 1852)
3:05:46.968979 INFO: Collecting fragment features
3:05:47.590779 INFO: Finished candidate scoring
3:05:47.916528 PROGRESS: === Epoch 11, step 0, extracted 1852 precursors and 8969 fragments ===
3:05:47.916860 INFO: performing precursor FDR with 47 features
3:05:47.916910 INFO: Decoy channel: -1
3:05:47.916937 INFO: Competetive: True
3:05:47.921624 WARNING: dropped 2 decoy PSMs due to missing features
3:05:47.949556 INFO: Test AUC: 0.570
3:05:47.949652 INFO: Train AUC: 0.527
3:05:47.949697 INFO: AUC difference: 8.25%
3:05:47.949731 WARNING: AUC difference > 5%. This may indicate overfitting.
3:05:48.095104 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
3:05:48.095899 PROGRESS: ============================= Precursor FDR =============================
3:05:48.096034 PROGRESS: Total precursors accumulated: 16
3:05:48.096141 PROGRESS: Target precursors: 15 (93.75%)
3:05:48.096238 PROGRESS: Decoy precursors: 1 (6.25%)
3:05:48.096331 PROGRESS: 
3:05:48.096420 PROGRESS: Precursor Summary:
3:05:48.098254 PROGRESS: Channel   0:	 0.05 FDR:     9; 0.01 FDR:     9; 0.001 FDR:     9
3:05:48.098383 PROGRESS: 
3:05:48.098473 PROGRESS: Protein Summary:
3:05:48.100111 PROGRESS: Channel   0:	 0.05 FDR:     9; 0.01 FDR:     9; 0.001 FDR:     9
3:05:48.100222 PROGRESS: =========================================================================
3:05:48.101237 PROGRESS: === Epoch 11, step 1, extracting elution groups 1000 to 3000 ===
3:05:48.179368 PROGRESS: Extracting batch of 3949 precursors
3:05:48.181568 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:05:48.181635 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:05:48.181681 INFO: FWHM in RT is 14.47 seconds, sigma is 0.53
3:05:48.181715 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:05:48.181984 INFO: Starting candidate selection
3:05:52.186490 INFO: Starting candidate scoring
3:05:53.521211 INFO: Finished candidate processing
3:05:53.521321 INFO: Collecting candidate features
3:05:55.715738 WARNING: intensity_correlation has 4 NaNs ( 0.11 % out of 3721)
3:05:55.722901 INFO: Collecting fragment features
3:05:56.351973 INFO: Finished candidate scoring
3:05:56.634985 PROGRESS: === Epoch 11, step 1, extracted 3721 precursors and 18263 fragments ===
3:05:56.635284 INFO: performing precursor FDR with 47 features
3:05:56.635331 INFO: Decoy channel: -1
3:05:56.635358 INFO: Competetive: True
3:05:56.644197 WARNING: dropped 3 target PSMs due to missing features
3:05:56.644288 WARNING: dropped 3 decoy PSMs due to missing features
3:05:56.682553 INFO: Test AUC: 0.530
3:05:56.682671 INFO: Train AUC: 0.552
3:05:56.682715 INFO: AUC difference: 4.14%
3:05:56.805099 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
3:05:56.805840 PROGRESS: ============================= Precursor FDR =============================
3:05:56.805955 PROGRESS: Total precursors accumulated: 44
3:05:56.806023 PROGRESS: Target precursors: 41 (93.18%)
3:05:56.806084 PROGRESS: Decoy precursors: 3 (6.82%)
3:05:56.806141 PROGRESS: 
3:05:56.806196 PROGRESS: Precursor Summary:
3:05:56.807627 PROGRESS: Channel   0:	 0.05 FDR:    33; 0.01 FDR:    24; 0.001 FDR:    24
3:05:56.807742 PROGRESS: 
3:05:56.807830 PROGRESS: Protein Summary:
3:05:56.809462 PROGRESS: Channel   0:	 0.05 FDR:    33; 0.01 FDR:    24; 0.001 FDR:    24
3:05:56.809575 PROGRESS: =========================================================================
3:05:56.810452 PROGRESS: === Epoch 11, step 2, extracting elution groups 3000 to 7000 ===
3:05:56.892905 PROGRESS: Extracting batch of 7896 precursors
3:05:56.896217 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:05:56.896280 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:05:56.896318 INFO: FWHM in RT is 14.47 seconds, sigma is 0.53
3:05:56.896364 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:05:56.896577 INFO: Starting candidate selection
3:06:00.917357 INFO: Starting candidate scoring
3:06:02.267685 INFO: Finished candidate processing
3:06:02.267781 INFO: Collecting candidate features
3:06:04.446284 WARNING: intensity_correlation has 12 NaNs ( 0.16 % out of 7431)
3:06:04.451933 INFO: Collecting fragment features
3:06:05.077396 INFO: Finished candidate scoring
3:06:05.364628 PROGRESS: === Epoch 11, step 2, extracted 7431 precursors and 35809 fragments ===
3:06:05.364954 INFO: performing precursor FDR with 47 features
3:06:05.365004 INFO: Decoy channel: -1
3:06:05.365031 INFO: Competetive: True
3:06:05.380306 WARNING: dropped 7 target PSMs due to missing features
3:06:05.380424 WARNING: dropped 11 decoy PSMs due to missing features
3:06:05.664320 INFO: Test AUC: 0.545
3:06:05.664462 INFO: Train AUC: 0.582
3:06:05.664537 INFO: AUC difference: 6.46%
3:06:05.664588 WARNING: AUC difference > 5%. This may indicate overfitting.
3:06:05.784692 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
3:06:05.785552 PROGRESS: ============================= Precursor FDR =============================
3:06:05.785692 PROGRESS: Total precursors accumulated: 96
3:06:05.785791 PROGRESS: Target precursors: 88 (91.67%)
3:06:05.785875 PROGRESS: Decoy precursors: 8 (8.33%)
3:06:05.785975 PROGRESS: 
3:06:05.786065 PROGRESS: Precursor Summary:
3:06:05.788056 PROGRESS: Channel   0:	 0.05 FDR:    82; 0.01 FDR:    59; 0.001 FDR:    59
3:06:05.788205 PROGRESS: 
3:06:05.788294 PROGRESS: Protein Summary:
3:06:05.790384 PROGRESS: Channel   0:	 0.05 FDR:    82; 0.01 FDR:    59; 0.001 FDR:    59
3:06:05.790509 PROGRESS: =========================================================================
3:06:05.791699 PROGRESS: === Epoch 11, step 3, extracting elution groups 7000 to 15000 ===
3:06:05.883703 PROGRESS: Extracting batch of 15797 precursors
3:06:05.889262 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:06:05.889337 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:06:05.889378 INFO: FWHM in RT is 14.47 seconds, sigma is 0.53
3:06:05.889407 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:06:05.889654 INFO: Starting candidate selection
3:06:10.125881 INFO: Starting candidate scoring
3:06:11.572303 INFO: Finished candidate processing
3:06:11.572396 INFO: Collecting candidate features
3:06:13.804253 WARNING: intensity_correlation has 19 NaNs ( 0.13 % out of 14794)
3:06:13.810353 INFO: Collecting fragment features
3:06:14.452331 INFO: Finished candidate scoring
3:06:14.750370 PROGRESS: === Epoch 11, step 3, extracted 14794 precursors and 71386 fragments ===
3:06:14.750704 INFO: performing precursor FDR with 47 features
3:06:14.750749 INFO: Decoy channel: -1
3:06:14.750775 INFO: Competetive: True
3:06:14.780263 WARNING: dropped 17 target PSMs due to missing features
3:06:14.780400 WARNING: dropped 20 decoy PSMs due to missing features
3:06:15.567810 INFO: Test AUC: 0.539
3:06:15.568098 INFO: Train AUC: 0.604
3:06:15.568207 INFO: AUC difference: 10.81%
3:06:15.568296 WARNING: AUC difference > 5%. This may indicate overfitting.
3:06:15.694245 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
3:06:15.695185 PROGRESS: ============================= Precursor FDR =============================
3:06:15.695311 PROGRESS: Total precursors accumulated: 237
3:06:15.695390 PROGRESS: Target precursors: 217 (91.56%)
3:06:15.695461 PROGRESS: Decoy precursors: 20 (8.44%)
3:06:15.695524 PROGRESS: 
3:06:15.695585 PROGRESS: Precursor Summary:
3:06:15.697129 PROGRESS: Channel   0:	 0.05 FDR:   166; 0.01 FDR:   125; 0.001 FDR:   121
3:06:15.697248 PROGRESS: 
3:06:15.697323 PROGRESS: Protein Summary:
3:06:15.699136 PROGRESS: Channel   0:	 0.05 FDR:   162; 0.01 FDR:   123; 0.001 FDR:   119
3:06:15.699267 PROGRESS: =========================================================================
3:06:15.700200 PROGRESS: === Epoch 11, step 4, extracting elution groups 15000 to 31000 ===
3:06:15.807940 PROGRESS: Extracting batch of 31613 precursors
3:06:15.818876 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:06:15.818995 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:06:15.819034 INFO: FWHM in RT is 14.47 seconds, sigma is 0.53
3:06:15.819063 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:06:15.819304 INFO: Starting candidate selection
3:06:20.372006 INFO: Starting candidate scoring
3:06:21.968122 INFO: Finished candidate processing
3:06:21.968226 INFO: Collecting candidate features
3:06:24.248337 WARNING: intensity_correlation has 46 NaNs ( 0.16 % out of 29555)
3:06:24.255728 INFO: Collecting fragment features
3:06:24.917521 INFO: Finished candidate scoring
3:06:25.233408 PROGRESS: === Epoch 11, step 4, extracted 29555 precursors and 142923 fragments ===
3:06:25.233781 INFO: performing precursor FDR with 47 features
3:06:25.233837 INFO: Decoy channel: -1
3:06:25.233864 INFO: Competetive: True
3:06:25.292942 WARNING: dropped 37 target PSMs due to missing features
3:06:25.293058 WARNING: dropped 46 decoy PSMs due to missing features
3:06:27.056556 INFO: Test AUC: 0.557
3:06:27.063638 INFO: Train AUC: 0.605
3:06:27.063821 INFO: AUC difference: 7.91%
3:06:27.063918 WARNING: AUC difference > 5%. This may indicate overfitting.
3:06:27.193051 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
3:06:27.194164 PROGRESS: ============================= Precursor FDR =============================
3:06:27.194283 PROGRESS: Total precursors accumulated: 662
3:06:27.194360 PROGRESS: Target precursors: 604 (91.24%)
3:06:27.194436 PROGRESS: Decoy precursors: 58 (8.76%)
3:06:27.194499 PROGRESS: 
3:06:27.194560 PROGRESS: Precursor Summary:
3:06:27.196224 PROGRESS: Channel   0:	 0.05 FDR:   365; 0.01 FDR:   210; 0.001 FDR:   203
3:06:27.196355 PROGRESS: 
3:06:27.196427 PROGRESS: Protein Summary:
3:06:27.198373 PROGRESS: Channel   0:	 0.05 FDR:   355; 0.01 FDR:   204; 0.001 FDR:   197
3:06:27.198484 PROGRESS: =========================================================================
3:06:27.199469 PROGRESS: === Epoch 11, step 5, extracting elution groups 31000 to 63000 ===
3:06:27.335289 PROGRESS: Extracting batch of 63245 precursors
3:06:27.355090 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:06:27.355190 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:06:27.355245 INFO: FWHM in RT is 14.47 seconds, sigma is 0.53
3:06:27.355272 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:06:27.355540 INFO: Starting candidate selection
3:06:32.553936 INFO: Starting candidate scoring
3:06:34.462993 INFO: Finished candidate processing
3:06:34.463169 INFO: Collecting candidate features
3:06:36.841315 WARNING: intensity_correlation has 84 NaNs ( 0.14 % out of 59223)
3:06:36.850327 INFO: Collecting fragment features
3:06:37.547256 INFO: Finished candidate scoring
3:06:37.899524 PROGRESS: === Epoch 11, step 5, extracted 59223 precursors and 286510 fragments ===
3:06:37.899870 INFO: performing precursor FDR with 47 features
3:06:37.899919 INFO: Decoy channel: -1
3:06:37.899945 INFO: Competetive: True
3:06:38.033746 WARNING: dropped 83 target PSMs due to missing features
3:06:38.033889 WARNING: dropped 84 decoy PSMs due to missing features
3:06:42.014659 INFO: Test AUC: 0.553
3:06:42.014777 INFO: Train AUC: 0.598
3:06:42.014817 INFO: AUC difference: 7.56%
3:06:42.014862 WARNING: AUC difference > 5%. This may indicate overfitting.
3:06:42.151921 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
3:06:42.153219 PROGRESS: ============================= Precursor FDR =============================
3:06:42.153345 PROGRESS: Total precursors accumulated: 1,161
3:06:42.153424 PROGRESS: Target precursors: 1,060 (91.30%)
3:06:42.153493 PROGRESS: Decoy precursors: 101 (8.70%)
3:06:42.153556 PROGRESS: 
3:06:42.153617 PROGRESS: Precursor Summary:
3:06:42.155480 PROGRESS: Channel   0:	 0.05 FDR:   650; 0.01 FDR:   445; 0.001 FDR:   313
3:06:42.155597 PROGRESS: 
3:06:42.155683 PROGRESS: Protein Summary:
3:06:42.157886 PROGRESS: Channel   0:	 0.05 FDR:   615; 0.01 FDR:   420; 0.001 FDR:   298
3:06:42.157997 PROGRESS: =========================================================================
3:06:42.159124 PROGRESS: === Epoch 11, step 6, extracting elution groups 63000 to 127000 ===
3:06:42.334489 PROGRESS: Extracting batch of 126456 precursors
3:06:42.372800 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:06:42.372913 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:06:42.372970 INFO: FWHM in RT is 14.47 seconds, sigma is 0.53
3:06:42.372998 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:06:42.373262 INFO: Starting candidate selection
3:06:48.826069 INFO: Starting candidate scoring
3:06:51.306933 INFO: Finished candidate processing
3:06:51.307115 INFO: Collecting candidate features
3:06:53.835011 WARNING: intensity_correlation has 159 NaNs ( 0.13 % out of 118326)
3:06:53.847768 INFO: Collecting fragment features
3:06:54.590166 INFO: Finished candidate scoring
3:06:55.012780 PROGRESS: === Epoch 11, step 6, extracted 118326 precursors and 570950 fragments ===
3:06:55.013144 INFO: performing precursor FDR with 47 features
3:06:55.013192 INFO: Decoy channel: -1
3:06:55.013219 INFO: Competetive: True
3:06:55.284745 WARNING: dropped 161 target PSMs due to missing features
3:06:55.284860 WARNING: dropped 165 decoy PSMs due to missing features
3:07:03.573887 INFO: Test AUC: 0.552
3:07:03.574029 INFO: Train AUC: 0.582
3:07:03.574072 INFO: AUC difference: 5.13%
3:07:03.574100 WARNING: AUC difference > 5%. This may indicate overfitting.
3:07:03.747490 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
3:07:03.749327 PROGRESS: ============================= Precursor FDR =============================
3:07:03.749482 PROGRESS: Total precursors accumulated: 2,600
3:07:03.749562 PROGRESS: Target precursors: 2,373 (91.27%)
3:07:03.749631 PROGRESS: Decoy precursors: 227 (8.73%)
3:07:03.749694 PROGRESS: 
3:07:03.749757 PROGRESS: Precursor Summary:
3:07:03.751961 PROGRESS: Channel   0:	 0.05 FDR: 1,478; 0.01 FDR:   846; 0.001 FDR:   379
3:07:03.752097 PROGRESS: 
3:07:03.752173 PROGRESS: Protein Summary:
3:07:03.754938 PROGRESS: Channel   0:	 0.05 FDR: 1,342; 0.01 FDR:   754; 0.001 FDR:   333
3:07:03.755069 PROGRESS: =========================================================================
3:07:03.756454 PROGRESS: === Epoch 11, step 7, extracting elution groups 127000 to 255000 ===
3:07:03.984548 PROGRESS: Extracting batch of 252809 precursors
3:07:04.056700 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:07:04.056816 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:07:04.056855 INFO: FWHM in RT is 14.47 seconds, sigma is 0.53
3:07:04.056899 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:07:04.057167 INFO: Starting candidate selection
3:07:13.034122 INFO: Starting candidate scoring
3:07:16.723636 INFO: Finished candidate processing
3:07:16.723822 INFO: Collecting candidate features
3:07:19.670816 WARNING: intensity_correlation has 315 NaNs ( 0.13 % out of 236550)
3:07:19.691256 INFO: Collecting fragment features
3:07:20.533595 INFO: Finished candidate scoring
3:07:21.113593 PROGRESS: === Epoch 11, step 7, extracted 236550 precursors and 1142079 fragments ===
3:07:21.113939 INFO: performing precursor FDR with 47 features
3:07:21.113986 INFO: Decoy channel: -1
3:07:21.114013 INFO: Competetive: True
3:07:21.707490 WARNING: dropped 313 target PSMs due to missing features
3:07:21.707610 WARNING: dropped 328 decoy PSMs due to missing features
3:07:38.769989 INFO: Test AUC: 0.552
3:07:38.770136 INFO: Train AUC: 0.574
3:07:38.770176 INFO: AUC difference: 3.76%
3:07:38.954175 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
3:07:38.956410 PROGRESS: ============================= Precursor FDR =============================
3:07:38.956560 PROGRESS: Total precursors accumulated: 4,297
3:07:38.956640 PROGRESS: Target precursors: 3,921 (91.25%)
3:07:38.956708 PROGRESS: Decoy precursors: 376 (8.75%)
3:07:38.956773 PROGRESS: 
3:07:38.956836 PROGRESS: Precursor Summary:
3:07:38.959606 PROGRESS: Channel   0:	 0.05 FDR: 2,781; 0.01 FDR: 1,822; 0.001 FDR: 1,254
3:07:38.959750 PROGRESS: 
3:07:38.959822 PROGRESS: Protein Summary:
3:07:38.963555 PROGRESS: Channel   0:	 0.05 FDR: 2,318; 0.01 FDR: 1,479; 0.001 FDR: 1,027
3:07:38.963685 PROGRESS: =========================================================================
3:07:38.965544 PROGRESS: === Epoch 11, step 8, extracting elution groups 255000 to 511000 ===
3:07:39.268351 PROGRESS: Extracting batch of 505844 precursors
3:07:39.400172 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:07:39.400290 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:07:39.400347 INFO: FWHM in RT is 14.47 seconds, sigma is 0.53
3:07:39.400377 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:07:39.400658 INFO: Starting candidate selection
3:07:53.575648 INFO: Starting candidate scoring
3:07:59.785542 INFO: Finished candidate processing
3:07:59.785740 INFO: Collecting candidate features
3:08:03.474110 WARNING: intensity_correlation has 682 NaNs ( 0.14 % out of 473327)
3:08:03.475192 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 473327)
3:08:03.509202 INFO: Collecting fragment features
3:08:04.556794 INFO: Finished candidate scoring
3:08:05.457072 PROGRESS: === Epoch 11, step 8, extracted 473327 precursors and 2283156 fragments ===
3:08:05.457457 INFO: performing precursor FDR with 47 features
3:08:05.464178 INFO: Decoy channel: -1
3:08:05.464334 INFO: Competetive: True
3:08:06.613521 WARNING: dropped 656 target PSMs due to missing features
3:08:06.613643 WARNING: dropped 667 decoy PSMs due to missing features
3:08:41.039744 INFO: Test AUC: 0.552
3:08:41.039867 INFO: Train AUC: 0.563
3:08:41.039903 INFO: AUC difference: 1.92%
3:08:41.281821 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
3:08:41.284669 PROGRESS: ============================= Precursor FDR =============================
3:08:41.284827 PROGRESS: Total precursors accumulated: 6,579
3:08:41.284904 PROGRESS: Target precursors: 6,002 (91.23%)
3:08:41.284984 PROGRESS: Decoy precursors: 577 (8.77%)
3:08:41.285049 PROGRESS: 
3:08:41.285111 PROGRESS: Precursor Summary:
3:08:41.288759 PROGRESS: Channel   0:	 0.05 FDR: 4,790; 0.01 FDR: 3,358; 0.001 FDR: 2,314
3:08:41.288887 PROGRESS: 
3:08:41.288957 PROGRESS: Protein Summary:
3:08:41.294088 PROGRESS: Channel   0:	 0.05 FDR: 3,347; 0.01 FDR: 2,306; 0.001 FDR: 1,656
3:08:41.294209 PROGRESS: =========================================================================
3:08:41.298486 INFO: calibration group: precursor, fitting rt estimator 
3:08:41.703277 INFO: calibration group: fragment, fitting mz estimator 
3:08:42.290640 INFO: === checking if epoch conditions were reached ===
3:08:42.290842 INFO: ✅ ms2_error      : 7.0000 <= 7
3:08:42.290930 INFO: ❌ rt_error       : 201.3491 > 100
3:08:42.291004 INFO: ✅ current_epoch  : 11 >= 3
3:08:42.291070 INFO: ==============================================
3:08:42.509885 INFO: calibration group: precursor, predicting mz
3:08:42.510168 WARNING: mz prediction was skipped as it has not been fitted yet
3:08:42.510210 INFO: calibration group: precursor, predicting rt
3:08:49.309540 INFO: calibration group: fragment, predicting mz
3:09:07.048467 PROGRESS: === Epoch 12, step 0, extracting elution groups 0 to 1000 ===
3:09:07.147834 PROGRESS: Extracting batch of 1973 precursors
3:09:07.149547 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:09:07.149637 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:09:07.149679 INFO: FWHM in RT is 14.32 seconds, sigma is 0.52
3:09:07.149709 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:09:07.149966 INFO: Starting candidate selection
3:09:11.479213 INFO: Starting candidate scoring
3:09:12.773730 INFO: Finished candidate processing
3:09:12.773835 INFO: Collecting candidate features
3:09:14.968102 INFO: Collecting fragment features
3:09:15.599569 INFO: Finished candidate scoring
3:09:15.923085 PROGRESS: === Epoch 12, step 0, extracted 1857 precursors and 8933 fragments ===
3:09:15.923421 INFO: performing precursor FDR with 47 features
3:09:15.923463 INFO: Decoy channel: -1
3:09:15.923489 INFO: Competetive: True
3:09:15.956430 INFO: Test AUC: 0.551
3:09:15.956535 INFO: Train AUC: 0.561
3:09:15.956578 INFO: AUC difference: 1.73%
3:09:16.076149 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
3:09:16.076942 PROGRESS: ============================= Precursor FDR =============================
3:09:16.077061 PROGRESS: Total precursors accumulated: 5
3:09:16.077137 PROGRESS: Target precursors: 5 (100.00%)
3:09:16.077204 PROGRESS: Decoy precursors: 0 (0.00%)
3:09:16.077266 PROGRESS: 
3:09:16.077326 PROGRESS: Precursor Summary:
3:09:16.078820 PROGRESS: Channel   0:	 0.05 FDR:     5; 0.01 FDR:     5; 0.001 FDR:     5
3:09:16.078934 PROGRESS: 
3:09:16.079007 PROGRESS: Protein Summary:
3:09:16.080687 PROGRESS: Channel   0:	 0.05 FDR:     5; 0.01 FDR:     5; 0.001 FDR:     5
3:09:16.080796 PROGRESS: =========================================================================
3:09:16.081677 PROGRESS: === Epoch 12, step 1, extracting elution groups 1000 to 3000 ===
3:09:16.158984 PROGRESS: Extracting batch of 3956 precursors
3:09:16.161166 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:09:16.161238 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:09:16.161276 INFO: FWHM in RT is 14.32 seconds, sigma is 0.52
3:09:16.161321 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:09:16.161534 INFO: Starting candidate selection
3:09:20.165530 INFO: Starting candidate scoring
3:09:21.479542 INFO: Finished candidate processing
3:09:21.479630 INFO: Collecting candidate features
3:09:23.648949 WARNING: intensity_correlation has 4 NaNs ( 0.11 % out of 3686)
3:09:23.654961 INFO: Collecting fragment features
3:09:24.297192 INFO: Finished candidate scoring
3:09:24.577523 PROGRESS: === Epoch 12, step 1, extracted 3686 precursors and 18018 fragments ===
3:09:24.577823 INFO: performing precursor FDR with 47 features
3:09:24.577872 INFO: Decoy channel: -1
3:09:24.577899 INFO: Competetive: True
3:09:24.586554 WARNING: dropped 3 target PSMs due to missing features
3:09:24.586665 WARNING: dropped 1 decoy PSMs due to missing features
3:09:24.624371 INFO: Test AUC: 0.558
3:09:24.624494 INFO: Train AUC: 0.556
3:09:24.624539 INFO: AUC difference: 0.39%
3:09:24.744933 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
3:09:24.745718 PROGRESS: ============================= Precursor FDR =============================
3:09:24.745855 PROGRESS: Total precursors accumulated: 18
3:09:24.745934 PROGRESS: Target precursors: 17 (94.44%)
3:09:24.746002 PROGRESS: Decoy precursors: 1 (5.56%)
3:09:24.746075 PROGRESS: 
3:09:24.746137 PROGRESS: Precursor Summary:
3:09:24.747560 PROGRESS: Channel   0:	 0.05 FDR:    14; 0.01 FDR:    14; 0.001 FDR:    14
3:09:24.747672 PROGRESS: 
3:09:24.747745 PROGRESS: Protein Summary:
3:09:24.749341 PROGRESS: Channel   0:	 0.05 FDR:    14; 0.01 FDR:    14; 0.001 FDR:    14
3:09:24.749478 PROGRESS: =========================================================================
3:09:24.750343 PROGRESS: === Epoch 12, step 2, extracting elution groups 3000 to 7000 ===
3:09:24.832541 PROGRESS: Extracting batch of 7886 precursors
3:09:24.835817 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:09:24.835879 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:09:24.835917 INFO: FWHM in RT is 14.32 seconds, sigma is 0.52
3:09:24.835962 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:09:24.836175 INFO: Starting candidate selection
3:09:28.882183 INFO: Starting candidate scoring
3:09:30.233608 INFO: Finished candidate processing
3:09:30.233816 INFO: Collecting candidate features
3:09:32.410443 WARNING: intensity_correlation has 6 NaNs ( 0.08 % out of 7390)
3:09:32.416906 INFO: Collecting fragment features
3:09:33.063050 INFO: Finished candidate scoring
3:09:33.349679 PROGRESS: === Epoch 12, step 2, extracted 7390 precursors and 35828 fragments ===
3:09:33.350010 INFO: performing precursor FDR with 47 features
3:09:33.350063 INFO: Decoy channel: -1
3:09:33.350089 INFO: Competetive: True
3:09:33.365127 WARNING: dropped 6 target PSMs due to missing features
3:09:33.365227 WARNING: dropped 4 decoy PSMs due to missing features
3:09:33.609864 INFO: Test AUC: 0.541
3:09:33.609998 INFO: Train AUC: 0.576
3:09:33.610062 INFO: AUC difference: 6.08%
3:09:33.610098 WARNING: AUC difference > 5%. This may indicate overfitting.
3:09:33.733722 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
3:09:33.734593 PROGRESS: ============================= Precursor FDR =============================
3:09:33.734715 PROGRESS: Total precursors accumulated: 94
3:09:33.734794 PROGRESS: Target precursors: 87 (92.55%)
3:09:33.734862 PROGRESS: Decoy precursors: 7 (7.45%)
3:09:33.734926 PROGRESS: 
3:09:33.734988 PROGRESS: Precursor Summary:
3:09:33.736444 PROGRESS: Channel   0:	 0.05 FDR:    78; 0.01 FDR:    44; 0.001 FDR:    44
3:09:33.736556 PROGRESS: 
3:09:33.736629 PROGRESS: Protein Summary:
3:09:33.738311 PROGRESS: Channel   0:	 0.05 FDR:    78; 0.01 FDR:    44; 0.001 FDR:    44
3:09:33.738433 PROGRESS: =========================================================================
3:09:33.739308 PROGRESS: === Epoch 12, step 3, extracting elution groups 7000 to 15000 ===
3:09:33.830295 PROGRESS: Extracting batch of 15797 precursors
3:09:33.835701 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:09:33.835768 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:09:33.835802 INFO: FWHM in RT is 14.32 seconds, sigma is 0.52
3:09:33.835844 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:09:33.836059 INFO: Starting candidate selection
3:09:38.048668 INFO: Starting candidate scoring
3:09:39.470218 INFO: Finished candidate processing
3:09:39.470310 INFO: Collecting candidate features
3:09:41.667313 WARNING: intensity_correlation has 15 NaNs ( 0.10 % out of 14704)
3:09:41.673289 INFO: Collecting fragment features
3:09:42.328946 INFO: Finished candidate scoring
3:09:42.623722 PROGRESS: === Epoch 12, step 3, extracted 14704 precursors and 71114 fragments ===
3:09:42.624035 INFO: performing precursor FDR with 47 features
3:09:42.624081 INFO: Decoy channel: -1
3:09:42.624109 INFO: Competetive: True
3:09:42.652900 WARNING: dropped 12 target PSMs due to missing features
3:09:42.653014 WARNING: dropped 13 decoy PSMs due to missing features
3:09:43.404405 INFO: Test AUC: 0.544
3:09:43.404562 INFO: Train AUC: 0.588
3:09:43.404632 INFO: AUC difference: 7.47%
3:09:43.404668 WARNING: AUC difference > 5%. This may indicate overfitting.
3:09:43.529556 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
3:09:43.530459 PROGRESS: ============================= Precursor FDR =============================
3:09:43.530588 PROGRESS: Total precursors accumulated: 188
3:09:43.530667 PROGRESS: Target precursors: 173 (92.02%)
3:09:43.530737 PROGRESS: Decoy precursors: 15 (7.98%)
3:09:43.530801 PROGRESS: 
3:09:43.530862 PROGRESS: Precursor Summary:
3:09:43.532368 PROGRESS: Channel   0:	 0.05 FDR:   142; 0.01 FDR:   101; 0.001 FDR:    87
3:09:43.532480 PROGRESS: 
3:09:43.532554 PROGRESS: Protein Summary:
3:09:43.534309 PROGRESS: Channel   0:	 0.05 FDR:   142; 0.01 FDR:   101; 0.001 FDR:    87
3:09:43.534421 PROGRESS: =========================================================================
3:09:43.535331 PROGRESS: === Epoch 12, step 4, extracting elution groups 15000 to 31000 ===
3:09:43.643101 PROGRESS: Extracting batch of 31586 precursors
3:09:43.653557 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:09:43.653670 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:09:43.653710 INFO: FWHM in RT is 14.32 seconds, sigma is 0.52
3:09:43.653739 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:09:43.653990 INFO: Starting candidate selection
3:09:48.190227 INFO: Starting candidate scoring
3:09:49.760535 INFO: Finished candidate processing
3:09:49.760632 INFO: Collecting candidate features
3:09:52.040270 WARNING: intensity_correlation has 42 NaNs ( 0.14 % out of 29352)
3:09:52.047714 INFO: Collecting fragment features
3:09:52.731933 INFO: Finished candidate scoring
3:09:53.048306 PROGRESS: === Epoch 12, step 4, extracted 29352 precursors and 141399 fragments ===
3:09:53.048657 INFO: performing precursor FDR with 47 features
3:09:53.048703 INFO: Decoy channel: -1
3:09:53.048728 INFO: Competetive: True
3:09:53.107337 WARNING: dropped 29 target PSMs due to missing features
3:09:53.107446 WARNING: dropped 38 decoy PSMs due to missing features
3:09:55.051194 INFO: Test AUC: 0.553
3:09:55.051356 INFO: Train AUC: 0.595
3:09:55.051405 INFO: AUC difference: 6.94%
3:09:55.051440 WARNING: AUC difference > 5%. This may indicate overfitting.
3:09:55.196247 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
3:09:55.197402 PROGRESS: ============================= Precursor FDR =============================
3:09:55.197529 PROGRESS: Total precursors accumulated: 742
3:09:55.197608 PROGRESS: Target precursors: 675 (90.97%)
3:09:55.197676 PROGRESS: Decoy precursors: 67 (9.03%)
3:09:55.197740 PROGRESS: 
3:09:55.197812 PROGRESS: Precursor Summary:
3:09:55.199475 PROGRESS: Channel   0:	 0.05 FDR:   324; 0.01 FDR:   241; 0.001 FDR:   215
3:09:55.199614 PROGRESS: 
3:09:55.199689 PROGRESS: Protein Summary:
3:09:55.201643 PROGRESS: Channel   0:	 0.05 FDR:   317; 0.01 FDR:   236; 0.001 FDR:   212
3:09:55.201756 PROGRESS: =========================================================================
3:09:55.202782 PROGRESS: === Epoch 12, step 5, extracting elution groups 31000 to 63000 ===
3:09:55.341428 PROGRESS: Extracting batch of 63230 precursors
3:09:55.361105 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:09:55.361214 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:09:55.361252 INFO: FWHM in RT is 14.32 seconds, sigma is 0.52
3:09:55.361277 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:09:55.361539 INFO: Starting candidate selection
3:10:00.510906 INFO: Starting candidate scoring
3:10:02.384069 INFO: Finished candidate processing
3:10:02.384252 INFO: Collecting candidate features
3:10:04.752994 WARNING: intensity_correlation has 67 NaNs ( 0.11 % out of 58855)
3:10:04.761758 INFO: Collecting fragment features
3:10:05.470244 INFO: Finished candidate scoring
3:10:05.816750 PROGRESS: === Epoch 12, step 5, extracted 58855 precursors and 283642 fragments ===
3:10:05.817101 INFO: performing precursor FDR with 47 features
3:10:05.817147 INFO: Decoy channel: -1
3:10:05.817172 INFO: Competetive: True
3:10:05.946400 WARNING: dropped 57 target PSMs due to missing features
3:10:05.946515 WARNING: dropped 77 decoy PSMs due to missing features
3:10:09.801044 INFO: Test AUC: 0.552
3:10:09.801172 INFO: Train AUC: 0.590
3:10:09.801212 INFO: AUC difference: 6.44%
3:10:09.801239 WARNING: AUC difference > 5%. This may indicate overfitting.
3:10:09.938866 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
3:10:09.940190 PROGRESS: ============================= Precursor FDR =============================
3:10:09.940314 PROGRESS: Total precursors accumulated: 1,353
3:10:09.940392 PROGRESS: Target precursors: 1,231 (90.98%)
3:10:09.940459 PROGRESS: Decoy precursors: 122 (9.02%)
3:10:09.940522 PROGRESS: 
3:10:09.940595 PROGRESS: Precursor Summary:
3:10:09.942463 PROGRESS: Channel   0:	 0.05 FDR:   791; 0.01 FDR:   437; 0.001 FDR:   343
3:10:09.942580 PROGRESS: 
3:10:09.942654 PROGRESS: Protein Summary:
3:10:09.944891 PROGRESS: Channel   0:	 0.05 FDR:   759; 0.01 FDR:   418; 0.001 FDR:   330
3:10:09.945018 PROGRESS: =========================================================================
3:10:09.946149 PROGRESS: === Epoch 12, step 6, extracting elution groups 63000 to 127000 ===
3:10:10.121807 PROGRESS: Extracting batch of 126437 precursors
3:10:10.160641 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:10:10.160757 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:10:10.160797 INFO: FWHM in RT is 14.32 seconds, sigma is 0.52
3:10:10.160840 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:10:10.161099 INFO: Starting candidate selection
3:10:16.654174 INFO: Starting candidate scoring
3:10:19.158523 INFO: Finished candidate processing
3:10:19.158673 INFO: Collecting candidate features
3:10:21.713757 WARNING: intensity_correlation has 155 NaNs ( 0.13 % out of 117931)
3:10:21.727132 INFO: Collecting fragment features
3:10:22.501922 INFO: Finished candidate scoring
3:10:22.928664 PROGRESS: === Epoch 12, step 6, extracted 117931 precursors and 567675 fragments ===
3:10:22.929017 INFO: performing precursor FDR with 47 features
3:10:22.929065 INFO: Decoy channel: -1
3:10:22.929091 INFO: Competetive: True
3:10:23.203339 WARNING: dropped 130 target PSMs due to missing features
3:10:23.203456 WARNING: dropped 159 decoy PSMs due to missing features
3:10:31.670706 INFO: Test AUC: 0.548
3:10:31.670855 INFO: Train AUC: 0.582
3:10:31.670896 INFO: AUC difference: 5.84%
3:10:31.670924 WARNING: AUC difference > 5%. This may indicate overfitting.
3:10:31.825311 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
3:10:31.827152 PROGRESS: ============================= Precursor FDR =============================
3:10:31.827304 PROGRESS: Total precursors accumulated: 2,842
3:10:31.827397 PROGRESS: Target precursors: 2,592 (91.20%)
3:10:31.827468 PROGRESS: Decoy precursors: 250 (8.80%)
3:10:31.827534 PROGRESS: 
3:10:31.827597 PROGRESS: Precursor Summary:
3:10:31.829710 PROGRESS: Channel   0:	 0.05 FDR: 1,424; 0.01 FDR:   830; 0.001 FDR:   368
3:10:31.829853 PROGRESS: 
3:10:31.829928 PROGRESS: Protein Summary:
3:10:31.832571 PROGRESS: Channel   0:	 0.05 FDR: 1,289; 0.01 FDR:   750; 0.001 FDR:   346
3:10:31.832705 PROGRESS: =========================================================================
3:10:31.834059 PROGRESS: === Epoch 12, step 7, extracting elution groups 127000 to 255000 ===
3:10:32.060639 PROGRESS: Extracting batch of 252906 precursors
3:10:32.133074 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:10:32.133189 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:10:32.133226 INFO: FWHM in RT is 14.32 seconds, sigma is 0.52
3:10:32.133270 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:10:32.133532 INFO: Starting candidate selection
3:10:41.162380 INFO: Starting candidate scoring
3:10:44.872511 INFO: Finished candidate processing
3:10:44.872696 INFO: Collecting candidate features
3:10:47.802799 WARNING: intensity_correlation has 289 NaNs ( 0.12 % out of 235920)
3:10:47.823216 INFO: Collecting fragment features
3:10:48.682881 INFO: Finished candidate scoring
3:10:49.263475 PROGRESS: === Epoch 12, step 7, extracted 235920 precursors and 1138447 fragments ===
3:10:49.263829 INFO: performing precursor FDR with 47 features
3:10:49.263878 INFO: Decoy channel: -1
3:10:49.263904 INFO: Competetive: True
3:10:49.853800 WARNING: dropped 277 target PSMs due to missing features
3:10:49.853931 WARNING: dropped 301 decoy PSMs due to missing features
3:11:06.890323 INFO: Test AUC: 0.553
3:11:06.890468 INFO: Train AUC: 0.573
3:11:06.890510 INFO: AUC difference: 3.49%
3:11:07.072714 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
3:11:07.074942 PROGRESS: ============================= Precursor FDR =============================
3:11:07.075096 PROGRESS: Total precursors accumulated: 4,132
3:11:07.075178 PROGRESS: Target precursors: 3,765 (91.12%)
3:11:07.075247 PROGRESS: Decoy precursors: 367 (8.88%)
3:11:07.075313 PROGRESS: 
3:11:07.075376 PROGRESS: Precursor Summary:
3:11:07.078198 PROGRESS: Channel   0:	 0.05 FDR: 2,692; 0.01 FDR: 1,732; 0.001 FDR: 1,401
3:11:07.078325 PROGRESS: 
3:11:07.078399 PROGRESS: Protein Summary:
3:11:07.082127 PROGRESS: Channel   0:	 0.05 FDR: 2,203; 0.01 FDR: 1,378; 0.001 FDR: 1,132
3:11:07.082245 PROGRESS: =========================================================================
3:11:07.084083 PROGRESS: === Epoch 12, step 8, extracting elution groups 255000 to 511000 ===
3:11:07.391437 PROGRESS: Extracting batch of 505749 precursors
3:11:07.525577 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:11:07.525690 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:11:07.525726 INFO: FWHM in RT is 14.32 seconds, sigma is 0.52
3:11:07.525780 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:11:07.526057 INFO: Starting candidate selection
3:11:21.726698 INFO: Starting candidate scoring
3:11:27.938765 INFO: Finished candidate processing
3:11:27.938859 INFO: Collecting candidate features
3:11:31.567168 WARNING: intensity_correlation has 544 NaNs ( 0.12 % out of 471189)
3:11:31.568224 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 471189)
3:11:31.600454 INFO: Collecting fragment features
3:11:32.656365 INFO: Finished candidate scoring
3:11:33.539276 PROGRESS: === Epoch 12, step 8, extracted 471189 precursors and 2274604 fragments ===
3:11:33.539643 INFO: performing precursor FDR with 47 features
3:11:33.546376 INFO: Decoy channel: -1
3:11:33.546532 INFO: Competetive: True
3:11:34.687078 WARNING: dropped 555 target PSMs due to missing features
3:11:34.687205 WARNING: dropped 567 decoy PSMs due to missing features
3:12:09.500079 INFO: Test AUC: 0.548
3:12:09.500212 INFO: Train AUC: 0.567
3:12:09.500269 INFO: AUC difference: 3.37%
3:12:09.740268 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
3:12:09.743353 PROGRESS: ============================= Precursor FDR =============================
3:12:09.743517 PROGRESS: Total precursors accumulated: 7,103
3:12:09.743595 PROGRESS: Target precursors: 6,474 (91.14%)
3:12:09.743663 PROGRESS: Decoy precursors: 629 (8.86%)
3:12:09.743740 PROGRESS: 
3:12:09.743805 PROGRESS: Precursor Summary:
3:12:09.747365 PROGRESS: Channel   0:	 0.05 FDR: 4,953; 0.01 FDR: 3,413; 0.001 FDR: 1,461
3:12:09.747511 PROGRESS: 
3:12:09.747584 PROGRESS: Protein Summary:
3:12:09.752610 PROGRESS: Channel   0:	 0.05 FDR: 3,464; 0.01 FDR: 2,347; 0.001 FDR: 1,145
3:12:09.752745 PROGRESS: =========================================================================
3:12:09.757061 INFO: calibration group: precursor, fitting rt estimator 
3:12:10.160259 INFO: calibration group: fragment, fitting mz estimator 
3:12:10.759939 INFO: === checking if epoch conditions were reached ===
3:12:10.760152 INFO: ✅ ms2_error      : 7.0000 <= 7
3:12:10.760241 INFO: ❌ rt_error       : 204.5923 > 100
3:12:10.760315 INFO: ✅ current_epoch  : 12 >= 3
3:12:10.760380 INFO: ==============================================
3:12:11.004208 INFO: calibration group: precursor, predicting mz
3:12:11.004477 WARNING: mz prediction was skipped as it has not been fitted yet
3:12:11.004518 INFO: calibration group: precursor, predicting rt
3:12:17.776744 INFO: calibration group: fragment, predicting mz
3:12:35.601176 PROGRESS: === Epoch 13, step 0, extracting elution groups 0 to 1000 ===
3:12:35.698765 PROGRESS: Extracting batch of 1977 precursors
3:12:35.700464 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:12:35.700552 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:12:35.700593 INFO: FWHM in RT is 14.13 seconds, sigma is 0.51
3:12:35.700623 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:12:35.700876 INFO: Starting candidate selection
3:12:40.071297 INFO: Starting candidate scoring
3:12:41.387010 INFO: Finished candidate processing
3:12:41.387140 INFO: Collecting candidate features
3:12:43.564123 WARNING: intensity_correlation has 4 NaNs ( 0.22 % out of 1812)
3:12:43.570064 INFO: Collecting fragment features
3:12:44.207427 INFO: Finished candidate scoring
3:12:44.552943 PROGRESS: === Epoch 13, step 0, extracted 1812 precursors and 8789 fragments ===
3:12:44.553271 INFO: performing precursor FDR with 47 features
3:12:44.553314 INFO: Decoy channel: -1
3:12:44.553341 INFO: Competetive: True
3:12:44.558048 WARNING: dropped 1 target PSMs due to missing features
3:12:44.558139 WARNING: dropped 3 decoy PSMs due to missing features
3:12:44.585693 INFO: Test AUC: 0.561
3:12:44.585799 INFO: Train AUC: 0.568
3:12:44.585846 INFO: AUC difference: 1.30%
3:12:44.705255 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
3:12:44.706034 PROGRESS: ============================= Precursor FDR =============================
3:12:44.706159 PROGRESS: Total precursors accumulated: 13
3:12:44.706236 PROGRESS: Target precursors: 12 (92.31%)
3:12:44.706305 PROGRESS: Decoy precursors: 1 (7.69%)
3:12:44.706367 PROGRESS: 
3:12:44.706429 PROGRESS: Precursor Summary:
3:12:44.707826 PROGRESS: Channel   0:	 0.05 FDR:     5; 0.01 FDR:     5; 0.001 FDR:     5
3:12:44.707942 PROGRESS: 
3:12:44.708016 PROGRESS: Protein Summary:
3:12:44.709592 PROGRESS: Channel   0:	 0.05 FDR:     5; 0.01 FDR:     5; 0.001 FDR:     5
3:12:44.709705 PROGRESS: =========================================================================
3:12:44.710565 PROGRESS: === Epoch 13, step 1, extracting elution groups 1000 to 3000 ===
3:12:44.787798 PROGRESS: Extracting batch of 3942 precursors
3:12:44.790007 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:12:44.790069 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:12:44.790108 INFO: FWHM in RT is 14.13 seconds, sigma is 0.51
3:12:44.790155 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:12:44.790372 INFO: Starting candidate selection
3:12:48.838228 INFO: Starting candidate scoring
3:12:50.163559 INFO: Finished candidate processing
3:12:50.163651 INFO: Collecting candidate features
3:12:52.352853 WARNING: intensity_correlation has 4 NaNs ( 0.11 % out of 3668)
3:12:52.358846 INFO: Collecting fragment features
3:12:53.010204 INFO: Finished candidate scoring
3:12:53.291666 PROGRESS: === Epoch 13, step 1, extracted 3668 precursors and 17563 fragments ===
3:12:53.291960 INFO: performing precursor FDR with 47 features
3:12:53.292006 INFO: Decoy channel: -1
3:12:53.292034 INFO: Competetive: True
3:12:53.300558 WARNING: dropped 3 target PSMs due to missing features
3:12:53.300649 WARNING: dropped 5 decoy PSMs due to missing features
3:12:53.338057 INFO: Test AUC: 0.545
3:12:53.338177 INFO: Train AUC: 0.554
3:12:53.338222 INFO: AUC difference: 1.59%
3:12:53.458615 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
3:12:53.459403 PROGRESS: ============================= Precursor FDR =============================
3:12:53.459536 PROGRESS: Total precursors accumulated: 30
3:12:53.459616 PROGRESS: Target precursors: 28 (93.33%)
3:12:53.459684 PROGRESS: Decoy precursors: 2 (6.67%)
3:12:53.459746 PROGRESS: 
3:12:53.459807 PROGRESS: Precursor Summary:
3:12:53.461244 PROGRESS: Channel   0:	 0.05 FDR:    25; 0.01 FDR:    16; 0.001 FDR:    16
3:12:53.461358 PROGRESS: 
3:12:53.461433 PROGRESS: Protein Summary:
3:12:53.463082 PROGRESS: Channel   0:	 0.05 FDR:    25; 0.01 FDR:    16; 0.001 FDR:    16
3:12:53.463209 PROGRESS: =========================================================================
3:12:53.464074 PROGRESS: === Epoch 13, step 2, extracting elution groups 3000 to 7000 ===
3:12:53.546341 PROGRESS: Extracting batch of 7911 precursors
3:12:53.549685 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:12:53.549748 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:12:53.549819 INFO: FWHM in RT is 14.13 seconds, sigma is 0.51
3:12:53.549851 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:12:53.550072 INFO: Starting candidate selection
3:12:57.645745 INFO: Starting candidate scoring
3:12:59.013887 INFO: Finished candidate processing
3:12:59.013981 INFO: Collecting candidate features
3:13:01.221540 WARNING: intensity_correlation has 3 NaNs ( 0.04 % out of 7322)
3:13:01.227065 INFO: Collecting fragment features
3:13:01.883346 INFO: Finished candidate scoring
3:13:02.171028 PROGRESS: === Epoch 13, step 2, extracted 7322 precursors and 35435 fragments ===
3:13:02.171360 INFO: performing precursor FDR with 47 features
3:13:02.171409 INFO: Decoy channel: -1
3:13:02.171436 INFO: Competetive: True
3:13:02.186655 WARNING: dropped 4 target PSMs due to missing features
3:13:02.186773 WARNING: dropped 7 decoy PSMs due to missing features
3:13:02.505079 INFO: Test AUC: 0.542
3:13:02.505214 INFO: Train AUC: 0.581
3:13:02.505259 INFO: AUC difference: 6.57%
3:13:02.505293 WARNING: AUC difference > 5%. This may indicate overfitting.
3:13:02.640895 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
3:13:02.641723 PROGRESS: ============================= Precursor FDR =============================
3:13:02.641856 PROGRESS: Total precursors accumulated: 72
3:13:02.641936 PROGRESS: Target precursors: 66 (91.67%)
3:13:02.642005 PROGRESS: Decoy precursors: 6 (8.33%)
3:13:02.642069 PROGRESS: 
3:13:02.642130 PROGRESS: Precursor Summary:
3:13:02.643605 PROGRESS: Channel   0:	 0.05 FDR:    50; 0.01 FDR:    44; 0.001 FDR:    44
3:13:02.643732 PROGRESS: 
3:13:02.643805 PROGRESS: Protein Summary:
3:13:02.645450 PROGRESS: Channel   0:	 0.05 FDR:    49; 0.01 FDR:    43; 0.001 FDR:    43
3:13:02.645561 PROGRESS: =========================================================================
3:13:02.646441 PROGRESS: === Epoch 13, step 3, extracting elution groups 7000 to 15000 ===
3:13:02.737736 PROGRESS: Extracting batch of 15809 precursors
3:13:02.743168 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:13:02.743233 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:13:02.743276 INFO: FWHM in RT is 14.13 seconds, sigma is 0.51
3:13:02.743318 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:13:02.743537 INFO: Starting candidate selection
3:13:06.991291 INFO: Starting candidate scoring
3:13:08.433632 INFO: Finished candidate processing
3:13:08.433728 INFO: Collecting candidate features
3:13:10.665142 WARNING: intensity_correlation has 14 NaNs ( 0.10 % out of 14636)
3:13:10.671987 INFO: Collecting fragment features
3:13:11.339399 INFO: Finished candidate scoring
3:13:11.636094 PROGRESS: === Epoch 13, step 3, extracted 14636 precursors and 70076 fragments ===
3:13:11.636427 INFO: performing precursor FDR with 47 features
3:13:11.636476 INFO: Decoy channel: -1
3:13:11.636504 INFO: Competetive: True
3:13:11.665366 WARNING: dropped 9 target PSMs due to missing features
3:13:11.665479 WARNING: dropped 16 decoy PSMs due to missing features
3:13:12.366893 INFO: Test AUC: 0.561
3:13:12.367293 INFO: Train AUC: 0.592
3:13:12.374149 INFO: AUC difference: 5.32%
3:13:12.374264 WARNING: AUC difference > 5%. This may indicate overfitting.
3:13:12.498410 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
3:13:12.499335 PROGRESS: ============================= Precursor FDR =============================
3:13:12.499454 PROGRESS: Total precursors accumulated: 275
3:13:12.499533 PROGRESS: Target precursors: 252 (91.64%)
3:13:12.499601 PROGRESS: Decoy precursors: 23 (8.36%)
3:13:12.499665 PROGRESS: 
3:13:12.499726 PROGRESS: Precursor Summary:
3:13:12.501257 PROGRESS: Channel   0:	 0.05 FDR:   161; 0.01 FDR:    97; 0.001 FDR:    97
3:13:12.501370 PROGRESS: 
3:13:12.501443 PROGRESS: Protein Summary:
3:13:12.503215 PROGRESS: Channel   0:	 0.05 FDR:   160; 0.01 FDR:    96; 0.001 FDR:    96
3:13:12.503324 PROGRESS: =========================================================================
3:13:12.504254 PROGRESS: === Epoch 13, step 4, extracting elution groups 15000 to 31000 ===
3:13:12.611696 PROGRESS: Extracting batch of 31625 precursors
3:13:12.622215 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:13:12.622312 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:13:12.622350 INFO: FWHM in RT is 14.13 seconds, sigma is 0.51
3:13:12.622378 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:13:12.622618 INFO: Starting candidate selection
3:13:17.195014 INFO: Starting candidate scoring
3:13:18.790721 INFO: Finished candidate processing
3:13:18.790912 INFO: Collecting candidate features
3:13:21.074978 WARNING: intensity_correlation has 27 NaNs ( 0.09 % out of 29379)
3:13:21.081973 INFO: Collecting fragment features
3:13:21.769708 INFO: Finished candidate scoring
3:13:22.083532 PROGRESS: === Epoch 13, step 4, extracted 29379 precursors and 141280 fragments ===
3:13:22.083858 INFO: performing precursor FDR with 47 features
3:13:22.083906 INFO: Decoy channel: -1
3:13:22.083933 INFO: Competetive: True
3:13:22.143178 WARNING: dropped 24 target PSMs due to missing features
3:13:22.143288 WARNING: dropped 28 decoy PSMs due to missing features
3:13:24.055910 INFO: Test AUC: 0.557
3:13:24.063020 INFO: Train AUC: 0.601
3:13:24.063209 INFO: AUC difference: 7.24%
3:13:24.063304 WARNING: AUC difference > 5%. This may indicate overfitting.
3:13:24.189840 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
3:13:24.190974 PROGRESS: ============================= Precursor FDR =============================
3:13:24.191093 PROGRESS: Total precursors accumulated: 935
3:13:24.191170 PROGRESS: Target precursors: 854 (91.34%)
3:13:24.191238 PROGRESS: Decoy precursors: 81 (8.66%)
3:13:24.191300 PROGRESS: 
3:13:24.191361 PROGRESS: Precursor Summary:
3:13:24.193048 PROGRESS: Channel   0:	 0.05 FDR:   467; 0.01 FDR:   229; 0.001 FDR:   223
3:13:24.193177 PROGRESS: 
3:13:24.193253 PROGRESS: Protein Summary:
3:13:24.195256 PROGRESS: Channel   0:	 0.05 FDR:   454; 0.01 FDR:   222; 0.001 FDR:   216
3:13:24.195384 PROGRESS: =========================================================================
3:13:24.196389 PROGRESS: === Epoch 13, step 5, extracting elution groups 31000 to 63000 ===
3:13:24.332263 PROGRESS: Extracting batch of 63211 precursors
3:13:24.352650 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:13:24.352771 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:13:24.352810 INFO: FWHM in RT is 14.13 seconds, sigma is 0.51
3:13:24.352837 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:13:24.353084 INFO: Starting candidate selection
3:13:29.602603 INFO: Starting candidate scoring
3:13:31.509946 INFO: Finished candidate processing
3:13:31.510134 INFO: Collecting candidate features
3:13:33.854425 WARNING: intensity_correlation has 54 NaNs ( 0.09 % out of 58882)
3:13:33.863285 INFO: Collecting fragment features
3:13:34.577020 INFO: Finished candidate scoring
3:13:34.925383 PROGRESS: === Epoch 13, step 5, extracted 58882 precursors and 284115 fragments ===
3:13:34.925725 INFO: performing precursor FDR with 47 features
3:13:34.925785 INFO: Decoy channel: -1
3:13:34.925812 INFO: Competetive: True
3:13:35.054410 WARNING: dropped 49 target PSMs due to missing features
3:13:35.054530 WARNING: dropped 57 decoy PSMs due to missing features
3:13:39.037212 INFO: Test AUC: 0.557
3:13:39.037334 INFO: Train AUC: 0.596
3:13:39.037388 INFO: AUC difference: 6.60%
3:13:39.037423 WARNING: AUC difference > 5%. This may indicate overfitting.
3:13:39.173015 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
3:13:39.174410 PROGRESS: ============================= Precursor FDR =============================
3:13:39.174547 PROGRESS: Total precursors accumulated: 1,580
3:13:39.174629 PROGRESS: Target precursors: 1,442 (91.27%)
3:13:39.174698 PROGRESS: Decoy precursors: 138 (8.73%)
3:13:39.174762 PROGRESS: 
3:13:39.174823 PROGRESS: Precursor Summary:
3:13:39.176669 PROGRESS: Channel   0:	 0.05 FDR:   827; 0.01 FDR:   404; 0.001 FDR:   305
3:13:39.176798 PROGRESS: 
3:13:39.176872 PROGRESS: Protein Summary:
3:13:39.179103 PROGRESS: Channel   0:	 0.05 FDR:   786; 0.01 FDR:   382; 0.001 FDR:   293
3:13:39.179229 PROGRESS: =========================================================================
3:13:39.180319 PROGRESS: === Epoch 13, step 6, extracting elution groups 63000 to 127000 ===
3:13:39.356289 PROGRESS: Extracting batch of 126434 precursors
3:13:39.394859 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:13:39.394969 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:13:39.395006 INFO: FWHM in RT is 14.13 seconds, sigma is 0.51
3:13:39.395049 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:13:39.395307 INFO: Starting candidate selection
3:13:45.902799 INFO: Starting candidate scoring
3:13:48.387696 INFO: Finished candidate processing
3:13:48.387878 INFO: Collecting candidate features
3:13:50.916933 WARNING: intensity_correlation has 130 NaNs ( 0.11 % out of 117484)
3:13:50.929491 INFO: Collecting fragment features
3:13:51.699151 INFO: Finished candidate scoring
3:13:52.123232 PROGRESS: === Epoch 13, step 6, extracted 117484 precursors and 566104 fragments ===
3:13:52.123579 INFO: performing precursor FDR with 47 features
3:13:52.123623 INFO: Decoy channel: -1
3:13:52.123649 INFO: Competetive: True
3:13:52.391231 WARNING: dropped 123 target PSMs due to missing features
3:13:52.391348 WARNING: dropped 113 decoy PSMs due to missing features
3:14:00.323629 INFO: Test AUC: 0.557
3:14:00.323762 INFO: Train AUC: 0.584
3:14:00.323817 INFO: AUC difference: 4.54%
3:14:00.475101 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
3:14:00.476763 PROGRESS: ============================= Precursor FDR =============================
3:14:00.476907 PROGRESS: Total precursors accumulated: 2,431
3:14:00.476988 PROGRESS: Target precursors: 2,218 (91.24%)
3:14:00.477056 PROGRESS: Decoy precursors: 213 (8.76%)
3:14:00.477119 PROGRESS: 
3:14:00.477180 PROGRESS: Precursor Summary:
3:14:00.479277 PROGRESS: Channel   0:	 0.05 FDR: 1,288; 0.01 FDR:   787; 0.001 FDR:   510
3:14:00.479422 PROGRESS: 
3:14:00.479501 PROGRESS: Protein Summary:
3:14:00.482157 PROGRESS: Channel   0:	 0.05 FDR: 1,162; 0.01 FDR:   708; 0.001 FDR:   474
3:14:00.482272 PROGRESS: =========================================================================
3:14:00.483609 PROGRESS: === Epoch 13, step 7, extracting elution groups 127000 to 255000 ===
3:14:00.709395 PROGRESS: Extracting batch of 252880 precursors
3:14:00.781870 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:14:00.782007 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:14:00.782048 INFO: FWHM in RT is 14.13 seconds, sigma is 0.51
3:14:00.782076 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:14:00.782356 INFO: Starting candidate selection
3:14:09.856390 INFO: Starting candidate scoring
3:14:13.589501 INFO: Finished candidate processing
3:14:13.589685 INFO: Collecting candidate features
3:14:16.525643 WARNING: intensity_correlation has 196 NaNs ( 0.08 % out of 235311)
3:14:16.546108 INFO: Collecting fragment features
3:14:17.382579 INFO: Finished candidate scoring
3:14:17.964879 PROGRESS: === Epoch 13, step 7, extracted 235311 precursors and 1134429 fragments ===
3:14:17.965224 INFO: performing precursor FDR with 47 features
3:14:17.965271 INFO: Decoy channel: -1
3:14:17.965299 INFO: Competetive: True
3:14:18.551404 WARNING: dropped 222 target PSMs due to missing features
3:14:18.551526 WARNING: dropped 210 decoy PSMs due to missing features
3:14:35.689602 INFO: Test AUC: 0.552
3:14:35.689738 INFO: Train AUC: 0.573
3:14:35.689808 INFO: AUC difference: 3.72%
3:14:35.871413 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
3:14:35.873664 PROGRESS: ============================= Precursor FDR =============================
3:14:35.873826 PROGRESS: Total precursors accumulated: 4,413
3:14:35.873909 PROGRESS: Target precursors: 4,027 (91.25%)
3:14:35.873977 PROGRESS: Decoy precursors: 386 (8.75%)
3:14:35.874040 PROGRESS: 
3:14:35.874101 PROGRESS: Precursor Summary:
3:14:35.876849 PROGRESS: Channel   0:	 0.05 FDR: 2,803; 0.01 FDR: 1,772; 0.001 FDR: 1,121
3:14:35.876968 PROGRESS: 
3:14:35.877040 PROGRESS: Protein Summary:
3:14:35.880687 PROGRESS: Channel   0:	 0.05 FDR: 2,341; 0.01 FDR: 1,459; 0.001 FDR:   946
3:14:35.880817 PROGRESS: =========================================================================
3:14:35.882690 PROGRESS: === Epoch 13, step 8, extracting elution groups 255000 to 511000 ===
3:14:36.186978 PROGRESS: Extracting batch of 505842 precursors
3:14:36.318387 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:14:36.318502 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:14:36.318540 INFO: FWHM in RT is 14.13 seconds, sigma is 0.51
3:14:36.318583 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:14:36.318850 INFO: Starting candidate selection
3:14:50.467696 INFO: Starting candidate scoring
3:14:56.555057 INFO: Finished candidate processing
3:14:56.555249 INFO: Collecting candidate features
3:15:00.191745 WARNING: intensity_correlation has 408 NaNs ( 0.09 % out of 470565)
3:15:00.225080 INFO: Collecting fragment features
3:15:01.253210 INFO: Finished candidate scoring
3:15:02.137016 PROGRESS: === Epoch 13, step 8, extracted 470565 precursors and 2269093 fragments ===
3:15:02.137376 INFO: performing precursor FDR with 47 features
3:15:02.144132 INFO: Decoy channel: -1
3:15:02.144287 INFO: Competetive: True
3:15:03.264370 WARNING: dropped 415 target PSMs due to missing features
3:15:03.264494 WARNING: dropped 425 decoy PSMs due to missing features
3:15:37.601538 INFO: Test AUC: 0.550
3:15:37.601688 INFO: Train AUC: 0.567
3:15:37.601729 INFO: AUC difference: 2.90%
3:15:37.838930 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
3:15:37.841784 PROGRESS: ============================= Precursor FDR =============================
3:15:37.841945 PROGRESS: Total precursors accumulated: 6,792
3:15:37.842022 PROGRESS: Target precursors: 6,191 (91.15%)
3:15:37.842088 PROGRESS: Decoy precursors: 601 (8.85%)
3:15:37.842149 PROGRESS: 
3:15:37.842239 PROGRESS: Precursor Summary:
3:15:37.845835 PROGRESS: Channel   0:	 0.05 FDR: 4,743; 0.01 FDR: 3,470; 0.001 FDR: 2,557
3:15:37.845991 PROGRESS: 
3:15:37.846067 PROGRESS: Protein Summary:
3:15:37.851366 PROGRESS: Channel   0:	 0.05 FDR: 3,334; 0.01 FDR: 2,423; 0.001 FDR: 1,838
3:15:37.851522 PROGRESS: =========================================================================
3:15:37.855875 INFO: calibration group: precursor, fitting rt estimator 
3:15:38.260421 INFO: calibration group: fragment, fitting mz estimator 
3:15:38.859617 INFO: === checking if epoch conditions were reached ===
3:15:38.859824 INFO: ✅ ms2_error      : 7.0000 <= 7
3:15:38.859914 INFO: ❌ rt_error       : 202.5218 > 100
3:15:38.859988 INFO: ✅ current_epoch  : 13 >= 3
3:15:38.860053 INFO: ==============================================
3:15:39.076751 INFO: calibration group: precursor, predicting mz
3:15:39.077026 WARNING: mz prediction was skipped as it has not been fitted yet
3:15:39.077067 INFO: calibration group: precursor, predicting rt
3:15:45.866815 INFO: calibration group: fragment, predicting mz
3:16:03.688632 PROGRESS: === Epoch 14, step 0, extracting elution groups 0 to 1000 ===
3:16:03.788122 PROGRESS: Extracting batch of 1975 precursors
3:16:03.789826 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:16:03.789903 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:16:03.789961 INFO: FWHM in RT is 14.25 seconds, sigma is 0.52
3:16:03.789992 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:16:03.790250 INFO: Starting candidate selection
3:16:08.126568 INFO: Starting candidate scoring
3:16:09.406254 INFO: Finished candidate processing
3:16:09.406359 INFO: Collecting candidate features
3:16:11.554733 WARNING: intensity_correlation has 2 NaNs ( 0.11 % out of 1826)
3:16:11.560534 INFO: Collecting fragment features
3:16:12.191918 INFO: Finished candidate scoring
3:16:12.534592 PROGRESS: === Epoch 14, step 0, extracted 1826 precursors and 8876 fragments ===
3:16:12.534908 INFO: performing precursor FDR with 47 features
3:16:12.534954 INFO: Decoy channel: -1
3:16:12.534981 INFO: Competetive: True
3:16:12.539714 WARNING: dropped 1 target PSMs due to missing features
3:16:12.539788 WARNING: dropped 1 decoy PSMs due to missing features
3:16:12.567266 INFO: Test AUC: 0.541
3:16:12.567364 INFO: Train AUC: 0.553
3:16:12.567409 INFO: AUC difference: 2.17%
3:16:12.686988 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
3:16:12.687781 PROGRESS: ============================= Precursor FDR =============================
3:16:12.687900 PROGRESS: Total precursors accumulated: 7
3:16:12.687978 PROGRESS: Target precursors: 7 (100.00%)
3:16:12.688046 PROGRESS: Decoy precursors: 0 (0.00%)
3:16:12.688111 PROGRESS: 
3:16:12.688172 PROGRESS: Precursor Summary:
3:16:12.689661 PROGRESS: Channel   0:	 0.05 FDR:     7; 0.01 FDR:     7; 0.001 FDR:     7
3:16:12.689778 PROGRESS: 
3:16:12.689857 PROGRESS: Protein Summary:
3:16:12.691546 PROGRESS: Channel   0:	 0.05 FDR:     7; 0.01 FDR:     7; 0.001 FDR:     7
3:16:12.691670 PROGRESS: =========================================================================
3:16:12.692555 PROGRESS: === Epoch 14, step 1, extracting elution groups 1000 to 3000 ===
3:16:12.769711 PROGRESS: Extracting batch of 3956 precursors
3:16:12.771826 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:16:12.771901 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:16:12.771942 INFO: FWHM in RT is 14.25 seconds, sigma is 0.52
3:16:12.771972 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:16:12.772184 INFO: Starting candidate selection
3:16:19.834395 INFO: Starting candidate scoring
3:16:21.166672 INFO: Finished candidate processing
3:16:21.166760 INFO: Collecting candidate features
3:16:23.353701 WARNING: intensity_correlation has 2 NaNs ( 0.05 % out of 3689)
3:16:23.359680 INFO: Collecting fragment features
3:16:23.981271 INFO: Finished candidate scoring
3:16:24.267941 PROGRESS: === Epoch 14, step 1, extracted 3689 precursors and 17697 fragments ===
3:16:24.268285 INFO: performing precursor FDR with 47 features
3:16:24.268331 INFO: Decoy channel: -1
3:16:24.268357 INFO: Competetive: True
3:16:24.277331 WARNING: dropped 3 target PSMs due to missing features
3:16:24.277418 WARNING: dropped 1 decoy PSMs due to missing features
3:16:24.315064 INFO: Test AUC: 0.544
3:16:24.315184 INFO: Train AUC: 0.544
3:16:24.315230 INFO: AUC difference: 0.07%
3:16:24.437700 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
3:16:24.438510 PROGRESS: ============================= Precursor FDR =============================
3:16:24.438633 PROGRESS: Total precursors accumulated: 18
3:16:24.438713 PROGRESS: Target precursors: 17 (94.44%)
3:16:24.438781 PROGRESS: Decoy precursors: 1 (5.56%)
3:16:24.438844 PROGRESS: 
3:16:24.438906 PROGRESS: Precursor Summary:
3:16:24.440306 PROGRESS: Channel   0:	 0.05 FDR:    14; 0.01 FDR:    14; 0.001 FDR:    14
3:16:24.440423 PROGRESS: 
3:16:24.440498 PROGRESS: Protein Summary:
3:16:24.442096 PROGRESS: Channel   0:	 0.05 FDR:    14; 0.01 FDR:    14; 0.001 FDR:    14
3:16:24.442208 PROGRESS: =========================================================================
3:16:24.443046 PROGRESS: === Epoch 14, step 2, extracting elution groups 3000 to 7000 ===
3:16:24.525553 PROGRESS: Extracting batch of 7885 precursors
3:16:24.529176 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:16:24.529248 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:16:24.529286 INFO: FWHM in RT is 14.25 seconds, sigma is 0.52
3:16:24.529333 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:16:24.529566 INFO: Starting candidate selection
3:16:28.622681 INFO: Starting candidate scoring
3:16:29.974663 INFO: Finished candidate processing
3:16:29.974874 INFO: Collecting candidate features
3:16:32.147584 WARNING: intensity_correlation has 3 NaNs ( 0.04 % out of 7324)
3:16:32.154282 INFO: Collecting fragment features
3:16:32.773453 INFO: Finished candidate scoring
3:16:33.062306 PROGRESS: === Epoch 14, step 2, extracted 7324 precursors and 35131 fragments ===
3:16:33.062637 INFO: performing precursor FDR with 47 features
3:16:33.062681 INFO: Decoy channel: -1
3:16:33.062708 INFO: Competetive: True
3:16:33.078051 WARNING: dropped 4 target PSMs due to missing features
3:16:33.078155 WARNING: dropped 3 decoy PSMs due to missing features
3:16:33.332685 INFO: Test AUC: 0.553
3:16:33.332819 INFO: Train AUC: 0.573
3:16:33.332865 INFO: AUC difference: 3.53%
3:16:33.456392 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
3:16:33.457253 PROGRESS: ============================= Precursor FDR =============================
3:16:33.457373 PROGRESS: Total precursors accumulated: 122
3:16:33.457450 PROGRESS: Target precursors: 112 (91.80%)
3:16:33.457540 PROGRESS: Decoy precursors: 10 (8.20%)
3:16:33.457604 PROGRESS: 
3:16:33.457665 PROGRESS: Precursor Summary:
3:16:33.459141 PROGRESS: Channel   0:	 0.05 FDR:    50; 0.01 FDR:    44; 0.001 FDR:    44
3:16:33.459271 PROGRESS: 
3:16:33.459343 PROGRESS: Protein Summary:
3:16:33.460975 PROGRESS: Channel   0:	 0.05 FDR:    50; 0.01 FDR:    44; 0.001 FDR:    44
3:16:33.461101 PROGRESS: =========================================================================
3:16:33.461983 PROGRESS: === Epoch 14, step 3, extracting elution groups 7000 to 15000 ===
3:16:33.553402 PROGRESS: Extracting batch of 15785 precursors
3:16:33.559027 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:16:33.559093 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:16:33.559128 INFO: FWHM in RT is 14.25 seconds, sigma is 0.52
3:16:33.559168 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:16:33.559390 INFO: Starting candidate selection
3:16:37.807437 INFO: Starting candidate scoring
3:16:39.236192 INFO: Finished candidate processing
3:16:39.236367 INFO: Collecting candidate features
3:16:41.473185 WARNING: intensity_correlation has 15 NaNs ( 0.10 % out of 14682)
3:16:41.479212 INFO: Collecting fragment features
3:16:42.118063 INFO: Finished candidate scoring
3:16:42.419484 PROGRESS: === Epoch 14, step 3, extracted 14682 precursors and 71043 fragments ===
3:16:42.419823 INFO: performing precursor FDR with 47 features
3:16:42.419871 INFO: Decoy channel: -1
3:16:42.419897 INFO: Competetive: True
3:16:42.449203 WARNING: dropped 13 target PSMs due to missing features
3:16:42.449316 WARNING: dropped 9 decoy PSMs due to missing features
3:16:43.311571 INFO: Test AUC: 0.546
3:16:43.311717 INFO: Train AUC: 0.588
3:16:43.311779 INFO: AUC difference: 7.03%
3:16:43.311818 WARNING: AUC difference > 5%. This may indicate overfitting.
3:16:43.440015 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
3:16:43.441067 PROGRESS: ============================= Precursor FDR =============================
3:16:43.441192 PROGRESS: Total precursors accumulated: 411
3:16:43.441271 PROGRESS: Target precursors: 376 (91.48%)
3:16:43.441340 PROGRESS: Decoy precursors: 35 (8.52%)
3:16:43.441404 PROGRESS: 
3:16:43.441465 PROGRESS: Precursor Summary:
3:16:43.443076 PROGRESS: Channel   0:	 0.05 FDR:   188; 0.01 FDR:   103; 0.001 FDR:    97
3:16:43.443215 PROGRESS: 
3:16:43.443289 PROGRESS: Protein Summary:
3:16:43.445104 PROGRESS: Channel   0:	 0.05 FDR:   185; 0.01 FDR:   100; 0.001 FDR:    94
3:16:43.445230 PROGRESS: =========================================================================
3:16:43.446161 PROGRESS: === Epoch 14, step 4, extracting elution groups 15000 to 31000 ===
3:16:43.554910 PROGRESS: Extracting batch of 31617 precursors
3:16:43.565440 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:16:43.565554 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:16:43.565593 INFO: FWHM in RT is 14.25 seconds, sigma is 0.52
3:16:43.565621 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:16:43.565902 INFO: Starting candidate selection
3:16:48.199462 INFO: Starting candidate scoring
3:16:49.799148 INFO: Finished candidate processing
3:16:49.799341 INFO: Collecting candidate features
3:16:52.071602 WARNING: intensity_correlation has 31 NaNs ( 0.11 % out of 29422)
3:16:52.078655 INFO: Collecting fragment features
3:16:52.744531 INFO: Finished candidate scoring
3:16:53.069096 PROGRESS: === Epoch 14, step 4, extracted 29422 precursors and 141624 fragments ===
3:16:53.069455 INFO: performing precursor FDR with 47 features
3:16:53.069504 INFO: Decoy channel: -1
3:16:53.069530 INFO: Competetive: True
3:16:53.128069 WARNING: dropped 35 target PSMs due to missing features
3:16:53.128178 WARNING: dropped 18 decoy PSMs due to missing features
3:16:55.198518 INFO: Test AUC: 0.548
3:16:55.198666 INFO: Train AUC: 0.596
3:16:55.198714 INFO: AUC difference: 8.10%
3:16:55.198751 WARNING: AUC difference > 5%. This may indicate overfitting.
3:16:55.325562 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
3:16:55.326847 PROGRESS: ============================= Precursor FDR =============================
3:16:55.326979 PROGRESS: Total precursors accumulated: 970
3:16:55.327057 PROGRESS: Target precursors: 882 (90.93%)
3:16:55.327124 PROGRESS: Decoy precursors: 88 (9.07%)
3:16:55.327187 PROGRESS: 
3:16:55.327248 PROGRESS: Precursor Summary:
3:16:55.329001 PROGRESS: Channel   0:	 0.05 FDR:   467; 0.01 FDR:   276; 0.001 FDR:   143
3:16:55.329135 PROGRESS: 
3:16:55.329210 PROGRESS: Protein Summary:
3:16:55.331260 PROGRESS: Channel   0:	 0.05 FDR:   450; 0.01 FDR:   261; 0.001 FDR:   138
3:16:55.331388 PROGRESS: =========================================================================
3:16:55.332453 PROGRESS: === Epoch 14, step 5, extracting elution groups 31000 to 63000 ===
3:16:55.469413 PROGRESS: Extracting batch of 63222 precursors
3:16:55.489779 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:16:55.489903 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:16:55.489941 INFO: FWHM in RT is 14.25 seconds, sigma is 0.52
3:16:55.489968 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:16:55.490225 INFO: Starting candidate selection
3:17:00.703497 INFO: Starting candidate scoring
3:17:02.595467 INFO: Finished candidate processing
3:17:02.595555 INFO: Collecting candidate features
3:17:04.947453 WARNING: intensity_correlation has 74 NaNs ( 0.13 % out of 58820)
3:17:04.956359 INFO: Collecting fragment features
3:17:05.638053 INFO: Finished candidate scoring
3:17:05.989580 PROGRESS: === Epoch 14, step 5, extracted 58820 precursors and 284013 fragments ===
3:17:05.989972 INFO: performing precursor FDR with 47 features
3:17:05.990023 INFO: Decoy channel: -1
3:17:05.990051 INFO: Competetive: True
3:17:06.120860 WARNING: dropped 74 target PSMs due to missing features
3:17:06.120972 WARNING: dropped 53 decoy PSMs due to missing features
3:17:10.045563 INFO: Test AUC: 0.552
3:17:10.045681 INFO: Train AUC: 0.595
3:17:10.045720 INFO: AUC difference: 7.23%
3:17:10.045763 WARNING: AUC difference > 5%. This may indicate overfitting.
3:17:10.181880 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
3:17:10.183464 PROGRESS: ============================= Precursor FDR =============================
3:17:10.183610 PROGRESS: Total precursors accumulated: 1,690
3:17:10.183690 PROGRESS: Target precursors: 1,539 (91.07%)
3:17:10.183758 PROGRESS: Decoy precursors: 151 (8.93%)
3:17:10.183821 PROGRESS: 
3:17:10.183882 PROGRESS: Precursor Summary:
3:17:10.185925 PROGRESS: Channel   0:	 0.05 FDR:   841; 0.01 FDR:   464; 0.001 FDR:   343
3:17:10.186054 PROGRESS: 
3:17:10.186129 PROGRESS: Protein Summary:
3:17:10.188510 PROGRESS: Channel   0:	 0.05 FDR:   793; 0.01 FDR:   431; 0.001 FDR:   320
3:17:10.188627 PROGRESS: =========================================================================
3:17:10.189813 PROGRESS: === Epoch 14, step 6, extracting elution groups 63000 to 127000 ===
3:17:10.367564 PROGRESS: Extracting batch of 126474 precursors
3:17:10.406131 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:17:10.406249 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:17:10.406287 INFO: FWHM in RT is 14.25 seconds, sigma is 0.52
3:17:10.406330 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:17:10.406595 INFO: Starting candidate selection
3:17:16.881724 INFO: Starting candidate scoring
3:17:19.358814 INFO: Finished candidate processing
3:17:19.358913 INFO: Collecting candidate features
3:17:21.883317 WARNING: intensity_correlation has 121 NaNs ( 0.10 % out of 117640)
3:17:21.896206 INFO: Collecting fragment features
3:17:22.633434 INFO: Finished candidate scoring
3:17:23.060075 PROGRESS: === Epoch 14, step 6, extracted 117640 precursors and 565568 fragments ===
3:17:23.060446 INFO: performing precursor FDR with 47 features
3:17:23.060494 INFO: Decoy channel: -1
3:17:23.060521 INFO: Competetive: True
3:17:23.329190 WARNING: dropped 127 target PSMs due to missing features
3:17:23.329308 WARNING: dropped 121 decoy PSMs due to missing features
3:17:32.037149 INFO: Test AUC: 0.553
3:17:32.037281 INFO: Train AUC: 0.586
3:17:32.037338 INFO: AUC difference: 5.70%
3:17:32.037367 WARNING: AUC difference > 5%. This may indicate overfitting.
3:17:32.193089 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
3:17:32.195202 PROGRESS: ============================= Precursor FDR =============================
3:17:32.195393 PROGRESS: Total precursors accumulated: 3,175
3:17:32.195476 PROGRESS: Target precursors: 2,897 (91.24%)
3:17:32.195547 PROGRESS: Decoy precursors: 278 (8.76%)
3:17:32.195623 PROGRESS: 
3:17:32.195687 PROGRESS: Precursor Summary:
3:17:32.198185 PROGRESS: Channel   0:	 0.05 FDR: 1,659; 0.01 FDR:   925; 0.001 FDR:   783
3:17:32.198327 PROGRESS: 
3:17:32.198402 PROGRESS: Protein Summary:
3:17:32.201497 PROGRESS: Channel   0:	 0.05 FDR: 1,498; 0.01 FDR:   814; 0.001 FDR:   684
3:17:32.201632 PROGRESS: =========================================================================
3:17:32.203127 PROGRESS: === Epoch 14, step 7, extracting elution groups 127000 to 255000 ===
3:17:32.428553 PROGRESS: Extracting batch of 252860 precursors
3:17:32.502225 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:17:32.502358 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:17:32.502398 INFO: FWHM in RT is 14.25 seconds, sigma is 0.52
3:17:32.502442 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:17:32.502716 INFO: Starting candidate selection
3:17:41.561652 INFO: Starting candidate scoring
3:17:45.245131 INFO: Finished candidate processing
3:17:45.245318 INFO: Collecting candidate features
3:17:48.221234 WARNING: intensity_correlation has 248 NaNs ( 0.11 % out of 235150)
3:17:48.242352 INFO: Collecting fragment features
3:17:49.113864 INFO: Finished candidate scoring
3:17:49.701976 PROGRESS: === Epoch 14, step 7, extracted 235150 precursors and 1133243 fragments ===
3:17:49.702318 INFO: performing precursor FDR with 47 features
3:17:49.702363 INFO: Decoy channel: -1
3:17:49.702390 INFO: Competetive: True
3:17:50.300514 WARNING: dropped 246 target PSMs due to missing features
3:17:50.300645 WARNING: dropped 250 decoy PSMs due to missing features
3:18:07.985920 INFO: Test AUC: 0.552
3:18:07.986070 INFO: Train AUC: 0.574
3:18:07.986110 INFO: AUC difference: 3.93%
3:18:08.169927 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
3:18:08.172433 PROGRESS: ============================= Precursor FDR =============================
3:18:08.172604 PROGRESS: Total precursors accumulated: 4,789
3:18:08.172684 PROGRESS: Target precursors: 4,360 (91.04%)
3:18:08.172796 PROGRESS: Decoy precursors: 429 (8.96%)
3:18:08.172888 PROGRESS: 
3:18:08.172986 PROGRESS: Precursor Summary:
3:18:08.175866 PROGRESS: Channel   0:	 0.05 FDR: 2,883; 0.01 FDR: 1,829; 0.001 FDR:   760
3:18:08.176011 PROGRESS: 
3:18:08.176085 PROGRESS: Protein Summary:
3:18:08.179909 PROGRESS: Channel   0:	 0.05 FDR: 2,392; 0.01 FDR: 1,480; 0.001 FDR:   671
3:18:08.180039 PROGRESS: =========================================================================
3:18:08.182033 PROGRESS: === Epoch 14, step 8, extracting elution groups 255000 to 511000 ===
3:18:08.485585 PROGRESS: Extracting batch of 505744 precursors
3:18:08.618288 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:18:08.618420 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:18:08.618461 INFO: FWHM in RT is 14.25 seconds, sigma is 0.52
3:18:08.618488 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:18:08.618757 INFO: Starting candidate selection
3:18:22.739609 INFO: Starting candidate scoring
3:18:28.799274 INFO: Finished candidate processing
3:18:28.799462 INFO: Collecting candidate features
3:18:32.426401 WARNING: intensity_correlation has 513 NaNs ( 0.11 % out of 469876)
3:18:32.427476 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 469876)
3:18:32.460765 INFO: Collecting fragment features
3:18:33.509540 INFO: Finished candidate scoring
3:18:34.396271 PROGRESS: === Epoch 14, step 8, extracted 469876 precursors and 2266083 fragments ===
3:18:34.396632 INFO: performing precursor FDR with 47 features
3:18:34.403326 INFO: Decoy channel: -1
3:18:34.403503 INFO: Competetive: True
3:18:35.549289 WARNING: dropped 494 target PSMs due to missing features
3:18:35.549418 WARNING: dropped 515 decoy PSMs due to missing features
3:19:10.166891 INFO: Test AUC: 0.551
3:19:10.167019 INFO: Train AUC: 0.565
3:19:10.167060 INFO: AUC difference: 2.35%
3:19:10.406988 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
3:19:10.410208 PROGRESS: ============================= Precursor FDR =============================
3:19:10.410381 PROGRESS: Total precursors accumulated: 7,518
3:19:10.410462 PROGRESS: Target precursors: 6,855 (91.18%)
3:19:10.410533 PROGRESS: Decoy precursors: 663 (8.82%)
3:19:10.410598 PROGRESS: 
3:19:10.410660 PROGRESS: Precursor Summary:
3:19:10.414412 PROGRESS: Channel   0:	 0.05 FDR: 5,109; 0.01 FDR: 3,526; 0.001 FDR: 1,758
3:19:10.414557 PROGRESS: 
3:19:10.414630 PROGRESS: Protein Summary:
3:19:10.419978 PROGRESS: Channel   0:	 0.05 FDR: 3,618; 0.01 FDR: 2,396; 0.001 FDR: 1,314
3:19:10.420123 PROGRESS: =========================================================================
3:19:10.424689 INFO: calibration group: precursor, fitting rt estimator 
3:19:10.833414 INFO: calibration group: fragment, fitting mz estimator 
3:19:11.421662 INFO: === checking if epoch conditions were reached ===
3:19:11.421893 INFO: ✅ ms2_error      : 7.0000 <= 7
3:19:11.421976 INFO: ❌ rt_error       : 202.1851 > 100
3:19:11.422040 INFO: ✅ current_epoch  : 14 >= 3
3:19:11.422096 INFO: ==============================================
3:19:11.666322 INFO: calibration group: precursor, predicting mz
3:19:11.666604 WARNING: mz prediction was skipped as it has not been fitted yet
3:19:11.666647 INFO: calibration group: precursor, predicting rt
3:19:18.464182 INFO: calibration group: fragment, predicting mz
3:19:36.284142 PROGRESS: === Epoch 15, step 0, extracting elution groups 0 to 1000 ===
3:19:36.382329 PROGRESS: Extracting batch of 1977 precursors
3:19:36.384122 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:19:36.384212 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:19:36.384253 INFO: FWHM in RT is 14.46 seconds, sigma is 0.53
3:19:36.384299 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:19:36.384532 INFO: Starting candidate selection
3:19:40.727847 INFO: Starting candidate scoring
3:19:42.019867 INFO: Finished candidate processing
3:19:42.019995 INFO: Collecting candidate features
3:19:44.173706 WARNING: intensity_correlation has 4 NaNs ( 0.22 % out of 1848)
3:19:44.179876 INFO: Collecting fragment features
3:19:44.815877 INFO: Finished candidate scoring
3:19:45.157731 PROGRESS: === Epoch 15, step 0, extracted 1848 precursors and 8642 fragments ===
3:19:45.158102 INFO: performing precursor FDR with 47 features
3:19:45.158157 INFO: Decoy channel: -1
3:19:45.158203 INFO: Competetive: True
3:19:45.163152 WARNING: dropped 3 target PSMs due to missing features
3:19:45.163219 WARNING: dropped 1 decoy PSMs due to missing features
3:19:45.192959 INFO: Test AUC: 0.550
3:19:45.193063 INFO: Train AUC: 0.541
3:19:45.193127 INFO: AUC difference: 1.82%
3:19:45.313808 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
3:19:45.314635 PROGRESS: ============================= Precursor FDR =============================
3:19:45.314781 PROGRESS: Total precursors accumulated: 6
3:19:45.314888 PROGRESS: Target precursors: 6 (100.00%)
3:19:45.314986 PROGRESS: Decoy precursors: 0 (0.00%)
3:19:45.315078 PROGRESS: 
3:19:45.315166 PROGRESS: Precursor Summary:
3:19:45.316685 PROGRESS: Channel   0:	 0.05 FDR:     6; 0.01 FDR:     6; 0.001 FDR:     6
3:19:45.316845 PROGRESS: 
3:19:45.316950 PROGRESS: Protein Summary:
3:19:45.319289 PROGRESS: Channel   0:	 0.05 FDR:     6; 0.01 FDR:     6; 0.001 FDR:     6
3:19:45.319439 PROGRESS: =========================================================================
3:19:45.320379 PROGRESS: === Epoch 15, step 1, extracting elution groups 1000 to 3000 ===
3:19:45.398134 PROGRESS: Extracting batch of 3953 precursors
3:19:45.400354 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:19:45.400414 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:19:45.400454 INFO: FWHM in RT is 14.46 seconds, sigma is 0.53
3:19:45.400499 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:19:45.400759 INFO: Starting candidate selection
3:19:49.428678 INFO: Starting candidate scoring
3:19:50.767422 INFO: Finished candidate processing
3:19:50.767511 INFO: Collecting candidate features
3:19:52.934699 WARNING: intensity_correlation has 9 NaNs ( 0.24 % out of 3685)
3:19:52.940825 INFO: Collecting fragment features
3:19:53.564395 INFO: Finished candidate scoring
3:19:53.845707 PROGRESS: === Epoch 15, step 1, extracted 3685 precursors and 17581 fragments ===
3:19:53.846005 INFO: performing precursor FDR with 47 features
3:19:53.846051 INFO: Decoy channel: -1
3:19:53.846076 INFO: Competetive: True
3:19:53.855107 WARNING: dropped 7 target PSMs due to missing features
3:19:53.855195 WARNING: dropped 6 decoy PSMs due to missing features
3:19:53.892886 INFO: Test AUC: 0.550
3:19:53.893018 INFO: Train AUC: 0.561
3:19:53.893066 INFO: AUC difference: 1.90%
3:19:54.013535 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
3:19:54.014338 PROGRESS: ============================= Precursor FDR =============================
3:19:54.014468 PROGRESS: Total precursors accumulated: 24
3:19:54.014546 PROGRESS: Target precursors: 22 (91.67%)
3:19:54.014615 PROGRESS: Decoy precursors: 2 (8.33%)
3:19:54.014679 PROGRESS: 
3:19:54.014741 PROGRESS: Precursor Summary:
3:19:54.016161 PROGRESS: Channel   0:	 0.05 FDR:    22; 0.01 FDR:    20; 0.001 FDR:    20
3:19:54.016275 PROGRESS: 
3:19:54.016349 PROGRESS: Protein Summary:
3:19:54.017963 PROGRESS: Channel   0:	 0.05 FDR:    22; 0.01 FDR:    20; 0.001 FDR:    20
3:19:54.018075 PROGRESS: =========================================================================
3:19:54.018923 PROGRESS: === Epoch 15, step 2, extracting elution groups 3000 to 7000 ===
3:19:54.100791 PROGRESS: Extracting batch of 7889 precursors
3:19:54.104176 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:19:54.104240 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:19:54.104294 INFO: FWHM in RT is 14.46 seconds, sigma is 0.53
3:19:54.104324 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:19:54.104547 INFO: Starting candidate selection
3:19:58.179820 INFO: Starting candidate scoring
3:19:59.527490 INFO: Finished candidate processing
3:19:59.527584 INFO: Collecting candidate features
3:20:01.734130 WARNING: intensity_correlation has 9 NaNs ( 0.12 % out of 7318)
3:20:01.734434 WARNING: height_correlation has 1 NaNs ( 0.01 % out of 7318)
3:20:01.741126 INFO: Collecting fragment features
3:20:02.371922 INFO: Finished candidate scoring
3:20:02.659665 PROGRESS: === Epoch 15, step 2, extracted 7318 precursors and 35313 fragments ===
3:20:02.660015 INFO: performing precursor FDR with 47 features
3:20:02.660061 INFO: Decoy channel: -1
3:20:02.660087 INFO: Competetive: True
3:20:02.675561 WARNING: dropped 11 target PSMs due to missing features
3:20:02.675662 WARNING: dropped 11 decoy PSMs due to missing features
3:20:02.954764 INFO: Test AUC: 0.554
3:20:02.954899 INFO: Train AUC: 0.578
3:20:02.954981 INFO: AUC difference: 4.13%
3:20:03.075577 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
3:20:03.076463 PROGRESS: ============================= Precursor FDR =============================
3:20:03.076587 PROGRESS: Total precursors accumulated: 113
3:20:03.076665 PROGRESS: Target precursors: 103 (91.15%)
3:20:03.076732 PROGRESS: Decoy precursors: 10 (8.85%)
3:20:03.076795 PROGRESS: 
3:20:03.076855 PROGRESS: Precursor Summary:
3:20:03.078344 PROGRESS: Channel   0:	 0.05 FDR:    82; 0.01 FDR:    50; 0.001 FDR:    50
3:20:03.078461 PROGRESS: 
3:20:03.078535 PROGRESS: Protein Summary:
3:20:03.080220 PROGRESS: Channel   0:	 0.05 FDR:    82; 0.01 FDR:    50; 0.001 FDR:    50
3:20:03.080328 PROGRESS: =========================================================================
3:20:03.081206 PROGRESS: === Epoch 15, step 3, extracting elution groups 7000 to 15000 ===
3:20:03.173720 PROGRESS: Extracting batch of 15797 precursors
3:20:03.186494 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:20:03.186573 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:20:03.186610 INFO: FWHM in RT is 14.46 seconds, sigma is 0.53
3:20:03.186636 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:20:03.186860 INFO: Starting candidate selection
3:20:07.443213 INFO: Starting candidate scoring
3:20:08.874113 INFO: Finished candidate processing
3:20:08.874207 INFO: Collecting candidate features
3:20:11.075914 WARNING: intensity_correlation has 22 NaNs ( 0.15 % out of 14738)
3:20:11.082005 INFO: Collecting fragment features
3:20:11.717184 INFO: Finished candidate scoring
3:20:12.012399 PROGRESS: === Epoch 15, step 3, extracted 14738 precursors and 71461 fragments ===
3:20:12.012723 INFO: performing precursor FDR with 47 features
3:20:12.012772 INFO: Decoy channel: -1
3:20:12.012799 INFO: Competetive: True
3:20:12.041393 WARNING: dropped 23 target PSMs due to missing features
3:20:12.041509 WARNING: dropped 21 decoy PSMs due to missing features
3:20:12.791530 INFO: Test AUC: 0.542
3:20:12.791684 INFO: Train AUC: 0.592
3:20:12.791732 INFO: AUC difference: 8.39%
3:20:12.791765 WARNING: AUC difference > 5%. This may indicate overfitting.
3:20:12.917044 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
3:20:12.918099 PROGRESS: ============================= Precursor FDR =============================
3:20:12.918228 PROGRESS: Total precursors accumulated: 395
3:20:12.918307 PROGRESS: Target precursors: 362 (91.65%)
3:20:12.918376 PROGRESS: Decoy precursors: 33 (8.35%)
3:20:12.918438 PROGRESS: 
3:20:12.918513 PROGRESS: Precursor Summary:
3:20:12.920128 PROGRESS: Channel   0:	 0.05 FDR:   249; 0.01 FDR:   109; 0.001 FDR:    73
3:20:12.920256 PROGRESS: 
3:20:12.920331 PROGRESS: Protein Summary:
3:20:12.922181 PROGRESS: Channel   0:	 0.05 FDR:   247; 0.01 FDR:   107; 0.001 FDR:    73
3:20:12.922313 PROGRESS: =========================================================================
3:20:12.923253 PROGRESS: === Epoch 15, step 4, extracting elution groups 15000 to 31000 ===
3:20:13.031701 PROGRESS: Extracting batch of 31588 precursors
3:20:13.042370 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:20:13.042469 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:20:13.042508 INFO: FWHM in RT is 14.46 seconds, sigma is 0.53
3:20:13.042535 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:20:13.042782 INFO: Starting candidate selection
3:20:17.554992 INFO: Starting candidate scoring
3:20:19.122933 INFO: Finished candidate processing
3:20:19.123027 INFO: Collecting candidate features
3:20:21.404690 WARNING: intensity_correlation has 39 NaNs ( 0.13 % out of 29329)
3:20:21.411716 INFO: Collecting fragment features
3:20:22.073398 INFO: Finished candidate scoring
3:20:22.390046 PROGRESS: === Epoch 15, step 4, extracted 29329 precursors and 141730 fragments ===
3:20:22.390406 INFO: performing precursor FDR with 47 features
3:20:22.390452 INFO: Decoy channel: -1
3:20:22.390477 INFO: Competetive: True
3:20:22.449380 WARNING: dropped 40 target PSMs due to missing features
3:20:22.449489 WARNING: dropped 43 decoy PSMs due to missing features
3:20:24.327128 INFO: Test AUC: 0.554
3:20:24.327275 INFO: Train AUC: 0.598
3:20:24.327323 INFO: AUC difference: 7.43%
3:20:24.327361 WARNING: AUC difference > 5%. This may indicate overfitting.
3:20:24.460131 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
3:20:24.461540 PROGRESS: ============================= Precursor FDR =============================
3:20:24.461671 PROGRESS: Total precursors accumulated: 1,344
3:20:24.461765 PROGRESS: Target precursors: 1,230 (91.52%)
3:20:24.461848 PROGRESS: Decoy precursors: 114 (8.48%)
3:20:24.461921 PROGRESS: 
3:20:24.461987 PROGRESS: Precursor Summary:
3:20:24.463779 PROGRESS: Channel   0:	 0.05 FDR:   644; 0.01 FDR:   201; 0.001 FDR:   156
3:20:24.463891 PROGRESS: 
3:20:24.463981 PROGRESS: Protein Summary:
3:20:24.466111 PROGRESS: Channel   0:	 0.05 FDR:   632; 0.01 FDR:   198; 0.001 FDR:   155
3:20:24.466223 PROGRESS: =========================================================================
3:20:24.467280 PROGRESS: === Epoch 15, step 5, extracting elution groups 31000 to 63000 ===
3:20:24.604474 PROGRESS: Extracting batch of 63284 precursors
3:20:24.624780 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:20:24.624890 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:20:24.624946 INFO: FWHM in RT is 14.46 seconds, sigma is 0.53
3:20:24.624973 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:20:24.625229 INFO: Starting candidate selection
3:20:29.831598 INFO: Starting candidate scoring
3:20:31.710373 INFO: Finished candidate processing
3:20:31.710556 INFO: Collecting candidate features
3:20:34.086920 WARNING: intensity_correlation has 88 NaNs ( 0.15 % out of 58963)
3:20:34.095921 INFO: Collecting fragment features
3:20:34.790386 INFO: Finished candidate scoring
3:20:35.143831 PROGRESS: === Epoch 15, step 5, extracted 58963 precursors and 284762 fragments ===
3:20:35.144198 INFO: performing precursor FDR with 47 features
3:20:35.144244 INFO: Decoy channel: -1
3:20:35.144270 INFO: Competetive: True
3:20:35.276390 WARNING: dropped 82 target PSMs due to missing features
3:20:35.276506 WARNING: dropped 89 decoy PSMs due to missing features
3:20:39.346384 INFO: Test AUC: 0.555
3:20:39.346519 INFO: Train AUC: 0.593
3:20:39.346561 INFO: AUC difference: 6.41%
3:20:39.346589 WARNING: AUC difference > 5%. This may indicate overfitting.
3:20:39.484049 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
3:20:39.485748 PROGRESS: ============================= Precursor FDR =============================
3:20:39.485913 PROGRESS: Total precursors accumulated: 2,237
3:20:39.485991 PROGRESS: Target precursors: 2,041 (91.24%)
3:20:39.486060 PROGRESS: Decoy precursors: 196 (8.76%)
3:20:39.486123 PROGRESS: 
3:20:39.486183 PROGRESS: Precursor Summary:
3:20:39.488196 PROGRESS: Channel   0:	 0.05 FDR: 1,015; 0.01 FDR:   521; 0.001 FDR:   393
3:20:39.488317 PROGRESS: 
3:20:39.488392 PROGRESS: Protein Summary:
3:20:39.490846 PROGRESS: Channel   0:	 0.05 FDR:   979; 0.01 FDR:   501; 0.001 FDR:   380
3:20:39.490961 PROGRESS: =========================================================================
3:20:39.492154 PROGRESS: === Epoch 15, step 6, extracting elution groups 63000 to 127000 ===
3:20:39.667196 PROGRESS: Extracting batch of 126496 precursors
3:20:39.708524 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:20:39.708741 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:20:39.708867 INFO: FWHM in RT is 14.46 seconds, sigma is 0.53
3:20:39.708966 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:20:39.709298 INFO: Starting candidate selection
3:20:46.199261 INFO: Starting candidate scoring
3:20:48.713402 INFO: Finished candidate processing
3:20:48.713587 INFO: Collecting candidate features
3:20:51.256582 WARNING: intensity_correlation has 173 NaNs ( 0.15 % out of 117785)
3:20:51.269984 INFO: Collecting fragment features
3:20:52.014058 INFO: Finished candidate scoring
3:20:52.437670 PROGRESS: === Epoch 15, step 6, extracted 117785 precursors and 568053 fragments ===
3:20:52.438050 INFO: performing precursor FDR with 47 features
3:20:52.438096 INFO: Decoy channel: -1
3:20:52.438121 INFO: Competetive: True
3:20:52.706205 WARNING: dropped 164 target PSMs due to missing features
3:20:52.706322 WARNING: dropped 180 decoy PSMs due to missing features
3:21:00.895309 INFO: Test AUC: 0.549
3:21:00.895437 INFO: Train AUC: 0.581
3:21:00.895494 INFO: AUC difference: 5.49%
3:21:00.895522 WARNING: AUC difference > 5%. This may indicate overfitting.
3:21:01.058101 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
3:21:01.060114 PROGRESS: ============================= Precursor FDR =============================
3:21:01.060276 PROGRESS: Total precursors accumulated: 3,246
3:21:01.060359 PROGRESS: Target precursors: 2,958 (91.13%)
3:21:01.060428 PROGRESS: Decoy precursors: 288 (8.87%)
3:21:01.060493 PROGRESS: 
3:21:01.060555 PROGRESS: Precursor Summary:
3:21:01.062883 PROGRESS: Channel   0:	 0.05 FDR: 1,789; 0.01 FDR:   865; 0.001 FDR:   577
3:21:01.063035 PROGRESS: 
3:21:01.063111 PROGRESS: Protein Summary:
3:21:01.066060 PROGRESS: Channel   0:	 0.05 FDR: 1,630; 0.01 FDR:   781; 0.001 FDR:   526
3:21:01.066177 PROGRESS: =========================================================================
3:21:01.067589 PROGRESS: === Epoch 15, step 7, extracting elution groups 127000 to 255000 ===
3:21:01.293832 PROGRESS: Extracting batch of 252846 precursors
3:21:01.367134 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:21:01.367253 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:21:01.367295 INFO: FWHM in RT is 14.46 seconds, sigma is 0.53
3:21:01.367322 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:21:01.367602 INFO: Starting candidate selection
3:21:10.396294 INFO: Starting candidate scoring
3:21:14.077766 INFO: Finished candidate processing
3:21:14.077893 INFO: Collecting candidate features
3:21:17.012611 WARNING: intensity_correlation has 363 NaNs ( 0.15 % out of 235226)
3:21:17.033238 INFO: Collecting fragment features
3:21:17.872187 INFO: Finished candidate scoring
3:21:18.452959 PROGRESS: === Epoch 15, step 7, extracted 235226 precursors and 1134766 fragments ===
3:21:18.453341 INFO: performing precursor FDR with 47 features
3:21:18.453406 INFO: Decoy channel: -1
3:21:18.453456 INFO: Competetive: True
3:21:19.043393 WARNING: dropped 353 target PSMs due to missing features
3:21:19.043513 WARNING: dropped 354 decoy PSMs due to missing features
3:21:36.193070 INFO: Test AUC: 0.553
3:21:36.193204 INFO: Train AUC: 0.572
3:21:36.193258 INFO: AUC difference: 3.23%
3:21:36.380365 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
3:21:36.383021 PROGRESS: ============================= Precursor FDR =============================
3:21:36.383185 PROGRESS: Total precursors accumulated: 5,327
3:21:36.383263 PROGRESS: Target precursors: 4,857 (91.18%)
3:21:36.383330 PROGRESS: Decoy precursors: 470 (8.82%)
3:21:36.383392 PROGRESS: 
3:21:36.383468 PROGRESS: Precursor Summary:
3:21:36.386495 PROGRESS: Channel   0:	 0.05 FDR: 3,267; 0.01 FDR: 1,826; 0.001 FDR: 1,344
3:21:36.386636 PROGRESS: 
3:21:36.386711 PROGRESS: Protein Summary:
3:21:36.390791 PROGRESS: Channel   0:	 0.05 FDR: 2,780; 0.01 FDR: 1,531; 0.001 FDR: 1,145
3:21:36.390927 PROGRESS: =========================================================================
3:21:36.392826 PROGRESS: === Epoch 15, step 8, extracting elution groups 255000 to 511000 ===
3:21:36.696343 PROGRESS: Extracting batch of 505857 precursors
3:21:36.828144 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:21:36.828258 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:21:36.828300 INFO: FWHM in RT is 14.46 seconds, sigma is 0.53
3:21:36.828346 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:21:36.828606 INFO: Starting candidate selection
3:21:50.951541 INFO: Starting candidate scoring
3:21:57.082981 INFO: Finished candidate processing
3:21:57.083118 INFO: Collecting candidate features
3:22:00.763891 WARNING: intensity_correlation has 699 NaNs ( 0.15 % out of 470483)
3:22:00.798013 INFO: Collecting fragment features
3:22:01.841427 INFO: Finished candidate scoring
3:22:02.735106 PROGRESS: === Epoch 15, step 8, extracted 470483 precursors and 2271833 fragments ===
3:22:02.735465 INFO: performing precursor FDR with 47 features
3:22:02.735509 INFO: Decoy channel: -1
3:22:02.735535 INFO: Competetive: True
3:22:03.882203 WARNING: dropped 710 target PSMs due to missing features
3:22:03.882325 WARNING: dropped 696 decoy PSMs due to missing features
3:22:38.989815 INFO: Test AUC: 0.551
3:22:38.989963 INFO: Train AUC: 0.566
3:22:38.990001 INFO: AUC difference: 2.65%
3:22:39.242574 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
3:22:39.245737 PROGRESS: ============================= Precursor FDR =============================
3:22:39.245926 PROGRESS: Total precursors accumulated: 7,374
3:22:39.246008 PROGRESS: Target precursors: 6,733 (91.31%)
3:22:39.246076 PROGRESS: Decoy precursors: 641 (8.69%)
3:22:39.246139 PROGRESS: 
3:22:39.246202 PROGRESS: Precursor Summary:
3:22:39.250029 PROGRESS: Channel   0:	 0.05 FDR: 5,087; 0.01 FDR: 3,530; 0.001 FDR: 2,179
3:22:39.250188 PROGRESS: 
3:22:39.250264 PROGRESS: Protein Summary:
3:22:39.255765 PROGRESS: Channel   0:	 0.05 FDR: 3,652; 0.01 FDR: 2,475; 0.001 FDR: 1,628
3:22:39.255906 PROGRESS: =========================================================================
3:22:39.260491 INFO: calibration group: precursor, fitting rt estimator 
3:22:39.672495 INFO: calibration group: fragment, fitting mz estimator 
3:22:40.270912 INFO: === checking if epoch conditions were reached ===
3:22:40.271123 INFO: ✅ ms2_error      : 7.0000 <= 7
3:22:40.271213 INFO: ❌ rt_error       : 200.6610 > 100
3:22:40.271300 INFO: ✅ current_epoch  : 15 >= 3
3:22:40.271364 INFO: ==============================================
3:22:40.491850 INFO: calibration group: precursor, predicting mz
3:22:40.492141 WARNING: mz prediction was skipped as it has not been fitted yet
3:22:40.492184 INFO: calibration group: precursor, predicting rt
3:22:47.284198 INFO: calibration group: fragment, predicting mz
3:23:05.198549 PROGRESS: === Epoch 16, step 0, extracting elution groups 0 to 1000 ===
3:23:05.298321 PROGRESS: Extracting batch of 1970 precursors
3:23:05.300109 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:23:05.300188 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:23:05.300244 INFO: FWHM in RT is 14.40 seconds, sigma is 0.52
3:23:05.300275 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:23:05.300532 INFO: Starting candidate selection
3:23:09.705303 INFO: Starting candidate scoring
3:23:11.020565 INFO: Finished candidate processing
3:23:11.020656 INFO: Collecting candidate features
3:23:13.170017 WARNING: intensity_correlation has 1 NaNs ( 0.05 % out of 1832)
3:23:13.175992 INFO: Collecting fragment features
3:23:13.806736 INFO: Finished candidate scoring
3:23:14.149011 PROGRESS: === Epoch 16, step 0, extracted 1832 precursors and 8965 fragments ===
3:23:14.149343 INFO: performing precursor FDR with 47 features
3:23:14.149388 INFO: Decoy channel: -1
3:23:14.149415 INFO: Competetive: True
3:23:14.154134 WARNING: dropped 1 target PSMs due to missing features
3:23:14.183418 INFO: Test AUC: 0.571
3:23:14.183513 INFO: Train AUC: 0.558
3:23:14.183557 INFO: AUC difference: 2.36%
3:23:14.324622 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
3:23:14.325426 PROGRESS: ============================= Precursor FDR =============================
3:23:14.325546 PROGRESS: Total precursors accumulated: 5
3:23:14.325624 PROGRESS: Target precursors: 5 (100.00%)
3:23:14.325694 PROGRESS: Decoy precursors: 0 (0.00%)
3:23:14.325758 PROGRESS: 
3:23:14.325833 PROGRESS: Precursor Summary:
3:23:14.327335 PROGRESS: Channel   0:	 0.05 FDR:     5; 0.01 FDR:     5; 0.001 FDR:     5
3:23:14.327475 PROGRESS: 
3:23:14.327551 PROGRESS: Protein Summary:
3:23:14.329245 PROGRESS: Channel   0:	 0.05 FDR:     5; 0.01 FDR:     5; 0.001 FDR:     5
3:23:14.329356 PROGRESS: =========================================================================
3:23:14.330258 PROGRESS: === Epoch 16, step 1, extracting elution groups 1000 to 3000 ===
3:23:14.408127 PROGRESS: Extracting batch of 3941 precursors
3:23:14.410328 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:23:14.410390 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:23:14.410429 INFO: FWHM in RT is 14.40 seconds, sigma is 0.52
3:23:14.410476 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:23:14.410691 INFO: Starting candidate selection
3:23:18.460317 INFO: Starting candidate scoring
3:23:19.775005 INFO: Finished candidate processing
3:23:19.775103 INFO: Collecting candidate features
3:23:21.961496 WARNING: intensity_correlation has 2 NaNs ( 0.05 % out of 3643)
3:23:21.967748 INFO: Collecting fragment features
3:23:22.615626 INFO: Finished candidate scoring
3:23:22.898359 PROGRESS: === Epoch 16, step 1, extracted 3643 precursors and 17543 fragments ===
3:23:22.898651 INFO: performing precursor FDR with 47 features
3:23:22.898699 INFO: Decoy channel: -1
3:23:22.898725 INFO: Competetive: True
3:23:22.907599 WARNING: dropped 2 target PSMs due to missing features
3:23:22.907689 WARNING: dropped 1 decoy PSMs due to missing features
3:23:22.945446 INFO: Test AUC: 0.565
3:23:22.945567 INFO: Train AUC: 0.553
3:23:22.945610 INFO: AUC difference: 2.13%
3:23:23.066635 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
3:23:23.067430 PROGRESS: ============================= Precursor FDR =============================
3:23:23.067554 PROGRESS: Total precursors accumulated: 28
3:23:23.067634 PROGRESS: Target precursors: 26 (92.86%)
3:23:23.067717 PROGRESS: Decoy precursors: 2 (7.14%)
3:23:23.067781 PROGRESS: 
3:23:23.067843 PROGRESS: Precursor Summary:
3:23:23.069277 PROGRESS: Channel   0:	 0.05 FDR:    25; 0.01 FDR:    24; 0.001 FDR:    24
3:23:23.069408 PROGRESS: 
3:23:23.069482 PROGRESS: Protein Summary:
3:23:23.071118 PROGRESS: Channel   0:	 0.05 FDR:    25; 0.01 FDR:    24; 0.001 FDR:    24
3:23:23.071234 PROGRESS: =========================================================================
3:23:23.072098 PROGRESS: === Epoch 16, step 2, extracting elution groups 3000 to 7000 ===
3:23:23.154441 PROGRESS: Extracting batch of 7895 precursors
3:23:23.157733 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:23:23.157839 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:23:23.157882 INFO: FWHM in RT is 14.40 seconds, sigma is 0.52
3:23:23.157913 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:23:23.158136 INFO: Starting candidate selection
3:23:27.241335 INFO: Starting candidate scoring
3:23:28.591644 INFO: Finished candidate processing
3:23:28.591740 INFO: Collecting candidate features
3:23:30.797954 WARNING: intensity_correlation has 9 NaNs ( 0.12 % out of 7395)
3:23:30.803689 INFO: Collecting fragment features
3:23:31.457309 INFO: Finished candidate scoring
3:23:31.745616 PROGRESS: === Epoch 16, step 2, extracted 7395 precursors and 35489 fragments ===
3:23:31.745968 INFO: performing precursor FDR with 47 features
3:23:31.746012 INFO: Decoy channel: -1
3:23:31.746038 INFO: Competetive: True
3:23:31.761498 WARNING: dropped 7 target PSMs due to missing features
3:23:31.761600 WARNING: dropped 5 decoy PSMs due to missing features
3:23:32.090046 INFO: Test AUC: 0.553
3:23:32.090186 INFO: Train AUC: 0.583
3:23:32.090278 INFO: AUC difference: 5.18%
3:23:32.090340 WARNING: AUC difference > 5%. This may indicate overfitting.
3:23:32.214377 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
3:23:32.215234 PROGRESS: ============================= Precursor FDR =============================
3:23:32.215353 PROGRESS: Total precursors accumulated: 88
3:23:32.215431 PROGRESS: Target precursors: 80 (90.91%)
3:23:32.215500 PROGRESS: Decoy precursors: 8 (9.09%)
3:23:32.215562 PROGRESS: 
3:23:32.215626 PROGRESS: Precursor Summary:
3:23:32.217090 PROGRESS: Channel   0:	 0.05 FDR:    54; 0.01 FDR:    52; 0.001 FDR:    52
3:23:32.217201 PROGRESS: 
3:23:32.217290 PROGRESS: Protein Summary:
3:23:32.218985 PROGRESS: Channel   0:	 0.05 FDR:    54; 0.01 FDR:    52; 0.001 FDR:    52
3:23:32.219113 PROGRESS: =========================================================================
3:23:32.219998 PROGRESS: === Epoch 16, step 3, extracting elution groups 7000 to 15000 ===
3:23:32.311583 PROGRESS: Extracting batch of 15789 precursors
3:23:32.317149 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:23:32.317216 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:23:32.317251 INFO: FWHM in RT is 14.40 seconds, sigma is 0.52
3:23:32.317294 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:23:32.317511 INFO: Starting candidate selection
3:23:36.607947 INFO: Starting candidate scoring
3:23:38.058550 INFO: Finished candidate processing
3:23:38.058701 INFO: Collecting candidate features
3:23:40.291899 WARNING: intensity_correlation has 28 NaNs ( 0.19 % out of 14723)
3:23:40.297993 INFO: Collecting fragment features
3:23:40.974661 INFO: Finished candidate scoring
3:23:41.276680 PROGRESS: === Epoch 16, step 3, extracted 14723 precursors and 71053 fragments ===
3:23:41.277016 INFO: performing precursor FDR with 47 features
3:23:41.277066 INFO: Decoy channel: -1
3:23:41.277093 INFO: Competetive: True
3:23:41.305398 WARNING: dropped 23 target PSMs due to missing features
3:23:41.305507 WARNING: dropped 17 decoy PSMs due to missing features
3:23:42.089862 INFO: Test AUC: 0.548
3:23:42.090030 INFO: Train AUC: 0.593
3:23:42.090079 INFO: AUC difference: 7.62%
3:23:42.090112 WARNING: AUC difference > 5%. This may indicate overfitting.
3:23:42.216975 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
3:23:42.217936 PROGRESS: ============================= Precursor FDR =============================
3:23:42.218068 PROGRESS: Total precursors accumulated: 233
3:23:42.218153 PROGRESS: Target precursors: 212 (90.99%)
3:23:42.218232 PROGRESS: Decoy precursors: 21 (9.01%)
3:23:42.218296 PROGRESS: 
3:23:42.218357 PROGRESS: Precursor Summary:
3:23:42.219876 PROGRESS: Channel   0:	 0.05 FDR:   137; 0.01 FDR:   104; 0.001 FDR:   103
3:23:42.219986 PROGRESS: 
3:23:42.220059 PROGRESS: Protein Summary:
3:23:42.221823 PROGRESS: Channel   0:	 0.05 FDR:   134; 0.01 FDR:   102; 0.001 FDR:   101
3:23:42.221934 PROGRESS: =========================================================================
3:23:42.222850 PROGRESS: === Epoch 16, step 4, extracting elution groups 15000 to 31000 ===
3:23:42.330061 PROGRESS: Extracting batch of 31630 precursors
3:23:42.340524 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:23:42.340632 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:23:42.340675 INFO: FWHM in RT is 14.40 seconds, sigma is 0.52
3:23:42.340703 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:23:42.340949 INFO: Starting candidate selection
3:23:46.942547 INFO: Starting candidate scoring
3:23:48.540893 INFO: Finished candidate processing
3:23:48.541082 INFO: Collecting candidate features
3:23:50.794840 WARNING: intensity_correlation has 33 NaNs ( 0.11 % out of 29454)
3:23:50.803160 INFO: Collecting fragment features
3:23:51.478600 INFO: Finished candidate scoring
3:23:51.791152 PROGRESS: === Epoch 16, step 4, extracted 29454 precursors and 142282 fragments ===
3:23:51.791513 INFO: performing precursor FDR with 47 features
3:23:51.791584 INFO: Decoy channel: -1
3:23:51.791622 INFO: Competetive: True
3:23:51.849572 WARNING: dropped 36 target PSMs due to missing features
3:23:51.849679 WARNING: dropped 37 decoy PSMs due to missing features
3:23:53.806336 INFO: Test AUC: 0.550
3:23:53.806489 INFO: Train AUC: 0.600
3:23:53.806537 INFO: AUC difference: 8.25%
3:23:53.806572 WARNING: AUC difference > 5%. This may indicate overfitting.
3:23:53.938448 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
3:23:53.939581 PROGRESS: ============================= Precursor FDR =============================
3:23:53.939707 PROGRESS: Total precursors accumulated: 793
3:23:53.939785 PROGRESS: Target precursors: 724 (91.30%)
3:23:53.939854 PROGRESS: Decoy precursors: 69 (8.70%)
3:23:53.939919 PROGRESS: 
3:23:53.939981 PROGRESS: Precursor Summary:
3:23:53.941614 PROGRESS: Channel   0:	 0.05 FDR:   364; 0.01 FDR:   148; 0.001 FDR:   136
3:23:53.941754 PROGRESS: 
3:23:53.941851 PROGRESS: Protein Summary:
3:23:53.943757 PROGRESS: Channel   0:	 0.05 FDR:   352; 0.01 FDR:   144; 0.001 FDR:   132
3:23:53.943868 PROGRESS: =========================================================================
3:23:53.944823 PROGRESS: === Epoch 16, step 5, extracting elution groups 31000 to 63000 ===
3:23:54.080185 PROGRESS: Extracting batch of 63233 precursors
3:23:54.100530 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:23:54.100636 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:23:54.100672 INFO: FWHM in RT is 14.40 seconds, sigma is 0.52
3:23:54.100714 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:23:54.100965 INFO: Starting candidate selection
3:23:59.322997 INFO: Starting candidate scoring
3:24:01.205506 INFO: Finished candidate processing
3:24:01.205608 INFO: Collecting candidate features
3:24:03.580748 WARNING: intensity_correlation has 73 NaNs ( 0.12 % out of 59004)
3:24:03.589751 INFO: Collecting fragment features
3:24:04.305401 INFO: Finished candidate scoring
3:24:04.658323 PROGRESS: === Epoch 16, step 5, extracted 59004 precursors and 285176 fragments ===
3:24:04.658665 INFO: performing precursor FDR with 47 features
3:24:04.658715 INFO: Decoy channel: -1
3:24:04.658742 INFO: Competetive: True
3:24:04.796738 WARNING: dropped 73 target PSMs due to missing features
3:24:04.796854 WARNING: dropped 73 decoy PSMs due to missing features
3:24:08.500304 INFO: Test AUC: 0.552
3:24:08.500421 INFO: Train AUC: 0.595
3:24:08.500479 INFO: AUC difference: 7.17%
3:24:08.500507 WARNING: AUC difference > 5%. This may indicate overfitting.
3:24:08.631899 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
3:24:08.633476 PROGRESS: ============================= Precursor FDR =============================
3:24:08.633621 PROGRESS: Total precursors accumulated: 1,985
3:24:08.633701 PROGRESS: Target precursors: 1,808 (91.08%)
3:24:08.633777 PROGRESS: Decoy precursors: 177 (8.92%)
3:24:08.633843 PROGRESS: 
3:24:08.633905 PROGRESS: Precursor Summary:
3:24:08.635826 PROGRESS: Channel   0:	 0.05 FDR:   890; 0.01 FDR:   419; 0.001 FDR:   324
3:24:08.635962 PROGRESS: 
3:24:08.636038 PROGRESS: Protein Summary:
3:24:08.638366 PROGRESS: Channel   0:	 0.05 FDR:   845; 0.01 FDR:   395; 0.001 FDR:   306
3:24:08.638480 PROGRESS: =========================================================================
3:24:08.639615 PROGRESS: === Epoch 16, step 6, extracting elution groups 63000 to 127000 ===
3:24:08.816053 PROGRESS: Extracting batch of 126485 precursors
3:24:08.855052 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:24:08.855165 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:24:08.855202 INFO: FWHM in RT is 14.40 seconds, sigma is 0.52
3:24:08.855245 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:24:08.855504 INFO: Starting candidate selection
3:24:15.378402 INFO: Starting candidate scoring
3:24:17.879249 INFO: Finished candidate processing
3:24:17.879350 INFO: Collecting candidate features
3:24:20.437797 WARNING: intensity_correlation has 171 NaNs ( 0.15 % out of 117809)
3:24:20.450994 INFO: Collecting fragment features
3:24:21.213810 INFO: Finished candidate scoring
3:24:21.652403 PROGRESS: === Epoch 16, step 6, extracted 117809 precursors and 566973 fragments ===
3:24:21.652761 INFO: performing precursor FDR with 47 features
3:24:21.652808 INFO: Decoy channel: -1
3:24:21.652834 INFO: Competetive: True
3:24:21.921917 WARNING: dropped 176 target PSMs due to missing features
3:24:21.922049 WARNING: dropped 141 decoy PSMs due to missing features
3:24:30.320020 INFO: Test AUC: 0.549
3:24:30.320148 INFO: Train AUC: 0.585
3:24:30.320204 INFO: AUC difference: 6.30%
3:24:30.320233 WARNING: AUC difference > 5%. This may indicate overfitting.
3:24:30.472666 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
3:24:30.474656 PROGRESS: ============================= Precursor FDR =============================
3:24:30.474794 PROGRESS: Total precursors accumulated: 3,386
3:24:30.474875 PROGRESS: Target precursors: 3,088 (91.20%)
3:24:30.474946 PROGRESS: Decoy precursors: 298 (8.80%)
3:24:30.475010 PROGRESS: 
3:24:30.475072 PROGRESS: Precursor Summary:
3:24:30.477322 PROGRESS: Channel   0:	 0.05 FDR: 2,004; 0.01 FDR:   969; 0.001 FDR:   110
3:24:30.477456 PROGRESS: 
3:24:30.477530 PROGRESS: Protein Summary:
3:24:30.480401 PROGRESS: Channel   0:	 0.05 FDR: 1,829; 0.01 FDR:   889; 0.001 FDR:   107
3:24:30.480531 PROGRESS: =========================================================================
3:24:30.481993 PROGRESS: === Epoch 16, step 7, extracting elution groups 127000 to 255000 ===
3:24:30.707755 PROGRESS: Extracting batch of 252863 precursors
3:24:30.781680 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:24:30.781809 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:24:30.781865 INFO: FWHM in RT is 14.40 seconds, sigma is 0.52
3:24:30.781892 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:24:30.782155 INFO: Starting candidate selection
3:24:39.848365 INFO: Starting candidate scoring
3:24:43.540781 INFO: Finished candidate processing
3:24:43.540959 INFO: Collecting candidate features
3:24:46.472372 WARNING: intensity_correlation has 343 NaNs ( 0.15 % out of 235496)
3:24:46.492948 INFO: Collecting fragment features
3:24:47.355458 INFO: Finished candidate scoring
3:24:47.935441 PROGRESS: === Epoch 16, step 7, extracted 235496 precursors and 1135861 fragments ===
3:24:47.935811 INFO: performing precursor FDR with 47 features
3:24:47.935858 INFO: Decoy channel: -1
3:24:47.935885 INFO: Competetive: True
3:24:48.527069 WARNING: dropped 345 target PSMs due to missing features
3:24:48.527193 WARNING: dropped 315 decoy PSMs due to missing features
3:25:05.529072 INFO: Test AUC: 0.551
3:25:05.529206 INFO: Train AUC: 0.573
3:25:05.529263 INFO: AUC difference: 3.87%
3:25:05.717055 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
3:25:05.719497 PROGRESS: ============================= Precursor FDR =============================
3:25:05.719655 PROGRESS: Total precursors accumulated: 4,738
3:25:05.719735 PROGRESS: Target precursors: 4,320 (91.18%)
3:25:05.719831 PROGRESS: Decoy precursors: 418 (8.82%)
3:25:05.719896 PROGRESS: 
3:25:05.719957 PROGRESS: Precursor Summary:
3:25:05.722859 PROGRESS: Channel   0:	 0.05 FDR: 3,134; 0.01 FDR: 1,818; 0.001 FDR: 1,020
3:25:05.723014 PROGRESS: 
3:25:05.723086 PROGRESS: Protein Summary:
3:25:05.727044 PROGRESS: Channel   0:	 0.05 FDR: 2,607; 0.01 FDR: 1,481; 0.001 FDR:   862
3:25:05.727173 PROGRESS: =========================================================================
3:25:05.729085 PROGRESS: === Epoch 16, step 8, extracting elution groups 255000 to 511000 ===
3:25:06.035122 PROGRESS: Extracting batch of 505771 precursors
3:25:06.169484 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:25:06.169602 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:25:06.169641 INFO: FWHM in RT is 14.40 seconds, sigma is 0.52
3:25:06.169684 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:25:06.169982 INFO: Starting candidate selection
3:25:20.397713 INFO: Starting candidate scoring
3:25:26.550962 INFO: Finished candidate processing
3:25:26.551155 INFO: Collecting candidate features
3:25:30.240612 WARNING: intensity_correlation has 625 NaNs ( 0.13 % out of 471621)
3:25:30.275005 INFO: Collecting fragment features
3:25:31.339008 INFO: Finished candidate scoring
3:25:32.232633 PROGRESS: === Epoch 16, step 8, extracted 471621 precursors and 2278236 fragments ===
3:25:32.233002 INFO: performing precursor FDR with 47 features
3:25:32.239717 INFO: Decoy channel: -1
3:25:32.239872 INFO: Competetive: True
3:25:33.402821 WARNING: dropped 676 target PSMs due to missing features
3:25:33.402958 WARNING: dropped 609 decoy PSMs due to missing features
3:26:08.673061 INFO: Test AUC: 0.551
3:26:08.673192 INFO: Train AUC: 0.566
3:26:08.673248 INFO: AUC difference: 2.71%
3:26:08.913703 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
3:26:08.916794 PROGRESS: ============================= Precursor FDR =============================
3:26:08.916956 PROGRESS: Total precursors accumulated: 7,304
3:26:08.917035 PROGRESS: Target precursors: 6,651 (91.06%)
3:26:08.917121 PROGRESS: Decoy precursors: 653 (8.94%)
3:26:08.917185 PROGRESS: 
3:26:08.917246 PROGRESS: Precursor Summary:
3:26:08.921045 PROGRESS: Channel   0:	 0.05 FDR: 5,099; 0.01 FDR: 3,523; 0.001 FDR: 2,599
3:26:08.921214 PROGRESS: 
3:26:08.921300 PROGRESS: Protein Summary:
3:26:08.926812 PROGRESS: Channel   0:	 0.05 FDR: 3,618; 0.01 FDR: 2,404; 0.001 FDR: 1,824
3:26:08.926965 PROGRESS: =========================================================================
3:26:08.931479 INFO: calibration group: precursor, fitting rt estimator 
3:26:09.340746 INFO: calibration group: fragment, fitting mz estimator 
3:26:09.930869 INFO: === checking if epoch conditions were reached ===
3:26:09.931081 INFO: ✅ ms2_error      : 7.0000 <= 7
3:26:09.931172 INFO: ❌ rt_error       : 203.1706 > 100
3:26:09.931246 INFO: ✅ current_epoch  : 16 >= 3
3:26:09.931310 INFO: ==============================================
3:26:10.179953 INFO: calibration group: precursor, predicting mz
3:26:10.180242 WARNING: mz prediction was skipped as it has not been fitted yet
3:26:10.180284 INFO: calibration group: precursor, predicting rt
3:26:17.015689 INFO: calibration group: fragment, predicting mz
3:26:35.114600 PROGRESS: === Epoch 17, step 0, extracting elution groups 0 to 1000 ===
3:26:35.213024 PROGRESS: Extracting batch of 1974 precursors
3:26:35.214767 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:26:35.214849 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:26:35.214892 INFO: FWHM in RT is 14.45 seconds, sigma is 0.53
3:26:35.214933 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:26:35.215178 INFO: Starting candidate selection
3:26:39.611770 INFO: Starting candidate scoring
3:26:40.908987 INFO: Finished candidate processing
3:26:40.909125 INFO: Collecting candidate features
3:26:43.087247 WARNING: intensity_correlation has 4 NaNs ( 0.22 % out of 1837)
3:26:43.093181 INFO: Collecting fragment features
3:26:43.733677 INFO: Finished candidate scoring
3:26:44.078380 PROGRESS: === Epoch 17, step 0, extracted 1837 precursors and 9027 fragments ===
3:26:44.078726 INFO: performing precursor FDR with 47 features
3:26:44.078783 INFO: Decoy channel: -1
3:26:44.078831 INFO: Competetive: True
3:26:44.083662 WARNING: dropped 2 target PSMs due to missing features
3:26:44.083734 WARNING: dropped 2 decoy PSMs due to missing features
3:26:44.111743 INFO: Test AUC: 0.490
3:26:44.111840 INFO: Train AUC: 0.559
3:26:44.111887 INFO: AUC difference: 12.27%
3:26:44.111922 WARNING: AUC difference > 5%. This may indicate overfitting.
3:26:44.229944 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
3:26:44.230709 PROGRESS: ============================= Precursor FDR =============================
3:26:44.230832 PROGRESS: Total precursors accumulated: 13
3:26:44.230911 PROGRESS: Target precursors: 12 (92.31%)
3:26:44.230991 PROGRESS: Decoy precursors: 1 (7.69%)
3:26:44.231056 PROGRESS: 
3:26:44.231118 PROGRESS: Precursor Summary:
3:26:44.232528 PROGRESS: Channel   0:	 0.05 FDR:     6; 0.01 FDR:     6; 0.001 FDR:     6
3:26:44.232641 PROGRESS: 
3:26:44.232715 PROGRESS: Protein Summary:
3:26:44.234331 PROGRESS: Channel   0:	 0.05 FDR:     6; 0.01 FDR:     6; 0.001 FDR:     6
3:26:44.234443 PROGRESS: =========================================================================
3:26:44.235300 PROGRESS: === Epoch 17, step 1, extracting elution groups 1000 to 3000 ===
3:26:44.312357 PROGRESS: Extracting batch of 3964 precursors
3:26:44.314550 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:26:44.314629 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:26:44.314670 INFO: FWHM in RT is 14.45 seconds, sigma is 0.53
3:26:44.314702 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:26:44.314917 INFO: Starting candidate selection
3:26:48.403543 INFO: Starting candidate scoring
3:26:49.741848 INFO: Finished candidate processing
3:26:49.741946 INFO: Collecting candidate features
3:26:51.938854 WARNING: intensity_correlation has 3 NaNs ( 0.08 % out of 3675)
3:26:51.944876 INFO: Collecting fragment features
3:26:52.587585 INFO: Finished candidate scoring
3:26:52.867929 PROGRESS: === Epoch 17, step 1, extracted 3675 precursors and 17588 fragments ===
3:26:52.868217 INFO: performing precursor FDR with 47 features
3:26:52.868263 INFO: Decoy channel: -1
3:26:52.868291 INFO: Competetive: True
3:26:52.876787 WARNING: dropped 3 target PSMs due to missing features
3:26:52.876893 WARNING: dropped 4 decoy PSMs due to missing features
3:26:52.914129 INFO: Test AUC: 0.520
3:26:52.914253 INFO: Train AUC: 0.548
3:26:52.914299 INFO: AUC difference: 5.00%
3:26:53.034530 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
3:26:53.035321 PROGRESS: ============================= Precursor FDR =============================
3:26:53.035447 PROGRESS: Total precursors accumulated: 39
3:26:53.035526 PROGRESS: Target precursors: 36 (92.31%)
3:26:53.035594 PROGRESS: Decoy precursors: 3 (7.69%)
3:26:53.035657 PROGRESS: 
3:26:53.035719 PROGRESS: Precursor Summary:
3:26:53.037164 PROGRESS: Channel   0:	 0.05 FDR:    32; 0.01 FDR:    27; 0.001 FDR:    27
3:26:53.037297 PROGRESS: 
3:26:53.037370 PROGRESS: Protein Summary:
3:26:53.039035 PROGRESS: Channel   0:	 0.05 FDR:    32; 0.01 FDR:    27; 0.001 FDR:    27
3:26:53.039162 PROGRESS: =========================================================================
3:26:53.040023 PROGRESS: === Epoch 17, step 2, extracting elution groups 3000 to 7000 ===
3:26:53.122264 PROGRESS: Extracting batch of 7870 precursors
3:26:53.125554 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:26:53.125618 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:26:53.125655 INFO: FWHM in RT is 14.45 seconds, sigma is 0.53
3:26:53.125700 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:26:53.125947 INFO: Starting candidate selection
3:26:57.212296 INFO: Starting candidate scoring
3:26:58.557818 INFO: Finished candidate processing
3:26:58.557954 INFO: Collecting candidate features
3:27:00.741259 WARNING: intensity_correlation has 9 NaNs ( 0.12 % out of 7342)
3:27:00.747555 INFO: Collecting fragment features
3:27:01.398996 INFO: Finished candidate scoring
3:27:01.685072 PROGRESS: === Epoch 17, step 2, extracted 7342 precursors and 35336 fragments ===
3:27:01.685408 INFO: performing precursor FDR with 47 features
3:27:01.685456 INFO: Decoy channel: -1
3:27:01.685483 INFO: Competetive: True
3:27:01.700645 WARNING: dropped 9 target PSMs due to missing features
3:27:01.700748 WARNING: dropped 7 decoy PSMs due to missing features
3:27:02.006223 INFO: Test AUC: 0.557
3:27:02.006354 INFO: Train AUC: 0.574
3:27:02.006417 INFO: AUC difference: 3.00%
3:27:02.128181 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
3:27:02.129033 PROGRESS: ============================= Precursor FDR =============================
3:27:02.129164 PROGRESS: Total precursors accumulated: 144
3:27:02.129247 PROGRESS: Target precursors: 131 (90.97%)
3:27:02.129320 PROGRESS: Decoy precursors: 13 (9.03%)
3:27:02.129388 PROGRESS: 
3:27:02.129453 PROGRESS: Precursor Summary:
3:27:02.130998 PROGRESS: Channel   0:	 0.05 FDR:   105; 0.01 FDR:    75; 0.001 FDR:    75
3:27:02.131129 PROGRESS: 
3:27:02.131203 PROGRESS: Protein Summary:
3:27:02.132937 PROGRESS: Channel   0:	 0.05 FDR:   105; 0.01 FDR:    75; 0.001 FDR:    75
3:27:02.133060 PROGRESS: =========================================================================
3:27:02.133991 PROGRESS: === Epoch 17, step 3, extracting elution groups 7000 to 15000 ===
3:27:02.226028 PROGRESS: Extracting batch of 15811 precursors
3:27:02.231540 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:27:02.231609 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:27:02.231644 INFO: FWHM in RT is 14.45 seconds, sigma is 0.53
3:27:02.231687 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:27:02.231911 INFO: Starting candidate selection
3:27:06.546824 INFO: Starting candidate scoring
3:27:07.985091 INFO: Finished candidate processing
3:27:07.985180 INFO: Collecting candidate features
3:27:10.219580 WARNING: intensity_correlation has 18 NaNs ( 0.12 % out of 14722)
3:27:10.225624 INFO: Collecting fragment features
3:27:10.895201 INFO: Finished candidate scoring
3:27:11.193591 PROGRESS: === Epoch 17, step 3, extracted 14722 precursors and 71340 fragments ===
3:27:11.193955 INFO: performing precursor FDR with 47 features
3:27:11.194011 INFO: Decoy channel: -1
3:27:11.194039 INFO: Competetive: True
3:27:11.222870 WARNING: dropped 15 target PSMs due to missing features
3:27:11.222987 WARNING: dropped 19 decoy PSMs due to missing features
3:27:11.977626 INFO: Test AUC: 0.543
3:27:11.977782 INFO: Train AUC: 0.593
3:27:11.977832 INFO: AUC difference: 8.39%
3:27:11.977880 WARNING: AUC difference > 5%. This may indicate overfitting.
3:27:12.103857 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
3:27:12.104865 PROGRESS: ============================= Precursor FDR =============================
3:27:12.104987 PROGRESS: Total precursors accumulated: 455
3:27:12.105065 PROGRESS: Target precursors: 416 (91.43%)
3:27:12.105134 PROGRESS: Decoy precursors: 39 (8.57%)
3:27:12.105199 PROGRESS: 
3:27:12.105274 PROGRESS: Precursor Summary:
3:27:12.106862 PROGRESS: Channel   0:	 0.05 FDR:   186; 0.01 FDR:   141; 0.001 FDR:   135
3:27:12.107005 PROGRESS: 
3:27:12.107079 PROGRESS: Protein Summary:
3:27:12.108893 PROGRESS: Channel   0:	 0.05 FDR:   184; 0.01 FDR:   139; 0.001 FDR:   133
3:27:12.109017 PROGRESS: =========================================================================
3:27:12.109976 PROGRESS: === Epoch 17, step 4, extracting elution groups 15000 to 31000 ===
3:27:12.217632 PROGRESS: Extracting batch of 31622 precursors
3:27:12.228058 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:27:12.228166 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:27:12.228208 INFO: FWHM in RT is 14.45 seconds, sigma is 0.53
3:27:12.228235 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:27:12.228472 INFO: Starting candidate selection
3:27:16.822268 INFO: Starting candidate scoring
3:27:18.402927 INFO: Finished candidate processing
3:27:18.403116 INFO: Collecting candidate features
3:27:20.656469 WARNING: intensity_correlation has 55 NaNs ( 0.19 % out of 29419)
3:27:20.664287 INFO: Collecting fragment features
3:27:21.344885 INFO: Finished candidate scoring
3:27:21.657109 PROGRESS: === Epoch 17, step 4, extracted 29419 precursors and 141916 fragments ===
3:27:21.657452 INFO: performing precursor FDR with 47 features
3:27:21.657499 INFO: Decoy channel: -1
3:27:21.657526 INFO: Competetive: True
3:27:21.716139 WARNING: dropped 43 target PSMs due to missing features
3:27:21.716243 WARNING: dropped 46 decoy PSMs due to missing features
3:27:23.632396 INFO: Test AUC: 0.548
3:27:23.632544 INFO: Train AUC: 0.602
3:27:23.632592 INFO: AUC difference: 8.98%
3:27:23.632627 WARNING: AUC difference > 5%. This may indicate overfitting.
3:27:23.775027 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
3:27:23.776269 PROGRESS: ============================= Precursor FDR =============================
3:27:23.776394 PROGRESS: Total precursors accumulated: 1,080
3:27:23.776471 PROGRESS: Target precursors: 985 (91.20%)
3:27:23.776538 PROGRESS: Decoy precursors: 95 (8.80%)
3:27:23.776611 PROGRESS: 
3:27:23.776674 PROGRESS: Precursor Summary:
3:27:23.778381 PROGRESS: Channel   0:	 0.05 FDR:   488; 0.01 FDR:   227; 0.001 FDR:   165
3:27:23.778495 PROGRESS: 
3:27:23.778570 PROGRESS: Protein Summary:
3:27:23.780559 PROGRESS: Channel   0:	 0.05 FDR:   472; 0.01 FDR:   218; 0.001 FDR:   158
3:27:23.780669 PROGRESS: =========================================================================
3:27:23.781660 PROGRESS: === Epoch 17, step 5, extracting elution groups 31000 to 63000 ===
3:27:23.917689 PROGRESS: Extracting batch of 63230 precursors
3:27:23.937723 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:27:23.937840 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:27:23.937895 INFO: FWHM in RT is 14.45 seconds, sigma is 0.53
3:27:23.937922 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:27:23.938175 INFO: Starting candidate selection
3:27:29.167904 INFO: Starting candidate scoring
3:27:31.057001 INFO: Finished candidate processing
3:27:31.057121 INFO: Collecting candidate features
3:27:33.400267 WARNING: intensity_correlation has 86 NaNs ( 0.15 % out of 58881)
3:27:33.409101 INFO: Collecting fragment features
3:27:34.121443 INFO: Finished candidate scoring
3:27:34.468646 PROGRESS: === Epoch 17, step 5, extracted 58881 precursors and 283824 fragments ===
3:27:34.468980 INFO: performing precursor FDR with 47 features
3:27:34.469043 INFO: Decoy channel: -1
3:27:34.469070 INFO: Competetive: True
3:27:34.598240 WARNING: dropped 89 target PSMs due to missing features
3:27:34.598357 WARNING: dropped 86 decoy PSMs due to missing features
3:27:38.460536 INFO: Test AUC: 0.557
3:27:38.460656 INFO: Train AUC: 0.592
3:27:38.460711 INFO: AUC difference: 5.92%
3:27:38.460739 WARNING: AUC difference > 5%. This may indicate overfitting.
3:27:38.596843 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
3:27:38.598511 PROGRESS: ============================= Precursor FDR =============================
3:27:38.598645 PROGRESS: Total precursors accumulated: 2,310
3:27:38.598725 PROGRESS: Target precursors: 2,108 (91.26%)
3:27:38.598794 PROGRESS: Decoy precursors: 202 (8.74%)
3:27:38.598859 PROGRESS: 
3:27:38.598921 PROGRESS: Precursor Summary:
3:27:38.600834 PROGRESS: Channel   0:	 0.05 FDR:   966; 0.01 FDR:   503; 0.001 FDR:   335
3:27:38.600977 PROGRESS: 
3:27:38.601051 PROGRESS: Protein Summary:
3:27:38.603401 PROGRESS: Channel   0:	 0.05 FDR:   912; 0.01 FDR:   471; 0.001 FDR:   317
3:27:38.603520 PROGRESS: =========================================================================
3:27:38.604678 PROGRESS: === Epoch 17, step 6, extracting elution groups 63000 to 127000 ===
3:27:38.780654 PROGRESS: Extracting batch of 126410 precursors
3:27:38.821248 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:27:38.821363 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:27:38.821419 INFO: FWHM in RT is 14.45 seconds, sigma is 0.53
3:27:38.821446 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:27:38.821722 INFO: Starting candidate selection
3:27:45.360746 INFO: Starting candidate scoring
3:27:47.852737 INFO: Finished candidate processing
3:27:47.852918 INFO: Collecting candidate features
3:27:50.378363 WARNING: intensity_correlation has 160 NaNs ( 0.14 % out of 117566)
3:27:50.391456 INFO: Collecting fragment features
3:27:51.160647 INFO: Finished candidate scoring
3:27:51.581843 PROGRESS: === Epoch 17, step 6, extracted 117566 precursors and 567967 fragments ===
3:27:51.582221 INFO: performing precursor FDR with 47 features
3:27:51.582291 INFO: Decoy channel: -1
3:27:51.582326 INFO: Competetive: True
3:27:51.853074 WARNING: dropped 172 target PSMs due to missing features
3:27:51.853190 WARNING: dropped 163 decoy PSMs due to missing features
3:27:59.968856 INFO: Test AUC: 0.557
3:27:59.968979 INFO: Train AUC: 0.585
3:27:59.969035 INFO: AUC difference: 4.64%
3:28:00.137497 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
3:28:00.139467 PROGRESS: ============================= Precursor FDR =============================
3:28:00.139615 PROGRESS: Total precursors accumulated: 3,335
3:28:00.139692 PROGRESS: Target precursors: 3,037 (91.06%)
3:28:00.139760 PROGRESS: Decoy precursors: 298 (8.94%)
3:28:00.139823 PROGRESS: 
3:28:00.139884 PROGRESS: Precursor Summary:
3:28:00.142083 PROGRESS: Channel   0:	 0.05 FDR: 1,731; 0.01 FDR:   874; 0.001 FDR:   306
3:28:00.142200 PROGRESS: 
3:28:00.142273 PROGRESS: Protein Summary:
3:28:00.145017 PROGRESS: Channel   0:	 0.05 FDR: 1,556; 0.01 FDR:   777; 0.001 FDR:   283
3:28:00.145128 PROGRESS: =========================================================================
3:28:00.146523 PROGRESS: === Epoch 17, step 7, extracting elution groups 127000 to 255000 ===
3:28:00.370427 PROGRESS: Extracting batch of 253016 precursors
3:28:00.443422 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:28:00.443540 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:28:00.443578 INFO: FWHM in RT is 14.45 seconds, sigma is 0.53
3:28:00.443622 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:28:00.443885 INFO: Starting candidate selection
3:28:09.532505 INFO: Starting candidate scoring
3:28:13.239531 INFO: Finished candidate processing
3:28:13.239648 INFO: Collecting candidate features
3:28:16.215465 WARNING: intensity_correlation has 314 NaNs ( 0.13 % out of 235728)
3:28:16.236097 INFO: Collecting fragment features
3:28:17.111240 INFO: Finished candidate scoring
3:28:17.697554 PROGRESS: === Epoch 17, step 7, extracted 235728 precursors and 1139035 fragments ===
3:28:17.697907 INFO: performing precursor FDR with 47 features
3:28:17.697954 INFO: Decoy channel: -1
3:28:17.697981 INFO: Competetive: True
3:28:18.294269 WARNING: dropped 328 target PSMs due to missing features
3:28:18.294414 WARNING: dropped 321 decoy PSMs due to missing features
3:28:34.963064 INFO: Test AUC: 0.551
3:28:34.963195 INFO: Train AUC: 0.576
3:28:34.963265 INFO: AUC difference: 4.28%
3:28:35.147089 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
3:28:35.149474 PROGRESS: ============================= Precursor FDR =============================
3:28:35.149620 PROGRESS: Total precursors accumulated: 4,735
3:28:35.149697 PROGRESS: Target precursors: 4,314 (91.11%)
3:28:35.149763 PROGRESS: Decoy precursors: 421 (8.89%)
3:28:35.149855 PROGRESS: 
3:28:35.149917 PROGRESS: Precursor Summary:
3:28:35.152538 PROGRESS: Channel   0:	 0.05 FDR: 2,887; 0.01 FDR: 1,693; 0.001 FDR:   684
3:28:35.152669 PROGRESS: 
3:28:35.152742 PROGRESS: Protein Summary:
3:28:35.156346 PROGRESS: Channel   0:	 0.05 FDR: 2,400; 0.01 FDR: 1,390; 0.001 FDR:   591
3:28:35.156459 PROGRESS: =========================================================================
3:28:35.158312 PROGRESS: === Epoch 17, step 8, extracting elution groups 255000 to 511000 ===
3:28:35.461966 PROGRESS: Extracting batch of 505847 precursors
3:28:35.594176 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:28:35.594309 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:28:35.594351 INFO: FWHM in RT is 14.45 seconds, sigma is 0.53
3:28:35.594378 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:28:35.594660 INFO: Starting candidate selection
3:28:49.794273 INFO: Starting candidate scoring
3:28:55.930055 INFO: Finished candidate processing
3:28:55.930247 INFO: Collecting candidate features
3:28:59.563599 WARNING: intensity_correlation has 647 NaNs ( 0.14 % out of 471066)
3:28:59.596797 INFO: Collecting fragment features
3:29:00.652178 INFO: Finished candidate scoring
3:29:01.535508 PROGRESS: === Epoch 17, step 8, extracted 471066 precursors and 2274568 fragments ===
3:29:01.535868 INFO: performing precursor FDR with 47 features
3:29:01.535912 INFO: Decoy channel: -1
3:29:01.535938 INFO: Competetive: True
3:29:02.660189 WARNING: dropped 668 target PSMs due to missing features
3:29:02.660312 WARNING: dropped 628 decoy PSMs due to missing features
3:29:37.103707 INFO: Test AUC: 0.551
3:29:37.103832 INFO: Train AUC: 0.567
3:29:37.103889 INFO: AUC difference: 2.83%
3:29:37.342661 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
3:29:37.345688 PROGRESS: ============================= Precursor FDR =============================
3:29:37.345879 PROGRESS: Total precursors accumulated: 7,342
3:29:37.345963 PROGRESS: Target precursors: 6,686 (91.07%)
3:29:37.346032 PROGRESS: Decoy precursors: 656 (8.93%)
3:29:37.346095 PROGRESS: 
3:29:37.346171 PROGRESS: Precursor Summary:
3:29:37.349869 PROGRESS: Channel   0:	 0.05 FDR: 5,116; 0.01 FDR: 3,587; 0.001 FDR: 2,302
3:29:37.350019 PROGRESS: 
3:29:37.350092 PROGRESS: Protein Summary:
3:29:37.355417 PROGRESS: Channel   0:	 0.05 FDR: 3,665; 0.01 FDR: 2,471; 0.001 FDR: 1,647
3:29:37.355549 PROGRESS: =========================================================================
3:29:37.359993 INFO: calibration group: precursor, fitting rt estimator 
3:29:37.776210 INFO: calibration group: fragment, fitting mz estimator 
3:29:38.362365 INFO: === checking if epoch conditions were reached ===
3:29:38.362566 INFO: ✅ ms2_error      : 7.0000 <= 7
3:29:38.362656 INFO: ❌ rt_error       : 201.9384 > 100
3:29:38.362731 INFO: ✅ current_epoch  : 17 >= 3
3:29:38.362797 INFO: ==============================================
3:29:38.579834 INFO: calibration group: precursor, predicting mz
3:29:38.580099 WARNING: mz prediction was skipped as it has not been fitted yet
3:29:38.580154 INFO: calibration group: precursor, predicting rt
3:29:45.326198 INFO: calibration group: fragment, predicting mz
3:30:03.478156 PROGRESS: === Epoch 18, step 0, extracting elution groups 0 to 1000 ===
3:30:03.577594 PROGRESS: Extracting batch of 1980 precursors
3:30:03.579321 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:30:03.579418 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:30:03.579461 INFO: FWHM in RT is 14.22 seconds, sigma is 0.52
3:30:03.579490 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:30:03.579729 INFO: Starting candidate selection
3:30:08.031390 INFO: Starting candidate scoring
3:30:09.347991 INFO: Finished candidate processing
3:30:09.348083 INFO: Collecting candidate features
3:30:11.498419 WARNING: intensity_correlation has 3 NaNs ( 0.16 % out of 1837)
3:30:11.504187 INFO: Collecting fragment features
3:30:12.135817 INFO: Finished candidate scoring
3:30:12.486708 PROGRESS: === Epoch 18, step 0, extracted 1837 precursors and 8969 fragments ===
3:30:12.487052 INFO: performing precursor FDR with 47 features
3:30:12.487095 INFO: Decoy channel: -1
3:30:12.487123 INFO: Competetive: True
3:30:12.491761 WARNING: dropped 2 target PSMs due to missing features
3:30:12.491837 WARNING: dropped 1 decoy PSMs due to missing features
3:30:12.519439 INFO: Test AUC: 0.562
3:30:12.519539 INFO: Train AUC: 0.565
3:30:12.519585 INFO: AUC difference: 0.54%
3:30:12.666661 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
3:30:12.667487 PROGRESS: ============================= Precursor FDR =============================
3:30:12.667608 PROGRESS: Total precursors accumulated: 9
3:30:12.667686 PROGRESS: Target precursors: 9 (100.00%)
3:30:12.667755 PROGRESS: Decoy precursors: 0 (0.00%)
3:30:12.667819 PROGRESS: 
3:30:12.667880 PROGRESS: Precursor Summary:
3:30:12.669375 PROGRESS: Channel   0:	 0.05 FDR:     9; 0.01 FDR:     9; 0.001 FDR:     9
3:30:12.669512 PROGRESS: 
3:30:12.669586 PROGRESS: Protein Summary:
3:30:12.671302 PROGRESS: Channel   0:	 0.05 FDR:     9; 0.01 FDR:     9; 0.001 FDR:     9
3:30:12.671430 PROGRESS: =========================================================================
3:30:12.672329 PROGRESS: === Epoch 18, step 1, extracting elution groups 1000 to 3000 ===
3:30:12.750211 PROGRESS: Extracting batch of 3948 precursors
3:30:12.752391 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:30:12.752453 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:30:12.752491 INFO: FWHM in RT is 14.22 seconds, sigma is 0.52
3:30:12.752521 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:30:12.752750 INFO: Starting candidate selection
3:30:16.823996 INFO: Starting candidate scoring
3:30:18.150403 INFO: Finished candidate processing
3:30:18.150515 INFO: Collecting candidate features
3:30:20.344183 WARNING: intensity_correlation has 3 NaNs ( 0.08 % out of 3660)
3:30:20.350296 INFO: Collecting fragment features
3:30:21.002722 INFO: Finished candidate scoring
3:30:21.283714 PROGRESS: === Epoch 18, step 1, extracted 3660 precursors and 17738 fragments ===
3:30:21.284004 INFO: performing precursor FDR with 47 features
3:30:21.284052 INFO: Decoy channel: -1
3:30:21.284078 INFO: Competetive: True
3:30:21.292462 WARNING: dropped 5 target PSMs due to missing features
3:30:21.292549 WARNING: dropped 1 decoy PSMs due to missing features
3:30:21.329616 INFO: Test AUC: 0.585
3:30:21.329734 INFO: Train AUC: 0.547
3:30:21.329787 INFO: AUC difference: 6.81%
3:30:21.329823 WARNING: AUC difference > 5%. This may indicate overfitting.
3:30:21.450523 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
3:30:21.451303 PROGRESS: ============================= Precursor FDR =============================
3:30:21.451420 PROGRESS: Total precursors accumulated: 26
3:30:21.451497 PROGRESS: Target precursors: 24 (92.31%)
3:30:21.451566 PROGRESS: Decoy precursors: 2 (7.69%)
3:30:21.451630 PROGRESS: 
3:30:21.451692 PROGRESS: Precursor Summary:
3:30:21.453117 PROGRESS: Channel   0:	 0.05 FDR:    24; 0.01 FDR:    24; 0.001 FDR:    24
3:30:21.453228 PROGRESS: 
3:30:21.453302 PROGRESS: Protein Summary:
3:30:21.454931 PROGRESS: Channel   0:	 0.05 FDR:    24; 0.01 FDR:    24; 0.001 FDR:    24
3:30:21.455083 PROGRESS: =========================================================================
3:30:21.455941 PROGRESS: === Epoch 18, step 2, extracting elution groups 3000 to 7000 ===
3:30:21.538318 PROGRESS: Extracting batch of 7905 precursors
3:30:21.541630 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:30:21.541721 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:30:21.541763 INFO: FWHM in RT is 14.22 seconds, sigma is 0.52
3:30:21.541806 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:30:21.542046 INFO: Starting candidate selection
3:30:25.649854 INFO: Starting candidate scoring
3:30:26.996433 INFO: Finished candidate processing
3:30:26.996530 INFO: Collecting candidate features
3:30:29.197830 WARNING: intensity_correlation has 7 NaNs ( 0.10 % out of 7365)
3:30:29.203444 INFO: Collecting fragment features
3:30:29.859190 INFO: Finished candidate scoring
3:30:30.147766 PROGRESS: === Epoch 18, step 2, extracted 7365 precursors and 35456 fragments ===
3:30:30.148087 INFO: performing precursor FDR with 47 features
3:30:30.148144 INFO: Decoy channel: -1
3:30:30.148190 INFO: Competetive: True
3:30:30.163577 WARNING: dropped 9 target PSMs due to missing features
3:30:30.163678 WARNING: dropped 4 decoy PSMs due to missing features
3:30:30.401550 INFO: Test AUC: 0.553
3:30:30.401679 INFO: Train AUC: 0.581
3:30:30.401727 INFO: AUC difference: 4.88%
3:30:30.528152 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
3:30:30.529009 PROGRESS: ============================= Precursor FDR =============================
3:30:30.529131 PROGRESS: Total precursors accumulated: 82
3:30:30.529209 PROGRESS: Target precursors: 75 (91.46%)
3:30:30.529278 PROGRESS: Decoy precursors: 7 (8.54%)
3:30:30.529341 PROGRESS: 
3:30:30.529402 PROGRESS: Precursor Summary:
3:30:30.530893 PROGRESS: Channel   0:	 0.05 FDR:    58; 0.01 FDR:    56; 0.001 FDR:    56
3:30:30.531026 PROGRESS: 
3:30:30.531101 PROGRESS: Protein Summary:
3:30:30.532769 PROGRESS: Channel   0:	 0.05 FDR:    57; 0.01 FDR:    55; 0.001 FDR:    55
3:30:30.532882 PROGRESS: =========================================================================
3:30:30.533791 PROGRESS: === Epoch 18, step 3, extracting elution groups 7000 to 15000 ===
3:30:30.625986 PROGRESS: Extracting batch of 15825 precursors
3:30:30.631555 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:30:30.631622 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:30:30.631656 INFO: FWHM in RT is 14.22 seconds, sigma is 0.52
3:30:30.631699 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:30:30.631915 INFO: Starting candidate selection
3:30:34.972315 INFO: Starting candidate scoring
3:30:36.415855 INFO: Finished candidate processing
3:30:36.415949 INFO: Collecting candidate features
3:30:38.612792 WARNING: intensity_correlation has 16 NaNs ( 0.11 % out of 14755)
3:30:38.618743 INFO: Collecting fragment features
3:30:39.273499 INFO: Finished candidate scoring
3:30:39.568318 PROGRESS: === Epoch 18, step 3, extracted 14755 precursors and 70568 fragments ===
3:30:39.568644 INFO: performing precursor FDR with 47 features
3:30:39.568692 INFO: Decoy channel: -1
3:30:39.568718 INFO: Competetive: True
3:30:39.596896 WARNING: dropped 14 target PSMs due to missing features
3:30:39.597006 WARNING: dropped 15 decoy PSMs due to missing features
3:30:40.260233 INFO: Test AUC: 0.551
3:30:40.260448 INFO: Train AUC: 0.591
3:30:40.260499 INFO: AUC difference: 6.65%
3:30:40.260533 WARNING: AUC difference > 5%. This may indicate overfitting.
3:30:40.385734 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
3:30:40.386703 PROGRESS: ============================= Precursor FDR =============================
3:30:40.386827 PROGRESS: Total precursors accumulated: 265
3:30:40.386905 PROGRESS: Target precursors: 243 (91.70%)
3:30:40.386972 PROGRESS: Decoy precursors: 22 (8.30%)
3:30:40.387034 PROGRESS: 
3:30:40.387094 PROGRESS: Precursor Summary:
3:30:40.388595 PROGRESS: Channel   0:	 0.05 FDR:   158; 0.01 FDR:    37; 0.001 FDR:    37
3:30:40.388708 PROGRESS: 
3:30:40.388783 PROGRESS: Protein Summary:
3:30:40.390516 PROGRESS: Channel   0:	 0.05 FDR:   155; 0.01 FDR:    37; 0.001 FDR:    37
3:30:40.390630 PROGRESS: =========================================================================
3:30:40.391514 PROGRESS: === Epoch 18, step 4, extracting elution groups 15000 to 31000 ===
3:30:40.499130 PROGRESS: Extracting batch of 31630 precursors
3:30:40.509641 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:30:40.509737 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:30:40.509786 INFO: FWHM in RT is 14.22 seconds, sigma is 0.52
3:30:40.509815 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:30:40.510061 INFO: Starting candidate selection
3:30:45.075725 INFO: Starting candidate scoring
3:30:46.626210 INFO: Finished candidate processing
3:30:46.626311 INFO: Collecting candidate features
3:30:48.873787 WARNING: intensity_correlation has 41 NaNs ( 0.14 % out of 29475)
3:30:48.881099 INFO: Collecting fragment features
3:30:49.560044 INFO: Finished candidate scoring
3:30:49.872518 PROGRESS: === Epoch 18, step 4, extracted 29475 precursors and 142054 fragments ===
3:30:49.872840 INFO: performing precursor FDR with 47 features
3:30:49.872885 INFO: Decoy channel: -1
3:30:49.872911 INFO: Competetive: True
3:30:49.930998 WARNING: dropped 34 target PSMs due to missing features
3:30:49.931108 WARNING: dropped 36 decoy PSMs due to missing features
3:30:51.818937 INFO: Test AUC: 0.556
3:30:51.819092 INFO: Train AUC: 0.603
3:30:51.819137 INFO: AUC difference: 7.80%
3:30:51.819171 WARNING: AUC difference > 5%. This may indicate overfitting.
3:30:51.946290 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
3:30:51.947510 PROGRESS: ============================= Precursor FDR =============================
3:30:51.947652 PROGRESS: Total precursors accumulated: 1,012
3:30:51.947732 PROGRESS: Target precursors: 924 (91.30%)
3:30:51.947800 PROGRESS: Decoy precursors: 88 (8.70%)
3:30:51.947864 PROGRESS: 
3:30:51.947924 PROGRESS: Precursor Summary:
3:30:51.949616 PROGRESS: Channel   0:	 0.05 FDR:   516; 0.01 FDR:   193; 0.001 FDR:   105
3:30:51.949732 PROGRESS: 
3:30:51.949818 PROGRESS: Protein Summary:
3:30:51.951791 PROGRESS: Channel   0:	 0.05 FDR:   499; 0.01 FDR:   186; 0.001 FDR:   103
3:30:51.951905 PROGRESS: =========================================================================
3:30:51.952885 PROGRESS: === Epoch 18, step 5, extracting elution groups 31000 to 63000 ===
3:30:52.089545 PROGRESS: Extracting batch of 63223 precursors
3:30:52.109782 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:30:52.109913 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:30:52.109952 INFO: FWHM in RT is 14.22 seconds, sigma is 0.52
3:30:52.109980 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:30:52.110230 INFO: Starting candidate selection
3:30:57.346746 INFO: Starting candidate scoring
3:30:59.220967 INFO: Finished candidate processing
3:30:59.221081 INFO: Collecting candidate features
3:31:01.592252 WARNING: intensity_correlation has 44 NaNs ( 0.07 % out of 58831)
3:31:01.601125 INFO: Collecting fragment features
3:31:02.324538 INFO: Finished candidate scoring
3:31:02.675375 PROGRESS: === Epoch 18, step 5, extracted 58831 precursors and 283804 fragments ===
3:31:02.675719 INFO: performing precursor FDR with 47 features
3:31:02.675767 INFO: Decoy channel: -1
3:31:02.675794 INFO: Competetive: True
3:31:02.807519 WARNING: dropped 53 target PSMs due to missing features
3:31:02.807639 WARNING: dropped 61 decoy PSMs due to missing features
3:31:06.784813 INFO: Test AUC: 0.557
3:31:06.784932 INFO: Train AUC: 0.595
3:31:06.784987 INFO: AUC difference: 6.46%
3:31:06.785015 WARNING: AUC difference > 5%. This may indicate overfitting.
3:31:06.919843 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
3:31:06.921309 PROGRESS: ============================= Precursor FDR =============================
3:31:06.921450 PROGRESS: Total precursors accumulated: 1,750
3:31:06.921529 PROGRESS: Target precursors: 1,596 (91.20%)
3:31:06.921597 PROGRESS: Decoy precursors: 154 (8.80%)
3:31:06.921661 PROGRESS: 
3:31:06.921722 PROGRESS: Precursor Summary:
3:31:06.923553 PROGRESS: Channel   0:	 0.05 FDR:   829; 0.01 FDR:   450; 0.001 FDR:   186
3:31:06.923702 PROGRESS: 
3:31:06.923777 PROGRESS: Protein Summary:
3:31:06.925998 PROGRESS: Channel   0:	 0.05 FDR:   790; 0.01 FDR:   422; 0.001 FDR:   178
3:31:06.926113 PROGRESS: =========================================================================
3:31:06.927236 PROGRESS: === Epoch 18, step 6, extracting elution groups 63000 to 127000 ===
3:31:07.102859 PROGRESS: Extracting batch of 126435 precursors
3:31:07.141524 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:31:07.141641 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:31:07.141679 INFO: FWHM in RT is 14.22 seconds, sigma is 0.52
3:31:07.141704 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:31:07.141982 INFO: Starting candidate selection
3:31:13.660069 INFO: Starting candidate scoring
3:31:16.129294 INFO: Finished candidate processing
3:31:16.129412 INFO: Collecting candidate features
3:31:18.674235 WARNING: intensity_correlation has 129 NaNs ( 0.11 % out of 117894)
3:31:18.686891 INFO: Collecting fragment features
3:31:19.450644 INFO: Finished candidate scoring
3:31:19.872599 PROGRESS: === Epoch 18, step 6, extracted 117894 precursors and 568316 fragments ===
3:31:19.872938 INFO: performing precursor FDR with 47 features
3:31:19.872983 INFO: Decoy channel: -1
3:31:19.873010 INFO: Competetive: True
3:31:20.141899 WARNING: dropped 113 target PSMs due to missing features
3:31:20.142031 WARNING: dropped 130 decoy PSMs due to missing features
3:31:28.342566 INFO: Test AUC: 0.554
3:31:28.342693 INFO: Train AUC: 0.585
3:31:28.342751 INFO: AUC difference: 5.34%
3:31:28.342780 WARNING: AUC difference > 5%. This may indicate overfitting.
3:31:28.495474 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
3:31:28.497413 PROGRESS: ============================= Precursor FDR =============================
3:31:28.497558 PROGRESS: Total precursors accumulated: 3,323
3:31:28.497636 PROGRESS: Target precursors: 3,033 (91.27%)
3:31:28.497703 PROGRESS: Decoy precursors: 290 (8.73%)
3:31:28.497766 PROGRESS: 
3:31:28.497840 PROGRESS: Precursor Summary:
3:31:28.500073 PROGRESS: Channel   0:	 0.05 FDR: 1,709; 0.01 FDR:   909; 0.001 FDR:   550
3:31:28.500189 PROGRESS: 
3:31:28.500262 PROGRESS: Protein Summary:
3:31:28.503097 PROGRESS: Channel   0:	 0.05 FDR: 1,538; 0.01 FDR:   803; 0.001 FDR:   494
3:31:28.503224 PROGRESS: =========================================================================
3:31:28.504617 PROGRESS: === Epoch 18, step 7, extracting elution groups 127000 to 255000 ===
3:31:28.728872 PROGRESS: Extracting batch of 252851 precursors
3:31:28.801982 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:31:28.802115 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:31:28.802156 INFO: FWHM in RT is 14.22 seconds, sigma is 0.52
3:31:28.802186 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:31:28.802461 INFO: Starting candidate selection
3:31:37.904442 INFO: Starting candidate scoring
3:31:41.608106 INFO: Finished candidate processing
3:31:41.608290 INFO: Collecting candidate features
3:31:44.574844 WARNING: intensity_correlation has 213 NaNs ( 0.09 % out of 235211)
3:31:44.595512 INFO: Collecting fragment features
3:31:45.467948 INFO: Finished candidate scoring
3:31:46.054247 PROGRESS: === Epoch 18, step 7, extracted 235211 precursors and 1133662 fragments ===
3:31:46.054605 INFO: performing precursor FDR with 47 features
3:31:46.054651 INFO: Decoy channel: -1
3:31:46.054678 INFO: Competetive: True
3:31:46.654676 WARNING: dropped 224 target PSMs due to missing features
3:31:46.654796 WARNING: dropped 232 decoy PSMs due to missing features
3:32:03.794943 INFO: Test AUC: 0.553
3:32:03.795075 INFO: Train AUC: 0.574
3:32:03.795131 INFO: AUC difference: 3.63%
3:32:03.979915 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
3:32:03.982252 PROGRESS: ============================= Precursor FDR =============================
3:32:03.982402 PROGRESS: Total precursors accumulated: 4,574
3:32:03.982481 PROGRESS: Target precursors: 4,166 (91.08%)
3:32:03.982563 PROGRESS: Decoy precursors: 408 (8.92%)
3:32:03.982628 PROGRESS: 
3:32:03.982690 PROGRESS: Precursor Summary:
3:32:03.985464 PROGRESS: Channel   0:	 0.05 FDR: 2,856; 0.01 FDR: 1,751; 0.001 FDR: 1,046
3:32:03.985587 PROGRESS: 
3:32:03.985660 PROGRESS: Protein Summary:
3:32:03.989322 PROGRESS: Channel   0:	 0.05 FDR: 2,377; 0.01 FDR: 1,423; 0.001 FDR:   879
3:32:03.989452 PROGRESS: =========================================================================
3:32:03.991327 PROGRESS: === Epoch 18, step 8, extracting elution groups 255000 to 511000 ===
3:32:04.298344 PROGRESS: Extracting batch of 505741 precursors
3:32:04.432660 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:32:04.432774 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:32:04.432812 INFO: FWHM in RT is 14.22 seconds, sigma is 0.52
3:32:04.432854 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:32:04.433119 INFO: Starting candidate selection
3:32:18.743234 INFO: Starting candidate scoring
3:32:24.888741 INFO: Finished candidate processing
3:32:24.888930 INFO: Collecting candidate features
3:32:28.521832 WARNING: intensity_correlation has 472 NaNs ( 0.10 % out of 471015)
3:32:28.555256 INFO: Collecting fragment features
3:32:29.605000 INFO: Finished candidate scoring
3:32:30.489993 PROGRESS: === Epoch 18, step 8, extracted 471015 precursors and 2268765 fragments ===
3:32:30.490341 INFO: performing precursor FDR with 47 features
3:32:30.490389 INFO: Decoy channel: -1
3:32:30.490417 INFO: Competetive: True
3:32:31.627687 WARNING: dropped 482 target PSMs due to missing features
3:32:31.627808 WARNING: dropped 446 decoy PSMs due to missing features
3:33:06.423145 INFO: Test AUC: 0.552
3:33:06.423273 INFO: Train AUC: 0.567
3:33:06.423329 INFO: AUC difference: 2.62%
3:33:06.664200 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
3:33:06.667196 PROGRESS: ============================= Precursor FDR =============================
3:33:06.667358 PROGRESS: Total precursors accumulated: 6,887
3:33:06.667446 PROGRESS: Target precursors: 6,276 (91.13%)
3:33:06.667532 PROGRESS: Decoy precursors: 611 (8.87%)
3:33:06.667596 PROGRESS: 
3:33:06.667656 PROGRESS: Precursor Summary:
3:33:06.671394 PROGRESS: Channel   0:	 0.05 FDR: 4,868; 0.01 FDR: 3,418; 0.001 FDR: 2,167
3:33:06.671544 PROGRESS: 
3:33:06.671616 PROGRESS: Protein Summary:
3:33:06.676770 PROGRESS: Channel   0:	 0.05 FDR: 3,433; 0.01 FDR: 2,336; 0.001 FDR: 1,569
3:33:06.676904 PROGRESS: =========================================================================
3:33:06.679538 PROGRESS: === Epoch 18, step 9, extracting elution groups 511000 to 1023000 ===
3:33:07.111073 PROGRESS: Extracting batch of 1011688 precursors
3:33:07.390449 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:33:07.390565 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:33:07.390605 INFO: FWHM in RT is 14.22 seconds, sigma is 0.52
3:33:07.390635 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:33:07.390909 INFO: Starting candidate selection
3:33:31.706371 INFO: Starting candidate scoring
3:33:42.820141 INFO: Finished candidate processing
3:33:42.820335 INFO: Collecting candidate features
3:33:47.698591 WARNING: intensity_correlation has 960 NaNs ( 0.10 % out of 942525)
3:33:47.700385 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 942525)
3:33:47.759060 INFO: Collecting fragment features
3:33:49.388500 INFO: Finished candidate scoring
3:33:50.966100 PROGRESS: === Epoch 18, step 9, extracted 942525 precursors and 4540947 fragments ===
3:33:50.966471 INFO: performing precursor FDR with 47 features
3:33:50.966515 INFO: Decoy channel: -1
3:33:50.966540 INFO: Competetive: True
3:33:53.216606 WARNING: dropped 980 target PSMs due to missing features
3:33:53.216735 WARNING: dropped 908 decoy PSMs due to missing features
3:35:03.989695 INFO: Test AUC: 0.551
3:35:03.989849 INFO: Train AUC: 0.562
3:35:03.989891 INFO: AUC difference: 2.01%
3:35:04.342447 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
3:35:04.346590 PROGRESS: ============================= Precursor FDR =============================
3:35:04.346767 PROGRESS: Total precursors accumulated: 11,679
3:35:04.346845 PROGRESS: Target precursors: 10,660 (91.27%)
3:35:04.346929 PROGRESS: Decoy precursors: 1,019 (8.73%)
3:35:04.346992 PROGRESS: 
3:35:04.347054 PROGRESS: Precursor Summary:
3:35:04.352489 PROGRESS: Channel   0:	 0.05 FDR: 9,058; 0.01 FDR: 6,883; 0.001 FDR: 4,084
3:35:04.352674 PROGRESS: 
3:35:04.352748 PROGRESS: Protein Summary:
3:35:04.360693 PROGRESS: Channel   0:	 0.05 FDR: 4,890; 0.01 FDR: 3,652; 0.001 FDR: 2,458
3:35:04.360857 PROGRESS: =========================================================================
3:35:04.367646 INFO: calibration group: precursor, fitting rt estimator 
3:35:05.402009 INFO: calibration group: fragment, fitting mz estimator 
3:35:05.990414 INFO: === checking if epoch conditions were reached ===
3:35:05.990624 INFO: ✅ ms2_error      : 7.0000 <= 7
3:35:05.990712 INFO: ❌ rt_error       : 200.3534 > 100
3:35:05.990786 INFO: ✅ current_epoch  : 18 >= 3
3:35:05.990849 INFO: ==============================================
3:35:06.209981 INFO: calibration group: precursor, predicting mz
3:35:06.210259 WARNING: mz prediction was skipped as it has not been fitted yet
3:35:06.210301 INFO: calibration group: precursor, predicting rt
3:35:13.049777 INFO: calibration group: fragment, predicting mz
3:35:31.188010 PROGRESS: === Epoch 19, step 0, extracting elution groups 0 to 1000 ===
3:35:31.308953 PROGRESS: Extracting batch of 1980 precursors
3:35:31.310716 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:35:31.310816 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:35:31.310860 INFO: FWHM in RT is 14.34 seconds, sigma is 0.52
3:35:31.310891 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:35:31.311121 INFO: Starting candidate selection
3:35:35.761985 INFO: Starting candidate scoring
3:35:37.075759 INFO: Finished candidate processing
3:35:37.075847 INFO: Collecting candidate features
3:35:39.261594 INFO: Collecting fragment features
3:35:39.902553 INFO: Finished candidate scoring
3:35:40.304464 PROGRESS: === Epoch 19, step 0, extracted 1847 precursors and 9048 fragments ===
3:35:40.304795 INFO: performing precursor FDR with 47 features
3:35:40.304840 INFO: Decoy channel: -1
3:35:40.304866 INFO: Competetive: True
3:35:40.337876 INFO: Test AUC: 0.528
3:35:40.337983 INFO: Train AUC: 0.516
3:35:40.338028 INFO: AUC difference: 2.33%
3:35:40.457397 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
3:35:40.458183 PROGRESS: ============================= Precursor FDR =============================
3:35:40.458308 PROGRESS: Total precursors accumulated: 13
3:35:40.458399 PROGRESS: Target precursors: 12 (92.31%)
3:35:40.458470 PROGRESS: Decoy precursors: 1 (7.69%)
3:35:40.458532 PROGRESS: 
3:35:40.458593 PROGRESS: Precursor Summary:
3:35:40.460008 PROGRESS: Channel   0:	 0.05 FDR:    12; 0.01 FDR:    12; 0.001 FDR:    12
3:35:40.460125 PROGRESS: 
3:35:40.460198 PROGRESS: Protein Summary:
3:35:40.461813 PROGRESS: Channel   0:	 0.05 FDR:    12; 0.01 FDR:    12; 0.001 FDR:    12
3:35:40.461927 PROGRESS: =========================================================================
3:35:40.462787 PROGRESS: === Epoch 19, step 1, extracting elution groups 1000 to 3000 ===
3:35:40.540940 PROGRESS: Extracting batch of 3957 precursors
3:35:40.543172 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:35:40.543252 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:35:40.543295 INFO: FWHM in RT is 14.34 seconds, sigma is 0.52
3:35:40.543325 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:35:40.543563 INFO: Starting candidate selection
3:35:44.637598 INFO: Starting candidate scoring
3:35:45.973263 INFO: Finished candidate processing
3:35:45.973355 INFO: Collecting candidate features
3:35:48.133343 WARNING: intensity_correlation has 5 NaNs ( 0.14 % out of 3673)
3:35:48.139354 INFO: Collecting fragment features
3:35:48.778536 INFO: Finished candidate scoring
3:35:49.057162 PROGRESS: === Epoch 19, step 1, extracted 3673 precursors and 17613 fragments ===
3:35:49.057445 INFO: performing precursor FDR with 47 features
3:35:49.057492 INFO: Decoy channel: -1
3:35:49.057518 INFO: Competetive: True
3:35:49.066053 WARNING: dropped 4 target PSMs due to missing features
3:35:49.066145 WARNING: dropped 1 decoy PSMs due to missing features
3:35:49.103110 INFO: Test AUC: 0.544
3:35:49.103226 INFO: Train AUC: 0.535
3:35:49.103272 INFO: AUC difference: 1.70%
3:35:49.236228 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
3:35:49.237021 PROGRESS: ============================= Precursor FDR =============================
3:35:49.237144 PROGRESS: Total precursors accumulated: 53
3:35:49.237223 PROGRESS: Target precursors: 50 (94.34%)
3:35:49.237294 PROGRESS: Decoy precursors: 3 (5.66%)
3:35:49.237358 PROGRESS: 
3:35:49.237420 PROGRESS: Precursor Summary:
3:35:49.238868 PROGRESS: Channel   0:	 0.05 FDR:    49; 0.01 FDR:    38; 0.001 FDR:    38
3:35:49.238996 PROGRESS: 
3:35:49.239081 PROGRESS: Protein Summary:
3:35:49.240713 PROGRESS: Channel   0:	 0.05 FDR:    49; 0.01 FDR:    38; 0.001 FDR:    38
3:35:49.240820 PROGRESS: =========================================================================
3:35:49.241700 PROGRESS: === Epoch 19, step 2, extracting elution groups 3000 to 7000 ===
3:35:49.323896 PROGRESS: Extracting batch of 7901 precursors
3:35:49.327271 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:35:49.327336 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:35:49.327376 INFO: FWHM in RT is 14.34 seconds, sigma is 0.52
3:35:49.327421 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:35:49.327644 INFO: Starting candidate selection
3:35:53.481065 INFO: Starting candidate scoring
3:35:54.846552 INFO: Finished candidate processing
3:35:54.846650 INFO: Collecting candidate features
3:35:57.031617 WARNING: intensity_correlation has 3 NaNs ( 0.04 % out of 7350)
3:35:57.037268 INFO: Collecting fragment features
3:35:57.685807 INFO: Finished candidate scoring
3:35:57.971473 PROGRESS: === Epoch 19, step 2, extracted 7350 precursors and 35566 fragments ===
3:35:57.971802 INFO: performing precursor FDR with 47 features
3:35:57.971870 INFO: Decoy channel: -1
3:35:57.971906 INFO: Competetive: True
3:35:57.987024 WARNING: dropped 5 target PSMs due to missing features
3:35:57.987141 WARNING: dropped 3 decoy PSMs due to missing features
3:35:58.252649 INFO: Test AUC: 0.535
3:35:58.252780 INFO: Train AUC: 0.573
3:35:58.252852 INFO: AUC difference: 6.63%
3:35:58.252903 WARNING: AUC difference > 5%. This may indicate overfitting.
3:35:58.373903 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
3:35:58.381570 PROGRESS: ============================= Precursor FDR =============================
3:35:58.381721 PROGRESS: Total precursors accumulated: 111
3:35:58.381823 PROGRESS: Target precursors: 101 (90.99%)
3:35:58.381898 PROGRESS: Decoy precursors: 10 (9.01%)
3:35:58.381962 PROGRESS: 
3:35:58.382025 PROGRESS: Precursor Summary:
3:35:58.383537 PROGRESS: Channel   0:	 0.05 FDR:    81; 0.01 FDR:    56; 0.001 FDR:    56
3:35:58.383651 PROGRESS: 
3:35:58.383725 PROGRESS: Protein Summary:
3:35:58.385418 PROGRESS: Channel   0:	 0.05 FDR:    81; 0.01 FDR:    56; 0.001 FDR:    56
3:35:58.385545 PROGRESS: =========================================================================
3:35:58.386432 PROGRESS: === Epoch 19, step 3, extracting elution groups 7000 to 15000 ===
3:35:58.477435 PROGRESS: Extracting batch of 15815 precursors
3:35:58.482942 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:35:58.483010 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:35:58.483044 INFO: FWHM in RT is 14.34 seconds, sigma is 0.52
3:35:58.483085 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:35:58.483302 INFO: Starting candidate selection
3:36:02.776881 INFO: Starting candidate scoring
3:36:04.198954 INFO: Finished candidate processing
3:36:04.199064 INFO: Collecting candidate features
3:36:06.427493 WARNING: intensity_correlation has 19 NaNs ( 0.13 % out of 14696)
3:36:06.434572 INFO: Collecting fragment features
3:36:07.097130 INFO: Finished candidate scoring
3:36:07.393690 PROGRESS: === Epoch 19, step 3, extracted 14696 precursors and 71215 fragments ===
3:36:07.394032 INFO: performing precursor FDR with 47 features
3:36:07.394079 INFO: Decoy channel: -1
3:36:07.394105 INFO: Competetive: True
3:36:07.422711 WARNING: dropped 16 target PSMs due to missing features
3:36:07.422842 WARNING: dropped 11 decoy PSMs due to missing features
3:36:08.167665 INFO: Test AUC: 0.541
3:36:08.167818 INFO: Train AUC: 0.596
3:36:08.167864 INFO: AUC difference: 9.13%
3:36:08.167898 WARNING: AUC difference > 5%. This may indicate overfitting.
3:36:08.293010 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
3:36:08.293935 PROGRESS: ============================= Precursor FDR =============================
3:36:08.294061 PROGRESS: Total precursors accumulated: 215
3:36:08.294138 PROGRESS: Target precursors: 197 (91.63%)
3:36:08.294206 PROGRESS: Decoy precursors: 18 (8.37%)
3:36:08.294268 PROGRESS: 
3:36:08.294330 PROGRESS: Precursor Summary:
3:36:08.295837 PROGRESS: Channel   0:	 0.05 FDR:   148; 0.01 FDR:   114; 0.001 FDR:   100
3:36:08.295949 PROGRESS: 
3:36:08.296022 PROGRESS: Protein Summary:
3:36:08.297764 PROGRESS: Channel   0:	 0.05 FDR:   146; 0.01 FDR:   112; 0.001 FDR:    99
3:36:08.297882 PROGRESS: =========================================================================
3:36:08.298793 PROGRESS: === Epoch 19, step 4, extracting elution groups 15000 to 31000 ===
3:36:08.413270 PROGRESS: Extracting batch of 31621 precursors
3:36:08.423681 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:36:08.423795 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:36:08.423832 INFO: FWHM in RT is 14.34 seconds, sigma is 0.52
3:36:08.423860 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:36:08.424093 INFO: Starting candidate selection
3:36:13.006493 INFO: Starting candidate scoring
3:36:14.563730 INFO: Finished candidate processing
3:36:14.563836 INFO: Collecting candidate features
3:36:16.834086 WARNING: intensity_correlation has 36 NaNs ( 0.12 % out of 29515)
3:36:16.841522 INFO: Collecting fragment features
3:36:17.523740 INFO: Finished candidate scoring
3:36:17.837387 PROGRESS: === Epoch 19, step 4, extracted 29515 precursors and 142481 fragments ===
3:36:17.837733 INFO: performing precursor FDR with 47 features
3:36:17.837790 INFO: Decoy channel: -1
3:36:17.837817 INFO: Competetive: True
3:36:17.896135 WARNING: dropped 36 target PSMs due to missing features
3:36:17.896245 WARNING: dropped 27 decoy PSMs due to missing features
3:36:19.716547 INFO: Test AUC: 0.551
3:36:19.716707 INFO: Train AUC: 0.607
3:36:19.716755 INFO: AUC difference: 9.22%
3:36:19.716790 WARNING: AUC difference > 5%. This may indicate overfitting.
3:36:23.122775 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
3:36:23.123859 PROGRESS: ============================= Precursor FDR =============================
3:36:23.123988 PROGRESS: Total precursors accumulated: 519
3:36:23.124066 PROGRESS: Target precursors: 473 (91.14%)
3:36:23.124146 PROGRESS: Decoy precursors: 46 (8.86%)
3:36:23.124212 PROGRESS: 
3:36:23.124273 PROGRESS: Precursor Summary:
3:36:23.125975 PROGRESS: Channel   0:	 0.05 FDR:   345; 0.01 FDR:   228; 0.001 FDR:   209
3:36:23.126105 PROGRESS: 
3:36:23.126180 PROGRESS: Protein Summary:
3:36:23.128168 PROGRESS: Channel   0:	 0.05 FDR:   335; 0.01 FDR:   220; 0.001 FDR:   201
3:36:23.128279 PROGRESS: =========================================================================
3:36:23.129308 PROGRESS: === Epoch 19, step 5, extracting elution groups 31000 to 63000 ===
3:36:23.265901 PROGRESS: Extracting batch of 63197 precursors
3:36:23.285860 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:36:23.285985 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:36:23.286038 INFO: FWHM in RT is 14.34 seconds, sigma is 0.52
3:36:23.286065 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:36:23.286323 INFO: Starting candidate selection
3:36:28.570541 INFO: Starting candidate scoring
3:36:30.448906 INFO: Finished candidate processing
3:36:30.449086 INFO: Collecting candidate features
3:36:32.819972 WARNING: intensity_correlation has 67 NaNs ( 0.11 % out of 58732)
3:36:32.828982 INFO: Collecting fragment features
3:36:33.545352 INFO: Finished candidate scoring
3:36:33.904387 PROGRESS: === Epoch 19, step 5, extracted 58732 precursors and 283502 fragments ===
3:36:33.904806 INFO: performing precursor FDR with 47 features
3:36:33.904856 INFO: Decoy channel: -1
3:36:33.904881 INFO: Competetive: True
3:36:34.039654 WARNING: dropped 72 target PSMs due to missing features
3:36:34.039767 WARNING: dropped 58 decoy PSMs due to missing features
3:36:38.120169 INFO: Test AUC: 0.558
3:36:38.120298 INFO: Train AUC: 0.602
3:36:38.120344 INFO: AUC difference: 7.30%
3:36:38.120377 WARNING: AUC difference > 5%. This may indicate overfitting.
3:36:38.258839 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
3:36:38.260217 PROGRESS: ============================= Precursor FDR =============================
3:36:38.260384 PROGRESS: Total precursors accumulated: 1,175
3:36:38.260476 PROGRESS: Target precursors: 1,071 (91.15%)
3:36:38.260561 PROGRESS: Decoy precursors: 104 (8.85%)
3:36:38.260649 PROGRESS: 
3:36:38.260737 PROGRESS: Precursor Summary:
3:36:38.263206 PROGRESS: Channel   0:	 0.05 FDR:   641; 0.01 FDR:   454; 0.001 FDR:   328
3:36:38.263373 PROGRESS: 
3:36:38.263478 PROGRESS: Protein Summary:
3:36:38.265752 PROGRESS: Channel   0:	 0.05 FDR:   607; 0.01 FDR:   428; 0.001 FDR:   310
3:36:38.265911 PROGRESS: =========================================================================
3:36:38.267441 PROGRESS: === Epoch 19, step 6, extracting elution groups 63000 to 127000 ===
3:36:38.443039 PROGRESS: Extracting batch of 126474 precursors
3:36:38.481832 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:36:38.481970 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:36:38.482020 INFO: FWHM in RT is 14.34 seconds, sigma is 0.52
3:36:38.482053 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:36:38.482327 INFO: Starting candidate selection
3:36:45.032805 INFO: Starting candidate scoring
3:36:47.512216 INFO: Finished candidate processing
3:36:47.512346 INFO: Collecting candidate features
3:36:50.033458 WARNING: intensity_correlation has 157 NaNs ( 0.13 % out of 117573)
3:36:50.046180 INFO: Collecting fragment features
3:36:50.812035 INFO: Finished candidate scoring
3:36:51.241363 PROGRESS: === Epoch 19, step 6, extracted 117573 precursors and 566872 fragments ===
3:36:51.241743 INFO: performing precursor FDR with 47 features
3:36:51.241807 INFO: Decoy channel: -1
3:36:51.241836 INFO: Competetive: True
3:36:51.512786 WARNING: dropped 143 target PSMs due to missing features
3:36:51.512903 WARNING: dropped 144 decoy PSMs due to missing features
3:37:00.368831 INFO: Test AUC: 0.554
3:37:00.368982 INFO: Train AUC: 0.595
3:37:00.369022 INFO: AUC difference: 6.89%
3:37:00.369050 WARNING: AUC difference > 5%. This may indicate overfitting.
3:37:00.522489 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
3:37:00.524194 PROGRESS: ============================= Precursor FDR =============================
3:37:00.524358 PROGRESS: Total precursors accumulated: 2,135
3:37:00.524438 PROGRESS: Target precursors: 1,944 (91.05%)
3:37:00.524507 PROGRESS: Decoy precursors: 191 (8.95%)
3:37:00.524570 PROGRESS: 
3:37:00.524631 PROGRESS: Precursor Summary:
3:37:00.526943 PROGRESS: Channel   0:	 0.05 FDR: 1,334; 0.01 FDR:   870; 0.001 FDR:   588
3:37:00.527095 PROGRESS: 
3:37:00.527169 PROGRESS: Protein Summary:
3:37:00.530047 PROGRESS: Channel   0:	 0.05 FDR: 1,207; 0.01 FDR:   773; 0.001 FDR:   531
3:37:00.530166 PROGRESS: =========================================================================
3:37:00.531624 PROGRESS: === Epoch 19, step 7, extracting elution groups 127000 to 255000 ===
3:37:00.756325 PROGRESS: Extracting batch of 252917 precursors
3:37:00.829183 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:37:00.829302 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:37:00.829340 INFO: FWHM in RT is 14.34 seconds, sigma is 0.52
3:37:00.829384 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:37:00.829655 INFO: Starting candidate selection
3:37:09.920428 INFO: Starting candidate scoring
3:37:13.631029 INFO: Finished candidate processing
3:37:13.631220 INFO: Collecting candidate features
3:37:16.598093 WARNING: intensity_correlation has 274 NaNs ( 0.12 % out of 235347)
3:37:16.618954 INFO: Collecting fragment features
3:37:17.491372 INFO: Finished candidate scoring
3:37:18.082827 PROGRESS: === Epoch 19, step 7, extracted 235347 precursors and 1133399 fragments ===
3:37:18.083240 INFO: performing precursor FDR with 47 features
3:37:18.083288 INFO: Decoy channel: -1
3:37:18.083315 INFO: Competetive: True
3:37:18.687164 WARNING: dropped 270 target PSMs due to missing features
3:37:18.687292 WARNING: dropped 291 decoy PSMs due to missing features
3:37:36.174498 INFO: Test AUC: 0.553
3:37:36.174643 INFO: Train AUC: 0.580
3:37:36.174685 INFO: AUC difference: 4.70%
3:37:36.357025 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
3:37:36.359404 PROGRESS: ============================= Precursor FDR =============================
3:37:36.359579 PROGRESS: Total precursors accumulated: 3,951
3:37:36.359659 PROGRESS: Target precursors: 3,603 (91.19%)
3:37:36.359728 PROGRESS: Decoy precursors: 348 (8.81%)
3:37:36.359794 PROGRESS: 
3:37:36.359855 PROGRESS: Precursor Summary:
3:37:36.362821 PROGRESS: Channel   0:	 0.05 FDR: 2,636; 0.01 FDR: 1,628; 0.001 FDR: 1,268
3:37:36.362970 PROGRESS: 
3:37:36.363042 PROGRESS: Protein Summary:
3:37:36.366904 PROGRESS: Channel   0:	 0.05 FDR: 2,169; 0.01 FDR: 1,327; 0.001 FDR: 1,055
3:37:36.367046 PROGRESS: =========================================================================
3:37:36.368929 PROGRESS: === Epoch 19, step 8, extracting elution groups 255000 to 511000 ===
3:37:36.676211 PROGRESS: Extracting batch of 505732 precursors
3:37:36.811073 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:37:36.811189 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:37:36.811246 INFO: FWHM in RT is 14.34 seconds, sigma is 0.52
3:37:36.811273 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:37:36.811554 INFO: Starting candidate selection
3:37:51.120777 INFO: Starting candidate scoring
3:37:57.280778 INFO: Finished candidate processing
3:37:57.280972 INFO: Collecting candidate features
3:38:00.922256 WARNING: intensity_correlation has 596 NaNs ( 0.13 % out of 470640)
3:38:00.923347 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 470640)
3:38:00.955473 INFO: Collecting fragment features
3:38:02.007128 INFO: Finished candidate scoring
3:38:02.895646 PROGRESS: === Epoch 19, step 8, extracted 470640 precursors and 2271898 fragments ===
3:38:02.896025 INFO: performing precursor FDR with 47 features
3:38:02.896069 INFO: Decoy channel: -1
3:38:02.896095 INFO: Competetive: True
3:38:04.034234 WARNING: dropped 574 target PSMs due to missing features
3:38:04.034379 WARNING: dropped 583 decoy PSMs due to missing features
3:38:38.940274 INFO: Test AUC: 0.551
3:38:38.940405 INFO: Train AUC: 0.569
3:38:38.940475 INFO: AUC difference: 3.32%
3:38:39.181272 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
3:38:39.184334 PROGRESS: ============================= Precursor FDR =============================
3:38:39.184505 PROGRESS: Total precursors accumulated: 6,320
3:38:39.184584 PROGRESS: Target precursors: 5,769 (91.28%)
3:38:39.184669 PROGRESS: Decoy precursors: 551 (8.72%)
3:38:39.184743 PROGRESS: 
3:38:39.184807 PROGRESS: Precursor Summary:
3:38:39.188528 PROGRESS: Channel   0:	 0.05 FDR: 4,502; 0.01 FDR: 3,364; 0.001 FDR: 2,231
3:38:39.188687 PROGRESS: 
3:38:39.188760 PROGRESS: Protein Summary:
3:38:39.194006 PROGRESS: Channel   0:	 0.05 FDR: 3,116; 0.01 FDR: 2,303; 0.001 FDR: 1,620
3:38:39.194152 PROGRESS: =========================================================================
3:38:39.196828 PROGRESS: === Epoch 19, step 9, extracting elution groups 511000 to 1023000 ===
3:38:39.621105 PROGRESS: Extracting batch of 1011671 precursors
3:38:39.897159 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:38:39.897285 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:38:39.897326 INFO: FWHM in RT is 14.34 seconds, sigma is 0.52
3:38:39.897353 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:38:39.897628 INFO: Starting candidate selection
3:39:04.289967 INFO: Starting candidate scoring
3:39:15.433619 INFO: Finished candidate processing
3:39:15.433824 INFO: Collecting candidate features
3:39:20.314889 WARNING: intensity_correlation has 1105 NaNs ( 0.12 % out of 941376)
3:39:20.375031 INFO: Collecting fragment features
3:39:22.010349 INFO: Finished candidate scoring
3:39:23.589962 PROGRESS: === Epoch 19, step 9, extracted 941376 precursors and 4542338 fragments ===
3:39:23.590312 INFO: performing precursor FDR with 47 features
3:39:23.590358 INFO: Decoy channel: -1
3:39:23.590386 INFO: Competetive: True
3:39:25.795711 WARNING: dropped 1141 target PSMs due to missing features
3:39:25.795837 WARNING: dropped 1121 decoy PSMs due to missing features
3:40:37.128591 INFO: Test AUC: 0.552
3:40:37.128716 INFO: Train AUC: 0.563
3:40:37.128769 INFO: AUC difference: 1.85%
3:40:37.481355 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
3:40:37.485664 PROGRESS: ============================= Precursor FDR =============================
3:40:37.485879 PROGRESS: Total precursors accumulated: 11,593
3:40:37.485960 PROGRESS: Target precursors: 10,578 (91.24%)
3:40:37.486045 PROGRESS: Decoy precursors: 1,015 (8.76%)
3:40:37.486109 PROGRESS: 
3:40:37.486172 PROGRESS: Precursor Summary:
3:40:37.491838 PROGRESS: Channel   0:	 0.05 FDR: 8,970; 0.01 FDR: 6,623; 0.001 FDR: 4,513
3:40:37.492036 PROGRESS: 
3:40:37.492126 PROGRESS: Protein Summary:
3:40:37.500321 PROGRESS: Channel   0:	 0.05 FDR: 4,896; 0.01 FDR: 3,544; 0.001 FDR: 2,625
3:40:37.500518 PROGRESS: =========================================================================
3:40:37.507424 INFO: calibration group: precursor, fitting rt estimator 
3:40:38.479477 INFO: calibration group: fragment, fitting mz estimator 
3:40:39.285177 INFO: calibration group: precursor, predicting mz
3:40:39.286133 WARNING: mz prediction was skipped as it has not been fitted yet
3:40:39.286189 INFO: calibration group: precursor, predicting rt
3:40:46.124913 INFO: calibration group: fragment, predicting mz
3:41:04.243341 PROGRESS: Extracting batch of 9950763 precursors
3:41:06.952616 INFO: Duty cycle consists of 151 frames, 5.83 seconds cycle time
3:41:06.952730 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:41:06.952770 INFO: FWHM in RT is 14.53 seconds, sigma is 0.53
3:41:06.952814 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:41:06.953097 INFO: Starting candidate selection
3:44:15.514309 INFO: Applying score cutoff of 46.91101639556885
3:44:15.722295 INFO: Removed 6245413 precursors with score below cutoff
3:44:18.174137 INFO: Starting candidate scoring
3:44:57.695275 INFO: Finished candidate processing
3:44:57.695446 INFO: Collecting candidate features
3:45:08.381928 WARNING: intensity_correlation has 52 NaNs ( 0.00 % out of 3410070)
3:45:08.572531 INFO: Collecting fragment features
3:45:13.164473 INFO: Finished candidate scoring
3:45:16.619615 INFO: performing precursor FDR with 47 features
3:45:16.619733 INFO: Decoy channel: -1
3:45:16.619760 INFO: Competetive: True
3:45:19.564745 WARNING: dropped 28 target PSMs due to missing features
3:45:19.564869 WARNING: dropped 24 decoy PSMs due to missing features
3:47:31.515415 INFO: Test AUC: 0.566
3:47:31.515548 INFO: Train AUC: 0.572
3:47:31.515602 INFO: AUC difference: 1.04%
3:47:31.987644 INFO: Removing fragments below FDR threshold
3:47:32.286403 PROGRESS: ============================= Precursor FDR =============================
3:47:32.286700 PROGRESS: Total precursors accumulated: 22,381
3:47:32.286794 PROGRESS: Target precursors: 22,160 (99.01%)
3:47:32.286862 PROGRESS: Decoy precursors: 221 (0.99%)
3:47:32.286924 PROGRESS: 
3:47:32.286986 PROGRESS: Precursor Summary:
3:47:32.301785 PROGRESS: Channel   0:	 0.05 FDR: 22,160; 0.01 FDR: 22,160; 0.001 FDR: 15,927
3:47:32.302035 PROGRESS: 
3:47:32.302112 PROGRESS: Protein Summary:
3:47:32.321412 PROGRESS: Channel   0:	 0.05 FDR: 6,584; 0.01 FDR: 6,584; 0.001 FDR: 5,155
3:47:32.321672 PROGRESS: =========================================================================
3:47:32.716580 INFO: Finished workflow for LFQ_Orbitrap_AIF_Condition_B_Sample_Alpha_01
3:47:33.242021 PROGRESS: Loading raw file 4/6: LFQ_Orbitrap_AIF_Condition_A_Sample_Alpha_02
3:47:33.242196 INFO: Creating workflow folder for LFQ_Orbitrap_AIF_Condition_A_Sample_Alpha_02 at output/.progress/LFQ_Orbitrap_AIF_Condition_A_Sample_Alpha_02
3:48:03.389511 INFO: Determining DIA cycle
3:48:03.406222 WARNING: Failed to determine DIA cycle, will retry without MS1 spectra.
3:48:03.412261 INFO: Determining DIA cycle
3:48:03.429878 INFO: Found cycle with start 0.00 min and length 151.
3:48:03.605834 INFO: ============ Raw file stats ============
3:48:03.606227 INFO: RT (min)            : 0.0 - 150.0
3:48:03.606305 INFO: RT duration (sec)   : 8999.7
3:48:03.606337 INFO: RT duration (min)   : 150.0
3:48:03.606436 INFO: Cycle len (scans)   : 151
3:48:03.606473 INFO: Cycle len (sec)     : 5.84
3:48:03.606501 INFO: Number of cycles    : 1542
3:48:03.606563 INFO: MS2 range (m/z)     : 396.4 - 1004.7
3:48:03.606598 INFO: ========================================
3:48:05.876829 INFO: Initializing CalibrationManager
3:48:05.877101 INFO: Loading calibration config
3:48:05.877535 INFO: Calibration config: [{'name': 'fragment', 'estimators': [{'name': 'mz', 'model': 'LOESSRegression', 'model_args': {'n_kernels': 2}, 'input_columns': ['mz_library'], 'target_columns': ['mz_observed'], 'output_columns': ['mz_calibrated'], 'transform_deviation': '1e6', 'function': LOESSRegression(n_kernels=2)}]}, {'name': 'precursor', 'estimators': [{'name': 'mz', 'model': 'LOESSRegression', 'model_args': {'n_kernels': 2}, 'input_columns': ['mz_library'], 'target_columns': ['mz_observed'], 'output_columns': ['mz_calibrated'], 'transform_deviation': '1e6', 'function': LOESSRegression(n_kernels=2)}, {'name': 'rt', 'model': 'LOESSRegression', 'model_args': {'n_kernels': 6}, 'input_columns': ['rt_library'], 'target_columns': ['rt_observed'], 'output_columns': ['rt_calibrated'], 'function': LOESSRegression()}, {'name': 'mobility', 'model': 'LOESSRegression', 'model_args': {'n_kernels': 2}, 'input_columns': ['mobility_library'], 'target_columns': ['mobility_observed'], 'output_columns': ['mobility_calibrated'], 'function': LOESSRegression(n_kernels=2)}]}]
3:48:05.877652 INFO: Calibration group :fragment, found 1 estimator(s)
3:48:05.877734 INFO: Calibration group :precursor, found 3 estimator(s)
3:48:05.877829 INFO: Disabling ion mobility calibration
3:48:05.877863 INFO: removed mobility estimator from group precursor
3:48:05.877943 INFO: Initializing OptimizationManager
3:48:05.878034 INFO: initial parameter: fwhm_rt = 5
3:48:05.878091 INFO: initial parameter: fwhm_mobility = 0.01
3:48:05.878144 INFO: initial parameter: score_cutoff = 0
3:48:05.878238 PROGRESS: Initializing workflow LFQ_Orbitrap_AIF_Condition_A_Sample_Alpha_02
3:48:05.878315 INFO: Initializing OptimizationManager
3:48:05.878344 INFO: initial parameter: current_epoch = 0
3:48:05.878367 INFO: initial parameter: current_step = 0
3:48:05.878388 INFO: initial parameter: ms1_error = 10
3:48:05.878411 INFO: initial parameter: ms2_error = 10
3:48:05.878432 INFO: initial parameter: rt_error = 240
3:48:05.878453 INFO: initial parameter: mobility_error = 0.08
3:48:05.878473 INFO: initial parameter: column_type = library
3:48:05.878494 INFO: initial parameter: num_candidates = 1
3:48:05.878520 INFO: initial parameter: recalibration_target = 200
3:48:05.878541 INFO: initial parameter: accumulated_precursors = 0
3:48:05.878561 INFO: initial parameter: accumulated_precursors_01FDR = 0
3:48:05.878580 INFO: initial parameter: accumulated_precursors_001FDR = 0
3:48:05.878612 INFO: Initializing FDRManager
3:48:05.878645 INFO: Loading classifier store from /home/alphadia/miniconda3/envs/alphadia172/lib/python3.11/site-packages/alphadia/constants/classifier
3:48:05.881379 PROGRESS: Applying channel filter using only: [0]
3:48:07.890705 PROGRESS: 4,989,882 target precursors potentially observable (188,089 removed)
3:48:11.396139 INFO: === checking if epoch conditions were reached ===
3:48:11.396403 INFO: ❌ ms2_error      : 10.0000 > 7
3:48:11.396488 INFO: ❌ rt_error       : 240.0000 > 100
3:48:11.396552 INFO: ❌ current_epoch  : 0 < 3
3:48:11.396608 INFO: ==============================================
3:48:11.601627 INFO: calibration group: precursor, predicting mz
3:48:11.601940 WARNING: mz prediction was skipped as it has not been fitted yet
3:48:11.601987 INFO: calibration group: precursor, predicting rt
3:48:11.602046 WARNING: rt prediction was skipped as it has not been fitted yet
3:48:11.602079 INFO: calibration group: fragment, predicting mz
3:48:11.602133 WARNING: mz prediction was skipped as it has not been fitted yet
3:48:11.602170 PROGRESS: === Epoch 0, step 0, extracting elution groups 0 to 1000 ===
3:48:11.676631 PROGRESS: Extracting batch of 1986 precursors
3:48:11.678436 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:48:11.678513 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:48:11.678555 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
3:48:11.678586 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
3:48:11.678846 INFO: Starting candidate selection
3:48:15.301169 INFO: Starting candidate scoring
3:48:16.401169 INFO: Finished candidate processing
3:48:16.401344 INFO: Collecting candidate features
3:48:18.544514 INFO: Collecting fragment features
3:48:19.182977 INFO: Finished candidate scoring
3:48:19.459395 PROGRESS: === Epoch 0, step 0, extracted 1732 precursors and 9267 fragments ===
3:48:19.459676 INFO: performing precursor FDR with 47 features
3:48:19.459725 INFO: Decoy channel: -1
3:48:19.459752 INFO: Competetive: True
3:48:19.507968 INFO: Test AUC: 0.562
3:48:19.508075 INFO: Train AUC: 0.462
3:48:19.508121 INFO: AUC difference: 21.64%
3:48:19.508155 WARNING: AUC difference > 5%. This may indicate overfitting.
3:48:19.626316 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
3:48:19.627440 PROGRESS: ============================= Precursor FDR =============================
3:48:19.627583 PROGRESS: Total precursors accumulated: 885
3:48:19.627660 PROGRESS: Target precursors: 435 (49.15%)
3:48:19.627728 PROGRESS: Decoy precursors: 450 (50.85%)
3:48:19.627789 PROGRESS: 
3:48:19.627859 PROGRESS: Precursor Summary:
3:48:19.629263 PROGRESS: Channel   0:	 0.05 FDR:     0; 0.01 FDR:     0; 0.001 FDR:     0
3:48:19.629395 PROGRESS: 
3:48:19.629470 PROGRESS: Protein Summary:
3:48:19.631043 PROGRESS: Channel   0:	 0.05 FDR:     0; 0.01 FDR:     0; 0.001 FDR:     0
3:48:19.631154 PROGRESS: =========================================================================
3:48:19.631980 PROGRESS: === Epoch 0, step 1, extracting elution groups 1000 to 3000 ===
3:48:19.709669 PROGRESS: Extracting batch of 3941 precursors
3:48:19.711955 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:48:19.712019 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:48:19.712058 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
3:48:19.712088 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
3:48:19.712314 INFO: Starting candidate selection
3:48:23.290395 INFO: Starting candidate scoring
3:48:24.377955 INFO: Finished candidate processing
3:48:24.378044 INFO: Collecting candidate features
3:48:26.525944 WARNING: intensity_correlation has 1 NaNs ( 0.03 % out of 3302)
3:48:26.531734 INFO: Collecting fragment features
3:48:27.171592 INFO: Finished candidate scoring
3:48:27.452946 PROGRESS: === Epoch 0, step 1, extracted 3302 precursors and 18032 fragments ===
3:48:27.453235 INFO: performing precursor FDR with 47 features
3:48:27.453277 INFO: Decoy channel: -1
3:48:27.453304 INFO: Competetive: True
3:48:27.461396 WARNING: dropped 1 decoy PSMs due to missing features
3:48:27.520399 INFO: Test AUC: 0.513
3:48:27.520519 INFO: Train AUC: 0.494
3:48:27.520566 INFO: AUC difference: 3.76%
3:48:27.638628 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
3:48:27.640344 PROGRESS: ============================= Precursor FDR =============================
3:48:27.640506 PROGRESS: Total precursors accumulated: 2,591
3:48:27.640584 PROGRESS: Target precursors: 1,294 (49.94%)
3:48:27.640651 PROGRESS: Decoy precursors: 1,297 (50.06%)
3:48:27.640714 PROGRESS: 
3:48:27.640774 PROGRESS: Precursor Summary:
3:48:27.642232 PROGRESS: Channel   0:	 0.05 FDR:     0; 0.01 FDR:     0; 0.001 FDR:     0
3:48:27.642351 PROGRESS: 
3:48:27.642425 PROGRESS: Protein Summary:
3:48:27.644016 PROGRESS: Channel   0:	 0.05 FDR:     0; 0.01 FDR:     0; 0.001 FDR:     0
3:48:27.644137 PROGRESS: =========================================================================
3:48:27.644995 PROGRESS: === Epoch 0, step 2, extracting elution groups 3000 to 7000 ===
3:48:27.727310 PROGRESS: Extracting batch of 7898 precursors
3:48:27.730625 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:48:27.730690 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:48:27.730731 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
3:48:27.730777 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
3:48:27.731021 INFO: Starting candidate selection
3:48:31.429752 INFO: Starting candidate scoring
3:48:32.572869 INFO: Finished candidate processing
3:48:32.572969 INFO: Collecting candidate features
3:48:34.768223 INFO: Collecting fragment features
3:48:35.421403 INFO: Finished candidate scoring
3:48:35.710320 PROGRESS: === Epoch 0, step 2, extracted 6781 precursors and 36971 fragments ===
3:48:35.710673 INFO: performing precursor FDR with 47 features
3:48:35.710719 INFO: Decoy channel: -1
3:48:35.710746 INFO: Competetive: True
3:48:35.725321 WARNING: dropped 1 decoy PSMs due to missing features
3:48:35.780412 INFO: Test AUC: 0.494
3:48:35.780544 INFO: Train AUC: 0.492
3:48:35.780590 INFO: AUC difference: 0.33%
3:48:35.900738 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
3:48:35.901628 PROGRESS: ============================= Precursor FDR =============================
3:48:35.901755 PROGRESS: Total precursors accumulated: 2
3:48:35.901847 PROGRESS: Target precursors: 2 (100.00%)
3:48:35.901916 PROGRESS: Decoy precursors: 0 (0.00%)
3:48:35.901981 PROGRESS: 
3:48:35.902044 PROGRESS: Precursor Summary:
3:48:35.903560 PROGRESS: Channel   0:	 0.05 FDR:     2; 0.01 FDR:     2; 0.001 FDR:     2
3:48:35.903691 PROGRESS: 
3:48:35.903765 PROGRESS: Protein Summary:
3:48:35.905475 PROGRESS: Channel   0:	 0.05 FDR:     2; 0.01 FDR:     2; 0.001 FDR:     2
3:48:35.905589 PROGRESS: =========================================================================
3:48:35.906497 PROGRESS: === Epoch 0, step 3, extracting elution groups 7000 to 15000 ===
3:48:35.997953 PROGRESS: Extracting batch of 15849 precursors
3:48:36.003524 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:48:36.003597 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:48:36.003632 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
3:48:36.003673 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
3:48:36.003897 INFO: Starting candidate selection
3:48:39.919069 INFO: Starting candidate scoring
3:48:41.146381 INFO: Finished candidate processing
3:48:41.146471 INFO: Collecting candidate features
3:48:43.329452 INFO: Collecting fragment features
3:48:43.987741 INFO: Finished candidate scoring
3:48:44.282126 PROGRESS: === Epoch 0, step 3, extracted 13573 precursors and 74059 fragments ===
3:48:44.282434 INFO: performing precursor FDR with 47 features
3:48:44.282493 INFO: Decoy channel: -1
3:48:44.282531 INFO: Competetive: True
3:48:44.308189 WARNING: dropped 1 decoy PSMs due to missing features
3:48:45.054991 INFO: Test AUC: 0.536
3:48:45.055139 INFO: Train AUC: 0.536
3:48:45.061882 INFO: AUC difference: 0.09%
3:48:45.186198 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
3:48:45.187073 PROGRESS: ============================= Precursor FDR =============================
3:48:45.187192 PROGRESS: Total precursors accumulated: 4
3:48:45.187270 PROGRESS: Target precursors: 4 (100.00%)
3:48:45.187338 PROGRESS: Decoy precursors: 0 (0.00%)
3:48:45.187402 PROGRESS: 
3:48:45.187464 PROGRESS: Precursor Summary:
3:48:45.188975 PROGRESS: Channel   0:	 0.05 FDR:     4; 0.01 FDR:     4; 0.001 FDR:     4
3:48:45.189100 PROGRESS: 
3:48:45.189174 PROGRESS: Protein Summary:
3:48:45.190878 PROGRESS: Channel   0:	 0.05 FDR:     4; 0.01 FDR:     4; 0.001 FDR:     4
3:48:45.190997 PROGRESS: =========================================================================
3:48:45.191895 PROGRESS: === Epoch 0, step 4, extracting elution groups 15000 to 31000 ===
3:48:45.299509 PROGRESS: Extracting batch of 31659 precursors
3:48:45.310158 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:48:45.310251 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:48:45.310290 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
3:48:45.310316 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
3:48:45.310558 INFO: Starting candidate selection
3:48:49.566893 INFO: Starting candidate scoring
3:48:50.935780 INFO: Finished candidate processing
3:48:50.935973 INFO: Collecting candidate features
3:48:53.196769 INFO: Collecting fragment features
3:48:53.878226 INFO: Finished candidate scoring
3:48:54.192641 PROGRESS: === Epoch 0, step 4, extracted 27025 precursors and 147244 fragments ===
3:48:54.192997 INFO: performing precursor FDR with 47 features
3:48:54.193043 INFO: Decoy channel: -1
3:48:54.193070 INFO: Competetive: True
3:48:54.245203 WARNING: dropped 1 decoy PSMs due to missing features
3:48:55.783278 INFO: Test AUC: 0.538
3:48:55.783428 INFO: Train AUC: 0.550
3:48:55.783475 INFO: AUC difference: 2.24%
3:48:55.913049 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
3:48:55.913966 PROGRESS: ============================= Precursor FDR =============================
3:48:55.914089 PROGRESS: Total precursors accumulated: 3
3:48:55.914168 PROGRESS: Target precursors: 3 (100.00%)
3:48:55.914236 PROGRESS: Decoy precursors: 0 (0.00%)
3:48:55.914298 PROGRESS: 
3:48:55.914360 PROGRESS: Precursor Summary:
3:48:55.915883 PROGRESS: Channel   0:	 0.05 FDR:     3; 0.01 FDR:     3; 0.001 FDR:     3
3:48:55.915992 PROGRESS: 
3:48:55.916082 PROGRESS: Protein Summary:
3:48:55.917793 PROGRESS: Channel   0:	 0.05 FDR:     3; 0.01 FDR:     3; 0.001 FDR:     3
3:48:55.917903 PROGRESS: =========================================================================
3:48:55.918791 PROGRESS: === Epoch 0, step 5, extracting elution groups 31000 to 63000 ===
3:48:56.055476 PROGRESS: Extracting batch of 63257 precursors
3:48:56.075384 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:48:56.075495 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:48:56.075552 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
3:48:56.075583 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
3:48:56.075839 INFO: Starting candidate selection
3:49:01.049333 INFO: Starting candidate scoring
3:49:02.689636 INFO: Finished candidate processing
3:49:02.689734 INFO: Collecting candidate features
3:49:05.030672 WARNING: intensity_correlation has 3 NaNs ( 0.01 % out of 54079)
3:49:05.039170 INFO: Collecting fragment features
3:49:05.756049 INFO: Finished candidate scoring
3:49:06.105096 PROGRESS: === Epoch 0, step 5, extracted 54079 precursors and 294711 fragments ===
3:49:06.105491 INFO: performing precursor FDR with 47 features
3:49:06.105540 INFO: Decoy channel: -1
3:49:06.105566 INFO: Competetive: True
3:49:06.226940 WARNING: dropped 2 target PSMs due to missing features
3:49:06.227060 WARNING: dropped 2 decoy PSMs due to missing features
3:49:09.955201 INFO: Test AUC: 0.545
3:49:09.955326 INFO: Train AUC: 0.559
3:49:09.955382 INFO: AUC difference: 2.53%
3:49:10.089048 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
3:49:10.090019 PROGRESS: ============================= Precursor FDR =============================
3:49:10.090143 PROGRESS: Total precursors accumulated: 179
3:49:10.090220 PROGRESS: Target precursors: 163 (91.06%)
3:49:10.090287 PROGRESS: Decoy precursors: 16 (8.94%)
3:49:10.090351 PROGRESS: 
3:49:10.090413 PROGRESS: Precursor Summary:
3:49:10.091964 PROGRESS: Channel   0:	 0.05 FDR:   139; 0.01 FDR:   122; 0.001 FDR:   115
3:49:10.092097 PROGRESS: 
3:49:10.092171 PROGRESS: Protein Summary:
3:49:10.093986 PROGRESS: Channel   0:	 0.05 FDR:   135; 0.01 FDR:   118; 0.001 FDR:   112
3:49:10.094100 PROGRESS: =========================================================================
3:49:10.095049 PROGRESS: === Epoch 0, step 6, extracting elution groups 63000 to 127000 ===
3:49:10.271151 PROGRESS: Extracting batch of 126429 precursors
3:49:10.310048 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:49:10.310166 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:49:10.310207 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
3:49:10.310235 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
3:49:10.310499 INFO: Starting candidate selection
3:49:16.682944 INFO: Starting candidate scoring
3:49:18.848800 INFO: Finished candidate processing
3:49:18.848971 INFO: Collecting candidate features
3:49:21.354116 WARNING: intensity_correlation has 3 NaNs ( 0.00 % out of 108383)
3:49:21.366217 INFO: Collecting fragment features
3:49:22.127912 INFO: Finished candidate scoring
3:49:22.544923 PROGRESS: === Epoch 0, step 6, extracted 108383 precursors and 589313 fragments ===
3:49:22.545298 INFO: performing precursor FDR with 47 features
3:49:22.545342 INFO: Decoy channel: -1
3:49:22.545368 INFO: Competetive: True
3:49:22.795193 WARNING: dropped 5 target PSMs due to missing features
3:49:22.795311 WARNING: dropped 2 decoy PSMs due to missing features
3:49:30.269748 INFO: Test AUC: 0.541
3:49:30.269918 INFO: Train AUC: 0.559
3:49:30.269960 INFO: AUC difference: 3.15%
3:49:30.427037 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
3:49:30.428166 PROGRESS: ============================= Precursor FDR =============================
3:49:30.428306 PROGRESS: Total precursors accumulated: 499
3:49:30.428387 PROGRESS: Target precursors: 455 (91.18%)
3:49:30.428456 PROGRESS: Decoy precursors: 44 (8.82%)
3:49:30.428519 PROGRESS: 
3:49:30.428579 PROGRESS: Precursor Summary:
3:49:30.430389 PROGRESS: Channel   0:	 0.05 FDR:   376; 0.01 FDR:   321; 0.001 FDR:   301
3:49:30.430513 PROGRESS: 
3:49:30.430587 PROGRESS: Protein Summary:
3:49:30.432666 PROGRESS: Channel   0:	 0.05 FDR:   350; 0.01 FDR:   299; 0.001 FDR:   280
3:49:30.432785 PROGRESS: =========================================================================
3:49:30.434564 INFO: calibration group: precursor, fitting rt estimator 
3:49:30.589355 INFO: calibration group: fragment, fitting mz estimator 
3:49:30.983186 INFO: === checking if epoch conditions were reached ===
3:49:30.983332 INFO: ✅ ms2_error      : 7.0000 <= 7
3:49:30.983420 INFO: ❌ rt_error       : 257.7030 > 100
3:49:30.983502 INFO: ❌ current_epoch  : 0 < 3
3:49:30.983569 INFO: ==============================================
3:49:31.203557 INFO: calibration group: precursor, predicting mz
3:49:31.203866 WARNING: mz prediction was skipped as it has not been fitted yet
3:49:31.203912 INFO: calibration group: precursor, predicting rt
3:49:38.123449 INFO: calibration group: fragment, predicting mz
3:49:55.608736 PROGRESS: === Epoch 1, step 0, extracting elution groups 0 to 1000 ===
3:49:55.689655 PROGRESS: Extracting batch of 1964 precursors
3:49:55.691431 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:49:55.691517 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:49:55.691575 INFO: FWHM in RT is 17.34 seconds, sigma is 0.63
3:49:55.691604 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:49:55.691847 INFO: Starting candidate selection
3:50:00.133739 INFO: Starting candidate scoring
3:50:01.445455 INFO: Finished candidate processing
3:50:01.445546 INFO: Collecting candidate features
3:50:03.609706 WARNING: intensity_correlation has 5 NaNs ( 0.31 % out of 1610)
3:50:03.615672 INFO: Collecting fragment features
3:50:04.252380 INFO: Finished candidate scoring
3:50:04.547865 PROGRESS: === Epoch 1, step 0, extracted 1610 precursors and 8807 fragments ===
3:50:04.548177 INFO: performing precursor FDR with 47 features
3:50:04.548218 INFO: Decoy channel: -1
3:50:04.548245 INFO: Competetive: True
3:50:04.552901 WARNING: dropped 2 target PSMs due to missing features
3:50:04.552970 WARNING: dropped 3 decoy PSMs due to missing features
3:50:04.581471 INFO: Test AUC: 0.498
3:50:04.581563 INFO: Train AUC: 0.531
3:50:04.581608 INFO: AUC difference: 6.30%
3:50:04.581642 WARNING: AUC difference > 5%. This may indicate overfitting.
3:50:04.703111 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
3:50:04.703899 PROGRESS: ============================= Precursor FDR =============================
3:50:04.704019 PROGRESS: Total precursors accumulated: 7
3:50:04.704098 PROGRESS: Target precursors: 7 (100.00%)
3:50:04.704167 PROGRESS: Decoy precursors: 0 (0.00%)
3:50:04.704231 PROGRESS: 
3:50:04.704293 PROGRESS: Precursor Summary:
3:50:04.705789 PROGRESS: Channel   0:	 0.05 FDR:     7; 0.01 FDR:     7; 0.001 FDR:     7
3:50:04.705901 PROGRESS: 
3:50:04.705975 PROGRESS: Protein Summary:
3:50:04.707661 PROGRESS: Channel   0:	 0.05 FDR:     7; 0.01 FDR:     7; 0.001 FDR:     7
3:50:04.707776 PROGRESS: =========================================================================
3:50:04.708659 PROGRESS: === Epoch 1, step 1, extracting elution groups 1000 to 3000 ===
3:50:04.785671 PROGRESS: Extracting batch of 3947 precursors
3:50:04.787901 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:50:04.787960 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:50:04.787998 INFO: FWHM in RT is 17.34 seconds, sigma is 0.63
3:50:04.788028 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:50:04.788258 INFO: Starting candidate selection
3:50:08.842780 INFO: Starting candidate scoring
3:50:10.157794 INFO: Finished candidate processing
3:50:10.157888 INFO: Collecting candidate features
3:50:12.319389 WARNING: intensity_correlation has 6 NaNs ( 0.19 % out of 3239)
3:50:12.325518 INFO: Collecting fragment features
3:50:12.967633 INFO: Finished candidate scoring
3:50:13.248532 PROGRESS: === Epoch 1, step 1, extracted 3239 precursors and 17580 fragments ===
3:50:13.248818 INFO: performing precursor FDR with 47 features
3:50:13.248866 INFO: Decoy channel: -1
3:50:13.248894 INFO: Competetive: True
3:50:13.257145 WARNING: dropped 5 target PSMs due to missing features
3:50:13.257236 WARNING: dropped 6 decoy PSMs due to missing features
3:50:13.293113 INFO: Test AUC: 0.538
3:50:13.293228 INFO: Train AUC: 0.528
3:50:13.293274 INFO: AUC difference: 1.90%
3:50:13.414517 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
3:50:13.415298 PROGRESS: ============================= Precursor FDR =============================
3:50:13.415420 PROGRESS: Total precursors accumulated: 18
3:50:13.415498 PROGRESS: Target precursors: 17 (94.44%)
3:50:13.415567 PROGRESS: Decoy precursors: 1 (5.56%)
3:50:13.415632 PROGRESS: 
3:50:13.415695 PROGRESS: Precursor Summary:
3:50:13.417113 PROGRESS: Channel   0:	 0.05 FDR:    15; 0.01 FDR:    15; 0.001 FDR:    15
3:50:13.417226 PROGRESS: 
3:50:13.417299 PROGRESS: Protein Summary:
3:50:13.418917 PROGRESS: Channel   0:	 0.05 FDR:    15; 0.01 FDR:    15; 0.001 FDR:    15
3:50:13.419030 PROGRESS: =========================================================================
3:50:13.419884 PROGRESS: === Epoch 1, step 2, extracting elution groups 3000 to 7000 ===
3:50:13.502435 PROGRESS: Extracting batch of 7905 precursors
3:50:13.505785 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:50:13.505881 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:50:13.505922 INFO: FWHM in RT is 17.34 seconds, sigma is 0.63
3:50:13.505953 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:50:13.506176 INFO: Starting candidate selection
3:50:17.693331 INFO: Starting candidate scoring
3:50:19.058100 INFO: Finished candidate processing
3:50:19.058194 INFO: Collecting candidate features
3:50:21.257866 WARNING: intensity_correlation has 14 NaNs ( 0.21 % out of 6548)
3:50:21.263642 INFO: Collecting fragment features
3:50:21.918512 INFO: Finished candidate scoring
3:50:22.205785 PROGRESS: === Epoch 1, step 2, extracted 6548 precursors and 35233 fragments ===
3:50:22.206127 INFO: performing precursor FDR with 47 features
3:50:22.206174 INFO: Decoy channel: -1
3:50:22.206199 INFO: Competetive: True
3:50:22.220464 WARNING: dropped 12 target PSMs due to missing features
3:50:22.220562 WARNING: dropped 13 decoy PSMs due to missing features
3:50:22.274802 INFO: Test AUC: 0.536
3:50:22.274929 INFO: Train AUC: 0.535
3:50:22.274976 INFO: AUC difference: 0.21%
3:50:22.405150 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
3:50:22.405987 PROGRESS: ============================= Precursor FDR =============================
3:50:22.406113 PROGRESS: Total precursors accumulated: 38
3:50:22.406201 PROGRESS: Target precursors: 35 (92.11%)
3:50:22.406271 PROGRESS: Decoy precursors: 3 (7.89%)
3:50:22.406333 PROGRESS: 
3:50:22.406394 PROGRESS: Precursor Summary:
3:50:22.407830 PROGRESS: Channel   0:	 0.05 FDR:    30; 0.01 FDR:    28; 0.001 FDR:    28
3:50:22.407943 PROGRESS: 
3:50:22.408018 PROGRESS: Protein Summary:
3:50:22.409653 PROGRESS: Channel   0:	 0.05 FDR:    30; 0.01 FDR:    28; 0.001 FDR:    28
3:50:22.409764 PROGRESS: =========================================================================
3:50:22.410640 PROGRESS: === Epoch 1, step 3, extracting elution groups 7000 to 15000 ===
3:50:22.502968 PROGRESS: Extracting batch of 15792 precursors
3:50:22.508543 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:50:22.508613 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:50:22.508649 INFO: FWHM in RT is 17.34 seconds, sigma is 0.63
3:50:22.508693 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:50:22.508917 INFO: Starting candidate selection
3:50:26.861607 INFO: Starting candidate scoring
3:50:28.298168 INFO: Finished candidate processing
3:50:28.298352 INFO: Collecting candidate features
3:50:30.508028 WARNING: intensity_correlation has 23 NaNs ( 0.18 % out of 12909)
3:50:30.514000 INFO: Collecting fragment features
3:50:31.169858 INFO: Finished candidate scoring
3:50:31.462332 PROGRESS: === Epoch 1, step 3, extracted 12909 precursors and 69464 fragments ===
3:50:31.462654 INFO: performing precursor FDR with 47 features
3:50:31.462700 INFO: Decoy channel: -1
3:50:31.462727 INFO: Competetive: True
3:50:31.488434 WARNING: dropped 22 target PSMs due to missing features
3:50:31.488545 WARNING: dropped 26 decoy PSMs due to missing features
3:50:31.976151 INFO: Test AUC: 0.524
3:50:31.976360 INFO: Train AUC: 0.552
3:50:31.976412 INFO: AUC difference: 5.17%
3:50:31.976447 WARNING: AUC difference > 5%. This may indicate overfitting.
3:50:32.102451 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
3:50:32.103309 PROGRESS: ============================= Precursor FDR =============================
3:50:32.103435 PROGRESS: Total precursors accumulated: 91
3:50:32.103513 PROGRESS: Target precursors: 83 (91.21%)
3:50:32.103582 PROGRESS: Decoy precursors: 8 (8.79%)
3:50:32.103649 PROGRESS: 
3:50:32.103712 PROGRESS: Precursor Summary:
3:50:32.105191 PROGRESS: Channel   0:	 0.05 FDR:    68; 0.01 FDR:    68; 0.001 FDR:    68
3:50:32.105317 PROGRESS: 
3:50:32.105392 PROGRESS: Protein Summary:
3:50:32.107084 PROGRESS: Channel   0:	 0.05 FDR:    66; 0.01 FDR:    66; 0.001 FDR:    66
3:50:32.107231 PROGRESS: =========================================================================
3:50:32.108123 PROGRESS: === Epoch 1, step 4, extracting elution groups 15000 to 31000 ===
3:50:32.216029 PROGRESS: Extracting batch of 31583 precursors
3:50:32.226728 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:50:32.226826 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:50:32.226864 INFO: FWHM in RT is 17.34 seconds, sigma is 0.63
3:50:32.226892 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:50:32.227136 INFO: Starting candidate selection
3:50:36.866284 INFO: Starting candidate scoring
3:50:38.417609 INFO: Finished candidate processing
3:50:38.417826 INFO: Collecting candidate features
3:50:40.666795 WARNING: intensity_correlation has 81 NaNs ( 0.31 % out of 25843)
3:50:40.673582 INFO: Collecting fragment features
3:50:41.354038 INFO: Finished candidate scoring
3:50:41.663912 PROGRESS: === Epoch 1, step 4, extracted 25843 precursors and 139482 fragments ===
3:50:41.664256 INFO: performing precursor FDR with 47 features
3:50:41.664301 INFO: Decoy channel: -1
3:50:41.664327 INFO: Competetive: True
3:50:41.716345 WARNING: dropped 69 target PSMs due to missing features
3:50:41.716453 WARNING: dropped 60 decoy PSMs due to missing features
3:50:43.251724 INFO: Test AUC: 0.530
3:50:43.251874 INFO: Train AUC: 0.564
3:50:43.251921 INFO: AUC difference: 5.89%
3:50:43.251954 WARNING: AUC difference > 5%. This may indicate overfitting.
3:50:43.381518 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
3:50:43.382466 PROGRESS: ============================= Precursor FDR =============================
3:50:43.382598 PROGRESS: Total precursors accumulated: 170
3:50:43.382677 PROGRESS: Target precursors: 155 (91.18%)
3:50:43.382746 PROGRESS: Decoy precursors: 15 (8.82%)
3:50:43.382809 PROGRESS: 
3:50:43.382870 PROGRESS: Precursor Summary:
3:50:43.384420 PROGRESS: Channel   0:	 0.05 FDR:   133; 0.01 FDR:   120; 0.001 FDR:   102
3:50:43.384570 PROGRESS: 
3:50:43.384644 PROGRESS: Protein Summary:
3:50:43.386441 PROGRESS: Channel   0:	 0.05 FDR:   129; 0.01 FDR:   116; 0.001 FDR:    99
3:50:43.386556 PROGRESS: =========================================================================
3:50:43.387485 PROGRESS: === Epoch 1, step 5, extracting elution groups 31000 to 63000 ===
3:50:43.524317 PROGRESS: Extracting batch of 63229 precursors
3:50:43.544716 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:50:43.544825 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:50:43.544862 INFO: FWHM in RT is 17.34 seconds, sigma is 0.63
3:50:43.544906 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:50:43.545160 INFO: Starting candidate selection
3:50:48.824432 INFO: Starting candidate scoring
3:50:50.635268 INFO: Finished candidate processing
3:50:50.635357 INFO: Collecting candidate features
3:50:52.971478 WARNING: intensity_correlation has 126 NaNs ( 0.24 % out of 51862)
3:50:52.981302 INFO: Collecting fragment features
3:50:53.684215 INFO: Finished candidate scoring
3:50:54.025324 PROGRESS: === Epoch 1, step 5, extracted 51862 precursors and 279474 fragments ===
3:50:54.025697 INFO: performing precursor FDR with 47 features
3:50:54.025746 INFO: Decoy channel: -1
3:50:54.025782 INFO: Competetive: True
3:50:54.137888 WARNING: dropped 129 target PSMs due to missing features
3:50:54.138000 WARNING: dropped 126 decoy PSMs due to missing features
3:50:57.624599 INFO: Test AUC: 0.543
3:50:57.624723 INFO: Train AUC: 0.570
3:50:57.624778 INFO: AUC difference: 4.78%
3:50:57.759856 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
3:50:57.760892 PROGRESS: ============================= Precursor FDR =============================
3:50:57.761016 PROGRESS: Total precursors accumulated: 355
3:50:57.761094 PROGRESS: Target precursors: 324 (91.27%)
3:50:57.761166 PROGRESS: Decoy precursors: 31 (8.73%)
3:50:57.761233 PROGRESS: 
3:50:57.761295 PROGRESS: Precursor Summary:
3:50:57.763006 PROGRESS: Channel   0:	 0.05 FDR:   289; 0.01 FDR:   251; 0.001 FDR:   168
3:50:57.763127 PROGRESS: 
3:50:57.763199 PROGRESS: Protein Summary:
3:50:57.765146 PROGRESS: Channel   0:	 0.05 FDR:   277; 0.01 FDR:   239; 0.001 FDR:   163
3:50:57.765260 PROGRESS: =========================================================================
3:50:57.766304 PROGRESS: === Epoch 1, step 6, extracting elution groups 63000 to 127000 ===
3:50:57.942691 PROGRESS: Extracting batch of 126495 precursors
3:50:57.982208 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:50:57.982344 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:50:57.982386 INFO: FWHM in RT is 17.34 seconds, sigma is 0.63
3:50:57.982413 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:50:57.982677 INFO: Starting candidate selection
3:51:04.604739 INFO: Starting candidate scoring
3:51:06.989029 INFO: Finished candidate processing
3:51:06.989178 INFO: Collecting candidate features
3:51:09.480816 WARNING: intensity_correlation has 252 NaNs ( 0.24 % out of 103582)
3:51:09.492951 INFO: Collecting fragment features
3:51:10.249749 INFO: Finished candidate scoring
3:51:10.655416 PROGRESS: === Epoch 1, step 6, extracted 103582 precursors and 560758 fragments ===
3:51:10.655784 INFO: performing precursor FDR with 47 features
3:51:10.655830 INFO: Decoy channel: -1
3:51:10.655857 INFO: Competetive: True
3:51:10.895723 WARNING: dropped 252 target PSMs due to missing features
3:51:10.895838 WARNING: dropped 255 decoy PSMs due to missing features
3:51:18.170308 INFO: Test AUC: 0.544
3:51:18.170453 INFO: Train AUC: 0.568
3:51:18.170494 INFO: AUC difference: 4.21%
3:51:18.323517 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
3:51:18.324665 PROGRESS: ============================= Precursor FDR =============================
3:51:18.324790 PROGRESS: Total precursors accumulated: 704
3:51:18.324869 PROGRESS: Target precursors: 640 (90.91%)
3:51:18.324950 PROGRESS: Decoy precursors: 64 (9.09%)
3:51:18.325014 PROGRESS: 
3:51:18.325076 PROGRESS: Precursor Summary:
3:51:18.326939 PROGRESS: Channel   0:	 0.05 FDR:   584; 0.01 FDR:   441; 0.001 FDR:   290
3:51:18.327057 PROGRESS: 
3:51:18.327129 PROGRESS: Protein Summary:
3:51:18.329306 PROGRESS: Channel   0:	 0.05 FDR:   536; 0.01 FDR:   413; 0.001 FDR:   274
3:51:18.329430 PROGRESS: =========================================================================
3:51:18.331298 INFO: calibration group: precursor, fitting rt estimator 
3:51:18.445827 INFO: calibration group: fragment, fitting mz estimator 
3:51:19.011209 INFO: === checking if epoch conditions were reached ===
3:51:19.011359 INFO: ✅ ms2_error      : 7.0000 <= 7
3:51:19.011446 INFO: ❌ rt_error       : 225.5853 > 100
3:51:19.011519 INFO: ❌ current_epoch  : 1 < 3
3:51:19.011583 INFO: ==============================================
3:51:19.254910 INFO: calibration group: precursor, predicting mz
3:51:19.255206 WARNING: mz prediction was skipped as it has not been fitted yet
3:51:19.255247 INFO: calibration group: precursor, predicting rt
3:51:26.455294 INFO: calibration group: fragment, predicting mz
3:51:43.813607 PROGRESS: === Epoch 2, step 0, extracting elution groups 0 to 1000 ===
3:51:43.895393 PROGRESS: Extracting batch of 1965 precursors
3:51:43.897167 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:51:43.897264 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:51:43.897305 INFO: FWHM in RT is 16.30 seconds, sigma is 0.59
3:51:43.897335 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:51:43.897565 INFO: Starting candidate selection
3:51:48.277205 INFO: Starting candidate scoring
3:51:49.559021 INFO: Finished candidate processing
3:51:49.559111 INFO: Collecting candidate features
3:51:51.720145 WARNING: intensity_correlation has 5 NaNs ( 0.33 % out of 1532)
3:51:51.726000 INFO: Collecting fragment features
3:51:52.363006 INFO: Finished candidate scoring
3:51:52.657993 PROGRESS: === Epoch 2, step 0, extracted 1532 precursors and 8118 fragments ===
3:51:52.658318 INFO: performing precursor FDR with 47 features
3:51:52.658367 INFO: Decoy channel: -1
3:51:52.658397 INFO: Competetive: True
3:51:52.663001 WARNING: dropped 3 target PSMs due to missing features
3:51:52.663072 WARNING: dropped 2 decoy PSMs due to missing features
3:51:52.691357 INFO: Test AUC: 0.580
3:51:52.691449 INFO: Train AUC: 0.534
3:51:52.691493 INFO: AUC difference: 8.61%
3:51:52.691527 WARNING: AUC difference > 5%. This may indicate overfitting.
3:51:52.812714 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
3:51:52.813510 PROGRESS: ============================= Precursor FDR =============================
3:51:52.813633 PROGRESS: Total precursors accumulated: 4
3:51:52.813710 PROGRESS: Target precursors: 4 (100.00%)
3:51:52.813785 PROGRESS: Decoy precursors: 0 (0.00%)
3:51:52.813851 PROGRESS: 
3:51:52.813912 PROGRESS: Precursor Summary:
3:51:52.815391 PROGRESS: Channel   0:	 0.05 FDR:     4; 0.01 FDR:     4; 0.001 FDR:     4
3:51:52.815516 PROGRESS: 
3:51:52.815590 PROGRESS: Protein Summary:
3:51:52.817261 PROGRESS: Channel   0:	 0.05 FDR:     4; 0.01 FDR:     4; 0.001 FDR:     4
3:51:52.817370 PROGRESS: =========================================================================
3:51:52.818256 PROGRESS: === Epoch 2, step 1, extracting elution groups 1000 to 3000 ===
3:51:52.895851 PROGRESS: Extracting batch of 3945 precursors
3:51:52.898152 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:51:52.898230 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:51:52.898274 INFO: FWHM in RT is 16.30 seconds, sigma is 0.59
3:51:52.898304 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:51:52.898520 INFO: Starting candidate selection
3:51:56.963625 INFO: Starting candidate scoring
3:51:58.259606 INFO: Finished candidate processing
3:51:58.259694 INFO: Collecting candidate features
3:52:00.428245 WARNING: intensity_correlation has 12 NaNs ( 0.39 % out of 3049)
3:52:00.435077 INFO: Collecting fragment features
3:52:01.081241 INFO: Finished candidate scoring
3:52:01.361200 PROGRESS: === Epoch 2, step 1, extracted 3049 precursors and 16279 fragments ===
3:52:01.361479 INFO: performing precursor FDR with 47 features
3:52:01.361525 INFO: Decoy channel: -1
3:52:01.361551 INFO: Competetive: True
3:52:01.369216 WARNING: dropped 7 target PSMs due to missing features
3:52:01.369318 WARNING: dropped 10 decoy PSMs due to missing features
3:52:01.404405 INFO: Test AUC: 0.538
3:52:01.404521 INFO: Train AUC: 0.551
3:52:01.404567 INFO: AUC difference: 2.40%
3:52:01.524333 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
3:52:01.525101 PROGRESS: ============================= Precursor FDR =============================
3:52:01.525224 PROGRESS: Total precursors accumulated: 13
3:52:01.525302 PROGRESS: Target precursors: 12 (92.31%)
3:52:01.525383 PROGRESS: Decoy precursors: 1 (7.69%)
3:52:01.525448 PROGRESS: 
3:52:01.525509 PROGRESS: Precursor Summary:
3:52:01.526932 PROGRESS: Channel   0:	 0.05 FDR:    12; 0.01 FDR:    12; 0.001 FDR:    12
3:52:01.527056 PROGRESS: 
3:52:01.527145 PROGRESS: Protein Summary:
3:52:01.528747 PROGRESS: Channel   0:	 0.05 FDR:    12; 0.01 FDR:    12; 0.001 FDR:    12
3:52:01.528856 PROGRESS: =========================================================================
3:52:01.529722 PROGRESS: === Epoch 2, step 2, extracting elution groups 3000 to 7000 ===
3:52:01.611831 PROGRESS: Extracting batch of 7891 precursors
3:52:01.615279 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:52:01.615343 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:52:01.615381 INFO: FWHM in RT is 16.30 seconds, sigma is 0.59
3:52:01.615427 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:52:01.615647 INFO: Starting candidate selection
3:52:05.701907 INFO: Starting candidate scoring
3:52:07.026869 INFO: Finished candidate processing
3:52:07.027022 INFO: Collecting candidate features
3:52:09.204273 WARNING: intensity_correlation has 11 NaNs ( 0.18 % out of 6161)
3:52:09.209924 INFO: Collecting fragment features
3:52:09.865425 INFO: Finished candidate scoring
3:52:10.149880 PROGRESS: === Epoch 2, step 2, extracted 6161 precursors and 32992 fragments ===
3:52:10.150193 INFO: performing precursor FDR with 47 features
3:52:10.150239 INFO: Decoy channel: -1
3:52:10.150269 INFO: Competetive: True
3:52:10.163803 WARNING: dropped 13 target PSMs due to missing features
3:52:10.163922 WARNING: dropped 15 decoy PSMs due to missing features
3:52:10.216594 INFO: Test AUC: 0.553
3:52:10.216722 INFO: Train AUC: 0.542
3:52:10.216765 INFO: AUC difference: 1.93%
3:52:10.338187 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
3:52:10.339013 PROGRESS: ============================= Precursor FDR =============================
3:52:10.339134 PROGRESS: Total precursors accumulated: 47
3:52:10.339212 PROGRESS: Target precursors: 43 (91.49%)
3:52:10.339279 PROGRESS: Decoy precursors: 4 (8.51%)
3:52:10.339343 PROGRESS: 
3:52:10.339407 PROGRESS: Precursor Summary:
3:52:10.340856 PROGRESS: Channel   0:	 0.05 FDR:    42; 0.01 FDR:    33; 0.001 FDR:    33
3:52:10.340969 PROGRESS: 
3:52:10.341044 PROGRESS: Protein Summary:
3:52:10.342708 PROGRESS: Channel   0:	 0.05 FDR:    42; 0.01 FDR:    33; 0.001 FDR:    33
3:52:10.342819 PROGRESS: =========================================================================
3:52:10.343681 PROGRESS: === Epoch 2, step 3, extracting elution groups 7000 to 15000 ===
3:52:10.435518 PROGRESS: Extracting batch of 15808 precursors
3:52:10.441179 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:52:10.441248 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:52:10.441284 INFO: FWHM in RT is 16.30 seconds, sigma is 0.59
3:52:10.441308 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:52:10.441550 INFO: Starting candidate selection
3:52:14.692713 INFO: Starting candidate scoring
3:52:16.090858 INFO: Finished candidate processing
3:52:16.090950 INFO: Collecting candidate features
3:52:18.290361 WARNING: intensity_correlation has 29 NaNs ( 0.24 % out of 12094)
3:52:18.296358 INFO: Collecting fragment features
3:52:18.955635 INFO: Finished candidate scoring
3:52:19.247442 PROGRESS: === Epoch 2, step 3, extracted 12094 precursors and 64088 fragments ===
3:52:19.247786 INFO: performing precursor FDR with 47 features
3:52:19.247831 INFO: Decoy channel: -1
3:52:19.247859 INFO: Competetive: True
3:52:19.272435 WARNING: dropped 26 target PSMs due to missing features
3:52:19.272564 WARNING: dropped 31 decoy PSMs due to missing features
3:52:19.746024 INFO: Test AUC: 0.529
3:52:19.746163 INFO: Train AUC: 0.563
3:52:19.746209 INFO: AUC difference: 6.16%
3:52:19.746243 WARNING: AUC difference > 5%. This may indicate overfitting.
3:52:19.869207 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
3:52:19.870072 PROGRESS: ============================= Precursor FDR =============================
3:52:19.870193 PROGRESS: Total precursors accumulated: 99
3:52:19.870271 PROGRESS: Target precursors: 91 (91.92%)
3:52:19.870339 PROGRESS: Decoy precursors: 8 (8.08%)
3:52:19.870403 PROGRESS: 
3:52:19.870465 PROGRESS: Precursor Summary:
3:52:19.871923 PROGRESS: Channel   0:	 0.05 FDR:    82; 0.01 FDR:    34; 0.001 FDR:    34
3:52:19.872036 PROGRESS: 
3:52:19.872109 PROGRESS: Protein Summary:
3:52:19.873760 PROGRESS: Channel   0:	 0.05 FDR:    79; 0.01 FDR:    33; 0.001 FDR:    33
3:52:19.873895 PROGRESS: =========================================================================
3:52:19.874761 PROGRESS: === Epoch 2, step 4, extracting elution groups 15000 to 31000 ===
3:52:19.983583 PROGRESS: Extracting batch of 31653 precursors
3:52:19.994392 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:52:19.994490 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:52:19.994529 INFO: FWHM in RT is 16.30 seconds, sigma is 0.59
3:52:19.994557 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:52:19.994799 INFO: Starting candidate selection
3:52:24.584682 INFO: Starting candidate scoring
3:52:26.124066 INFO: Finished candidate processing
3:52:26.124162 INFO: Collecting candidate features
3:52:28.395699 WARNING: intensity_correlation has 59 NaNs ( 0.24 % out of 24593)
3:52:28.402490 INFO: Collecting fragment features
3:52:29.088036 INFO: Finished candidate scoring
3:52:29.399292 PROGRESS: === Epoch 2, step 4, extracted 24593 precursors and 131185 fragments ===
3:52:29.399677 INFO: performing precursor FDR with 47 features
3:52:29.399732 INFO: Decoy channel: -1
3:52:29.399760 INFO: Competetive: True
3:52:29.449056 WARNING: dropped 51 target PSMs due to missing features
3:52:29.449170 WARNING: dropped 65 decoy PSMs due to missing features
3:52:30.916903 INFO: Test AUC: 0.538
3:52:30.917048 INFO: Train AUC: 0.574
3:52:30.917094 INFO: AUC difference: 6.29%
3:52:30.917129 WARNING: AUC difference > 5%. This may indicate overfitting.
3:52:31.046877 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
3:52:31.047800 PROGRESS: ============================= Precursor FDR =============================
3:52:31.047926 PROGRESS: Total precursors accumulated: 184
3:52:31.048005 PROGRESS: Target precursors: 169 (91.85%)
3:52:31.048074 PROGRESS: Decoy precursors: 15 (8.15%)
3:52:31.048137 PROGRESS: 
3:52:31.048199 PROGRESS: Precursor Summary:
3:52:31.049739 PROGRESS: Channel   0:	 0.05 FDR:   152; 0.01 FDR:   118; 0.001 FDR:    73
3:52:31.049881 PROGRESS: 
3:52:31.049955 PROGRESS: Protein Summary:
3:52:31.051725 PROGRESS: Channel   0:	 0.05 FDR:   143; 0.01 FDR:   112; 0.001 FDR:    70
3:52:31.051855 PROGRESS: =========================================================================
3:52:31.052781 PROGRESS: === Epoch 2, step 5, extracting elution groups 31000 to 63000 ===
3:52:31.191005 PROGRESS: Extracting batch of 63189 precursors
3:52:31.221091 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:52:31.221211 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:52:31.221268 INFO: FWHM in RT is 16.30 seconds, sigma is 0.59
3:52:31.221295 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:52:31.221549 INFO: Starting candidate selection
3:52:36.386109 INFO: Starting candidate scoring
3:52:38.174906 INFO: Finished candidate processing
3:52:38.175082 INFO: Collecting candidate features
3:52:40.496706 WARNING: intensity_correlation has 128 NaNs ( 0.26 % out of 49007)
3:52:40.504943 INFO: Collecting fragment features
3:52:41.212602 INFO: Finished candidate scoring
3:52:41.549339 PROGRESS: === Epoch 2, step 5, extracted 49007 precursors and 260909 fragments ===
3:52:41.549685 INFO: performing precursor FDR with 47 features
3:52:41.549732 INFO: Decoy channel: -1
3:52:41.549759 INFO: Competetive: True
3:52:41.655346 WARNING: dropped 118 target PSMs due to missing features
3:52:41.655461 WARNING: dropped 126 decoy PSMs due to missing features
3:52:44.908216 INFO: Test AUC: 0.544
3:52:44.908335 INFO: Train AUC: 0.575
3:52:44.908396 INFO: AUC difference: 5.38%
3:52:44.908425 WARNING: AUC difference > 5%. This may indicate overfitting.
3:52:45.044113 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
3:52:45.045152 PROGRESS: ============================= Precursor FDR =============================
3:52:45.045282 PROGRESS: Total precursors accumulated: 477
3:52:45.045362 PROGRESS: Target precursors: 435 (91.19%)
3:52:45.045430 PROGRESS: Decoy precursors: 42 (8.81%)
3:52:45.045506 PROGRESS: 
3:52:45.045568 PROGRESS: Precursor Summary:
3:52:45.047264 PROGRESS: Channel   0:	 0.05 FDR:   367; 0.01 FDR:   263; 0.001 FDR:   209
3:52:45.047402 PROGRESS: 
3:52:45.047478 PROGRESS: Protein Summary:
3:52:45.049436 PROGRESS: Channel   0:	 0.05 FDR:   344; 0.01 FDR:   248; 0.001 FDR:   199
3:52:45.049544 PROGRESS: =========================================================================
3:52:45.050597 PROGRESS: === Epoch 2, step 6, extracting elution groups 63000 to 127000 ===
3:52:45.226683 PROGRESS: Extracting batch of 126450 precursors
3:52:45.266129 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:52:45.266241 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:52:45.266297 INFO: FWHM in RT is 16.30 seconds, sigma is 0.59
3:52:45.266324 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:52:45.266585 INFO: Starting candidate selection
3:52:51.588147 INFO: Starting candidate scoring
3:52:53.912780 INFO: Finished candidate processing
3:52:53.912878 INFO: Collecting candidate features
3:52:56.386491 WARNING: intensity_correlation has 242 NaNs ( 0.25 % out of 98239)
3:52:56.397724 INFO: Collecting fragment features
3:52:57.154401 INFO: Finished candidate scoring
3:52:57.552227 PROGRESS: === Epoch 2, step 6, extracted 98239 precursors and 523951 fragments ===
3:52:57.552601 INFO: performing precursor FDR with 47 features
3:52:57.552650 INFO: Decoy channel: -1
3:52:57.552677 INFO: Competetive: True
3:52:57.779890 WARNING: dropped 247 target PSMs due to missing features
3:52:57.780005 WARNING: dropped 239 decoy PSMs due to missing features
3:53:04.916837 INFO: Test AUC: 0.548
3:53:04.916964 INFO: Train AUC: 0.572
3:53:04.917021 INFO: AUC difference: 4.12%
3:53:05.065678 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
3:53:05.066947 PROGRESS: ============================= Precursor FDR =============================
3:53:05.067077 PROGRESS: Total precursors accumulated: 947
3:53:05.067155 PROGRESS: Target precursors: 862 (91.02%)
3:53:05.067223 PROGRESS: Decoy precursors: 85 (8.98%)
3:53:05.067287 PROGRESS: 
3:53:05.067349 PROGRESS: Precursor Summary:
3:53:05.069179 PROGRESS: Channel   0:	 0.05 FDR:   672; 0.01 FDR:   531; 0.001 FDR:   119
3:53:05.069310 PROGRESS: 
3:53:05.069385 PROGRESS: Protein Summary:
3:53:05.071556 PROGRESS: Channel   0:	 0.05 FDR:   604; 0.01 FDR:   479; 0.001 FDR:   117
3:53:05.071695 PROGRESS: =========================================================================
3:53:05.072876 PROGRESS: === Epoch 2, step 7, extracting elution groups 127000 to 255000 ===
3:53:05.298324 PROGRESS: Extracting batch of 252851 precursors
3:53:05.371063 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:53:05.371177 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:53:05.371216 INFO: FWHM in RT is 16.30 seconds, sigma is 0.59
3:53:05.371260 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:53:05.371526 INFO: Starting candidate selection
3:53:13.936499 INFO: Starting candidate scoring
3:53:17.252527 INFO: Finished candidate processing
3:53:17.252712 INFO: Collecting candidate features
3:53:20.062004 WARNING: intensity_correlation has 470 NaNs ( 0.24 % out of 196329)
3:53:20.081140 INFO: Collecting fragment features
3:53:20.916094 INFO: Finished candidate scoring
3:53:21.446148 PROGRESS: === Epoch 2, step 7, extracted 196329 precursors and 1047017 fragments ===
3:53:21.446494 INFO: performing precursor FDR with 47 features
3:53:21.446541 INFO: Decoy channel: -1
3:53:21.446567 INFO: Competetive: True
3:53:21.920728 WARNING: dropped 499 target PSMs due to missing features
3:53:21.920849 WARNING: dropped 457 decoy PSMs due to missing features
3:53:36.094718 INFO: Test AUC: 0.549
3:53:36.094867 INFO: Train AUC: 0.566
3:53:36.094908 INFO: AUC difference: 2.84%
3:53:36.269913 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
3:53:36.271412 PROGRESS: ============================= Precursor FDR =============================
3:53:36.271547 PROGRESS: Total precursors accumulated: 1,778
3:53:36.271627 PROGRESS: Target precursors: 1,621 (91.17%)
3:53:36.271695 PROGRESS: Decoy precursors: 157 (8.83%)
3:53:36.271759 PROGRESS: 
3:53:36.271821 PROGRESS: Precursor Summary:
3:53:36.273965 PROGRESS: Channel   0:	 0.05 FDR: 1,407; 0.01 FDR: 1,003; 0.001 FDR:   175
3:53:36.274083 PROGRESS: 
3:53:36.274157 PROGRESS: Protein Summary:
3:53:36.276781 PROGRESS: Channel   0:	 0.05 FDR: 1,170; 0.01 FDR:   834; 0.001 FDR:   172
3:53:36.276912 PROGRESS: =========================================================================
3:53:36.279323 INFO: calibration group: precursor, fitting rt estimator 
3:53:36.437454 INFO: calibration group: fragment, fitting mz estimator 
3:53:37.028683 INFO: === checking if epoch conditions were reached ===
3:53:37.028857 INFO: ✅ ms2_error      : 7.0000 <= 7
3:53:37.028951 INFO: ❌ rt_error       : 203.4438 > 100
3:53:37.029025 INFO: ✅ current_epoch  : 2 >= 3
3:53:37.029091 INFO: ==============================================
3:53:37.236183 INFO: calibration group: precursor, predicting mz
3:53:37.236473 WARNING: mz prediction was skipped as it has not been fitted yet
3:53:37.236517 INFO: calibration group: precursor, predicting rt
3:53:44.399913 INFO: calibration group: fragment, predicting mz
3:54:01.657356 PROGRESS: === Epoch 3, step 0, extracting elution groups 0 to 1000 ===
3:54:01.745816 PROGRESS: Extracting batch of 1976 precursors
3:54:01.747557 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:54:01.747651 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:54:01.747693 INFO: FWHM in RT is 16.42 seconds, sigma is 0.60
3:54:01.747724 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:54:01.747983 INFO: Starting candidate selection
3:54:06.213302 INFO: Starting candidate scoring
3:54:07.523370 INFO: Finished candidate processing
3:54:07.523463 INFO: Collecting candidate features
3:54:09.679141 WARNING: intensity_correlation has 2 NaNs ( 0.13 % out of 1578)
3:54:09.684938 INFO: Collecting fragment features
3:54:10.322588 INFO: Finished candidate scoring
3:54:10.621325 PROGRESS: === Epoch 3, step 0, extracted 1578 precursors and 8554 fragments ===
3:54:10.621660 INFO: performing precursor FDR with 47 features
3:54:10.621703 INFO: Decoy channel: -1
3:54:10.621729 INFO: Competetive: True
3:54:10.626076 WARNING: dropped 2 target PSMs due to missing features
3:54:10.653640 INFO: Test AUC: 0.517
3:54:10.653736 INFO: Train AUC: 0.523
3:54:10.653790 INFO: AUC difference: 1.05%
3:54:10.772597 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
3:54:10.773395 PROGRESS: ============================= Precursor FDR =============================
3:54:10.773518 PROGRESS: Total precursors accumulated: 14
3:54:10.773596 PROGRESS: Target precursors: 14 (100.00%)
3:54:10.773666 PROGRESS: Decoy precursors: 0 (0.00%)
3:54:10.773729 PROGRESS: 
3:54:10.773800 PROGRESS: Precursor Summary:
3:54:10.775299 PROGRESS: Channel   0:	 0.05 FDR:    14; 0.01 FDR:    14; 0.001 FDR:    14
3:54:10.775414 PROGRESS: 
3:54:10.775489 PROGRESS: Protein Summary:
3:54:10.777193 PROGRESS: Channel   0:	 0.05 FDR:    14; 0.01 FDR:    14; 0.001 FDR:    14
3:54:10.777320 PROGRESS: =========================================================================
3:54:10.778236 PROGRESS: === Epoch 3, step 1, extracting elution groups 1000 to 3000 ===
3:54:10.856034 PROGRESS: Extracting batch of 3961 precursors
3:54:10.858332 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:54:10.858416 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:54:10.858459 INFO: FWHM in RT is 16.42 seconds, sigma is 0.60
3:54:10.858490 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:54:10.858712 INFO: Starting candidate selection
3:54:14.927768 INFO: Starting candidate scoring
3:54:16.233728 INFO: Finished candidate processing
3:54:16.233829 INFO: Collecting candidate features
3:54:18.422916 WARNING: intensity_correlation has 3 NaNs ( 0.09 % out of 3186)
3:54:18.429579 INFO: Collecting fragment features
3:54:19.077986 INFO: Finished candidate scoring
3:54:19.360467 PROGRESS: === Epoch 3, step 1, extracted 3186 precursors and 16993 fragments ===
3:54:19.360753 INFO: performing precursor FDR with 47 features
3:54:19.360799 INFO: Decoy channel: -1
3:54:19.360825 INFO: Competetive: True
3:54:19.368812 WARNING: dropped 3 target PSMs due to missing features
3:54:19.368898 WARNING: dropped 2 decoy PSMs due to missing features
3:54:19.404648 INFO: Test AUC: 0.553
3:54:19.404763 INFO: Train AUC: 0.541
3:54:19.404809 INFO: AUC difference: 2.32%
3:54:19.549550 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
3:54:19.550349 PROGRESS: ============================= Precursor FDR =============================
3:54:19.550488 PROGRESS: Total precursors accumulated: 25
3:54:19.550566 PROGRESS: Target precursors: 24 (96.00%)
3:54:19.550636 PROGRESS: Decoy precursors: 1 (4.00%)
3:54:19.550699 PROGRESS: 
3:54:19.550760 PROGRESS: Precursor Summary:
3:54:19.552180 PROGRESS: Channel   0:	 0.05 FDR:    24; 0.01 FDR:    18; 0.001 FDR:    18
3:54:19.552293 PROGRESS: 
3:54:19.552367 PROGRESS: Protein Summary:
3:54:19.554000 PROGRESS: Channel   0:	 0.05 FDR:    24; 0.01 FDR:    18; 0.001 FDR:    18
3:54:19.554112 PROGRESS: =========================================================================
3:54:19.554972 PROGRESS: === Epoch 3, step 2, extracting elution groups 3000 to 7000 ===
3:54:19.638195 PROGRESS: Extracting batch of 7889 precursors
3:54:19.641614 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:54:19.641680 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:54:19.641722 INFO: FWHM in RT is 16.42 seconds, sigma is 0.60
3:54:19.641779 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:54:19.642023 INFO: Starting candidate selection
3:54:23.795753 INFO: Starting candidate scoring
3:54:25.132085 INFO: Finished candidate processing
3:54:25.132181 INFO: Collecting candidate features
3:54:27.335064 WARNING: intensity_correlation has 14 NaNs ( 0.22 % out of 6291)
3:54:27.340712 INFO: Collecting fragment features
3:54:27.994426 INFO: Finished candidate scoring
3:54:28.281736 PROGRESS: === Epoch 3, step 2, extracted 6291 precursors and 33769 fragments ===
3:54:28.282104 INFO: performing precursor FDR with 47 features
3:54:28.282170 INFO: Decoy channel: -1
3:54:28.282219 INFO: Competetive: True
3:54:28.296094 WARNING: dropped 10 target PSMs due to missing features
3:54:28.296210 WARNING: dropped 9 decoy PSMs due to missing features
3:54:28.350952 INFO: Test AUC: 0.569
3:54:28.351089 INFO: Train AUC: 0.535
3:54:28.351157 INFO: AUC difference: 6.36%
3:54:28.351205 WARNING: AUC difference > 5%. This may indicate overfitting.
3:54:28.494140 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
3:54:28.494965 PROGRESS: ============================= Precursor FDR =============================
3:54:28.495095 PROGRESS: Total precursors accumulated: 55
3:54:28.495174 PROGRESS: Target precursors: 51 (92.73%)
3:54:28.495242 PROGRESS: Decoy precursors: 4 (7.27%)
3:54:28.495306 PROGRESS: 
3:54:28.495367 PROGRESS: Precursor Summary:
3:54:28.496805 PROGRESS: Channel   0:	 0.05 FDR:    43; 0.01 FDR:    36; 0.001 FDR:    36
3:54:28.496917 PROGRESS: 
3:54:28.496991 PROGRESS: Protein Summary:
3:54:28.498632 PROGRESS: Channel   0:	 0.05 FDR:    43; 0.01 FDR:    36; 0.001 FDR:    36
3:54:28.498742 PROGRESS: =========================================================================
3:54:28.499604 PROGRESS: === Epoch 3, step 3, extracting elution groups 7000 to 15000 ===
3:54:28.590878 PROGRESS: Extracting batch of 15803 precursors
3:54:28.596436 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:54:28.596507 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:54:28.596542 INFO: FWHM in RT is 16.42 seconds, sigma is 0.60
3:54:28.596584 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:54:28.596803 INFO: Starting candidate selection
3:54:32.887993 INFO: Starting candidate scoring
3:54:34.299264 INFO: Finished candidate processing
3:54:34.299441 INFO: Collecting candidate features
3:54:36.524578 WARNING: intensity_correlation has 34 NaNs ( 0.27 % out of 12482)
3:54:36.530450 INFO: Collecting fragment features
3:54:37.194878 INFO: Finished candidate scoring
3:54:37.489610 PROGRESS: === Epoch 3, step 3, extracted 12482 precursors and 67051 fragments ===
3:54:37.489967 INFO: performing precursor FDR with 47 features
3:54:37.490019 INFO: Decoy channel: -1
3:54:37.490048 INFO: Competetive: True
3:54:37.515494 WARNING: dropped 25 target PSMs due to missing features
3:54:37.515607 WARNING: dropped 28 decoy PSMs due to missing features
3:54:38.028182 INFO: Test AUC: 0.534
3:54:38.028336 INFO: Train AUC: 0.565
3:54:38.028395 INFO: AUC difference: 5.47%
3:54:38.028430 WARNING: AUC difference > 5%. This may indicate overfitting.
3:54:38.155326 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
3:54:38.156184 PROGRESS: ============================= Precursor FDR =============================
3:54:38.156304 PROGRESS: Total precursors accumulated: 121
3:54:38.156381 PROGRESS: Target precursors: 111 (91.74%)
3:54:38.156448 PROGRESS: Decoy precursors: 10 (8.26%)
3:54:38.156510 PROGRESS: 
3:54:38.156570 PROGRESS: Precursor Summary:
3:54:38.158043 PROGRESS: Channel   0:	 0.05 FDR:    88; 0.01 FDR:    46; 0.001 FDR:    46
3:54:38.158166 PROGRESS: 
3:54:38.158241 PROGRESS: Protein Summary:
3:54:38.159905 PROGRESS: Channel   0:	 0.05 FDR:    87; 0.01 FDR:    46; 0.001 FDR:    46
3:54:38.160014 PROGRESS: =========================================================================
3:54:38.160882 PROGRESS: === Epoch 3, step 4, extracting elution groups 15000 to 31000 ===
3:54:38.269814 PROGRESS: Extracting batch of 31625 precursors
3:54:38.280706 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:54:38.280824 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:54:38.280864 INFO: FWHM in RT is 16.42 seconds, sigma is 0.60
3:54:38.280892 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:54:38.281130 INFO: Starting candidate selection
3:54:42.920767 INFO: Starting candidate scoring
3:54:44.476621 INFO: Finished candidate processing
3:54:44.476716 INFO: Collecting candidate features
3:54:46.746935 WARNING: intensity_correlation has 59 NaNs ( 0.24 % out of 24987)
3:54:46.753589 INFO: Collecting fragment features
3:54:47.436034 INFO: Finished candidate scoring
3:54:47.748430 PROGRESS: === Epoch 3, step 4, extracted 24987 precursors and 133007 fragments ===
3:54:47.748784 INFO: performing precursor FDR with 47 features
3:54:47.748833 INFO: Decoy channel: -1
3:54:47.748859 INFO: Competetive: True
3:54:47.798277 WARNING: dropped 60 target PSMs due to missing features
3:54:47.798407 WARNING: dropped 52 decoy PSMs due to missing features
3:54:49.208253 INFO: Test AUC: 0.544
3:54:49.208400 INFO: Train AUC: 0.577
3:54:49.208447 INFO: AUC difference: 5.75%
3:54:49.208479 WARNING: AUC difference > 5%. This may indicate overfitting.
3:54:49.331280 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
3:54:49.332242 PROGRESS: ============================= Precursor FDR =============================
3:54:49.332370 PROGRESS: Total precursors accumulated: 330
3:54:49.332447 PROGRESS: Target precursors: 301 (91.21%)
3:54:49.332516 PROGRESS: Decoy precursors: 29 (8.79%)
3:54:49.332579 PROGRESS: 
3:54:49.332640 PROGRESS: Precursor Summary:
3:54:49.334241 PROGRESS: Channel   0:	 0.05 FDR:   203; 0.01 FDR:   177; 0.001 FDR:   150
3:54:49.334356 PROGRESS: 
3:54:49.334430 PROGRESS: Protein Summary:
3:54:49.336262 PROGRESS: Channel   0:	 0.05 FDR:   195; 0.01 FDR:   170; 0.001 FDR:   143
3:54:49.336372 PROGRESS: =========================================================================
3:54:49.337334 PROGRESS: === Epoch 3, step 5, extracting elution groups 31000 to 63000 ===
3:54:49.473608 PROGRESS: Extracting batch of 63217 precursors
3:54:49.493365 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:54:49.493470 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:54:49.493507 INFO: FWHM in RT is 16.42 seconds, sigma is 0.60
3:54:49.493549 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:54:49.493807 INFO: Starting candidate selection
3:54:54.687209 INFO: Starting candidate scoring
3:54:56.486180 INFO: Finished candidate processing
3:54:56.486268 INFO: Collecting candidate features
3:54:58.806481 WARNING: intensity_correlation has 125 NaNs ( 0.25 % out of 50205)
3:54:58.814713 INFO: Collecting fragment features
3:54:59.514791 INFO: Finished candidate scoring
3:54:59.853500 PROGRESS: === Epoch 3, step 5, extracted 50205 precursors and 267719 fragments ===
3:54:59.853871 INFO: performing precursor FDR with 47 features
3:54:59.860601 INFO: Decoy channel: -1
3:54:59.860752 INFO: Competetive: True
3:54:59.969822 WARNING: dropped 122 target PSMs due to missing features
3:54:59.969935 WARNING: dropped 115 decoy PSMs due to missing features
3:55:03.406780 INFO: Test AUC: 0.542
3:55:03.406925 INFO: Train AUC: 0.582
3:55:03.406981 INFO: AUC difference: 6.91%
3:55:03.407009 WARNING: AUC difference > 5%. This may indicate overfitting.
3:55:03.540282 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
3:55:03.541374 PROGRESS: ============================= Precursor FDR =============================
3:55:03.541501 PROGRESS: Total precursors accumulated: 626
3:55:03.541579 PROGRESS: Target precursors: 571 (91.21%)
3:55:03.541648 PROGRESS: Decoy precursors: 55 (8.79%)
3:55:03.541712 PROGRESS: 
3:55:03.541783 PROGRESS: Precursor Summary:
3:55:03.543468 PROGRESS: Channel   0:	 0.05 FDR:   422; 0.01 FDR:   230; 0.001 FDR:   172
3:55:03.543597 PROGRESS: 
3:55:03.543671 PROGRESS: Protein Summary:
3:55:03.545625 PROGRESS: Channel   0:	 0.05 FDR:   392; 0.01 FDR:   214; 0.001 FDR:   161
3:55:03.545737 PROGRESS: =========================================================================
3:55:03.546750 PROGRESS: === Epoch 3, step 6, extracting elution groups 63000 to 127000 ===
3:55:03.722462 PROGRESS: Extracting batch of 126456 precursors
3:55:03.760947 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:55:03.761061 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:55:03.761098 INFO: FWHM in RT is 16.42 seconds, sigma is 0.60
3:55:03.761143 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:55:03.761407 INFO: Starting candidate selection
3:55:10.144254 INFO: Starting candidate scoring
3:55:12.472028 INFO: Finished candidate processing
3:55:12.472136 INFO: Collecting candidate features
3:55:14.951920 WARNING: intensity_correlation has 261 NaNs ( 0.26 % out of 100150)
3:55:14.964446 INFO: Collecting fragment features
3:55:15.721981 INFO: Finished candidate scoring
3:55:16.119968 PROGRESS: === Epoch 3, step 6, extracted 100150 precursors and 536440 fragments ===
3:55:16.120319 INFO: performing precursor FDR with 47 features
3:55:16.120367 INFO: Decoy channel: -1
3:55:16.120394 INFO: Competetive: True
3:55:16.352598 WARNING: dropped 263 target PSMs due to missing features
3:55:16.352710 WARNING: dropped 235 decoy PSMs due to missing features
3:55:23.365709 INFO: Test AUC: 0.545
3:55:23.365864 INFO: Train AUC: 0.575
3:55:23.365922 INFO: AUC difference: 5.17%
3:55:23.365951 WARNING: AUC difference > 5%. This may indicate overfitting.
3:55:23.508782 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
3:55:23.510070 PROGRESS: ============================= Precursor FDR =============================
3:55:23.510209 PROGRESS: Total precursors accumulated: 1,146
3:55:23.510290 PROGRESS: Target precursors: 1,044 (91.10%)
3:55:23.510358 PROGRESS: Decoy precursors: 102 (8.90%)
3:55:23.510421 PROGRESS: 
3:55:23.510482 PROGRESS: Precursor Summary:
3:55:23.512402 PROGRESS: Channel   0:	 0.05 FDR:   812; 0.01 FDR:   582; 0.001 FDR:   421
3:55:23.512519 PROGRESS: 
3:55:23.512593 PROGRESS: Protein Summary:
3:55:23.514950 PROGRESS: Channel   0:	 0.05 FDR:   723; 0.01 FDR:   521; 0.001 FDR:   380
3:55:23.515079 PROGRESS: =========================================================================
3:55:23.516285 PROGRESS: === Epoch 3, step 7, extracting elution groups 127000 to 255000 ===
3:55:23.740349 PROGRESS: Extracting batch of 252846 precursors
3:55:23.812765 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:55:23.812898 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:55:23.812941 INFO: FWHM in RT is 16.42 seconds, sigma is 0.60
3:55:23.812968 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:55:23.813230 INFO: Starting candidate selection
3:55:32.526297 INFO: Starting candidate scoring
3:55:35.952785 INFO: Finished candidate processing
3:55:35.952973 INFO: Collecting candidate features
3:55:38.767518 WARNING: intensity_correlation has 509 NaNs ( 0.25 % out of 199970)
3:55:38.785665 INFO: Collecting fragment features
3:55:39.626000 INFO: Finished candidate scoring
3:55:40.165058 PROGRESS: === Epoch 3, step 7, extracted 199970 precursors and 1070509 fragments ===
3:55:40.165406 INFO: performing precursor FDR with 47 features
3:55:40.165452 INFO: Decoy channel: -1
3:55:40.165479 INFO: Competetive: True
3:55:40.661062 WARNING: dropped 516 target PSMs due to missing features
3:55:40.661179 WARNING: dropped 491 decoy PSMs due to missing features
3:55:55.143501 INFO: Test AUC: 0.550
3:55:55.143629 INFO: Train AUC: 0.570
3:55:55.143685 INFO: AUC difference: 3.54%
3:55:55.319933 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
3:55:55.321643 PROGRESS: ============================= Precursor FDR =============================
3:55:55.321801 PROGRESS: Total precursors accumulated: 2,334
3:55:55.321882 PROGRESS: Target precursors: 2,134 (91.43%)
3:55:55.321950 PROGRESS: Decoy precursors: 200 (8.57%)
3:55:55.322013 PROGRESS: 
3:55:55.322075 PROGRESS: Precursor Summary:
3:55:55.324423 PROGRESS: Channel   0:	 0.05 FDR: 1,764; 0.01 FDR: 1,261; 0.001 FDR:   760
3:55:55.324564 PROGRESS: 
3:55:55.324638 PROGRESS: Protein Summary:
3:55:55.327665 PROGRESS: Channel   0:	 0.05 FDR: 1,461; 0.01 FDR: 1,031; 0.001 FDR:   648
3:55:55.327790 PROGRESS: =========================================================================
3:55:55.330480 INFO: calibration group: precursor, fitting rt estimator 
3:55:55.515915 INFO: calibration group: fragment, fitting mz estimator 
3:55:56.111428 INFO: === checking if epoch conditions were reached ===
3:55:56.111586 INFO: ✅ ms2_error      : 7.0000 <= 7
3:55:56.111674 INFO: ❌ rt_error       : 203.1328 > 100
3:55:56.111747 INFO: ✅ current_epoch  : 3 >= 3
3:55:56.111813 INFO: ==============================================
3:55:56.334703 INFO: calibration group: precursor, predicting mz
3:55:56.334990 WARNING: mz prediction was skipped as it has not been fitted yet
3:55:56.335032 INFO: calibration group: precursor, predicting rt
3:56:03.497605 INFO: calibration group: fragment, predicting mz
3:56:21.124862 PROGRESS: === Epoch 4, step 0, extracting elution groups 0 to 1000 ===
3:56:21.213014 PROGRESS: Extracting batch of 1975 precursors
3:56:21.214757 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:56:21.214833 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:56:21.214903 INFO: FWHM in RT is 15.60 seconds, sigma is 0.57
3:56:21.214933 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:56:21.215183 INFO: Starting candidate selection
3:56:25.674305 INFO: Starting candidate scoring
3:56:26.962655 INFO: Finished candidate processing
3:56:26.962777 INFO: Collecting candidate features
3:56:29.143407 WARNING: intensity_correlation has 6 NaNs ( 0.37 % out of 1618)
3:56:29.149471 INFO: Collecting fragment features
3:56:29.795142 INFO: Finished candidate scoring
3:56:30.106172 PROGRESS: === Epoch 4, step 0, extracted 1618 precursors and 8737 fragments ===
3:56:30.106478 INFO: performing precursor FDR with 47 features
3:56:30.106519 INFO: Decoy channel: -1
3:56:30.106545 INFO: Competetive: True
3:56:30.111134 WARNING: dropped 3 target PSMs due to missing features
3:56:30.111202 WARNING: dropped 3 decoy PSMs due to missing features
3:56:30.139171 INFO: Test AUC: 0.522
3:56:30.139257 INFO: Train AUC: 0.546
3:56:30.139302 INFO: AUC difference: 4.38%
3:56:30.258890 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
3:56:30.259682 PROGRESS: ============================= Precursor FDR =============================
3:56:30.259804 PROGRESS: Total precursors accumulated: 4
3:56:30.259897 PROGRESS: Target precursors: 4 (100.00%)
3:56:30.259966 PROGRESS: Decoy precursors: 0 (0.00%)
3:56:30.260029 PROGRESS: 
3:56:30.260091 PROGRESS: Precursor Summary:
3:56:30.261576 PROGRESS: Channel   0:	 0.05 FDR:     4; 0.01 FDR:     4; 0.001 FDR:     4
3:56:30.261688 PROGRESS: 
3:56:30.261763 PROGRESS: Protein Summary:
3:56:30.263473 PROGRESS: Channel   0:	 0.05 FDR:     4; 0.01 FDR:     4; 0.001 FDR:     4
3:56:30.263591 PROGRESS: =========================================================================
3:56:30.264487 PROGRESS: === Epoch 4, step 1, extracting elution groups 1000 to 3000 ===
3:56:30.341528 PROGRESS: Extracting batch of 3952 precursors
3:56:30.343784 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:56:30.343846 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:56:30.343886 INFO: FWHM in RT is 15.60 seconds, sigma is 0.57
3:56:30.343933 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:56:30.344146 INFO: Starting candidate selection
3:56:34.443018 INFO: Starting candidate scoring
3:56:35.742832 INFO: Finished candidate processing
3:56:35.742917 INFO: Collecting candidate features
3:56:37.906145 WARNING: intensity_correlation has 7 NaNs ( 0.22 % out of 3244)
3:56:37.913101 INFO: Collecting fragment features
3:56:38.570865 INFO: Finished candidate scoring
3:56:38.852504 PROGRESS: === Epoch 4, step 1, extracted 3244 precursors and 17253 fragments ===
3:56:38.852785 INFO: performing precursor FDR with 47 features
3:56:38.852829 INFO: Decoy channel: -1
3:56:38.852855 INFO: Competetive: True
3:56:38.861165 WARNING: dropped 8 target PSMs due to missing features
3:56:38.861253 WARNING: dropped 5 decoy PSMs due to missing features
3:56:38.897122 INFO: Test AUC: 0.545
3:56:38.897240 INFO: Train AUC: 0.536
3:56:38.897286 INFO: AUC difference: 1.55%
3:56:39.020273 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
3:56:39.021074 PROGRESS: ============================= Precursor FDR =============================
3:56:39.021200 PROGRESS: Total precursors accumulated: 19
3:56:39.021280 PROGRESS: Target precursors: 18 (94.74%)
3:56:39.021348 PROGRESS: Decoy precursors: 1 (5.26%)
3:56:39.021410 PROGRESS: 
3:56:39.021470 PROGRESS: Precursor Summary:
3:56:39.022920 PROGRESS: Channel   0:	 0.05 FDR:    16; 0.01 FDR:    16; 0.001 FDR:    16
3:56:39.023050 PROGRESS: 
3:56:39.023135 PROGRESS: Protein Summary:
3:56:39.024753 PROGRESS: Channel   0:	 0.05 FDR:    16; 0.01 FDR:    16; 0.001 FDR:    16
3:56:39.024879 PROGRESS: =========================================================================
3:56:39.025738 PROGRESS: === Epoch 4, step 2, extracting elution groups 3000 to 7000 ===
3:56:39.107661 PROGRESS: Extracting batch of 7921 precursors
3:56:39.111092 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:56:39.111157 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:56:39.111196 INFO: FWHM in RT is 15.60 seconds, sigma is 0.57
3:56:39.111243 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:56:39.111466 INFO: Starting candidate selection
3:56:43.297131 INFO: Starting candidate scoring
3:56:44.634401 INFO: Finished candidate processing
3:56:44.634504 INFO: Collecting candidate features
3:56:46.835248 WARNING: intensity_correlation has 26 NaNs ( 0.40 % out of 6492)
3:56:46.840758 INFO: Collecting fragment features
3:56:47.493813 INFO: Finished candidate scoring
3:56:47.780189 PROGRESS: === Epoch 4, step 2, extracted 6492 precursors and 34786 fragments ===
3:56:47.780531 INFO: performing precursor FDR with 47 features
3:56:47.780577 INFO: Decoy channel: -1
3:56:47.780604 INFO: Competetive: True
3:56:47.794617 WARNING: dropped 23 target PSMs due to missing features
3:56:47.794716 WARNING: dropped 16 decoy PSMs due to missing features
3:56:47.848379 INFO: Test AUC: 0.537
3:56:47.848506 INFO: Train AUC: 0.553
3:56:47.848548 INFO: AUC difference: 2.77%
3:56:47.971641 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
3:56:47.972472 PROGRESS: ============================= Precursor FDR =============================
3:56:47.972600 PROGRESS: Total precursors accumulated: 45
3:56:47.972677 PROGRESS: Target precursors: 42 (93.33%)
3:56:47.972746 PROGRESS: Decoy precursors: 3 (6.67%)
3:56:47.972809 PROGRESS: 
3:56:47.972871 PROGRESS: Precursor Summary:
3:56:47.974321 PROGRESS: Channel   0:	 0.05 FDR:    29; 0.01 FDR:    16; 0.001 FDR:    16
3:56:47.974448 PROGRESS: 
3:56:47.974522 PROGRESS: Protein Summary:
3:56:47.976148 PROGRESS: Channel   0:	 0.05 FDR:    29; 0.01 FDR:    16; 0.001 FDR:    16
3:56:47.976287 PROGRESS: =========================================================================
3:56:47.977145 PROGRESS: === Epoch 4, step 3, extracting elution groups 7000 to 15000 ===
3:56:48.068372 PROGRESS: Extracting batch of 15794 precursors
3:56:48.073949 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:56:48.074029 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:56:48.074066 INFO: FWHM in RT is 15.60 seconds, sigma is 0.57
3:56:48.074094 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:56:48.074315 INFO: Starting candidate selection
3:56:52.435750 INFO: Starting candidate scoring
3:56:53.861708 INFO: Finished candidate processing
3:56:53.861850 INFO: Collecting candidate features
3:56:56.087738 WARNING: intensity_correlation has 27 NaNs ( 0.21 % out of 12826)
3:56:56.093655 INFO: Collecting fragment features
3:56:56.755228 INFO: Finished candidate scoring
3:56:57.049621 PROGRESS: === Epoch 4, step 3, extracted 12826 precursors and 68793 fragments ===
3:56:57.049973 INFO: performing precursor FDR with 47 features
3:56:57.050023 INFO: Decoy channel: -1
3:56:57.050050 INFO: Competetive: True
3:56:57.075863 WARNING: dropped 41 target PSMs due to missing features
3:56:57.075976 WARNING: dropped 25 decoy PSMs due to missing features
3:56:57.551061 INFO: Test AUC: 0.541
3:56:57.551220 INFO: Train AUC: 0.573
3:56:57.551267 INFO: AUC difference: 5.55%
3:56:57.551302 WARNING: AUC difference > 5%. This may indicate overfitting.
3:56:57.678854 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
3:56:57.679721 PROGRESS: ============================= Precursor FDR =============================
3:56:57.679844 PROGRESS: Total precursors accumulated: 94
3:56:57.679922 PROGRESS: Target precursors: 86 (91.49%)
3:56:57.679991 PROGRESS: Decoy precursors: 8 (8.51%)
3:56:57.680053 PROGRESS: 
3:56:57.680114 PROGRESS: Precursor Summary:
3:56:57.681571 PROGRESS: Channel   0:	 0.05 FDR:    77; 0.01 FDR:    45; 0.001 FDR:    45
3:56:57.681682 PROGRESS: 
3:56:57.681755 PROGRESS: Protein Summary:
3:56:57.683425 PROGRESS: Channel   0:	 0.05 FDR:    76; 0.01 FDR:    45; 0.001 FDR:    45
3:56:57.683535 PROGRESS: =========================================================================
3:56:57.684401 PROGRESS: === Epoch 4, step 4, extracting elution groups 15000 to 31000 ===
3:56:57.791877 PROGRESS: Extracting batch of 31626 precursors
3:56:57.802351 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:56:57.802447 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:56:57.802485 INFO: FWHM in RT is 15.60 seconds, sigma is 0.57
3:56:57.802515 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:56:57.802757 INFO: Starting candidate selection
3:57:02.432646 INFO: Starting candidate scoring
3:57:03.981203 INFO: Finished candidate processing
3:57:03.981402 INFO: Collecting candidate features
3:57:06.260261 WARNING: intensity_correlation has 74 NaNs ( 0.29 % out of 25926)
3:57:06.267051 INFO: Collecting fragment features
3:57:06.949095 INFO: Finished candidate scoring
3:57:07.259746 PROGRESS: === Epoch 4, step 4, extracted 25926 precursors and 138265 fragments ===
3:57:07.260089 INFO: performing precursor FDR with 47 features
3:57:07.260140 INFO: Decoy channel: -1
3:57:07.260167 INFO: Competetive: True
3:57:07.312022 WARNING: dropped 86 target PSMs due to missing features
3:57:07.312130 WARNING: dropped 54 decoy PSMs due to missing features
3:57:08.709508 INFO: Test AUC: 0.539
3:57:08.709646 INFO: Train AUC: 0.582
3:57:08.709692 INFO: AUC difference: 7.26%
3:57:08.709727 WARNING: AUC difference > 5%. This may indicate overfitting.
3:57:08.838841 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
3:57:08.839791 PROGRESS: ============================= Precursor FDR =============================
3:57:08.839918 PROGRESS: Total precursors accumulated: 271
3:57:08.840008 PROGRESS: Target precursors: 249 (91.88%)
3:57:08.840083 PROGRESS: Decoy precursors: 22 (8.12%)
3:57:08.840148 PROGRESS: 
3:57:08.840209 PROGRESS: Precursor Summary:
3:57:08.841755 PROGRESS: Channel   0:	 0.05 FDR:   194; 0.01 FDR:   113; 0.001 FDR:   106
3:57:08.841886 PROGRESS: 
3:57:08.841960 PROGRESS: Protein Summary:
3:57:08.843747 PROGRESS: Channel   0:	 0.05 FDR:   189; 0.01 FDR:   112; 0.001 FDR:   105
3:57:08.843860 PROGRESS: =========================================================================
3:57:08.844782 PROGRESS: === Epoch 4, step 5, extracting elution groups 31000 to 63000 ===
3:57:08.980696 PROGRESS: Extracting batch of 63239 precursors
3:57:09.007653 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:57:09.007762 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:57:09.007801 INFO: FWHM in RT is 15.60 seconds, sigma is 0.57
3:57:09.007844 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:57:09.008091 INFO: Starting candidate selection
3:57:14.249131 INFO: Starting candidate scoring
3:57:16.079935 INFO: Finished candidate processing
3:57:16.080039 INFO: Collecting candidate features
3:57:18.436849 WARNING: intensity_correlation has 94 NaNs ( 0.18 % out of 51702)
3:57:18.445224 INFO: Collecting fragment features
3:57:19.161071 INFO: Finished candidate scoring
3:57:19.504653 PROGRESS: === Epoch 4, step 5, extracted 51702 precursors and 275164 fragments ===
3:57:19.505011 INFO: performing precursor FDR with 47 features
3:57:19.505059 INFO: Decoy channel: -1
3:57:19.505086 INFO: Competetive: True
3:57:19.618472 WARNING: dropped 130 target PSMs due to missing features
3:57:19.618606 WARNING: dropped 104 decoy PSMs due to missing features
3:57:22.970629 INFO: Test AUC: 0.547
3:57:22.970756 INFO: Train AUC: 0.585
3:57:22.970795 INFO: AUC difference: 6.59%
3:57:22.970823 WARNING: AUC difference > 5%. This may indicate overfitting.
3:57:23.117532 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
3:57:23.118675 PROGRESS: ============================= Precursor FDR =============================
3:57:23.118800 PROGRESS: Total precursors accumulated: 707
3:57:23.118879 PROGRESS: Target precursors: 645 (91.23%)
3:57:23.118948 PROGRESS: Decoy precursors: 62 (8.77%)
3:57:23.119011 PROGRESS: 
3:57:23.119072 PROGRESS: Precursor Summary:
3:57:23.120807 PROGRESS: Channel   0:	 0.05 FDR:   447; 0.01 FDR:   346; 0.001 FDR:   251
3:57:23.120923 PROGRESS: 
3:57:23.120997 PROGRESS: Protein Summary:
3:57:23.123061 PROGRESS: Channel   0:	 0.05 FDR:   413; 0.01 FDR:   317; 0.001 FDR:   229
3:57:23.123176 PROGRESS: =========================================================================
3:57:23.124256 PROGRESS: === Epoch 4, step 6, extracting elution groups 63000 to 127000 ===
3:57:23.303338 PROGRESS: Extracting batch of 126448 precursors
3:57:23.342277 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:57:23.342395 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:57:23.342437 INFO: FWHM in RT is 15.60 seconds, sigma is 0.57
3:57:23.342465 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:57:23.342730 INFO: Starting candidate selection
3:57:29.851051 INFO: Starting candidate scoring
3:57:32.240816 INFO: Finished candidate processing
3:57:32.240989 INFO: Collecting candidate features
3:57:34.724032 WARNING: intensity_correlation has 219 NaNs ( 0.21 % out of 103181)
3:57:34.735759 INFO: Collecting fragment features
3:57:35.504645 INFO: Finished candidate scoring
3:57:35.905730 PROGRESS: === Epoch 4, step 6, extracted 103181 precursors and 550362 fragments ===
3:57:35.906109 INFO: performing precursor FDR with 47 features
3:57:35.906156 INFO: Decoy channel: -1
3:57:35.906182 INFO: Competetive: True
3:57:36.144102 WARNING: dropped 242 target PSMs due to missing features
3:57:36.144217 WARNING: dropped 211 decoy PSMs due to missing features
3:57:43.315818 INFO: Test AUC: 0.547
3:57:43.315942 INFO: Train AUC: 0.579
3:57:43.315999 INFO: AUC difference: 5.64%
3:57:43.316027 WARNING: AUC difference > 5%. This may indicate overfitting.
3:57:43.462897 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
3:57:43.464171 PROGRESS: ============================= Precursor FDR =============================
3:57:43.464305 PROGRESS: Total precursors accumulated: 1,124
3:57:43.464383 PROGRESS: Target precursors: 1,028 (91.46%)
3:57:43.464451 PROGRESS: Decoy precursors: 96 (8.54%)
3:57:43.464514 PROGRESS: 
3:57:43.464575 PROGRESS: Precursor Summary:
3:57:43.466506 PROGRESS: Channel   0:	 0.05 FDR:   799; 0.01 FDR:   563; 0.001 FDR:   342
3:57:43.466629 PROGRESS: 
3:57:43.466704 PROGRESS: Protein Summary:
3:57:43.469010 PROGRESS: Channel   0:	 0.05 FDR:   719; 0.01 FDR:   509; 0.001 FDR:   313
3:57:43.469141 PROGRESS: =========================================================================
3:57:43.470350 PROGRESS: === Epoch 4, step 7, extracting elution groups 127000 to 255000 ===
3:57:43.696738 PROGRESS: Extracting batch of 253008 precursors
3:57:43.770061 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:57:43.770198 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:57:43.770240 INFO: FWHM in RT is 15.60 seconds, sigma is 0.57
3:57:43.770268 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:57:43.770555 INFO: Starting candidate selection
3:57:52.649947 INFO: Starting candidate scoring
3:57:56.106955 INFO: Finished candidate processing
3:57:56.107142 INFO: Collecting candidate features
3:57:58.944212 WARNING: intensity_correlation has 439 NaNs ( 0.21 % out of 207276)
3:57:58.963871 INFO: Collecting fragment features
3:57:59.813025 INFO: Finished candidate scoring
3:58:00.360166 PROGRESS: === Epoch 4, step 7, extracted 207276 precursors and 1105995 fragments ===
3:58:00.360545 INFO: performing precursor FDR with 47 features
3:58:00.360597 INFO: Decoy channel: -1
3:58:00.360624 INFO: Competetive: True
3:58:00.871543 WARNING: dropped 472 target PSMs due to missing features
3:58:00.871664 WARNING: dropped 420 decoy PSMs due to missing features
3:58:15.744551 INFO: Test AUC: 0.548
3:58:15.744673 INFO: Train AUC: 0.570
3:58:15.744731 INFO: AUC difference: 3.86%
3:58:15.933931 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
3:58:15.935580 PROGRESS: ============================= Precursor FDR =============================
3:58:15.935740 PROGRESS: Total precursors accumulated: 2,329
3:58:15.935818 PROGRESS: Target precursors: 2,130 (91.46%)
3:58:15.935885 PROGRESS: Decoy precursors: 199 (8.54%)
3:58:15.935948 PROGRESS: 
3:58:15.936009 PROGRESS: Precursor Summary:
3:58:15.938397 PROGRESS: Channel   0:	 0.05 FDR: 1,753; 0.01 FDR: 1,301; 0.001 FDR:   740
3:58:15.938519 PROGRESS: 
3:58:15.938592 PROGRESS: Protein Summary:
3:58:15.941629 PROGRESS: Channel   0:	 0.05 FDR: 1,440; 0.01 FDR: 1,065; 0.001 FDR:   639
3:58:15.941762 PROGRESS: =========================================================================
3:58:15.944620 INFO: calibration group: precursor, fitting rt estimator 
3:58:16.154256 INFO: calibration group: fragment, fitting mz estimator 
3:58:16.746912 INFO: === checking if epoch conditions were reached ===
3:58:16.747072 INFO: ✅ ms2_error      : 7.0000 <= 7
3:58:16.747160 INFO: ❌ rt_error       : 204.9090 > 100
3:58:16.747234 INFO: ✅ current_epoch  : 4 >= 3
3:58:16.747299 INFO: ==============================================
3:58:16.971423 INFO: calibration group: precursor, predicting mz
3:58:16.971690 WARNING: mz prediction was skipped as it has not been fitted yet
3:58:16.971735 INFO: calibration group: precursor, predicting rt
3:58:23.924684 INFO: calibration group: fragment, predicting mz
3:58:41.402610 PROGRESS: === Epoch 5, step 0, extracting elution groups 0 to 1000 ===
3:58:41.489659 PROGRESS: Extracting batch of 1973 precursors
3:58:41.491363 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:58:41.491455 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:58:41.491511 INFO: FWHM in RT is 15.70 seconds, sigma is 0.57
3:58:41.491541 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:58:41.491783 INFO: Starting candidate selection
3:58:45.900943 INFO: Starting candidate scoring
3:58:47.176879 INFO: Finished candidate processing
3:58:47.176972 INFO: Collecting candidate features
3:58:49.335334 WARNING: intensity_correlation has 4 NaNs ( 0.24 % out of 1640)
3:58:49.341170 INFO: Collecting fragment features
3:58:49.971830 INFO: Finished candidate scoring
3:58:50.270921 PROGRESS: === Epoch 5, step 0, extracted 1640 precursors and 8893 fragments ===
3:58:50.271264 INFO: performing precursor FDR with 47 features
3:58:50.271308 INFO: Decoy channel: -1
3:58:50.271333 INFO: Competetive: True
3:58:50.275841 WARNING: dropped 2 target PSMs due to missing features
3:58:50.275928 WARNING: dropped 2 decoy PSMs due to missing features
3:58:50.304275 INFO: Test AUC: 0.514
3:58:50.304367 INFO: Train AUC: 0.537
3:58:50.304409 INFO: AUC difference: 4.38%
3:58:50.439352 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
3:58:50.440117 PROGRESS: ============================= Precursor FDR =============================
3:58:50.440235 PROGRESS: Total precursors accumulated: 12
3:58:50.440313 PROGRESS: Target precursors: 11 (91.67%)
3:58:50.440382 PROGRESS: Decoy precursors: 1 (8.33%)
3:58:50.440446 PROGRESS: 
3:58:50.440507 PROGRESS: Precursor Summary:
3:58:50.441932 PROGRESS: Channel   0:	 0.05 FDR:     9; 0.01 FDR:     9; 0.001 FDR:     9
3:58:50.442046 PROGRESS: 
3:58:50.442122 PROGRESS: Protein Summary:
3:58:50.443708 PROGRESS: Channel   0:	 0.05 FDR:     9; 0.01 FDR:     9; 0.001 FDR:     9
3:58:50.443846 PROGRESS: =========================================================================
3:58:50.444698 PROGRESS: === Epoch 5, step 1, extracting elution groups 1000 to 3000 ===
3:58:50.522912 PROGRESS: Extracting batch of 3942 precursors
3:58:50.525507 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:58:50.525585 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:58:50.525640 INFO: FWHM in RT is 15.70 seconds, sigma is 0.57
3:58:50.525681 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:58:50.525977 INFO: Starting candidate selection
3:58:54.610214 INFO: Starting candidate scoring
3:58:55.912288 INFO: Finished candidate processing
3:58:55.912377 INFO: Collecting candidate features
3:58:58.074125 WARNING: intensity_correlation has 6 NaNs ( 0.18 % out of 3364)
3:58:58.080175 INFO: Collecting fragment features
3:58:58.718652 INFO: Finished candidate scoring
3:58:58.998176 PROGRESS: === Epoch 5, step 1, extracted 3364 precursors and 17979 fragments ===
3:58:58.998449 INFO: performing precursor FDR with 47 features
3:58:58.998493 INFO: Decoy channel: -1
3:58:58.998520 INFO: Competetive: True
3:58:59.006624 WARNING: dropped 5 target PSMs due to missing features
3:58:59.006712 WARNING: dropped 5 decoy PSMs due to missing features
3:58:59.042518 INFO: Test AUC: 0.523
3:58:59.042641 INFO: Train AUC: 0.541
3:58:59.042687 INFO: AUC difference: 3.35%
3:58:59.170179 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
3:58:59.170989 PROGRESS: ============================= Precursor FDR =============================
3:58:59.171112 PROGRESS: Total precursors accumulated: 35
3:58:59.171190 PROGRESS: Target precursors: 32 (91.43%)
3:58:59.171258 PROGRESS: Decoy precursors: 3 (8.57%)
3:58:59.171322 PROGRESS: 
3:58:59.171386 PROGRESS: Precursor Summary:
3:58:59.172815 PROGRESS: Channel   0:	 0.05 FDR:    28; 0.01 FDR:    28; 0.001 FDR:    28
3:58:59.172931 PROGRESS: 
3:58:59.173005 PROGRESS: Protein Summary:
3:58:59.174644 PROGRESS: Channel   0:	 0.05 FDR:    28; 0.01 FDR:    28; 0.001 FDR:    28
3:58:59.174758 PROGRESS: =========================================================================
3:58:59.175617 PROGRESS: === Epoch 5, step 2, extracting elution groups 3000 to 7000 ===
3:58:59.258143 PROGRESS: Extracting batch of 7890 precursors
3:58:59.261413 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:58:59.261475 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:58:59.261513 INFO: FWHM in RT is 15.70 seconds, sigma is 0.57
3:58:59.261570 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:58:59.261819 INFO: Starting candidate selection
3:59:03.429785 INFO: Starting candidate scoring
3:59:04.759175 INFO: Finished candidate processing
3:59:04.759268 INFO: Collecting candidate features
3:59:06.967288 WARNING: intensity_correlation has 14 NaNs ( 0.21 % out of 6601)
3:59:06.973746 INFO: Collecting fragment features
3:59:07.628136 INFO: Finished candidate scoring
3:59:07.915576 PROGRESS: === Epoch 5, step 2, extracted 6601 precursors and 35358 fragments ===
3:59:07.915906 INFO: performing precursor FDR with 47 features
3:59:07.915951 INFO: Decoy channel: -1
3:59:07.915977 INFO: Competetive: True
3:59:07.930150 WARNING: dropped 12 target PSMs due to missing features
3:59:07.930268 WARNING: dropped 12 decoy PSMs due to missing features
3:59:07.984573 INFO: Test AUC: 0.537
3:59:07.984704 INFO: Train AUC: 0.542
3:59:07.984751 INFO: AUC difference: 0.88%
3:59:08.105166 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
3:59:08.106020 PROGRESS: ============================= Precursor FDR =============================
3:59:08.106147 PROGRESS: Total precursors accumulated: 68
3:59:08.106224 PROGRESS: Target precursors: 62 (91.18%)
3:59:08.106291 PROGRESS: Decoy precursors: 6 (8.82%)
3:59:08.106352 PROGRESS: 
3:59:08.106413 PROGRESS: Precursor Summary:
3:59:08.107872 PROGRESS: Channel   0:	 0.05 FDR:    55; 0.01 FDR:    42; 0.001 FDR:    42
3:59:08.107985 PROGRESS: 
3:59:08.108058 PROGRESS: Protein Summary:
3:59:08.109698 PROGRESS: Channel   0:	 0.05 FDR:    55; 0.01 FDR:    42; 0.001 FDR:    42
3:59:08.109819 PROGRESS: =========================================================================
3:59:08.110693 PROGRESS: === Epoch 5, step 3, extracting elution groups 7000 to 15000 ===
3:59:08.202145 PROGRESS: Extracting batch of 15810 precursors
3:59:08.207673 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:59:08.207737 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:59:08.207772 INFO: FWHM in RT is 15.70 seconds, sigma is 0.57
3:59:08.207814 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:59:08.208034 INFO: Starting candidate selection
3:59:12.590134 INFO: Starting candidate scoring
3:59:14.016641 INFO: Finished candidate processing
3:59:14.016737 INFO: Collecting candidate features
3:59:16.233837 WARNING: intensity_correlation has 25 NaNs ( 0.19 % out of 13411)
3:59:16.239830 INFO: Collecting fragment features
3:59:16.903023 INFO: Finished candidate scoring
3:59:17.197375 PROGRESS: === Epoch 5, step 3, extracted 13411 precursors and 71921 fragments ===
3:59:17.197709 INFO: performing precursor FDR with 47 features
3:59:17.197757 INFO: Decoy channel: -1
3:59:17.197792 INFO: Competetive: True
3:59:17.224158 WARNING: dropped 29 target PSMs due to missing features
3:59:17.224272 WARNING: dropped 20 decoy PSMs due to missing features
3:59:17.700550 INFO: Test AUC: 0.523
3:59:17.700699 INFO: Train AUC: 0.573
3:59:17.701548 INFO: AUC difference: 8.79%
3:59:17.701593 WARNING: AUC difference > 5%. This may indicate overfitting.
3:59:17.829455 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
3:59:17.830342 PROGRESS: ============================= Precursor FDR =============================
3:59:17.830462 PROGRESS: Total precursors accumulated: 147
3:59:17.830540 PROGRESS: Target precursors: 134 (91.16%)
3:59:17.830607 PROGRESS: Decoy precursors: 13 (8.84%)
3:59:17.830672 PROGRESS: 
3:59:17.830734 PROGRESS: Precursor Summary:
3:59:17.832206 PROGRESS: Channel   0:	 0.05 FDR:   109; 0.01 FDR:    73; 0.001 FDR:    73
3:59:17.832318 PROGRESS: 
3:59:17.832391 PROGRESS: Protein Summary:
3:59:17.834114 PROGRESS: Channel   0:	 0.05 FDR:   106; 0.01 FDR:    72; 0.001 FDR:    72
3:59:17.834225 PROGRESS: =========================================================================
3:59:17.835119 PROGRESS: === Epoch 5, step 4, extracting elution groups 15000 to 31000 ===
3:59:17.943691 PROGRESS: Extracting batch of 31566 precursors
3:59:17.954224 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:59:17.954320 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:59:17.954359 INFO: FWHM in RT is 15.70 seconds, sigma is 0.57
3:59:17.954386 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:59:17.954628 INFO: Starting candidate selection
3:59:22.655308 INFO: Starting candidate scoring
3:59:24.226595 INFO: Finished candidate processing
3:59:24.226706 INFO: Collecting candidate features
3:59:26.468839 WARNING: intensity_correlation has 60 NaNs ( 0.23 % out of 26496)
3:59:26.475390 INFO: Collecting fragment features
3:59:27.147667 INFO: Finished candidate scoring
3:59:27.456098 PROGRESS: === Epoch 5, step 4, extracted 26496 precursors and 141192 fragments ===
3:59:27.456435 INFO: performing precursor FDR with 47 features
3:59:27.456478 INFO: Decoy channel: -1
3:59:27.456504 INFO: Competetive: True
3:59:27.508809 WARNING: dropped 59 target PSMs due to missing features
3:59:27.508917 WARNING: dropped 50 decoy PSMs due to missing features
3:59:29.039082 INFO: Test AUC: 0.539
3:59:29.039231 INFO: Train AUC: 0.582
3:59:29.039279 INFO: AUC difference: 7.38%
3:59:29.039314 WARNING: AUC difference > 5%. This may indicate overfitting.
3:59:29.167268 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
3:59:29.168257 PROGRESS: ============================= Precursor FDR =============================
3:59:29.168384 PROGRESS: Total precursors accumulated: 358
3:59:29.168462 PROGRESS: Target precursors: 327 (91.34%)
3:59:29.168530 PROGRESS: Decoy precursors: 31 (8.66%)
3:59:29.168594 PROGRESS: 
3:59:29.168654 PROGRESS: Precursor Summary:
3:59:29.170271 PROGRESS: Channel   0:	 0.05 FDR:   278; 0.01 FDR:   215; 0.001 FDR:   143
3:59:29.170388 PROGRESS: 
3:59:29.170462 PROGRESS: Protein Summary:
3:59:29.172336 PROGRESS: Channel   0:	 0.05 FDR:   273; 0.01 FDR:   211; 0.001 FDR:   141
3:59:29.172449 PROGRESS: =========================================================================
3:59:29.173427 PROGRESS: === Epoch 5, step 5, extracting elution groups 31000 to 63000 ===
3:59:29.310756 PROGRESS: Extracting batch of 63219 precursors
3:59:29.330879 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:59:29.330982 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:59:29.331019 INFO: FWHM in RT is 15.70 seconds, sigma is 0.57
3:59:29.331063 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:59:29.331311 INFO: Starting candidate selection
3:59:34.617373 INFO: Starting candidate scoring
3:59:36.437871 INFO: Finished candidate processing
3:59:36.437963 INFO: Collecting candidate features
3:59:38.766625 WARNING: intensity_correlation has 115 NaNs ( 0.22 % out of 53345)
3:59:38.775130 INFO: Collecting fragment features
3:59:39.480048 INFO: Finished candidate scoring
3:59:39.821213 PROGRESS: === Epoch 5, step 5, extracted 53345 precursors and 284866 fragments ===
3:59:39.821556 INFO: performing precursor FDR with 47 features
3:59:39.821604 INFO: Decoy channel: -1
3:59:39.821630 INFO: Competetive: True
3:59:39.936805 WARNING: dropped 127 target PSMs due to missing features
3:59:39.936918 WARNING: dropped 97 decoy PSMs due to missing features
3:59:43.480376 INFO: Test AUC: 0.554
3:59:43.480518 INFO: Train AUC: 0.584
3:59:43.480557 INFO: AUC difference: 5.18%
3:59:43.480585 WARNING: AUC difference > 5%. This may indicate overfitting.
3:59:43.612045 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
3:59:43.613203 PROGRESS: ============================= Precursor FDR =============================
3:59:43.613343 PROGRESS: Total precursors accumulated: 818
3:59:43.613424 PROGRESS: Target precursors: 746 (91.20%)
3:59:43.613493 PROGRESS: Decoy precursors: 72 (8.80%)
3:59:43.613557 PROGRESS: 
3:59:43.613618 PROGRESS: Precursor Summary:
3:59:43.615364 PROGRESS: Channel   0:	 0.05 FDR:   514; 0.01 FDR:   314; 0.001 FDR:   239
3:59:43.615499 PROGRESS: 
3:59:43.615573 PROGRESS: Protein Summary:
3:59:43.617631 PROGRESS: Channel   0:	 0.05 FDR:   490; 0.01 FDR:   302; 0.001 FDR:   231
3:59:43.617751 PROGRESS: =========================================================================
3:59:43.618816 PROGRESS: === Epoch 5, step 6, extracting elution groups 63000 to 127000 ===
3:59:43.797838 PROGRESS: Extracting batch of 126481 precursors
3:59:43.837751 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
3:59:43.837905 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
3:59:43.837958 INFO: FWHM in RT is 15.70 seconds, sigma is 0.57
3:59:43.837987 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
3:59:43.838255 INFO: Starting candidate selection
3:59:50.430210 INFO: Starting candidate scoring
3:59:52.834788 INFO: Finished candidate processing
3:59:52.834936 INFO: Collecting candidate features
3:59:55.332381 WARNING: intensity_correlation has 239 NaNs ( 0.22 % out of 106593)
3:59:55.344234 INFO: Collecting fragment features
3:59:56.106030 INFO: Finished candidate scoring
3:59:56.517885 PROGRESS: === Epoch 5, step 6, extracted 106593 precursors and 570524 fragments ===
3:59:56.518250 INFO: performing precursor FDR with 47 features
3:59:56.518296 INFO: Decoy channel: -1
3:59:56.518323 INFO: Competetive: True
3:59:56.763513 WARNING: dropped 251 target PSMs due to missing features
3:59:56.763628 WARNING: dropped 212 decoy PSMs due to missing features
4:00:04.343412 INFO: Test AUC: 0.551
4:00:04.343537 INFO: Train AUC: 0.576
4:00:04.343596 INFO: AUC difference: 4.22%
4:00:04.497972 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
4:00:04.499398 PROGRESS: ============================= Precursor FDR =============================
4:00:04.499532 PROGRESS: Total precursors accumulated: 1,621
4:00:04.499627 PROGRESS: Target precursors: 1,477 (91.12%)
4:00:04.499724 PROGRESS: Decoy precursors: 144 (8.88%)
4:00:04.499813 PROGRESS: 
4:00:04.499905 PROGRESS: Precursor Summary:
4:00:04.501922 PROGRESS: Channel   0:	 0.05 FDR: 1,010; 0.01 FDR:   637; 0.001 FDR:   435
4:00:04.502063 PROGRESS: 
4:00:04.502161 PROGRESS: Protein Summary:
4:00:04.505455 PROGRESS: Channel   0:	 0.05 FDR:   924; 0.01 FDR:   586; 0.001 FDR:   404
4:00:04.505581 PROGRESS: =========================================================================
4:00:04.506876 PROGRESS: === Epoch 5, step 7, extracting elution groups 127000 to 255000 ===
4:00:04.730745 PROGRESS: Extracting batch of 252808 precursors
4:00:04.802995 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:00:04.803114 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:00:04.803154 INFO: FWHM in RT is 15.70 seconds, sigma is 0.57
4:00:04.803197 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:00:04.803498 INFO: Starting candidate selection
4:00:13.993634 INFO: Starting candidate scoring
4:00:17.551907 INFO: Finished candidate processing
4:00:17.552096 INFO: Collecting candidate features
4:00:20.448537 WARNING: intensity_correlation has 498 NaNs ( 0.23 % out of 213395)
4:00:20.468989 INFO: Collecting fragment features
4:00:21.333827 INFO: Finished candidate scoring
4:00:21.896745 PROGRESS: === Epoch 5, step 7, extracted 213395 precursors and 1142702 fragments ===
4:00:21.897091 INFO: performing precursor FDR with 47 features
4:00:21.897136 INFO: Decoy channel: -1
4:00:21.897163 INFO: Competetive: True
4:00:22.446481 WARNING: dropped 499 target PSMs due to missing features
4:00:22.446609 WARNING: dropped 462 decoy PSMs due to missing features
4:00:38.071139 INFO: Test AUC: 0.551
4:00:38.071279 INFO: Train AUC: 0.571
4:00:38.071325 INFO: AUC difference: 3.50%
4:00:38.247938 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
4:00:38.249889 PROGRESS: ============================= Precursor FDR =============================
4:00:38.250034 PROGRESS: Total precursors accumulated: 3,190
4:00:38.250126 PROGRESS: Target precursors: 2,910 (91.22%)
4:00:38.250212 PROGRESS: Decoy precursors: 280 (8.78%)
4:00:38.250299 PROGRESS: 
4:00:38.250387 PROGRESS: Precursor Summary:
4:00:38.253602 PROGRESS: Channel   0:	 0.05 FDR: 2,251; 0.01 FDR: 1,580; 0.001 FDR: 1,036
4:00:38.253751 PROGRESS: 
4:00:38.253880 PROGRESS: Protein Summary:
4:00:38.258160 PROGRESS: Channel   0:	 0.05 FDR: 1,883; 0.01 FDR: 1,305; 0.001 FDR:   876
4:00:38.258278 PROGRESS: =========================================================================
4:00:38.261101 INFO: calibration group: precursor, fitting rt estimator 
4:00:38.482367 INFO: calibration group: fragment, fitting mz estimator 
4:00:39.074498 INFO: === checking if epoch conditions were reached ===
4:00:39.074665 INFO: ✅ ms2_error      : 7.0000 <= 7
4:00:39.074752 INFO: ❌ rt_error       : 198.9631 > 100
4:00:39.074824 INFO: ✅ current_epoch  : 5 >= 3
4:00:39.074889 INFO: ==============================================
4:00:39.295597 INFO: calibration group: precursor, predicting mz
4:00:39.295874 WARNING: mz prediction was skipped as it has not been fitted yet
4:00:39.295918 INFO: calibration group: precursor, predicting rt
4:00:46.311446 INFO: calibration group: fragment, predicting mz
4:01:03.815765 PROGRESS: === Epoch 6, step 0, extracting elution groups 0 to 1000 ===
4:01:03.903703 PROGRESS: Extracting batch of 1977 precursors
4:01:03.905436 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:01:03.905529 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:01:03.905572 INFO: FWHM in RT is 15.12 seconds, sigma is 0.55
4:01:03.905602 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:01:03.905864 INFO: Starting candidate selection
4:01:08.402480 INFO: Starting candidate scoring
4:01:09.709280 INFO: Finished candidate processing
4:01:09.709372 INFO: Collecting candidate features
4:01:11.883396 WARNING: intensity_correlation has 4 NaNs ( 0.23 % out of 1704)
4:01:11.889307 INFO: Collecting fragment features
4:01:12.541233 INFO: Finished candidate scoring
4:01:12.843056 PROGRESS: === Epoch 6, step 0, extracted 1704 precursors and 9055 fragments ===
4:01:12.843386 INFO: performing precursor FDR with 47 features
4:01:12.843428 INFO: Decoy channel: -1
4:01:12.843454 INFO: Competetive: True
4:01:12.848119 WARNING: dropped 3 target PSMs due to missing features
4:01:12.848189 WARNING: dropped 1 decoy PSMs due to missing features
4:01:12.876766 INFO: Test AUC: 0.557
4:01:12.876857 INFO: Train AUC: 0.517
4:01:12.876902 INFO: AUC difference: 7.62%
4:01:12.876935 WARNING: AUC difference > 5%. This may indicate overfitting.
4:01:12.996649 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
4:01:12.997394 PROGRESS: ============================= Precursor FDR =============================
4:01:12.997515 PROGRESS: Total precursors accumulated: 12
4:01:12.997593 PROGRESS: Target precursors: 11 (91.67%)
4:01:12.997662 PROGRESS: Decoy precursors: 1 (8.33%)
4:01:12.997724 PROGRESS: 
4:01:12.997793 PROGRESS: Precursor Summary:
4:01:12.999190 PROGRESS: Channel   0:	 0.05 FDR:    10; 0.01 FDR:    10; 0.001 FDR:    10
4:01:12.999318 PROGRESS: 
4:01:12.999394 PROGRESS: Protein Summary:
4:01:13.000979 PROGRESS: Channel   0:	 0.05 FDR:    10; 0.01 FDR:    10; 0.001 FDR:    10
4:01:13.001093 PROGRESS: =========================================================================
4:01:13.001959 PROGRESS: === Epoch 6, step 1, extracting elution groups 1000 to 3000 ===
4:01:13.079039 PROGRESS: Extracting batch of 3961 precursors
4:01:13.081239 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:01:13.081299 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:01:13.081337 INFO: FWHM in RT is 15.12 seconds, sigma is 0.55
4:01:13.081382 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:01:13.081598 INFO: Starting candidate selection
4:01:17.239640 INFO: Starting candidate scoring
4:01:18.561552 INFO: Finished candidate processing
4:01:18.561673 INFO: Collecting candidate features
4:01:20.739616 WARNING: intensity_correlation has 8 NaNs ( 0.24 % out of 3391)
4:01:20.745624 INFO: Collecting fragment features
4:01:21.386266 INFO: Finished candidate scoring
4:01:21.666814 PROGRESS: === Epoch 6, step 1, extracted 3391 precursors and 18165 fragments ===
4:01:21.667105 INFO: performing precursor FDR with 47 features
4:01:21.667160 INFO: Decoy channel: -1
4:01:21.667189 INFO: Competetive: True
4:01:21.675363 WARNING: dropped 10 target PSMs due to missing features
4:01:21.675462 WARNING: dropped 2 decoy PSMs due to missing features
4:01:21.711211 INFO: Test AUC: 0.524
4:01:21.711335 INFO: Train AUC: 0.544
4:01:21.711402 INFO: AUC difference: 3.61%
4:01:25.436106 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
4:01:25.436941 PROGRESS: ============================= Precursor FDR =============================
4:01:25.437069 PROGRESS: Total precursors accumulated: 24
4:01:25.437147 PROGRESS: Target precursors: 22 (91.67%)
4:01:25.437215 PROGRESS: Decoy precursors: 2 (8.33%)
4:01:25.437279 PROGRESS: 
4:01:25.437339 PROGRESS: Precursor Summary:
4:01:25.438756 PROGRESS: Channel   0:	 0.05 FDR:    21; 0.01 FDR:    13; 0.001 FDR:    13
4:01:25.438872 PROGRESS: 
4:01:25.438946 PROGRESS: Protein Summary:
4:01:25.440542 PROGRESS: Channel   0:	 0.05 FDR:    21; 0.01 FDR:    13; 0.001 FDR:    13
4:01:25.440653 PROGRESS: =========================================================================
4:01:25.441489 PROGRESS: === Epoch 6, step 2, extracting elution groups 3000 to 7000 ===
4:01:25.523722 PROGRESS: Extracting batch of 7903 precursors
4:01:25.527080 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:01:25.527147 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:01:25.527185 INFO: FWHM in RT is 15.12 seconds, sigma is 0.55
4:01:25.527229 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:01:25.527455 INFO: Starting candidate selection
4:01:29.795595 INFO: Starting candidate scoring
4:01:31.158559 INFO: Finished candidate processing
4:01:31.158749 INFO: Collecting candidate features
4:01:33.341923 WARNING: intensity_correlation has 13 NaNs ( 0.19 % out of 6795)
4:01:33.348683 INFO: Collecting fragment features
4:01:33.992496 INFO: Finished candidate scoring
4:01:34.283122 PROGRESS: === Epoch 6, step 2, extracted 6795 precursors and 36220 fragments ===
4:01:34.283479 INFO: performing precursor FDR with 47 features
4:01:34.283527 INFO: Decoy channel: -1
4:01:34.283553 INFO: Competetive: True
4:01:34.298182 WARNING: dropped 18 target PSMs due to missing features
4:01:34.298284 WARNING: dropped 7 decoy PSMs due to missing features
4:01:34.354415 INFO: Test AUC: 0.544
4:01:34.354544 INFO: Train AUC: 0.545
4:01:34.354588 INFO: AUC difference: 0.19%
4:01:34.474555 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
4:01:34.475379 PROGRESS: ============================= Precursor FDR =============================
4:01:34.475508 PROGRESS: Total precursors accumulated: 56
4:01:34.475585 PROGRESS: Target precursors: 52 (92.86%)
4:01:34.475654 PROGRESS: Decoy precursors: 4 (7.14%)
4:01:34.475717 PROGRESS: 
4:01:34.475778 PROGRESS: Precursor Summary:
4:01:34.477215 PROGRESS: Channel   0:	 0.05 FDR:    49; 0.01 FDR:    36; 0.001 FDR:    36
4:01:34.477330 PROGRESS: 
4:01:34.477404 PROGRESS: Protein Summary:
4:01:34.479047 PROGRESS: Channel   0:	 0.05 FDR:    49; 0.01 FDR:    36; 0.001 FDR:    36
4:01:34.479163 PROGRESS: =========================================================================
4:01:34.480024 PROGRESS: === Epoch 6, step 3, extracting elution groups 7000 to 15000 ===
4:01:34.571584 PROGRESS: Extracting batch of 15814 precursors
4:01:34.577245 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:01:34.577312 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:01:34.577345 INFO: FWHM in RT is 15.12 seconds, sigma is 0.55
4:01:34.577387 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:01:34.577612 INFO: Starting candidate selection
4:01:39.013282 INFO: Starting candidate scoring
4:01:40.446045 INFO: Finished candidate processing
4:01:40.446137 INFO: Collecting candidate features
4:01:42.650192 WARNING: intensity_correlation has 28 NaNs ( 0.21 % out of 13542)
4:01:42.656002 INFO: Collecting fragment features
4:01:43.313009 INFO: Finished candidate scoring
4:01:43.611786 PROGRESS: === Epoch 6, step 3, extracted 13542 precursors and 72613 fragments ===
4:01:43.612142 INFO: performing precursor FDR with 47 features
4:01:43.612191 INFO: Decoy channel: -1
4:01:43.612217 INFO: Competetive: True
4:01:43.639538 WARNING: dropped 34 target PSMs due to missing features
4:01:43.639648 WARNING: dropped 19 decoy PSMs due to missing features
4:01:44.315009 INFO: Test AUC: 0.526
4:01:44.315162 INFO: Train AUC: 0.584
4:01:44.315222 INFO: AUC difference: 10.06%
4:01:44.315258 WARNING: AUC difference > 5%. This may indicate overfitting.
4:01:44.443404 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
4:01:44.444343 PROGRESS: ============================= Precursor FDR =============================
4:01:44.444471 PROGRESS: Total precursors accumulated: 199
4:01:44.444549 PROGRESS: Target precursors: 183 (91.96%)
4:01:44.444629 PROGRESS: Decoy precursors: 16 (8.04%)
4:01:44.444693 PROGRESS: 
4:01:44.444754 PROGRESS: Precursor Summary:
4:01:44.446307 PROGRESS: Channel   0:	 0.05 FDR:   151; 0.01 FDR:   109; 0.001 FDR:    91
4:01:44.446441 PROGRESS: 
4:01:44.446515 PROGRESS: Protein Summary:
4:01:44.448278 PROGRESS: Channel   0:	 0.05 FDR:   150; 0.01 FDR:   108; 0.001 FDR:    90
4:01:44.448389 PROGRESS: =========================================================================
4:01:44.449314 PROGRESS: === Epoch 6, step 4, extracting elution groups 15000 to 31000 ===
4:01:44.559090 PROGRESS: Extracting batch of 31609 precursors
4:01:44.569906 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:01:44.570007 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:01:44.570045 INFO: FWHM in RT is 15.12 seconds, sigma is 0.55
4:01:44.570073 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:01:44.570326 INFO: Starting candidate selection
4:01:49.247455 INFO: Starting candidate scoring
4:01:50.802281 INFO: Finished candidate processing
4:01:50.802469 INFO: Collecting candidate features
4:01:53.078780 WARNING: intensity_correlation has 45 NaNs ( 0.17 % out of 27148)
4:01:53.085628 INFO: Collecting fragment features
4:01:53.771164 INFO: Finished candidate scoring
4:01:54.088557 PROGRESS: === Epoch 6, step 4, extracted 27148 precursors and 145053 fragments ===
4:01:54.088925 INFO: performing precursor FDR with 47 features
4:01:54.088975 INFO: Decoy channel: -1
4:01:54.089001 INFO: Competetive: True
4:01:54.144482 WARNING: dropped 62 target PSMs due to missing features
4:01:54.144594 WARNING: dropped 36 decoy PSMs due to missing features
4:01:55.891112 INFO: Test AUC: 0.543
4:01:55.891262 INFO: Train AUC: 0.586
4:01:55.891310 INFO: AUC difference: 7.31%
4:01:55.891345 WARNING: AUC difference > 5%. This may indicate overfitting.
4:01:56.021154 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
4:01:56.022215 PROGRESS: ============================= Precursor FDR =============================
4:01:56.022343 PROGRESS: Total precursors accumulated: 335
4:01:56.022421 PROGRESS: Target precursors: 306 (91.34%)
4:01:56.022490 PROGRESS: Decoy precursors: 29 (8.66%)
4:01:56.022552 PROGRESS: 
4:01:56.022613 PROGRESS: Precursor Summary:
4:01:56.024281 PROGRESS: Channel   0:	 0.05 FDR:   245; 0.01 FDR:   195; 0.001 FDR:   191
4:01:56.024405 PROGRESS: 
4:01:56.024479 PROGRESS: Protein Summary:
4:01:56.026464 PROGRESS: Channel   0:	 0.05 FDR:   240; 0.01 FDR:   190; 0.001 FDR:   186
4:01:56.026581 PROGRESS: =========================================================================
4:01:56.027596 PROGRESS: === Epoch 6, step 5, extracting elution groups 31000 to 63000 ===
4:01:56.165051 PROGRESS: Extracting batch of 63226 precursors
4:01:56.185592 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:01:56.185700 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:01:56.185737 INFO: FWHM in RT is 15.12 seconds, sigma is 0.55
4:01:56.185800 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:01:56.186069 INFO: Starting candidate selection
4:02:01.530517 INFO: Starting candidate scoring
4:02:03.370025 INFO: Finished candidate processing
4:02:03.370116 INFO: Collecting candidate features
4:02:05.708944 WARNING: intensity_correlation has 112 NaNs ( 0.21 % out of 54336)
4:02:05.717447 INFO: Collecting fragment features
4:02:06.425630 INFO: Finished candidate scoring
4:02:06.774240 PROGRESS: === Epoch 6, step 5, extracted 54336 precursors and 290476 fragments ===
4:02:06.774615 INFO: performing precursor FDR with 47 features
4:02:06.774665 INFO: Decoy channel: -1
4:02:06.774692 INFO: Competetive: True
4:02:06.893639 WARNING: dropped 123 target PSMs due to missing features
4:02:06.893754 WARNING: dropped 87 decoy PSMs due to missing features
4:02:10.624578 INFO: Test AUC: 0.548
4:02:10.624700 INFO: Train AUC: 0.585
4:02:10.624759 INFO: AUC difference: 6.24%
4:02:10.624787 WARNING: AUC difference > 5%. This may indicate overfitting.
4:02:10.762955 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
4:02:10.764357 PROGRESS: ============================= Precursor FDR =============================
4:02:10.764489 PROGRESS: Total precursors accumulated: 1,168
4:02:10.764566 PROGRESS: Target precursors: 1,066 (91.27%)
4:02:10.764635 PROGRESS: Decoy precursors: 102 (8.73%)
4:02:10.764698 PROGRESS: 
4:02:10.764758 PROGRESS: Precursor Summary:
4:02:10.766694 PROGRESS: Channel   0:	 0.05 FDR:   658; 0.01 FDR:   412; 0.001 FDR:   319
4:02:10.766849 PROGRESS: 
4:02:10.766926 PROGRESS: Protein Summary:
4:02:10.769195 PROGRESS: Channel   0:	 0.05 FDR:   622; 0.01 FDR:   387; 0.001 FDR:   304
4:02:10.769332 PROGRESS: =========================================================================
4:02:10.770483 PROGRESS: === Epoch 6, step 6, extracting elution groups 63000 to 127000 ===
4:02:10.946287 PROGRESS: Extracting batch of 126520 precursors
4:02:10.985310 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:02:10.985425 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:02:10.985465 INFO: FWHM in RT is 15.12 seconds, sigma is 0.55
4:02:10.985508 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:02:10.985788 INFO: Starting candidate selection
4:02:17.603462 INFO: Starting candidate scoring
4:02:20.041191 INFO: Finished candidate processing
4:02:20.041306 INFO: Collecting candidate features
4:02:22.538586 WARNING: intensity_correlation has 182 NaNs ( 0.17 % out of 109008)
4:02:22.550593 INFO: Collecting fragment features
4:02:23.313406 INFO: Finished candidate scoring
4:02:23.732426 PROGRESS: === Epoch 6, step 6, extracted 109008 precursors and 583432 fragments ===
4:02:23.732821 INFO: performing precursor FDR with 47 features
4:02:23.732874 INFO: Decoy channel: -1
4:02:23.732901 INFO: Competetive: True
4:02:23.983139 WARNING: dropped 211 target PSMs due to missing features
4:02:23.983255 WARNING: dropped 181 decoy PSMs due to missing features
4:02:31.752847 INFO: Test AUC: 0.549
4:02:31.752971 INFO: Train AUC: 0.576
4:02:31.753028 INFO: AUC difference: 4.81%
4:02:31.905385 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
4:02:31.906988 PROGRESS: ============================= Precursor FDR =============================
4:02:31.907161 PROGRESS: Total precursors accumulated: 1,889
4:02:31.907238 PROGRESS: Target precursors: 1,721 (91.11%)
4:02:31.907305 PROGRESS: Decoy precursors: 168 (8.89%)
4:02:31.907368 PROGRESS: 
4:02:31.907429 PROGRESS: Precursor Summary:
4:02:31.909659 PROGRESS: Channel   0:	 0.05 FDR: 1,155; 0.01 FDR:   867; 0.001 FDR:   579
4:02:31.909807 PROGRESS: 
4:02:31.909886 PROGRESS: Protein Summary:
4:02:31.912657 PROGRESS: Channel   0:	 0.05 FDR: 1,046; 0.01 FDR:   780; 0.001 FDR:   528
4:02:31.912775 PROGRESS: =========================================================================
4:02:31.914216 PROGRESS: === Epoch 6, step 7, extracting elution groups 127000 to 255000 ===
4:02:32.142236 PROGRESS: Extracting batch of 252997 precursors
4:02:32.217481 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:02:32.217595 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:02:32.217664 INFO: FWHM in RT is 15.12 seconds, sigma is 0.55
4:02:32.217693 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:02:32.217983 INFO: Starting candidate selection
4:02:41.459371 INFO: Starting candidate scoring
4:02:45.062402 INFO: Finished candidate processing
4:02:45.062591 INFO: Collecting candidate features
4:02:47.938219 WARNING: intensity_correlation has 352 NaNs ( 0.16 % out of 217600)
4:02:47.957417 INFO: Collecting fragment features
4:02:48.814617 INFO: Finished candidate scoring
4:02:49.381938 PROGRESS: === Epoch 6, step 7, extracted 217600 precursors and 1165045 fragments ===
4:02:49.382311 INFO: performing precursor FDR with 47 features
4:02:49.382359 INFO: Decoy channel: -1
4:02:49.382386 INFO: Competetive: True
4:02:49.928362 WARNING: dropped 382 target PSMs due to missing features
4:02:49.928479 WARNING: dropped 362 decoy PSMs due to missing features
4:03:06.268506 INFO: Test AUC: 0.552
4:03:06.268637 INFO: Train AUC: 0.571
4:03:06.268695 INFO: AUC difference: 3.29%
4:03:06.449322 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
4:03:06.451538 PROGRESS: ============================= Precursor FDR =============================
4:03:06.451726 PROGRESS: Total precursors accumulated: 3,422
4:03:06.451805 PROGRESS: Target precursors: 3,120 (91.17%)
4:03:06.451874 PROGRESS: Decoy precursors: 302 (8.83%)
4:03:06.451949 PROGRESS: 
4:03:06.452012 PROGRESS: Precursor Summary:
4:03:06.454949 PROGRESS: Channel   0:	 0.05 FDR: 2,447; 0.01 FDR: 1,792; 0.001 FDR: 1,293
4:03:06.455103 PROGRESS: 
4:03:06.455178 PROGRESS: Protein Summary:
4:03:06.459041 PROGRESS: Channel   0:	 0.05 FDR: 2,010; 0.01 FDR: 1,454; 0.001 FDR: 1,067
4:03:06.459182 PROGRESS: =========================================================================
4:03:06.462379 INFO: calibration group: precursor, fitting rt estimator 
4:03:06.702755 INFO: calibration group: fragment, fitting mz estimator 
4:03:07.302522 INFO: === checking if epoch conditions were reached ===
4:03:07.302773 INFO: ✅ ms2_error      : 7.0000 <= 7
4:03:07.302868 INFO: ❌ rt_error       : 201.4846 > 100
4:03:07.302942 INFO: ✅ current_epoch  : 6 >= 3
4:03:07.303007 INFO: ==============================================
4:03:07.521920 INFO: calibration group: precursor, predicting mz
4:03:07.522223 WARNING: mz prediction was skipped as it has not been fitted yet
4:03:07.522265 INFO: calibration group: precursor, predicting rt
4:03:14.428963 INFO: calibration group: fragment, predicting mz
4:03:32.133665 PROGRESS: === Epoch 7, step 0, extracting elution groups 0 to 1000 ===
4:03:32.221761 PROGRESS: Extracting batch of 1977 precursors
4:03:32.223611 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:03:32.223701 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:03:32.223759 INFO: FWHM in RT is 15.00 seconds, sigma is 0.55
4:03:32.223800 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:03:32.224071 INFO: Starting candidate selection
4:03:36.767364 INFO: Starting candidate scoring
4:03:38.079381 INFO: Finished candidate processing
4:03:38.079471 INFO: Collecting candidate features
4:03:40.260012 WARNING: intensity_correlation has 3 NaNs ( 0.17 % out of 1738)
4:03:40.266053 INFO: Collecting fragment features
4:03:40.910425 INFO: Finished candidate scoring
4:03:41.226094 PROGRESS: === Epoch 7, step 0, extracted 1738 precursors and 9361 fragments ===
4:03:41.226416 INFO: performing precursor FDR with 47 features
4:03:41.226455 INFO: Decoy channel: -1
4:03:41.226481 INFO: Competetive: True
4:03:41.231465 WARNING: dropped 1 target PSMs due to missing features
4:03:41.231534 WARNING: dropped 2 decoy PSMs due to missing features
4:03:41.259775 INFO: Test AUC: 0.546
4:03:41.259870 INFO: Train AUC: 0.566
4:03:41.259917 INFO: AUC difference: 3.50%
4:03:41.383797 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
4:03:41.384614 PROGRESS: ============================= Precursor FDR =============================
4:03:41.384737 PROGRESS: Total precursors accumulated: 5
4:03:41.384823 PROGRESS: Target precursors: 5 (100.00%)
4:03:41.384890 PROGRESS: Decoy precursors: 0 (0.00%)
4:03:41.384952 PROGRESS: 
4:03:41.385013 PROGRESS: Precursor Summary:
4:03:41.386503 PROGRESS: Channel   0:	 0.05 FDR:     5; 0.01 FDR:     5; 0.001 FDR:     5
4:03:41.386617 PROGRESS: 
4:03:41.386690 PROGRESS: Protein Summary:
4:03:41.388363 PROGRESS: Channel   0:	 0.05 FDR:     5; 0.01 FDR:     5; 0.001 FDR:     5
4:03:41.388474 PROGRESS: =========================================================================
4:03:41.389353 PROGRESS: === Epoch 7, step 1, extracting elution groups 1000 to 3000 ===
4:03:41.467022 PROGRESS: Extracting batch of 3951 precursors
4:03:41.469326 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:03:41.469387 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:03:41.469424 INFO: FWHM in RT is 15.00 seconds, sigma is 0.55
4:03:41.469470 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:03:41.469690 INFO: Starting candidate selection
4:03:45.661839 INFO: Starting candidate scoring
4:03:46.995999 INFO: Finished candidate processing
4:03:46.996140 INFO: Collecting candidate features
4:03:49.182576 WARNING: intensity_correlation has 6 NaNs ( 0.17 % out of 3529)
4:03:49.188794 INFO: Collecting fragment features
4:03:49.828112 INFO: Finished candidate scoring
4:03:50.116215 PROGRESS: === Epoch 7, step 1, extracted 3529 precursors and 18939 fragments ===
4:03:50.116508 INFO: performing precursor FDR with 47 features
4:03:50.116556 INFO: Decoy channel: -1
4:03:50.116583 INFO: Competetive: True
4:03:50.125571 WARNING: dropped 4 target PSMs due to missing features
4:03:50.125680 WARNING: dropped 5 decoy PSMs due to missing features
4:03:50.163745 INFO: Test AUC: 0.540
4:03:50.163864 INFO: Train AUC: 0.550
4:03:50.163910 INFO: AUC difference: 1.85%
4:03:50.282319 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
4:03:50.283126 PROGRESS: ============================= Precursor FDR =============================
4:03:50.283252 PROGRESS: Total precursors accumulated: 35
4:03:50.283330 PROGRESS: Target precursors: 33 (94.29%)
4:03:50.283398 PROGRESS: Decoy precursors: 2 (5.71%)
4:03:50.283462 PROGRESS: 
4:03:50.283534 PROGRESS: Precursor Summary:
4:03:50.284965 PROGRESS: Channel   0:	 0.05 FDR:    28; 0.01 FDR:    28; 0.001 FDR:    28
4:03:50.285077 PROGRESS: 
4:03:50.285166 PROGRESS: Protein Summary:
4:03:50.286815 PROGRESS: Channel   0:	 0.05 FDR:    28; 0.01 FDR:    28; 0.001 FDR:    28
4:03:50.286946 PROGRESS: =========================================================================
4:03:50.287828 PROGRESS: === Epoch 7, step 2, extracting elution groups 3000 to 7000 ===
4:03:50.370749 PROGRESS: Extracting batch of 7904 precursors
4:03:50.374283 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:03:50.374367 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:03:50.374409 INFO: FWHM in RT is 15.00 seconds, sigma is 0.55
4:03:50.374439 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:03:50.374665 INFO: Starting candidate selection
4:03:54.635594 INFO: Starting candidate scoring
4:03:56.003982 INFO: Finished candidate processing
4:03:56.004073 INFO: Collecting candidate features
4:03:58.189981 WARNING: intensity_correlation has 10 NaNs ( 0.14 % out of 7006)
4:03:58.195641 INFO: Collecting fragment features
4:03:58.842862 INFO: Finished candidate scoring
4:03:59.131109 PROGRESS: === Epoch 7, step 2, extracted 7006 precursors and 37530 fragments ===
4:03:59.131445 INFO: performing precursor FDR with 47 features
4:03:59.131492 INFO: Decoy channel: -1
4:03:59.131518 INFO: Competetive: True
4:03:59.146416 WARNING: dropped 9 target PSMs due to missing features
4:03:59.146518 WARNING: dropped 10 decoy PSMs due to missing features
4:03:59.203502 INFO: Test AUC: 0.554
4:03:59.203634 INFO: Train AUC: 0.550
4:03:59.203684 INFO: AUC difference: 0.80%
4:03:59.338744 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
4:03:59.339640 PROGRESS: ============================= Precursor FDR =============================
4:03:59.339762 PROGRESS: Total precursors accumulated: 57
4:03:59.339839 PROGRESS: Target precursors: 53 (92.98%)
4:03:59.339907 PROGRESS: Decoy precursors: 4 (7.02%)
4:03:59.339970 PROGRESS: 
4:03:59.340031 PROGRESS: Precursor Summary:
4:03:59.341471 PROGRESS: Channel   0:	 0.05 FDR:    46; 0.01 FDR:    45; 0.001 FDR:    45
4:03:59.341585 PROGRESS: 
4:03:59.341660 PROGRESS: Protein Summary:
4:03:59.343318 PROGRESS: Channel   0:	 0.05 FDR:    46; 0.01 FDR:    45; 0.001 FDR:    45
4:03:59.343429 PROGRESS: =========================================================================
4:03:59.344308 PROGRESS: === Epoch 7, step 3, extracting elution groups 7000 to 15000 ===
4:03:59.436069 PROGRESS: Extracting batch of 15813 precursors
4:03:59.441792 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:03:59.441878 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:03:59.441917 INFO: FWHM in RT is 15.00 seconds, sigma is 0.55
4:03:59.441945 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:03:59.442164 INFO: Starting candidate selection
4:04:03.867398 INFO: Starting candidate scoring
4:04:05.308441 INFO: Finished candidate processing
4:04:05.308631 INFO: Collecting candidate features
4:04:07.518639 WARNING: intensity_correlation has 29 NaNs ( 0.21 % out of 14060)
4:04:07.525785 INFO: Collecting fragment features
4:04:08.183748 INFO: Finished candidate scoring
4:04:08.480302 PROGRESS: === Epoch 7, step 3, extracted 14060 precursors and 75285 fragments ===
4:04:08.480651 INFO: performing precursor FDR with 47 features
4:04:08.480699 INFO: Decoy channel: -1
4:04:08.480727 INFO: Competetive: True
4:04:08.508913 WARNING: dropped 26 target PSMs due to missing features
4:04:08.509026 WARNING: dropped 22 decoy PSMs due to missing features
4:04:09.245316 INFO: Test AUC: 0.534
4:04:09.245466 INFO: Train AUC: 0.585
4:04:09.245513 INFO: AUC difference: 8.64%
4:04:09.245547 WARNING: AUC difference > 5%. This may indicate overfitting.
4:04:09.372318 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
4:04:09.373261 PROGRESS: ============================= Precursor FDR =============================
4:04:09.373383 PROGRESS: Total precursors accumulated: 209
4:04:09.373460 PROGRESS: Target precursors: 191 (91.39%)
4:04:09.373529 PROGRESS: Decoy precursors: 18 (8.61%)
4:04:09.373592 PROGRESS: 
4:04:09.373653 PROGRESS: Precursor Summary:
4:04:09.375220 PROGRESS: Channel   0:	 0.05 FDR:   148; 0.01 FDR:   109; 0.001 FDR:   107
4:04:09.375363 PROGRESS: 
4:04:09.375437 PROGRESS: Protein Summary:
4:04:09.377217 PROGRESS: Channel   0:	 0.05 FDR:   147; 0.01 FDR:   108; 0.001 FDR:   106
4:04:09.377342 PROGRESS: =========================================================================
4:04:09.378278 PROGRESS: === Epoch 7, step 4, extracting elution groups 15000 to 31000 ===
4:04:09.486213 PROGRESS: Extracting batch of 31616 precursors
4:04:09.496855 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:04:09.496968 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:04:09.497007 INFO: FWHM in RT is 15.00 seconds, sigma is 0.55
4:04:09.497036 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:04:09.497284 INFO: Starting candidate selection
4:04:14.240322 INFO: Starting candidate scoring
4:04:15.831583 INFO: Finished candidate processing
4:04:15.831674 INFO: Collecting candidate features
4:04:18.110154 WARNING: intensity_correlation has 30 NaNs ( 0.11 % out of 28207)
4:04:18.117145 INFO: Collecting fragment features
4:04:18.793371 INFO: Finished candidate scoring
4:04:19.107373 PROGRESS: === Epoch 7, step 4, extracted 28207 precursors and 151000 fragments ===
4:04:19.107726 INFO: performing precursor FDR with 47 features
4:04:19.107773 INFO: Decoy channel: -1
4:04:19.107801 INFO: Competetive: True
4:04:19.163926 WARNING: dropped 44 target PSMs due to missing features
4:04:19.164037 WARNING: dropped 34 decoy PSMs due to missing features
4:04:20.807234 INFO: Test AUC: 0.556
4:04:20.807399 INFO: Train AUC: 0.579
4:04:20.807452 INFO: AUC difference: 3.94%
4:04:20.956465 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
4:04:20.957532 PROGRESS: ============================= Precursor FDR =============================
4:04:20.957657 PROGRESS: Total precursors accumulated: 471
4:04:20.957735 PROGRESS: Target precursors: 430 (91.30%)
4:04:20.957813 PROGRESS: Decoy precursors: 41 (8.70%)
4:04:20.957879 PROGRESS: 
4:04:20.957942 PROGRESS: Precursor Summary:
4:04:20.959656 PROGRESS: Channel   0:	 0.05 FDR:   327; 0.01 FDR:   212; 0.001 FDR:   125
4:04:20.959788 PROGRESS: 
4:04:20.959862 PROGRESS: Protein Summary:
4:04:20.961835 PROGRESS: Channel   0:	 0.05 FDR:   320; 0.01 FDR:   207; 0.001 FDR:   123
4:04:20.961949 PROGRESS: =========================================================================
4:04:20.962966 PROGRESS: === Epoch 7, step 5, extracting elution groups 31000 to 63000 ===
4:04:21.099947 PROGRESS: Extracting batch of 63258 precursors
4:04:21.120310 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:04:21.120422 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:04:21.120459 INFO: FWHM in RT is 15.00 seconds, sigma is 0.55
4:04:21.120501 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:04:21.120754 INFO: Starting candidate selection
4:04:26.508451 INFO: Starting candidate scoring
4:04:28.398817 INFO: Finished candidate processing
4:04:28.398996 INFO: Collecting candidate features
4:04:30.764368 WARNING: intensity_correlation has 94 NaNs ( 0.17 % out of 56210)
4:04:30.773241 INFO: Collecting fragment features
4:04:31.491084 INFO: Finished candidate scoring
4:04:31.842360 PROGRESS: === Epoch 7, step 5, extracted 56210 precursors and 300085 fragments ===
4:04:31.842764 INFO: performing precursor FDR with 47 features
4:04:31.842818 INFO: Decoy channel: -1
4:04:31.842844 INFO: Competetive: True
4:04:31.969329 WARNING: dropped 101 target PSMs due to missing features
4:04:31.969451 WARNING: dropped 71 decoy PSMs due to missing features
4:04:35.660600 INFO: Test AUC: 0.550
4:04:35.660717 INFO: Train AUC: 0.582
4:04:35.660754 INFO: AUC difference: 5.47%
4:04:35.660799 WARNING: AUC difference > 5%. This may indicate overfitting.
4:04:35.801047 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
4:04:35.802423 PROGRESS: ============================= Precursor FDR =============================
4:04:35.802577 PROGRESS: Total precursors accumulated: 1,218
4:04:35.802658 PROGRESS: Target precursors: 1,109 (91.05%)
4:04:35.802727 PROGRESS: Decoy precursors: 109 (8.95%)
4:04:35.802790 PROGRESS: 
4:04:35.802852 PROGRESS: Precursor Summary:
4:04:35.804802 PROGRESS: Channel   0:	 0.05 FDR:   668; 0.01 FDR:   421; 0.001 FDR:   348
4:04:35.804957 PROGRESS: 
4:04:35.805032 PROGRESS: Protein Summary:
4:04:35.807322 PROGRESS: Channel   0:	 0.05 FDR:   626; 0.01 FDR:   397; 0.001 FDR:   329
4:04:35.807461 PROGRESS: =========================================================================
4:04:35.808604 PROGRESS: === Epoch 7, step 6, extracting elution groups 63000 to 127000 ===
4:04:35.984578 PROGRESS: Extracting batch of 126477 precursors
4:04:36.024309 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:04:36.024426 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:04:36.024466 INFO: FWHM in RT is 15.00 seconds, sigma is 0.55
4:04:36.024509 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:04:36.024779 INFO: Starting candidate selection
4:04:42.698912 INFO: Starting candidate scoring
4:04:45.187537 INFO: Finished candidate processing
4:04:45.187721 INFO: Collecting candidate features
4:04:47.729932 WARNING: intensity_correlation has 181 NaNs ( 0.16 % out of 112461)
4:04:47.730432 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 112461)
4:04:47.742629 INFO: Collecting fragment features
4:04:48.514438 INFO: Finished candidate scoring
4:04:48.939106 PROGRESS: === Epoch 7, step 6, extracted 112461 precursors and 600293 fragments ===
4:04:48.939491 INFO: performing precursor FDR with 47 features
4:04:48.939549 INFO: Decoy channel: -1
4:04:48.939576 INFO: Competetive: True
4:04:49.202865 WARNING: dropped 186 target PSMs due to missing features
4:04:49.202998 WARNING: dropped 167 decoy PSMs due to missing features
4:04:57.209292 INFO: Test AUC: 0.553
4:04:57.209417 INFO: Train AUC: 0.577
4:04:57.209475 INFO: AUC difference: 4.06%
4:04:57.384356 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
4:04:57.386122 PROGRESS: ============================= Precursor FDR =============================
4:04:57.386270 PROGRESS: Total precursors accumulated: 2,341
4:04:57.386353 PROGRESS: Target precursors: 2,137 (91.29%)
4:04:57.386422 PROGRESS: Decoy precursors: 204 (8.71%)
4:04:57.386486 PROGRESS: 
4:04:57.386548 PROGRESS: Precursor Summary:
4:04:57.388916 PROGRESS: Channel   0:	 0.05 FDR: 1,608; 0.01 FDR:   923; 0.001 FDR:   724
4:04:57.389078 PROGRESS: 
4:04:57.389155 PROGRESS: Protein Summary:
4:04:57.392151 PROGRESS: Channel   0:	 0.05 FDR: 1,441; 0.01 FDR:   810; 0.001 FDR:   640
4:04:57.392271 PROGRESS: =========================================================================
4:04:57.393765 PROGRESS: === Epoch 7, step 7, extracting elution groups 127000 to 255000 ===
4:04:57.619367 PROGRESS: Extracting batch of 252897 precursors
4:04:57.693072 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:04:57.693191 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:04:57.693247 INFO: FWHM in RT is 15.00 seconds, sigma is 0.55
4:04:57.693274 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:04:57.693561 INFO: Starting candidate selection
4:05:06.933860 INFO: Starting candidate scoring
4:05:10.593404 INFO: Finished candidate processing
4:05:10.593589 INFO: Collecting candidate features
4:05:13.494929 WARNING: intensity_correlation has 377 NaNs ( 0.17 % out of 224901)
4:05:13.515095 INFO: Collecting fragment features
4:05:14.376655 INFO: Finished candidate scoring
4:05:14.950377 PROGRESS: === Epoch 7, step 7, extracted 224901 precursors and 1200094 fragments ===
4:05:14.950748 INFO: performing precursor FDR with 47 features
4:05:14.950793 INFO: Decoy channel: -1
4:05:14.950819 INFO: Competetive: True
4:05:15.519329 WARNING: dropped 370 target PSMs due to missing features
4:05:15.519464 WARNING: dropped 360 decoy PSMs due to missing features
4:05:32.277707 INFO: Test AUC: 0.552
4:05:32.277871 INFO: Train AUC: 0.570
4:05:32.277929 INFO: AUC difference: 3.16%
4:05:32.463276 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
4:05:32.465580 PROGRESS: ============================= Precursor FDR =============================
4:05:32.465749 PROGRESS: Total precursors accumulated: 4,128
4:05:32.465839 PROGRESS: Target precursors: 3,767 (91.25%)
4:05:32.465909 PROGRESS: Decoy precursors: 361 (8.75%)
4:05:32.465972 PROGRESS: 
4:05:32.466035 PROGRESS: Precursor Summary:
4:05:32.468880 PROGRESS: Channel   0:	 0.05 FDR: 2,667; 0.01 FDR: 1,728; 0.001 FDR:   923
4:05:32.469030 PROGRESS: 
4:05:32.469105 PROGRESS: Protein Summary:
4:05:32.472827 PROGRESS: Channel   0:	 0.05 FDR: 2,172; 0.01 FDR: 1,383; 0.001 FDR:   771
4:05:32.472965 PROGRESS: =========================================================================
4:05:32.476112 INFO: calibration group: precursor, fitting rt estimator 
4:05:32.723462 INFO: calibration group: fragment, fitting mz estimator 
4:05:33.323726 INFO: === checking if epoch conditions were reached ===
4:05:33.323912 INFO: ✅ ms2_error      : 7.0000 <= 7
4:05:33.324001 INFO: ❌ rt_error       : 203.0282 > 100
4:05:33.324083 INFO: ✅ current_epoch  : 7 >= 3
4:05:33.324150 INFO: ==============================================
4:05:33.544185 INFO: calibration group: precursor, predicting mz
4:05:33.544479 WARNING: mz prediction was skipped as it has not been fitted yet
4:05:33.544521 INFO: calibration group: precursor, predicting rt
4:05:40.382204 INFO: calibration group: fragment, predicting mz
4:05:58.131845 PROGRESS: === Epoch 8, step 0, extracting elution groups 0 to 1000 ===
4:05:58.219105 PROGRESS: Extracting batch of 1978 precursors
4:05:58.220929 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:05:58.221020 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:05:58.221061 INFO: FWHM in RT is 14.68 seconds, sigma is 0.53
4:05:58.221108 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:05:58.221340 INFO: Starting candidate selection
4:06:02.668597 INFO: Starting candidate scoring
4:06:03.954298 INFO: Finished candidate processing
4:06:03.954393 INFO: Collecting candidate features
4:06:06.112332 WARNING: intensity_correlation has 2 NaNs ( 0.11 % out of 1797)
4:06:06.118554 INFO: Collecting fragment features
4:06:06.760744 INFO: Finished candidate scoring
4:06:07.073365 PROGRESS: === Epoch 8, step 0, extracted 1797 precursors and 9377 fragments ===
4:06:07.073704 INFO: performing precursor FDR with 47 features
4:06:07.073748 INFO: Decoy channel: -1
4:06:07.073783 INFO: Competetive: True
4:06:07.078425 WARNING: dropped 2 target PSMs due to missing features
4:06:07.106588 INFO: Test AUC: 0.619
4:06:07.106696 INFO: Train AUC: 0.539
4:06:07.106762 INFO: AUC difference: 14.94%
4:06:07.106810 WARNING: AUC difference > 5%. This may indicate overfitting.
4:06:07.230117 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
4:06:07.230914 PROGRESS: ============================= Precursor FDR =============================
4:06:07.231035 PROGRESS: Total precursors accumulated: 8
4:06:07.231115 PROGRESS: Target precursors: 8 (100.00%)
4:06:07.231184 PROGRESS: Decoy precursors: 0 (0.00%)
4:06:07.231248 PROGRESS: 
4:06:07.231308 PROGRESS: Precursor Summary:
4:06:07.232805 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
4:06:07.232915 PROGRESS: 
4:06:07.232989 PROGRESS: Protein Summary:
4:06:07.234693 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
4:06:07.234804 PROGRESS: =========================================================================
4:06:07.235689 PROGRESS: === Epoch 8, step 1, extracting elution groups 1000 to 3000 ===
4:06:07.312588 PROGRESS: Extracting batch of 3938 precursors
4:06:07.314849 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:06:07.314920 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:06:07.314958 INFO: FWHM in RT is 14.68 seconds, sigma is 0.53
4:06:07.314989 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:06:07.315217 INFO: Starting candidate selection
4:06:11.477498 INFO: Starting candidate scoring
4:06:12.804575 INFO: Finished candidate processing
4:06:12.804662 INFO: Collecting candidate features
4:06:14.993005 WARNING: intensity_correlation has 7 NaNs ( 0.19 % out of 3603)
4:06:14.999251 INFO: Collecting fragment features
4:06:15.647715 INFO: Finished candidate scoring
4:06:15.930990 PROGRESS: === Epoch 8, step 1, extracted 3603 precursors and 19249 fragments ===
4:06:15.931282 INFO: performing precursor FDR with 47 features
4:06:15.931328 INFO: Decoy channel: -1
4:06:15.931355 INFO: Competetive: True
4:06:15.940282 WARNING: dropped 4 target PSMs due to missing features
4:06:15.940374 WARNING: dropped 5 decoy PSMs due to missing features
4:06:15.978297 INFO: Test AUC: 0.575
4:06:15.978413 INFO: Train AUC: 0.565
4:06:15.978459 INFO: AUC difference: 1.89%
4:06:16.098803 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
4:06:16.099612 PROGRESS: ============================= Precursor FDR =============================
4:06:16.099734 PROGRESS: Total precursors accumulated: 25
4:06:16.099812 PROGRESS: Target precursors: 23 (92.00%)
4:06:16.099881 PROGRESS: Decoy precursors: 2 (8.00%)
4:06:16.099945 PROGRESS: 
4:06:16.100007 PROGRESS: Precursor Summary:
4:06:16.101444 PROGRESS: Channel   0:	 0.05 FDR:    22; 0.01 FDR:    21; 0.001 FDR:    21
4:06:16.101560 PROGRESS: 
4:06:16.101635 PROGRESS: Protein Summary:
4:06:16.103277 PROGRESS: Channel   0:	 0.05 FDR:    22; 0.01 FDR:    21; 0.001 FDR:    21
4:06:16.103409 PROGRESS: =========================================================================
4:06:16.104286 PROGRESS: === Epoch 8, step 2, extracting elution groups 3000 to 7000 ===
4:06:16.186766 PROGRESS: Extracting batch of 7904 precursors
4:06:16.190192 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:06:16.190260 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:06:16.190300 INFO: FWHM in RT is 14.68 seconds, sigma is 0.53
4:06:16.190348 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:06:16.190577 INFO: Starting candidate selection
4:06:20.406057 INFO: Starting candidate scoring
4:06:21.754758 INFO: Finished candidate processing
4:06:21.754858 INFO: Collecting candidate features
4:06:23.935770 WARNING: intensity_correlation has 11 NaNs ( 0.15 % out of 7203)
4:06:23.941498 INFO: Collecting fragment features
4:06:24.588238 INFO: Finished candidate scoring
4:06:24.874577 PROGRESS: === Epoch 8, step 2, extracted 7203 precursors and 38367 fragments ===
4:06:24.874895 INFO: performing precursor FDR with 47 features
4:06:24.874939 INFO: Decoy channel: -1
4:06:24.874966 INFO: Competetive: True
4:06:24.890055 WARNING: dropped 7 target PSMs due to missing features
4:06:24.890155 WARNING: dropped 13 decoy PSMs due to missing features
4:06:25.154789 INFO: Test AUC: 0.541
4:06:25.154923 INFO: Train AUC: 0.578
4:06:25.154968 INFO: AUC difference: 6.47%
4:06:25.155001 WARNING: AUC difference > 5%. This may indicate overfitting.
4:06:25.275223 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
4:06:25.276093 PROGRESS: ============================= Precursor FDR =============================
4:06:25.276216 PROGRESS: Total precursors accumulated: 116
4:06:25.276309 PROGRESS: Target precursors: 106 (91.38%)
4:06:25.276380 PROGRESS: Decoy precursors: 10 (8.62%)
4:06:25.276443 PROGRESS: 
4:06:25.276506 PROGRESS: Precursor Summary:
4:06:25.278009 PROGRESS: Channel   0:	 0.05 FDR:    91; 0.01 FDR:    50; 0.001 FDR:    50
4:06:25.278125 PROGRESS: 
4:06:25.278200 PROGRESS: Protein Summary:
4:06:25.279886 PROGRESS: Channel   0:	 0.05 FDR:    88; 0.01 FDR:    47; 0.001 FDR:    47
4:06:25.279997 PROGRESS: =========================================================================
4:06:25.280882 PROGRESS: === Epoch 8, step 3, extracting elution groups 7000 to 15000 ===
4:06:25.373133 PROGRESS: Extracting batch of 15816 precursors
4:06:25.378801 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:06:25.378872 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:06:25.378907 INFO: FWHM in RT is 14.68 seconds, sigma is 0.53
4:06:25.378934 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:06:25.379177 INFO: Starting candidate selection
4:06:29.799029 INFO: Starting candidate scoring
4:06:31.238725 INFO: Finished candidate processing
4:06:31.238840 INFO: Collecting candidate features
4:06:33.447248 WARNING: intensity_correlation has 18 NaNs ( 0.12 % out of 14474)
4:06:33.453517 INFO: Collecting fragment features
4:06:34.108409 INFO: Finished candidate scoring
4:06:34.402029 PROGRESS: === Epoch 8, step 3, extracted 14474 precursors and 77050 fragments ===
4:06:34.402392 INFO: performing precursor FDR with 47 features
4:06:34.402441 INFO: Decoy channel: -1
4:06:34.402468 INFO: Competetive: True
4:06:34.431093 WARNING: dropped 18 target PSMs due to missing features
4:06:34.431206 WARNING: dropped 20 decoy PSMs due to missing features
4:06:35.231610 INFO: Test AUC: 0.551
4:06:35.231756 INFO: Train AUC: 0.585
4:06:35.231815 INFO: AUC difference: 5.86%
4:06:35.231849 WARNING: AUC difference > 5%. This may indicate overfitting.
4:06:35.367908 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
4:06:35.368881 PROGRESS: ============================= Precursor FDR =============================
4:06:35.369006 PROGRESS: Total precursors accumulated: 243
4:06:35.369084 PROGRESS: Target precursors: 222 (91.36%)
4:06:35.369152 PROGRESS: Decoy precursors: 21 (8.64%)
4:06:35.369215 PROGRESS: 
4:06:35.369277 PROGRESS: Precursor Summary:
4:06:35.370845 PROGRESS: Channel   0:	 0.05 FDR:   188; 0.01 FDR:   112; 0.001 FDR:    84
4:06:35.370980 PROGRESS: 
4:06:35.371055 PROGRESS: Protein Summary:
4:06:35.372858 PROGRESS: Channel   0:	 0.05 FDR:   181; 0.01 FDR:   109; 0.001 FDR:    82
4:06:35.372986 PROGRESS: =========================================================================
4:06:35.373927 PROGRESS: === Epoch 8, step 4, extracting elution groups 15000 to 31000 ===
4:06:35.481953 PROGRESS: Extracting batch of 31621 precursors
4:06:35.492698 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:06:35.492812 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:06:35.492852 INFO: FWHM in RT is 14.68 seconds, sigma is 0.53
4:06:35.492880 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:06:35.493122 INFO: Starting candidate selection
4:06:40.187302 INFO: Starting candidate scoring
4:06:41.754945 INFO: Finished candidate processing
4:06:41.755038 INFO: Collecting candidate features
4:06:44.041124 WARNING: intensity_correlation has 45 NaNs ( 0.16 % out of 28834)
4:06:44.049491 INFO: Collecting fragment features
4:06:44.745204 INFO: Finished candidate scoring
4:06:45.058803 PROGRESS: === Epoch 8, step 4, extracted 28834 precursors and 152358 fragments ===
4:06:45.059174 INFO: performing precursor FDR with 47 features
4:06:45.059224 INFO: Decoy channel: -1
4:06:45.059251 INFO: Competetive: True
4:06:45.116890 WARNING: dropped 43 target PSMs due to missing features
4:06:45.117000 WARNING: dropped 40 decoy PSMs due to missing features
4:06:47.007393 INFO: Test AUC: 0.555
4:06:47.007543 INFO: Train AUC: 0.586
4:06:47.007589 INFO: AUC difference: 5.28%
4:06:47.007622 WARNING: AUC difference > 5%. This may indicate overfitting.
4:06:47.157401 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
4:06:47.158532 PROGRESS: ============================= Precursor FDR =============================
4:06:47.158660 PROGRESS: Total precursors accumulated: 631
4:06:47.158739 PROGRESS: Target precursors: 577 (91.44%)
4:06:47.158806 PROGRESS: Decoy precursors: 54 (8.56%)
4:06:47.158870 PROGRESS: 
4:06:47.158930 PROGRESS: Precursor Summary:
4:06:47.160645 PROGRESS: Channel   0:	 0.05 FDR:   428; 0.01 FDR:   231; 0.001 FDR:   203
4:06:47.160766 PROGRESS: 
4:06:47.160841 PROGRESS: Protein Summary:
4:06:47.162984 PROGRESS: Channel   0:	 0.05 FDR:   417; 0.01 FDR:   225; 0.001 FDR:   197
4:06:47.163098 PROGRESS: =========================================================================
4:06:47.164126 PROGRESS: === Epoch 8, step 5, extracting elution groups 31000 to 63000 ===
4:06:47.301058 PROGRESS: Extracting batch of 63221 precursors
4:06:47.321660 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:06:47.321778 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:06:47.321839 INFO: FWHM in RT is 14.68 seconds, sigma is 0.53
4:06:47.321867 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:06:47.322124 INFO: Starting candidate selection
4:06:52.673361 INFO: Starting candidate scoring
4:06:54.553221 INFO: Finished candidate processing
4:06:54.553332 INFO: Collecting candidate features
4:06:56.893730 WARNING: intensity_correlation has 97 NaNs ( 0.17 % out of 57639)
4:06:56.902608 INFO: Collecting fragment features
4:06:57.612550 INFO: Finished candidate scoring
4:06:57.960645 PROGRESS: === Epoch 8, step 5, extracted 57639 precursors and 305689 fragments ===
4:06:57.961019 INFO: performing precursor FDR with 47 features
4:06:57.961066 INFO: Decoy channel: -1
4:06:57.961093 INFO: Competetive: True
4:06:58.088812 WARNING: dropped 99 target PSMs due to missing features
4:06:58.088931 WARNING: dropped 81 decoy PSMs due to missing features
4:07:01.892481 INFO: Test AUC: 0.552
4:07:01.892602 INFO: Train AUC: 0.585
4:07:01.892662 INFO: AUC difference: 5.64%
4:07:01.892691 WARNING: AUC difference > 5%. This may indicate overfitting.
4:07:02.030997 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
4:07:02.032398 PROGRESS: ============================= Precursor FDR =============================
4:07:02.032546 PROGRESS: Total precursors accumulated: 1,341
4:07:02.032627 PROGRESS: Target precursors: 1,224 (91.28%)
4:07:02.032701 PROGRESS: Decoy precursors: 117 (8.72%)
4:07:02.032818 PROGRESS: 
4:07:02.032897 PROGRESS: Precursor Summary:
4:07:02.034909 PROGRESS: Channel   0:	 0.05 FDR:   771; 0.01 FDR:   508; 0.001 FDR:   357
4:07:02.035047 PROGRESS: 
4:07:02.035121 PROGRESS: Protein Summary:
4:07:02.037502 PROGRESS: Channel   0:	 0.05 FDR:   737; 0.01 FDR:   484; 0.001 FDR:   343
4:07:02.037634 PROGRESS: =========================================================================
4:07:02.038860 PROGRESS: === Epoch 8, step 6, extracting elution groups 63000 to 127000 ===
4:07:02.216198 PROGRESS: Extracting batch of 126475 precursors
4:07:02.256371 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:07:02.256484 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:07:02.256523 INFO: FWHM in RT is 14.68 seconds, sigma is 0.53
4:07:02.256569 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:07:02.256870 INFO: Starting candidate selection
4:07:08.919257 INFO: Starting candidate scoring
4:07:11.418590 INFO: Finished candidate processing
4:07:11.418771 INFO: Collecting candidate features
4:07:13.940829 WARNING: intensity_correlation has 136 NaNs ( 0.12 % out of 115627)
4:07:13.953562 INFO: Collecting fragment features
4:07:14.721016 INFO: Finished candidate scoring
4:07:15.143983 PROGRESS: === Epoch 8, step 6, extracted 115627 precursors and 613599 fragments ===
4:07:15.144362 INFO: performing precursor FDR with 47 features
4:07:15.144410 INFO: Decoy channel: -1
4:07:15.144435 INFO: Competetive: True
4:07:15.405774 WARNING: dropped 172 target PSMs due to missing features
4:07:15.405893 WARNING: dropped 144 decoy PSMs due to missing features
4:07:23.872292 INFO: Test AUC: 0.553
4:07:23.872439 INFO: Train AUC: 0.577
4:07:23.872480 INFO: AUC difference: 4.13%
4:07:24.028168 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
4:07:24.030022 PROGRESS: ============================= Precursor FDR =============================
4:07:24.030160 PROGRESS: Total precursors accumulated: 2,784
4:07:24.030252 PROGRESS: Target precursors: 2,539 (91.20%)
4:07:24.030321 PROGRESS: Decoy precursors: 245 (8.80%)
4:07:24.030384 PROGRESS: 
4:07:24.030446 PROGRESS: Precursor Summary:
4:07:24.032814 PROGRESS: Channel   0:	 0.05 FDR: 1,770; 0.01 FDR: 1,019; 0.001 FDR:   688
4:07:24.032955 PROGRESS: 
4:07:24.033030 PROGRESS: Protein Summary:
4:07:24.036040 PROGRESS: Channel   0:	 0.05 FDR: 1,598; 0.01 FDR:   912; 0.001 FDR:   627
4:07:24.036172 PROGRESS: =========================================================================
4:07:24.037657 PROGRESS: === Epoch 8, step 7, extracting elution groups 127000 to 255000 ===
4:07:24.264073 PROGRESS: Extracting batch of 252990 precursors
4:07:24.338296 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:07:24.338430 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:07:24.338473 INFO: FWHM in RT is 14.68 seconds, sigma is 0.53
4:07:24.338501 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:07:24.338786 INFO: Starting candidate selection
4:07:33.622338 INFO: Starting candidate scoring
4:07:37.398375 INFO: Finished candidate processing
4:07:37.398561 INFO: Collecting candidate features
4:07:40.318026 WARNING: intensity_correlation has 284 NaNs ( 0.12 % out of 231251)
4:07:40.318715 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 231251)
4:07:40.338660 INFO: Collecting fragment features
4:07:41.211042 INFO: Finished candidate scoring
4:07:41.788097 PROGRESS: === Epoch 8, step 7, extracted 231251 precursors and 1228600 fragments ===
4:07:41.788475 INFO: performing precursor FDR with 47 features
4:07:41.788521 INFO: Decoy channel: -1
4:07:41.788547 INFO: Competetive: True
4:07:42.367778 WARNING: dropped 320 target PSMs due to missing features
4:07:42.367895 WARNING: dropped 280 decoy PSMs due to missing features
4:07:59.226419 INFO: Test AUC: 0.550
4:07:59.226565 INFO: Train AUC: 0.570
4:07:59.226619 INFO: AUC difference: 3.41%
4:07:59.426900 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
4:07:59.429151 PROGRESS: ============================= Precursor FDR =============================
4:07:59.429313 PROGRESS: Total precursors accumulated: 4,058
4:07:59.429393 PROGRESS: Target precursors: 3,699 (91.15%)
4:07:59.429459 PROGRESS: Decoy precursors: 359 (8.85%)
4:07:59.429522 PROGRESS: 
4:07:59.429582 PROGRESS: Precursor Summary:
4:07:59.432500 PROGRESS: Channel   0:	 0.05 FDR: 2,714; 0.01 FDR: 1,823; 0.001 FDR: 1,454
4:07:59.432648 PROGRESS: 
4:07:59.432733 PROGRESS: Protein Summary:
4:07:59.436573 PROGRESS: Channel   0:	 0.05 FDR: 2,156; 0.01 FDR: 1,434; 0.001 FDR: 1,156
4:07:59.436702 PROGRESS: =========================================================================
4:07:59.439797 INFO: calibration group: precursor, fitting rt estimator 
4:07:59.687769 INFO: calibration group: fragment, fitting mz estimator 
4:08:00.277668 INFO: === checking if epoch conditions were reached ===
4:08:00.277905 INFO: ✅ ms2_error      : 7.0000 <= 7
4:08:00.277986 INFO: ❌ rt_error       : 199.1718 > 100
4:08:00.278051 INFO: ✅ current_epoch  : 8 >= 3
4:08:00.278109 INFO: ==============================================
4:08:00.497134 INFO: calibration group: precursor, predicting mz
4:08:00.497435 WARNING: mz prediction was skipped as it has not been fitted yet
4:08:00.497479 INFO: calibration group: precursor, predicting rt
4:08:07.293074 INFO: calibration group: fragment, predicting mz
4:08:25.084898 PROGRESS: === Epoch 9, step 0, extracting elution groups 0 to 1000 ===
4:08:25.173598 PROGRESS: Extracting batch of 1977 precursors
4:08:25.175411 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:08:25.175505 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:08:25.175546 INFO: FWHM in RT is 14.97 seconds, sigma is 0.54
4:08:25.175592 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:08:25.175855 INFO: Starting candidate selection
4:08:29.673093 INFO: Starting candidate scoring
4:08:30.981854 INFO: Finished candidate processing
4:08:30.981952 INFO: Collecting candidate features
4:08:33.140456 WARNING: intensity_correlation has 5 NaNs ( 0.27 % out of 1869)
4:08:33.146433 INFO: Collecting fragment features
4:08:33.783360 INFO: Finished candidate scoring
4:08:34.096722 PROGRESS: === Epoch 9, step 0, extracted 1869 precursors and 10060 fragments ===
4:08:34.097056 INFO: performing precursor FDR with 47 features
4:08:34.097095 INFO: Decoy channel: -1
4:08:34.097122 INFO: Competetive: True
4:08:34.102009 WARNING: dropped 2 target PSMs due to missing features
4:08:34.102098 WARNING: dropped 3 decoy PSMs due to missing features
4:08:34.130487 INFO: Test AUC: 0.525
4:08:34.130593 INFO: Train AUC: 0.568
4:08:34.130658 INFO: AUC difference: 7.58%
4:08:34.130705 WARNING: AUC difference > 5%. This may indicate overfitting.
4:08:34.257244 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
4:08:34.258081 PROGRESS: ============================= Precursor FDR =============================
4:08:34.258205 PROGRESS: Total precursors accumulated: 10
4:08:34.258284 PROGRESS: Target precursors: 10 (100.00%)
4:08:34.258363 PROGRESS: Decoy precursors: 0 (0.00%)
4:08:34.258428 PROGRESS: 
4:08:34.258488 PROGRESS: Precursor Summary:
4:08:34.259990 PROGRESS: Channel   0:	 0.05 FDR:    10; 0.01 FDR:    10; 0.001 FDR:    10
4:08:34.260100 PROGRESS: 
4:08:34.260173 PROGRESS: Protein Summary:
4:08:34.261883 PROGRESS: Channel   0:	 0.05 FDR:    10; 0.01 FDR:    10; 0.001 FDR:    10
4:08:34.261995 PROGRESS: =========================================================================
4:08:34.262889 PROGRESS: === Epoch 9, step 1, extracting elution groups 1000 to 3000 ===
4:08:34.340178 PROGRESS: Extracting batch of 3955 precursors
4:08:34.342501 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:08:34.342566 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:08:34.342606 INFO: FWHM in RT is 14.97 seconds, sigma is 0.54
4:08:34.342649 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:08:34.342893 INFO: Starting candidate selection
4:08:38.459519 INFO: Starting candidate scoring
4:08:39.769559 INFO: Finished candidate processing
4:08:39.769651 INFO: Collecting candidate features
4:08:41.933840 WARNING: intensity_correlation has 5 NaNs ( 0.13 % out of 3721)
4:08:41.940026 INFO: Collecting fragment features
4:08:42.579730 INFO: Finished candidate scoring
4:08:42.860656 PROGRESS: === Epoch 9, step 1, extracted 3721 precursors and 19998 fragments ===
4:08:42.860938 INFO: performing precursor FDR with 47 features
4:08:42.860982 INFO: Decoy channel: -1
4:08:42.861009 INFO: Competetive: True
4:08:42.869731 WARNING: dropped 6 target PSMs due to missing features
4:08:42.869847 WARNING: dropped 4 decoy PSMs due to missing features
4:08:42.908858 INFO: Test AUC: 0.538
4:08:42.908978 INFO: Train AUC: 0.551
4:08:42.909024 INFO: AUC difference: 2.47%
4:08:43.027423 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
4:08:43.028224 PROGRESS: ============================= Precursor FDR =============================
4:08:43.028347 PROGRESS: Total precursors accumulated: 29
4:08:43.028425 PROGRESS: Target precursors: 27 (93.10%)
4:08:43.028495 PROGRESS: Decoy precursors: 2 (6.90%)
4:08:43.028560 PROGRESS: 
4:08:43.028625 PROGRESS: Precursor Summary:
4:08:43.030069 PROGRESS: Channel   0:	 0.05 FDR:    24; 0.01 FDR:    24; 0.001 FDR:    24
4:08:43.030183 PROGRESS: 
4:08:43.030258 PROGRESS: Protein Summary:
4:08:43.031887 PROGRESS: Channel   0:	 0.05 FDR:    24; 0.01 FDR:    24; 0.001 FDR:    24
4:08:43.031998 PROGRESS: =========================================================================
4:08:43.032848 PROGRESS: === Epoch 9, step 2, extracting elution groups 3000 to 7000 ===
4:08:43.115548 PROGRESS: Extracting batch of 7908 precursors
4:08:43.118865 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:08:43.118942 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:08:43.118981 INFO: FWHM in RT is 14.97 seconds, sigma is 0.54
4:08:43.119010 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:08:43.119267 INFO: Starting candidate selection
4:08:47.314535 INFO: Starting candidate scoring
4:08:48.663456 INFO: Finished candidate processing
4:08:48.663552 INFO: Collecting candidate features
4:08:50.844574 WARNING: intensity_correlation has 8 NaNs ( 0.11 % out of 7431)
4:08:50.850322 INFO: Collecting fragment features
4:08:51.497342 INFO: Finished candidate scoring
4:08:51.784122 PROGRESS: === Epoch 9, step 2, extracted 7431 precursors and 39662 fragments ===
4:08:51.784449 INFO: performing precursor FDR with 47 features
4:08:51.784494 INFO: Decoy channel: -1
4:08:51.784520 INFO: Competetive: True
4:08:51.799859 WARNING: dropped 11 target PSMs due to missing features
4:08:51.799960 WARNING: dropped 7 decoy PSMs due to missing features
4:08:52.109914 INFO: Test AUC: 0.541
4:08:52.110043 INFO: Train AUC: 0.565
4:08:52.110089 INFO: AUC difference: 4.22%
4:08:52.231695 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
4:08:52.232541 PROGRESS: ============================= Precursor FDR =============================
4:08:52.232662 PROGRESS: Total precursors accumulated: 72
4:08:52.232740 PROGRESS: Target precursors: 67 (93.06%)
4:08:52.232808 PROGRESS: Decoy precursors: 5 (6.94%)
4:08:52.232871 PROGRESS: 
4:08:52.232932 PROGRESS: Precursor Summary:
4:08:52.234414 PROGRESS: Channel   0:	 0.05 FDR:    64; 0.01 FDR:    41; 0.001 FDR:    41
4:08:52.234532 PROGRESS: 
4:08:52.234607 PROGRESS: Protein Summary:
4:08:52.236279 PROGRESS: Channel   0:	 0.05 FDR:    62; 0.01 FDR:    41; 0.001 FDR:    41
4:08:52.236391 PROGRESS: =========================================================================
4:08:52.237265 PROGRESS: === Epoch 9, step 3, extracting elution groups 7000 to 15000 ===
4:08:52.328921 PROGRESS: Extracting batch of 15815 precursors
4:08:52.334485 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:08:52.334574 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:08:52.334634 INFO: FWHM in RT is 14.97 seconds, sigma is 0.54
4:08:52.334663 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:08:52.334901 INFO: Starting candidate selection
4:08:56.696964 INFO: Starting candidate scoring
4:08:58.117726 INFO: Finished candidate processing
4:08:58.117934 INFO: Collecting candidate features
4:09:00.358498 WARNING: intensity_correlation has 26 NaNs ( 0.18 % out of 14822)
4:09:00.364625 INFO: Collecting fragment features
4:09:01.028828 INFO: Finished candidate scoring
4:09:01.326793 PROGRESS: === Epoch 9, step 3, extracted 14822 precursors and 78784 fragments ===
4:09:01.327196 INFO: performing precursor FDR with 47 features
4:09:01.327246 INFO: Decoy channel: -1
4:09:01.327273 INFO: Competetive: True
4:09:01.357161 WARNING: dropped 22 target PSMs due to missing features
4:09:01.357293 WARNING: dropped 22 decoy PSMs due to missing features
4:09:02.097626 INFO: Test AUC: 0.536
4:09:02.097781 INFO: Train AUC: 0.577
4:09:02.097829 INFO: AUC difference: 7.05%
4:09:02.097864 WARNING: AUC difference > 5%. This may indicate overfitting.
4:09:02.222996 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
4:09:02.223986 PROGRESS: ============================= Precursor FDR =============================
4:09:02.224122 PROGRESS: Total precursors accumulated: 321
4:09:02.224234 PROGRESS: Target precursors: 293 (91.28%)
4:09:02.224321 PROGRESS: Decoy precursors: 28 (8.72%)
4:09:02.224410 PROGRESS: 
4:09:02.224501 PROGRESS: Precursor Summary:
4:09:02.226149 PROGRESS: Channel   0:	 0.05 FDR:   224; 0.01 FDR:   158; 0.001 FDR:   146
4:09:02.226271 PROGRESS: 
4:09:02.226372 PROGRESS: Protein Summary:
4:09:02.228843 PROGRESS: Channel   0:	 0.05 FDR:   218; 0.01 FDR:   152; 0.001 FDR:   140
4:09:02.228986 PROGRESS: =========================================================================
4:09:02.229996 PROGRESS: === Epoch 9, step 4, extracting elution groups 15000 to 31000 ===
4:09:02.338734 PROGRESS: Extracting batch of 31591 precursors
4:09:02.349898 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:09:02.349998 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:09:02.350037 INFO: FWHM in RT is 14.97 seconds, sigma is 0.54
4:09:02.350065 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:09:02.350318 INFO: Starting candidate selection
4:09:07.052843 INFO: Starting candidate scoring
4:09:08.647640 INFO: Finished candidate processing
4:09:08.647839 INFO: Collecting candidate features
4:09:10.906634 WARNING: intensity_correlation has 47 NaNs ( 0.16 % out of 29724)
4:09:10.914898 INFO: Collecting fragment features
4:09:11.592197 INFO: Finished candidate scoring
4:09:11.905450 PROGRESS: === Epoch 9, step 4, extracted 29724 precursors and 158504 fragments ===
4:09:11.905842 INFO: performing precursor FDR with 47 features
4:09:11.905911 INFO: Decoy channel: -1
4:09:11.905957 INFO: Competetive: True
4:09:11.965672 WARNING: dropped 47 target PSMs due to missing features
4:09:11.965794 WARNING: dropped 44 decoy PSMs due to missing features
4:09:13.864490 INFO: Test AUC: 0.545
4:09:13.865490 INFO: Train AUC: 0.589
4:09:13.865545 INFO: AUC difference: 7.35%
4:09:13.865576 WARNING: AUC difference > 5%. This may indicate overfitting.
4:09:13.994467 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
4:09:13.995613 PROGRESS: ============================= Precursor FDR =============================
4:09:13.995741 PROGRESS: Total precursors accumulated: 746
4:09:13.995821 PROGRESS: Target precursors: 679 (91.02%)
4:09:13.995891 PROGRESS: Decoy precursors: 67 (8.98%)
4:09:13.995967 PROGRESS: 
4:09:13.996030 PROGRESS: Precursor Summary:
4:09:13.997763 PROGRESS: Channel   0:	 0.05 FDR:   433; 0.01 FDR:   259; 0.001 FDR:   229
4:09:13.997909 PROGRESS: 
4:09:13.997983 PROGRESS: Protein Summary:
4:09:14.000009 PROGRESS: Channel   0:	 0.05 FDR:   411; 0.01 FDR:   246; 0.001 FDR:   216
4:09:14.000122 PROGRESS: =========================================================================
4:09:14.001169 PROGRESS: === Epoch 9, step 5, extracting elution groups 31000 to 63000 ===
4:09:14.139422 PROGRESS: Extracting batch of 63204 precursors
4:09:14.159819 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:09:14.159926 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:09:14.159964 INFO: FWHM in RT is 14.97 seconds, sigma is 0.54
4:09:14.160007 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:09:14.160260 INFO: Starting candidate selection
4:09:19.531439 INFO: Starting candidate scoring
4:09:21.432815 INFO: Finished candidate processing
4:09:21.432996 INFO: Collecting candidate features
4:09:23.815547 WARNING: intensity_correlation has 92 NaNs ( 0.15 % out of 59407)
4:09:23.825051 INFO: Collecting fragment features
4:09:24.545310 INFO: Finished candidate scoring
4:09:24.899311 PROGRESS: === Epoch 9, step 5, extracted 59407 precursors and 315769 fragments ===
4:09:24.899666 INFO: performing precursor FDR with 47 features
4:09:24.899714 INFO: Decoy channel: -1
4:09:24.899741 INFO: Competetive: True
4:09:25.035114 WARNING: dropped 94 target PSMs due to missing features
4:09:25.035237 WARNING: dropped 89 decoy PSMs due to missing features
4:09:28.976165 INFO: Test AUC: 0.557
4:09:28.976283 INFO: Train AUC: 0.583
4:09:28.976342 INFO: AUC difference: 4.45%
4:09:29.110213 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
4:09:29.111753 PROGRESS: ============================= Precursor FDR =============================
4:09:29.111890 PROGRESS: Total precursors accumulated: 1,906
4:09:29.111971 PROGRESS: Target precursors: 1,739 (91.24%)
4:09:29.112043 PROGRESS: Decoy precursors: 167 (8.76%)
4:09:29.112109 PROGRESS: 
4:09:29.112171 PROGRESS: Precursor Summary:
4:09:29.114253 PROGRESS: Channel   0:	 0.05 FDR: 1,170; 0.01 FDR:   576; 0.001 FDR:   443
4:09:29.114380 PROGRESS: 
4:09:29.114457 PROGRESS: Protein Summary:
4:09:29.116988 PROGRESS: Channel   0:	 0.05 FDR: 1,101; 0.01 FDR:   542; 0.001 FDR:   413
4:09:29.117114 PROGRESS: =========================================================================
4:09:29.118361 PROGRESS: === Epoch 9, step 6, extracting elution groups 63000 to 127000 ===
4:09:29.295430 PROGRESS: Extracting batch of 126487 precursors
4:09:29.334993 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:09:29.335136 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:09:29.335192 INFO: FWHM in RT is 14.97 seconds, sigma is 0.54
4:09:29.335220 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:09:29.335484 INFO: Starting candidate selection
4:09:36.059635 INFO: Starting candidate scoring
4:09:38.607579 INFO: Finished candidate processing
4:09:38.607707 INFO: Collecting candidate features
4:09:41.131979 WARNING: intensity_correlation has 193 NaNs ( 0.16 % out of 118694)
4:09:41.144669 INFO: Collecting fragment features
4:09:41.911791 INFO: Finished candidate scoring
4:09:42.334830 PROGRESS: === Epoch 9, step 6, extracted 118694 precursors and 631064 fragments ===
4:09:42.335217 INFO: performing precursor FDR with 47 features
4:09:42.335265 INFO: Decoy channel: -1
4:09:42.335291 INFO: Competetive: True
4:09:42.606503 WARNING: dropped 188 target PSMs due to missing features
4:09:42.606619 WARNING: dropped 188 decoy PSMs due to missing features
4:09:51.505831 INFO: Test AUC: 0.551
4:09:51.505979 INFO: Train AUC: 0.578
4:09:51.506020 INFO: AUC difference: 4.63%
4:09:51.659189 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
4:09:51.661162 PROGRESS: ============================= Precursor FDR =============================
4:09:51.661298 PROGRESS: Total precursors accumulated: 3,194
4:09:51.661378 PROGRESS: Target precursors: 2,918 (91.36%)
4:09:51.661447 PROGRESS: Decoy precursors: 276 (8.64%)
4:09:51.661512 PROGRESS: 
4:09:51.661575 PROGRESS: Precursor Summary:
4:09:51.663972 PROGRESS: Channel   0:	 0.05 FDR: 1,984; 0.01 FDR: 1,147; 0.001 FDR:   615
4:09:51.664116 PROGRESS: 
4:09:51.664191 PROGRESS: Protein Summary:
4:09:51.667318 PROGRESS: Channel   0:	 0.05 FDR: 1,759; 0.01 FDR:   998; 0.001 FDR:   543
4:09:51.667460 PROGRESS: =========================================================================
4:09:51.668997 PROGRESS: === Epoch 9, step 7, extracting elution groups 127000 to 255000 ===
4:09:51.895866 PROGRESS: Extracting batch of 253050 precursors
4:09:51.969728 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:09:51.969857 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:09:51.969898 INFO: FWHM in RT is 14.97 seconds, sigma is 0.54
4:09:51.969942 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:09:51.970209 INFO: Starting candidate selection
4:10:01.287748 INFO: Starting candidate scoring
4:10:05.103456 INFO: Finished candidate processing
4:10:05.103642 INFO: Collecting candidate features
4:10:08.079561 WARNING: intensity_correlation has 378 NaNs ( 0.16 % out of 237419)
4:10:08.100090 INFO: Collecting fragment features
4:10:08.984509 INFO: Finished candidate scoring
4:10:09.566217 PROGRESS: === Epoch 9, step 7, extracted 237419 precursors and 1264137 fragments ===
4:10:09.566594 INFO: performing precursor FDR with 47 features
4:10:09.566643 INFO: Decoy channel: -1
4:10:09.566670 INFO: Competetive: True
4:10:10.157813 WARNING: dropped 374 target PSMs due to missing features
4:10:10.157957 WARNING: dropped 380 decoy PSMs due to missing features
4:10:27.407467 INFO: Test AUC: 0.553
4:10:27.407596 INFO: Train AUC: 0.571
4:10:27.407653 INFO: AUC difference: 3.14%
4:10:27.592053 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
4:10:27.594474 PROGRESS: ============================= Precursor FDR =============================
4:10:27.594616 PROGRESS: Total precursors accumulated: 4,767
4:10:27.594694 PROGRESS: Target precursors: 4,356 (91.38%)
4:10:27.594779 PROGRESS: Decoy precursors: 411 (8.62%)
4:10:27.594848 PROGRESS: 
4:10:27.594911 PROGRESS: Precursor Summary:
4:10:27.597919 PROGRESS: Channel   0:	 0.05 FDR: 3,311; 0.01 FDR: 2,119; 0.001 FDR: 1,519
4:10:27.598050 PROGRESS: 
4:10:27.598125 PROGRESS: Protein Summary:
4:10:27.602164 PROGRESS: Channel   0:	 0.05 FDR: 2,612; 0.01 FDR: 1,634; 0.001 FDR: 1,182
4:10:27.602285 PROGRESS: =========================================================================
4:10:27.605560 INFO: calibration group: precursor, fitting rt estimator 
4:10:27.873063 INFO: calibration group: fragment, fitting mz estimator 
4:10:28.462278 INFO: === checking if epoch conditions were reached ===
4:10:28.462488 INFO: ✅ ms2_error      : 7.0000 <= 7
4:10:28.462570 INFO: ❌ rt_error       : 204.0164 > 100
4:10:28.462635 INFO: ✅ current_epoch  : 9 >= 3
4:10:28.462692 INFO: ==============================================
4:10:28.680765 INFO: calibration group: precursor, predicting mz
4:10:28.681054 WARNING: mz prediction was skipped as it has not been fitted yet
4:10:28.681099 INFO: calibration group: precursor, predicting rt
4:10:35.373674 INFO: calibration group: fragment, predicting mz
4:10:53.048590 PROGRESS: === Epoch 10, step 0, extracting elution groups 0 to 1000 ===
4:10:53.136702 PROGRESS: Extracting batch of 1979 precursors
4:10:53.138478 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:10:53.138571 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:10:53.138613 INFO: FWHM in RT is 14.38 seconds, sigma is 0.52
4:10:53.138644 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:10:53.138879 INFO: Starting candidate selection
4:10:57.656123 INFO: Starting candidate scoring
4:10:58.962386 INFO: Finished candidate processing
4:10:58.962479 INFO: Collecting candidate features
4:11:01.151701 INFO: Collecting fragment features
4:11:01.795449 INFO: Finished candidate scoring
4:11:02.113086 PROGRESS: === Epoch 10, step 0, extracted 1880 precursors and 10206 fragments ===
4:11:02.113416 INFO: performing precursor FDR with 47 features
4:11:02.113459 INFO: Decoy channel: -1
4:11:02.113487 INFO: Competetive: True
4:11:02.145534 INFO: Test AUC: 0.549
4:11:02.145650 INFO: Train AUC: 0.575
4:11:02.145716 INFO: AUC difference: 4.43%
4:11:02.264638 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
4:11:02.265437 PROGRESS: ============================= Precursor FDR =============================
4:11:02.265582 PROGRESS: Total precursors accumulated: 13
4:11:02.265689 PROGRESS: Target precursors: 12 (92.31%)
4:11:02.265797 PROGRESS: Decoy precursors: 1 (7.69%)
4:11:02.265882 PROGRESS: 
4:11:02.265976 PROGRESS: Precursor Summary:
4:11:02.267438 PROGRESS: Channel   0:	 0.05 FDR:    11; 0.01 FDR:    11; 0.001 FDR:    11
4:11:02.267579 PROGRESS: 
4:11:02.267688 PROGRESS: Protein Summary:
4:11:02.269861 PROGRESS: Channel   0:	 0.05 FDR:    11; 0.01 FDR:    11; 0.001 FDR:    11
4:11:02.270001 PROGRESS: =========================================================================
4:11:02.270894 PROGRESS: === Epoch 10, step 1, extracting elution groups 1000 to 3000 ===
4:11:02.348402 PROGRESS: Extracting batch of 3955 precursors
4:11:02.350754 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:11:02.350835 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:11:02.350916 INFO: FWHM in RT is 14.38 seconds, sigma is 0.52
4:11:02.350981 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:11:02.351222 INFO: Starting candidate selection
4:11:06.499688 INFO: Starting candidate scoring
4:11:07.810189 INFO: Finished candidate processing
4:11:07.810302 INFO: Collecting candidate features
4:11:10.022033 WARNING: intensity_correlation has 3 NaNs ( 0.08 % out of 3708)
4:11:10.028321 INFO: Collecting fragment features
4:11:10.676803 INFO: Finished candidate scoring
4:11:10.959541 PROGRESS: === Epoch 10, step 1, extracted 3708 precursors and 19575 fragments ===
4:11:10.959832 INFO: performing precursor FDR with 47 features
4:11:10.959879 INFO: Decoy channel: -1
4:11:10.959906 INFO: Competetive: True
4:11:10.968678 WARNING: dropped 1 target PSMs due to missing features
4:11:10.968771 WARNING: dropped 2 decoy PSMs due to missing features
4:11:11.007275 INFO: Test AUC: 0.573
4:11:11.007399 INFO: Train AUC: 0.545
4:11:11.007445 INFO: AUC difference: 5.27%
4:11:11.007480 WARNING: AUC difference > 5%. This may indicate overfitting.
4:11:11.124128 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
4:11:11.124942 PROGRESS: ============================= Precursor FDR =============================
4:11:11.125069 PROGRESS: Total precursors accumulated: 31
4:11:11.125146 PROGRESS: Target precursors: 29 (93.55%)
4:11:11.125214 PROGRESS: Decoy precursors: 2 (6.45%)
4:11:11.125277 PROGRESS: 
4:11:11.125339 PROGRESS: Precursor Summary:
4:11:11.126776 PROGRESS: Channel   0:	 0.05 FDR:    29; 0.01 FDR:    14; 0.001 FDR:    14
4:11:11.126891 PROGRESS: 
4:11:11.126965 PROGRESS: Protein Summary:
4:11:11.128582 PROGRESS: Channel   0:	 0.05 FDR:    29; 0.01 FDR:    14; 0.001 FDR:    14
4:11:11.128707 PROGRESS: =========================================================================
4:11:11.129561 PROGRESS: === Epoch 10, step 2, extracting elution groups 3000 to 7000 ===
4:11:11.212014 PROGRESS: Extracting batch of 7910 precursors
4:11:11.215306 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:11:11.215368 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:11:11.215406 INFO: FWHM in RT is 14.38 seconds, sigma is 0.52
4:11:11.215450 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:11:11.215669 INFO: Starting candidate selection
4:11:15.420204 INFO: Starting candidate scoring
4:11:16.765961 INFO: Finished candidate processing
4:11:16.766054 INFO: Collecting candidate features
4:11:18.963901 WARNING: intensity_correlation has 9 NaNs ( 0.12 % out of 7460)
4:11:18.969638 INFO: Collecting fragment features
4:11:19.624999 INFO: Finished candidate scoring
4:11:19.913248 PROGRESS: === Epoch 10, step 2, extracted 7460 precursors and 39853 fragments ===
4:11:19.913603 INFO: performing precursor FDR with 47 features
4:11:19.913661 INFO: Decoy channel: -1
4:11:19.913710 INFO: Competetive: True
4:11:19.929107 WARNING: dropped 4 target PSMs due to missing features
4:11:19.929220 WARNING: dropped 8 decoy PSMs due to missing features
4:11:20.220943 INFO: Test AUC: 0.535
4:11:20.221075 INFO: Train AUC: 0.571
4:11:20.221122 INFO: AUC difference: 6.34%
4:11:20.221156 WARNING: AUC difference > 5%. This may indicate overfitting.
4:11:20.341171 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
4:11:20.342063 PROGRESS: ============================= Precursor FDR =============================
4:11:20.342190 PROGRESS: Total precursors accumulated: 143
4:11:20.342268 PROGRESS: Target precursors: 131 (91.61%)
4:11:20.342336 PROGRESS: Decoy precursors: 12 (8.39%)
4:11:20.342400 PROGRESS: 
4:11:20.342462 PROGRESS: Precursor Summary:
4:11:20.343964 PROGRESS: Channel   0:	 0.05 FDR:   111; 0.01 FDR:    42; 0.001 FDR:    42
4:11:20.344079 PROGRESS: 
4:11:20.344153 PROGRESS: Protein Summary:
4:11:20.345850 PROGRESS: Channel   0:	 0.05 FDR:   110; 0.01 FDR:    42; 0.001 FDR:    42
4:11:20.345963 PROGRESS: =========================================================================
4:11:20.346838 PROGRESS: === Epoch 10, step 3, extracting elution groups 7000 to 15000 ===
4:11:20.439736 PROGRESS: Extracting batch of 15806 precursors
4:11:20.445361 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:11:20.445434 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:11:20.445469 INFO: FWHM in RT is 14.38 seconds, sigma is 0.52
4:11:20.445511 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:11:20.445731 INFO: Starting candidate selection
4:11:24.825021 INFO: Starting candidate scoring
4:11:26.259794 INFO: Finished candidate processing
4:11:26.259887 INFO: Collecting candidate features
4:11:28.491133 WARNING: intensity_correlation has 18 NaNs ( 0.12 % out of 14884)
4:11:28.497319 INFO: Collecting fragment features
4:11:29.162441 INFO: Finished candidate scoring
4:11:29.460842 PROGRESS: === Epoch 10, step 3, extracted 14884 precursors and 79089 fragments ===
4:11:29.461206 INFO: performing precursor FDR with 47 features
4:11:29.461282 INFO: Decoy channel: -1
4:11:29.461311 INFO: Competetive: True
4:11:29.490854 WARNING: dropped 12 target PSMs due to missing features
4:11:29.490968 WARNING: dropped 18 decoy PSMs due to missing features
4:11:30.248030 INFO: Test AUC: 0.545
4:11:30.248190 INFO: Train AUC: 0.577
4:11:30.248260 INFO: AUC difference: 5.46%
4:11:30.248296 WARNING: AUC difference > 5%. This may indicate overfitting.
4:11:30.372310 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
4:11:30.373254 PROGRESS: ============================= Precursor FDR =============================
4:11:30.373378 PROGRESS: Total precursors accumulated: 267
4:11:30.373455 PROGRESS: Target precursors: 245 (91.76%)
4:11:30.373523 PROGRESS: Decoy precursors: 22 (8.24%)
4:11:30.373585 PROGRESS: 
4:11:30.373646 PROGRESS: Precursor Summary:
4:11:30.375215 PROGRESS: Channel   0:	 0.05 FDR:   188; 0.01 FDR:   152; 0.001 FDR:   116
4:11:30.375330 PROGRESS: 
4:11:30.375404 PROGRESS: Protein Summary:
4:11:30.377218 PROGRESS: Channel   0:	 0.05 FDR:   186; 0.01 FDR:   150; 0.001 FDR:   114
4:11:30.377330 PROGRESS: =========================================================================
4:11:30.378301 PROGRESS: === Epoch 10, step 4, extracting elution groups 15000 to 31000 ===
4:11:30.488873 PROGRESS: Extracting batch of 31609 precursors
4:11:30.499657 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:11:30.499765 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:11:30.499807 INFO: FWHM in RT is 14.38 seconds, sigma is 0.52
4:11:30.499835 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:11:30.500076 INFO: Starting candidate selection
4:11:35.203796 INFO: Starting candidate scoring
4:11:36.777521 INFO: Finished candidate processing
4:11:36.777702 INFO: Collecting candidate features
4:11:39.061539 WARNING: intensity_correlation has 26 NaNs ( 0.09 % out of 29877)
4:11:39.068930 INFO: Collecting fragment features
4:11:39.753943 INFO: Finished candidate scoring
4:11:40.069979 PROGRESS: === Epoch 10, step 4, extracted 29877 precursors and 158749 fragments ===
4:11:40.070343 INFO: performing precursor FDR with 47 features
4:11:40.070407 INFO: Decoy channel: -1
4:11:40.070453 INFO: Competetive: True
4:11:40.130826 WARNING: dropped 25 target PSMs due to missing features
4:11:40.130938 WARNING: dropped 31 decoy PSMs due to missing features
4:11:41.850941 INFO: Test AUC: 0.551
4:11:41.851084 INFO: Train AUC: 0.584
4:11:41.851130 INFO: AUC difference: 5.80%
4:11:41.851165 WARNING: AUC difference > 5%. This may indicate overfitting.
4:11:41.976422 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
4:11:41.977645 PROGRESS: ============================= Precursor FDR =============================
4:11:41.977779 PROGRESS: Total precursors accumulated: 1,044
4:11:41.977861 PROGRESS: Target precursors: 954 (91.38%)
4:11:41.977929 PROGRESS: Decoy precursors: 90 (8.62%)
4:11:41.977992 PROGRESS: 
4:11:41.978054 PROGRESS: Precursor Summary:
4:11:41.979804 PROGRESS: Channel   0:	 0.05 FDR:   621; 0.01 FDR:   274; 0.001 FDR:   185
4:11:41.979921 PROGRESS: 
4:11:41.979995 PROGRESS: Protein Summary:
4:11:41.982097 PROGRESS: Channel   0:	 0.05 FDR:   609; 0.01 FDR:   268; 0.001 FDR:   182
4:11:41.982208 PROGRESS: =========================================================================
4:11:41.983232 PROGRESS: === Epoch 10, step 5, extracting elution groups 31000 to 63000 ===
4:11:42.120622 PROGRESS: Extracting batch of 63278 precursors
4:11:42.141200 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:11:42.141312 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:11:42.141352 INFO: FWHM in RT is 14.38 seconds, sigma is 0.52
4:11:42.141379 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:11:42.141632 INFO: Starting candidate selection
4:11:47.533014 INFO: Starting candidate scoring
4:11:49.436372 INFO: Finished candidate processing
4:11:49.436478 INFO: Collecting candidate features
4:11:51.778826 WARNING: intensity_correlation has 58 NaNs ( 0.10 % out of 59755)
4:11:51.787808 INFO: Collecting fragment features
4:11:52.498029 INFO: Finished candidate scoring
4:11:52.847180 PROGRESS: === Epoch 10, step 5, extracted 59755 precursors and 318311 fragments ===
4:11:52.847561 INFO: performing precursor FDR with 47 features
4:11:52.847611 INFO: Decoy channel: -1
4:11:52.847640 INFO: Competetive: True
4:11:52.981161 WARNING: dropped 51 target PSMs due to missing features
4:11:52.981275 WARNING: dropped 63 decoy PSMs due to missing features
4:11:57.315547 INFO: Test AUC: 0.550
4:11:57.315667 INFO: Train AUC: 0.582
4:11:57.315723 INFO: AUC difference: 5.50%
4:11:57.315752 WARNING: AUC difference > 5%. This may indicate overfitting.
4:11:57.459945 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
4:11:57.461492 PROGRESS: ============================= Precursor FDR =============================
4:11:57.461648 PROGRESS: Total precursors accumulated: 1,963
4:11:57.461728 PROGRESS: Target precursors: 1,789 (91.14%)
4:11:57.461805 PROGRESS: Decoy precursors: 174 (8.86%)
4:11:57.461870 PROGRESS: 
4:11:57.461931 PROGRESS: Precursor Summary:
4:11:57.463925 PROGRESS: Channel   0:	 0.05 FDR: 1,170; 0.01 FDR:   563; 0.001 FDR:   331
4:11:57.464062 PROGRESS: 
4:11:57.464138 PROGRESS: Protein Summary:
4:11:57.466625 PROGRESS: Channel   0:	 0.05 FDR: 1,087; 0.01 FDR:   513; 0.001 FDR:   305
4:11:57.466740 PROGRESS: =========================================================================
4:11:57.467961 PROGRESS: === Epoch 10, step 6, extracting elution groups 63000 to 127000 ===
4:11:57.643531 PROGRESS: Extracting batch of 126475 precursors
4:11:57.683201 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:11:57.683330 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:11:57.683372 INFO: FWHM in RT is 14.38 seconds, sigma is 0.52
4:11:57.683398 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:11:57.683661 INFO: Starting candidate selection
4:12:04.371426 INFO: Starting candidate scoring
4:12:06.907584 INFO: Finished candidate processing
4:12:06.907765 INFO: Collecting candidate features
4:12:09.439191 WARNING: intensity_correlation has 121 NaNs ( 0.10 % out of 119724)
4:12:09.452500 INFO: Collecting fragment features
4:12:10.219999 INFO: Finished candidate scoring
4:12:10.642477 PROGRESS: === Epoch 10, step 6, extracted 119724 precursors and 638555 fragments ===
4:12:10.642816 INFO: performing precursor FDR with 47 features
4:12:10.642863 INFO: Decoy channel: -1
4:12:10.642889 INFO: Competetive: True
4:12:10.914968 WARNING: dropped 113 target PSMs due to missing features
4:12:10.915078 WARNING: dropped 122 decoy PSMs due to missing features
4:12:19.180715 INFO: Test AUC: 0.557
4:12:19.180841 INFO: Train AUC: 0.578
4:12:19.180898 INFO: AUC difference: 3.70%
4:12:19.330564 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
4:12:19.332561 PROGRESS: ============================= Precursor FDR =============================
4:12:19.332712 PROGRESS: Total precursors accumulated: 3,470
4:12:19.332789 PROGRESS: Target precursors: 3,171 (91.38%)
4:12:19.332856 PROGRESS: Decoy precursors: 299 (8.62%)
4:12:19.332920 PROGRESS: 
4:12:19.332984 PROGRESS: Precursor Summary:
4:12:19.335434 PROGRESS: Channel   0:	 0.05 FDR: 2,162; 0.01 FDR: 1,153; 0.001 FDR:   785
4:12:19.335575 PROGRESS: 
4:12:19.335649 PROGRESS: Protein Summary:
4:12:19.338843 PROGRESS: Channel   0:	 0.05 FDR: 1,882; 0.01 FDR:   980; 0.001 FDR:   671
4:12:19.338956 PROGRESS: =========================================================================
4:12:19.340462 PROGRESS: === Epoch 10, step 7, extracting elution groups 127000 to 255000 ===
4:12:19.567267 PROGRESS: Extracting batch of 252897 precursors
4:12:19.640226 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:12:19.640339 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:12:19.640376 INFO: FWHM in RT is 14.38 seconds, sigma is 0.52
4:12:19.640419 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:12:19.640680 INFO: Starting candidate selection
4:12:28.950931 INFO: Starting candidate scoring
4:12:32.792552 INFO: Finished candidate processing
4:12:32.792735 INFO: Collecting candidate features
4:12:35.764890 WARNING: intensity_correlation has 218 NaNs ( 0.09 % out of 239015)
4:12:35.785788 INFO: Collecting fragment features
4:12:36.659210 INFO: Finished candidate scoring
4:12:37.241002 PROGRESS: === Epoch 10, step 7, extracted 239015 precursors and 1274114 fragments ===
4:12:37.241383 INFO: performing precursor FDR with 47 features
4:12:37.241428 INFO: Decoy channel: -1
4:12:37.241456 INFO: Competetive: True
4:12:37.835061 WARNING: dropped 222 target PSMs due to missing features
4:12:37.835181 WARNING: dropped 231 decoy PSMs due to missing features
4:12:55.930000 INFO: Test AUC: 0.554
4:12:55.930151 INFO: Train AUC: 0.573
4:12:55.930192 INFO: AUC difference: 3.25%
4:12:56.117491 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
4:12:56.120070 PROGRESS: ============================= Precursor FDR =============================
4:12:56.120215 PROGRESS: Total precursors accumulated: 5,285
4:12:56.120293 PROGRESS: Target precursors: 4,826 (91.32%)
4:12:56.120360 PROGRESS: Decoy precursors: 459 (8.68%)
4:12:56.120440 PROGRESS: 
4:12:56.120502 PROGRESS: Precursor Summary:
4:12:56.123611 PROGRESS: Channel   0:	 0.05 FDR: 3,679; 0.01 FDR: 2,358; 0.001 FDR: 1,475
4:12:56.123756 PROGRESS: 
4:12:56.123827 PROGRESS: Protein Summary:
4:12:56.128216 PROGRESS: Channel   0:	 0.05 FDR: 2,913; 0.01 FDR: 1,816; 0.001 FDR: 1,167
4:12:56.128336 PROGRESS: =========================================================================
4:12:56.131942 INFO: calibration group: precursor, fitting rt estimator 
4:12:56.415531 INFO: calibration group: fragment, fitting mz estimator 
4:12:57.003853 INFO: === checking if epoch conditions were reached ===
4:12:57.004055 INFO: ✅ ms2_error      : 7.0000 <= 7
4:12:57.004155 INFO: ❌ rt_error       : 203.3457 > 100
4:12:57.004244 INFO: ✅ current_epoch  : 10 >= 3
4:12:57.004336 INFO: ==============================================
4:12:57.229282 INFO: calibration group: precursor, predicting mz
4:12:57.229569 WARNING: mz prediction was skipped as it has not been fitted yet
4:12:57.229612 INFO: calibration group: precursor, predicting rt
4:13:04.018620 INFO: calibration group: fragment, predicting mz
4:13:21.998441 PROGRESS: === Epoch 11, step 0, extracting elution groups 0 to 1000 ===
4:13:22.086147 PROGRESS: Extracting batch of 1978 precursors
4:13:22.087894 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:13:22.087974 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:13:22.088030 INFO: FWHM in RT is 14.51 seconds, sigma is 0.53
4:13:22.088059 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:13:22.088306 INFO: Starting candidate selection
4:13:26.648953 INFO: Starting candidate scoring
4:13:27.960352 INFO: Finished candidate processing
4:13:27.960440 INFO: Collecting candidate features
4:13:30.147018 WARNING: intensity_correlation has 1 NaNs ( 0.05 % out of 1869)
4:13:30.153111 INFO: Collecting fragment features
4:13:30.799875 INFO: Finished candidate scoring
4:13:31.117174 PROGRESS: === Epoch 11, step 0, extracted 1869 precursors and 10043 fragments ===
4:13:31.117508 INFO: performing precursor FDR with 47 features
4:13:31.117549 INFO: Decoy channel: -1
4:13:31.117576 INFO: Competetive: True
4:13:31.122151 WARNING: dropped 1 decoy PSMs due to missing features
4:13:31.151616 INFO: Test AUC: 0.608
4:13:31.151711 INFO: Train AUC: 0.549
4:13:31.151757 INFO: AUC difference: 10.70%
4:13:31.151790 WARNING: AUC difference > 5%. This may indicate overfitting.
4:13:31.272385 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
4:13:31.273155 PROGRESS: ============================= Precursor FDR =============================
4:13:31.273277 PROGRESS: Total precursors accumulated: 14
4:13:31.273355 PROGRESS: Target precursors: 13 (92.86%)
4:13:31.273422 PROGRESS: Decoy precursors: 1 (7.14%)
4:13:31.273485 PROGRESS: 
4:13:31.273545 PROGRESS: Precursor Summary:
4:13:31.274971 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
4:13:31.275098 PROGRESS: 
4:13:31.275174 PROGRESS: Protein Summary:
4:13:31.276763 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
4:13:31.276877 PROGRESS: =========================================================================
4:13:31.277726 PROGRESS: === Epoch 11, step 1, extracting elution groups 1000 to 3000 ===
4:13:31.355753 PROGRESS: Extracting batch of 3955 precursors
4:13:31.358021 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:13:31.358100 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:13:31.358142 INFO: FWHM in RT is 14.51 seconds, sigma is 0.53
4:13:31.358174 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:13:31.358399 INFO: Starting candidate selection
4:13:35.524384 INFO: Starting candidate scoring
4:13:36.836774 INFO: Finished candidate processing
4:13:36.836864 INFO: Collecting candidate features
4:13:39.027610 WARNING: intensity_correlation has 5 NaNs ( 0.13 % out of 3766)
4:13:39.033649 INFO: Collecting fragment features
4:13:39.682506 INFO: Finished candidate scoring
4:13:39.965937 PROGRESS: === Epoch 11, step 1, extracted 3766 precursors and 20118 fragments ===
4:13:39.966222 INFO: performing precursor FDR with 47 features
4:13:39.966269 INFO: Decoy channel: -1
4:13:39.966295 INFO: Competetive: True
4:13:39.975142 WARNING: dropped 3 target PSMs due to missing features
4:13:39.975230 WARNING: dropped 3 decoy PSMs due to missing features
4:13:40.012981 INFO: Test AUC: 0.558
4:13:40.013102 INFO: Train AUC: 0.551
4:13:40.013146 INFO: AUC difference: 1.17%
4:13:40.134414 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
4:13:40.135198 PROGRESS: ============================= Precursor FDR =============================
4:13:40.135324 PROGRESS: Total precursors accumulated: 12
4:13:40.135403 PROGRESS: Target precursors: 11 (91.67%)
4:13:40.135473 PROGRESS: Decoy precursors: 1 (8.33%)
4:13:40.135549 PROGRESS: 
4:13:40.135611 PROGRESS: Precursor Summary:
4:13:40.137020 PROGRESS: Channel   0:	 0.05 FDR:     6; 0.01 FDR:     6; 0.001 FDR:     6
4:13:40.137137 PROGRESS: 
4:13:40.137210 PROGRESS: Protein Summary:
4:13:40.138819 PROGRESS: Channel   0:	 0.05 FDR:     6; 0.01 FDR:     6; 0.001 FDR:     6
4:13:40.138943 PROGRESS: =========================================================================
4:13:40.139808 PROGRESS: === Epoch 11, step 2, extracting elution groups 3000 to 7000 ===
4:13:40.222079 PROGRESS: Extracting batch of 7917 precursors
4:13:40.225438 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:13:40.225503 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:13:40.225541 INFO: FWHM in RT is 14.51 seconds, sigma is 0.53
4:13:40.225586 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:13:40.225836 INFO: Starting candidate selection
4:13:44.513047 INFO: Starting candidate scoring
4:13:45.880730 INFO: Finished candidate processing
4:13:45.880825 INFO: Collecting candidate features
4:13:48.057248 WARNING: intensity_correlation has 4 NaNs ( 0.05 % out of 7517)
4:13:48.063654 INFO: Collecting fragment features
4:13:48.710147 INFO: Finished candidate scoring
4:13:48.996525 PROGRESS: === Epoch 11, step 2, extracted 7517 precursors and 40226 fragments ===
4:13:48.996833 INFO: performing precursor FDR with 47 features
4:13:48.996876 INFO: Decoy channel: -1
4:13:48.996901 INFO: Competetive: True
4:13:49.012224 WARNING: dropped 6 target PSMs due to missing features
4:13:49.012340 WARNING: dropped 4 decoy PSMs due to missing features
4:13:49.317984 INFO: Test AUC: 0.538
4:13:49.318114 INFO: Train AUC: 0.569
4:13:49.318157 INFO: AUC difference: 5.54%
4:13:49.318192 WARNING: AUC difference > 5%. This may indicate overfitting.
4:13:49.438026 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
4:13:49.438873 PROGRESS: ============================= Precursor FDR =============================
4:13:49.438993 PROGRESS: Total precursors accumulated: 94
4:13:49.439072 PROGRESS: Target precursors: 86 (91.49%)
4:13:49.439140 PROGRESS: Decoy precursors: 8 (8.51%)
4:13:49.439203 PROGRESS: 
4:13:49.439263 PROGRESS: Precursor Summary:
4:13:49.440718 PROGRESS: Channel   0:	 0.05 FDR:    46; 0.01 FDR:    27; 0.001 FDR:    27
4:13:49.440831 PROGRESS: 
4:13:49.440905 PROGRESS: Protein Summary:
4:13:49.442553 PROGRESS: Channel   0:	 0.05 FDR:    45; 0.01 FDR:    26; 0.001 FDR:    26
4:13:49.442667 PROGRESS: =========================================================================
4:13:49.443532 PROGRESS: === Epoch 11, step 3, extracting elution groups 7000 to 15000 ===
4:13:49.535388 PROGRESS: Extracting batch of 15798 precursors
4:13:49.541014 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:13:49.541083 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:13:49.541117 INFO: FWHM in RT is 14.51 seconds, sigma is 0.53
4:13:49.541162 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:13:49.541387 INFO: Starting candidate selection
4:13:53.952284 INFO: Starting candidate scoring
4:13:55.376100 INFO: Finished candidate processing
4:13:55.376196 INFO: Collecting candidate features
4:13:57.607869 WARNING: intensity_correlation has 16 NaNs ( 0.11 % out of 15026)
4:13:57.613946 INFO: Collecting fragment features
4:13:58.280215 INFO: Finished candidate scoring
4:13:58.576854 PROGRESS: === Epoch 11, step 3, extracted 15026 precursors and 81073 fragments ===
4:13:58.577213 INFO: performing precursor FDR with 47 features
4:13:58.577262 INFO: Decoy channel: -1
4:13:58.577287 INFO: Competetive: True
4:13:58.606865 WARNING: dropped 12 target PSMs due to missing features
4:13:58.606989 WARNING: dropped 14 decoy PSMs due to missing features
4:13:59.375411 INFO: Test AUC: 0.542
4:13:59.376445 INFO: Train AUC: 0.585
4:13:59.376619 INFO: AUC difference: 7.33%
4:13:59.376739 WARNING: AUC difference > 5%. This may indicate overfitting.
4:13:59.499664 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
4:13:59.500586 PROGRESS: ============================= Precursor FDR =============================
4:13:59.500710 PROGRESS: Total precursors accumulated: 267
4:13:59.500796 PROGRESS: Target precursors: 244 (91.39%)
4:13:59.500866 PROGRESS: Decoy precursors: 23 (8.61%)
4:13:59.500930 PROGRESS: 
4:13:59.500992 PROGRESS: Precursor Summary:
4:13:59.502529 PROGRESS: Channel   0:	 0.05 FDR:   162; 0.01 FDR:   102; 0.001 FDR:    58
4:13:59.502645 PROGRESS: 
4:13:59.502719 PROGRESS: Protein Summary:
4:13:59.504465 PROGRESS: Channel   0:	 0.05 FDR:   159; 0.01 FDR:   100; 0.001 FDR:    57
4:13:59.504576 PROGRESS: =========================================================================
4:13:59.505488 PROGRESS: === Epoch 11, step 4, extracting elution groups 15000 to 31000 ===
4:13:59.613158 PROGRESS: Extracting batch of 31652 precursors
4:13:59.623819 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:13:59.623929 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:13:59.623968 INFO: FWHM in RT is 14.51 seconds, sigma is 0.53
4:13:59.623996 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:13:59.624238 INFO: Starting candidate selection
4:14:04.392916 INFO: Starting candidate scoring
4:14:06.009890 INFO: Finished candidate processing
4:14:06.010084 INFO: Collecting candidate features
4:14:08.274825 WARNING: intensity_correlation has 37 NaNs ( 0.12 % out of 30038)
4:14:08.282765 INFO: Collecting fragment features
4:14:08.962307 INFO: Finished candidate scoring
4:14:09.275301 PROGRESS: === Epoch 11, step 4, extracted 30038 precursors and 159842 fragments ===
4:14:09.275654 INFO: performing precursor FDR with 47 features
4:14:09.275703 INFO: Decoy channel: -1
4:14:09.275729 INFO: Competetive: True
4:14:09.335401 WARNING: dropped 30 target PSMs due to missing features
4:14:09.335510 WARNING: dropped 33 decoy PSMs due to missing features
4:14:11.179792 INFO: Test AUC: 0.546
4:14:11.179942 INFO: Train AUC: 0.590
4:14:11.179990 INFO: AUC difference: 7.38%
4:14:11.180025 WARNING: AUC difference > 5%. This may indicate overfitting.
4:14:11.308406 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
4:14:11.309584 PROGRESS: ============================= Precursor FDR =============================
4:14:11.309709 PROGRESS: Total precursors accumulated: 912
4:14:11.309797 PROGRESS: Target precursors: 832 (91.23%)
4:14:11.309867 PROGRESS: Decoy precursors: 80 (8.77%)
4:14:11.309930 PROGRESS: 
4:14:11.309992 PROGRESS: Precursor Summary:
4:14:11.311714 PROGRESS: Channel   0:	 0.05 FDR:   547; 0.01 FDR:   252; 0.001 FDR:   195
4:14:11.311830 PROGRESS: 
4:14:11.311915 PROGRESS: Protein Summary:
4:14:11.313950 PROGRESS: Channel   0:	 0.05 FDR:   528; 0.01 FDR:   246; 0.001 FDR:   190
4:14:11.314062 PROGRESS: =========================================================================
4:14:11.315071 PROGRESS: === Epoch 11, step 5, extracting elution groups 31000 to 63000 ===
4:14:11.452022 PROGRESS: Extracting batch of 63205 precursors
4:14:11.472135 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:14:11.472245 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:14:11.472285 INFO: FWHM in RT is 14.51 seconds, sigma is 0.53
4:14:11.472327 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:14:11.472577 INFO: Starting candidate selection
4:14:16.907438 INFO: Starting candidate scoring
4:14:18.817360 INFO: Finished candidate processing
4:14:18.817456 INFO: Collecting candidate features
4:14:21.174136 WARNING: intensity_correlation has 70 NaNs ( 0.12 % out of 59952)
4:14:21.183074 INFO: Collecting fragment features
4:14:21.894441 INFO: Finished candidate scoring
4:14:22.243172 PROGRESS: === Epoch 11, step 5, extracted 59952 precursors and 320823 fragments ===
4:14:22.243538 INFO: performing precursor FDR with 47 features
4:14:22.243587 INFO: Decoy channel: -1
4:14:22.243613 INFO: Competetive: True
4:14:22.377317 WARNING: dropped 63 target PSMs due to missing features
4:14:22.377434 WARNING: dropped 70 decoy PSMs due to missing features
4:14:26.186760 INFO: Test AUC: 0.550
4:14:26.186897 INFO: Train AUC: 0.586
4:14:26.186933 INFO: AUC difference: 6.27%
4:14:26.186960 WARNING: AUC difference > 5%. This may indicate overfitting.
4:14:26.334031 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
4:14:26.335501 PROGRESS: ============================= Precursor FDR =============================
4:14:26.335663 PROGRESS: Total precursors accumulated: 1,724
4:14:26.335741 PROGRESS: Target precursors: 1,568 (90.95%)
4:14:26.335809 PROGRESS: Decoy precursors: 156 (9.05%)
4:14:26.335881 PROGRESS: 
4:14:26.335963 PROGRESS: Precursor Summary:
4:14:26.337954 PROGRESS: Channel   0:	 0.05 FDR: 1,034; 0.01 FDR:   423; 0.001 FDR:   364
4:14:26.338079 PROGRESS: 
4:14:26.338175 PROGRESS: Protein Summary:
4:14:26.341351 PROGRESS: Channel   0:	 0.05 FDR:   963; 0.01 FDR:   400; 0.001 FDR:   347
4:14:26.341481 PROGRESS: =========================================================================
4:14:26.342674 PROGRESS: === Epoch 11, step 6, extracting elution groups 63000 to 127000 ===
4:14:26.519102 PROGRESS: Extracting batch of 126509 precursors
4:14:26.557927 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:14:26.558041 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:14:26.558081 INFO: FWHM in RT is 14.51 seconds, sigma is 0.53
4:14:26.558109 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:14:26.558374 INFO: Starting candidate selection
4:14:33.305967 INFO: Starting candidate scoring
4:14:35.829376 INFO: Finished candidate processing
4:14:35.829505 INFO: Collecting candidate features
4:14:38.367460 WARNING: intensity_correlation has 130 NaNs ( 0.11 % out of 120095)
4:14:38.380218 INFO: Collecting fragment features
4:14:39.146274 INFO: Finished candidate scoring
4:14:39.572371 PROGRESS: === Epoch 11, step 6, extracted 120095 precursors and 642317 fragments ===
4:14:39.572718 INFO: performing precursor FDR with 47 features
4:14:39.572765 INFO: Decoy channel: -1
4:14:39.572791 INFO: Competetive: True
4:14:39.847586 WARNING: dropped 134 target PSMs due to missing features
4:14:39.847702 WARNING: dropped 129 decoy PSMs due to missing features
4:14:48.666487 INFO: Test AUC: 0.548
4:14:48.666628 INFO: Train AUC: 0.581
4:14:48.666670 INFO: AUC difference: 5.60%
4:14:48.666698 WARNING: AUC difference > 5%. This may indicate overfitting.
4:14:48.822499 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
4:14:48.824307 PROGRESS: ============================= Precursor FDR =============================
4:14:48.824452 PROGRESS: Total precursors accumulated: 2,925
4:14:48.824529 PROGRESS: Target precursors: 2,669 (91.25%)
4:14:48.824596 PROGRESS: Decoy precursors: 256 (8.75%)
4:14:48.824658 PROGRESS: 
4:14:48.824719 PROGRESS: Precursor Summary:
4:14:48.827071 PROGRESS: Channel   0:	 0.05 FDR: 1,925; 0.01 FDR: 1,184; 0.001 FDR:   649
4:14:48.827208 PROGRESS: 
4:14:48.827282 PROGRESS: Protein Summary:
4:14:48.830326 PROGRESS: Channel   0:	 0.05 FDR: 1,711; 0.01 FDR: 1,040; 0.001 FDR:   583
4:14:48.830438 PROGRESS: =========================================================================
4:14:48.831973 PROGRESS: === Epoch 11, step 7, extracting elution groups 127000 to 255000 ===
4:14:49.055220 PROGRESS: Extracting batch of 252906 precursors
4:14:49.127635 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:14:49.127773 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:14:49.127816 INFO: FWHM in RT is 14.51 seconds, sigma is 0.53
4:14:49.127843 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:14:49.128113 INFO: Starting candidate selection
4:14:58.456668 INFO: Starting candidate scoring
4:15:02.297543 INFO: Finished candidate processing
4:15:02.297729 INFO: Collecting candidate features
4:15:05.236078 WARNING: intensity_correlation has 276 NaNs ( 0.11 % out of 240167)
4:15:05.256856 INFO: Collecting fragment features
4:15:06.130084 INFO: Finished candidate scoring
4:15:06.711000 PROGRESS: === Epoch 11, step 7, extracted 240167 precursors and 1283616 fragments ===
4:15:06.711365 INFO: performing precursor FDR with 47 features
4:15:06.711412 INFO: Decoy channel: -1
4:15:06.711437 INFO: Competetive: True
4:15:07.308728 WARNING: dropped 258 target PSMs due to missing features
4:15:07.308849 WARNING: dropped 281 decoy PSMs due to missing features
4:15:24.425339 INFO: Test AUC: 0.553
4:15:24.425474 INFO: Train AUC: 0.572
4:15:24.425531 INFO: AUC difference: 3.30%
4:15:24.609651 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
4:15:24.611946 PROGRESS: ============================= Precursor FDR =============================
4:15:24.612099 PROGRESS: Total precursors accumulated: 4,619
4:15:24.612180 PROGRESS: Target precursors: 4,209 (91.12%)
4:15:24.612270 PROGRESS: Decoy precursors: 410 (8.88%)
4:15:24.612337 PROGRESS: 
4:15:24.612413 PROGRESS: Precursor Summary:
4:15:24.615380 PROGRESS: Channel   0:	 0.05 FDR: 3,296; 0.01 FDR: 2,016; 0.001 FDR: 1,518
4:15:24.615518 PROGRESS: 
4:15:24.615590 PROGRESS: Protein Summary:
4:15:24.619608 PROGRESS: Channel   0:	 0.05 FDR: 2,642; 0.01 FDR: 1,591; 0.001 FDR: 1,224
4:15:24.619718 PROGRESS: =========================================================================
4:15:24.621692 PROGRESS: === Epoch 11, step 8, extracting elution groups 255000 to 511000 ===
4:15:24.925062 PROGRESS: Extracting batch of 505793 precursors
4:15:25.057465 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:15:25.057581 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:15:25.057619 INFO: FWHM in RT is 14.51 seconds, sigma is 0.53
4:15:25.057661 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:15:25.057953 INFO: Starting candidate selection
4:15:39.561683 INFO: Starting candidate scoring
4:15:45.986826 INFO: Finished candidate processing
4:15:45.987021 INFO: Collecting candidate features
4:15:49.689167 WARNING: intensity_correlation has 519 NaNs ( 0.11 % out of 480520)
4:15:49.723929 INFO: Collecting fragment features
4:15:50.811723 INFO: Finished candidate scoring
4:15:51.721647 PROGRESS: === Epoch 11, step 8, extracted 480520 precursors and 2566104 fragments ===
4:15:51.722049 INFO: performing precursor FDR with 47 features
4:15:51.722098 INFO: Decoy channel: -1
4:15:51.722126 INFO: Competetive: True
4:15:52.878656 WARNING: dropped 513 target PSMs due to missing features
4:15:52.878784 WARNING: dropped 545 decoy PSMs due to missing features
4:16:28.388807 INFO: Test AUC: 0.553
4:16:28.388931 INFO: Train AUC: 0.567
4:16:28.388982 INFO: AUC difference: 2.62%
4:16:28.627287 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
4:16:28.630481 PROGRESS: ============================= Precursor FDR =============================
4:16:28.630644 PROGRESS: Total precursors accumulated: 8,254
4:16:28.630723 PROGRESS: Target precursors: 7,533 (91.26%)
4:16:28.630791 PROGRESS: Decoy precursors: 721 (8.74%)
4:16:28.630855 PROGRESS: 
4:16:28.630915 PROGRESS: Precursor Summary:
4:16:28.635227 PROGRESS: Channel   0:	 0.05 FDR: 6,255; 0.01 FDR: 4,611; 0.001 FDR: 3,549
4:16:28.635390 PROGRESS: 
4:16:28.635475 PROGRESS: Protein Summary:
4:16:28.641839 PROGRESS: Channel   0:	 0.05 FDR: 4,229; 0.01 FDR: 3,029; 0.001 FDR: 2,357
4:16:28.641982 PROGRESS: =========================================================================
4:16:28.647157 INFO: calibration group: precursor, fitting rt estimator 
4:16:29.233021 INFO: calibration group: fragment, fitting mz estimator 
4:16:29.824217 INFO: === checking if epoch conditions were reached ===
4:16:29.824423 INFO: ✅ ms2_error      : 7.0000 <= 7
4:16:29.824500 INFO: ❌ rt_error       : 197.2773 > 100
4:16:29.824563 INFO: ✅ current_epoch  : 11 >= 3
4:16:29.824619 INFO: ==============================================
4:16:30.042413 INFO: calibration group: precursor, predicting mz
4:16:30.042697 WARNING: mz prediction was skipped as it has not been fitted yet
4:16:30.042745 INFO: calibration group: precursor, predicting rt
4:16:36.760405 INFO: calibration group: fragment, predicting mz
4:16:54.323286 PROGRESS: === Epoch 12, step 0, extracting elution groups 0 to 1000 ===
4:16:54.422373 PROGRESS: Extracting batch of 1976 precursors
4:16:54.424106 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:16:54.424182 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:16:54.424219 INFO: FWHM in RT is 14.39 seconds, sigma is 0.52
4:16:54.424265 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:16:54.424494 INFO: Starting candidate selection
4:16:58.938169 INFO: Starting candidate scoring
4:17:00.224615 INFO: Finished candidate processing
4:17:00.224732 INFO: Collecting candidate features
4:17:02.387428 INFO: Collecting fragment features
4:17:03.022404 INFO: Finished candidate scoring
4:17:03.367500 PROGRESS: === Epoch 12, step 0, extracted 1865 precursors and 9910 fragments ===
4:17:03.367826 INFO: performing precursor FDR with 47 features
4:17:03.367869 INFO: Decoy channel: -1
4:17:03.367895 INFO: Competetive: True
4:17:03.400239 INFO: Test AUC: 0.548
4:17:03.400346 INFO: Train AUC: 0.546
4:17:03.400390 INFO: AUC difference: 0.38%
4:17:03.519115 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
4:17:03.519911 PROGRESS: ============================= Precursor FDR =============================
4:17:03.520034 PROGRESS: Total precursors accumulated: 6
4:17:03.520112 PROGRESS: Target precursors: 6 (100.00%)
4:17:03.520194 PROGRESS: Decoy precursors: 0 (0.00%)
4:17:03.520259 PROGRESS: 
4:17:03.520320 PROGRESS: Precursor Summary:
4:17:03.521843 PROGRESS: Channel   0:	 0.05 FDR:     6; 0.01 FDR:     6; 0.001 FDR:     6
4:17:03.521952 PROGRESS: 
4:17:03.522027 PROGRESS: Protein Summary:
4:17:03.523700 PROGRESS: Channel   0:	 0.05 FDR:     6; 0.01 FDR:     6; 0.001 FDR:     6
4:17:03.523811 PROGRESS: =========================================================================
4:17:03.524691 PROGRESS: === Epoch 12, step 1, extracting elution groups 1000 to 3000 ===
4:17:03.601724 PROGRESS: Extracting batch of 3962 precursors
4:17:03.603856 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:17:03.603915 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:17:03.603953 INFO: FWHM in RT is 14.39 seconds, sigma is 0.52
4:17:03.603999 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:17:03.604213 INFO: Starting candidate selection
4:17:07.789246 INFO: Starting candidate scoring
4:17:09.114124 INFO: Finished candidate processing
4:17:09.114305 INFO: Collecting candidate features
4:17:11.282245 WARNING: intensity_correlation has 3 NaNs ( 0.08 % out of 3756)
4:17:11.288338 INFO: Collecting fragment features
4:17:11.930666 INFO: Finished candidate scoring
4:17:12.211098 PROGRESS: === Epoch 12, step 1, extracted 3756 precursors and 19970 fragments ===
4:17:12.211384 INFO: performing precursor FDR with 47 features
4:17:12.211430 INFO: Decoy channel: -1
4:17:12.211457 INFO: Competetive: True
4:17:12.219889 WARNING: dropped 1 target PSMs due to missing features
4:17:12.219978 WARNING: dropped 2 decoy PSMs due to missing features
4:17:12.257043 INFO: Test AUC: 0.535
4:17:12.257158 INFO: Train AUC: 0.547
4:17:12.257201 INFO: AUC difference: 2.14%
4:17:12.379556 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
4:17:12.380367 PROGRESS: ============================= Precursor FDR =============================
4:17:12.380487 PROGRESS: Total precursors accumulated: 30
4:17:12.380564 PROGRESS: Target precursors: 28 (93.33%)
4:17:12.380632 PROGRESS: Decoy precursors: 2 (6.67%)
4:17:12.380695 PROGRESS: 
4:17:12.380757 PROGRESS: Precursor Summary:
4:17:12.382194 PROGRESS: Channel   0:	 0.05 FDR:    28; 0.01 FDR:    26; 0.001 FDR:    26
4:17:12.382309 PROGRESS: 
4:17:12.382382 PROGRESS: Protein Summary:
4:17:12.384012 PROGRESS: Channel   0:	 0.05 FDR:    28; 0.01 FDR:    26; 0.001 FDR:    26
4:17:12.384122 PROGRESS: =========================================================================
4:17:12.384981 PROGRESS: === Epoch 12, step 2, extracting elution groups 3000 to 7000 ===
4:17:12.466918 PROGRESS: Extracting batch of 7896 precursors
4:17:12.470260 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:17:12.470347 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:17:12.470391 INFO: FWHM in RT is 14.39 seconds, sigma is 0.52
4:17:12.470421 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:17:12.470639 INFO: Starting candidate selection
4:17:16.701351 INFO: Starting candidate scoring
4:17:18.047954 INFO: Finished candidate processing
4:17:18.048139 INFO: Collecting candidate features
4:17:20.221828 WARNING: intensity_correlation has 8 NaNs ( 0.11 % out of 7515)
4:17:20.227312 INFO: Collecting fragment features
4:17:20.871702 INFO: Finished candidate scoring
4:17:21.157207 PROGRESS: === Epoch 12, step 2, extracted 7515 precursors and 40134 fragments ===
4:17:21.157534 INFO: performing precursor FDR with 47 features
4:17:21.157578 INFO: Decoy channel: -1
4:17:21.157604 INFO: Competetive: True
4:17:21.172801 WARNING: dropped 4 target PSMs due to missing features
4:17:21.172903 WARNING: dropped 7 decoy PSMs due to missing features
4:17:21.425803 INFO: Test AUC: 0.549
4:17:21.425928 INFO: Train AUC: 0.572
4:17:21.425972 INFO: AUC difference: 4.05%
4:17:21.552265 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
4:17:21.553114 PROGRESS: ============================= Precursor FDR =============================
4:17:21.553237 PROGRESS: Total precursors accumulated: 78
4:17:21.553314 PROGRESS: Target precursors: 71 (91.03%)
4:17:21.553384 PROGRESS: Decoy precursors: 7 (8.97%)
4:17:21.553449 PROGRESS: 
4:17:21.553511 PROGRESS: Precursor Summary:
4:17:21.554973 PROGRESS: Channel   0:	 0.05 FDR:    65; 0.01 FDR:    61; 0.001 FDR:    61
4:17:21.555088 PROGRESS: 
4:17:21.555162 PROGRESS: Protein Summary:
4:17:21.556821 PROGRESS: Channel   0:	 0.05 FDR:    65; 0.01 FDR:    61; 0.001 FDR:    61
4:17:21.556956 PROGRESS: =========================================================================
4:17:21.557839 PROGRESS: === Epoch 12, step 3, extracting elution groups 7000 to 15000 ===
4:17:21.649803 PROGRESS: Extracting batch of 15791 precursors
4:17:21.655260 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:17:21.655334 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:17:21.655374 INFO: FWHM in RT is 14.39 seconds, sigma is 0.52
4:17:21.655420 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:17:21.655648 INFO: Starting candidate selection
4:17:26.046611 INFO: Starting candidate scoring
4:17:27.465106 INFO: Finished candidate processing
4:17:27.465196 INFO: Collecting candidate features
4:17:29.702285 WARNING: intensity_correlation has 17 NaNs ( 0.11 % out of 15009)
4:17:29.708303 INFO: Collecting fragment features
4:17:30.374268 INFO: Finished candidate scoring
4:17:30.672437 PROGRESS: === Epoch 12, step 3, extracted 15009 precursors and 80151 fragments ===
4:17:30.672816 INFO: performing precursor FDR with 47 features
4:17:30.672865 INFO: Decoy channel: -1
4:17:30.672892 INFO: Competetive: True
4:17:30.702130 WARNING: dropped 11 target PSMs due to missing features
4:17:30.702260 WARNING: dropped 17 decoy PSMs due to missing features
4:17:31.468275 INFO: Test AUC: 0.551
4:17:31.468422 INFO: Train AUC: 0.587
4:17:31.468467 INFO: AUC difference: 6.05%
4:17:31.468502 WARNING: AUC difference > 5%. This may indicate overfitting.
4:17:31.596158 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
4:17:31.597105 PROGRESS: ============================= Precursor FDR =============================
4:17:31.597257 PROGRESS: Total precursors accumulated: 189
4:17:31.597364 PROGRESS: Target precursors: 172 (91.01%)
4:17:31.597462 PROGRESS: Decoy precursors: 17 (8.99%)
4:17:31.597559 PROGRESS: 
4:17:31.597657 PROGRESS: Precursor Summary:
4:17:31.599246 PROGRESS: Channel   0:	 0.05 FDR:   154; 0.01 FDR:   102; 0.001 FDR:    97
4:17:31.599384 PROGRESS: 
4:17:31.599491 PROGRESS: Protein Summary:
4:17:31.601872 PROGRESS: Channel   0:	 0.05 FDR:   152; 0.01 FDR:   102; 0.001 FDR:    97
4:17:31.602015 PROGRESS: =========================================================================
4:17:31.603138 PROGRESS: === Epoch 12, step 4, extracting elution groups 15000 to 31000 ===
4:17:31.711820 PROGRESS: Extracting batch of 31613 precursors
4:17:31.722749 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:17:31.722849 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:17:31.722893 INFO: FWHM in RT is 14.39 seconds, sigma is 0.52
4:17:31.722942 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:17:31.723233 INFO: Starting candidate selection
4:17:36.452876 INFO: Starting candidate scoring
4:17:38.028292 INFO: Finished candidate processing
4:17:38.028481 INFO: Collecting candidate features
4:17:40.288958 WARNING: intensity_correlation has 36 NaNs ( 0.12 % out of 30011)
4:17:40.296855 INFO: Collecting fragment features
4:17:40.974448 INFO: Finished candidate scoring
4:17:41.286992 PROGRESS: === Epoch 12, step 4, extracted 30011 precursors and 160694 fragments ===
4:17:41.287333 INFO: performing precursor FDR with 47 features
4:17:41.287379 INFO: Decoy channel: -1
4:17:41.287406 INFO: Competetive: True
4:17:41.347457 WARNING: dropped 31 target PSMs due to missing features
4:17:41.347570 WARNING: dropped 33 decoy PSMs due to missing features
4:17:43.201927 INFO: Test AUC: 0.554
4:17:43.202080 INFO: Train AUC: 0.592
4:17:43.202127 INFO: AUC difference: 6.37%
4:17:43.202162 WARNING: AUC difference > 5%. This may indicate overfitting.
4:17:43.326562 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
4:17:43.327656 PROGRESS: ============================= Precursor FDR =============================
4:17:43.327784 PROGRESS: Total precursors accumulated: 712
4:17:43.327863 PROGRESS: Target precursors: 648 (91.01%)
4:17:43.327933 PROGRESS: Decoy precursors: 64 (8.99%)
4:17:43.328008 PROGRESS: 
4:17:43.328071 PROGRESS: Precursor Summary:
4:17:43.329748 PROGRESS: Channel   0:	 0.05 FDR:   444; 0.01 FDR:   224; 0.001 FDR:   180
4:17:43.329885 PROGRESS: 
4:17:43.329959 PROGRESS: Protein Summary:
4:17:43.331933 PROGRESS: Channel   0:	 0.05 FDR:   430; 0.01 FDR:   218; 0.001 FDR:   176
4:17:43.332044 PROGRESS: =========================================================================
4:17:43.333038 PROGRESS: === Epoch 12, step 5, extracting elution groups 31000 to 63000 ===
4:17:43.470412 PROGRESS: Extracting batch of 63257 precursors
4:17:43.490604 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:17:43.490732 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:17:43.490773 INFO: FWHM in RT is 14.39 seconds, sigma is 0.52
4:17:43.490801 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:17:43.491054 INFO: Starting candidate selection
4:17:48.898828 INFO: Starting candidate scoring
4:17:50.791371 INFO: Finished candidate processing
4:17:50.791558 INFO: Collecting candidate features
4:17:53.172649 WARNING: intensity_correlation has 61 NaNs ( 0.10 % out of 59948)
4:17:53.181615 INFO: Collecting fragment features
4:17:53.902807 INFO: Finished candidate scoring
4:17:54.255662 PROGRESS: === Epoch 12, step 5, extracted 59948 precursors and 321124 fragments ===
4:17:54.256023 INFO: performing precursor FDR with 47 features
4:17:54.256070 INFO: Decoy channel: -1
4:17:54.256098 INFO: Competetive: True
4:17:54.391052 WARNING: dropped 72 target PSMs due to missing features
4:17:54.391170 WARNING: dropped 53 decoy PSMs due to missing features
4:17:58.258014 INFO: Test AUC: 0.550
4:17:58.258131 INFO: Train AUC: 0.591
4:17:58.258172 INFO: AUC difference: 7.03%
4:17:58.258201 WARNING: AUC difference > 5%. This may indicate overfitting.
4:17:58.398141 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
4:17:58.399565 PROGRESS: ============================= Precursor FDR =============================
4:17:58.399688 PROGRESS: Total precursors accumulated: 1,534
4:17:58.399766 PROGRESS: Target precursors: 1,400 (91.26%)
4:17:58.399851 PROGRESS: Decoy precursors: 134 (8.74%)
4:17:58.399916 PROGRESS: 
4:17:58.399980 PROGRESS: Precursor Summary:
4:17:58.402010 PROGRESS: Channel   0:	 0.05 FDR: 1,014; 0.01 FDR:   576; 0.001 FDR:   427
4:17:58.402129 PROGRESS: 
4:17:58.402203 PROGRESS: Protein Summary:
4:17:58.404641 PROGRESS: Channel   0:	 0.05 FDR:   965; 0.01 FDR:   544; 0.001 FDR:   403
4:17:58.404777 PROGRESS: =========================================================================
4:17:58.406013 PROGRESS: === Epoch 12, step 6, extracting elution groups 63000 to 127000 ===
4:17:58.582991 PROGRESS: Extracting batch of 126410 precursors
4:17:58.621165 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:17:58.621280 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:17:58.621317 INFO: FWHM in RT is 14.39 seconds, sigma is 0.52
4:17:58.621359 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:17:58.621618 INFO: Starting candidate selection
4:18:05.357878 INFO: Starting candidate scoring
4:18:07.913191 INFO: Finished candidate processing
4:18:07.913282 INFO: Collecting candidate features
4:18:10.443506 WARNING: intensity_correlation has 105 NaNs ( 0.09 % out of 120120)
4:18:10.456387 INFO: Collecting fragment features
4:18:11.232423 INFO: Finished candidate scoring
4:18:11.657696 PROGRESS: === Epoch 12, step 6, extracted 120120 precursors and 642011 fragments ===
4:18:11.658060 INFO: performing precursor FDR with 47 features
4:18:11.658107 INFO: Decoy channel: -1
4:18:11.658133 INFO: Competetive: True
4:18:11.931918 WARNING: dropped 129 target PSMs due to missing features
4:18:11.932050 WARNING: dropped 101 decoy PSMs due to missing features
4:18:20.492562 INFO: Test AUC: 0.551
4:18:20.492692 INFO: Train AUC: 0.583
4:18:20.492748 INFO: AUC difference: 5.35%
4:18:20.492776 WARNING: AUC difference > 5%. This may indicate overfitting.
4:18:20.674142 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
4:18:20.675812 PROGRESS: ============================= Precursor FDR =============================
4:18:20.675956 PROGRESS: Total precursors accumulated: 2,600
4:18:20.676035 PROGRESS: Target precursors: 2,373 (91.27%)
4:18:20.676102 PROGRESS: Decoy precursors: 227 (8.73%)
4:18:20.676166 PROGRESS: 
4:18:20.676228 PROGRESS: Precursor Summary:
4:18:20.678621 PROGRESS: Channel   0:	 0.05 FDR: 1,784; 0.01 FDR: 1,102; 0.001 FDR:   805
4:18:20.678747 PROGRESS: 
4:18:20.678823 PROGRESS: Protein Summary:
4:18:20.681872 PROGRESS: Channel   0:	 0.05 FDR: 1,593; 0.01 FDR:   974; 0.001 FDR:   712
4:18:20.681988 PROGRESS: =========================================================================
4:18:20.683502 PROGRESS: === Epoch 12, step 7, extracting elution groups 127000 to 255000 ===
4:18:20.910116 PROGRESS: Extracting batch of 252965 precursors
4:18:20.982910 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:18:20.983026 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:18:20.983064 INFO: FWHM in RT is 14.39 seconds, sigma is 0.52
4:18:20.983108 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:18:20.983371 INFO: Starting candidate selection
4:18:30.319290 INFO: Starting candidate scoring
4:18:34.121746 INFO: Finished candidate processing
4:18:34.122051 INFO: Collecting candidate features
4:18:37.101712 WARNING: intensity_correlation has 235 NaNs ( 0.10 % out of 240138)
4:18:37.122590 INFO: Collecting fragment features
4:18:38.008599 INFO: Finished candidate scoring
4:18:38.604811 PROGRESS: === Epoch 12, step 7, extracted 240138 precursors and 1285211 fragments ===
4:18:38.605164 INFO: performing precursor FDR with 47 features
4:18:38.605211 INFO: Decoy channel: -1
4:18:38.605238 INFO: Competetive: True
4:18:39.214935 WARNING: dropped 243 target PSMs due to missing features
4:18:39.215064 WARNING: dropped 222 decoy PSMs due to missing features
4:18:56.490989 INFO: Test AUC: 0.551
4:18:56.491123 INFO: Train AUC: 0.574
4:18:56.491184 INFO: AUC difference: 3.93%
4:18:56.677294 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
4:18:56.679590 PROGRESS: ============================= Precursor FDR =============================
4:18:56.679749 PROGRESS: Total precursors accumulated: 4,493
4:18:56.679828 PROGRESS: Target precursors: 4,105 (91.36%)
4:18:56.679895 PROGRESS: Decoy precursors: 388 (8.64%)
4:18:56.679960 PROGRESS: 
4:18:56.680020 PROGRESS: Precursor Summary:
4:18:56.683007 PROGRESS: Channel   0:	 0.05 FDR: 3,205; 0.01 FDR: 2,132; 0.001 FDR: 1,821
4:18:56.683154 PROGRESS: 
4:18:56.683227 PROGRESS: Protein Summary:
4:18:56.687314 PROGRESS: Channel   0:	 0.05 FDR: 2,561; 0.01 FDR: 1,662; 0.001 FDR: 1,437
4:18:56.687443 PROGRESS: =========================================================================
4:18:56.689408 PROGRESS: === Epoch 12, step 8, extracting elution groups 255000 to 511000 ===
4:18:56.996350 PROGRESS: Extracting batch of 505748 precursors
4:18:57.130462 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:18:57.130580 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:18:57.130621 INFO: FWHM in RT is 14.39 seconds, sigma is 0.52
4:18:57.130648 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:18:57.130919 INFO: Starting candidate selection
4:19:11.623155 INFO: Starting candidate scoring
4:19:17.990342 INFO: Finished candidate processing
4:19:17.990538 INFO: Collecting candidate features
4:19:21.687760 WARNING: intensity_correlation has 504 NaNs ( 0.10 % out of 480092)
4:19:21.721899 INFO: Collecting fragment features
4:19:22.801711 INFO: Finished candidate scoring
4:19:23.709011 PROGRESS: === Epoch 12, step 8, extracted 480092 precursors and 2563222 fragments ===
4:19:23.709381 INFO: performing precursor FDR with 47 features
4:19:23.709426 INFO: Decoy channel: -1
4:19:23.709452 INFO: Competetive: True
4:19:24.872048 WARNING: dropped 507 target PSMs due to missing features
4:19:24.872172 WARNING: dropped 462 decoy PSMs due to missing features
4:20:00.952899 INFO: Test AUC: 0.554
4:20:00.953024 INFO: Train AUC: 0.567
4:20:00.953077 INFO: AUC difference: 2.21%
4:20:01.202964 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
4:20:01.206099 PROGRESS: ============================= Precursor FDR =============================
4:20:01.206261 PROGRESS: Total precursors accumulated: 7,944
4:20:01.206342 PROGRESS: Target precursors: 7,249 (91.25%)
4:20:01.206412 PROGRESS: Decoy precursors: 695 (8.75%)
4:20:01.206476 PROGRESS: 
4:20:01.206549 PROGRESS: Precursor Summary:
4:20:01.210402 PROGRESS: Channel   0:	 0.05 FDR: 5,838; 0.01 FDR: 4,149; 0.001 FDR: 2,020
4:20:01.210536 PROGRESS: 
4:20:01.210610 PROGRESS: Protein Summary:
4:20:01.216193 PROGRESS: Channel   0:	 0.05 FDR: 3,955; 0.01 FDR: 2,750; 0.001 FDR: 1,473
4:20:01.216330 PROGRESS: =========================================================================
4:20:01.221223 INFO: calibration group: precursor, fitting rt estimator 
4:20:01.725689 INFO: calibration group: fragment, fitting mz estimator 
4:20:02.321463 INFO: === checking if epoch conditions were reached ===
4:20:02.321667 INFO: ✅ ms2_error      : 7.0000 <= 7
4:20:02.321747 INFO: ❌ rt_error       : 198.1751 > 100
4:20:02.321824 INFO: ✅ current_epoch  : 12 >= 3
4:20:02.321883 INFO: ==============================================
4:20:02.540987 INFO: calibration group: precursor, predicting mz
4:20:02.541278 WARNING: mz prediction was skipped as it has not been fitted yet
4:20:02.541323 INFO: calibration group: precursor, predicting rt
4:20:09.319760 INFO: calibration group: fragment, predicting mz
4:20:27.285489 PROGRESS: === Epoch 13, step 0, extracting elution groups 0 to 1000 ===
4:20:27.384755 PROGRESS: Extracting batch of 1981 precursors
4:20:27.386498 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:20:27.386575 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:20:27.386615 INFO: FWHM in RT is 14.46 seconds, sigma is 0.53
4:20:27.386662 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:20:27.386894 INFO: Starting candidate selection
4:20:31.955473 INFO: Starting candidate scoring
4:20:33.254912 INFO: Finished candidate processing
4:20:33.255028 INFO: Collecting candidate features
4:20:35.434412 WARNING: intensity_correlation has 1 NaNs ( 0.05 % out of 1893)
4:20:35.440170 INFO: Collecting fragment features
4:20:36.085698 INFO: Finished candidate scoring
4:20:36.433286 PROGRESS: === Epoch 13, step 0, extracted 1893 precursors and 10144 fragments ===
4:20:36.433617 INFO: performing precursor FDR with 47 features
4:20:36.433659 INFO: Decoy channel: -1
4:20:36.433687 INFO: Competetive: True
4:20:36.438217 WARNING: dropped 1 target PSMs due to missing features
4:20:36.467200 INFO: Test AUC: 0.557
4:20:36.467302 INFO: Train AUC: 0.550
4:20:36.467346 INFO: AUC difference: 1.31%
4:20:36.588751 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
4:20:36.589523 PROGRESS: ============================= Precursor FDR =============================
4:20:36.589644 PROGRESS: Total precursors accumulated: 12
4:20:36.589721 PROGRESS: Target precursors: 11 (91.67%)
4:20:36.589800 PROGRESS: Decoy precursors: 1 (8.33%)
4:20:36.589864 PROGRESS: 
4:20:36.589925 PROGRESS: Precursor Summary:
4:20:36.591324 PROGRESS: Channel   0:	 0.05 FDR:     5; 0.01 FDR:     5; 0.001 FDR:     5
4:20:36.591456 PROGRESS: 
4:20:36.591531 PROGRESS: Protein Summary:
4:20:36.593113 PROGRESS: Channel   0:	 0.05 FDR:     5; 0.01 FDR:     5; 0.001 FDR:     5
4:20:36.593228 PROGRESS: =========================================================================
4:20:36.594090 PROGRESS: === Epoch 13, step 1, extracting elution groups 1000 to 3000 ===
4:20:36.671149 PROGRESS: Extracting batch of 3952 precursors
4:20:36.673294 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:20:36.673354 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:20:36.673392 INFO: FWHM in RT is 14.46 seconds, sigma is 0.53
4:20:36.673437 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:20:36.673648 INFO: Starting candidate selection
4:20:40.847485 INFO: Starting candidate scoring
4:20:42.153187 INFO: Finished candidate processing
4:20:42.153274 INFO: Collecting candidate features
4:20:44.342565 WARNING: intensity_correlation has 3 NaNs ( 0.08 % out of 3757)
4:20:44.348634 INFO: Collecting fragment features
4:20:44.999329 INFO: Finished candidate scoring
4:20:45.282500 PROGRESS: === Epoch 13, step 1, extracted 3757 precursors and 20163 fragments ===
4:20:45.282776 INFO: performing precursor FDR with 47 features
4:20:45.282831 INFO: Decoy channel: -1
4:20:45.282862 INFO: Competetive: True
4:20:45.291443 WARNING: dropped 2 target PSMs due to missing features
4:20:45.291538 WARNING: dropped 2 decoy PSMs due to missing features
4:20:45.328939 INFO: Test AUC: 0.536
4:20:45.329056 INFO: Train AUC: 0.545
4:20:45.329101 INFO: AUC difference: 1.61%
4:20:49.330343 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
4:20:49.331178 PROGRESS: ============================= Precursor FDR =============================
4:20:49.331307 PROGRESS: Total precursors accumulated: 30
4:20:49.331386 PROGRESS: Target precursors: 28 (93.33%)
4:20:49.331453 PROGRESS: Decoy precursors: 2 (6.67%)
4:20:49.331516 PROGRESS: 
4:20:49.331578 PROGRESS: Precursor Summary:
4:20:49.333013 PROGRESS: Channel   0:	 0.05 FDR:    27; 0.01 FDR:    13; 0.001 FDR:    13
4:20:49.333143 PROGRESS: 
4:20:49.333216 PROGRESS: Protein Summary:
4:20:49.334831 PROGRESS: Channel   0:	 0.05 FDR:    27; 0.01 FDR:    13; 0.001 FDR:    13
4:20:49.334945 PROGRESS: =========================================================================
4:20:49.335789 PROGRESS: === Epoch 13, step 2, extracting elution groups 3000 to 7000 ===
4:20:49.418271 PROGRESS: Extracting batch of 7904 precursors
4:20:49.428599 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:20:49.428673 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:20:49.428730 INFO: FWHM in RT is 14.46 seconds, sigma is 0.53
4:20:49.428770 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:20:49.429020 INFO: Starting candidate selection
4:20:53.811697 INFO: Starting candidate scoring
4:20:55.189356 INFO: Finished candidate processing
4:20:55.189455 INFO: Collecting candidate features
4:20:57.403816 WARNING: intensity_correlation has 6 NaNs ( 0.08 % out of 7475)
4:20:57.409563 INFO: Collecting fragment features
4:20:58.064463 INFO: Finished candidate scoring
4:20:58.359056 PROGRESS: === Epoch 13, step 2, extracted 7475 precursors and 40307 fragments ===
4:20:58.359417 INFO: performing precursor FDR with 47 features
4:20:58.359462 INFO: Decoy channel: -1
4:20:58.359488 INFO: Competetive: True
4:20:58.375879 WARNING: dropped 6 target PSMs due to missing features
4:20:58.375985 WARNING: dropped 4 decoy PSMs due to missing features
4:20:58.617716 INFO: Test AUC: 0.569
4:20:58.617855 INFO: Train AUC: 0.571
4:20:58.617914 INFO: AUC difference: 0.36%
4:20:58.757724 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
4:20:58.758638 PROGRESS: ============================= Precursor FDR =============================
4:20:58.758762 PROGRESS: Total precursors accumulated: 104
4:20:58.758840 PROGRESS: Target precursors: 95 (91.35%)
4:20:58.758908 PROGRESS: Decoy precursors: 9 (8.65%)
4:20:58.758970 PROGRESS: 
4:20:58.759030 PROGRESS: Precursor Summary:
4:20:58.760495 PROGRESS: Channel   0:	 0.05 FDR:    61; 0.01 FDR:    24; 0.001 FDR:    24
4:20:58.760626 PROGRESS: 
4:20:58.760699 PROGRESS: Protein Summary:
4:20:58.762367 PROGRESS: Channel   0:	 0.05 FDR:    61; 0.01 FDR:    24; 0.001 FDR:    24
4:20:58.762482 PROGRESS: =========================================================================
4:20:58.763358 PROGRESS: === Epoch 13, step 3, extracting elution groups 7000 to 15000 ===
4:20:58.855739 PROGRESS: Extracting batch of 15796 precursors
4:20:58.861403 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:20:58.861469 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:20:58.861505 INFO: FWHM in RT is 14.46 seconds, sigma is 0.53
4:20:58.861546 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:20:58.861774 INFO: Starting candidate selection
4:21:03.335275 INFO: Starting candidate scoring
4:21:04.777912 INFO: Finished candidate processing
4:21:04.778009 INFO: Collecting candidate features
4:21:06.981516 WARNING: intensity_correlation has 16 NaNs ( 0.11 % out of 14982)
4:21:06.987751 INFO: Collecting fragment features
4:21:07.646559 INFO: Finished candidate scoring
4:21:07.948210 PROGRESS: === Epoch 13, step 3, extracted 14982 precursors and 80533 fragments ===
4:21:07.948629 INFO: performing precursor FDR with 47 features
4:21:07.948687 INFO: Decoy channel: -1
4:21:07.948718 INFO: Competetive: True
4:21:07.978665 WARNING: dropped 14 target PSMs due to missing features
4:21:07.978799 WARNING: dropped 12 decoy PSMs due to missing features
4:21:08.788429 INFO: Test AUC: 0.555
4:21:08.788582 INFO: Train AUC: 0.589
4:21:08.788629 INFO: AUC difference: 5.86%
4:21:08.788663 WARNING: AUC difference > 5%. This may indicate overfitting.
4:21:08.913446 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
4:21:08.914492 PROGRESS: ============================= Precursor FDR =============================
4:21:08.914618 PROGRESS: Total precursors accumulated: 388
4:21:08.914696 PROGRESS: Target precursors: 356 (91.75%)
4:21:08.914764 PROGRESS: Decoy precursors: 32 (8.25%)
4:21:08.914827 PROGRESS: 
4:21:08.914888 PROGRESS: Precursor Summary:
4:21:08.916425 PROGRESS: Channel   0:	 0.05 FDR:   193; 0.01 FDR:    60; 0.001 FDR:    60
4:21:08.916559 PROGRESS: 
4:21:08.916632 PROGRESS: Protein Summary:
4:21:08.918420 PROGRESS: Channel   0:	 0.05 FDR:   190; 0.01 FDR:    60; 0.001 FDR:    60
4:21:08.918531 PROGRESS: =========================================================================
4:21:08.919421 PROGRESS: === Epoch 13, step 4, extracting elution groups 15000 to 31000 ===
4:21:09.027274 PROGRESS: Extracting batch of 31609 precursors
4:21:09.038085 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:21:09.038180 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:21:09.038219 INFO: FWHM in RT is 14.46 seconds, sigma is 0.53
4:21:09.038246 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:21:09.038509 INFO: Starting candidate selection
4:21:13.815944 INFO: Starting candidate scoring
4:21:15.393391 INFO: Finished candidate processing
4:21:15.393483 INFO: Collecting candidate features
4:21:17.646656 WARNING: intensity_correlation has 29 NaNs ( 0.10 % out of 30053)
4:21:17.653674 INFO: Collecting fragment features
4:21:18.330194 INFO: Finished candidate scoring
4:21:18.650613 PROGRESS: === Epoch 13, step 4, extracted 30053 precursors and 160279 fragments ===
4:21:18.650969 INFO: performing precursor FDR with 47 features
4:21:18.651018 INFO: Decoy channel: -1
4:21:18.651045 INFO: Competetive: True
4:21:18.711244 WARNING: dropped 25 target PSMs due to missing features
4:21:18.711359 WARNING: dropped 30 decoy PSMs due to missing features
4:21:20.470140 INFO: Test AUC: 0.548
4:21:20.470294 INFO: Train AUC: 0.599
4:21:20.470339 INFO: AUC difference: 8.61%
4:21:20.470374 WARNING: AUC difference > 5%. This may indicate overfitting.
4:21:20.595535 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
4:21:20.596782 PROGRESS: ============================= Precursor FDR =============================
4:21:20.596937 PROGRESS: Total precursors accumulated: 846
4:21:20.597018 PROGRESS: Target precursors: 772 (91.25%)
4:21:20.597086 PROGRESS: Decoy precursors: 74 (8.75%)
4:21:20.597147 PROGRESS: 
4:21:20.597207 PROGRESS: Precursor Summary:
4:21:20.598987 PROGRESS: Channel   0:	 0.05 FDR:   525; 0.01 FDR:   260; 0.001 FDR:   146
4:21:20.599129 PROGRESS: 
4:21:20.599203 PROGRESS: Protein Summary:
4:21:20.601263 PROGRESS: Channel   0:	 0.05 FDR:   507; 0.01 FDR:   250; 0.001 FDR:   143
4:21:20.601391 PROGRESS: =========================================================================
4:21:20.602462 PROGRESS: === Epoch 13, step 5, extracting elution groups 31000 to 63000 ===
4:21:20.738772 PROGRESS: Extracting batch of 63201 precursors
4:21:20.758855 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:21:20.758959 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:21:20.758996 INFO: FWHM in RT is 14.46 seconds, sigma is 0.53
4:21:20.759022 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:21:20.759291 INFO: Starting candidate selection
4:21:26.229707 INFO: Starting candidate scoring
4:21:28.131093 INFO: Finished candidate processing
4:21:28.131195 INFO: Collecting candidate features
4:21:30.508839 WARNING: intensity_correlation has 59 NaNs ( 0.10 % out of 59872)
4:21:30.519405 INFO: Collecting fragment features
4:21:31.246616 INFO: Finished candidate scoring
4:21:31.607093 PROGRESS: === Epoch 13, step 5, extracted 59872 precursors and 319779 fragments ===
4:21:31.607490 INFO: performing precursor FDR with 47 features
4:21:31.607539 INFO: Decoy channel: -1
4:21:31.607565 INFO: Competetive: True
4:21:31.745079 WARNING: dropped 54 target PSMs due to missing features
4:21:31.745198 WARNING: dropped 60 decoy PSMs due to missing features
4:21:35.754081 INFO: Test AUC: 0.554
4:21:35.754220 INFO: Train AUC: 0.593
4:21:35.754259 INFO: AUC difference: 6.51%
4:21:35.754286 WARNING: AUC difference > 5%. This may indicate overfitting.
4:21:35.889865 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
4:21:35.891455 PROGRESS: ============================= Precursor FDR =============================
4:21:35.891593 PROGRESS: Total precursors accumulated: 1,709
4:21:35.891669 PROGRESS: Target precursors: 1,560 (91.28%)
4:21:35.891752 PROGRESS: Decoy precursors: 149 (8.72%)
4:21:35.891814 PROGRESS: 
4:21:35.891875 PROGRESS: Precursor Summary:
4:21:35.893929 PROGRESS: Channel   0:	 0.05 FDR: 1,105; 0.01 FDR:   460; 0.001 FDR:   183
4:21:35.894064 PROGRESS: 
4:21:35.894139 PROGRESS: Protein Summary:
4:21:35.896579 PROGRESS: Channel   0:	 0.05 FDR: 1,031; 0.01 FDR:   431; 0.001 FDR:   177
4:21:35.896693 PROGRESS: =========================================================================
4:21:35.897862 PROGRESS: === Epoch 13, step 6, extracting elution groups 63000 to 127000 ===
4:21:36.072546 PROGRESS: Extracting batch of 126438 precursors
4:21:36.111778 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:21:36.111895 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:21:36.111933 INFO: FWHM in RT is 14.46 seconds, sigma is 0.53
4:21:36.111976 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:21:36.112246 INFO: Starting candidate selection
4:21:42.891682 INFO: Starting candidate scoring
4:21:45.453883 INFO: Finished candidate processing
4:21:45.454037 INFO: Collecting candidate features
4:21:48.019478 WARNING: intensity_correlation has 120 NaNs ( 0.10 % out of 119891)
4:21:48.032609 INFO: Collecting fragment features
4:21:48.809928 INFO: Finished candidate scoring
4:21:49.246810 PROGRESS: === Epoch 13, step 6, extracted 119891 precursors and 641692 fragments ===
4:21:49.247190 INFO: performing precursor FDR with 47 features
4:21:49.247236 INFO: Decoy channel: -1
4:21:49.247267 INFO: Competetive: True
4:21:49.527977 WARNING: dropped 110 target PSMs due to missing features
4:21:49.528105 WARNING: dropped 124 decoy PSMs due to missing features
4:21:58.079611 INFO: Test AUC: 0.556
4:21:58.079745 INFO: Train AUC: 0.585
4:21:58.079802 INFO: AUC difference: 4.93%
4:21:58.236213 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
4:21:58.238205 PROGRESS: ============================= Precursor FDR =============================
4:21:58.238350 PROGRESS: Total precursors accumulated: 3,008
4:21:58.238429 PROGRESS: Target precursors: 2,741 (91.12%)
4:21:58.238498 PROGRESS: Decoy precursors: 267 (8.88%)
4:21:58.238562 PROGRESS: 
4:21:58.238623 PROGRESS: Precursor Summary:
4:21:58.241141 PROGRESS: Channel   0:	 0.05 FDR: 1,796; 0.01 FDR: 1,089; 0.001 FDR:   761
4:21:58.241276 PROGRESS: 
4:21:58.241351 PROGRESS: Protein Summary:
4:21:58.244539 PROGRESS: Channel   0:	 0.05 FDR: 1,592; 0.01 FDR:   947; 0.001 FDR:   670
4:21:58.244663 PROGRESS: =========================================================================
4:21:58.246230 PROGRESS: === Epoch 13, step 7, extracting elution groups 127000 to 255000 ===
4:21:58.470907 PROGRESS: Extracting batch of 252926 precursors
4:21:58.544212 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:21:58.544329 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:21:58.544368 INFO: FWHM in RT is 14.46 seconds, sigma is 0.53
4:21:58.544412 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:21:58.544694 INFO: Starting candidate selection
4:22:07.884368 INFO: Starting candidate scoring
4:22:11.696520 INFO: Finished candidate processing
4:22:11.696707 INFO: Collecting candidate features
4:22:14.681810 WARNING: intensity_correlation has 239 NaNs ( 0.10 % out of 239748)
4:22:14.702590 INFO: Collecting fragment features
4:22:15.590452 INFO: Finished candidate scoring
4:22:16.182877 PROGRESS: === Epoch 13, step 7, extracted 239748 precursors and 1281480 fragments ===
4:22:16.183256 INFO: performing precursor FDR with 47 features
4:22:16.183306 INFO: Decoy channel: -1
4:22:16.183333 INFO: Competetive: True
4:22:16.792197 WARNING: dropped 223 target PSMs due to missing features
4:22:16.792317 WARNING: dropped 250 decoy PSMs due to missing features
4:22:34.367119 INFO: Test AUC: 0.553
4:22:34.367246 INFO: Train AUC: 0.577
4:22:34.367301 INFO: AUC difference: 4.07%
4:22:34.571309 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
4:22:34.573843 PROGRESS: ============================= Precursor FDR =============================
4:22:34.573989 PROGRESS: Total precursors accumulated: 4,935
4:22:34.574069 PROGRESS: Target precursors: 4,502 (91.23%)
4:22:34.574137 PROGRESS: Decoy precursors: 433 (8.77%)
4:22:34.574201 PROGRESS: 
4:22:34.574262 PROGRESS: Precursor Summary:
4:22:34.577559 PROGRESS: Channel   0:	 0.05 FDR: 3,503; 0.01 FDR: 2,235; 0.001 FDR: 1,725
4:22:34.577718 PROGRESS: 
4:22:34.577819 PROGRESS: Protein Summary:
4:22:34.582392 PROGRESS: Channel   0:	 0.05 FDR: 2,741; 0.01 FDR: 1,700; 0.001 FDR: 1,328
4:22:34.582535 PROGRESS: =========================================================================
4:22:34.584683 PROGRESS: === Epoch 13, step 8, extracting elution groups 255000 to 511000 ===
4:22:34.892640 PROGRESS: Extracting batch of 505719 precursors
4:22:35.028205 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:22:35.028317 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:22:35.028355 INFO: FWHM in RT is 14.46 seconds, sigma is 0.53
4:22:35.028398 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:22:35.028672 INFO: Starting candidate selection
4:22:49.553504 INFO: Starting candidate scoring
4:22:55.845029 INFO: Finished candidate processing
4:22:55.845224 INFO: Collecting candidate features
4:22:59.546273 WARNING: intensity_correlation has 469 NaNs ( 0.10 % out of 479273)
4:22:59.547351 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 479273)
4:22:59.581317 INFO: Collecting fragment features
4:23:00.666413 INFO: Finished candidate scoring
4:23:01.579237 PROGRESS: === Epoch 13, step 8, extracted 479273 precursors and 2563683 fragments ===
4:23:01.579630 INFO: performing precursor FDR with 47 features
4:23:01.579679 INFO: Decoy channel: -1
4:23:01.579710 INFO: Competetive: True
4:23:02.743999 WARNING: dropped 459 target PSMs due to missing features
4:23:02.744126 WARNING: dropped 483 decoy PSMs due to missing features
4:23:38.505291 INFO: Test AUC: 0.556
4:23:38.505421 INFO: Train AUC: 0.569
4:23:38.505459 INFO: AUC difference: 2.37%
4:23:38.759583 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
4:23:38.762939 PROGRESS: ============================= Precursor FDR =============================
4:23:38.763132 PROGRESS: Total precursors accumulated: 7,799
4:23:38.763213 PROGRESS: Target precursors: 7,116 (91.24%)
4:23:38.763279 PROGRESS: Decoy precursors: 683 (8.76%)
4:23:38.763358 PROGRESS: 
4:23:38.763419 PROGRESS: Precursor Summary:
4:23:38.767610 PROGRESS: Channel   0:	 0.05 FDR: 5,828; 0.01 FDR: 4,131; 0.001 FDR: 2,837
4:23:38.767785 PROGRESS: 
4:23:38.767858 PROGRESS: Protein Summary:
4:23:38.774081 PROGRESS: Channel   0:	 0.05 FDR: 3,892; 0.01 FDR: 2,685; 0.001 FDR: 1,960
4:23:38.774239 PROGRESS: =========================================================================
4:23:38.779202 INFO: calibration group: precursor, fitting rt estimator 
4:23:39.297216 INFO: calibration group: fragment, fitting mz estimator 
4:23:39.892605 INFO: === checking if epoch conditions were reached ===
4:23:39.892875 INFO: ✅ ms2_error      : 7.0000 <= 7
4:23:39.892967 INFO: ❌ rt_error       : 199.6396 > 100
4:23:39.893040 INFO: ✅ current_epoch  : 13 >= 3
4:23:39.893105 INFO: ==============================================
4:23:40.111578 INFO: calibration group: precursor, predicting mz
4:23:40.111871 WARNING: mz prediction was skipped as it has not been fitted yet
4:23:40.111913 INFO: calibration group: precursor, predicting rt
4:23:46.843119 INFO: calibration group: fragment, predicting mz
4:24:04.470108 PROGRESS: === Epoch 14, step 0, extracting elution groups 0 to 1000 ===
4:24:04.569113 PROGRESS: Extracting batch of 1980 precursors
4:24:04.570947 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:24:04.571023 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:24:04.571061 INFO: FWHM in RT is 14.85 seconds, sigma is 0.54
4:24:04.571106 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:24:04.571388 INFO: Starting candidate selection
4:24:09.129230 INFO: Starting candidate scoring
4:24:10.437242 INFO: Finished candidate processing
4:24:10.437337 INFO: Collecting candidate features
4:24:12.624497 WARNING: intensity_correlation has 3 NaNs ( 0.16 % out of 1878)
4:24:12.631732 INFO: Collecting fragment features
4:24:13.276258 INFO: Finished candidate scoring
4:24:13.624899 PROGRESS: === Epoch 14, step 0, extracted 1878 precursors and 10091 fragments ===
4:24:13.625228 INFO: performing precursor FDR with 47 features
4:24:13.625270 INFO: Decoy channel: -1
4:24:13.625297 INFO: Competetive: True
4:24:13.630434 WARNING: dropped 1 target PSMs due to missing features
4:24:13.630538 WARNING: dropped 2 decoy PSMs due to missing features
4:24:13.660227 INFO: Test AUC: 0.585
4:24:13.660329 INFO: Train AUC: 0.544
4:24:13.660375 INFO: AUC difference: 7.56%
4:24:13.660410 WARNING: AUC difference > 5%. This may indicate overfitting.
4:24:13.780302 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
4:24:13.781061 PROGRESS: ============================= Precursor FDR =============================
4:24:13.781184 PROGRESS: Total precursors accumulated: 13
4:24:13.781261 PROGRESS: Target precursors: 12 (92.31%)
4:24:13.781329 PROGRESS: Decoy precursors: 1 (7.69%)
4:24:13.781392 PROGRESS: 
4:24:13.781453 PROGRESS: Precursor Summary:
4:24:13.782863 PROGRESS: Channel   0:	 0.05 FDR:    11; 0.01 FDR:    11; 0.001 FDR:    11
4:24:13.783005 PROGRESS: 
4:24:13.783080 PROGRESS: Protein Summary:
4:24:13.784667 PROGRESS: Channel   0:	 0.05 FDR:    10; 0.01 FDR:    10; 0.001 FDR:    10
4:24:13.784795 PROGRESS: =========================================================================
4:24:13.785642 PROGRESS: === Epoch 14, step 1, extracting elution groups 1000 to 3000 ===
4:24:13.863183 PROGRESS: Extracting batch of 3943 precursors
4:24:13.865458 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:24:13.865520 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:24:13.865562 INFO: FWHM in RT is 14.85 seconds, sigma is 0.54
4:24:13.865610 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:24:13.865850 INFO: Starting candidate selection
4:24:18.067468 INFO: Starting candidate scoring
4:24:19.378898 INFO: Finished candidate processing
4:24:19.378993 INFO: Collecting candidate features
4:24:21.550477 WARNING: intensity_correlation has 4 NaNs ( 0.11 % out of 3742)
4:24:21.556641 INFO: Collecting fragment features
4:24:22.199968 INFO: Finished candidate scoring
4:24:22.482181 PROGRESS: === Epoch 14, step 1, extracted 3742 precursors and 20150 fragments ===
4:24:22.482460 INFO: performing precursor FDR with 47 features
4:24:22.482505 INFO: Decoy channel: -1
4:24:22.482532 INFO: Competetive: True
4:24:22.491854 WARNING: dropped 3 target PSMs due to missing features
4:24:22.491945 WARNING: dropped 4 decoy PSMs due to missing features
4:24:22.530541 INFO: Test AUC: 0.528
4:24:22.530665 INFO: Train AUC: 0.559
4:24:22.530710 INFO: AUC difference: 5.58%
4:24:22.530745 WARNING: AUC difference > 5%. This may indicate overfitting.
4:24:22.663121 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
4:24:22.663911 PROGRESS: ============================= Precursor FDR =============================
4:24:22.664032 PROGRESS: Total precursors accumulated: 30
4:24:22.664122 PROGRESS: Target precursors: 28 (93.33%)
4:24:22.664192 PROGRESS: Decoy precursors: 2 (6.67%)
4:24:22.664255 PROGRESS: 
4:24:22.664315 PROGRESS: Precursor Summary:
4:24:22.665745 PROGRESS: Channel   0:	 0.05 FDR:    28; 0.01 FDR:    26; 0.001 FDR:    26
4:24:22.665886 PROGRESS: 
4:24:22.665960 PROGRESS: Protein Summary:
4:24:22.667575 PROGRESS: Channel   0:	 0.05 FDR:    27; 0.01 FDR:    25; 0.001 FDR:    25
4:24:22.667700 PROGRESS: =========================================================================
4:24:22.668561 PROGRESS: === Epoch 14, step 2, extracting elution groups 3000 to 7000 ===
4:24:22.751369 PROGRESS: Extracting batch of 7878 precursors
4:24:22.754824 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:24:22.754895 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:24:22.754961 INFO: FWHM in RT is 14.85 seconds, sigma is 0.54
4:24:22.754991 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:24:22.755224 INFO: Starting candidate selection
4:24:27.036334 INFO: Starting candidate scoring
4:24:28.382080 INFO: Finished candidate processing
4:24:28.382175 INFO: Collecting candidate features
4:24:30.559693 WARNING: intensity_correlation has 7 NaNs ( 0.09 % out of 7491)
4:24:30.565422 INFO: Collecting fragment features
4:24:31.220406 INFO: Finished candidate scoring
4:24:31.507611 PROGRESS: === Epoch 14, step 2, extracted 7491 precursors and 40799 fragments ===
4:24:31.507983 INFO: performing precursor FDR with 47 features
4:24:31.508029 INFO: Decoy channel: -1
4:24:31.508055 INFO: Competetive: True
4:24:31.524136 WARNING: dropped 6 target PSMs due to missing features
4:24:31.524240 WARNING: dropped 8 decoy PSMs due to missing features
4:24:31.824483 INFO: Test AUC: 0.573
4:24:31.824615 INFO: Train AUC: 0.573
4:24:31.824659 INFO: AUC difference: 0.05%
4:24:31.948084 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
4:24:31.948939 PROGRESS: ============================= Precursor FDR =============================
4:24:31.949060 PROGRESS: Total precursors accumulated: 119
4:24:31.949138 PROGRESS: Target precursors: 109 (91.60%)
4:24:31.949206 PROGRESS: Decoy precursors: 10 (8.40%)
4:24:31.949269 PROGRESS: 
4:24:31.949329 PROGRESS: Precursor Summary:
4:24:31.950853 PROGRESS: Channel   0:	 0.05 FDR:    93; 0.01 FDR:    73; 0.001 FDR:    73
4:24:31.950999 PROGRESS: 
4:24:31.951086 PROGRESS: Protein Summary:
4:24:31.952820 PROGRESS: Channel   0:	 0.05 FDR:    92; 0.01 FDR:    72; 0.001 FDR:    72
4:24:31.952945 PROGRESS: =========================================================================
4:24:31.953863 PROGRESS: === Epoch 14, step 3, extracting elution groups 7000 to 15000 ===
4:24:32.045280 PROGRESS: Extracting batch of 15779 precursors
4:24:32.051011 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:24:32.051085 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:24:32.051122 INFO: FWHM in RT is 14.85 seconds, sigma is 0.54
4:24:32.051165 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:24:32.051393 INFO: Starting candidate selection
4:24:36.525174 INFO: Starting candidate scoring
4:24:37.968911 INFO: Finished candidate processing
4:24:37.969004 INFO: Collecting candidate features
4:24:40.199239 WARNING: intensity_correlation has 21 NaNs ( 0.14 % out of 14995)
4:24:40.205240 INFO: Collecting fragment features
4:24:40.869480 INFO: Finished candidate scoring
4:24:41.169380 PROGRESS: === Epoch 14, step 3, extracted 14995 precursors and 80242 fragments ===
4:24:41.169777 INFO: performing precursor FDR with 47 features
4:24:41.169836 INFO: Decoy channel: -1
4:24:41.169871 INFO: Competetive: True
4:24:41.200401 WARNING: dropped 20 target PSMs due to missing features
4:24:41.200523 WARNING: dropped 15 decoy PSMs due to missing features
4:24:41.949644 INFO: Test AUC: 0.555
4:24:41.949810 INFO: Train AUC: 0.591
4:24:41.949862 INFO: AUC difference: 6.12%
4:24:41.949897 WARNING: AUC difference > 5%. This may indicate overfitting.
4:24:42.074340 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
4:24:42.075361 PROGRESS: ============================= Precursor FDR =============================
4:24:42.075487 PROGRESS: Total precursors accumulated: 341
4:24:42.075564 PROGRESS: Target precursors: 313 (91.79%)
4:24:42.075631 PROGRESS: Decoy precursors: 28 (8.21%)
4:24:42.075694 PROGRESS: 
4:24:42.075755 PROGRESS: Precursor Summary:
4:24:42.077413 PROGRESS: Channel   0:	 0.05 FDR:   244; 0.01 FDR:   189; 0.001 FDR:   167
4:24:42.077540 PROGRESS: 
4:24:42.077615 PROGRESS: Protein Summary:
4:24:42.079547 PROGRESS: Channel   0:	 0.05 FDR:   238; 0.01 FDR:   185; 0.001 FDR:   164
4:24:42.079677 PROGRESS: =========================================================================
4:24:42.080683 PROGRESS: === Epoch 14, step 4, extracting elution groups 15000 to 31000 ===
4:24:42.189301 PROGRESS: Extracting batch of 31651 precursors
4:24:42.200360 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:24:42.200480 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:24:42.200524 INFO: FWHM in RT is 14.85 seconds, sigma is 0.54
4:24:42.200554 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:24:42.200798 INFO: Starting candidate selection
4:24:46.963751 INFO: Starting candidate scoring
4:24:48.553117 INFO: Finished candidate processing
4:24:48.553212 INFO: Collecting candidate features
4:24:50.826589 WARNING: intensity_correlation has 42 NaNs ( 0.14 % out of 30141)
4:24:50.833581 INFO: Collecting fragment features
4:24:51.512779 INFO: Finished candidate scoring
4:24:51.828214 PROGRESS: === Epoch 14, step 4, extracted 30141 precursors and 161433 fragments ===
4:24:51.828580 INFO: performing precursor FDR with 47 features
4:24:51.828625 INFO: Decoy channel: -1
4:24:51.828652 INFO: Competetive: True
4:24:51.889116 WARNING: dropped 43 target PSMs due to missing features
4:24:51.889225 WARNING: dropped 34 decoy PSMs due to missing features
4:24:53.825509 INFO: Test AUC: 0.556
4:24:53.825651 INFO: Train AUC: 0.603
4:24:53.825698 INFO: AUC difference: 7.76%
4:24:53.825733 WARNING: AUC difference > 5%. This may indicate overfitting.
4:24:53.952051 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
4:24:53.953281 PROGRESS: ============================= Precursor FDR =============================
4:24:53.953430 PROGRESS: Total precursors accumulated: 858
4:24:53.953509 PROGRESS: Target precursors: 783 (91.26%)
4:24:53.953577 PROGRESS: Decoy precursors: 75 (8.74%)
4:24:53.953640 PROGRESS: 
4:24:53.953702 PROGRESS: Precursor Summary:
4:24:53.955529 PROGRESS: Channel   0:	 0.05 FDR:   578; 0.01 FDR:   326; 0.001 FDR:   288
4:24:53.955671 PROGRESS: 
4:24:53.955745 PROGRESS: Protein Summary:
4:24:53.957902 PROGRESS: Channel   0:	 0.05 FDR:   558; 0.01 FDR:   313; 0.001 FDR:   277
4:24:53.958032 PROGRESS: =========================================================================
4:24:53.959121 PROGRESS: === Epoch 14, step 5, extracting elution groups 31000 to 63000 ===
4:24:54.096223 PROGRESS: Extracting batch of 63224 precursors
4:24:54.116563 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:24:54.116672 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:24:54.116711 INFO: FWHM in RT is 14.85 seconds, sigma is 0.54
4:24:54.116754 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:24:54.117010 INFO: Starting candidate selection
4:24:59.574886 INFO: Starting candidate scoring
4:25:01.476471 INFO: Finished candidate processing
4:25:01.476623 INFO: Collecting candidate features
4:25:03.820650 WARNING: intensity_correlation has 103 NaNs ( 0.17 % out of 60035)
4:25:03.831389 INFO: Collecting fragment features
4:25:04.539443 INFO: Finished candidate scoring
4:25:04.891590 PROGRESS: === Epoch 14, step 5, extracted 60035 precursors and 322065 fragments ===
4:25:04.892020 INFO: performing precursor FDR with 47 features
4:25:04.892623 INFO: Decoy channel: -1
4:25:04.892670 INFO: Competetive: True
4:25:05.027484 WARNING: dropped 96 target PSMs due to missing features
4:25:05.027601 WARNING: dropped 84 decoy PSMs due to missing features
4:25:08.921413 INFO: Test AUC: 0.554
4:25:08.921528 INFO: Train AUC: 0.597
4:25:08.921588 INFO: AUC difference: 7.29%
4:25:08.921615 WARNING: AUC difference > 5%. This may indicate overfitting.
4:25:09.058706 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
4:25:09.060245 PROGRESS: ============================= Precursor FDR =============================
4:25:09.060402 PROGRESS: Total precursors accumulated: 1,790
4:25:09.060481 PROGRESS: Target precursors: 1,635 (91.34%)
4:25:09.060562 PROGRESS: Decoy precursors: 155 (8.66%)
4:25:09.060628 PROGRESS: 
4:25:09.060690 PROGRESS: Precursor Summary:
4:25:09.062858 PROGRESS: Channel   0:	 0.05 FDR: 1,214; 0.01 FDR:   647; 0.001 FDR:   491
4:25:09.063013 PROGRESS: 
4:25:09.063087 PROGRESS: Protein Summary:
4:25:09.065688 PROGRESS: Channel   0:	 0.05 FDR: 1,130; 0.01 FDR:   599; 0.001 FDR:   456
4:25:09.065825 PROGRESS: =========================================================================
4:25:09.067115 PROGRESS: === Epoch 14, step 6, extracting elution groups 63000 to 127000 ===
4:25:09.243904 PROGRESS: Extracting batch of 126426 precursors
4:25:09.282168 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:25:09.282300 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:25:09.282342 INFO: FWHM in RT is 14.85 seconds, sigma is 0.54
4:25:09.282383 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:25:09.282654 INFO: Starting candidate selection
4:25:15.991500 INFO: Starting candidate scoring
4:25:18.510252 INFO: Finished candidate processing
4:25:18.510366 INFO: Collecting candidate features
4:25:21.079810 WARNING: intensity_correlation has 160 NaNs ( 0.13 % out of 120152)
4:25:21.094501 INFO: Collecting fragment features
4:25:21.876683 INFO: Finished candidate scoring
4:25:22.307839 PROGRESS: === Epoch 14, step 6, extracted 120152 precursors and 644451 fragments ===
4:25:22.308216 INFO: performing precursor FDR with 47 features
4:25:22.308263 INFO: Decoy channel: -1
4:25:22.308289 INFO: Competetive: True
4:25:22.588738 WARNING: dropped 182 target PSMs due to missing features
4:25:22.588867 WARNING: dropped 158 decoy PSMs due to missing features
4:25:31.216819 INFO: Test AUC: 0.563
4:25:31.216946 INFO: Train AUC: 0.587
4:25:31.217001 INFO: AUC difference: 4.11%
4:25:31.372910 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
4:25:31.374744 PROGRESS: ============================= Precursor FDR =============================
4:25:31.374886 PROGRESS: Total precursors accumulated: 2,709
4:25:31.374964 PROGRESS: Target precursors: 2,466 (91.03%)
4:25:31.375032 PROGRESS: Decoy precursors: 243 (8.97%)
4:25:31.375096 PROGRESS: 
4:25:31.375157 PROGRESS: Precursor Summary:
4:25:31.377619 PROGRESS: Channel   0:	 0.05 FDR: 1,824; 0.01 FDR: 1,147; 0.001 FDR:   799
4:25:31.377774 PROGRESS: 
4:25:31.377854 PROGRESS: Protein Summary:
4:25:31.381048 PROGRESS: Channel   0:	 0.05 FDR: 1,614; 0.01 FDR: 1,008; 0.001 FDR:   703
4:25:31.381163 PROGRESS: =========================================================================
4:25:31.382735 PROGRESS: === Epoch 14, step 7, extracting elution groups 127000 to 255000 ===
4:25:31.608763 PROGRESS: Extracting batch of 252812 precursors
4:25:31.683028 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:25:31.683159 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:25:31.683203 INFO: FWHM in RT is 14.85 seconds, sigma is 0.54
4:25:31.683230 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:25:31.683496 INFO: Starting candidate selection
4:25:41.082142 INFO: Starting candidate scoring
4:25:44.917032 INFO: Finished candidate processing
4:25:44.917220 INFO: Collecting candidate features
4:25:47.870731 WARNING: intensity_correlation has 344 NaNs ( 0.14 % out of 240326)
4:25:47.891598 INFO: Collecting fragment features
4:25:48.763382 INFO: Finished candidate scoring
4:25:49.351211 PROGRESS: === Epoch 14, step 7, extracted 240326 precursors and 1289498 fragments ===
4:25:49.351557 INFO: performing precursor FDR with 47 features
4:25:49.351605 INFO: Decoy channel: -1
4:25:49.351632 INFO: Competetive: True
4:25:49.948863 WARNING: dropped 360 target PSMs due to missing features
4:25:49.948981 WARNING: dropped 324 decoy PSMs due to missing features
4:26:07.618496 INFO: Test AUC: 0.556
4:26:07.618641 INFO: Train AUC: 0.577
4:26:07.618681 INFO: AUC difference: 3.70%
4:26:07.812107 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
4:26:07.814527 PROGRESS: ============================= Precursor FDR =============================
4:26:07.814689 PROGRESS: Total precursors accumulated: 4,533
4:26:07.814767 PROGRESS: Target precursors: 4,133 (91.18%)
4:26:07.814834 PROGRESS: Decoy precursors: 400 (8.82%)
4:26:07.814895 PROGRESS: 
4:26:07.814955 PROGRESS: Precursor Summary:
4:26:07.818000 PROGRESS: Channel   0:	 0.05 FDR: 3,163; 0.01 FDR: 2,201; 0.001 FDR: 1,593
4:26:07.818143 PROGRESS: 
4:26:07.818216 PROGRESS: Protein Summary:
4:26:07.822444 PROGRESS: Channel   0:	 0.05 FDR: 2,520; 0.01 FDR: 1,722; 0.001 FDR: 1,272
4:26:07.822567 PROGRESS: =========================================================================
4:26:07.824606 PROGRESS: === Epoch 14, step 8, extracting elution groups 255000 to 511000 ===
4:26:08.128143 PROGRESS: Extracting batch of 505849 precursors
4:26:08.259935 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:26:08.260069 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:26:08.260126 INFO: FWHM in RT is 14.85 seconds, sigma is 0.54
4:26:08.260155 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:26:08.260421 INFO: Starting candidate selection
4:26:22.813039 INFO: Starting candidate scoring
4:26:29.161535 INFO: Finished candidate processing
4:26:29.161725 INFO: Collecting candidate features
4:26:32.871476 WARNING: intensity_correlation has 721 NaNs ( 0.15 % out of 480616)
4:26:32.906111 INFO: Collecting fragment features
4:26:33.997051 INFO: Finished candidate scoring
4:26:34.905607 PROGRESS: === Epoch 14, step 8, extracted 480616 precursors and 2578886 fragments ===
4:26:34.906010 INFO: performing precursor FDR with 47 features
4:26:34.906061 INFO: Decoy channel: -1
4:26:34.906087 INFO: Competetive: True
4:26:36.068786 WARNING: dropped 724 target PSMs due to missing features
4:26:36.068909 WARNING: dropped 681 decoy PSMs due to missing features
4:27:11.765971 INFO: Test AUC: 0.554
4:27:11.766115 INFO: Train AUC: 0.570
4:27:11.766153 INFO: AUC difference: 2.84%
4:27:12.011946 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
4:27:12.015206 PROGRESS: ============================= Precursor FDR =============================
4:27:12.015391 PROGRESS: Total precursors accumulated: 7,794
4:27:12.015471 PROGRESS: Target precursors: 7,117 (91.31%)
4:27:12.015538 PROGRESS: Decoy precursors: 677 (8.69%)
4:27:12.015601 PROGRESS: 
4:27:12.015661 PROGRESS: Precursor Summary:
4:27:12.019969 PROGRESS: Channel   0:	 0.05 FDR: 5,776; 0.01 FDR: 4,202; 0.001 FDR: 3,348
4:27:12.020151 PROGRESS: 
4:27:12.020224 PROGRESS: Protein Summary:
4:27:12.026518 PROGRESS: Channel   0:	 0.05 FDR: 3,860; 0.01 FDR: 2,694; 0.001 FDR: 2,188
4:27:12.026674 PROGRESS: =========================================================================
4:27:12.031710 INFO: calibration group: precursor, fitting rt estimator 
4:27:12.555190 INFO: calibration group: fragment, fitting mz estimator 
4:27:13.153378 INFO: === checking if epoch conditions were reached ===
4:27:13.153646 INFO: ✅ ms2_error      : 7.0000 <= 7
4:27:13.153739 INFO: ❌ rt_error       : 199.0519 > 100
4:27:13.153824 INFO: ✅ current_epoch  : 14 >= 3
4:27:13.153891 INFO: ==============================================
4:27:13.373292 INFO: calibration group: precursor, predicting mz
4:27:13.373563 WARNING: mz prediction was skipped as it has not been fitted yet
4:27:13.373605 INFO: calibration group: precursor, predicting rt
4:27:20.121430 INFO: calibration group: fragment, predicting mz
4:27:37.989958 PROGRESS: === Epoch 15, step 0, extracting elution groups 0 to 1000 ===
4:27:38.088938 PROGRESS: Extracting batch of 1976 precursors
4:27:38.090840 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:27:38.090927 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:27:38.090965 INFO: FWHM in RT is 14.61 seconds, sigma is 0.53
4:27:38.091009 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:27:38.091242 INFO: Starting candidate selection
4:27:42.675004 INFO: Starting candidate scoring
4:27:43.979094 INFO: Finished candidate processing
4:27:43.979187 INFO: Collecting candidate features
4:27:46.161994 WARNING: intensity_correlation has 4 NaNs ( 0.21 % out of 1871)
4:27:46.168181 INFO: Collecting fragment features
4:27:46.819082 INFO: Finished candidate scoring
4:27:47.165669 PROGRESS: === Epoch 15, step 0, extracted 1871 precursors and 10025 fragments ===
4:27:47.166028 INFO: performing precursor FDR with 47 features
4:27:47.166077 INFO: Decoy channel: -1
4:27:47.166104 INFO: Competetive: True
4:27:47.171168 WARNING: dropped 1 target PSMs due to missing features
4:27:47.171239 WARNING: dropped 3 decoy PSMs due to missing features
4:27:47.200281 INFO: Test AUC: 0.464
4:27:47.200377 INFO: Train AUC: 0.570
4:27:47.200422 INFO: AUC difference: 18.57%
4:27:47.200457 WARNING: AUC difference > 5%. This may indicate overfitting.
4:27:47.322322 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
4:27:47.323102 PROGRESS: ============================= Precursor FDR =============================
4:27:47.323223 PROGRESS: Total precursors accumulated: 12
4:27:47.323301 PROGRESS: Target precursors: 11 (91.67%)
4:27:47.323369 PROGRESS: Decoy precursors: 1 (8.33%)
4:27:47.323432 PROGRESS: 
4:27:47.323494 PROGRESS: Precursor Summary:
4:27:47.324905 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
4:27:47.325033 PROGRESS: 
4:27:47.325109 PROGRESS: Protein Summary:
4:27:47.326721 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
4:27:47.326836 PROGRESS: =========================================================================
4:27:47.327690 PROGRESS: === Epoch 15, step 1, extracting elution groups 1000 to 3000 ===
4:27:47.405434 PROGRESS: Extracting batch of 3958 precursors
4:27:47.407691 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:27:47.407754 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:27:47.407792 INFO: FWHM in RT is 14.61 seconds, sigma is 0.53
4:27:47.407837 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:27:47.408048 INFO: Starting candidate selection
4:27:51.600796 INFO: Starting candidate scoring
4:27:52.909686 INFO: Finished candidate processing
4:27:52.909837 INFO: Collecting candidate features
4:27:55.106858 WARNING: intensity_correlation has 2 NaNs ( 0.05 % out of 3768)
4:27:55.113620 INFO: Collecting fragment features
4:27:55.761549 INFO: Finished candidate scoring
4:27:56.045958 PROGRESS: === Epoch 15, step 1, extracted 3768 precursors and 20152 fragments ===
4:27:56.046262 INFO: performing precursor FDR with 47 features
4:27:56.046308 INFO: Decoy channel: -1
4:27:56.046334 INFO: Competetive: True
4:27:56.055552 WARNING: dropped 3 target PSMs due to missing features
4:27:56.055646 WARNING: dropped 3 decoy PSMs due to missing features
4:27:56.094117 INFO: Test AUC: 0.569
4:27:56.094232 INFO: Train AUC: 0.544
4:27:56.094278 INFO: AUC difference: 4.58%
4:27:56.215637 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
4:27:56.216429 PROGRESS: ============================= Precursor FDR =============================
4:27:56.216556 PROGRESS: Total precursors accumulated: 30
4:27:56.216636 PROGRESS: Target precursors: 28 (93.33%)
4:27:56.216705 PROGRESS: Decoy precursors: 2 (6.67%)
4:27:56.216768 PROGRESS: 
4:27:56.216830 PROGRESS: Precursor Summary:
4:27:56.218283 PROGRESS: Channel   0:	 0.05 FDR:    25; 0.01 FDR:    24; 0.001 FDR:    24
4:27:56.218400 PROGRESS: 
4:27:56.218475 PROGRESS: Protein Summary:
4:27:56.220092 PROGRESS: Channel   0:	 0.05 FDR:    25; 0.01 FDR:    24; 0.001 FDR:    24
4:27:56.220210 PROGRESS: =========================================================================
4:27:56.221074 PROGRESS: === Epoch 15, step 2, extracting elution groups 3000 to 7000 ===
4:27:56.303437 PROGRESS: Extracting batch of 7893 precursors
4:27:56.306805 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:27:56.306872 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:27:56.306912 INFO: FWHM in RT is 14.61 seconds, sigma is 0.53
4:27:56.306942 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:27:56.307167 INFO: Starting candidate selection
4:28:00.635660 INFO: Starting candidate scoring
4:28:02.005700 INFO: Finished candidate processing
4:28:02.005827 INFO: Collecting candidate features
4:28:04.202481 WARNING: intensity_correlation has 10 NaNs ( 0.13 % out of 7452)
4:28:04.208232 INFO: Collecting fragment features
4:28:04.861988 INFO: Finished candidate scoring
4:28:05.152270 PROGRESS: === Epoch 15, step 2, extracted 7452 precursors and 39712 fragments ===
4:28:05.152621 INFO: performing precursor FDR with 47 features
4:28:05.152670 INFO: Decoy channel: -1
4:28:05.152696 INFO: Competetive: True
4:28:05.168792 WARNING: dropped 8 target PSMs due to missing features
4:28:05.168894 WARNING: dropped 8 decoy PSMs due to missing features
4:28:05.446100 INFO: Test AUC: 0.534
4:28:05.446230 INFO: Train AUC: 0.582
4:28:05.446275 INFO: AUC difference: 8.33%
4:28:05.446334 WARNING: AUC difference > 5%. This may indicate overfitting.
4:28:05.570467 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
4:28:05.571328 PROGRESS: ============================= Precursor FDR =============================
4:28:05.571448 PROGRESS: Total precursors accumulated: 100
4:28:05.571526 PROGRESS: Target precursors: 91 (91.00%)
4:28:05.571594 PROGRESS: Decoy precursors: 9 (9.00%)
4:28:05.571669 PROGRESS: 
4:28:05.571732 PROGRESS: Precursor Summary:
4:28:05.573192 PROGRESS: Channel   0:	 0.05 FDR:    63; 0.01 FDR:    57; 0.001 FDR:    57
4:28:05.573318 PROGRESS: 
4:28:05.573393 PROGRESS: Protein Summary:
4:28:05.575080 PROGRESS: Channel   0:	 0.05 FDR:    63; 0.01 FDR:    57; 0.001 FDR:    57
4:28:05.575193 PROGRESS: =========================================================================
4:28:05.576071 PROGRESS: === Epoch 15, step 3, extracting elution groups 7000 to 15000 ===
4:28:05.667648 PROGRESS: Extracting batch of 15812 precursors
4:28:05.673218 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:28:05.673286 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:28:05.673320 INFO: FWHM in RT is 14.61 seconds, sigma is 0.53
4:28:05.673362 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:28:05.673582 INFO: Starting candidate selection
4:28:10.137521 INFO: Starting candidate scoring
4:28:11.586593 INFO: Finished candidate processing
4:28:11.586687 INFO: Collecting candidate features
4:28:13.802179 WARNING: intensity_correlation has 24 NaNs ( 0.16 % out of 14993)
4:28:13.808220 INFO: Collecting fragment features
4:28:14.468347 INFO: Finished candidate scoring
4:28:14.767622 PROGRESS: === Epoch 15, step 3, extracted 14993 precursors and 80543 fragments ===
4:28:14.768000 INFO: performing precursor FDR with 47 features
4:28:14.768049 INFO: Decoy channel: -1
4:28:14.768076 INFO: Competetive: True
4:28:14.797321 WARNING: dropped 19 target PSMs due to missing features
4:28:14.797432 WARNING: dropped 21 decoy PSMs due to missing features
4:28:15.591507 INFO: Test AUC: 0.548
4:28:15.591742 INFO: Train AUC: 0.594
4:28:15.591821 INFO: AUC difference: 7.77%
4:28:15.591887 WARNING: AUC difference > 5%. This may indicate overfitting.
4:28:15.715645 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
4:28:15.716598 PROGRESS: ============================= Precursor FDR =============================
4:28:15.716718 PROGRESS: Total precursors accumulated: 327
4:28:15.716796 PROGRESS: Target precursors: 298 (91.13%)
4:28:15.716865 PROGRESS: Decoy precursors: 29 (8.87%)
4:28:15.716928 PROGRESS: 
4:28:15.716989 PROGRESS: Precursor Summary:
4:28:15.718609 PROGRESS: Channel   0:	 0.05 FDR:   221; 0.01 FDR:   124; 0.001 FDR:   116
4:28:15.718728 PROGRESS: 
4:28:15.718804 PROGRESS: Protein Summary:
4:28:15.720646 PROGRESS: Channel   0:	 0.05 FDR:   219; 0.01 FDR:   122; 0.001 FDR:   114
4:28:15.720798 PROGRESS: =========================================================================
4:28:15.721740 PROGRESS: === Epoch 15, step 4, extracting elution groups 15000 to 31000 ===
4:28:15.830509 PROGRESS: Extracting batch of 31618 precursors
4:28:15.841331 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:28:15.841426 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:28:15.841463 INFO: FWHM in RT is 14.61 seconds, sigma is 0.53
4:28:15.841490 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:28:15.841739 INFO: Starting candidate selection
4:28:20.570828 INFO: Starting candidate scoring
4:28:22.140029 INFO: Finished candidate processing
4:28:22.140122 INFO: Collecting candidate features
4:28:24.420214 WARNING: intensity_correlation has 38 NaNs ( 0.13 % out of 30007)
4:28:24.427309 INFO: Collecting fragment features
4:28:25.111991 INFO: Finished candidate scoring
4:28:25.429270 PROGRESS: === Epoch 15, step 4, extracted 30007 precursors and 160858 fragments ===
4:28:25.429622 INFO: performing precursor FDR with 47 features
4:28:25.429670 INFO: Decoy channel: -1
4:28:25.429707 INFO: Competetive: True
4:28:25.490292 WARNING: dropped 33 target PSMs due to missing features
4:28:25.490402 WARNING: dropped 45 decoy PSMs due to missing features
4:28:27.248685 INFO: Test AUC: 0.550
4:28:27.248830 INFO: Train AUC: 0.603
4:28:27.248875 INFO: AUC difference: 8.75%
4:28:27.248909 WARNING: AUC difference > 5%. This may indicate overfitting.
4:28:27.377557 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
4:28:27.378751 PROGRESS: ============================= Precursor FDR =============================
4:28:27.378883 PROGRESS: Total precursors accumulated: 814
4:28:27.378961 PROGRESS: Target precursors: 740 (90.91%)
4:28:27.379028 PROGRESS: Decoy precursors: 74 (9.09%)
4:28:27.379091 PROGRESS: 
4:28:27.379151 PROGRESS: Precursor Summary:
4:28:27.380877 PROGRESS: Channel   0:	 0.05 FDR:   449; 0.01 FDR:   241; 0.001 FDR:   221
4:28:27.380998 PROGRESS: 
4:28:27.381089 PROGRESS: Protein Summary:
4:28:27.383136 PROGRESS: Channel   0:	 0.05 FDR:   436; 0.01 FDR:   233; 0.001 FDR:   213
4:28:27.383264 PROGRESS: =========================================================================
4:28:27.384295 PROGRESS: === Epoch 15, step 5, extracting elution groups 31000 to 63000 ===
4:28:27.521370 PROGRESS: Extracting batch of 63233 precursors
4:28:27.541361 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:28:27.541469 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:28:27.541505 INFO: FWHM in RT is 14.61 seconds, sigma is 0.53
4:28:27.541548 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:28:27.541807 INFO: Starting candidate selection
4:28:32.975723 INFO: Starting candidate scoring
4:28:34.877534 INFO: Finished candidate processing
4:28:34.877744 INFO: Collecting candidate features
4:28:37.254949 WARNING: intensity_correlation has 78 NaNs ( 0.13 % out of 59842)
4:28:37.265667 INFO: Collecting fragment features
4:28:37.985329 INFO: Finished candidate scoring
4:28:38.338324 PROGRESS: === Epoch 15, step 5, extracted 59842 precursors and 320030 fragments ===
4:28:38.338680 INFO: performing precursor FDR with 47 features
4:28:38.338728 INFO: Decoy channel: -1
4:28:38.338755 INFO: Competetive: True
4:28:38.474599 WARNING: dropped 68 target PSMs due to missing features
4:28:38.474729 WARNING: dropped 88 decoy PSMs due to missing features
4:28:42.357855 INFO: Test AUC: 0.548
4:28:42.357989 INFO: Train AUC: 0.599
4:28:42.358030 INFO: AUC difference: 8.41%
4:28:42.358064 WARNING: AUC difference > 5%. This may indicate overfitting.
4:28:42.498333 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
4:28:42.499843 PROGRESS: ============================= Precursor FDR =============================
4:28:42.499998 PROGRESS: Total precursors accumulated: 1,702
4:28:42.500076 PROGRESS: Target precursors: 1,551 (91.13%)
4:28:42.500143 PROGRESS: Decoy precursors: 151 (8.87%)
4:28:42.500205 PROGRESS: 
4:28:42.500265 PROGRESS: Precursor Summary:
4:28:42.502348 PROGRESS: Channel   0:	 0.05 FDR: 1,036; 0.01 FDR:   574; 0.001 FDR:   478
4:28:42.502483 PROGRESS: 
4:28:42.502557 PROGRESS: Protein Summary:
4:28:42.505057 PROGRESS: Channel   0:	 0.05 FDR:   965; 0.01 FDR:   532; 0.001 FDR:   442
4:28:42.505191 PROGRESS: =========================================================================
4:28:42.506451 PROGRESS: === Epoch 15, step 6, extracting elution groups 63000 to 127000 ===
4:28:42.682309 PROGRESS: Extracting batch of 126479 precursors
4:28:42.721478 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:28:42.721594 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:28:42.721632 INFO: FWHM in RT is 14.61 seconds, sigma is 0.53
4:28:42.721676 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:28:42.721949 INFO: Starting candidate selection
4:28:49.417855 INFO: Starting candidate scoring
4:28:51.946053 INFO: Finished candidate processing
4:28:51.946162 INFO: Collecting candidate features
4:28:54.514894 WARNING: intensity_correlation has 133 NaNs ( 0.11 % out of 119892)
4:28:54.536404 INFO: Collecting fragment features
4:28:55.315403 INFO: Finished candidate scoring
4:28:55.748095 PROGRESS: === Epoch 15, step 6, extracted 119892 precursors and 641297 fragments ===
4:28:55.748462 INFO: performing precursor FDR with 47 features
4:28:55.748508 INFO: Decoy channel: -1
4:28:55.748535 INFO: Competetive: True
4:28:56.026794 WARNING: dropped 128 target PSMs due to missing features
4:28:56.026907 WARNING: dropped 161 decoy PSMs due to missing features
4:29:04.573425 INFO: Test AUC: 0.552
4:29:04.573553 INFO: Train AUC: 0.589
4:29:04.573610 INFO: AUC difference: 6.25%
4:29:04.573638 WARNING: AUC difference > 5%. This may indicate overfitting.
4:29:04.729487 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
4:29:04.731301 PROGRESS: ============================= Precursor FDR =============================
4:29:04.731438 PROGRESS: Total precursors accumulated: 2,714
4:29:04.731517 PROGRESS: Target precursors: 2,479 (91.34%)
4:29:04.731586 PROGRESS: Decoy precursors: 235 (8.66%)
4:29:04.731649 PROGRESS: 
4:29:04.731725 PROGRESS: Precursor Summary:
4:29:04.734081 PROGRESS: Channel   0:	 0.05 FDR: 1,746; 0.01 FDR: 1,047; 0.001 FDR:   524
4:29:04.734225 PROGRESS: 
4:29:04.734299 PROGRESS: Protein Summary:
4:29:04.737244 PROGRESS: Channel   0:	 0.05 FDR: 1,544; 0.01 FDR:   920; 0.001 FDR:   479
4:29:04.737364 PROGRESS: =========================================================================
4:29:04.738858 PROGRESS: === Epoch 15, step 7, extracting elution groups 127000 to 255000 ===
4:29:04.962117 PROGRESS: Extracting batch of 252986 precursors
4:29:05.034308 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:29:05.034446 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:29:05.034489 INFO: FWHM in RT is 14.61 seconds, sigma is 0.53
4:29:05.034518 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:29:05.034784 INFO: Starting candidate selection
4:29:14.401819 INFO: Starting candidate scoring
4:29:18.265619 INFO: Finished candidate processing
4:29:18.265831 INFO: Collecting candidate features
4:29:21.206381 WARNING: intensity_correlation has 269 NaNs ( 0.11 % out of 239886)
4:29:21.227337 INFO: Collecting fragment features
4:29:22.102016 INFO: Finished candidate scoring
4:29:22.687971 PROGRESS: === Epoch 15, step 7, extracted 239886 precursors and 1284187 fragments ===
4:29:22.688343 INFO: performing precursor FDR with 47 features
4:29:22.688387 INFO: Decoy channel: -1
4:29:22.688414 INFO: Competetive: True
4:29:23.285749 WARNING: dropped 263 target PSMs due to missing features
4:29:23.285894 WARNING: dropped 295 decoy PSMs due to missing features
4:29:41.318434 INFO: Test AUC: 0.552
4:29:41.318583 INFO: Train AUC: 0.579
4:29:41.318627 INFO: AUC difference: 4.59%
4:29:41.509375 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
4:29:41.511771 PROGRESS: ============================= Precursor FDR =============================
4:29:41.511930 PROGRESS: Total precursors accumulated: 4,733
4:29:41.512009 PROGRESS: Target precursors: 4,313 (91.13%)
4:29:41.512076 PROGRESS: Decoy precursors: 420 (8.87%)
4:29:41.512140 PROGRESS: 
4:29:41.512200 PROGRESS: Precursor Summary:
4:29:41.515496 PROGRESS: Channel   0:	 0.05 FDR: 3,606; 0.01 FDR: 2,343; 0.001 FDR: 1,735
4:29:41.515648 PROGRESS: 
4:29:41.515721 PROGRESS: Protein Summary:
4:29:41.520184 PROGRESS: Channel   0:	 0.05 FDR: 2,899; 0.01 FDR: 1,839; 0.001 FDR: 1,358
4:29:41.520320 PROGRESS: =========================================================================
4:29:41.522478 PROGRESS: === Epoch 15, step 8, extracting elution groups 255000 to 511000 ===
4:29:41.830968 PROGRESS: Extracting batch of 505769 precursors
4:29:41.965313 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:29:41.965429 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:29:41.965468 INFO: FWHM in RT is 14.61 seconds, sigma is 0.53
4:29:41.965512 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:29:41.965795 INFO: Starting candidate selection
4:29:56.551833 INFO: Starting candidate scoring
4:30:02.890103 INFO: Finished candidate processing
4:30:02.890301 INFO: Collecting candidate features
4:30:06.557385 WARNING: intensity_correlation has 572 NaNs ( 0.12 % out of 478925)
4:30:06.591975 INFO: Collecting fragment features
4:30:07.662323 INFO: Finished candidate scoring
4:30:08.563148 PROGRESS: === Epoch 15, step 8, extracted 478925 precursors and 2563441 fragments ===
4:30:08.563515 INFO: performing precursor FDR with 47 features
4:30:08.563557 INFO: Decoy channel: -1
4:30:08.563583 INFO: Competetive: True
4:30:09.705126 WARNING: dropped 535 target PSMs due to missing features
4:30:09.705250 WARNING: dropped 595 decoy PSMs due to missing features
4:30:45.616556 INFO: Test AUC: 0.554
4:30:45.616685 INFO: Train AUC: 0.570
4:30:45.616725 INFO: AUC difference: 2.87%
4:30:45.862972 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
4:30:45.866197 PROGRESS: ============================= Precursor FDR =============================
4:30:45.866360 PROGRESS: Total precursors accumulated: 7,954
4:30:45.866442 PROGRESS: Target precursors: 7,259 (91.26%)
4:30:45.866512 PROGRESS: Decoy precursors: 695 (8.74%)
4:30:45.866577 PROGRESS: 
4:30:45.866639 PROGRESS: Precursor Summary:
4:30:45.870799 PROGRESS: Channel   0:	 0.05 FDR: 5,933; 0.01 FDR: 4,217; 0.001 FDR: 3,415
4:30:45.870953 PROGRESS: 
4:30:45.871028 PROGRESS: Protein Summary:
4:30:45.877161 PROGRESS: Channel   0:	 0.05 FDR: 3,922; 0.01 FDR: 2,745; 0.001 FDR: 2,282
4:30:45.877305 PROGRESS: =========================================================================
4:30:45.882128 INFO: calibration group: precursor, fitting rt estimator 
4:30:46.390198 INFO: calibration group: fragment, fitting mz estimator 
4:30:46.975366 INFO: === checking if epoch conditions were reached ===
4:30:46.975621 INFO: ✅ ms2_error      : 7.0000 <= 7
4:30:46.975712 INFO: ❌ rt_error       : 200.3297 > 100
4:30:46.975793 INFO: ✅ current_epoch  : 15 >= 3
4:30:46.975861 INFO: ==============================================
4:30:47.193510 INFO: calibration group: precursor, predicting mz
4:30:47.193813 WARNING: mz prediction was skipped as it has not been fitted yet
4:30:47.193858 INFO: calibration group: precursor, predicting rt
4:30:53.950151 INFO: calibration group: fragment, predicting mz
4:31:11.707298 PROGRESS: === Epoch 16, step 0, extracting elution groups 0 to 1000 ===
4:31:11.808474 PROGRESS: Extracting batch of 1981 precursors
4:31:11.810335 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:31:11.810417 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:31:11.810459 INFO: FWHM in RT is 14.58 seconds, sigma is 0.53
4:31:11.810506 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:31:11.810743 INFO: Starting candidate selection
4:31:16.370693 INFO: Starting candidate scoring
4:31:17.659842 INFO: Finished candidate processing
4:31:17.659935 INFO: Collecting candidate features
4:31:19.836166 WARNING: intensity_correlation has 3 NaNs ( 0.16 % out of 1863)
4:31:19.842453 INFO: Collecting fragment features
4:31:20.485883 INFO: Finished candidate scoring
4:31:20.831965 PROGRESS: === Epoch 16, step 0, extracted 1863 precursors and 10047 fragments ===
4:31:20.832298 INFO: performing precursor FDR with 47 features
4:31:20.832342 INFO: Decoy channel: -1
4:31:20.832370 INFO: Competetive: True
4:31:20.837305 WARNING: dropped 1 target PSMs due to missing features
4:31:20.837380 WARNING: dropped 2 decoy PSMs due to missing features
4:31:20.865924 INFO: Test AUC: 0.555
4:31:20.866021 INFO: Train AUC: 0.544
4:31:20.866065 INFO: AUC difference: 2.10%
4:31:20.988248 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
4:31:20.989078 PROGRESS: ============================= Precursor FDR =============================
4:31:20.989201 PROGRESS: Total precursors accumulated: 7
4:31:20.989280 PROGRESS: Target precursors: 7 (100.00%)
4:31:20.989351 PROGRESS: Decoy precursors: 0 (0.00%)
4:31:20.989417 PROGRESS: 
4:31:20.989479 PROGRESS: Precursor Summary:
4:31:20.991025 PROGRESS: Channel   0:	 0.05 FDR:     7; 0.01 FDR:     7; 0.001 FDR:     7
4:31:20.991154 PROGRESS: 
4:31:20.991229 PROGRESS: Protein Summary:
4:31:20.992925 PROGRESS: Channel   0:	 0.05 FDR:     7; 0.01 FDR:     7; 0.001 FDR:     7
4:31:20.993053 PROGRESS: =========================================================================
4:31:20.993965 PROGRESS: === Epoch 16, step 1, extracting elution groups 1000 to 3000 ===
4:31:21.071253 PROGRESS: Extracting batch of 3946 precursors
4:31:21.073449 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:31:21.073509 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:31:21.073548 INFO: FWHM in RT is 14.58 seconds, sigma is 0.53
4:31:21.073595 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:31:21.073837 INFO: Starting candidate selection
4:31:25.319279 INFO: Starting candidate scoring
4:31:26.652220 INFO: Finished candidate processing
4:31:26.652354 INFO: Collecting candidate features
4:31:28.819049 WARNING: intensity_correlation has 1 NaNs ( 0.03 % out of 3754)
4:31:28.825354 INFO: Collecting fragment features
4:31:29.465307 INFO: Finished candidate scoring
4:31:29.745310 PROGRESS: === Epoch 16, step 1, extracted 3754 precursors and 19784 fragments ===
4:31:29.745628 INFO: performing precursor FDR with 47 features
4:31:29.745676 INFO: Decoy channel: -1
4:31:29.745703 INFO: Competetive: True
4:31:29.754441 WARNING: dropped 2 target PSMs due to missing features
4:31:29.754531 WARNING: dropped 2 decoy PSMs due to missing features
4:31:29.793664 INFO: Test AUC: 0.554
4:31:29.793790 INFO: Train AUC: 0.539
4:31:29.793837 INFO: AUC difference: 2.72%
4:31:29.914790 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
4:31:29.915595 PROGRESS: ============================= Precursor FDR =============================
4:31:29.915721 PROGRESS: Total precursors accumulated: 30
4:31:29.915799 PROGRESS: Target precursors: 28 (93.33%)
4:31:29.915867 PROGRESS: Decoy precursors: 2 (6.67%)
4:31:29.915930 PROGRESS: 
4:31:29.915990 PROGRESS: Precursor Summary:
4:31:29.917405 PROGRESS: Channel   0:	 0.05 FDR:    25; 0.01 FDR:    23; 0.001 FDR:    23
4:31:29.917514 PROGRESS: 
4:31:29.917604 PROGRESS: Protein Summary:
4:31:29.919223 PROGRESS: Channel   0:	 0.05 FDR:    25; 0.01 FDR:    23; 0.001 FDR:    23
4:31:29.919335 PROGRESS: =========================================================================
4:31:29.920186 PROGRESS: === Epoch 16, step 2, extracting elution groups 3000 to 7000 ===
4:31:30.002043 PROGRESS: Extracting batch of 7883 precursors
4:31:30.005317 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:31:30.005379 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:31:30.005417 INFO: FWHM in RT is 14.58 seconds, sigma is 0.53
4:31:30.005462 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:31:30.005684 INFO: Starting candidate selection
4:31:34.273054 INFO: Starting candidate scoring
4:31:35.625319 INFO: Finished candidate processing
4:31:35.625416 INFO: Collecting candidate features
4:31:37.804595 WARNING: intensity_correlation has 11 NaNs ( 0.15 % out of 7498)
4:31:37.810356 INFO: Collecting fragment features
4:31:38.453960 INFO: Finished candidate scoring
4:31:38.739245 PROGRESS: === Epoch 16, step 2, extracted 7498 precursors and 40291 fragments ===
4:31:38.739607 INFO: performing precursor FDR with 47 features
4:31:38.739662 INFO: Decoy channel: -1
4:31:38.739704 INFO: Competetive: True
4:31:38.755259 WARNING: dropped 6 target PSMs due to missing features
4:31:38.755358 WARNING: dropped 9 decoy PSMs due to missing features
4:31:39.018153 INFO: Test AUC: 0.520
4:31:39.018289 INFO: Train AUC: 0.584
4:31:39.018334 INFO: AUC difference: 10.90%
4:31:39.018368 WARNING: AUC difference > 5%. This may indicate overfitting.
4:31:39.137861 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
4:31:39.138734 PROGRESS: ============================= Precursor FDR =============================
4:31:39.138890 PROGRESS: Total precursors accumulated: 125
4:31:39.138983 PROGRESS: Target precursors: 115 (92.00%)
4:31:39.139059 PROGRESS: Decoy precursors: 10 (8.00%)
4:31:39.139129 PROGRESS: 
4:31:39.139196 PROGRESS: Precursor Summary:
4:31:39.140650 PROGRESS: Channel   0:	 0.05 FDR:   103; 0.01 FDR:    65; 0.001 FDR:    65
4:31:39.140767 PROGRESS: 
4:31:39.140856 PROGRESS: Protein Summary:
4:31:39.143141 PROGRESS: Channel   0:	 0.05 FDR:   102; 0.01 FDR:    65; 0.001 FDR:    65
4:31:39.143259 PROGRESS: =========================================================================
4:31:39.144130 PROGRESS: === Epoch 16, step 3, extracting elution groups 7000 to 15000 ===
4:31:39.237354 PROGRESS: Extracting batch of 15831 precursors
4:31:39.243007 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:31:39.243089 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:31:39.243131 INFO: FWHM in RT is 14.58 seconds, sigma is 0.53
4:31:39.243161 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:31:39.243395 INFO: Starting candidate selection
4:31:43.732514 INFO: Starting candidate scoring
4:31:45.177231 INFO: Finished candidate processing
4:31:45.177325 INFO: Collecting candidate features
4:31:47.419474 WARNING: intensity_correlation has 16 NaNs ( 0.11 % out of 14993)
4:31:47.425497 INFO: Collecting fragment features
4:31:48.091364 INFO: Finished candidate scoring
4:31:48.389755 PROGRESS: === Epoch 16, step 3, extracted 14993 precursors and 80326 fragments ===
4:31:48.390136 INFO: performing precursor FDR with 47 features
4:31:48.390182 INFO: Decoy channel: -1
4:31:48.390208 INFO: Competetive: True
4:31:48.420217 WARNING: dropped 13 target PSMs due to missing features
4:31:48.420327 WARNING: dropped 18 decoy PSMs due to missing features
4:31:49.250920 INFO: Test AUC: 0.541
4:31:49.251076 INFO: Train AUC: 0.597
4:31:49.251123 INFO: AUC difference: 9.37%
4:31:49.251158 WARNING: AUC difference > 5%. This may indicate overfitting.
4:31:49.407563 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
4:31:49.408482 PROGRESS: ============================= Precursor FDR =============================
4:31:49.408602 PROGRESS: Total precursors accumulated: 323
4:31:49.408676 PROGRESS: Target precursors: 295 (91.33%)
4:31:49.408742 PROGRESS: Decoy precursors: 28 (8.67%)
4:31:49.408804 PROGRESS: 
4:31:49.408863 PROGRESS: Precursor Summary:
4:31:49.410420 PROGRESS: Channel   0:	 0.05 FDR:   211; 0.01 FDR:   123; 0.001 FDR:   108
4:31:49.410545 PROGRESS: 
4:31:49.410621 PROGRESS: Protein Summary:
4:31:49.412390 PROGRESS: Channel   0:	 0.05 FDR:   206; 0.01 FDR:   120; 0.001 FDR:   106
4:31:49.412498 PROGRESS: =========================================================================
4:31:49.413404 PROGRESS: === Epoch 16, step 4, extracting elution groups 15000 to 31000 ===
4:31:49.521494 PROGRESS: Extracting batch of 31622 precursors
4:31:49.532208 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:31:49.532319 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:31:49.532359 INFO: FWHM in RT is 14.58 seconds, sigma is 0.53
4:31:49.532386 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:31:49.532626 INFO: Starting candidate selection
4:31:54.301002 INFO: Starting candidate scoring
4:31:55.887534 INFO: Finished candidate processing
4:31:55.887659 INFO: Collecting candidate features
4:31:58.144983 WARNING: intensity_correlation has 36 NaNs ( 0.12 % out of 29979)
4:31:58.152076 INFO: Collecting fragment features
4:31:58.827069 INFO: Finished candidate scoring
4:31:59.141985 PROGRESS: === Epoch 16, step 4, extracted 29979 precursors and 160127 fragments ===
4:31:59.142332 INFO: performing precursor FDR with 47 features
4:31:59.142380 INFO: Decoy channel: -1
4:31:59.142409 INFO: Competetive: True
4:31:59.201862 WARNING: dropped 35 target PSMs due to missing features
4:31:59.201974 WARNING: dropped 32 decoy PSMs due to missing features
4:32:01.149816 INFO: Test AUC: 0.561
4:32:01.149946 INFO: Train AUC: 0.601
4:32:01.149986 INFO: AUC difference: 6.66%
4:32:01.150011 WARNING: AUC difference > 5%. This may indicate overfitting.
4:32:01.274718 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
4:32:01.275866 PROGRESS: ============================= Precursor FDR =============================
4:32:01.276019 PROGRESS: Total precursors accumulated: 800
4:32:01.276097 PROGRESS: Target precursors: 731 (91.38%)
4:32:01.276166 PROGRESS: Decoy precursors: 69 (8.62%)
4:32:01.276229 PROGRESS: 
4:32:01.276290 PROGRESS: Precursor Summary:
4:32:01.278058 PROGRESS: Channel   0:	 0.05 FDR:   532; 0.01 FDR:   268; 0.001 FDR:   256
4:32:01.278176 PROGRESS: 
4:32:01.278251 PROGRESS: Protein Summary:
4:32:01.280319 PROGRESS: Channel   0:	 0.05 FDR:   515; 0.01 FDR:   262; 0.001 FDR:   250
4:32:01.280431 PROGRESS: =========================================================================
4:32:01.281458 PROGRESS: === Epoch 16, step 5, extracting elution groups 31000 to 63000 ===
4:32:01.417951 PROGRESS: Extracting batch of 63221 precursors
4:32:01.437630 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:32:01.437738 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:32:01.437784 INFO: FWHM in RT is 14.58 seconds, sigma is 0.53
4:32:01.437830 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:32:01.438085 INFO: Starting candidate selection
4:32:06.841057 INFO: Starting candidate scoring
4:32:08.722179 INFO: Finished candidate processing
4:32:08.722275 INFO: Collecting candidate features
4:32:11.067572 WARNING: intensity_correlation has 64 NaNs ( 0.11 % out of 60009)
4:32:11.077549 INFO: Collecting fragment features
4:32:11.791358 INFO: Finished candidate scoring
4:32:12.140840 PROGRESS: === Epoch 16, step 5, extracted 60009 precursors and 322331 fragments ===
4:32:12.141199 INFO: performing precursor FDR with 47 features
4:32:12.141248 INFO: Decoy channel: -1
4:32:12.141274 INFO: Competetive: True
4:32:12.275948 WARNING: dropped 69 target PSMs due to missing features
4:32:12.276063 WARNING: dropped 62 decoy PSMs due to missing features
4:32:16.228928 INFO: Test AUC: 0.557
4:32:16.229053 INFO: Train AUC: 0.598
4:32:16.229101 INFO: AUC difference: 6.73%
4:32:16.229134 WARNING: AUC difference > 5%. This may indicate overfitting.
4:32:16.365292 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
4:32:16.366706 PROGRESS: ============================= Precursor FDR =============================
4:32:16.366843 PROGRESS: Total precursors accumulated: 1,504
4:32:16.366922 PROGRESS: Target precursors: 1,372 (91.22%)
4:32:16.366991 PROGRESS: Decoy precursors: 132 (8.78%)
4:32:16.367055 PROGRESS: 
4:32:16.367116 PROGRESS: Precursor Summary:
4:32:16.369115 PROGRESS: Channel   0:	 0.05 FDR:   923; 0.01 FDR:   611; 0.001 FDR:   501
4:32:16.369251 PROGRESS: 
4:32:16.369325 PROGRESS: Protein Summary:
4:32:16.371769 PROGRESS: Channel   0:	 0.05 FDR:   857; 0.01 FDR:   569; 0.001 FDR:   469
4:32:16.371897 PROGRESS: =========================================================================
4:32:16.373152 PROGRESS: === Epoch 16, step 6, extracting elution groups 63000 to 127000 ===
4:32:16.547875 PROGRESS: Extracting batch of 126532 precursors
4:32:16.586738 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:32:16.586884 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:32:16.586938 INFO: FWHM in RT is 14.58 seconds, sigma is 0.53
4:32:16.586965 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:32:16.587222 INFO: Starting candidate selection
4:32:23.292672 INFO: Starting candidate scoring
4:32:25.807001 INFO: Finished candidate processing
4:32:25.807187 INFO: Collecting candidate features
4:32:28.371321 WARNING: intensity_correlation has 155 NaNs ( 0.13 % out of 120029)
4:32:28.384320 INFO: Collecting fragment features
4:32:29.164277 INFO: Finished candidate scoring
4:32:29.601870 PROGRESS: === Epoch 16, step 6, extracted 120029 precursors and 642599 fragments ===
4:32:29.602228 INFO: performing precursor FDR with 47 features
4:32:29.602277 INFO: Decoy channel: -1
4:32:29.602304 INFO: Competetive: True
4:32:29.882843 WARNING: dropped 148 target PSMs due to missing features
4:32:29.882967 WARNING: dropped 138 decoy PSMs due to missing features
4:32:38.390774 INFO: Test AUC: 0.553
4:32:38.390928 INFO: Train AUC: 0.591
4:32:38.390984 INFO: AUC difference: 6.43%
4:32:38.391011 WARNING: AUC difference > 5%. This may indicate overfitting.
4:32:38.544849 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
4:32:38.546588 PROGRESS: ============================= Precursor FDR =============================
4:32:38.552013 PROGRESS: Total precursors accumulated: 2,552
4:32:38.552212 PROGRESS: Target precursors: 2,328 (91.22%)
4:32:38.552359 PROGRESS: Decoy precursors: 224 (8.78%)
4:32:38.552491 PROGRESS: 
4:32:38.552619 PROGRESS: Precursor Summary:
4:32:38.558848 PROGRESS: Channel   0:	 0.05 FDR: 1,796; 0.01 FDR: 1,169; 0.001 FDR:   680
4:32:38.559163 PROGRESS: 
4:32:38.559373 PROGRESS: Protein Summary:
4:32:38.564496 PROGRESS: Channel   0:	 0.05 FDR: 1,585; 0.01 FDR: 1,019; 0.001 FDR:   607
4:32:38.564604 PROGRESS: =========================================================================
4:32:38.566146 PROGRESS: === Epoch 16, step 7, extracting elution groups 127000 to 255000 ===
4:32:38.790665 PROGRESS: Extracting batch of 252905 precursors
4:32:38.863098 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:32:38.863212 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:32:38.863252 INFO: FWHM in RT is 14.58 seconds, sigma is 0.53
4:32:38.863295 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:32:38.863555 INFO: Starting candidate selection
4:32:48.212689 INFO: Starting candidate scoring
4:32:52.037467 INFO: Finished candidate processing
4:32:52.037649 INFO: Collecting candidate features
4:32:54.993064 WARNING: intensity_correlation has 284 NaNs ( 0.12 % out of 239507)
4:32:55.013644 INFO: Collecting fragment features
4:32:55.895485 INFO: Finished candidate scoring
4:32:56.479343 PROGRESS: === Epoch 16, step 7, extracted 239507 precursors and 1284101 fragments ===
4:32:56.479735 INFO: performing precursor FDR with 47 features
4:32:56.479783 INFO: Decoy channel: -1
4:32:56.479810 INFO: Competetive: True
4:32:57.077680 WARNING: dropped 291 target PSMs due to missing features
4:32:57.077832 WARNING: dropped 279 decoy PSMs due to missing features
4:33:14.284283 INFO: Test AUC: 0.554
4:33:14.284413 INFO: Train AUC: 0.579
4:33:14.284468 INFO: AUC difference: 4.37%
4:33:14.471947 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
4:33:14.474237 PROGRESS: ============================= Precursor FDR =============================
4:33:14.474384 PROGRESS: Total precursors accumulated: 4,330
4:33:14.474462 PROGRESS: Target precursors: 3,949 (91.20%)
4:33:14.474528 PROGRESS: Decoy precursors: 381 (8.80%)
4:33:14.474590 PROGRESS: 
4:33:14.474650 PROGRESS: Precursor Summary:
4:33:14.477571 PROGRESS: Channel   0:	 0.05 FDR: 3,071; 0.01 FDR: 2,038; 0.001 FDR: 1,556
4:33:14.477724 PROGRESS: 
4:33:14.477829 PROGRESS: Protein Summary:
4:33:14.481924 PROGRESS: Channel   0:	 0.05 FDR: 2,465; 0.01 FDR: 1,619; 0.001 FDR: 1,258
4:33:14.482042 PROGRESS: =========================================================================
4:33:14.484021 PROGRESS: === Epoch 16, step 8, extracting elution groups 255000 to 511000 ===
4:33:14.791165 PROGRESS: Extracting batch of 505775 precursors
4:33:14.924831 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:33:14.924948 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:33:14.924984 INFO: FWHM in RT is 14.58 seconds, sigma is 0.53
4:33:14.925027 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:33:14.925297 INFO: Starting candidate selection
4:33:29.479101 INFO: Starting candidate scoring
4:33:35.772244 INFO: Finished candidate processing
4:33:35.772371 INFO: Collecting candidate features
4:33:39.412627 WARNING: intensity_correlation has 558 NaNs ( 0.12 % out of 479470)
4:33:39.446208 INFO: Collecting fragment features
4:33:40.517131 INFO: Finished candidate scoring
4:33:41.413137 PROGRESS: === Epoch 16, step 8, extracted 479470 precursors and 2569340 fragments ===
4:33:41.413511 INFO: performing precursor FDR with 47 features
4:33:41.413556 INFO: Decoy channel: -1
4:33:41.413583 INFO: Competetive: True
4:33:42.552324 WARNING: dropped 580 target PSMs due to missing features
4:33:42.552453 WARNING: dropped 548 decoy PSMs due to missing features
4:34:18.527146 INFO: Test AUC: 0.554
4:34:18.527277 INFO: Train AUC: 0.572
4:34:18.527316 INFO: AUC difference: 3.06%
4:34:18.770130 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
4:34:18.773353 PROGRESS: ============================= Precursor FDR =============================
4:34:18.773524 PROGRESS: Total precursors accumulated: 7,900
4:34:18.773602 PROGRESS: Target precursors: 7,213 (91.30%)
4:34:18.773668 PROGRESS: Decoy precursors: 687 (8.70%)
4:34:18.773729 PROGRESS: 
4:34:18.773800 PROGRESS: Precursor Summary:
4:34:18.777715 PROGRESS: Channel   0:	 0.05 FDR: 5,838; 0.01 FDR: 4,121; 0.001 FDR: 2,741
4:34:18.777891 PROGRESS: 
4:34:18.777965 PROGRESS: Protein Summary:
4:34:18.783895 PROGRESS: Channel   0:	 0.05 FDR: 3,923; 0.01 FDR: 2,692; 0.001 FDR: 1,919
4:34:18.784038 PROGRESS: =========================================================================
4:34:18.788731 INFO: calibration group: precursor, fitting rt estimator 
4:34:19.285535 INFO: calibration group: fragment, fitting mz estimator 
4:34:19.884419 INFO: === checking if epoch conditions were reached ===
4:34:19.884690 INFO: ✅ ms2_error      : 7.0000 <= 7
4:34:19.884781 INFO: ❌ rt_error       : 201.5978 > 100
4:34:19.884854 INFO: ✅ current_epoch  : 16 >= 3
4:34:19.884919 INFO: ==============================================
4:34:20.104483 INFO: calibration group: precursor, predicting mz
4:34:20.104739 WARNING: mz prediction was skipped as it has not been fitted yet
4:34:20.104783 INFO: calibration group: precursor, predicting rt
4:34:26.848688 INFO: calibration group: fragment, predicting mz
4:34:44.706929 PROGRESS: === Epoch 17, step 0, extracting elution groups 0 to 1000 ===
4:34:44.804976 PROGRESS: Extracting batch of 1969 precursors
4:34:44.806753 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:34:44.806833 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:34:44.806875 INFO: FWHM in RT is 14.56 seconds, sigma is 0.53
4:34:44.806906 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:34:44.807135 INFO: Starting candidate selection
4:34:49.347666 INFO: Starting candidate scoring
4:34:50.636342 INFO: Finished candidate processing
4:34:50.636434 INFO: Collecting candidate features
4:34:52.788447 WARNING: intensity_correlation has 2 NaNs ( 0.11 % out of 1855)
4:34:52.794287 INFO: Collecting fragment features
4:34:53.433939 INFO: Finished candidate scoring
4:34:53.776798 PROGRESS: === Epoch 17, step 0, extracted 1855 precursors and 10006 fragments ===
4:34:53.777152 INFO: performing precursor FDR with 47 features
4:34:53.777192 INFO: Decoy channel: -1
4:34:53.777219 INFO: Competetive: True
4:34:53.781750 WARNING: dropped 2 decoy PSMs due to missing features
4:34:53.809536 INFO: Test AUC: 0.557
4:34:53.809634 INFO: Train AUC: 0.562
4:34:53.809680 INFO: AUC difference: 0.79%
4:34:53.927872 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
4:34:53.928628 PROGRESS: ============================= Precursor FDR =============================
4:34:53.928748 PROGRESS: Total precursors accumulated: 15
4:34:53.928826 PROGRESS: Target precursors: 14 (93.33%)
4:34:53.928894 PROGRESS: Decoy precursors: 1 (6.67%)
4:34:53.928957 PROGRESS: 
4:34:53.929018 PROGRESS: Precursor Summary:
4:34:53.930434 PROGRESS: Channel   0:	 0.05 FDR:    12; 0.01 FDR:    12; 0.001 FDR:    12
4:34:53.930546 PROGRESS: 
4:34:53.930631 PROGRESS: Protein Summary:
4:34:53.932222 PROGRESS: Channel   0:	 0.05 FDR:    12; 0.01 FDR:    12; 0.001 FDR:    12
4:34:53.932332 PROGRESS: =========================================================================
4:34:53.933180 PROGRESS: === Epoch 17, step 1, extracting elution groups 1000 to 3000 ===
4:34:54.010311 PROGRESS: Extracting batch of 3957 precursors
4:34:54.012481 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:34:54.012539 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:34:54.012578 INFO: FWHM in RT is 14.56 seconds, sigma is 0.53
4:34:54.012624 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:34:54.012834 INFO: Starting candidate selection
4:34:58.277610 INFO: Starting candidate scoring
4:34:59.606555 INFO: Finished candidate processing
4:34:59.606648 INFO: Collecting candidate features
4:35:01.796354 WARNING: intensity_correlation has 3 NaNs ( 0.08 % out of 3770)
4:35:01.802464 INFO: Collecting fragment features
4:35:02.453038 INFO: Finished candidate scoring
4:35:02.736316 PROGRESS: === Epoch 17, step 1, extracted 3770 precursors and 20378 fragments ===
4:35:02.736626 INFO: performing precursor FDR with 47 features
4:35:02.736671 INFO: Decoy channel: -1
4:35:02.736697 INFO: Competetive: True
4:35:02.745450 WARNING: dropped 3 target PSMs due to missing features
4:35:02.745543 WARNING: dropped 2 decoy PSMs due to missing features
4:35:02.784814 INFO: Test AUC: 0.553
4:35:02.784935 INFO: Train AUC: 0.560
4:35:02.784979 INFO: AUC difference: 1.34%
4:35:02.905732 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
4:35:02.906542 PROGRESS: ============================= Precursor FDR =============================
4:35:02.906663 PROGRESS: Total precursors accumulated: 31
4:35:02.906740 PROGRESS: Target precursors: 29 (93.55%)
4:35:02.906808 PROGRESS: Decoy precursors: 2 (6.45%)
4:35:02.906872 PROGRESS: 
4:35:02.906933 PROGRESS: Precursor Summary:
4:35:02.908366 PROGRESS: Channel   0:	 0.05 FDR:    28; 0.01 FDR:    20; 0.001 FDR:    20
4:35:02.908494 PROGRESS: 
4:35:02.908568 PROGRESS: Protein Summary:
4:35:02.910191 PROGRESS: Channel   0:	 0.05 FDR:    28; 0.01 FDR:    20; 0.001 FDR:    20
4:35:02.910305 PROGRESS: =========================================================================
4:35:02.911160 PROGRESS: === Epoch 17, step 2, extracting elution groups 3000 to 7000 ===
4:35:02.993371 PROGRESS: Extracting batch of 7909 precursors
4:35:02.996727 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:35:02.996791 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:35:02.996829 INFO: FWHM in RT is 14.56 seconds, sigma is 0.53
4:35:02.996874 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:35:02.997093 INFO: Starting candidate selection
4:35:07.357389 INFO: Starting candidate scoring
4:35:08.729969 INFO: Finished candidate processing
4:35:08.730060 INFO: Collecting candidate features
4:35:10.926928 WARNING: intensity_correlation has 11 NaNs ( 0.15 % out of 7482)
4:35:10.932443 INFO: Collecting fragment features
4:35:11.580251 INFO: Finished candidate scoring
4:35:11.867239 PROGRESS: === Epoch 17, step 2, extracted 7482 precursors and 39944 fragments ===
4:35:11.867572 INFO: performing precursor FDR with 47 features
4:35:11.867617 INFO: Decoy channel: -1
4:35:11.867642 INFO: Competetive: True
4:35:11.883016 WARNING: dropped 8 target PSMs due to missing features
4:35:11.883116 WARNING: dropped 8 decoy PSMs due to missing features
4:35:12.126572 INFO: Test AUC: 0.541
4:35:12.126708 INFO: Train AUC: 0.581
4:35:12.126755 INFO: AUC difference: 6.77%
4:35:12.126788 WARNING: AUC difference > 5%. This may indicate overfitting.
4:35:12.251102 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
4:35:12.251956 PROGRESS: ============================= Precursor FDR =============================
4:35:12.252078 PROGRESS: Total precursors accumulated: 94
4:35:12.252156 PROGRESS: Target precursors: 86 (91.49%)
4:35:12.252225 PROGRESS: Decoy precursors: 8 (8.51%)
4:35:12.252287 PROGRESS: 
4:35:12.252348 PROGRESS: Precursor Summary:
4:35:12.253839 PROGRESS: Channel   0:	 0.05 FDR:    54; 0.01 FDR:    48; 0.001 FDR:    48
4:35:12.253954 PROGRESS: 
4:35:12.254031 PROGRESS: Protein Summary:
4:35:12.255684 PROGRESS: Channel   0:	 0.05 FDR:    54; 0.01 FDR:    48; 0.001 FDR:    48
4:35:12.255807 PROGRESS: =========================================================================
4:35:12.256686 PROGRESS: === Epoch 17, step 3, extracting elution groups 7000 to 15000 ===
4:35:12.347815 PROGRESS: Extracting batch of 15777 precursors
4:35:12.353335 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:35:12.353400 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:35:12.353435 INFO: FWHM in RT is 14.56 seconds, sigma is 0.53
4:35:12.353476 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:35:12.353693 INFO: Starting candidate selection
4:35:16.868492 INFO: Starting candidate scoring
4:35:18.307021 INFO: Finished candidate processing
4:35:18.307109 INFO: Collecting candidate features
4:35:20.540640 WARNING: intensity_correlation has 14 NaNs ( 0.09 % out of 14927)
4:35:20.546701 INFO: Collecting fragment features
4:35:21.213396 INFO: Finished candidate scoring
4:35:21.510769 PROGRESS: === Epoch 17, step 3, extracted 14927 precursors and 79945 fragments ===
4:35:21.511127 INFO: performing precursor FDR with 47 features
4:35:21.511175 INFO: Decoy channel: -1
4:35:21.511201 INFO: Competetive: True
4:35:21.540847 WARNING: dropped 16 target PSMs due to missing features
4:35:21.540984 WARNING: dropped 14 decoy PSMs due to missing features
4:35:22.210773 INFO: Test AUC: 0.555
4:35:22.211797 INFO: Train AUC: 0.594
4:35:22.211860 INFO: AUC difference: 6.44%
4:35:22.211890 WARNING: AUC difference > 5%. This may indicate overfitting.
4:35:22.338130 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
4:35:22.339119 PROGRESS: ============================= Precursor FDR =============================
4:35:22.339246 PROGRESS: Total precursors accumulated: 325
4:35:22.339323 PROGRESS: Target precursors: 298 (91.69%)
4:35:22.339403 PROGRESS: Decoy precursors: 27 (8.31%)
4:35:22.339468 PROGRESS: 
4:35:22.339529 PROGRESS: Precursor Summary:
4:35:22.341123 PROGRESS: Channel   0:	 0.05 FDR:   236; 0.01 FDR:   122; 0.001 FDR:   119
4:35:22.341238 PROGRESS: 
4:35:22.341311 PROGRESS: Protein Summary:
4:35:22.343140 PROGRESS: Channel   0:	 0.05 FDR:   233; 0.01 FDR:   120; 0.001 FDR:   117
4:35:22.343254 PROGRESS: =========================================================================
4:35:22.344183 PROGRESS: === Epoch 17, step 4, extracting elution groups 15000 to 31000 ===
4:35:22.452781 PROGRESS: Extracting batch of 31594 precursors
4:35:22.463393 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:35:22.463509 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:35:22.463550 INFO: FWHM in RT is 14.56 seconds, sigma is 0.53
4:35:22.463577 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:35:22.463818 INFO: Starting candidate selection
4:35:27.265488 INFO: Starting candidate scoring
4:35:28.849518 INFO: Finished candidate processing
4:35:28.849610 INFO: Collecting candidate features
4:35:31.098093 WARNING: intensity_correlation has 45 NaNs ( 0.15 % out of 29992)
4:35:31.104910 INFO: Collecting fragment features
4:35:31.781999 INFO: Finished candidate scoring
4:35:32.094574 PROGRESS: === Epoch 17, step 4, extracted 29992 precursors and 160658 fragments ===
4:35:32.094913 INFO: performing precursor FDR with 47 features
4:35:32.094960 INFO: Decoy channel: -1
4:35:32.094986 INFO: Competetive: True
4:35:32.154230 WARNING: dropped 38 target PSMs due to missing features
4:35:32.154343 WARNING: dropped 37 decoy PSMs due to missing features
4:35:34.109543 INFO: Test AUC: 0.554
4:35:34.109699 INFO: Train AUC: 0.604
4:35:34.109745 INFO: AUC difference: 8.16%
4:35:34.109787 WARNING: AUC difference > 5%. This may indicate overfitting.
4:35:34.239319 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
4:35:34.240442 PROGRESS: ============================= Precursor FDR =============================
4:35:34.240567 PROGRESS: Total precursors accumulated: 826
4:35:34.240645 PROGRESS: Target precursors: 754 (91.28%)
4:35:34.240712 PROGRESS: Decoy precursors: 72 (8.72%)
4:35:34.240786 PROGRESS: 
4:35:34.240847 PROGRESS: Precursor Summary:
4:35:34.242675 PROGRESS: Channel   0:	 0.05 FDR:   637; 0.01 FDR:   366; 0.001 FDR:   267
4:35:34.242798 PROGRESS: 
4:35:34.242874 PROGRESS: Protein Summary:
4:35:34.245013 PROGRESS: Channel   0:	 0.05 FDR:   610; 0.01 FDR:   350; 0.001 FDR:   255
4:35:34.245126 PROGRESS: =========================================================================
4:35:34.246237 PROGRESS: === Epoch 17, step 5, extracting elution groups 31000 to 63000 ===
4:35:34.382482 PROGRESS: Extracting batch of 63244 precursors
4:35:34.402823 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:35:34.402933 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:35:34.402971 INFO: FWHM in RT is 14.56 seconds, sigma is 0.53
4:35:34.403016 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:35:34.403262 INFO: Starting candidate selection
4:35:39.860957 INFO: Starting candidate scoring
4:35:41.742075 INFO: Finished candidate processing
4:35:41.742170 INFO: Collecting candidate features
4:35:44.085342 WARNING: intensity_correlation has 54 NaNs ( 0.09 % out of 59985)
4:35:44.094235 INFO: Collecting fragment features
4:35:44.802363 INFO: Finished candidate scoring
4:35:45.151167 PROGRESS: === Epoch 17, step 5, extracted 59985 precursors and 321453 fragments ===
4:35:45.151546 INFO: performing precursor FDR with 47 features
4:35:45.151594 INFO: Decoy channel: -1
4:35:45.151620 INFO: Competetive: True
4:35:45.285642 WARNING: dropped 71 target PSMs due to missing features
4:35:45.285754 WARNING: dropped 58 decoy PSMs due to missing features
4:35:49.383496 INFO: Test AUC: 0.559
4:35:49.383614 INFO: Train AUC: 0.598
4:35:49.383656 INFO: AUC difference: 6.56%
4:35:49.383701 WARNING: AUC difference > 5%. This may indicate overfitting.
4:35:49.518417 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
4:35:49.519847 PROGRESS: ============================= Precursor FDR =============================
4:35:49.519995 PROGRESS: Total precursors accumulated: 1,503
4:35:49.520072 PROGRESS: Target precursors: 1,370 (91.15%)
4:35:49.520139 PROGRESS: Decoy precursors: 133 (8.85%)
4:35:49.520204 PROGRESS: 
4:35:49.520265 PROGRESS: Precursor Summary:
4:35:49.522186 PROGRESS: Channel   0:	 0.05 FDR:   821; 0.01 FDR:   442; 0.001 FDR:   322
4:35:49.522310 PROGRESS: 
4:35:49.522386 PROGRESS: Protein Summary:
4:35:49.524647 PROGRESS: Channel   0:	 0.05 FDR:   764; 0.01 FDR:   413; 0.001 FDR:   307
4:35:49.524779 PROGRESS: =========================================================================
4:35:49.525932 PROGRESS: === Epoch 17, step 6, extracting elution groups 63000 to 127000 ===
4:35:49.702688 PROGRESS: Extracting batch of 126435 precursors
4:35:49.741417 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:35:49.741537 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:35:49.741576 INFO: FWHM in RT is 14.56 seconds, sigma is 0.53
4:35:49.741621 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:35:49.741896 INFO: Starting candidate selection
4:35:56.492351 INFO: Starting candidate scoring
4:35:59.049451 INFO: Finished candidate processing
4:35:59.049637 INFO: Collecting candidate features
4:36:01.585301 WARNING: intensity_correlation has 146 NaNs ( 0.12 % out of 120193)
4:36:01.599133 INFO: Collecting fragment features
4:36:02.369808 INFO: Finished candidate scoring
4:36:02.795480 PROGRESS: === Epoch 17, step 6, extracted 120193 precursors and 644403 fragments ===
4:36:02.795844 INFO: performing precursor FDR with 47 features
4:36:02.795895 INFO: Decoy channel: -1
4:36:02.795921 INFO: Competetive: True
4:36:03.071392 WARNING: dropped 134 target PSMs due to missing features
4:36:03.071509 WARNING: dropped 141 decoy PSMs due to missing features
4:36:12.023023 INFO: Test AUC: 0.556
4:36:12.023150 INFO: Train AUC: 0.588
4:36:12.023207 INFO: AUC difference: 5.54%
4:36:12.023235 WARNING: AUC difference > 5%. This may indicate overfitting.
4:36:12.178504 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
4:36:12.180215 PROGRESS: ============================= Precursor FDR =============================
4:36:12.180361 PROGRESS: Total precursors accumulated: 2,578
4:36:12.180440 PROGRESS: Target precursors: 2,354 (91.31%)
4:36:12.180507 PROGRESS: Decoy precursors: 224 (8.69%)
4:36:12.180571 PROGRESS: 
4:36:12.180634 PROGRESS: Precursor Summary:
4:36:12.182935 PROGRESS: Channel   0:	 0.05 FDR: 1,638; 0.01 FDR: 1,105; 0.001 FDR:   700
4:36:12.183071 PROGRESS: 
4:36:12.183144 PROGRESS: Protein Summary:
4:36:12.186082 PROGRESS: Channel   0:	 0.05 FDR: 1,422; 0.01 FDR:   949; 0.001 FDR:   611
4:36:12.186199 PROGRESS: =========================================================================
4:36:12.187696 PROGRESS: === Epoch 17, step 7, extracting elution groups 127000 to 255000 ===
4:36:12.410818 PROGRESS: Extracting batch of 252959 precursors
4:36:12.483295 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:36:12.483413 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:36:12.483454 INFO: FWHM in RT is 14.56 seconds, sigma is 0.53
4:36:12.483497 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:36:12.483758 INFO: Starting candidate selection
4:36:21.901007 INFO: Starting candidate scoring
4:36:25.714602 INFO: Finished candidate processing
4:36:25.714789 INFO: Collecting candidate features
4:36:28.667953 WARNING: intensity_correlation has 277 NaNs ( 0.12 % out of 240217)
4:36:28.688623 INFO: Collecting fragment features
4:36:29.563237 INFO: Finished candidate scoring
4:36:30.150499 PROGRESS: === Epoch 17, step 7, extracted 240217 precursors and 1290781 fragments ===
4:36:30.150837 INFO: performing precursor FDR with 47 features
4:36:30.150883 INFO: Decoy channel: -1
4:36:30.150910 INFO: Competetive: True
4:36:30.749121 WARNING: dropped 274 target PSMs due to missing features
4:36:30.749246 WARNING: dropped 278 decoy PSMs due to missing features
4:36:48.442078 INFO: Test AUC: 0.557
4:36:48.442228 INFO: Train AUC: 0.578
4:36:48.442269 INFO: AUC difference: 3.67%
4:36:48.627905 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
4:36:48.630205 PROGRESS: ============================= Precursor FDR =============================
4:36:48.630367 PROGRESS: Total precursors accumulated: 4,485
4:36:48.630448 PROGRESS: Target precursors: 4,086 (91.10%)
4:36:48.630516 PROGRESS: Decoy precursors: 399 (8.90%)
4:36:48.630592 PROGRESS: 
4:36:48.630656 PROGRESS: Precursor Summary:
4:36:48.633524 PROGRESS: Channel   0:	 0.05 FDR: 3,149; 0.01 FDR: 2,037; 0.001 FDR: 1,369
4:36:48.633673 PROGRESS: 
4:36:48.633744 PROGRESS: Protein Summary:
4:36:48.637871 PROGRESS: Channel   0:	 0.05 FDR: 2,476; 0.01 FDR: 1,590; 0.001 FDR: 1,115
4:36:48.637994 PROGRESS: =========================================================================
4:36:48.639958 PROGRESS: === Epoch 17, step 8, extracting elution groups 255000 to 511000 ===
4:36:48.946882 PROGRESS: Extracting batch of 505936 precursors
4:36:49.080640 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:36:49.080755 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:36:49.080793 INFO: FWHM in RT is 14.56 seconds, sigma is 0.53
4:36:49.080837 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:36:49.081105 INFO: Starting candidate selection
4:37:03.663971 INFO: Starting candidate scoring
4:37:10.069853 INFO: Finished candidate processing
4:37:10.070046 INFO: Collecting candidate features
4:37:13.733856 WARNING: intensity_correlation has 556 NaNs ( 0.12 % out of 480443)
4:37:13.768055 INFO: Collecting fragment features
4:37:14.839368 INFO: Finished candidate scoring
4:37:15.742174 PROGRESS: === Epoch 17, step 8, extracted 480443 precursors and 2569494 fragments ===
4:37:15.742537 INFO: performing precursor FDR with 47 features
4:37:15.742583 INFO: Decoy channel: -1
4:37:15.742609 INFO: Competetive: True
4:37:16.885205 WARNING: dropped 539 target PSMs due to missing features
4:37:16.885332 WARNING: dropped 569 decoy PSMs due to missing features
4:37:52.701816 INFO: Test AUC: 0.554
4:37:52.701984 INFO: Train AUC: 0.570
4:37:52.702022 INFO: AUC difference: 2.91%
4:37:52.945100 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
4:37:52.948233 PROGRESS: ============================= Precursor FDR =============================
4:37:52.948398 PROGRESS: Total precursors accumulated: 7,730
4:37:52.948477 PROGRESS: Target precursors: 7,057 (91.29%)
4:37:52.948544 PROGRESS: Decoy precursors: 673 (8.71%)
4:37:52.948605 PROGRESS: 
4:37:52.948667 PROGRESS: Precursor Summary:
4:37:52.952565 PROGRESS: Channel   0:	 0.05 FDR: 5,831; 0.01 FDR: 4,076; 0.001 FDR: 2,599
4:37:52.952730 PROGRESS: 
4:37:52.952802 PROGRESS: Protein Summary:
4:37:52.958569 PROGRESS: Channel   0:	 0.05 FDR: 3,854; 0.01 FDR: 2,644; 0.001 FDR: 1,795
4:37:52.958716 PROGRESS: =========================================================================
4:37:52.963565 INFO: calibration group: precursor, fitting rt estimator 
4:37:53.454149 INFO: calibration group: fragment, fitting mz estimator 
4:37:54.040417 INFO: === checking if epoch conditions were reached ===
4:37:54.040676 INFO: ✅ ms2_error      : 7.0000 <= 7
4:37:54.040768 INFO: ❌ rt_error       : 198.9993 > 100
4:37:54.040844 INFO: ✅ current_epoch  : 17 >= 3
4:37:54.040910 INFO: ==============================================
4:37:54.260997 INFO: calibration group: precursor, predicting mz
4:37:54.261285 WARNING: mz prediction was skipped as it has not been fitted yet
4:37:54.261327 INFO: calibration group: precursor, predicting rt
4:38:01.055600 INFO: calibration group: fragment, predicting mz
4:38:19.046550 PROGRESS: === Epoch 18, step 0, extracting elution groups 0 to 1000 ===
4:38:19.145404 PROGRESS: Extracting batch of 1978 precursors
4:38:19.147126 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:38:19.147201 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:38:19.147240 INFO: FWHM in RT is 14.63 seconds, sigma is 0.53
4:38:19.147285 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:38:19.147512 INFO: Starting candidate selection
4:38:23.774462 INFO: Starting candidate scoring
4:38:25.083577 INFO: Finished candidate processing
4:38:25.083711 INFO: Collecting candidate features
4:38:27.263943 WARNING: intensity_correlation has 2 NaNs ( 0.11 % out of 1871)
4:38:27.269852 INFO: Collecting fragment features
4:38:27.909181 INFO: Finished candidate scoring
4:38:28.258645 PROGRESS: === Epoch 18, step 0, extracted 1871 precursors and 10171 fragments ===
4:38:28.258957 INFO: performing precursor FDR with 47 features
4:38:28.259000 INFO: Decoy channel: -1
4:38:28.259028 INFO: Competetive: True
4:38:28.263814 WARNING: dropped 1 target PSMs due to missing features
4:38:28.263888 WARNING: dropped 1 decoy PSMs due to missing features
4:38:28.293393 INFO: Test AUC: 0.596
4:38:28.293491 INFO: Train AUC: 0.554
4:38:28.293535 INFO: AUC difference: 7.47%
4:38:28.293568 WARNING: AUC difference > 5%. This may indicate overfitting.
4:38:28.412776 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
4:38:28.413542 PROGRESS: ============================= Precursor FDR =============================
4:38:28.413664 PROGRESS: Total precursors accumulated: 17
4:38:28.413742 PROGRESS: Target precursors: 16 (94.12%)
4:38:28.413835 PROGRESS: Decoy precursors: 1 (5.88%)
4:38:28.413904 PROGRESS: 
4:38:28.413978 PROGRESS: Precursor Summary:
4:38:28.415394 PROGRESS: Channel   0:	 0.05 FDR:    10; 0.01 FDR:    10; 0.001 FDR:    10
4:38:28.415524 PROGRESS: 
4:38:28.415598 PROGRESS: Protein Summary:
4:38:28.417194 PROGRESS: Channel   0:	 0.05 FDR:    10; 0.01 FDR:    10; 0.001 FDR:    10
4:38:28.417307 PROGRESS: =========================================================================
4:38:28.418174 PROGRESS: === Epoch 18, step 1, extracting elution groups 1000 to 3000 ===
4:38:28.495283 PROGRESS: Extracting batch of 3955 precursors
4:38:28.497437 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:38:28.497497 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:38:28.497549 INFO: FWHM in RT is 14.63 seconds, sigma is 0.53
4:38:28.497596 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:38:28.497822 INFO: Starting candidate selection
4:38:32.740640 INFO: Starting candidate scoring
4:38:34.045967 INFO: Finished candidate processing
4:38:34.046054 INFO: Collecting candidate features
4:38:36.212008 WARNING: intensity_correlation has 5 NaNs ( 0.13 % out of 3746)
4:38:36.217937 INFO: Collecting fragment features
4:38:36.860074 INFO: Finished candidate scoring
4:38:37.140818 PROGRESS: === Epoch 18, step 1, extracted 3746 precursors and 20170 fragments ===
4:38:37.141101 INFO: performing precursor FDR with 47 features
4:38:37.141146 INFO: Decoy channel: -1
4:38:37.141173 INFO: Competetive: True
4:38:37.149882 WARNING: dropped 4 target PSMs due to missing features
4:38:37.149977 WARNING: dropped 3 decoy PSMs due to missing features
4:38:37.188059 INFO: Test AUC: 0.521
4:38:37.188179 INFO: Train AUC: 0.557
4:38:37.188222 INFO: AUC difference: 6.54%
4:38:37.188256 WARNING: AUC difference > 5%. This may indicate overfitting.
4:38:37.327709 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
4:38:37.328497 PROGRESS: ============================= Precursor FDR =============================
4:38:37.328615 PROGRESS: Total precursors accumulated: 38
4:38:37.328692 PROGRESS: Target precursors: 35 (92.11%)
4:38:37.328760 PROGRESS: Decoy precursors: 3 (7.89%)
4:38:37.328824 PROGRESS: 
4:38:37.328885 PROGRESS: Precursor Summary:
4:38:37.330325 PROGRESS: Channel   0:	 0.05 FDR:    33; 0.01 FDR:    31; 0.001 FDR:    31
4:38:37.330439 PROGRESS: 
4:38:37.330512 PROGRESS: Protein Summary:
4:38:37.332120 PROGRESS: Channel   0:	 0.05 FDR:    33; 0.01 FDR:    31; 0.001 FDR:    31
4:38:37.332231 PROGRESS: =========================================================================
4:38:37.333103 PROGRESS: === Epoch 18, step 2, extracting elution groups 3000 to 7000 ===
4:38:37.415312 PROGRESS: Extracting batch of 7902 precursors
4:38:37.418492 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:38:37.418575 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:38:37.418615 INFO: FWHM in RT is 14.63 seconds, sigma is 0.53
4:38:37.418646 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:38:37.418862 INFO: Starting candidate selection
4:38:41.707103 INFO: Starting candidate scoring
4:38:43.050362 INFO: Finished candidate processing
4:38:43.050456 INFO: Collecting candidate features
4:38:45.254492 WARNING: intensity_correlation has 11 NaNs ( 0.15 % out of 7428)
4:38:45.259969 INFO: Collecting fragment features
4:38:45.907825 INFO: Finished candidate scoring
4:38:46.193372 PROGRESS: === Epoch 18, step 2, extracted 7428 precursors and 39616 fragments ===
4:38:46.193701 INFO: performing precursor FDR with 47 features
4:38:46.193746 INFO: Decoy channel: -1
4:38:46.193784 INFO: Competetive: True
4:38:46.208695 WARNING: dropped 9 target PSMs due to missing features
4:38:46.208798 WARNING: dropped 9 decoy PSMs due to missing features
4:38:46.432326 INFO: Test AUC: 0.559
4:38:46.432463 INFO: Train AUC: 0.570
4:38:46.432508 INFO: AUC difference: 1.93%
4:38:46.556758 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
4:38:46.557569 PROGRESS: ============================= Precursor FDR =============================
4:38:46.557691 PROGRESS: Total precursors accumulated: 95
4:38:46.557767 PROGRESS: Target precursors: 87 (91.58%)
4:38:46.557864 PROGRESS: Decoy precursors: 8 (8.42%)
4:38:46.557928 PROGRESS: 
4:38:46.557990 PROGRESS: Precursor Summary:
4:38:46.559449 PROGRESS: Channel   0:	 0.05 FDR:    76; 0.01 FDR:    62; 0.001 FDR:    62
4:38:46.559561 PROGRESS: 
4:38:46.559634 PROGRESS: Protein Summary:
4:38:46.561266 PROGRESS: Channel   0:	 0.05 FDR:    76; 0.01 FDR:    62; 0.001 FDR:    62
4:38:46.561377 PROGRESS: =========================================================================
4:38:46.562285 PROGRESS: === Epoch 18, step 3, extracting elution groups 7000 to 15000 ===
4:38:46.654263 PROGRESS: Extracting batch of 15783 precursors
4:38:46.659797 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:38:46.659863 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:38:46.659897 INFO: FWHM in RT is 14.63 seconds, sigma is 0.53
4:38:46.659939 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:38:46.660160 INFO: Starting candidate selection
4:38:51.145425 INFO: Starting candidate scoring
4:38:52.579546 INFO: Finished candidate processing
4:38:52.579640 INFO: Collecting candidate features
4:38:54.788160 WARNING: intensity_correlation has 17 NaNs ( 0.11 % out of 14933)
4:38:54.794145 INFO: Collecting fragment features
4:38:55.449540 INFO: Finished candidate scoring
4:38:55.743723 PROGRESS: === Epoch 18, step 3, extracted 14933 precursors and 80296 fragments ===
4:38:55.744072 INFO: performing precursor FDR with 47 features
4:38:55.744119 INFO: Decoy channel: -1
4:38:55.744148 INFO: Competetive: True
4:38:55.772924 WARNING: dropped 21 target PSMs due to missing features
4:38:55.773039 WARNING: dropped 14 decoy PSMs due to missing features
4:38:56.430629 INFO: Test AUC: 0.546
4:38:56.430778 INFO: Train AUC: 0.589
4:38:56.430824 INFO: AUC difference: 7.21%
4:38:56.430858 WARNING: AUC difference > 5%. This may indicate overfitting.
4:38:56.558156 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
4:38:56.559084 PROGRESS: ============================= Precursor FDR =============================
4:38:56.559204 PROGRESS: Total precursors accumulated: 234
4:38:56.559279 PROGRESS: Target precursors: 214 (91.45%)
4:38:56.559344 PROGRESS: Decoy precursors: 20 (8.55%)
4:38:56.559406 PROGRESS: 
4:38:56.559465 PROGRESS: Precursor Summary:
4:38:56.560953 PROGRESS: Channel   0:	 0.05 FDR:   185; 0.01 FDR:   132; 0.001 FDR:    85
4:38:56.561066 PROGRESS: 
4:38:56.561138 PROGRESS: Protein Summary:
4:38:56.562912 PROGRESS: Channel   0:	 0.05 FDR:   182; 0.01 FDR:   130; 0.001 FDR:    85
4:38:56.563024 PROGRESS: =========================================================================
4:38:56.563947 PROGRESS: === Epoch 18, step 4, extracting elution groups 15000 to 31000 ===
4:38:56.671984 PROGRESS: Extracting batch of 31629 precursors
4:38:56.682593 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:38:56.682692 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:38:56.682732 INFO: FWHM in RT is 14.63 seconds, sigma is 0.53
4:38:56.682759 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:38:56.683002 INFO: Starting candidate selection
4:39:01.468782 INFO: Starting candidate scoring
4:39:03.052850 INFO: Finished candidate processing
4:39:03.053027 INFO: Collecting candidate features
4:39:05.340983 WARNING: intensity_correlation has 34 NaNs ( 0.11 % out of 30014)
4:39:05.348230 INFO: Collecting fragment features
4:39:06.029916 INFO: Finished candidate scoring
4:39:06.343845 PROGRESS: === Epoch 18, step 4, extracted 30014 precursors and 160145 fragments ===
4:39:06.344203 INFO: performing precursor FDR with 47 features
4:39:06.344250 INFO: Decoy channel: -1
4:39:06.344277 INFO: Competetive: True
4:39:06.404652 WARNING: dropped 40 target PSMs due to missing features
4:39:06.404768 WARNING: dropped 29 decoy PSMs due to missing features
4:39:08.222647 INFO: Test AUC: 0.545
4:39:08.222797 INFO: Train AUC: 0.602
4:39:08.222845 INFO: AUC difference: 9.48%
4:39:08.222880 WARNING: AUC difference > 5%. This may indicate overfitting.
4:39:08.351566 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
4:39:08.352624 PROGRESS: ============================= Precursor FDR =============================
4:39:08.352747 PROGRESS: Total precursors accumulated: 612
4:39:08.352824 PROGRESS: Target precursors: 559 (91.34%)
4:39:08.352893 PROGRESS: Decoy precursors: 53 (8.66%)
4:39:08.352958 PROGRESS: 
4:39:08.353019 PROGRESS: Precursor Summary:
4:39:08.354703 PROGRESS: Channel   0:	 0.05 FDR:   396; 0.01 FDR:   266; 0.001 FDR:   256
4:39:08.354819 PROGRESS: 
4:39:08.354892 PROGRESS: Protein Summary:
4:39:08.356862 PROGRESS: Channel   0:	 0.05 FDR:   381; 0.01 FDR:   255; 0.001 FDR:   245
4:39:08.356981 PROGRESS: =========================================================================
4:39:08.358011 PROGRESS: === Epoch 18, step 5, extracting elution groups 31000 to 63000 ===
4:39:08.496976 PROGRESS: Extracting batch of 63228 precursors
4:39:08.517447 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:39:08.517551 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:39:08.517589 INFO: FWHM in RT is 14.63 seconds, sigma is 0.53
4:39:08.517633 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:39:08.517899 INFO: Starting candidate selection
4:39:13.957492 INFO: Starting candidate scoring
4:39:15.847211 INFO: Finished candidate processing
4:39:15.847312 INFO: Collecting candidate features
4:39:18.202198 WARNING: intensity_correlation has 78 NaNs ( 0.13 % out of 59686)
4:39:18.211905 INFO: Collecting fragment features
4:39:18.919147 INFO: Finished candidate scoring
4:39:19.266897 PROGRESS: === Epoch 18, step 5, extracted 59686 precursors and 319712 fragments ===
4:39:19.267256 INFO: performing precursor FDR with 47 features
4:39:19.267306 INFO: Decoy channel: -1
4:39:19.267337 INFO: Competetive: True
4:39:19.398406 WARNING: dropped 88 target PSMs due to missing features
4:39:19.398527 WARNING: dropped 59 decoy PSMs due to missing features
4:39:23.185115 INFO: Test AUC: 0.557
4:39:23.185237 INFO: Train AUC: 0.599
4:39:23.185276 INFO: AUC difference: 6.98%
4:39:23.185304 WARNING: AUC difference > 5%. This may indicate overfitting.
4:39:23.319425 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
4:39:23.320812 PROGRESS: ============================= Precursor FDR =============================
4:39:23.320959 PROGRESS: Total precursors accumulated: 1,490
4:39:23.321036 PROGRESS: Target precursors: 1,361 (91.34%)
4:39:23.321105 PROGRESS: Decoy precursors: 129 (8.66%)
4:39:23.321169 PROGRESS: 
4:39:23.321229 PROGRESS: Precursor Summary:
4:39:23.323151 PROGRESS: Channel   0:	 0.05 FDR:   901; 0.01 FDR:   530; 0.001 FDR:   391
4:39:23.323285 PROGRESS: 
4:39:23.323359 PROGRESS: Protein Summary:
4:39:23.325674 PROGRESS: Channel   0:	 0.05 FDR:   844; 0.01 FDR:   493; 0.001 FDR:   372
4:39:23.325812 PROGRESS: =========================================================================
4:39:23.327003 PROGRESS: === Epoch 18, step 6, extracting elution groups 63000 to 127000 ===
4:39:23.501976 PROGRESS: Extracting batch of 126474 precursors
4:39:23.540121 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:39:23.540236 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:39:23.540273 INFO: FWHM in RT is 14.63 seconds, sigma is 0.53
4:39:23.540317 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:39:23.540580 INFO: Starting candidate selection
4:39:30.295588 INFO: Starting candidate scoring
4:39:32.795127 INFO: Finished candidate processing
4:39:32.795225 INFO: Collecting candidate features
4:39:35.327635 WARNING: intensity_correlation has 129 NaNs ( 0.11 % out of 119683)
4:39:35.340537 INFO: Collecting fragment features
4:39:36.110470 INFO: Finished candidate scoring
4:39:36.539495 PROGRESS: === Epoch 18, step 6, extracted 119683 precursors and 639643 fragments ===
4:39:36.539876 INFO: performing precursor FDR with 47 features
4:39:36.539925 INFO: Decoy channel: -1
4:39:36.539951 INFO: Competetive: True
4:39:36.813019 WARNING: dropped 160 target PSMs due to missing features
4:39:36.813137 WARNING: dropped 116 decoy PSMs due to missing features
4:39:45.091605 INFO: Test AUC: 0.552
4:39:45.091735 INFO: Train AUC: 0.590
4:39:45.091792 INFO: AUC difference: 6.42%
4:39:45.091820 WARNING: AUC difference > 5%. This may indicate overfitting.
4:39:45.247191 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
4:39:45.248804 PROGRESS: ============================= Precursor FDR =============================
4:39:45.248951 PROGRESS: Total precursors accumulated: 2,120
4:39:45.249030 PROGRESS: Target precursors: 1,935 (91.27%)
4:39:45.249112 PROGRESS: Decoy precursors: 185 (8.73%)
4:39:45.249176 PROGRESS: 
4:39:45.249236 PROGRESS: Precursor Summary:
4:39:45.251516 PROGRESS: Channel   0:	 0.05 FDR: 1,445; 0.01 FDR:   987; 0.001 FDR:   745
4:39:45.251661 PROGRESS: 
4:39:45.251736 PROGRESS: Protein Summary:
4:39:45.254632 PROGRESS: Channel   0:	 0.05 FDR: 1,279; 0.01 FDR:   865; 0.001 FDR:   663
4:39:45.254748 PROGRESS: =========================================================================
4:39:45.256193 PROGRESS: === Epoch 18, step 7, extracting elution groups 127000 to 255000 ===
4:39:45.482804 PROGRESS: Extracting batch of 252923 precursors
4:39:45.555601 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:39:45.555720 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:39:45.555757 INFO: FWHM in RT is 14.63 seconds, sigma is 0.53
4:39:45.555800 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:39:45.556066 INFO: Starting candidate selection
4:39:54.902461 INFO: Starting candidate scoring
4:39:58.702464 INFO: Finished candidate processing
4:39:58.702647 INFO: Collecting candidate features
4:40:01.648302 WARNING: intensity_correlation has 299 NaNs ( 0.12 % out of 239202)
4:40:01.668660 INFO: Collecting fragment features
4:40:02.544394 INFO: Finished candidate scoring
4:40:03.129332 PROGRESS: === Epoch 18, step 7, extracted 239202 precursors and 1278937 fragments ===
4:40:03.129705 INFO: performing precursor FDR with 47 features
4:40:03.129751 INFO: Decoy channel: -1
4:40:03.129786 INFO: Competetive: True
4:40:03.727529 WARNING: dropped 311 target PSMs due to missing features
4:40:03.727655 WARNING: dropped 264 decoy PSMs due to missing features
4:40:21.650892 INFO: Test AUC: 0.551
4:40:21.651022 INFO: Train AUC: 0.580
4:40:21.651080 INFO: AUC difference: 4.96%
4:40:21.833566 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
4:40:21.835627 PROGRESS: ============================= Precursor FDR =============================
4:40:21.835789 PROGRESS: Total precursors accumulated: 3,733
4:40:21.835871 PROGRESS: Target precursors: 3,405 (91.21%)
4:40:21.835941 PROGRESS: Decoy precursors: 328 (8.79%)
4:40:21.836004 PROGRESS: 
4:40:21.836065 PROGRESS: Precursor Summary:
4:40:21.838836 PROGRESS: Channel   0:	 0.05 FDR: 2,701; 0.01 FDR: 1,912; 0.001 FDR: 1,013
4:40:21.838990 PROGRESS: 
4:40:21.839062 PROGRESS: Protein Summary:
4:40:21.842700 PROGRESS: Channel   0:	 0.05 FDR: 2,187; 0.01 FDR: 1,523; 0.001 FDR:   844
4:40:21.842817 PROGRESS: =========================================================================
4:40:21.844752 PROGRESS: === Epoch 18, step 8, extracting elution groups 255000 to 511000 ===
4:40:22.153418 PROGRESS: Extracting batch of 505814 precursors
4:40:22.286548 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:40:22.286668 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:40:22.286705 INFO: FWHM in RT is 14.63 seconds, sigma is 0.53
4:40:22.286748 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:40:22.287010 INFO: Starting candidate selection
4:40:36.892664 INFO: Starting candidate scoring
4:40:43.260834 INFO: Finished candidate processing
4:40:43.261027 INFO: Collecting candidate features
4:40:46.960717 WARNING: intensity_correlation has 576 NaNs ( 0.12 % out of 478766)
4:40:46.995027 INFO: Collecting fragment features
4:40:48.075974 INFO: Finished candidate scoring
4:40:48.982535 PROGRESS: === Epoch 18, step 8, extracted 478766 precursors and 2561379 fragments ===
4:40:48.982924 INFO: performing precursor FDR with 47 features
4:40:48.982967 INFO: Decoy channel: -1
4:40:48.982994 INFO: Competetive: True
4:40:50.139463 WARNING: dropped 612 target PSMs due to missing features
4:40:50.139587 WARNING: dropped 539 decoy PSMs due to missing features
4:41:25.633834 INFO: Test AUC: 0.553
4:41:25.633974 INFO: Train AUC: 0.572
4:41:25.634010 INFO: AUC difference: 3.26%
4:41:25.875850 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
4:41:25.878802 PROGRESS: ============================= Precursor FDR =============================
4:41:25.879004 PROGRESS: Total precursors accumulated: 7,328
4:41:25.879083 PROGRESS: Target precursors: 6,678 (91.13%)
4:41:25.879152 PROGRESS: Decoy precursors: 650 (8.87%)
4:41:25.879216 PROGRESS: 
4:41:25.879277 PROGRESS: Precursor Summary:
4:41:25.883116 PROGRESS: Channel   0:	 0.05 FDR: 5,507; 0.01 FDR: 4,083; 0.001 FDR: 2,465
4:41:25.883274 PROGRESS: 
4:41:25.883347 PROGRESS: Protein Summary:
4:41:25.888980 PROGRESS: Channel   0:	 0.05 FDR: 3,688; 0.01 FDR: 2,666; 0.001 FDR: 1,735
4:41:25.889117 PROGRESS: =========================================================================
4:41:25.893840 INFO: calibration group: precursor, fitting rt estimator 
4:41:26.389928 INFO: calibration group: fragment, fitting mz estimator 
4:41:26.974899 INFO: === checking if epoch conditions were reached ===
4:41:26.975141 INFO: ✅ ms2_error      : 7.0000 <= 7
4:41:26.975230 INFO: ❌ rt_error       : 199.4016 > 100
4:41:26.975303 INFO: ✅ current_epoch  : 18 >= 3
4:41:26.975367 INFO: ==============================================
4:41:27.193554 INFO: calibration group: precursor, predicting mz
4:41:27.193826 WARNING: mz prediction was skipped as it has not been fitted yet
4:41:27.193870 INFO: calibration group: precursor, predicting rt
4:41:34.018918 INFO: calibration group: fragment, predicting mz
4:41:51.840817 PROGRESS: === Epoch 19, step 0, extracting elution groups 0 to 1000 ===
4:41:51.939117 PROGRESS: Extracting batch of 1958 precursors
4:41:51.940800 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:41:51.940877 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:41:51.940920 INFO: FWHM in RT is 14.72 seconds, sigma is 0.54
4:41:51.940966 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:41:51.941192 INFO: Starting candidate selection
4:41:56.493708 INFO: Starting candidate scoring
4:41:57.786421 INFO: Finished candidate processing
4:41:57.786514 INFO: Collecting candidate features
4:41:59.937525 WARNING: intensity_correlation has 1 NaNs ( 0.05 % out of 1843)
4:41:59.943232 INFO: Collecting fragment features
4:42:00.574138 INFO: Finished candidate scoring
4:42:00.915329 PROGRESS: === Epoch 19, step 0, extracted 1843 precursors and 9785 fragments ===
4:42:00.915646 INFO: performing precursor FDR with 47 features
4:42:00.915687 INFO: Decoy channel: -1
4:42:00.915714 INFO: Competetive: True
4:42:00.920182 WARNING: dropped 1 decoy PSMs due to missing features
4:42:00.947813 INFO: Test AUC: 0.573
4:42:00.947918 INFO: Train AUC: 0.548
4:42:00.947976 INFO: AUC difference: 4.51%
4:42:01.068061 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
4:42:01.068835 PROGRESS: ============================= Precursor FDR =============================
4:42:01.068975 PROGRESS: Total precursors accumulated: 8
4:42:01.069083 PROGRESS: Target precursors: 8 (100.00%)
4:42:01.069170 PROGRESS: Decoy precursors: 0 (0.00%)
4:42:01.069249 PROGRESS: 
4:42:01.069325 PROGRESS: Precursor Summary:
4:42:01.070840 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
4:42:01.070967 PROGRESS: 
4:42:01.071069 PROGRESS: Protein Summary:
4:42:01.072714 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
4:42:01.072836 PROGRESS: =========================================================================
4:42:01.073711 PROGRESS: === Epoch 19, step 1, extracting elution groups 1000 to 3000 ===
4:42:01.151460 PROGRESS: Extracting batch of 3953 precursors
4:42:01.153498 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:42:01.153558 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:42:01.153603 INFO: FWHM in RT is 14.72 seconds, sigma is 0.54
4:42:01.153653 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:42:01.153924 INFO: Starting candidate selection
4:42:05.382328 INFO: Starting candidate scoring
4:42:06.688827 INFO: Finished candidate processing
4:42:06.689008 INFO: Collecting candidate features
4:42:08.854936 WARNING: intensity_correlation has 5 NaNs ( 0.13 % out of 3762)
4:42:08.861760 INFO: Collecting fragment features
4:42:09.509589 INFO: Finished candidate scoring
4:42:09.791587 PROGRESS: === Epoch 19, step 1, extracted 3762 precursors and 19923 fragments ===
4:42:09.791873 INFO: performing precursor FDR with 47 features
4:42:09.791919 INFO: Decoy channel: -1
4:42:09.791945 INFO: Competetive: True
4:42:09.800671 WARNING: dropped 3 target PSMs due to missing features
4:42:09.800761 WARNING: dropped 3 decoy PSMs due to missing features
4:42:09.838224 INFO: Test AUC: 0.540
4:42:09.838341 INFO: Train AUC: 0.547
4:42:09.838386 INFO: AUC difference: 1.41%
4:42:09.959873 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
4:42:09.960647 PROGRESS: ============================= Precursor FDR =============================
4:42:09.960772 PROGRESS: Total precursors accumulated: 29
4:42:09.960850 PROGRESS: Target precursors: 27 (93.10%)
4:42:09.960918 PROGRESS: Decoy precursors: 2 (6.90%)
4:42:09.960982 PROGRESS: 
4:42:09.961044 PROGRESS: Precursor Summary:
4:42:09.962474 PROGRESS: Channel   0:	 0.05 FDR:    25; 0.01 FDR:    22; 0.001 FDR:    22
4:42:09.962601 PROGRESS: 
4:42:09.962675 PROGRESS: Protein Summary:
4:42:09.964281 PROGRESS: Channel   0:	 0.05 FDR:    25; 0.01 FDR:    22; 0.001 FDR:    22
4:42:09.964393 PROGRESS: =========================================================================
4:42:09.965251 PROGRESS: === Epoch 19, step 2, extracting elution groups 3000 to 7000 ===
4:42:10.046899 PROGRESS: Extracting batch of 7914 precursors
4:42:10.050161 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:42:10.050228 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:42:10.050271 INFO: FWHM in RT is 14.72 seconds, sigma is 0.54
4:42:10.050306 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:42:10.050529 INFO: Starting candidate selection
4:42:14.404267 INFO: Starting candidate scoring
4:42:15.750818 INFO: Finished candidate processing
4:42:15.750916 INFO: Collecting candidate features
4:42:17.950330 WARNING: intensity_correlation has 12 NaNs ( 0.16 % out of 7545)
4:42:17.955858 INFO: Collecting fragment features
4:42:18.602535 INFO: Finished candidate scoring
4:42:18.888117 PROGRESS: === Epoch 19, step 2, extracted 7545 precursors and 40628 fragments ===
4:42:18.888443 INFO: performing precursor FDR with 47 features
4:42:18.888488 INFO: Decoy channel: -1
4:42:18.888514 INFO: Competetive: True
4:42:18.903749 WARNING: dropped 10 target PSMs due to missing features
4:42:18.903866 WARNING: dropped 8 decoy PSMs due to missing features
4:42:19.159907 INFO: Test AUC: 0.567
4:42:19.160045 INFO: Train AUC: 0.580
4:42:19.160092 INFO: AUC difference: 2.36%
4:42:19.276881 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
4:42:19.277724 PROGRESS: ============================= Precursor FDR =============================
4:42:19.277865 PROGRESS: Total precursors accumulated: 103
4:42:19.277945 PROGRESS: Target precursors: 94 (91.26%)
4:42:19.278013 PROGRESS: Decoy precursors: 9 (8.74%)
4:42:19.278076 PROGRESS: 
4:42:19.278137 PROGRESS: Precursor Summary:
4:42:19.279594 PROGRESS: Channel   0:	 0.05 FDR:    88; 0.01 FDR:    55; 0.001 FDR:    55
4:42:19.279718 PROGRESS: 
4:42:19.279791 PROGRESS: Protein Summary:
4:42:19.281453 PROGRESS: Channel   0:	 0.05 FDR:    88; 0.01 FDR:    55; 0.001 FDR:    55
4:42:19.281563 PROGRESS: =========================================================================
4:42:19.282450 PROGRESS: === Epoch 19, step 3, extracting elution groups 7000 to 15000 ===
4:42:19.376176 PROGRESS: Extracting batch of 15793 precursors
4:42:19.381732 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:42:19.381812 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:42:19.381866 INFO: FWHM in RT is 14.72 seconds, sigma is 0.54
4:42:19.381892 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:42:19.382116 INFO: Starting candidate selection
4:42:23.883419 INFO: Starting candidate scoring
4:42:25.309877 INFO: Finished candidate processing
4:42:25.310024 INFO: Collecting candidate features
4:42:27.535325 WARNING: intensity_correlation has 14 NaNs ( 0.09 % out of 15034)
4:42:27.541252 INFO: Collecting fragment features
4:42:28.201029 INFO: Finished candidate scoring
4:42:28.495651 PROGRESS: === Epoch 19, step 3, extracted 15034 precursors and 80201 fragments ===
4:42:28.495998 INFO: performing precursor FDR with 47 features
4:42:28.496046 INFO: Decoy channel: -1
4:42:28.496072 INFO: Competetive: True
4:42:28.524610 WARNING: dropped 16 target PSMs due to missing features
4:42:28.524729 WARNING: dropped 16 decoy PSMs due to missing features
4:42:29.253007 INFO: Test AUC: 0.557
4:42:29.253161 INFO: Train AUC: 0.603
4:42:29.253208 INFO: AUC difference: 7.61%
4:42:29.253242 WARNING: AUC difference > 5%. This may indicate overfitting.
4:42:29.373955 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
4:42:29.374916 PROGRESS: ============================= Precursor FDR =============================
4:42:29.375041 PROGRESS: Total precursors accumulated: 365
4:42:29.375118 PROGRESS: Target precursors: 333 (91.23%)
4:42:29.375185 PROGRESS: Decoy precursors: 32 (8.77%)
4:42:29.375248 PROGRESS: 
4:42:29.375309 PROGRESS: Precursor Summary:
4:42:29.376857 PROGRESS: Channel   0:	 0.05 FDR:   247; 0.01 FDR:   146; 0.001 FDR:    96
4:42:29.376985 PROGRESS: 
4:42:29.377059 PROGRESS: Protein Summary:
4:42:29.378867 PROGRESS: Channel   0:	 0.05 FDR:   245; 0.01 FDR:   146; 0.001 FDR:    96
4:42:29.379004 PROGRESS: =========================================================================
4:42:29.379934 PROGRESS: === Epoch 19, step 4, extracting elution groups 15000 to 31000 ===
4:42:29.487747 PROGRESS: Extracting batch of 31572 precursors
4:42:29.498149 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:42:29.498243 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:42:29.498282 INFO: FWHM in RT is 14.72 seconds, sigma is 0.54
4:42:29.498313 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:42:29.498549 INFO: Starting candidate selection
4:42:34.301111 INFO: Starting candidate scoring
4:42:35.886237 INFO: Finished candidate processing
4:42:35.886397 INFO: Collecting candidate features
4:42:38.135182 WARNING: intensity_correlation has 41 NaNs ( 0.14 % out of 29999)
4:42:38.142612 INFO: Collecting fragment features
4:42:38.818123 INFO: Finished candidate scoring
4:42:39.130854 PROGRESS: === Epoch 19, step 4, extracted 29999 precursors and 160918 fragments ===
4:42:39.131192 INFO: performing precursor FDR with 47 features
4:42:39.131239 INFO: Decoy channel: -1
4:42:39.131265 INFO: Competetive: True
4:42:39.191700 WARNING: dropped 32 target PSMs due to missing features
4:42:39.191812 WARNING: dropped 41 decoy PSMs due to missing features
4:42:41.085207 INFO: Test AUC: 0.565
4:42:41.085361 INFO: Train AUC: 0.608
4:42:41.085409 INFO: AUC difference: 7.18%
4:42:41.085443 WARNING: AUC difference > 5%. This may indicate overfitting.
4:42:41.215155 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
4:42:41.216220 PROGRESS: ============================= Precursor FDR =============================
4:42:41.216341 PROGRESS: Total precursors accumulated: 815
4:42:41.216427 PROGRESS: Target precursors: 742 (91.04%)
4:42:41.216496 PROGRESS: Decoy precursors: 73 (8.96%)
4:42:41.216557 PROGRESS: 
4:42:41.216616 PROGRESS: Precursor Summary:
4:42:41.218321 PROGRESS: Channel   0:	 0.05 FDR:   467; 0.01 FDR:   291; 0.001 FDR:   261
4:42:41.218438 PROGRESS: 
4:42:41.218511 PROGRESS: Protein Summary:
4:42:41.220496 PROGRESS: Channel   0:	 0.05 FDR:   455; 0.01 FDR:   284; 0.001 FDR:   256
4:42:41.220606 PROGRESS: =========================================================================
4:42:41.221615 PROGRESS: === Epoch 19, step 5, extracting elution groups 31000 to 63000 ===
4:42:41.357485 PROGRESS: Extracting batch of 63262 precursors
4:42:41.377163 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:42:41.377270 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:42:41.377321 INFO: FWHM in RT is 14.72 seconds, sigma is 0.54
4:42:41.377347 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:42:41.377584 INFO: Starting candidate selection
4:42:46.880559 INFO: Starting candidate scoring
4:42:48.798542 INFO: Finished candidate processing
4:42:48.798674 INFO: Collecting candidate features
4:42:51.147079 WARNING: intensity_correlation has 89 NaNs ( 0.15 % out of 60127)
4:42:51.157097 INFO: Collecting fragment features
4:42:51.869055 INFO: Finished candidate scoring
4:42:52.215938 PROGRESS: === Epoch 19, step 5, extracted 60127 precursors and 321478 fragments ===
4:42:52.216277 INFO: performing precursor FDR with 47 features
4:42:52.216322 INFO: Decoy channel: -1
4:42:52.216347 INFO: Competetive: True
4:42:52.349747 WARNING: dropped 76 target PSMs due to missing features
4:42:52.349881 WARNING: dropped 86 decoy PSMs due to missing features
4:42:56.397724 INFO: Test AUC: 0.557
4:42:56.397891 INFO: Train AUC: 0.602
4:42:56.397934 INFO: AUC difference: 7.52%
4:42:56.397964 WARNING: AUC difference > 5%. This may indicate overfitting.
4:42:56.543056 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
4:42:56.544400 PROGRESS: ============================= Precursor FDR =============================
4:42:56.544547 PROGRESS: Total precursors accumulated: 1,388
4:42:56.544625 PROGRESS: Target precursors: 1,267 (91.28%)
4:42:56.544692 PROGRESS: Decoy precursors: 121 (8.72%)
4:42:56.544755 PROGRESS: 
4:42:56.544815 PROGRESS: Precursor Summary:
4:42:56.546742 PROGRESS: Channel   0:	 0.05 FDR:   868; 0.01 FDR:   512; 0.001 FDR:   434
4:42:56.546865 PROGRESS: 
4:42:56.546952 PROGRESS: Protein Summary:
4:42:56.549289 PROGRESS: Channel   0:	 0.05 FDR:   822; 0.01 FDR:   483; 0.001 FDR:   412
4:42:56.549404 PROGRESS: =========================================================================
4:42:56.550578 PROGRESS: === Epoch 19, step 6, extracting elution groups 63000 to 127000 ===
4:42:56.727271 PROGRESS: Extracting batch of 126488 precursors
4:42:56.766341 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:42:56.766461 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:42:56.766501 INFO: FWHM in RT is 14.72 seconds, sigma is 0.54
4:42:56.766527 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:42:56.766789 INFO: Starting candidate selection
4:43:03.524660 INFO: Starting candidate scoring
4:43:06.037209 INFO: Finished candidate processing
4:43:06.037331 INFO: Collecting candidate features
4:43:08.601237 WARNING: intensity_correlation has 153 NaNs ( 0.13 % out of 119950)
4:43:08.614333 INFO: Collecting fragment features
4:43:09.393361 INFO: Finished candidate scoring
4:43:09.828037 PROGRESS: === Epoch 19, step 6, extracted 119950 precursors and 643368 fragments ===
4:43:09.828384 INFO: performing precursor FDR with 47 features
4:43:09.828432 INFO: Decoy channel: -1
4:43:09.828458 INFO: Competetive: True
4:43:10.108099 WARNING: dropped 154 target PSMs due to missing features
4:43:10.108245 WARNING: dropped 161 decoy PSMs due to missing features
4:43:18.670191 INFO: Test AUC: 0.555
4:43:18.670335 INFO: Train AUC: 0.589
4:43:18.670375 INFO: AUC difference: 5.83%
4:43:18.670402 WARNING: AUC difference > 5%. This may indicate overfitting.
4:43:18.824540 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
4:43:18.826226 PROGRESS: ============================= Precursor FDR =============================
4:43:18.826375 PROGRESS: Total precursors accumulated: 2,471
4:43:18.826452 PROGRESS: Target precursors: 2,249 (91.02%)
4:43:18.826520 PROGRESS: Decoy precursors: 222 (8.98%)
4:43:18.826583 PROGRESS: 
4:43:18.826644 PROGRESS: Precursor Summary:
4:43:18.828901 PROGRESS: Channel   0:	 0.05 FDR: 1,632; 0.01 FDR: 1,101; 0.001 FDR:   827
4:43:18.829040 PROGRESS: 
4:43:18.829114 PROGRESS: Protein Summary:
4:43:18.832027 PROGRESS: Channel   0:	 0.05 FDR: 1,442; 0.01 FDR:   961; 0.001 FDR:   728
4:43:18.832156 PROGRESS: =========================================================================
4:43:18.833631 PROGRESS: === Epoch 19, step 7, extracting elution groups 127000 to 255000 ===
4:43:19.057208 PROGRESS: Extracting batch of 252955 precursors
4:43:19.129346 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:43:19.129458 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:43:19.129495 INFO: FWHM in RT is 14.72 seconds, sigma is 0.54
4:43:19.129538 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:43:19.129815 INFO: Starting candidate selection
4:43:28.520775 INFO: Starting candidate scoring
4:43:32.349637 INFO: Finished candidate processing
4:43:32.349839 INFO: Collecting candidate features
4:43:35.313928 WARNING: intensity_correlation has 310 NaNs ( 0.13 % out of 239969)
4:43:35.335054 INFO: Collecting fragment features
4:43:36.218397 INFO: Finished candidate scoring
4:43:36.800373 PROGRESS: === Epoch 19, step 7, extracted 239969 precursors and 1286804 fragments ===
4:43:36.800732 INFO: performing precursor FDR with 47 features
4:43:36.800777 INFO: Decoy channel: -1
4:43:36.800803 INFO: Competetive: True
4:43:37.399336 WARNING: dropped 301 target PSMs due to missing features
4:43:37.399457 WARNING: dropped 324 decoy PSMs due to missing features
4:43:54.938045 INFO: Test AUC: 0.554
4:43:54.938193 INFO: Train AUC: 0.580
4:43:54.938235 INFO: AUC difference: 4.38%
4:43:55.123953 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
4:43:55.126208 PROGRESS: ============================= Precursor FDR =============================
4:43:55.126362 PROGRESS: Total precursors accumulated: 4,264
4:43:55.126441 PROGRESS: Target precursors: 3,887 (91.16%)
4:43:55.126509 PROGRESS: Decoy precursors: 377 (8.84%)
4:43:55.126571 PROGRESS: 
4:43:55.126633 PROGRESS: Precursor Summary:
4:43:55.129509 PROGRESS: Channel   0:	 0.05 FDR: 3,151; 0.01 FDR: 2,131; 0.001 FDR: 1,532
4:43:55.129651 PROGRESS: 
4:43:55.129723 PROGRESS: Protein Summary:
4:43:55.133821 PROGRESS: Channel   0:	 0.05 FDR: 2,524; 0.01 FDR: 1,681; 0.001 FDR: 1,224
4:43:55.133938 PROGRESS: =========================================================================
4:43:55.135895 PROGRESS: === Epoch 19, step 8, extracting elution groups 255000 to 511000 ===
4:43:55.443088 PROGRESS: Extracting batch of 505900 precursors
4:43:55.576626 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:43:55.576744 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:43:55.576783 INFO: FWHM in RT is 14.72 seconds, sigma is 0.54
4:43:55.576826 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:43:55.577087 INFO: Starting candidate selection
4:44:10.148489 INFO: Starting candidate scoring
4:44:16.494900 INFO: Finished candidate processing
4:44:16.495138 INFO: Collecting candidate features
4:44:20.155209 WARNING: intensity_correlation has 675 NaNs ( 0.14 % out of 479935)
4:44:20.189322 INFO: Collecting fragment features
4:44:21.258028 INFO: Finished candidate scoring
4:44:22.151236 PROGRESS: === Epoch 19, step 8, extracted 479935 precursors and 2569864 fragments ===
4:44:22.151622 INFO: performing precursor FDR with 47 features
4:44:22.158325 INFO: Decoy channel: -1
4:44:22.158478 INFO: Competetive: True
4:44:23.297405 WARNING: dropped 647 target PSMs due to missing features
4:44:23.297530 WARNING: dropped 653 decoy PSMs due to missing features
4:44:58.735408 INFO: Test AUC: 0.555
4:44:58.735602 INFO: Train AUC: 0.571
4:44:58.735699 INFO: AUC difference: 2.90%
4:44:58.980825 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
4:44:58.983858 PROGRESS: ============================= Precursor FDR =============================
4:44:58.984017 PROGRESS: Total precursors accumulated: 7,740
4:44:58.984094 PROGRESS: Target precursors: 7,060 (91.21%)
4:44:58.984172 PROGRESS: Decoy precursors: 680 (8.79%)
4:44:58.984234 PROGRESS: 
4:44:58.984293 PROGRESS: Precursor Summary:
4:44:58.988315 PROGRESS: Channel   0:	 0.05 FDR: 5,859; 0.01 FDR: 4,252; 0.001 FDR: 3,310
4:44:58.988475 PROGRESS: 
4:44:58.988547 PROGRESS: Protein Summary:
4:44:58.994472 PROGRESS: Channel   0:	 0.05 FDR: 3,943; 0.01 FDR: 2,801; 0.001 FDR: 2,216
4:44:58.994631 PROGRESS: =========================================================================
4:44:58.999366 INFO: calibration group: precursor, fitting rt estimator 
4:44:59.549845 INFO: calibration group: fragment, fitting mz estimator 
4:45:00.261477 INFO: calibration group: precursor, predicting mz
4:45:00.262125 WARNING: mz prediction was skipped as it has not been fitted yet
4:45:00.262172 INFO: calibration group: precursor, predicting rt
4:45:07.005242 INFO: calibration group: fragment, predicting mz
4:45:24.592888 PROGRESS: Extracting batch of 9950763 precursors
4:45:27.250036 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:45:27.250156 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:45:27.250199 INFO: FWHM in RT is 14.50 seconds, sigma is 0.53
4:45:27.250227 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:45:27.250495 INFO: Starting candidate selection
4:48:37.539296 INFO: Applying score cutoff of 39.22377767944336
4:48:37.882015 INFO: Removed 3650833 precursors with score below cutoff
4:48:40.373920 INFO: Starting candidate scoring
4:49:49.256480 INFO: Finished candidate processing
4:49:49.256710 INFO: Collecting candidate features
4:50:05.735294 WARNING: intensity_correlation has 206 NaNs ( 0.00 % out of 5993063)
4:50:06.075602 INFO: Collecting fragment features
4:50:13.544314 INFO: Finished candidate scoring
4:50:19.339853 INFO: performing precursor FDR with 47 features
4:50:19.339972 INFO: Decoy channel: -1
4:50:19.340016 INFO: Competetive: True
4:50:24.553275 WARNING: dropped 109 target PSMs due to missing features
4:50:24.553399 WARNING: dropped 97 decoy PSMs due to missing features
4:54:15.058525 INFO: Test AUC: 0.564
4:54:15.058667 INFO: Train AUC: 0.566
4:54:15.058705 INFO: AUC difference: 0.41%
4:54:15.755005 INFO: Removing fragments below FDR threshold
4:54:16.192089 PROGRESS: ============================= Precursor FDR =============================
4:54:16.192357 PROGRESS: Total precursors accumulated: 27,095
4:54:16.192446 PROGRESS: Target precursors: 26,827 (99.01%)
4:54:16.192514 PROGRESS: Decoy precursors: 268 (0.99%)
4:54:16.192577 PROGRESS: 
4:54:16.192647 PROGRESS: Precursor Summary:
4:54:16.208838 PROGRESS: Channel   0:	 0.05 FDR: 26,827; 0.01 FDR: 26,827; 0.001 FDR: 18,744
4:54:16.209082 PROGRESS: 
4:54:16.209164 PROGRESS: Protein Summary:
4:54:16.231360 PROGRESS: Channel   0:	 0.05 FDR: 7,092; 0.01 FDR: 7,092; 0.001 FDR: 5,476
4:54:16.231605 PROGRESS: =========================================================================
4:54:16.723875 INFO: Finished workflow for LFQ_Orbitrap_AIF_Condition_A_Sample_Alpha_02
4:54:17.249139 PROGRESS: Loading raw file 5/6: LFQ_Orbitrap_AIF_Condition_B_Sample_Alpha_02
4:54:17.249322 INFO: Creating workflow folder for LFQ_Orbitrap_AIF_Condition_B_Sample_Alpha_02 at output/.progress/LFQ_Orbitrap_AIF_Condition_B_Sample_Alpha_02
4:54:47.359352 INFO: Determining DIA cycle
4:54:47.375961 WARNING: Failed to determine DIA cycle, will retry without MS1 spectra.
4:54:47.381696 INFO: Determining DIA cycle
4:54:47.399088 INFO: Found cycle with start 0.00 min and length 151.
4:54:47.563699 INFO: ============ Raw file stats ============
4:54:47.564075 INFO: RT (min)            : 0.0 - 150.0
4:54:47.564145 INFO: RT duration (sec)   : 8999.7
4:54:47.564175 INFO: RT duration (min)   : 150.0
4:54:47.564272 INFO: Cycle len (scans)   : 151
4:54:47.564315 INFO: Cycle len (sec)     : 5.84
4:54:47.564345 INFO: Number of cycles    : 1541
4:54:47.564404 INFO: MS2 range (m/z)     : 396.4 - 1004.7
4:54:47.564437 INFO: ========================================
4:54:49.777896 INFO: Initializing CalibrationManager
4:54:49.778157 INFO: Loading calibration config
4:54:49.778585 INFO: Calibration config: [{'name': 'fragment', 'estimators': [{'name': 'mz', 'model': 'LOESSRegression', 'model_args': {'n_kernels': 2}, 'input_columns': ['mz_library'], 'target_columns': ['mz_observed'], 'output_columns': ['mz_calibrated'], 'transform_deviation': '1e6', 'function': LOESSRegression(n_kernels=2)}]}, {'name': 'precursor', 'estimators': [{'name': 'mz', 'model': 'LOESSRegression', 'model_args': {'n_kernels': 2}, 'input_columns': ['mz_library'], 'target_columns': ['mz_observed'], 'output_columns': ['mz_calibrated'], 'transform_deviation': '1e6', 'function': LOESSRegression(n_kernels=2)}, {'name': 'rt', 'model': 'LOESSRegression', 'model_args': {'n_kernels': 6}, 'input_columns': ['rt_library'], 'target_columns': ['rt_observed'], 'output_columns': ['rt_calibrated'], 'function': LOESSRegression()}, {'name': 'mobility', 'model': 'LOESSRegression', 'model_args': {'n_kernels': 2}, 'input_columns': ['mobility_library'], 'target_columns': ['mobility_observed'], 'output_columns': ['mobility_calibrated'], 'function': LOESSRegression(n_kernels=2)}]}]
4:54:49.778702 INFO: Calibration group :fragment, found 1 estimator(s)
4:54:49.778785 INFO: Calibration group :precursor, found 3 estimator(s)
4:54:49.778863 INFO: Disabling ion mobility calibration
4:54:49.778895 INFO: removed mobility estimator from group precursor
4:54:49.778971 INFO: Initializing OptimizationManager
4:54:49.779058 INFO: initial parameter: fwhm_rt = 5
4:54:49.779114 INFO: initial parameter: fwhm_mobility = 0.01
4:54:49.779166 INFO: initial parameter: score_cutoff = 0
4:54:49.779253 PROGRESS: Initializing workflow LFQ_Orbitrap_AIF_Condition_B_Sample_Alpha_02
4:54:49.779323 INFO: Initializing OptimizationManager
4:54:49.779352 INFO: initial parameter: current_epoch = 0
4:54:49.779374 INFO: initial parameter: current_step = 0
4:54:49.779396 INFO: initial parameter: ms1_error = 10
4:54:49.779416 INFO: initial parameter: ms2_error = 10
4:54:49.779437 INFO: initial parameter: rt_error = 240
4:54:49.779458 INFO: initial parameter: mobility_error = 0.08
4:54:49.779478 INFO: initial parameter: column_type = library
4:54:49.779498 INFO: initial parameter: num_candidates = 1
4:54:49.779518 INFO: initial parameter: recalibration_target = 200
4:54:49.779539 INFO: initial parameter: accumulated_precursors = 0
4:54:49.779559 INFO: initial parameter: accumulated_precursors_01FDR = 0
4:54:49.779578 INFO: initial parameter: accumulated_precursors_001FDR = 0
4:54:49.779607 INFO: Initializing FDRManager
4:54:49.779639 INFO: Loading classifier store from /home/alphadia/miniconda3/envs/alphadia172/lib/python3.11/site-packages/alphadia/constants/classifier
4:54:49.782370 PROGRESS: Applying channel filter using only: [0]
4:54:51.756920 PROGRESS: 4,989,882 target precursors potentially observable (188,089 removed)
4:54:55.279223 INFO: === checking if epoch conditions were reached ===
4:54:55.279485 INFO: ❌ ms2_error      : 10.0000 > 7
4:54:55.279570 INFO: ❌ rt_error       : 240.0000 > 100
4:54:55.279633 INFO: ❌ current_epoch  : 0 < 3
4:54:55.279689 INFO: ==============================================
4:54:55.494767 INFO: calibration group: precursor, predicting mz
4:54:55.495056 WARNING: mz prediction was skipped as it has not been fitted yet
4:54:55.495099 INFO: calibration group: precursor, predicting rt
4:54:55.495158 WARNING: rt prediction was skipped as it has not been fitted yet
4:54:55.495190 INFO: calibration group: fragment, predicting mz
4:54:55.495244 WARNING: mz prediction was skipped as it has not been fitted yet
4:54:55.495279 PROGRESS: === Epoch 0, step 0, extracting elution groups 0 to 1000 ===
4:54:55.568137 PROGRESS: Extracting batch of 1969 precursors
4:54:55.569824 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:54:55.569904 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:54:55.569961 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
4:54:55.569991 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
4:54:55.570223 INFO: Starting candidate selection
4:54:59.385613 INFO: Starting candidate scoring
4:55:00.488562 INFO: Finished candidate processing
4:55:00.488653 INFO: Collecting candidate features
4:55:02.627938 INFO: Collecting fragment features
4:55:03.262842 INFO: Finished candidate scoring
4:55:03.539210 PROGRESS: === Epoch 0, step 0, extracted 1710 precursors and 9137 fragments ===
4:55:03.539474 INFO: performing precursor FDR with 47 features
4:55:03.539531 INFO: Decoy channel: -1
4:55:03.539559 INFO: Competetive: True
4:55:03.586331 INFO: Test AUC: 0.469
4:55:03.586437 INFO: Train AUC: 0.477
4:55:03.586481 INFO: AUC difference: 1.70%
4:55:03.701184 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
4:55:03.702272 PROGRESS: ============================= Precursor FDR =============================
4:55:03.702400 PROGRESS: Total precursors accumulated: 881
4:55:03.702477 PROGRESS: Target precursors: 435 (49.38%)
4:55:03.702545 PROGRESS: Decoy precursors: 446 (50.62%)
4:55:03.702608 PROGRESS: 
4:55:03.702678 PROGRESS: Precursor Summary:
4:55:03.704084 PROGRESS: Channel   0:	 0.05 FDR:     0; 0.01 FDR:     0; 0.001 FDR:     0
4:55:03.704210 PROGRESS: 
4:55:03.704283 PROGRESS: Protein Summary:
4:55:03.705866 PROGRESS: Channel   0:	 0.05 FDR:     0; 0.01 FDR:     0; 0.001 FDR:     0
4:55:03.705976 PROGRESS: =========================================================================
4:55:03.706816 PROGRESS: === Epoch 0, step 1, extracting elution groups 1000 to 3000 ===
4:55:03.784483 PROGRESS: Extracting batch of 3958 precursors
4:55:03.786636 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:55:03.786715 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:55:03.786754 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
4:55:03.786784 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
4:55:03.787004 INFO: Starting candidate selection
4:55:11.857732 INFO: Starting candidate scoring
4:55:12.946688 INFO: Finished candidate processing
4:55:12.946776 INFO: Collecting candidate features
4:55:15.098706 INFO: Collecting fragment features
4:55:15.740021 INFO: Finished candidate scoring
4:55:16.024352 PROGRESS: === Epoch 0, step 1, extracted 3381 precursors and 18146 fragments ===
4:55:16.024652 INFO: performing precursor FDR with 47 features
4:55:16.024698 INFO: Decoy channel: -1
4:55:16.024723 INFO: Competetive: True
4:55:16.068545 INFO: Test AUC: 0.485
4:55:16.068659 INFO: Train AUC: 0.492
4:55:16.068704 INFO: AUC difference: 1.42%
4:55:16.188449 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
4:55:16.189281 PROGRESS: ============================= Precursor FDR =============================
4:55:16.189404 PROGRESS: Total precursors accumulated: 1
4:55:16.189480 PROGRESS: Target precursors: 1 (100.00%)
4:55:16.189548 PROGRESS: Decoy precursors: 0 (0.00%)
4:55:16.189610 PROGRESS: 
4:55:16.189670 PROGRESS: Precursor Summary:
4:55:16.191147 PROGRESS: Channel   0:	 0.05 FDR:     1; 0.01 FDR:     1; 0.001 FDR:     1
4:55:16.191272 PROGRESS: 
4:55:16.191345 PROGRESS: Protein Summary:
4:55:16.193003 PROGRESS: Channel   0:	 0.05 FDR:     1; 0.01 FDR:     1; 0.001 FDR:     1
4:55:16.193124 PROGRESS: =========================================================================
4:55:16.194006 PROGRESS: === Epoch 0, step 2, extracting elution groups 3000 to 7000 ===
4:55:16.276900 PROGRESS: Extracting batch of 7899 precursors
4:55:16.280155 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:55:16.280217 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:55:16.280255 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
4:55:16.280300 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
4:55:16.280518 INFO: Starting candidate selection
4:55:20.245121 INFO: Starting candidate scoring
4:55:21.392381 INFO: Finished candidate processing
4:55:21.392473 INFO: Collecting candidate features
4:55:23.554883 WARNING: intensity_correlation has 1 NaNs ( 0.01 % out of 6729)
4:55:23.560417 INFO: Collecting fragment features
4:55:24.207618 INFO: Finished candidate scoring
4:55:24.496752 PROGRESS: === Epoch 0, step 2, extracted 6729 precursors and 35756 fragments ===
4:55:24.497107 INFO: performing precursor FDR with 47 features
4:55:24.497155 INFO: Decoy channel: -1
4:55:24.497185 INFO: Competetive: True
4:55:24.511249 WARNING: dropped 1 decoy PSMs due to missing features
4:55:24.608632 INFO: Test AUC: 0.460
4:55:24.608776 INFO: Train AUC: 0.499
4:55:24.608834 INFO: AUC difference: 7.76%
4:55:24.608885 WARNING: AUC difference > 5%. This may indicate overfitting.
4:55:24.730883 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
4:55:24.734310 PROGRESS: ============================= Precursor FDR =============================
4:55:24.734606 PROGRESS: Total precursors accumulated: 6,101
4:55:24.734750 PROGRESS: Target precursors: 3,000 (49.17%)
4:55:24.734880 PROGRESS: Decoy precursors: 3,101 (50.83%)
4:55:24.735002 PROGRESS: 
4:55:24.735120 PROGRESS: Precursor Summary:
4:55:24.738139 PROGRESS: Channel   0:	 0.05 FDR:     0; 0.01 FDR:     0; 0.001 FDR:     0
4:55:24.738324 PROGRESS: 
4:55:24.738436 PROGRESS: Protein Summary:
4:55:24.740898 PROGRESS: Channel   0:	 0.05 FDR:     0; 0.01 FDR:     0; 0.001 FDR:     0
4:55:24.741057 PROGRESS: =========================================================================
4:55:24.742346 PROGRESS: === Epoch 0, step 3, extracting elution groups 7000 to 15000 ===
4:55:24.834721 PROGRESS: Extracting batch of 15806 precursors
4:55:24.840338 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:55:24.840410 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:55:24.840444 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
4:55:24.840485 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
4:55:24.840711 INFO: Starting candidate selection
4:55:28.975047 INFO: Starting candidate scoring
4:55:30.198621 INFO: Finished candidate processing
4:55:30.198789 INFO: Collecting candidate features
4:55:32.420934 INFO: Collecting fragment features
4:55:33.092639 INFO: Finished candidate scoring
4:55:33.395703 PROGRESS: === Epoch 0, step 3, extracted 13527 precursors and 72999 fragments ===
4:55:33.396048 INFO: performing precursor FDR with 47 features
4:55:33.396096 INFO: Decoy channel: -1
4:55:33.396122 INFO: Competetive: True
4:55:33.422881 WARNING: dropped 1 decoy PSMs due to missing features
4:55:34.193398 INFO: Test AUC: 0.524
4:55:34.193546 INFO: Train AUC: 0.530
4:55:34.193592 INFO: AUC difference: 1.11%
4:55:34.315907 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
4:55:34.316821 PROGRESS: ============================= Precursor FDR =============================
4:55:34.316948 PROGRESS: Total precursors accumulated: 1
4:55:34.317026 PROGRESS: Target precursors: 1 (100.00%)
4:55:34.317094 PROGRESS: Decoy precursors: 0 (0.00%)
4:55:34.317156 PROGRESS: 
4:55:34.317217 PROGRESS: Precursor Summary:
4:55:34.318740 PROGRESS: Channel   0:	 0.05 FDR:     1; 0.01 FDR:     1; 0.001 FDR:     1
4:55:34.318855 PROGRESS: 
4:55:34.318928 PROGRESS: Protein Summary:
4:55:34.320628 PROGRESS: Channel   0:	 0.05 FDR:     1; 0.01 FDR:     1; 0.001 FDR:     1
4:55:34.320739 PROGRESS: =========================================================================
4:55:34.321626 PROGRESS: === Epoch 0, step 4, extracting elution groups 15000 to 31000 ===
4:55:34.429605 PROGRESS: Extracting batch of 31591 precursors
4:55:34.440137 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:55:34.440247 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:55:34.440287 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
4:55:34.440314 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
4:55:34.440564 INFO: Starting candidate selection
4:55:38.934901 INFO: Starting candidate scoring
4:55:40.302272 INFO: Finished candidate processing
4:55:40.302362 INFO: Collecting candidate features
4:55:42.534053 INFO: Collecting fragment features
4:55:43.209094 INFO: Finished candidate scoring
4:55:43.524987 PROGRESS: === Epoch 0, step 4, extracted 26956 precursors and 143897 fragments ===
4:55:43.525373 INFO: performing precursor FDR with 47 features
4:55:43.525420 INFO: Decoy channel: -1
4:55:43.525447 INFO: Competetive: True
4:55:43.577048 WARNING: dropped 1 decoy PSMs due to missing features
4:55:45.255365 INFO: Test AUC: 0.537
4:55:45.255511 INFO: Train AUC: 0.549
4:55:45.255558 INFO: AUC difference: 2.13%
4:55:45.381425 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
4:55:45.382353 PROGRESS: ============================= Precursor FDR =============================
4:55:45.382474 PROGRESS: Total precursors accumulated: 1
4:55:45.382551 PROGRESS: Target precursors: 1 (100.00%)
4:55:45.382619 PROGRESS: Decoy precursors: 0 (0.00%)
4:55:45.382681 PROGRESS: 
4:55:45.382741 PROGRESS: Precursor Summary:
4:55:45.384241 PROGRESS: Channel   0:	 0.05 FDR:     1; 0.01 FDR:     1; 0.001 FDR:     1
4:55:45.384364 PROGRESS: 
4:55:45.384436 PROGRESS: Protein Summary:
4:55:45.386132 PROGRESS: Channel   0:	 0.05 FDR:     1; 0.01 FDR:     1; 0.001 FDR:     1
4:55:45.386242 PROGRESS: =========================================================================
4:55:45.387125 PROGRESS: === Epoch 0, step 5, extracting elution groups 31000 to 63000 ===
4:55:45.523221 PROGRESS: Extracting batch of 63226 precursors
4:55:45.543031 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:55:45.543139 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:55:45.543175 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
4:55:45.543218 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
4:55:45.543470 INFO: Starting candidate selection
4:55:50.685687 INFO: Starting candidate scoring
4:55:52.313533 INFO: Finished candidate processing
4:55:52.313709 INFO: Collecting candidate features
4:55:54.666743 WARNING: intensity_correlation has 3 NaNs ( 0.01 % out of 53949)
4:55:54.675022 INFO: Collecting fragment features
4:55:55.384451 INFO: Finished candidate scoring
4:55:55.734509 PROGRESS: === Epoch 0, step 5, extracted 53949 precursors and 289830 fragments ===
4:55:55.735707 INFO: performing precursor FDR with 47 features
4:55:55.735762 INFO: Decoy channel: -1
4:55:55.735789 INFO: Competetive: True
4:55:55.855847 WARNING: dropped 2 target PSMs due to missing features
4:55:55.855961 WARNING: dropped 2 decoy PSMs due to missing features
4:55:59.842874 INFO: Test AUC: 0.544
4:55:59.842992 INFO: Train AUC: 0.553
4:55:59.843047 INFO: AUC difference: 1.62%
4:55:59.976913 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
4:55:59.996435 PROGRESS: ============================= Precursor FDR =============================
4:55:59.996682 PROGRESS: Total precursors accumulated: 54,747
4:55:59.996757 PROGRESS: Target precursors: 30,685 (56.05%)
4:55:59.996816 PROGRESS: Decoy precursors: 24,062 (43.95%)
4:55:59.996870 PROGRESS: 
4:55:59.996923 PROGRESS: Precursor Summary:
4:55:59.999023 PROGRESS: Channel   0:	 0.05 FDR:     0; 0.01 FDR:     0; 0.001 FDR:     0
4:55:59.999161 PROGRESS: 
4:55:59.999235 PROGRESS: Protein Summary:
4:56:00.001340 PROGRESS: Channel   0:	 0.05 FDR:     0; 0.01 FDR:     0; 0.001 FDR:     0
4:56:00.001451 PROGRESS: =========================================================================
4:56:00.002468 PROGRESS: === Epoch 0, step 6, extracting elution groups 63000 to 127000 ===
4:56:00.176086 PROGRESS: Extracting batch of 126491 precursors
4:56:00.214690 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:56:00.214822 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:56:00.214866 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
4:56:00.214892 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
4:56:00.215166 INFO: Starting candidate selection
4:56:06.795433 INFO: Starting candidate scoring
4:56:08.983697 INFO: Finished candidate processing
4:56:08.983810 INFO: Collecting candidate features
4:56:11.498353 WARNING: intensity_correlation has 5 NaNs ( 0.00 % out of 107970)
4:56:11.510057 INFO: Collecting fragment features
4:56:12.284189 INFO: Finished candidate scoring
4:56:12.709326 PROGRESS: === Epoch 0, step 6, extracted 107970 precursors and 578551 fragments ===
4:56:12.709739 INFO: performing precursor FDR with 47 features
4:56:12.709801 INFO: Decoy channel: -1
4:56:12.709829 INFO: Competetive: True
4:56:12.962788 WARNING: dropped 6 target PSMs due to missing features
4:56:12.962904 WARNING: dropped 3 decoy PSMs due to missing features
4:56:20.803985 INFO: Test AUC: 0.541
4:56:20.804117 INFO: Train AUC: 0.559
4:56:20.804189 INFO: AUC difference: 3.23%
4:56:20.958048 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
4:56:20.959155 PROGRESS: ============================= Precursor FDR =============================
4:56:20.959283 PROGRESS: Total precursors accumulated: 376
4:56:20.959361 PROGRESS: Target precursors: 343 (91.22%)
4:56:20.959428 PROGRESS: Decoy precursors: 33 (8.78%)
4:56:20.959490 PROGRESS: 
4:56:20.959551 PROGRESS: Precursor Summary:
4:56:20.961200 PROGRESS: Channel   0:	 0.05 FDR:   286; 0.01 FDR:   145; 0.001 FDR:     0
4:56:20.961334 PROGRESS: 
4:56:20.961411 PROGRESS: Protein Summary:
4:56:20.963265 PROGRESS: Channel   0:	 0.05 FDR:   272; 0.01 FDR:   139; 0.001 FDR:     0
4:56:20.963380 PROGRESS: =========================================================================
4:56:20.964347 PROGRESS: === Epoch 0, step 7, extracting elution groups 127000 to 255000 ===
4:56:21.186099 PROGRESS: Extracting batch of 252801 precursors
4:56:21.258059 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:56:21.258176 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:56:21.258217 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
4:56:21.258259 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
4:56:21.258531 INFO: Starting candidate selection
4:56:30.620631 INFO: Starting candidate scoring
4:56:33.917829 INFO: Finished candidate processing
4:56:33.917975 INFO: Collecting candidate features
4:56:36.808308 WARNING: intensity_correlation has 11 NaNs ( 0.01 % out of 215260)
4:56:36.808992 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 215260)
4:56:36.827989 INFO: Collecting fragment features
4:56:37.696595 INFO: Finished candidate scoring
4:56:38.267518 PROGRESS: === Epoch 0, step 7, extracted 215260 precursors and 1155054 fragments ===
4:56:38.267916 INFO: performing precursor FDR with 47 features
4:56:38.267965 INFO: Decoy channel: -1
4:56:38.267992 INFO: Competetive: True
4:56:38.821386 WARNING: dropped 10 target PSMs due to missing features
4:56:38.821505 WARNING: dropped 10 decoy PSMs due to missing features
4:56:54.420300 INFO: Test AUC: 0.544
4:56:54.420431 INFO: Train AUC: 0.560
4:56:54.420490 INFO: AUC difference: 2.96%
4:56:54.597636 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
4:56:54.599096 PROGRESS: ============================= Precursor FDR =============================
4:56:54.599265 PROGRESS: Total precursors accumulated: 1,053
4:56:54.599346 PROGRESS: Target precursors: 959 (91.07%)
4:56:54.599415 PROGRESS: Decoy precursors: 94 (8.93%)
4:56:54.599478 PROGRESS: 
4:56:54.599539 PROGRESS: Precursor Summary:
4:56:54.601560 PROGRESS: Channel   0:	 0.05 FDR:   797; 0.01 FDR:   529; 0.001 FDR:   123
4:56:54.601703 PROGRESS: 
4:56:54.601793 PROGRESS: Protein Summary:
4:56:54.604143 PROGRESS: Channel   0:	 0.05 FDR:   713; 0.01 FDR:   477; 0.001 FDR:   116
4:56:54.604272 PROGRESS: =========================================================================
4:56:54.606320 INFO: calibration group: precursor, fitting rt estimator 
4:56:54.774419 INFO: calibration group: fragment, fitting mz estimator 
4:56:55.371906 INFO: === checking if epoch conditions were reached ===
4:56:55.372125 INFO: ✅ ms2_error      : 7.0000 <= 7
4:56:55.372218 INFO: ❌ rt_error       : 230.1050 > 100
4:56:55.372295 INFO: ❌ current_epoch  : 0 < 3
4:56:55.372351 INFO: ==============================================
4:56:55.592367 INFO: calibration group: precursor, predicting mz
4:56:55.592684 WARNING: mz prediction was skipped as it has not been fitted yet
4:56:55.592728 INFO: calibration group: precursor, predicting rt
4:57:02.919028 INFO: calibration group: fragment, predicting mz
4:57:20.153811 PROGRESS: === Epoch 1, step 0, extracting elution groups 0 to 1000 ===
4:57:20.241068 PROGRESS: Extracting batch of 1971 precursors
4:57:20.242915 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:57:20.242987 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:57:20.243025 INFO: FWHM in RT is 17.54 seconds, sigma is 0.64
4:57:20.243082 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:57:20.243316 INFO: Starting candidate selection
4:57:24.843716 INFO: Starting candidate scoring
4:57:26.132031 INFO: Finished candidate processing
4:57:26.132122 INFO: Collecting candidate features
4:57:28.285601 WARNING: intensity_correlation has 4 NaNs ( 0.24 % out of 1690)
4:57:28.291619 INFO: Collecting fragment features
4:57:28.929122 INFO: Finished candidate scoring
4:57:29.242000 PROGRESS: === Epoch 1, step 0, extracted 1690 precursors and 8802 fragments ===
4:57:29.242328 INFO: performing precursor FDR with 47 features
4:57:29.242369 INFO: Decoy channel: -1
4:57:29.242395 INFO: Competetive: True
4:57:29.247352 WARNING: dropped 2 target PSMs due to missing features
4:57:29.247427 WARNING: dropped 2 decoy PSMs due to missing features
4:57:29.276936 INFO: Test AUC: 0.572
4:57:29.277035 INFO: Train AUC: 0.511
4:57:29.277080 INFO: AUC difference: 11.86%
4:57:29.277114 WARNING: AUC difference > 5%. This may indicate overfitting.
4:57:29.399031 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
4:57:29.399821 PROGRESS: ============================= Precursor FDR =============================
4:57:29.399943 PROGRESS: Total precursors accumulated: 3
4:57:29.400020 PROGRESS: Target precursors: 3 (100.00%)
4:57:29.400090 PROGRESS: Decoy precursors: 0 (0.00%)
4:57:29.400153 PROGRESS: 
4:57:29.400214 PROGRESS: Precursor Summary:
4:57:29.401676 PROGRESS: Channel   0:	 0.05 FDR:     3; 0.01 FDR:     3; 0.001 FDR:     3
4:57:29.401810 PROGRESS: 
4:57:29.401886 PROGRESS: Protein Summary:
4:57:29.403547 PROGRESS: Channel   0:	 0.05 FDR:     3; 0.01 FDR:     3; 0.001 FDR:     3
4:57:29.403672 PROGRESS: =========================================================================
4:57:29.404549 PROGRESS: === Epoch 1, step 1, extracting elution groups 1000 to 3000 ===
4:57:29.482310 PROGRESS: Extracting batch of 3957 precursors
4:57:29.484613 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:57:29.484674 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:57:29.484712 INFO: FWHM in RT is 17.54 seconds, sigma is 0.64
4:57:29.484757 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:57:29.484972 INFO: Starting candidate selection
4:57:33.777744 INFO: Starting candidate scoring
4:57:35.083784 INFO: Finished candidate processing
4:57:35.083873 INFO: Collecting candidate features
4:57:37.245052 WARNING: intensity_correlation has 7 NaNs ( 0.20 % out of 3423)
4:57:37.251208 INFO: Collecting fragment features
4:57:37.895069 INFO: Finished candidate scoring
4:57:38.177166 PROGRESS: === Epoch 1, step 1, extracted 3423 precursors and 18021 fragments ===
4:57:38.177463 INFO: performing precursor FDR with 47 features
4:57:38.177507 INFO: Decoy channel: -1
4:57:38.177533 INFO: Competetive: True
4:57:38.186015 WARNING: dropped 5 target PSMs due to missing features
4:57:38.186118 WARNING: dropped 6 decoy PSMs due to missing features
4:57:38.222587 INFO: Test AUC: 0.537
4:57:38.222707 INFO: Train AUC: 0.543
4:57:38.222752 INFO: AUC difference: 1.23%
4:57:38.341664 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
4:57:38.342448 PROGRESS: ============================= Precursor FDR =============================
4:57:38.342570 PROGRESS: Total precursors accumulated: 16
4:57:38.342658 PROGRESS: Target precursors: 15 (93.75%)
4:57:38.342728 PROGRESS: Decoy precursors: 1 (6.25%)
4:57:38.342791 PROGRESS: 
4:57:38.342850 PROGRESS: Precursor Summary:
4:57:38.344246 PROGRESS: Channel   0:	 0.05 FDR:    14; 0.01 FDR:    14; 0.001 FDR:    14
4:57:38.344373 PROGRESS: 
4:57:38.344446 PROGRESS: Protein Summary:
4:57:38.346067 PROGRESS: Channel   0:	 0.05 FDR:    14; 0.01 FDR:    14; 0.001 FDR:    14
4:57:38.346177 PROGRESS: =========================================================================
4:57:38.347017 PROGRESS: === Epoch 1, step 2, extracting elution groups 3000 to 7000 ===
4:57:38.430323 PROGRESS: Extracting batch of 7898 precursors
4:57:38.433633 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:57:38.433708 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:57:38.433747 INFO: FWHM in RT is 17.54 seconds, sigma is 0.64
4:57:38.433821 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:57:38.434051 INFO: Starting candidate selection
4:57:42.820076 INFO: Starting candidate scoring
4:57:44.187793 INFO: Finished candidate processing
4:57:44.187981 INFO: Collecting candidate features
4:57:46.391001 WARNING: intensity_correlation has 14 NaNs ( 0.20 % out of 6888)
4:57:46.396744 INFO: Collecting fragment features
4:57:47.045183 INFO: Finished candidate scoring
4:57:47.332691 PROGRESS: === Epoch 1, step 2, extracted 6888 precursors and 36235 fragments ===
4:57:47.333048 INFO: performing precursor FDR with 47 features
4:57:47.333094 INFO: Decoy channel: -1
4:57:47.333119 INFO: Competetive: True
4:57:47.348040 WARNING: dropped 12 target PSMs due to missing features
4:57:47.348144 WARNING: dropped 13 decoy PSMs due to missing features
4:57:47.408102 INFO: Test AUC: 0.540
4:57:47.408235 INFO: Train AUC: 0.549
4:57:47.408280 INFO: AUC difference: 1.63%
4:57:47.530635 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
4:57:47.531461 PROGRESS: ============================= Precursor FDR =============================
4:57:47.531585 PROGRESS: Total precursors accumulated: 25
4:57:47.531664 PROGRESS: Target precursors: 23 (92.00%)
4:57:47.531732 PROGRESS: Decoy precursors: 2 (8.00%)
4:57:47.531796 PROGRESS: 
4:57:47.531855 PROGRESS: Precursor Summary:
4:57:47.533276 PROGRESS: Channel   0:	 0.05 FDR:    18; 0.01 FDR:    18; 0.001 FDR:    18
4:57:47.533415 PROGRESS: 
4:57:47.533490 PROGRESS: Protein Summary:
4:57:47.535103 PROGRESS: Channel   0:	 0.05 FDR:    18; 0.01 FDR:    18; 0.001 FDR:    18
4:57:47.535213 PROGRESS: =========================================================================
4:57:47.536063 PROGRESS: === Epoch 1, step 3, extracting elution groups 7000 to 15000 ===
4:57:47.627810 PROGRESS: Extracting batch of 15793 precursors
4:57:47.633426 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:57:47.633510 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:57:47.633546 INFO: FWHM in RT is 17.54 seconds, sigma is 0.64
4:57:47.633573 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:57:47.633805 INFO: Starting candidate selection
4:57:52.135760 INFO: Starting candidate scoring
4:57:53.549918 INFO: Finished candidate processing
4:57:53.550106 INFO: Collecting candidate features
4:57:55.747749 WARNING: intensity_correlation has 37 NaNs ( 0.27 % out of 13825)
4:57:55.753749 INFO: Collecting fragment features
4:57:56.414160 INFO: Finished candidate scoring
4:57:56.710511 PROGRESS: === Epoch 1, step 3, extracted 13825 precursors and 72645 fragments ===
4:57:56.710833 INFO: performing precursor FDR with 47 features
4:57:56.710880 INFO: Decoy channel: -1
4:57:56.710906 INFO: Competetive: True
4:57:56.738735 WARNING: dropped 30 target PSMs due to missing features
4:57:56.738862 WARNING: dropped 32 decoy PSMs due to missing features
4:57:57.480641 INFO: Test AUC: 0.546
4:57:57.480787 INFO: Train AUC: 0.572
4:57:57.480834 INFO: AUC difference: 4.62%
4:57:57.602521 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
4:57:57.603374 PROGRESS: ============================= Precursor FDR =============================
4:57:57.603496 PROGRESS: Total precursors accumulated: 75
4:57:57.603572 PROGRESS: Target precursors: 69 (92.00%)
4:57:57.603640 PROGRESS: Decoy precursors: 6 (8.00%)
4:57:57.603703 PROGRESS: 
4:57:57.603764 PROGRESS: Precursor Summary:
4:57:57.605224 PROGRESS: Channel   0:	 0.05 FDR:    52; 0.01 FDR:    34; 0.001 FDR:    34
4:57:57.605350 PROGRESS: 
4:57:57.605424 PROGRESS: Protein Summary:
4:57:57.607079 PROGRESS: Channel   0:	 0.05 FDR:    52; 0.01 FDR:    34; 0.001 FDR:    34
4:57:57.607191 PROGRESS: =========================================================================
4:57:57.608058 PROGRESS: === Epoch 1, step 4, extracting elution groups 15000 to 31000 ===
4:57:57.716226 PROGRESS: Extracting batch of 31628 precursors
4:57:57.727039 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:57:57.727153 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:57:57.727193 INFO: FWHM in RT is 17.54 seconds, sigma is 0.64
4:57:57.727220 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:57:57.727461 INFO: Starting candidate selection
4:58:02.557005 INFO: Starting candidate scoring
4:58:04.114964 INFO: Finished candidate processing
4:58:04.115152 INFO: Collecting candidate features
4:58:06.396765 WARNING: intensity_correlation has 74 NaNs ( 0.27 % out of 27623)
4:58:06.404711 INFO: Collecting fragment features
4:58:07.089291 INFO: Finished candidate scoring
4:58:07.407217 PROGRESS: === Epoch 1, step 4, extracted 27623 precursors and 144844 fragments ===
4:58:07.407602 INFO: performing precursor FDR with 47 features
4:58:07.407655 INFO: Decoy channel: -1
4:58:07.407681 INFO: Competetive: True
4:58:07.463717 WARNING: dropped 62 target PSMs due to missing features
4:58:07.463830 WARNING: dropped 74 decoy PSMs due to missing features
4:58:09.118167 INFO: Test AUC: 0.549
4:58:09.118316 INFO: Train AUC: 0.578
4:58:09.118361 INFO: AUC difference: 5.03%
4:58:09.118395 WARNING: AUC difference > 5%. This may indicate overfitting.
4:58:09.243628 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
4:58:09.244580 PROGRESS: ============================= Precursor FDR =============================
4:58:09.244708 PROGRESS: Total precursors accumulated: 146
4:58:09.244787 PROGRESS: Target precursors: 133 (91.10%)
4:58:09.244856 PROGRESS: Decoy precursors: 13 (8.90%)
4:58:09.244920 PROGRESS: 
4:58:09.244981 PROGRESS: Precursor Summary:
4:58:09.246548 PROGRESS: Channel   0:	 0.05 FDR:    90; 0.01 FDR:    75; 0.001 FDR:    75
4:58:09.246682 PROGRESS: 
4:58:09.246758 PROGRESS: Protein Summary:
4:58:09.248492 PROGRESS: Channel   0:	 0.05 FDR:    88; 0.01 FDR:    73; 0.001 FDR:    73
4:58:09.248606 PROGRESS: =========================================================================
4:58:09.249509 PROGRESS: === Epoch 1, step 5, extracting elution groups 31000 to 63000 ===
4:58:09.387050 PROGRESS: Extracting batch of 63252 precursors
4:58:09.407443 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:58:09.407554 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:58:09.407592 INFO: FWHM in RT is 17.54 seconds, sigma is 0.64
4:58:09.407634 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:58:09.407916 INFO: Starting candidate selection
4:58:14.936498 INFO: Starting candidate scoring
4:58:16.818244 INFO: Finished candidate processing
4:58:16.818346 INFO: Collecting candidate features
4:58:19.154828 WARNING: intensity_correlation has 157 NaNs ( 0.28 % out of 55175)
4:58:19.163427 INFO: Collecting fragment features
4:58:19.873739 INFO: Finished candidate scoring
4:58:20.221377 PROGRESS: === Epoch 1, step 5, extracted 55175 precursors and 288511 fragments ===
4:58:20.221752 INFO: performing precursor FDR with 47 features
4:58:20.222450 INFO: Decoy channel: -1
4:58:20.222553 INFO: Competetive: True
4:58:20.345072 WARNING: dropped 133 target PSMs due to missing features
4:58:20.345187 WARNING: dropped 160 decoy PSMs due to missing features
4:58:24.137239 INFO: Test AUC: 0.541
4:58:24.137356 INFO: Train AUC: 0.585
4:58:24.137414 INFO: AUC difference: 7.37%
4:58:24.137442 WARNING: AUC difference > 5%. This may indicate overfitting.
4:58:24.271413 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
4:58:24.272436 PROGRESS: ============================= Precursor FDR =============================
4:58:24.272563 PROGRESS: Total precursors accumulated: 332
4:58:24.272653 PROGRESS: Target precursors: 302 (90.96%)
4:58:24.272723 PROGRESS: Decoy precursors: 30 (9.04%)
4:58:24.272787 PROGRESS: 
4:58:24.272848 PROGRESS: Precursor Summary:
4:58:24.274500 PROGRESS: Channel   0:	 0.05 FDR:   222; 0.01 FDR:   151; 0.001 FDR:    73
4:58:24.274629 PROGRESS: 
4:58:24.274713 PROGRESS: Protein Summary:
4:58:24.276570 PROGRESS: Channel   0:	 0.05 FDR:   217; 0.01 FDR:   148; 0.001 FDR:    73
4:58:24.276681 PROGRESS: =========================================================================
4:58:24.277644 PROGRESS: === Epoch 1, step 6, extracting elution groups 63000 to 127000 ===
4:58:24.453371 PROGRESS: Extracting batch of 126470 precursors
4:58:24.492250 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:58:24.492369 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:58:24.492407 INFO: FWHM in RT is 17.54 seconds, sigma is 0.64
4:58:24.492451 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:58:24.492731 INFO: Starting candidate selection
4:58:31.310803 INFO: Starting candidate scoring
4:58:33.780945 INFO: Finished candidate processing
4:58:33.781097 INFO: Collecting candidate features
4:58:36.316593 WARNING: intensity_correlation has 334 NaNs ( 0.30 % out of 110403)
4:58:36.328790 INFO: Collecting fragment features
4:58:37.102546 INFO: Finished candidate scoring
4:58:37.527167 PROGRESS: === Epoch 1, step 6, extracted 110403 precursors and 576649 fragments ===
4:58:37.527567 INFO: performing precursor FDR with 47 features
4:58:37.527615 INFO: Decoy channel: -1
4:58:37.527641 INFO: Competetive: True
4:58:37.785759 WARNING: dropped 305 target PSMs due to missing features
4:58:37.785900 WARNING: dropped 322 decoy PSMs due to missing features
4:58:45.481461 INFO: Test AUC: 0.549
4:58:45.481589 INFO: Train AUC: 0.576
4:58:45.481645 INFO: AUC difference: 4.58%
4:58:45.633429 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
4:58:45.634593 PROGRESS: ============================= Precursor FDR =============================
4:58:45.634734 PROGRESS: Total precursors accumulated: 621
4:58:45.634814 PROGRESS: Target precursors: 566 (91.14%)
4:58:45.634885 PROGRESS: Decoy precursors: 55 (8.86%)
4:58:45.634948 PROGRESS: 
4:58:45.635010 PROGRESS: Precursor Summary:
4:58:45.636871 PROGRESS: Channel   0:	 0.05 FDR:   471; 0.01 FDR:   359; 0.001 FDR:   341
4:58:45.637018 PROGRESS: 
4:58:45.637105 PROGRESS: Protein Summary:
4:58:45.639326 PROGRESS: Channel   0:	 0.05 FDR:   439; 0.01 FDR:   336; 0.001 FDR:   320
4:58:45.639458 PROGRESS: =========================================================================
4:58:45.640558 PROGRESS: === Epoch 1, step 7, extracting elution groups 127000 to 255000 ===
4:58:45.866367 PROGRESS: Extracting batch of 252960 precursors
4:58:45.939250 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:58:45.939368 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:58:45.939412 INFO: FWHM in RT is 17.54 seconds, sigma is 0.64
4:58:45.939449 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:58:45.939732 INFO: Starting candidate selection
4:58:55.231734 INFO: Starting candidate scoring
4:58:58.845258 INFO: Finished candidate processing
4:58:58.845443 INFO: Collecting candidate features
4:59:01.731811 WARNING: intensity_correlation has 622 NaNs ( 0.28 % out of 220769)
4:59:01.751121 INFO: Collecting fragment features
4:59:02.607833 INFO: Finished candidate scoring
4:59:03.173020 PROGRESS: === Epoch 1, step 7, extracted 220769 precursors and 1154832 fragments ===
4:59:03.173403 INFO: performing precursor FDR with 47 features
4:59:03.173449 INFO: Decoy channel: -1
4:59:03.173475 INFO: Competetive: True
4:59:03.730403 WARNING: dropped 634 target PSMs due to missing features
4:59:03.730522 WARNING: dropped 615 decoy PSMs due to missing features
4:59:19.876232 INFO: Test AUC: 0.545
4:59:19.876360 INFO: Train AUC: 0.572
4:59:19.876414 INFO: AUC difference: 4.72%
4:59:20.067353 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
4:59:20.068864 PROGRESS: ============================= Precursor FDR =============================
4:59:20.069024 PROGRESS: Total precursors accumulated: 1,410
4:59:20.069104 PROGRESS: Target precursors: 1,284 (91.06%)
4:59:20.069172 PROGRESS: Decoy precursors: 126 (8.94%)
4:59:20.069236 PROGRESS: 
4:59:20.069313 PROGRESS: Precursor Summary:
4:59:20.071532 PROGRESS: Channel   0:	 0.05 FDR: 1,075; 0.01 FDR:   779; 0.001 FDR:   521
4:59:20.071683 PROGRESS: 
4:59:20.071759 PROGRESS: Protein Summary:
4:59:20.074433 PROGRESS: Channel   0:	 0.05 FDR:   949; 0.01 FDR:   693; 0.001 FDR:   480
4:59:20.074552 PROGRESS: =========================================================================
4:59:20.076804 INFO: calibration group: precursor, fitting rt estimator 
4:59:20.232427 INFO: calibration group: fragment, fitting mz estimator 
4:59:20.820939 INFO: === checking if epoch conditions were reached ===
4:59:20.821145 INFO: ✅ ms2_error      : 7.0000 <= 7
4:59:20.821233 INFO: ❌ rt_error       : 204.9016 > 100
4:59:20.821306 INFO: ❌ current_epoch  : 1 < 3
4:59:20.821370 INFO: ==============================================
4:59:21.038209 INFO: calibration group: precursor, predicting mz
4:59:21.038507 WARNING: mz prediction was skipped as it has not been fitted yet
4:59:21.038553 INFO: calibration group: precursor, predicting rt
4:59:27.939561 INFO: calibration group: fragment, predicting mz
4:59:45.426974 PROGRESS: === Epoch 2, step 0, extracting elution groups 0 to 1000 ===
4:59:45.514961 PROGRESS: Extracting batch of 1970 precursors
4:59:45.516754 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:59:45.516825 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:59:45.516863 INFO: FWHM in RT is 16.00 seconds, sigma is 0.58
4:59:45.516908 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:59:45.517135 INFO: Starting candidate selection
4:59:50.162422 INFO: Starting candidate scoring
4:59:51.470697 INFO: Finished candidate processing
4:59:51.470791 INFO: Collecting candidate features
4:59:53.616908 WARNING: intensity_correlation has 2 NaNs ( 0.12 % out of 1716)
4:59:53.623103 INFO: Collecting fragment features
4:59:54.254892 INFO: Finished candidate scoring
4:59:54.568050 PROGRESS: === Epoch 2, step 0, extracted 1716 precursors and 9026 fragments ===
4:59:54.568379 INFO: performing precursor FDR with 47 features
4:59:54.568422 INFO: Decoy channel: -1
4:59:54.568449 INFO: Competetive: True
4:59:54.573050 WARNING: dropped 2 target PSMs due to missing features
4:59:54.602333 INFO: Test AUC: 0.580
4:59:54.602433 INFO: Train AUC: 0.562
4:59:54.602477 INFO: AUC difference: 3.26%
4:59:54.727049 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
4:59:54.727806 PROGRESS: ============================= Precursor FDR =============================
4:59:54.727927 PROGRESS: Total precursors accumulated: 16
4:59:54.728004 PROGRESS: Target precursors: 15 (93.75%)
4:59:54.728073 PROGRESS: Decoy precursors: 1 (6.25%)
4:59:54.728137 PROGRESS: 
4:59:54.728198 PROGRESS: Precursor Summary:
4:59:54.729605 PROGRESS: Channel   0:	 0.05 FDR:     9; 0.01 FDR:     9; 0.001 FDR:     9
4:59:54.729730 PROGRESS: 
4:59:54.729813 PROGRESS: Protein Summary:
4:59:54.731415 PROGRESS: Channel   0:	 0.05 FDR:     9; 0.01 FDR:     9; 0.001 FDR:     9
4:59:54.731540 PROGRESS: =========================================================================
4:59:54.732385 PROGRESS: === Epoch 2, step 1, extracting elution groups 1000 to 3000 ===
4:59:54.810188 PROGRESS: Extracting batch of 3955 precursors
4:59:54.812445 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
4:59:54.812504 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
4:59:54.812541 INFO: FWHM in RT is 16.00 seconds, sigma is 0.58
4:59:54.812586 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
4:59:54.812797 INFO: Starting candidate selection
4:59:59.121684 INFO: Starting candidate scoring
5:00:00.449623 INFO: Finished candidate processing
5:00:00.449718 INFO: Collecting candidate features
5:00:02.638280 WARNING: intensity_correlation has 9 NaNs ( 0.26 % out of 3446)
5:00:02.644450 INFO: Collecting fragment features
5:00:03.294531 INFO: Finished candidate scoring
5:00:03.577219 PROGRESS: === Epoch 2, step 1, extracted 3446 precursors and 17946 fragments ===
5:00:03.577512 INFO: performing precursor FDR with 47 features
5:00:03.577567 INFO: Decoy channel: -1
5:00:03.577595 INFO: Competetive: True
5:00:03.586333 WARNING: dropped 8 target PSMs due to missing features
5:00:03.586422 WARNING: dropped 3 decoy PSMs due to missing features
5:00:03.623750 INFO: Test AUC: 0.556
5:00:03.623869 INFO: Train AUC: 0.558
5:00:03.623913 INFO: AUC difference: 0.42%
5:00:03.743827 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
5:00:03.744597 PROGRESS: ============================= Precursor FDR =============================
5:00:03.744720 PROGRESS: Total precursors accumulated: 25
5:00:03.744796 PROGRESS: Target precursors: 23 (92.00%)
5:00:03.744863 PROGRESS: Decoy precursors: 2 (8.00%)
5:00:03.744925 PROGRESS: 
5:00:03.744986 PROGRESS: Precursor Summary:
5:00:03.746433 PROGRESS: Channel   0:	 0.05 FDR:    21; 0.01 FDR:    21; 0.001 FDR:    21
5:00:03.746550 PROGRESS: 
5:00:03.746624 PROGRESS: Protein Summary:
5:00:03.748226 PROGRESS: Channel   0:	 0.05 FDR:    21; 0.01 FDR:    21; 0.001 FDR:    21
5:00:03.748339 PROGRESS: =========================================================================
5:00:03.749182 PROGRESS: === Epoch 2, step 2, extracting elution groups 3000 to 7000 ===
5:00:03.831533 PROGRESS: Extracting batch of 7911 precursors
5:00:03.834969 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:00:03.835035 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:00:03.835073 INFO: FWHM in RT is 16.00 seconds, sigma is 0.58
5:00:03.835119 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:00:03.835346 INFO: Starting candidate selection
5:00:08.221544 INFO: Starting candidate scoring
5:00:09.587733 INFO: Finished candidate processing
5:00:09.587923 INFO: Collecting candidate features
5:00:11.797739 WARNING: intensity_correlation has 11 NaNs ( 0.16 % out of 6892)
5:00:11.803499 INFO: Collecting fragment features
5:00:12.458613 INFO: Finished candidate scoring
5:00:12.747094 PROGRESS: === Epoch 2, step 2, extracted 6892 precursors and 35677 fragments ===
5:00:12.747471 INFO: performing precursor FDR with 47 features
5:00:12.747521 INFO: Decoy channel: -1
5:00:12.747547 INFO: Competetive: True
5:00:12.762576 WARNING: dropped 16 target PSMs due to missing features
5:00:12.762691 WARNING: dropped 6 decoy PSMs due to missing features
5:00:12.819497 INFO: Test AUC: 0.544
5:00:12.819633 INFO: Train AUC: 0.547
5:00:12.819696 INFO: AUC difference: 0.49%
5:00:12.940166 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
5:00:12.940981 PROGRESS: ============================= Precursor FDR =============================
5:00:12.941120 PROGRESS: Total precursors accumulated: 51
5:00:12.941216 PROGRESS: Target precursors: 48 (94.12%)
5:00:12.941309 PROGRESS: Decoy precursors: 3 (5.88%)
5:00:12.941395 PROGRESS: 
5:00:12.941474 PROGRESS: Precursor Summary:
5:00:12.942988 PROGRESS: Channel   0:	 0.05 FDR:    45; 0.01 FDR:    43; 0.001 FDR:    43
5:00:12.943110 PROGRESS: 
5:00:12.943213 PROGRESS: Protein Summary:
5:00:12.945382 PROGRESS: Channel   0:	 0.05 FDR:    45; 0.01 FDR:    43; 0.001 FDR:    43
5:00:12.945516 PROGRESS: =========================================================================
5:00:12.946487 PROGRESS: === Epoch 2, step 3, extracting elution groups 7000 to 15000 ===
5:00:13.038103 PROGRESS: Extracting batch of 15813 precursors
5:00:13.043845 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:00:13.043915 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:00:13.043950 INFO: FWHM in RT is 16.00 seconds, sigma is 0.58
5:00:13.043989 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:00:13.044220 INFO: Starting candidate selection
5:00:17.603699 INFO: Starting candidate scoring
5:00:19.045218 INFO: Finished candidate processing
5:00:19.045327 INFO: Collecting candidate features
5:00:21.248901 WARNING: intensity_correlation has 41 NaNs ( 0.30 % out of 13801)
5:00:21.254994 INFO: Collecting fragment features
5:00:21.917519 INFO: Finished candidate scoring
5:00:22.212594 PROGRESS: === Epoch 2, step 3, extracted 13801 precursors and 72360 fragments ===
5:00:22.212940 INFO: performing precursor FDR with 47 features
5:00:22.212988 INFO: Decoy channel: -1
5:00:22.213014 INFO: Competetive: True
5:00:22.240249 WARNING: dropped 34 target PSMs due to missing features
5:00:22.240362 WARNING: dropped 29 decoy PSMs due to missing features
5:00:22.923625 INFO: Test AUC: 0.532
5:00:22.923773 INFO: Train AUC: 0.594
5:00:22.923819 INFO: AUC difference: 10.41%
5:00:22.923854 WARNING: AUC difference > 5%. This may indicate overfitting.
5:00:23.046351 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
5:00:23.047248 PROGRESS: ============================= Precursor FDR =============================
5:00:23.047373 PROGRESS: Total precursors accumulated: 139
5:00:23.047450 PROGRESS: Target precursors: 127 (91.37%)
5:00:23.047517 PROGRESS: Decoy precursors: 12 (8.63%)
5:00:23.047591 PROGRESS: 
5:00:23.047654 PROGRESS: Precursor Summary:
5:00:23.049148 PROGRESS: Channel   0:	 0.05 FDR:    93; 0.01 FDR:    46; 0.001 FDR:    46
5:00:23.049260 PROGRESS: 
5:00:23.049332 PROGRESS: Protein Summary:
5:00:23.051053 PROGRESS: Channel   0:	 0.05 FDR:    93; 0.01 FDR:    46; 0.001 FDR:    46
5:00:23.051167 PROGRESS: =========================================================================
5:00:23.052031 PROGRESS: === Epoch 2, step 4, extracting elution groups 15000 to 31000 ===
5:00:23.160462 PROGRESS: Extracting batch of 31623 precursors
5:00:23.171186 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:00:23.171299 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:00:23.171338 INFO: FWHM in RT is 16.00 seconds, sigma is 0.58
5:00:23.171365 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:00:23.171623 INFO: Starting candidate selection
5:00:27.995241 INFO: Starting candidate scoring
5:00:29.554169 INFO: Finished candidate processing
5:00:29.554264 INFO: Collecting candidate features
5:00:31.801629 WARNING: intensity_correlation has 79 NaNs ( 0.29 % out of 27542)
5:00:31.809624 INFO: Collecting fragment features
5:00:32.487375 INFO: Finished candidate scoring
5:00:32.798880 PROGRESS: === Epoch 2, step 4, extracted 27542 precursors and 144288 fragments ===
5:00:32.799256 INFO: performing precursor FDR with 47 features
5:00:32.799304 INFO: Decoy channel: -1
5:00:32.799330 INFO: Competetive: True
5:00:32.853915 WARNING: dropped 69 target PSMs due to missing features
5:00:32.854026 WARNING: dropped 73 decoy PSMs due to missing features
5:00:34.479950 INFO: Test AUC: 0.549
5:00:34.480096 INFO: Train AUC: 0.599
5:00:34.480142 INFO: AUC difference: 8.40%
5:00:34.480176 WARNING: AUC difference > 5%. This may indicate overfitting.
5:00:34.625103 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
5:00:34.626082 PROGRESS: ============================= Precursor FDR =============================
5:00:34.626207 PROGRESS: Total precursors accumulated: 237
5:00:34.626285 PROGRESS: Target precursors: 216 (91.14%)
5:00:34.626353 PROGRESS: Decoy precursors: 21 (8.86%)
5:00:34.626415 PROGRESS: 
5:00:34.626476 PROGRESS: Precursor Summary:
5:00:34.628021 PROGRESS: Channel   0:	 0.05 FDR:   184; 0.01 FDR:   121; 0.001 FDR:   120
5:00:34.628150 PROGRESS: 
5:00:34.628224 PROGRESS: Protein Summary:
5:00:34.630019 PROGRESS: Channel   0:	 0.05 FDR:   183; 0.01 FDR:   120; 0.001 FDR:   119
5:00:34.630144 PROGRESS: =========================================================================
5:00:34.631069 PROGRESS: === Epoch 2, step 5, extracting elution groups 31000 to 63000 ===
5:00:34.767317 PROGRESS: Extracting batch of 63234 precursors
5:00:34.787612 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:00:34.787721 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:00:34.787759 INFO: FWHM in RT is 16.00 seconds, sigma is 0.58
5:00:34.787802 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:00:34.788056 INFO: Starting candidate selection
5:00:40.293029 INFO: Starting candidate scoring
5:00:42.130832 INFO: Finished candidate processing
5:00:42.130933 INFO: Collecting candidate features
5:00:44.466565 WARNING: intensity_correlation has 140 NaNs ( 0.25 % out of 55106)
5:00:44.475296 INFO: Collecting fragment features
5:00:45.184461 INFO: Finished candidate scoring
5:00:45.531290 PROGRESS: === Epoch 2, step 5, extracted 55106 precursors and 288521 fragments ===
5:00:45.531638 INFO: performing precursor FDR with 47 features
5:00:45.531683 INFO: Decoy channel: -1
5:00:45.531710 INFO: Competetive: True
5:00:45.654096 WARNING: dropped 142 target PSMs due to missing features
5:00:45.654223 WARNING: dropped 140 decoy PSMs due to missing features
5:00:49.074043 INFO: Test AUC: 0.547
5:00:49.074167 INFO: Train AUC: 0.595
5:00:49.074224 INFO: AUC difference: 8.08%
5:00:49.074255 WARNING: AUC difference > 5%. This may indicate overfitting.
5:00:49.210292 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
5:00:49.211385 PROGRESS: ============================= Precursor FDR =============================
5:00:49.211510 PROGRESS: Total precursors accumulated: 509
5:00:49.211589 PROGRESS: Target precursors: 463 (90.96%)
5:00:49.211658 PROGRESS: Decoy precursors: 46 (9.04%)
5:00:49.211720 PROGRESS: 
5:00:49.211781 PROGRESS: Precursor Summary:
5:00:49.213519 PROGRESS: Channel   0:	 0.05 FDR:   375; 0.01 FDR:   260; 0.001 FDR:   242
5:00:49.213656 PROGRESS: 
5:00:49.213733 PROGRESS: Protein Summary:
5:00:49.215782 PROGRESS: Channel   0:	 0.05 FDR:   356; 0.01 FDR:   247; 0.001 FDR:   229
5:00:49.215895 PROGRESS: =========================================================================
5:00:49.216941 PROGRESS: === Epoch 2, step 6, extracting elution groups 63000 to 127000 ===
5:00:49.394254 PROGRESS: Extracting batch of 126461 precursors
5:00:49.433175 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:00:49.433295 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:00:49.433332 INFO: FWHM in RT is 16.00 seconds, sigma is 0.58
5:00:49.433375 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:00:49.433660 INFO: Starting candidate selection
5:00:56.262571 INFO: Starting candidate scoring
5:00:58.712371 INFO: Finished candidate processing
5:00:58.712524 INFO: Collecting candidate features
5:01:01.224269 WARNING: intensity_correlation has 291 NaNs ( 0.26 % out of 110326)
5:01:01.236575 INFO: Collecting fragment features
5:01:01.996073 INFO: Finished candidate scoring
5:01:02.411361 PROGRESS: === Epoch 2, step 6, extracted 110326 precursors and 579112 fragments ===
5:01:02.411746 INFO: performing precursor FDR with 47 features
5:01:02.411792 INFO: Decoy channel: -1
5:01:02.411819 INFO: Competetive: True
5:01:02.664239 WARNING: dropped 278 target PSMs due to missing features
5:01:02.664353 WARNING: dropped 295 decoy PSMs due to missing features
5:01:10.378987 INFO: Test AUC: 0.548
5:01:10.379111 INFO: Train AUC: 0.583
5:01:10.379165 INFO: AUC difference: 6.08%
5:01:10.379194 WARNING: AUC difference > 5%. This may indicate overfitting.
5:01:10.531859 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
5:01:10.533177 PROGRESS: ============================= Precursor FDR =============================
5:01:10.533325 PROGRESS: Total precursors accumulated: 999
5:01:10.533405 PROGRESS: Target precursors: 913 (91.39%)
5:01:10.533473 PROGRESS: Decoy precursors: 86 (8.61%)
5:01:10.533536 PROGRESS: 
5:01:10.533599 PROGRESS: Precursor Summary:
5:01:10.535599 PROGRESS: Channel   0:	 0.05 FDR:   757; 0.01 FDR:   604; 0.001 FDR:   480
5:01:10.535749 PROGRESS: 
5:01:10.535825 PROGRESS: Protein Summary:
5:01:10.538251 PROGRESS: Channel   0:	 0.05 FDR:   681; 0.01 FDR:   543; 0.001 FDR:   434
5:01:10.538368 PROGRESS: =========================================================================
5:01:10.540452 INFO: calibration group: precursor, fitting rt estimator 
5:01:10.668942 INFO: calibration group: fragment, fitting mz estimator 
5:01:11.260106 INFO: === checking if epoch conditions were reached ===
5:01:11.260289 INFO: ✅ ms2_error      : 7.0000 <= 7
5:01:11.260381 INFO: ❌ rt_error       : 200.1835 > 100
5:01:11.260473 INFO: ✅ current_epoch  : 2 >= 3
5:01:11.260531 INFO: ==============================================
5:01:11.479625 INFO: calibration group: precursor, predicting mz
5:01:11.479928 WARNING: mz prediction was skipped as it has not been fitted yet
5:01:11.479972 INFO: calibration group: precursor, predicting rt
5:01:18.492220 INFO: calibration group: fragment, predicting mz
5:01:36.408675 PROGRESS: === Epoch 3, step 0, extracting elution groups 0 to 1000 ===
5:01:36.490416 PROGRESS: Extracting batch of 1976 precursors
5:01:36.492194 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:01:36.492267 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:01:36.492306 INFO: FWHM in RT is 15.75 seconds, sigma is 0.57
5:01:36.492351 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:01:36.492577 INFO: Starting candidate selection
5:01:41.136458 INFO: Starting candidate scoring
5:01:42.443376 INFO: Finished candidate processing
5:01:42.443490 INFO: Collecting candidate features
5:01:44.606331 WARNING: intensity_correlation has 1 NaNs ( 0.06 % out of 1745)
5:01:44.612163 INFO: Collecting fragment features
5:01:45.249184 INFO: Finished candidate scoring
5:01:45.545538 PROGRESS: === Epoch 3, step 0, extracted 1745 precursors and 9141 fragments ===
5:01:45.545868 INFO: performing precursor FDR with 47 features
5:01:45.545915 INFO: Decoy channel: -1
5:01:45.545941 INFO: Competetive: True
5:01:45.550495 WARNING: dropped 1 decoy PSMs due to missing features
5:01:45.577953 INFO: Test AUC: 0.547
5:01:45.578049 INFO: Train AUC: 0.550
5:01:45.578097 INFO: AUC difference: 0.44%
5:01:45.700726 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
5:01:45.701507 PROGRESS: ============================= Precursor FDR =============================
5:01:45.701650 PROGRESS: Total precursors accumulated: 8
5:01:45.701754 PROGRESS: Target precursors: 8 (100.00%)
5:01:45.701871 PROGRESS: Decoy precursors: 0 (0.00%)
5:01:45.701955 PROGRESS: 
5:01:45.702036 PROGRESS: Precursor Summary:
5:01:45.703535 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
5:01:45.703656 PROGRESS: 
5:01:45.703755 PROGRESS: Protein Summary:
5:01:45.706045 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
5:01:45.706175 PROGRESS: =========================================================================
5:01:45.707090 PROGRESS: === Epoch 3, step 1, extracting elution groups 1000 to 3000 ===
5:01:45.784201 PROGRESS: Extracting batch of 3960 precursors
5:01:45.786433 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:01:45.786510 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:01:45.786558 INFO: FWHM in RT is 15.75 seconds, sigma is 0.57
5:01:45.786605 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:01:45.786831 INFO: Starting candidate selection
5:01:50.056016 INFO: Starting candidate scoring
5:01:51.372429 INFO: Finished candidate processing
5:01:51.372525 INFO: Collecting candidate features
5:01:53.561981 WARNING: intensity_correlation has 5 NaNs ( 0.15 % out of 3430)
5:01:53.569471 INFO: Collecting fragment features
5:01:54.210172 INFO: Finished candidate scoring
5:01:54.490920 PROGRESS: === Epoch 3, step 1, extracted 3430 precursors and 18138 fragments ===
5:01:54.491204 INFO: performing precursor FDR with 47 features
5:01:54.491250 INFO: Decoy channel: -1
5:01:54.491277 INFO: Competetive: True
5:01:54.499986 WARNING: dropped 3 target PSMs due to missing features
5:01:54.500077 WARNING: dropped 3 decoy PSMs due to missing features
5:01:54.537174 INFO: Test AUC: 0.528
5:01:54.537293 INFO: Train AUC: 0.535
5:01:54.537338 INFO: AUC difference: 1.42%
5:01:54.657092 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
5:01:54.657776 PROGRESS: ============================= Precursor FDR =============================
5:01:54.657901 PROGRESS: Total precursors accumulated: 18
5:01:54.657970 PROGRESS: Target precursors: 17 (94.44%)
5:01:54.658030 PROGRESS: Decoy precursors: 1 (5.56%)
5:01:54.658091 PROGRESS: 
5:01:54.658145 PROGRESS: Precursor Summary:
5:01:54.659544 PROGRESS: Channel   0:	 0.05 FDR:    15; 0.01 FDR:    15; 0.001 FDR:    15
5:01:54.659670 PROGRESS: 
5:01:54.659743 PROGRESS: Protein Summary:
5:01:54.661340 PROGRESS: Channel   0:	 0.05 FDR:    15; 0.01 FDR:    15; 0.001 FDR:    15
5:01:54.661450 PROGRESS: =========================================================================
5:01:54.662313 PROGRESS: === Epoch 3, step 2, extracting elution groups 3000 to 7000 ===
5:01:54.744646 PROGRESS: Extracting batch of 7911 precursors
5:01:54.747938 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:01:54.748000 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:01:54.748038 INFO: FWHM in RT is 15.75 seconds, sigma is 0.57
5:01:54.748082 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:01:54.748306 INFO: Starting candidate selection
5:01:59.088409 INFO: Starting candidate scoring
5:02:00.427399 INFO: Finished candidate processing
5:02:00.427491 INFO: Collecting candidate features
5:02:02.628536 WARNING: intensity_correlation has 15 NaNs ( 0.22 % out of 6925)
5:02:02.634626 INFO: Collecting fragment features
5:02:03.287440 INFO: Finished candidate scoring
5:02:03.575937 PROGRESS: === Epoch 3, step 2, extracted 6925 precursors and 36212 fragments ===
5:02:03.576287 INFO: performing precursor FDR with 47 features
5:02:03.576334 INFO: Decoy channel: -1
5:02:03.576361 INFO: Competetive: True
5:02:03.591381 WARNING: dropped 7 target PSMs due to missing features
5:02:03.591482 WARNING: dropped 14 decoy PSMs due to missing features
5:02:03.648867 INFO: Test AUC: 0.538
5:02:03.649001 INFO: Train AUC: 0.535
5:02:03.649049 INFO: AUC difference: 0.40%
5:02:03.772871 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
5:02:03.773706 PROGRESS: ============================= Precursor FDR =============================
5:02:03.773835 PROGRESS: Total precursors accumulated: 42
5:02:03.773915 PROGRESS: Target precursors: 39 (92.86%)
5:02:03.773983 PROGRESS: Decoy precursors: 3 (7.14%)
5:02:03.774048 PROGRESS: 
5:02:03.774109 PROGRESS: Precursor Summary:
5:02:03.775560 PROGRESS: Channel   0:	 0.05 FDR:    32; 0.01 FDR:    29; 0.001 FDR:    29
5:02:03.775669 PROGRESS: 
5:02:03.775758 PROGRESS: Protein Summary:
5:02:03.777417 PROGRESS: Channel   0:	 0.05 FDR:    32; 0.01 FDR:    29; 0.001 FDR:    29
5:02:03.777528 PROGRESS: =========================================================================
5:02:03.778403 PROGRESS: === Epoch 3, step 3, extracting elution groups 7000 to 15000 ===
5:02:03.870730 PROGRESS: Extracting batch of 15791 precursors
5:02:03.876451 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:02:03.876524 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:02:03.876560 INFO: FWHM in RT is 15.75 seconds, sigma is 0.57
5:02:03.876586 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:02:03.876820 INFO: Starting candidate selection
5:02:08.442106 INFO: Starting candidate scoring
5:02:09.888353 INFO: Finished candidate processing
5:02:09.888489 INFO: Collecting candidate features
5:02:12.092505 WARNING: intensity_correlation has 34 NaNs ( 0.25 % out of 13802)
5:02:12.098587 INFO: Collecting fragment features
5:02:12.756202 INFO: Finished candidate scoring
5:02:13.051057 PROGRESS: === Epoch 3, step 3, extracted 13802 precursors and 72348 fragments ===
5:02:13.051415 INFO: performing precursor FDR with 47 features
5:02:13.051464 INFO: Decoy channel: -1
5:02:13.051491 INFO: Competetive: True
5:02:13.078601 WARNING: dropped 28 target PSMs due to missing features
5:02:13.078713 WARNING: dropped 27 decoy PSMs due to missing features
5:02:13.931685 INFO: Test AUC: 0.538
5:02:13.931871 INFO: Train AUC: 0.590
5:02:13.931921 INFO: AUC difference: 8.82%
5:02:13.931956 WARNING: AUC difference > 5%. This may indicate overfitting.
5:02:14.059440 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
5:02:14.060365 PROGRESS: ============================= Precursor FDR =============================
5:02:14.060500 PROGRESS: Total precursors accumulated: 175
5:02:14.060578 PROGRESS: Target precursors: 160 (91.43%)
5:02:14.060645 PROGRESS: Decoy precursors: 15 (8.57%)
5:02:14.060708 PROGRESS: 
5:02:14.060770 PROGRESS: Precursor Summary:
5:02:14.062296 PROGRESS: Channel   0:	 0.05 FDR:   103; 0.01 FDR:    74; 0.001 FDR:    74
5:02:14.062415 PROGRESS: 
5:02:14.062488 PROGRESS: Protein Summary:
5:02:14.064211 PROGRESS: Channel   0:	 0.05 FDR:   103; 0.01 FDR:    74; 0.001 FDR:    74
5:02:14.064323 PROGRESS: =========================================================================
5:02:14.065226 PROGRESS: === Epoch 3, step 4, extracting elution groups 15000 to 31000 ===
5:02:14.174182 PROGRESS: Extracting batch of 31641 precursors
5:02:14.184768 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:02:14.184864 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:02:14.184901 INFO: FWHM in RT is 15.75 seconds, sigma is 0.57
5:02:14.184929 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:02:14.185172 INFO: Starting candidate selection
5:02:19.020649 INFO: Starting candidate scoring
5:02:20.591157 INFO: Finished candidate processing
5:02:20.591255 INFO: Collecting candidate features
5:02:22.838423 WARNING: intensity_correlation has 70 NaNs ( 0.25 % out of 27688)
5:02:22.845368 INFO: Collecting fragment features
5:02:23.521979 INFO: Finished candidate scoring
5:02:23.833906 PROGRESS: === Epoch 3, step 4, extracted 27688 precursors and 145661 fragments ===
5:02:23.834259 INFO: performing precursor FDR with 47 features
5:02:23.834306 INFO: Decoy channel: -1
5:02:23.834333 INFO: Competetive: True
5:02:23.888617 WARNING: dropped 68 target PSMs due to missing features
5:02:23.888723 WARNING: dropped 57 decoy PSMs due to missing features
5:02:25.604604 INFO: Test AUC: 0.549
5:02:25.604746 INFO: Train AUC: 0.600
5:02:25.604796 INFO: AUC difference: 8.59%
5:02:25.604832 WARNING: AUC difference > 5%. This may indicate overfitting.
5:02:25.732627 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
5:02:25.733585 PROGRESS: ============================= Precursor FDR =============================
5:02:25.733705 PROGRESS: Total precursors accumulated: 300
5:02:25.733792 PROGRESS: Target precursors: 273 (91.00%)
5:02:25.733863 PROGRESS: Decoy precursors: 27 (9.00%)
5:02:25.733926 PROGRESS: 
5:02:25.733988 PROGRESS: Precursor Summary:
5:02:25.735585 PROGRESS: Channel   0:	 0.05 FDR:   209; 0.01 FDR:   172; 0.001 FDR:   169
5:02:25.735715 PROGRESS: 
5:02:25.735788 PROGRESS: Protein Summary:
5:02:25.737637 PROGRESS: Channel   0:	 0.05 FDR:   206; 0.01 FDR:   170; 0.001 FDR:   167
5:02:25.737747 PROGRESS: =========================================================================
5:02:25.738723 PROGRESS: === Epoch 3, step 5, extracting elution groups 31000 to 63000 ===
5:02:25.876539 PROGRESS: Extracting batch of 63259 precursors
5:02:25.896685 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:02:25.896793 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:02:25.896830 INFO: FWHM in RT is 15.75 seconds, sigma is 0.57
5:02:25.896873 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:02:25.897128 INFO: Starting candidate selection
5:02:31.379081 INFO: Starting candidate scoring
5:02:33.239324 INFO: Finished candidate processing
5:02:33.239429 INFO: Collecting candidate features
5:02:35.599521 WARNING: intensity_correlation has 122 NaNs ( 0.22 % out of 55176)
5:02:35.609626 INFO: Collecting fragment features
5:02:36.326156 INFO: Finished candidate scoring
5:02:36.674157 PROGRESS: === Epoch 3, step 5, extracted 55176 precursors and 291010 fragments ===
5:02:36.674542 INFO: performing precursor FDR with 47 features
5:02:36.674590 INFO: Decoy channel: -1
5:02:36.674616 INFO: Competetive: True
5:02:36.798634 WARNING: dropped 131 target PSMs due to missing features
5:02:36.798763 WARNING: dropped 116 decoy PSMs due to missing features
5:02:40.435966 INFO: Test AUC: 0.551
5:02:40.436096 INFO: Train AUC: 0.597
5:02:40.436154 INFO: AUC difference: 7.69%
5:02:40.436188 WARNING: AUC difference > 5%. This may indicate overfitting.
5:02:40.570812 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
5:02:40.571917 PROGRESS: ============================= Precursor FDR =============================
5:02:40.572059 PROGRESS: Total precursors accumulated: 671
5:02:40.572145 PROGRESS: Target precursors: 612 (91.21%)
5:02:40.572220 PROGRESS: Decoy precursors: 59 (8.79%)
5:02:40.572308 PROGRESS: 
5:02:40.572378 PROGRESS: Precursor Summary:
5:02:40.574132 PROGRESS: Channel   0:	 0.05 FDR:   483; 0.01 FDR:   322; 0.001 FDR:    84
5:02:40.574255 PROGRESS: 
5:02:40.574348 PROGRESS: Protein Summary:
5:02:40.576989 PROGRESS: Channel   0:	 0.05 FDR:   457; 0.01 FDR:   306; 0.001 FDR:    81
5:02:40.577115 PROGRESS: =========================================================================
5:02:40.578212 PROGRESS: === Epoch 3, step 6, extracting elution groups 63000 to 127000 ===
5:02:40.754841 PROGRESS: Extracting batch of 126456 precursors
5:02:40.793574 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:02:40.793703 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:02:40.793749 INFO: FWHM in RT is 15.75 seconds, sigma is 0.57
5:02:40.793787 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:02:40.794092 INFO: Starting candidate selection
5:02:47.564205 INFO: Starting candidate scoring
5:02:50.003305 INFO: Finished candidate processing
5:02:50.003492 INFO: Collecting candidate features
5:02:52.543497 WARNING: intensity_correlation has 251 NaNs ( 0.23 % out of 110359)
5:02:52.555740 INFO: Collecting fragment features
5:02:53.329181 INFO: Finished candidate scoring
5:02:53.749778 PROGRESS: === Epoch 3, step 6, extracted 110359 precursors and 580043 fragments ===
5:02:53.750183 INFO: performing precursor FDR with 47 features
5:02:53.750231 INFO: Decoy channel: -1
5:02:53.750258 INFO: Competetive: True
5:02:54.006156 WARNING: dropped 255 target PSMs due to missing features
5:02:54.006293 WARNING: dropped 243 decoy PSMs due to missing features
5:03:01.718635 INFO: Test AUC: 0.550
5:03:01.718761 INFO: Train AUC: 0.588
5:03:01.718801 INFO: AUC difference: 6.50%
5:03:01.718828 WARNING: AUC difference > 5%. This may indicate overfitting.
5:03:01.871082 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
5:03:01.872375 PROGRESS: ============================= Precursor FDR =============================
5:03:01.872507 PROGRESS: Total precursors accumulated: 1,252
5:03:01.872583 PROGRESS: Target precursors: 1,147 (91.61%)
5:03:01.872651 PROGRESS: Decoy precursors: 105 (8.39%)
5:03:01.872713 PROGRESS: 
5:03:01.872773 PROGRESS: Precursor Summary:
5:03:01.874746 PROGRESS: Channel   0:	 0.05 FDR:   903; 0.01 FDR:   666; 0.001 FDR:   231
5:03:01.874903 PROGRESS: 
5:03:01.874977 PROGRESS: Protein Summary:
5:03:01.877303 PROGRESS: Channel   0:	 0.05 FDR:   799; 0.01 FDR:   588; 0.001 FDR:   217
5:03:01.877415 PROGRESS: =========================================================================
5:03:01.878725 PROGRESS: === Epoch 3, step 7, extracting elution groups 127000 to 255000 ===
5:03:02.105162 PROGRESS: Extracting batch of 252903 precursors
5:03:02.178288 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:03:02.178420 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:03:02.178463 INFO: FWHM in RT is 15.75 seconds, sigma is 0.57
5:03:02.178491 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:03:02.178756 INFO: Starting candidate selection
5:03:11.493735 INFO: Starting candidate scoring
5:03:15.106761 INFO: Finished candidate processing
5:03:15.106952 INFO: Collecting candidate features
5:03:18.001250 WARNING: intensity_correlation has 501 NaNs ( 0.23 % out of 221099)
5:03:18.020632 INFO: Collecting fragment features
5:03:18.877688 INFO: Finished candidate scoring
5:03:19.440671 PROGRESS: === Epoch 3, step 7, extracted 221099 precursors and 1163463 fragments ===
5:03:19.441041 INFO: performing precursor FDR with 47 features
5:03:19.441100 INFO: Decoy channel: -1
5:03:19.441127 INFO: Competetive: True
5:03:19.997050 WARNING: dropped 505 target PSMs due to missing features
5:03:19.997169 WARNING: dropped 494 decoy PSMs due to missing features
5:03:36.194309 INFO: Test AUC: 0.545
5:03:36.194458 INFO: Train AUC: 0.577
5:03:36.194499 INFO: AUC difference: 5.41%
5:03:36.194526 WARNING: AUC difference > 5%. This may indicate overfitting.
5:03:36.376359 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
5:03:36.378114 PROGRESS: ============================= Precursor FDR =============================
5:03:36.378258 PROGRESS: Total precursors accumulated: 2,288
5:03:36.378337 PROGRESS: Target precursors: 2,094 (91.52%)
5:03:36.378405 PROGRESS: Decoy precursors: 194 (8.48%)
5:03:36.378468 PROGRESS: 
5:03:36.378528 PROGRESS: Precursor Summary:
5:03:36.380740 PROGRESS: Channel   0:	 0.05 FDR: 1,716; 0.01 FDR: 1,224; 0.001 FDR:   200
5:03:36.380874 PROGRESS: 
5:03:36.380946 PROGRESS: Protein Summary:
5:03:36.383770 PROGRESS: Channel   0:	 0.05 FDR: 1,431; 0.01 FDR: 1,018; 0.001 FDR:   184
5:03:36.383896 PROGRESS: =========================================================================
5:03:36.386485 INFO: calibration group: precursor, fitting rt estimator 
5:03:36.581340 INFO: calibration group: fragment, fitting mz estimator 
5:03:37.180855 INFO: === checking if epoch conditions were reached ===
5:03:37.181030 INFO: ✅ ms2_error      : 7.0000 <= 7
5:03:37.181117 INFO: ❌ rt_error       : 206.5786 > 100
5:03:37.181191 INFO: ✅ current_epoch  : 3 >= 3
5:03:37.181256 INFO: ==============================================
5:03:37.398305 INFO: calibration group: precursor, predicting mz
5:03:37.398581 WARNING: mz prediction was skipped as it has not been fitted yet
5:03:37.398624 INFO: calibration group: precursor, predicting rt
5:03:44.274364 INFO: calibration group: fragment, predicting mz
5:04:01.753258 PROGRESS: === Epoch 4, step 0, extracting elution groups 0 to 1000 ===
5:04:01.840281 PROGRESS: Extracting batch of 1970 precursors
5:04:01.842020 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:04:01.842113 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:04:01.842156 INFO: FWHM in RT is 16.22 seconds, sigma is 0.59
5:04:01.842187 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:04:01.842420 INFO: Starting candidate selection
5:04:06.449455 INFO: Starting candidate scoring
5:04:07.737591 INFO: Finished candidate processing
5:04:07.737685 INFO: Collecting candidate features
5:04:09.888665 WARNING: intensity_correlation has 4 NaNs ( 0.23 % out of 1750)
5:04:09.894724 INFO: Collecting fragment features
5:04:10.527756 INFO: Finished candidate scoring
5:04:10.840515 PROGRESS: === Epoch 4, step 0, extracted 1750 precursors and 9172 fragments ===
5:04:10.840852 INFO: performing precursor FDR with 47 features
5:04:10.840895 INFO: Decoy channel: -1
5:04:10.840922 INFO: Competetive: True
5:04:10.845441 WARNING: dropped 4 decoy PSMs due to missing features
5:04:10.872584 INFO: Test AUC: 0.581
5:04:10.872678 INFO: Train AUC: 0.524
5:04:10.872722 INFO: AUC difference: 11.04%
5:04:10.872755 WARNING: AUC difference > 5%. This may indicate overfitting.
5:04:10.990352 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
5:04:10.991153 PROGRESS: ============================= Precursor FDR =============================
5:04:10.991274 PROGRESS: Total precursors accumulated: 2
5:04:10.991351 PROGRESS: Target precursors: 2 (100.00%)
5:04:10.991417 PROGRESS: Decoy precursors: 0 (0.00%)
5:04:10.991478 PROGRESS: 
5:04:10.991538 PROGRESS: Precursor Summary:
5:04:10.992989 PROGRESS: Channel   0:	 0.05 FDR:     2; 0.01 FDR:     2; 0.001 FDR:     2
5:04:10.993098 PROGRESS: 
5:04:10.993181 PROGRESS: Protein Summary:
5:04:10.994882 PROGRESS: Channel   0:	 0.05 FDR:     2; 0.01 FDR:     2; 0.001 FDR:     2
5:04:10.995001 PROGRESS: =========================================================================
5:04:10.995862 PROGRESS: === Epoch 4, step 1, extracting elution groups 1000 to 3000 ===
5:04:11.073403 PROGRESS: Extracting batch of 3954 precursors
5:04:11.075619 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:04:11.075679 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:04:11.075716 INFO: FWHM in RT is 16.22 seconds, sigma is 0.59
5:04:11.075745 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:04:11.075976 INFO: Starting candidate selection
5:04:15.404757 INFO: Starting candidate scoring
5:04:16.740564 INFO: Finished candidate processing
5:04:16.740705 INFO: Collecting candidate features
5:04:18.935433 WARNING: intensity_correlation has 7 NaNs ( 0.20 % out of 3520)
5:04:18.942447 INFO: Collecting fragment features
5:04:19.587935 INFO: Finished candidate scoring
5:04:19.872772 PROGRESS: === Epoch 4, step 1, extracted 3520 precursors and 18450 fragments ===
5:04:19.873045 INFO: performing precursor FDR with 47 features
5:04:19.873093 INFO: Decoy channel: -1
5:04:19.873120 INFO: Competetive: True
5:04:19.881862 WARNING: dropped 3 target PSMs due to missing features
5:04:19.881972 WARNING: dropped 8 decoy PSMs due to missing features
5:04:19.918828 INFO: Test AUC: 0.523
5:04:19.918950 INFO: Train AUC: 0.542
5:04:19.918996 INFO: AUC difference: 3.48%
5:04:20.058594 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
5:04:20.059387 PROGRESS: ============================= Precursor FDR =============================
5:04:20.059504 PROGRESS: Total precursors accumulated: 12
5:04:20.059582 PROGRESS: Target precursors: 11 (91.67%)
5:04:20.059649 PROGRESS: Decoy precursors: 1 (8.33%)
5:04:20.059710 PROGRESS: 
5:04:20.059771 PROGRESS: Precursor Summary:
5:04:20.061163 PROGRESS: Channel   0:	 0.05 FDR:    11; 0.01 FDR:    11; 0.001 FDR:    11
5:04:20.061274 PROGRESS: 
5:04:20.061348 PROGRESS: Protein Summary:
5:04:20.062981 PROGRESS: Channel   0:	 0.05 FDR:    11; 0.01 FDR:    11; 0.001 FDR:    11
5:04:20.063094 PROGRESS: =========================================================================
5:04:20.063931 PROGRESS: === Epoch 4, step 2, extracting elution groups 3000 to 7000 ===
5:04:20.147226 PROGRESS: Extracting batch of 7902 precursors
5:04:20.150532 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:04:20.150599 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:04:20.150639 INFO: FWHM in RT is 16.22 seconds, sigma is 0.59
5:04:20.150669 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:04:20.150892 INFO: Starting candidate selection
5:04:24.584648 INFO: Starting candidate scoring
5:04:25.955865 INFO: Finished candidate processing
5:04:25.955959 INFO: Collecting candidate features
5:04:28.158735 WARNING: intensity_correlation has 13 NaNs ( 0.19 % out of 6995)
5:04:28.164389 INFO: Collecting fragment features
5:04:28.816648 INFO: Finished candidate scoring
5:04:29.104964 PROGRESS: === Epoch 4, step 2, extracted 6995 precursors and 37323 fragments ===
5:04:29.105308 INFO: performing precursor FDR with 47 features
5:04:29.105355 INFO: Decoy channel: -1
5:04:29.105381 INFO: Competetive: True
5:04:29.120426 WARNING: dropped 9 target PSMs due to missing features
5:04:29.120531 WARNING: dropped 15 decoy PSMs due to missing features
5:04:29.177536 INFO: Test AUC: 0.539
5:04:29.177671 INFO: Train AUC: 0.538
5:04:29.177716 INFO: AUC difference: 0.05%
5:04:29.301741 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
5:04:29.302570 PROGRESS: ============================= Precursor FDR =============================
5:04:29.302694 PROGRESS: Total precursors accumulated: 45
5:04:29.302772 PROGRESS: Target precursors: 41 (91.11%)
5:04:29.302842 PROGRESS: Decoy precursors: 4 (8.89%)
5:04:29.302905 PROGRESS: 
5:04:29.302965 PROGRESS: Precursor Summary:
5:04:29.304406 PROGRESS: Channel   0:	 0.05 FDR:    36; 0.01 FDR:    34; 0.001 FDR:    34
5:04:29.304534 PROGRESS: 
5:04:29.304609 PROGRESS: Protein Summary:
5:04:29.306267 PROGRESS: Channel   0:	 0.05 FDR:    36; 0.01 FDR:    34; 0.001 FDR:    34
5:04:29.306381 PROGRESS: =========================================================================
5:04:29.307264 PROGRESS: === Epoch 4, step 3, extracting elution groups 7000 to 15000 ===
5:04:29.399416 PROGRESS: Extracting batch of 15814 precursors
5:04:29.404999 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:04:29.405062 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:04:29.405096 INFO: FWHM in RT is 16.22 seconds, sigma is 0.59
5:04:29.405138 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:04:29.405356 INFO: Starting candidate selection
5:04:34.001492 INFO: Starting candidate scoring
5:04:35.439334 INFO: Finished candidate processing
5:04:35.439429 INFO: Collecting candidate features
5:04:37.649148 WARNING: intensity_correlation has 46 NaNs ( 0.33 % out of 13955)
5:04:37.655159 INFO: Collecting fragment features
5:04:38.313641 INFO: Finished candidate scoring
5:04:38.607518 PROGRESS: === Epoch 4, step 3, extracted 13955 precursors and 73835 fragments ===
5:04:38.607878 INFO: performing precursor FDR with 47 features
5:04:38.607925 INFO: Decoy channel: -1
5:04:38.607952 INFO: Competetive: True
5:04:38.635625 WARNING: dropped 33 target PSMs due to missing features
5:04:38.635739 WARNING: dropped 37 decoy PSMs due to missing features
5:04:39.347547 INFO: Test AUC: 0.530
5:04:39.347685 INFO: Train AUC: 0.601
5:04:39.347731 INFO: AUC difference: 11.77%
5:04:39.347764 WARNING: AUC difference > 5%. This may indicate overfitting.
5:04:39.470165 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
5:04:39.471063 PROGRESS: ============================= Precursor FDR =============================
5:04:39.471182 PROGRESS: Total precursors accumulated: 181
5:04:39.471259 PROGRESS: Target precursors: 165 (91.16%)
5:04:39.471339 PROGRESS: Decoy precursors: 16 (8.84%)
5:04:39.471404 PROGRESS: 
5:04:39.471465 PROGRESS: Precursor Summary:
5:04:39.472976 PROGRESS: Channel   0:	 0.05 FDR:   146; 0.01 FDR:   115; 0.001 FDR:    96
5:04:39.473086 PROGRESS: 
5:04:39.473176 PROGRESS: Protein Summary:
5:04:39.474942 PROGRESS: Channel   0:	 0.05 FDR:   145; 0.01 FDR:   114; 0.001 FDR:    95
5:04:39.475068 PROGRESS: =========================================================================
5:04:39.475978 PROGRESS: === Epoch 4, step 4, extracting elution groups 15000 to 31000 ===
5:04:39.585513 PROGRESS: Extracting batch of 31620 precursors
5:04:39.596009 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:04:39.596124 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:04:39.596164 INFO: FWHM in RT is 16.22 seconds, sigma is 0.59
5:04:39.596192 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:04:39.596445 INFO: Starting candidate selection
5:04:44.464767 INFO: Starting candidate scoring
5:04:46.031141 INFO: Finished candidate processing
5:04:46.031332 INFO: Collecting candidate features
5:04:48.309647 WARNING: intensity_correlation has 64 NaNs ( 0.23 % out of 28017)
5:04:48.316668 INFO: Collecting fragment features
5:04:49.002590 INFO: Finished candidate scoring
5:04:49.317229 PROGRESS: === Epoch 4, step 4, extracted 28017 precursors and 148780 fragments ===
5:04:49.317598 INFO: performing precursor FDR with 47 features
5:04:49.317645 INFO: Decoy channel: -1
5:04:49.317671 INFO: Competetive: True
5:04:49.373421 WARNING: dropped 63 target PSMs due to missing features
5:04:49.373534 WARNING: dropped 71 decoy PSMs due to missing features
5:04:50.969708 INFO: Test AUC: 0.540
5:04:50.969868 INFO: Train AUC: 0.602
5:04:50.969917 INFO: AUC difference: 10.36%
5:04:50.969954 WARNING: AUC difference > 5%. This may indicate overfitting.
5:04:51.116142 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
5:04:51.117117 PROGRESS: ============================= Precursor FDR =============================
5:04:51.117236 PROGRESS: Total precursors accumulated: 378
5:04:51.117314 PROGRESS: Target precursors: 345 (91.27%)
5:04:51.117383 PROGRESS: Decoy precursors: 33 (8.73%)
5:04:51.117446 PROGRESS: 
5:04:51.117508 PROGRESS: Precursor Summary:
5:04:51.119156 PROGRESS: Channel   0:	 0.05 FDR:   251; 0.01 FDR:   223; 0.001 FDR:   188
5:04:51.119289 PROGRESS: 
5:04:51.119364 PROGRESS: Protein Summary:
5:04:51.121267 PROGRESS: Channel   0:	 0.05 FDR:   246; 0.01 FDR:   218; 0.001 FDR:   184
5:04:51.121377 PROGRESS: =========================================================================
5:04:51.122381 PROGRESS: === Epoch 4, step 5, extracting elution groups 31000 to 63000 ===
5:04:51.258984 PROGRESS: Extracting batch of 63223 precursors
5:04:51.278798 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:04:51.278907 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:04:51.278945 INFO: FWHM in RT is 16.22 seconds, sigma is 0.59
5:04:51.278990 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:04:51.279238 INFO: Starting candidate selection
5:04:56.772908 INFO: Starting candidate scoring
5:04:58.625617 INFO: Finished candidate processing
5:04:58.625707 INFO: Collecting candidate features
5:05:00.993683 WARNING: intensity_correlation has 125 NaNs ( 0.22 % out of 55866)
5:05:01.002364 INFO: Collecting fragment features
5:05:01.719581 INFO: Finished candidate scoring
5:05:02.068600 PROGRESS: === Epoch 4, step 5, extracted 55866 precursors and 295327 fragments ===
5:05:02.068986 INFO: performing precursor FDR with 47 features
5:05:02.069654 INFO: Decoy channel: -1
5:05:02.069745 INFO: Competetive: True
5:05:02.195654 WARNING: dropped 135 target PSMs due to missing features
5:05:02.195771 WARNING: dropped 124 decoy PSMs due to missing features
5:05:05.971369 INFO: Test AUC: 0.536
5:05:05.971489 INFO: Train AUC: 0.599
5:05:05.971545 INFO: AUC difference: 10.45%
5:05:05.971574 WARNING: AUC difference > 5%. This may indicate overfitting.
5:05:06.105997 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
5:05:06.107148 PROGRESS: ============================= Precursor FDR =============================
5:05:06.107313 PROGRESS: Total precursors accumulated: 797
5:05:06.107390 PROGRESS: Target precursors: 725 (90.97%)
5:05:06.107458 PROGRESS: Decoy precursors: 72 (9.03%)
5:05:06.107522 PROGRESS: 
5:05:06.107583 PROGRESS: Precursor Summary:
5:05:06.109380 PROGRESS: Channel   0:	 0.05 FDR:   569; 0.01 FDR:   437; 0.001 FDR:   340
5:05:06.109515 PROGRESS: 
5:05:06.109589 PROGRESS: Protein Summary:
5:05:06.111755 PROGRESS: Channel   0:	 0.05 FDR:   531; 0.01 FDR:   405; 0.001 FDR:   314
5:05:06.111866 PROGRESS: =========================================================================
5:05:06.113014 PROGRESS: === Epoch 4, step 6, extracting elution groups 63000 to 127000 ===
5:05:06.288263 PROGRESS: Extracting batch of 126424 precursors
5:05:06.326217 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:05:06.326350 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:05:06.326394 INFO: FWHM in RT is 16.22 seconds, sigma is 0.59
5:05:06.326426 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:05:06.326688 INFO: Starting candidate selection
5:05:13.115961 INFO: Starting candidate scoring
5:05:15.567467 INFO: Finished candidate processing
5:05:15.567616 INFO: Collecting candidate features
5:05:18.109069 WARNING: intensity_correlation has 274 NaNs ( 0.25 % out of 111690)
5:05:18.122683 INFO: Collecting fragment features
5:05:18.895952 INFO: Finished candidate scoring
5:05:19.318962 PROGRESS: === Epoch 4, step 6, extracted 111690 precursors and 591246 fragments ===
5:05:19.319349 INFO: performing precursor FDR with 47 features
5:05:19.319396 INFO: Decoy channel: -1
5:05:19.319423 INFO: Competetive: True
5:05:19.577674 WARNING: dropped 262 target PSMs due to missing features
5:05:19.577817 WARNING: dropped 271 decoy PSMs due to missing features
5:05:27.344752 INFO: Test AUC: 0.552
5:05:27.344897 INFO: Train AUC: 0.588
5:05:27.344939 INFO: AUC difference: 6.24%
5:05:27.344967 WARNING: AUC difference > 5%. This may indicate overfitting.
5:05:27.517557 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
5:05:27.519023 PROGRESS: ============================= Precursor FDR =============================
5:05:27.519169 PROGRESS: Total precursors accumulated: 1,628
5:05:27.519255 PROGRESS: Target precursors: 1,486 (91.28%)
5:05:27.519332 PROGRESS: Decoy precursors: 142 (8.72%)
5:05:27.519403 PROGRESS: 
5:05:27.519470 PROGRESS: Precursor Summary:
5:05:27.521600 PROGRESS: Channel   0:	 0.05 FDR: 1,152; 0.01 FDR:   871; 0.001 FDR:   689
5:05:27.521723 PROGRESS: 
5:05:27.521844 PROGRESS: Protein Summary:
5:05:27.525450 PROGRESS: Channel   0:	 0.05 FDR: 1,020; 0.01 FDR:   773; 0.001 FDR:   616
5:05:27.525567 PROGRESS: =========================================================================
5:05:27.526983 PROGRESS: === Epoch 4, step 7, extracting elution groups 127000 to 255000 ===
5:05:27.751511 PROGRESS: Extracting batch of 252831 precursors
5:05:27.824373 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:05:27.824500 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:05:27.824546 INFO: FWHM in RT is 16.22 seconds, sigma is 0.59
5:05:27.824575 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:05:27.824842 INFO: Starting candidate selection
5:05:37.233856 INFO: Starting candidate scoring
5:05:40.898300 INFO: Finished candidate processing
5:05:40.898397 INFO: Collecting candidate features
5:05:43.809462 WARNING: intensity_correlation has 548 NaNs ( 0.24 % out of 223726)
5:05:43.829160 INFO: Collecting fragment features
5:05:44.688173 INFO: Finished candidate scoring
5:05:45.253477 PROGRESS: === Epoch 4, step 7, extracted 223726 precursors and 1182604 fragments ===
5:05:45.253878 INFO: performing precursor FDR with 47 features
5:05:45.253930 INFO: Decoy channel: -1
5:05:45.253957 INFO: Competetive: True
5:05:45.818130 WARNING: dropped 531 target PSMs due to missing features
5:05:45.818251 WARNING: dropped 550 decoy PSMs due to missing features
5:06:02.078726 INFO: Test AUC: 0.550
5:06:02.078855 INFO: Train AUC: 0.578
5:06:02.078897 INFO: AUC difference: 4.82%
5:06:02.283869 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
5:06:02.285765 PROGRESS: ============================= Precursor FDR =============================
5:06:02.285928 PROGRESS: Total precursors accumulated: 2,926
5:06:02.286006 PROGRESS: Target precursors: 2,665 (91.08%)
5:06:02.286075 PROGRESS: Decoy precursors: 261 (8.92%)
5:06:02.286150 PROGRESS: 
5:06:02.286212 PROGRESS: Precursor Summary:
5:06:02.288796 PROGRESS: Channel   0:	 0.05 FDR: 2,006; 0.01 FDR: 1,563; 0.001 FDR: 1,224
5:06:02.288934 PROGRESS: 
5:06:02.289008 PROGRESS: Protein Summary:
5:06:02.292400 PROGRESS: Channel   0:	 0.05 FDR: 1,627; 0.01 FDR: 1,255; 0.001 FDR: 1,009
5:06:02.292520 PROGRESS: =========================================================================
5:06:02.295404 INFO: calibration group: precursor, fitting rt estimator 
5:06:02.530881 INFO: calibration group: fragment, fitting mz estimator 
5:06:03.120273 INFO: === checking if epoch conditions were reached ===
5:06:03.120442 INFO: ✅ ms2_error      : 7.0000 <= 7
5:06:03.120533 INFO: ❌ rt_error       : 203.0908 > 100
5:06:03.120610 INFO: ✅ current_epoch  : 4 >= 3
5:06:03.120676 INFO: ==============================================
5:06:03.338969 INFO: calibration group: precursor, predicting mz
5:06:03.339273 WARNING: mz prediction was skipped as it has not been fitted yet
5:06:03.339318 INFO: calibration group: precursor, predicting rt
5:06:10.200458 INFO: calibration group: fragment, predicting mz
5:06:27.808350 PROGRESS: === Epoch 5, step 0, extracting elution groups 0 to 1000 ===
5:06:27.896680 PROGRESS: Extracting batch of 1977 precursors
5:06:27.898432 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:06:27.898525 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:06:27.898567 INFO: FWHM in RT is 15.27 seconds, sigma is 0.56
5:06:27.898597 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:06:27.898828 INFO: Starting candidate selection
5:06:32.519009 INFO: Starting candidate scoring
5:06:33.800753 INFO: Finished candidate processing
5:06:33.800850 INFO: Collecting candidate features
5:06:35.953751 WARNING: intensity_correlation has 6 NaNs ( 0.34 % out of 1759)
5:06:35.959702 INFO: Collecting fragment features
5:06:36.593825 INFO: Finished candidate scoring
5:06:36.905314 PROGRESS: === Epoch 5, step 0, extracted 1759 precursors and 9203 fragments ===
5:06:36.905651 INFO: performing precursor FDR with 47 features
5:06:36.905693 INFO: Decoy channel: -1
5:06:36.905719 INFO: Competetive: True
5:06:36.910378 WARNING: dropped 3 target PSMs due to missing features
5:06:36.910451 WARNING: dropped 3 decoy PSMs due to missing features
5:06:36.939145 INFO: Test AUC: 0.565
5:06:36.939238 INFO: Train AUC: 0.522
5:06:36.939283 INFO: AUC difference: 8.34%
5:06:36.939316 WARNING: AUC difference > 5%. This may indicate overfitting.
5:06:37.058414 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
5:06:37.059184 PROGRESS: ============================= Precursor FDR =============================
5:06:37.059305 PROGRESS: Total precursors accumulated: 15
5:06:37.059385 PROGRESS: Target precursors: 14 (93.33%)
5:06:37.059454 PROGRESS: Decoy precursors: 1 (6.67%)
5:06:37.059518 PROGRESS: 
5:06:37.059579 PROGRESS: Precursor Summary:
5:06:37.060979 PROGRESS: Channel   0:	 0.05 FDR:    12; 0.01 FDR:    12; 0.001 FDR:    12
5:06:37.061105 PROGRESS: 
5:06:37.061178 PROGRESS: Protein Summary:
5:06:37.062781 PROGRESS: Channel   0:	 0.05 FDR:    12; 0.01 FDR:    12; 0.001 FDR:    12
5:06:37.062892 PROGRESS: =========================================================================
5:06:37.063740 PROGRESS: === Epoch 5, step 1, extracting elution groups 1000 to 3000 ===
5:06:37.141128 PROGRESS: Extracting batch of 3949 precursors
5:06:37.143366 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:06:37.143428 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:06:37.143468 INFO: FWHM in RT is 15.27 seconds, sigma is 0.56
5:06:37.143515 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:06:37.143728 INFO: Starting candidate selection
5:06:41.460925 INFO: Starting candidate scoring
5:06:42.764735 INFO: Finished candidate processing
5:06:42.764824 INFO: Collecting candidate features
5:06:44.924674 WARNING: intensity_correlation has 9 NaNs ( 0.25 % out of 3536)
5:06:44.931736 INFO: Collecting fragment features
5:06:45.572854 INFO: Finished candidate scoring
5:06:45.853240 PROGRESS: === Epoch 5, step 1, extracted 3536 precursors and 18631 fragments ===
5:06:45.853527 INFO: performing precursor FDR with 47 features
5:06:45.853574 INFO: Decoy channel: -1
5:06:45.853601 INFO: Competetive: True
5:06:45.862253 WARNING: dropped 6 target PSMs due to missing features
5:06:45.862348 WARNING: dropped 9 decoy PSMs due to missing features
5:06:45.899034 INFO: Test AUC: 0.542
5:06:45.899156 INFO: Train AUC: 0.525
5:06:45.899201 INFO: AUC difference: 3.23%
5:06:46.019195 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
5:06:46.019896 PROGRESS: ============================= Precursor FDR =============================
5:06:46.020011 PROGRESS: Total precursors accumulated: 36
5:06:46.020080 PROGRESS: Target precursors: 33 (91.67%)
5:06:46.020140 PROGRESS: Decoy precursors: 3 (8.33%)
5:06:46.020198 PROGRESS: 
5:06:46.020262 PROGRESS: Precursor Summary:
5:06:46.021678 PROGRESS: Channel   0:	 0.05 FDR:    32; 0.01 FDR:    25; 0.001 FDR:    25
5:06:46.021820 PROGRESS: 
5:06:46.021901 PROGRESS: Protein Summary:
5:06:46.023510 PROGRESS: Channel   0:	 0.05 FDR:    32; 0.01 FDR:    25; 0.001 FDR:    25
5:06:46.023620 PROGRESS: =========================================================================
5:06:46.024470 PROGRESS: === Epoch 5, step 2, extracting elution groups 3000 to 7000 ===
5:06:46.106834 PROGRESS: Extracting batch of 7904 precursors
5:06:46.110044 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:06:46.110110 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:06:46.110150 INFO: FWHM in RT is 15.27 seconds, sigma is 0.56
5:06:46.110181 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:06:46.110410 INFO: Starting candidate selection
5:06:50.483851 INFO: Starting candidate scoring
5:06:51.831191 INFO: Finished candidate processing
5:06:51.831289 INFO: Collecting candidate features
5:06:54.011039 WARNING: intensity_correlation has 15 NaNs ( 0.21 % out of 7137)
5:06:54.016551 INFO: Collecting fragment features
5:06:54.662730 INFO: Finished candidate scoring
5:06:54.948173 PROGRESS: === Epoch 5, step 2, extracted 7137 precursors and 37583 fragments ===
5:06:54.948501 INFO: performing precursor FDR with 47 features
5:06:54.948546 INFO: Decoy channel: -1
5:06:54.948573 INFO: Competetive: True
5:06:54.963416 WARNING: dropped 16 target PSMs due to missing features
5:06:54.963513 WARNING: dropped 14 decoy PSMs due to missing features
5:06:55.020371 INFO: Test AUC: 0.540
5:06:55.020503 INFO: Train AUC: 0.535
5:06:55.020548 INFO: AUC difference: 0.87%
5:06:55.143494 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
5:06:55.144315 PROGRESS: ============================= Precursor FDR =============================
5:06:55.144436 PROGRESS: Total precursors accumulated: 72
5:06:55.144515 PROGRESS: Target precursors: 67 (93.06%)
5:06:55.144584 PROGRESS: Decoy precursors: 5 (6.94%)
5:06:55.144648 PROGRESS: 
5:06:55.144710 PROGRESS: Precursor Summary:
5:06:55.146219 PROGRESS: Channel   0:	 0.05 FDR:    65; 0.01 FDR:    54; 0.001 FDR:    54
5:06:55.146332 PROGRESS: 
5:06:55.146405 PROGRESS: Protein Summary:
5:06:55.148052 PROGRESS: Channel   0:	 0.05 FDR:    64; 0.01 FDR:    53; 0.001 FDR:    53
5:06:55.148161 PROGRESS: =========================================================================
5:06:55.149047 PROGRESS: === Epoch 5, step 3, extracting elution groups 7000 to 15000 ===
5:06:55.240473 PROGRESS: Extracting batch of 15803 precursors
5:06:55.246008 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:06:55.246074 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:06:55.246126 INFO: FWHM in RT is 15.27 seconds, sigma is 0.56
5:06:55.246154 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:06:55.246373 INFO: Starting candidate selection
5:06:59.840219 INFO: Starting candidate scoring
5:07:01.276676 INFO: Finished candidate processing
5:07:01.276768 INFO: Collecting candidate features
5:07:03.475307 WARNING: intensity_correlation has 14 NaNs ( 0.10 % out of 14206)
5:07:03.481264 INFO: Collecting fragment features
5:07:04.138469 INFO: Finished candidate scoring
5:07:04.433083 PROGRESS: === Epoch 5, step 3, extracted 14206 precursors and 74805 fragments ===
5:07:04.433441 INFO: performing precursor FDR with 47 features
5:07:04.433489 INFO: Decoy channel: -1
5:07:04.433515 INFO: Competetive: True
5:07:04.461090 WARNING: dropped 23 target PSMs due to missing features
5:07:04.461204 WARNING: dropped 21 decoy PSMs due to missing features
5:07:05.131671 INFO: Test AUC: 0.536
5:07:05.131816 INFO: Train AUC: 0.592
5:07:05.131862 INFO: AUC difference: 9.50%
5:07:05.131897 WARNING: AUC difference > 5%. This may indicate overfitting.
5:07:05.275933 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
5:07:05.276841 PROGRESS: ============================= Precursor FDR =============================
5:07:05.276966 PROGRESS: Total precursors accumulated: 208
5:07:05.277045 PROGRESS: Target precursors: 190 (91.35%)
5:07:05.277115 PROGRESS: Decoy precursors: 18 (8.65%)
5:07:05.277182 PROGRESS: 
5:07:05.277244 PROGRESS: Precursor Summary:
5:07:05.278776 PROGRESS: Channel   0:	 0.05 FDR:   130; 0.01 FDR:   107; 0.001 FDR:    97
5:07:05.278894 PROGRESS: 
5:07:05.278969 PROGRESS: Protein Summary:
5:07:05.280713 PROGRESS: Channel   0:	 0.05 FDR:   127; 0.01 FDR:   104; 0.001 FDR:    95
5:07:05.280826 PROGRESS: =========================================================================
5:07:05.281742 PROGRESS: === Epoch 5, step 4, extracting elution groups 15000 to 31000 ===
5:07:05.391613 PROGRESS: Extracting batch of 31618 precursors
5:07:05.402070 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:07:05.402187 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:07:05.402228 INFO: FWHM in RT is 15.27 seconds, sigma is 0.56
5:07:05.402256 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:07:05.402497 INFO: Starting candidate selection
5:07:10.272121 INFO: Starting candidate scoring
5:07:11.834092 INFO: Finished candidate processing
5:07:11.834180 INFO: Collecting candidate features
5:07:14.082729 WARNING: intensity_correlation has 50 NaNs ( 0.18 % out of 28388)
5:07:14.089545 INFO: Collecting fragment features
5:07:14.765508 INFO: Finished candidate scoring
5:07:15.076647 PROGRESS: === Epoch 5, step 4, extracted 28388 precursors and 149156 fragments ===
5:07:15.077002 INFO: performing precursor FDR with 47 features
5:07:15.077051 INFO: Decoy channel: -1
5:07:15.077078 INFO: Competetive: True
5:07:15.132930 WARNING: dropped 48 target PSMs due to missing features
5:07:15.133043 WARNING: dropped 46 decoy PSMs due to missing features
5:07:16.831322 INFO: Test AUC: 0.546
5:07:16.831474 INFO: Train AUC: 0.604
5:07:16.831522 INFO: AUC difference: 9.60%
5:07:16.831557 WARNING: AUC difference > 5%. This may indicate overfitting.
5:07:16.970804 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
5:07:16.971821 PROGRESS: ============================= Precursor FDR =============================
5:07:16.971953 PROGRESS: Total precursors accumulated: 373
5:07:16.972034 PROGRESS: Target precursors: 341 (91.42%)
5:07:16.972104 PROGRESS: Decoy precursors: 32 (8.58%)
5:07:16.972167 PROGRESS: 
5:07:16.972228 PROGRESS: Precursor Summary:
5:07:16.973871 PROGRESS: Channel   0:	 0.05 FDR:   288; 0.01 FDR:   204; 0.001 FDR:   176
5:07:16.973988 PROGRESS: 
5:07:16.974061 PROGRESS: Protein Summary:
5:07:16.975931 PROGRESS: Channel   0:	 0.05 FDR:   280; 0.01 FDR:   197; 0.001 FDR:   171
5:07:16.976040 PROGRESS: =========================================================================
5:07:16.977018 PROGRESS: === Epoch 5, step 5, extracting elution groups 31000 to 63000 ===
5:07:17.114172 PROGRESS: Extracting batch of 63187 precursors
5:07:17.133982 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:07:17.134094 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:07:17.134132 INFO: FWHM in RT is 15.27 seconds, sigma is 0.56
5:07:17.134159 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:07:17.134407 INFO: Starting candidate selection
5:07:22.707715 INFO: Starting candidate scoring
5:07:24.586290 INFO: Finished candidate processing
5:07:24.586382 INFO: Collecting candidate features
5:07:26.938019 WARNING: intensity_correlation has 113 NaNs ( 0.20 % out of 56657)
5:07:26.946686 INFO: Collecting fragment features
5:07:27.655402 INFO: Finished candidate scoring
5:07:28.001925 PROGRESS: === Epoch 5, step 5, extracted 56657 precursors and 298334 fragments ===
5:07:28.002313 INFO: performing precursor FDR with 47 features
5:07:28.002359 INFO: Decoy channel: -1
5:07:28.002386 INFO: Competetive: True
5:07:28.127390 WARNING: dropped 105 target PSMs due to missing features
5:07:28.127507 WARNING: dropped 102 decoy PSMs due to missing features
5:07:31.770951 INFO: Test AUC: 0.545
5:07:31.771070 INFO: Train AUC: 0.601
5:07:31.771128 INFO: AUC difference: 9.30%
5:07:31.771155 WARNING: AUC difference > 5%. This may indicate overfitting.
5:07:31.904358 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
5:07:31.905557 PROGRESS: ============================= Precursor FDR =============================
5:07:31.905727 PROGRESS: Total precursors accumulated: 890
5:07:31.905818 PROGRESS: Target precursors: 811 (91.12%)
5:07:31.905889 PROGRESS: Decoy precursors: 79 (8.88%)
5:07:31.905952 PROGRESS: 
5:07:31.906013 PROGRESS: Precursor Summary:
5:07:31.907788 PROGRESS: Channel   0:	 0.05 FDR:   604; 0.01 FDR:   406; 0.001 FDR:   189
5:07:31.907931 PROGRESS: 
5:07:31.908006 PROGRESS: Protein Summary:
5:07:31.910143 PROGRESS: Channel   0:	 0.05 FDR:   570; 0.01 FDR:   386; 0.001 FDR:   181
5:07:31.910256 PROGRESS: =========================================================================
5:07:31.911376 PROGRESS: === Epoch 5, step 6, extracting elution groups 63000 to 127000 ===
5:07:32.087009 PROGRESS: Extracting batch of 126435 precursors
5:07:32.132782 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:07:32.132901 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:07:32.132939 INFO: FWHM in RT is 15.27 seconds, sigma is 0.56
5:07:32.132982 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:07:32.133241 INFO: Starting candidate selection
5:07:38.935687 INFO: Starting candidate scoring
5:07:41.391325 INFO: Finished candidate processing
5:07:41.391420 INFO: Collecting candidate features
5:07:43.935438 WARNING: intensity_correlation has 237 NaNs ( 0.21 % out of 113140)
5:07:43.948987 INFO: Collecting fragment features
5:07:44.723927 INFO: Finished candidate scoring
5:07:45.145605 PROGRESS: === Epoch 5, step 6, extracted 113140 precursors and 596887 fragments ===
5:07:45.146004 INFO: performing precursor FDR with 47 features
5:07:45.152698 INFO: Decoy channel: -1
5:07:45.152851 INFO: Competetive: True
5:07:45.416839 WARNING: dropped 226 target PSMs due to missing features
5:07:45.416953 WARNING: dropped 218 decoy PSMs due to missing features
5:07:53.454685 INFO: Test AUC: 0.547
5:07:53.454830 INFO: Train AUC: 0.589
5:07:53.454871 INFO: AUC difference: 7.17%
5:07:53.454901 WARNING: AUC difference > 5%. This may indicate overfitting.
5:07:53.628628 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
5:07:53.630176 PROGRESS: ============================= Precursor FDR =============================
5:07:53.630324 PROGRESS: Total precursors accumulated: 1,731
5:07:53.630402 PROGRESS: Target precursors: 1,579 (91.22%)
5:07:53.630470 PROGRESS: Decoy precursors: 152 (8.78%)
5:07:53.630532 PROGRESS: 
5:07:53.630592 PROGRESS: Precursor Summary:
5:07:53.632675 PROGRESS: Channel   0:	 0.05 FDR: 1,203; 0.01 FDR:   821; 0.001 FDR:   443
5:07:53.632816 PROGRESS: 
5:07:53.632890 PROGRESS: Protein Summary:
5:07:53.635516 PROGRESS: Channel   0:	 0.05 FDR: 1,083; 0.01 FDR:   722; 0.001 FDR:   400
5:07:53.635646 PROGRESS: =========================================================================
5:07:53.637014 PROGRESS: === Epoch 5, step 7, extracting elution groups 127000 to 255000 ===
5:07:53.864252 PROGRESS: Extracting batch of 252902 precursors
5:07:53.936019 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:07:53.936135 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:07:53.936172 INFO: FWHM in RT is 15.27 seconds, sigma is 0.56
5:07:53.936215 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:07:53.936478 INFO: Starting candidate selection
5:08:03.370426 INFO: Starting candidate scoring
5:08:07.058085 INFO: Finished candidate processing
5:08:07.058272 INFO: Collecting candidate features
5:08:10.005622 WARNING: intensity_correlation has 477 NaNs ( 0.21 % out of 226706)
5:08:10.026731 INFO: Collecting fragment features
5:08:10.897931 INFO: Finished candidate scoring
5:08:11.473526 PROGRESS: === Epoch 5, step 7, extracted 226706 precursors and 1194115 fragments ===
5:08:11.473908 INFO: performing precursor FDR with 47 features
5:08:11.473958 INFO: Decoy channel: -1
5:08:11.473984 INFO: Competetive: True
5:08:12.051778 WARNING: dropped 460 target PSMs due to missing features
5:08:12.051898 WARNING: dropped 461 decoy PSMs due to missing features
5:08:28.543307 INFO: Test AUC: 0.551
5:08:28.543437 INFO: Train AUC: 0.581
5:08:28.543493 INFO: AUC difference: 5.15%
5:08:28.543521 WARNING: AUC difference > 5%. This may indicate overfitting.
5:08:28.738251 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
5:08:28.740153 PROGRESS: ============================= Precursor FDR =============================
5:08:28.740310 PROGRESS: Total precursors accumulated: 2,975
5:08:28.740389 PROGRESS: Target precursors: 2,712 (91.16%)
5:08:28.740457 PROGRESS: Decoy precursors: 263 (8.84%)
5:08:28.740520 PROGRESS: 
5:08:28.740581 PROGRESS: Precursor Summary:
5:08:28.743243 PROGRESS: Channel   0:	 0.05 FDR: 2,146; 0.01 FDR: 1,632; 0.001 FDR: 1,059
5:08:28.743385 PROGRESS: 
5:08:28.743459 PROGRESS: Protein Summary:
5:08:28.746881 PROGRESS: Channel   0:	 0.05 FDR: 1,744; 0.01 FDR: 1,314; 0.001 FDR:   885
5:08:28.747009 PROGRESS: =========================================================================
5:08:28.749932 INFO: calibration group: precursor, fitting rt estimator 
5:08:28.978110 INFO: calibration group: fragment, fitting mz estimator 
5:08:29.570924 INFO: === checking if epoch conditions were reached ===
5:08:29.571097 INFO: ✅ ms2_error      : 7.0000 <= 7
5:08:29.571186 INFO: ❌ rt_error       : 203.4142 > 100
5:08:29.571260 INFO: ✅ current_epoch  : 5 >= 3
5:08:29.571334 INFO: ==============================================
5:08:29.788587 INFO: calibration group: precursor, predicting mz
5:08:29.788872 WARNING: mz prediction was skipped as it has not been fitted yet
5:08:29.788914 INFO: calibration group: precursor, predicting rt
5:08:36.563678 INFO: calibration group: fragment, predicting mz
5:08:54.324191 PROGRESS: === Epoch 6, step 0, extracting elution groups 0 to 1000 ===
5:08:54.412217 PROGRESS: Extracting batch of 1969 precursors
5:08:54.413901 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:08:54.413976 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:08:54.414017 INFO: FWHM in RT is 15.40 seconds, sigma is 0.56
5:08:54.414048 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:08:54.414275 INFO: Starting candidate selection
5:08:59.051204 INFO: Starting candidate scoring
5:09:00.338084 INFO: Finished candidate processing
5:09:00.338176 INFO: Collecting candidate features
5:09:02.483647 WARNING: intensity_correlation has 5 NaNs ( 0.27 % out of 1834)
5:09:02.489610 INFO: Collecting fragment features
5:09:03.117737 INFO: Finished candidate scoring
5:09:03.418216 PROGRESS: === Epoch 6, step 0, extracted 1834 precursors and 9679 fragments ===
5:09:03.418551 INFO: performing precursor FDR with 47 features
5:09:03.418593 INFO: Decoy channel: -1
5:09:03.418620 INFO: Competetive: True
5:09:03.423290 WARNING: dropped 4 target PSMs due to missing features
5:09:03.423363 WARNING: dropped 1 decoy PSMs due to missing features
5:09:03.450591 INFO: Test AUC: 0.496
5:09:03.450686 INFO: Train AUC: 0.554
5:09:03.450729 INFO: AUC difference: 10.43%
5:09:03.450762 WARNING: AUC difference > 5%. This may indicate overfitting.
5:09:03.569021 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
5:09:03.569816 PROGRESS: ============================= Precursor FDR =============================
5:09:03.569939 PROGRESS: Total precursors accumulated: 5
5:09:03.570015 PROGRESS: Target precursors: 5 (100.00%)
5:09:03.570083 PROGRESS: Decoy precursors: 0 (0.00%)
5:09:03.570147 PROGRESS: 
5:09:03.570208 PROGRESS: Precursor Summary:
5:09:03.571685 PROGRESS: Channel   0:	 0.05 FDR:     5; 0.01 FDR:     5; 0.001 FDR:     5
5:09:03.571797 PROGRESS: 
5:09:03.571887 PROGRESS: Protein Summary:
5:09:03.573556 PROGRESS: Channel   0:	 0.05 FDR:     5; 0.01 FDR:     5; 0.001 FDR:     5
5:09:03.573681 PROGRESS: =========================================================================
5:09:03.574574 PROGRESS: === Epoch 6, step 1, extracting elution groups 1000 to 3000 ===
5:09:03.651572 PROGRESS: Extracting batch of 3956 precursors
5:09:03.653719 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:09:03.653786 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:09:03.653843 INFO: FWHM in RT is 15.40 seconds, sigma is 0.56
5:09:03.653873 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:09:03.654088 INFO: Starting candidate selection
5:09:07.965587 INFO: Starting candidate scoring
5:09:09.272274 INFO: Finished candidate processing
5:09:09.272366 INFO: Collecting candidate features
5:09:11.458295 WARNING: intensity_correlation has 5 NaNs ( 0.14 % out of 3625)
5:09:11.465242 INFO: Collecting fragment features
5:09:12.113163 INFO: Finished candidate scoring
5:09:12.395633 PROGRESS: === Epoch 6, step 1, extracted 3625 precursors and 18611 fragments ===
5:09:12.395931 INFO: performing precursor FDR with 47 features
5:09:12.395976 INFO: Decoy channel: -1
5:09:12.396002 INFO: Competetive: True
5:09:12.404728 WARNING: dropped 8 target PSMs due to missing features
5:09:12.404819 WARNING: dropped 2 decoy PSMs due to missing features
5:09:12.442143 INFO: Test AUC: 0.555
5:09:12.442263 INFO: Train AUC: 0.541
5:09:12.442308 INFO: AUC difference: 2.73%
5:09:12.581367 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
5:09:12.582177 PROGRESS: ============================= Precursor FDR =============================
5:09:12.582306 PROGRESS: Total precursors accumulated: 14
5:09:12.582385 PROGRESS: Target precursors: 13 (92.86%)
5:09:12.582454 PROGRESS: Decoy precursors: 1 (7.14%)
5:09:12.582518 PROGRESS: 
5:09:12.582581 PROGRESS: Precursor Summary:
5:09:12.583993 PROGRESS: Channel   0:	 0.05 FDR:    13; 0.01 FDR:    13; 0.001 FDR:    13
5:09:12.584104 PROGRESS: 
5:09:12.584177 PROGRESS: Protein Summary:
5:09:12.585791 PROGRESS: Channel   0:	 0.05 FDR:    13; 0.01 FDR:    13; 0.001 FDR:    13
5:09:12.585904 PROGRESS: =========================================================================
5:09:12.586765 PROGRESS: === Epoch 6, step 2, extracting elution groups 3000 to 7000 ===
5:09:12.674568 PROGRESS: Extracting batch of 7901 precursors
5:09:12.677951 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:09:12.678018 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:09:12.678058 INFO: FWHM in RT is 15.40 seconds, sigma is 0.56
5:09:12.678087 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:09:12.678307 INFO: Starting candidate selection
5:09:17.051643 INFO: Starting candidate scoring
5:09:18.398860 INFO: Finished candidate processing
5:09:18.399046 INFO: Collecting candidate features
5:09:20.599390 WARNING: intensity_correlation has 13 NaNs ( 0.18 % out of 7292)
5:09:20.604904 INFO: Collecting fragment features
5:09:21.265628 INFO: Finished candidate scoring
5:09:21.553254 PROGRESS: === Epoch 6, step 2, extracted 7292 precursors and 38599 fragments ===
5:09:21.553581 INFO: performing precursor FDR with 47 features
5:09:21.553627 INFO: Decoy channel: -1
5:09:21.553653 INFO: Competetive: True
5:09:21.568603 WARNING: dropped 17 target PSMs due to missing features
5:09:21.568707 WARNING: dropped 6 decoy PSMs due to missing features
5:09:21.826295 INFO: Test AUC: 0.535
5:09:21.826432 INFO: Train AUC: 0.592
5:09:21.826475 INFO: AUC difference: 9.67%
5:09:21.826509 WARNING: AUC difference > 5%. This may indicate overfitting.
5:09:21.979771 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
5:09:21.980614 PROGRESS: ============================= Precursor FDR =============================
5:09:21.980738 PROGRESS: Total precursors accumulated: 66
5:09:21.980815 PROGRESS: Target precursors: 61 (92.42%)
5:09:21.980895 PROGRESS: Decoy precursors: 5 (7.58%)
5:09:21.980960 PROGRESS: 
5:09:21.981021 PROGRESS: Precursor Summary:
5:09:21.982481 PROGRESS: Channel   0:	 0.05 FDR:    45; 0.01 FDR:    35; 0.001 FDR:    35
5:09:21.982596 PROGRESS: 
5:09:21.982670 PROGRESS: Protein Summary:
5:09:21.984333 PROGRESS: Channel   0:	 0.05 FDR:    45; 0.01 FDR:    35; 0.001 FDR:    35
5:09:21.984445 PROGRESS: =========================================================================
5:09:21.985314 PROGRESS: === Epoch 6, step 3, extracting elution groups 7000 to 15000 ===
5:09:22.077364 PROGRESS: Extracting batch of 15813 precursors
5:09:22.086866 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:09:22.086944 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:09:22.086981 INFO: FWHM in RT is 15.40 seconds, sigma is 0.56
5:09:22.087025 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:09:22.087251 INFO: Starting candidate selection
5:09:26.631349 INFO: Starting candidate scoring
5:09:28.050703 INFO: Finished candidate processing
5:09:28.050794 INFO: Collecting candidate features
5:09:30.280588 WARNING: intensity_correlation has 28 NaNs ( 0.19 % out of 14654)
5:09:30.286659 INFO: Collecting fragment features
5:09:30.951643 INFO: Finished candidate scoring
5:09:31.248578 PROGRESS: === Epoch 6, step 3, extracted 14654 precursors and 77090 fragments ===
5:09:31.248942 INFO: performing precursor FDR with 47 features
5:09:31.248992 INFO: Decoy channel: -1
5:09:31.249019 INFO: Competetive: True
5:09:31.277925 WARNING: dropped 32 target PSMs due to missing features
5:09:31.278058 WARNING: dropped 19 decoy PSMs due to missing features
5:09:32.126674 INFO: Test AUC: 0.547
5:09:32.126821 INFO: Train AUC: 0.603
5:09:32.126868 INFO: AUC difference: 9.26%
5:09:32.126903 WARNING: AUC difference > 5%. This may indicate overfitting.
5:09:32.250321 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
5:09:32.251215 PROGRESS: ============================= Precursor FDR =============================
5:09:32.251339 PROGRESS: Total precursors accumulated: 144
5:09:32.251416 PROGRESS: Target precursors: 134 (93.06%)
5:09:32.251486 PROGRESS: Decoy precursors: 10 (6.94%)
5:09:32.251550 PROGRESS: 
5:09:32.251611 PROGRESS: Precursor Summary:
5:09:32.253099 PROGRESS: Channel   0:	 0.05 FDR:   103; 0.01 FDR:    65; 0.001 FDR:    65
5:09:32.253228 PROGRESS: 
5:09:32.253303 PROGRESS: Protein Summary:
5:09:32.255045 PROGRESS: Channel   0:	 0.05 FDR:   101; 0.01 FDR:    64; 0.001 FDR:    64
5:09:32.255159 PROGRESS: =========================================================================
5:09:32.256047 PROGRESS: === Epoch 6, step 4, extracting elution groups 15000 to 31000 ===
5:09:32.364674 PROGRESS: Extracting batch of 31597 precursors
5:09:32.375300 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:09:32.375419 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:09:32.375463 INFO: FWHM in RT is 15.40 seconds, sigma is 0.56
5:09:32.375493 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:09:32.375737 INFO: Starting candidate selection
5:09:37.260286 INFO: Starting candidate scoring
5:09:38.832136 INFO: Finished candidate processing
5:09:38.832234 INFO: Collecting candidate features
5:09:41.080396 WARNING: intensity_correlation has 58 NaNs ( 0.20 % out of 29270)
5:09:41.087237 INFO: Collecting fragment features
5:09:41.763347 INFO: Finished candidate scoring
5:09:42.074540 PROGRESS: === Epoch 6, step 4, extracted 29270 precursors and 152621 fragments ===
5:09:42.074872 INFO: performing precursor FDR with 47 features
5:09:42.074921 INFO: Decoy channel: -1
5:09:42.074947 INFO: Competetive: True
5:09:42.133604 WARNING: dropped 62 target PSMs due to missing features
5:09:42.133729 WARNING: dropped 47 decoy PSMs due to missing features
5:09:43.994437 INFO: Test AUC: 0.548
5:09:43.994588 INFO: Train AUC: 0.615
5:09:43.994635 INFO: AUC difference: 10.84%
5:09:43.994670 WARNING: AUC difference > 5%. This may indicate overfitting.
5:09:44.121602 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
5:09:44.122615 PROGRESS: ============================= Precursor FDR =============================
5:09:44.122739 PROGRESS: Total precursors accumulated: 439
5:09:44.122816 PROGRESS: Target precursors: 401 (91.34%)
5:09:44.122885 PROGRESS: Decoy precursors: 38 (8.66%)
5:09:44.122947 PROGRESS: 
5:09:44.123008 PROGRESS: Precursor Summary:
5:09:44.124633 PROGRESS: Channel   0:	 0.05 FDR:   289; 0.01 FDR:   222; 0.001 FDR:   177
5:09:44.124746 PROGRESS: 
5:09:44.124820 PROGRESS: Protein Summary:
5:09:44.126763 PROGRESS: Channel   0:	 0.05 FDR:   281; 0.01 FDR:   215; 0.001 FDR:   171
5:09:44.126875 PROGRESS: =========================================================================
5:09:44.127883 PROGRESS: === Epoch 6, step 5, extracting elution groups 31000 to 63000 ===
5:09:44.263587 PROGRESS: Extracting batch of 63257 precursors
5:09:44.283592 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:09:44.283701 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:09:44.283739 INFO: FWHM in RT is 15.40 seconds, sigma is 0.56
5:09:44.283800 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:09:44.284053 INFO: Starting candidate selection
5:09:49.848972 INFO: Starting candidate scoring
5:09:51.759627 INFO: Finished candidate processing
5:09:51.759816 INFO: Collecting candidate features
5:09:54.135661 WARNING: intensity_correlation has 118 NaNs ( 0.20 % out of 58554)
5:09:54.145648 INFO: Collecting fragment features
5:09:54.864101 INFO: Finished candidate scoring
5:09:55.213520 PROGRESS: === Epoch 6, step 5, extracted 58554 precursors and 306740 fragments ===
5:09:55.213911 INFO: performing precursor FDR with 47 features
5:09:55.213964 INFO: Decoy channel: -1
5:09:55.213991 INFO: Competetive: True
5:09:55.345884 WARNING: dropped 125 target PSMs due to missing features
5:09:55.346019 WARNING: dropped 102 decoy PSMs due to missing features
5:09:59.318144 INFO: Test AUC: 0.553
5:09:59.318262 INFO: Train AUC: 0.608
5:09:59.318307 INFO: AUC difference: 8.95%
5:09:59.318336 WARNING: AUC difference > 5%. This may indicate overfitting.
5:09:59.453556 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
5:09:59.454787 PROGRESS: ============================= Precursor FDR =============================
5:09:59.454916 PROGRESS: Total precursors accumulated: 987
5:09:59.454995 PROGRESS: Target precursors: 900 (91.19%)
5:09:59.455064 PROGRESS: Decoy precursors: 87 (8.81%)
5:09:59.455127 PROGRESS: 
5:09:59.455188 PROGRESS: Precursor Summary:
5:09:59.456951 PROGRESS: Channel   0:	 0.05 FDR:   550; 0.01 FDR:   358; 0.001 FDR:   197
5:09:59.457085 PROGRESS: 
5:09:59.457159 PROGRESS: Protein Summary:
5:09:59.459283 PROGRESS: Channel   0:	 0.05 FDR:   515; 0.01 FDR:   335; 0.001 FDR:   184
5:09:59.459413 PROGRESS: =========================================================================
5:09:59.460518 PROGRESS: === Epoch 6, step 6, extracting elution groups 63000 to 127000 ===
5:09:59.637190 PROGRESS: Extracting batch of 126472 precursors
5:09:59.676344 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:09:59.676459 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:09:59.676499 INFO: FWHM in RT is 15.40 seconds, sigma is 0.56
5:09:59.676542 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:09:59.676799 INFO: Starting candidate selection
5:10:06.500118 INFO: Starting candidate scoring
5:10:09.007800 INFO: Finished candidate processing
5:10:09.007949 INFO: Collecting candidate features
5:10:11.528223 WARNING: intensity_correlation has 262 NaNs ( 0.22 % out of 117143)
5:10:11.541824 INFO: Collecting fragment features
5:10:12.305406 INFO: Finished candidate scoring
5:10:12.727602 PROGRESS: === Epoch 6, step 6, extracted 117143 precursors and 614247 fragments ===
5:10:12.727962 INFO: performing precursor FDR with 47 features
5:10:12.728010 INFO: Decoy channel: -1
5:10:12.728036 INFO: Competetive: True
5:10:12.997451 WARNING: dropped 256 target PSMs due to missing features
5:10:12.997565 WARNING: dropped 233 decoy PSMs due to missing features
5:10:21.445199 INFO: Test AUC: 0.552
5:10:21.445324 INFO: Train AUC: 0.594
5:10:21.445381 INFO: AUC difference: 7.08%
5:10:21.445408 WARNING: AUC difference > 5%. This may indicate overfitting.
5:10:21.598850 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
5:10:21.600468 PROGRESS: ============================= Precursor FDR =============================
5:10:21.600610 PROGRESS: Total precursors accumulated: 2,021
5:10:21.600688 PROGRESS: Target precursors: 1,847 (91.39%)
5:10:21.600756 PROGRESS: Decoy precursors: 174 (8.61%)
5:10:21.600830 PROGRESS: 
5:10:21.600893 PROGRESS: Precursor Summary:
5:10:21.603081 PROGRESS: Channel   0:	 0.05 FDR: 1,244; 0.01 FDR:   863; 0.001 FDR:   605
5:10:21.603221 PROGRESS: 
5:10:21.603295 PROGRESS: Protein Summary:
5:10:21.605994 PROGRESS: Channel   0:	 0.05 FDR: 1,102; 0.01 FDR:   757; 0.001 FDR:   538
5:10:21.606109 PROGRESS: =========================================================================
5:10:21.607492 PROGRESS: === Epoch 6, step 7, extracting elution groups 127000 to 255000 ===
5:10:21.833882 PROGRESS: Extracting batch of 252973 precursors
5:10:21.906907 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:10:21.907041 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:10:21.907084 INFO: FWHM in RT is 15.40 seconds, sigma is 0.56
5:10:21.907112 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:10:21.907372 INFO: Starting candidate selection
5:10:31.373654 INFO: Starting candidate scoring
5:10:35.121525 INFO: Finished candidate processing
5:10:35.121721 INFO: Collecting candidate features
5:10:38.041310 WARNING: intensity_correlation has 462 NaNs ( 0.20 % out of 234333)
5:10:38.061317 INFO: Collecting fragment features
5:10:38.934958 INFO: Finished candidate scoring
5:10:39.514141 PROGRESS: === Epoch 6, step 7, extracted 234333 precursors and 1229258 fragments ===
5:10:39.514504 INFO: performing precursor FDR with 47 features
5:10:39.514550 INFO: Decoy channel: -1
5:10:39.514576 INFO: Competetive: True
5:10:40.102315 WARNING: dropped 492 target PSMs due to missing features
5:10:40.102434 WARNING: dropped 459 decoy PSMs due to missing features
5:10:57.214878 INFO: Test AUC: 0.552
5:10:57.215014 INFO: Train AUC: 0.579
5:10:57.215068 INFO: AUC difference: 4.73%
5:10:57.397047 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
5:10:57.399119 PROGRESS: ============================= Precursor FDR =============================
5:10:57.399275 PROGRESS: Total precursors accumulated: 3,459
5:10:57.399355 PROGRESS: Target precursors: 3,157 (91.27%)
5:10:57.399424 PROGRESS: Decoy precursors: 302 (8.73%)
5:10:57.399487 PROGRESS: 
5:10:57.399549 PROGRESS: Precursor Summary:
5:10:57.402181 PROGRESS: Channel   0:	 0.05 FDR: 2,412; 0.01 FDR: 1,665; 0.001 FDR: 1,197
5:10:57.402322 PROGRESS: 
5:10:57.402397 PROGRESS: Protein Summary:
5:10:57.405917 PROGRESS: Channel   0:	 0.05 FDR: 1,922; 0.01 FDR: 1,319; 0.001 FDR:   961
5:10:57.406041 PROGRESS: =========================================================================
5:10:57.408882 INFO: calibration group: precursor, fitting rt estimator 
5:10:57.639105 INFO: calibration group: fragment, fitting mz estimator 
5:10:58.224788 INFO: === checking if epoch conditions were reached ===
5:10:58.224948 INFO: ✅ ms2_error      : 7.0000 <= 7
5:10:58.225037 INFO: ❌ rt_error       : 200.6484 > 100
5:10:58.225110 INFO: ✅ current_epoch  : 6 >= 3
5:10:58.225175 INFO: ==============================================
5:10:58.443854 INFO: calibration group: precursor, predicting mz
5:10:58.444138 WARNING: mz prediction was skipped as it has not been fitted yet
5:10:58.444179 INFO: calibration group: precursor, predicting rt
5:11:05.146046 INFO: calibration group: fragment, predicting mz
5:11:23.081329 PROGRESS: === Epoch 7, step 0, extracting elution groups 0 to 1000 ===
5:11:23.169183 PROGRESS: Extracting batch of 1980 precursors
5:11:23.170934 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:11:23.171009 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:11:23.171047 INFO: FWHM in RT is 15.24 seconds, sigma is 0.55
5:11:23.171092 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:11:23.171318 INFO: Starting candidate selection
5:11:27.838273 INFO: Starting candidate scoring
5:11:29.132080 INFO: Finished candidate processing
5:11:29.132170 INFO: Collecting candidate features
5:11:31.291160 WARNING: intensity_correlation has 2 NaNs ( 0.11 % out of 1878)
5:11:31.296876 INFO: Collecting fragment features
5:11:31.935388 INFO: Finished candidate scoring
5:11:32.249622 PROGRESS: === Epoch 7, step 0, extracted 1878 precursors and 9754 fragments ===
5:11:32.249966 INFO: performing precursor FDR with 47 features
5:11:32.250010 INFO: Decoy channel: -1
5:11:32.250036 INFO: Competetive: True
5:11:32.254864 WARNING: dropped 1 target PSMs due to missing features
5:11:32.254933 WARNING: dropped 1 decoy PSMs due to missing features
5:11:32.283317 INFO: Test AUC: 0.534
5:11:32.283407 INFO: Train AUC: 0.549
5:11:32.283451 INFO: AUC difference: 2.86%
5:11:32.402009 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
5:11:32.402793 PROGRESS: ============================= Precursor FDR =============================
5:11:32.402938 PROGRESS: Total precursors accumulated: 15
5:11:32.403033 PROGRESS: Target precursors: 14 (93.33%)
5:11:32.403119 PROGRESS: Decoy precursors: 1 (6.67%)
5:11:32.403206 PROGRESS: 
5:11:32.403286 PROGRESS: Precursor Summary:
5:11:32.404687 PROGRESS: Channel   0:	 0.05 FDR:    14; 0.01 FDR:    14; 0.001 FDR:    14
5:11:32.404807 PROGRESS: 
5:11:32.404907 PROGRESS: Protein Summary:
5:11:32.406741 PROGRESS: Channel   0:	 0.05 FDR:    14; 0.01 FDR:    14; 0.001 FDR:    14
5:11:32.406867 PROGRESS: =========================================================================
5:11:32.407734 PROGRESS: === Epoch 7, step 1, extracting elution groups 1000 to 3000 ===
5:11:32.488272 PROGRESS: Extracting batch of 3953 precursors
5:11:32.490474 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:11:32.490536 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:11:32.490580 INFO: FWHM in RT is 15.24 seconds, sigma is 0.55
5:11:32.490632 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:11:32.490857 INFO: Starting candidate selection
5:11:36.795493 INFO: Starting candidate scoring
5:11:38.106007 INFO: Finished candidate processing
5:11:38.106176 INFO: Collecting candidate features
5:11:40.312467 WARNING: intensity_correlation has 3 NaNs ( 0.08 % out of 3714)
5:11:40.318908 INFO: Collecting fragment features
5:11:40.969919 INFO: Finished candidate scoring
5:11:41.252800 PROGRESS: === Epoch 7, step 1, extracted 3714 precursors and 19496 fragments ===
5:11:41.253087 INFO: performing precursor FDR with 47 features
5:11:41.253135 INFO: Decoy channel: -1
5:11:41.253162 INFO: Competetive: True
5:11:41.262009 WARNING: dropped 3 target PSMs due to missing features
5:11:41.262101 WARNING: dropped 2 decoy PSMs due to missing features
5:11:41.299881 INFO: Test AUC: 0.533
5:11:41.299998 INFO: Train AUC: 0.547
5:11:41.300041 INFO: AUC difference: 2.57%
5:11:41.418913 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
5:11:41.419711 PROGRESS: ============================= Precursor FDR =============================
5:11:41.419834 PROGRESS: Total precursors accumulated: 59
5:11:41.419914 PROGRESS: Target precursors: 55 (93.22%)
5:11:41.419983 PROGRESS: Decoy precursors: 4 (6.78%)
5:11:41.420047 PROGRESS: 
5:11:41.420110 PROGRESS: Precursor Summary:
5:11:41.421556 PROGRESS: Channel   0:	 0.05 FDR:    48; 0.01 FDR:    46; 0.001 FDR:    46
5:11:41.421685 PROGRESS: 
5:11:41.421759 PROGRESS: Protein Summary:
5:11:41.423426 PROGRESS: Channel   0:	 0.05 FDR:    48; 0.01 FDR:    46; 0.001 FDR:    46
5:11:41.423564 PROGRESS: =========================================================================
5:11:41.424445 PROGRESS: === Epoch 7, step 2, extracting elution groups 3000 to 7000 ===
5:11:41.506760 PROGRESS: Extracting batch of 7905 precursors
5:11:41.510148 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:11:41.510218 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:11:41.510260 INFO: FWHM in RT is 15.24 seconds, sigma is 0.55
5:11:41.510290 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:11:41.510508 INFO: Starting candidate selection
5:11:45.904188 INFO: Starting candidate scoring
5:11:47.240751 INFO: Finished candidate processing
5:11:47.240844 INFO: Collecting candidate features
5:11:49.442612 WARNING: intensity_correlation has 11 NaNs ( 0.15 % out of 7449)
5:11:49.448241 INFO: Collecting fragment features
5:11:50.100260 INFO: Finished candidate scoring
5:11:50.388296 PROGRESS: === Epoch 7, step 2, extracted 7449 precursors and 39219 fragments ===
5:11:50.388616 INFO: performing precursor FDR with 47 features
5:11:50.388662 INFO: Decoy channel: -1
5:11:50.388688 INFO: Competetive: True
5:11:50.404498 WARNING: dropped 11 target PSMs due to missing features
5:11:50.404596 WARNING: dropped 5 decoy PSMs due to missing features
5:11:50.681796 INFO: Test AUC: 0.530
5:11:50.681964 INFO: Train AUC: 0.592
5:11:50.682020 INFO: AUC difference: 10.47%
5:11:50.682062 WARNING: AUC difference > 5%. This may indicate overfitting.
5:11:50.800956 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
5:11:50.801823 PROGRESS: ============================= Precursor FDR =============================
5:11:50.801945 PROGRESS: Total precursors accumulated: 93
5:11:50.802023 PROGRESS: Target precursors: 87 (93.55%)
5:11:50.802092 PROGRESS: Decoy precursors: 6 (6.45%)
5:11:50.802156 PROGRESS: 
5:11:50.802218 PROGRESS: Precursor Summary:
5:11:50.803692 PROGRESS: Channel   0:	 0.05 FDR:    83; 0.01 FDR:    65; 0.001 FDR:    65
5:11:50.803820 PROGRESS: 
5:11:50.803895 PROGRESS: Protein Summary:
5:11:50.805586 PROGRESS: Channel   0:	 0.05 FDR:    82; 0.01 FDR:    64; 0.001 FDR:    64
5:11:50.805698 PROGRESS: =========================================================================
5:11:50.806593 PROGRESS: === Epoch 7, step 3, extracting elution groups 7000 to 15000 ===
5:11:50.903695 PROGRESS: Extracting batch of 15800 precursors
5:11:50.910418 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:11:50.910493 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:11:50.910530 INFO: FWHM in RT is 15.24 seconds, sigma is 0.55
5:11:50.910556 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:11:50.910776 INFO: Starting candidate selection
5:11:55.527004 INFO: Starting candidate scoring
5:11:56.970984 INFO: Finished candidate processing
5:11:56.971184 INFO: Collecting candidate features
5:11:59.204866 WARNING: intensity_correlation has 35 NaNs ( 0.23 % out of 14935)
5:11:59.210871 INFO: Collecting fragment features
5:11:59.879739 INFO: Finished candidate scoring
5:12:00.181408 PROGRESS: === Epoch 7, step 3, extracted 14935 precursors and 78766 fragments ===
5:12:00.181751 INFO: performing precursor FDR with 47 features
5:12:00.181808 INFO: Decoy channel: -1
5:12:00.181835 INFO: Competetive: True
5:12:00.210893 WARNING: dropped 31 target PSMs due to missing features
5:12:00.211006 WARNING: dropped 20 decoy PSMs due to missing features
5:12:00.904699 INFO: Test AUC: 0.544
5:12:00.904850 INFO: Train AUC: 0.598
5:12:00.904902 INFO: AUC difference: 9.07%
5:12:00.904942 WARNING: AUC difference > 5%. This may indicate overfitting.
5:12:01.029836 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
5:12:01.030811 PROGRESS: ============================= Precursor FDR =============================
5:12:01.030953 PROGRESS: Total precursors accumulated: 322
5:12:01.031037 PROGRESS: Target precursors: 294 (91.30%)
5:12:01.031111 PROGRESS: Decoy precursors: 28 (8.70%)
5:12:01.031181 PROGRESS: 
5:12:01.031248 PROGRESS: Precursor Summary:
5:12:01.032759 PROGRESS: Channel   0:	 0.05 FDR:   166; 0.01 FDR:   111; 0.001 FDR:   101
5:12:01.032876 PROGRESS: 
5:12:01.032966 PROGRESS: Protein Summary:
5:12:01.034960 PROGRESS: Channel   0:	 0.05 FDR:   161; 0.01 FDR:   106; 0.001 FDR:    96
5:12:01.035075 PROGRESS: =========================================================================
5:12:01.035986 PROGRESS: === Epoch 7, step 4, extracting elution groups 15000 to 31000 ===
5:12:01.146002 PROGRESS: Extracting batch of 31637 precursors
5:12:01.156657 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:12:01.156774 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:12:01.156817 INFO: FWHM in RT is 15.24 seconds, sigma is 0.55
5:12:01.156845 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:12:01.157086 INFO: Starting candidate selection
5:12:06.076349 INFO: Starting candidate scoring
5:12:07.676424 INFO: Finished candidate processing
5:12:07.676518 INFO: Collecting candidate features
5:12:09.923341 WARNING: intensity_correlation has 61 NaNs ( 0.20 % out of 29847)
5:12:09.930251 INFO: Collecting fragment features
5:12:10.608603 INFO: Finished candidate scoring
5:12:10.919219 PROGRESS: === Epoch 7, step 4, extracted 29847 precursors and 157758 fragments ===
5:12:10.919574 INFO: performing precursor FDR with 47 features
5:12:10.919635 INFO: Decoy channel: -1
5:12:10.919662 INFO: Competetive: True
5:12:10.978616 WARNING: dropped 59 target PSMs due to missing features
5:12:10.978742 WARNING: dropped 53 decoy PSMs due to missing features
5:12:12.833734 INFO: Test AUC: 0.540
5:12:12.833883 INFO: Train AUC: 0.616
5:12:12.833930 INFO: AUC difference: 12.46%
5:12:12.833964 WARNING: AUC difference > 5%. This may indicate overfitting.
5:12:12.960849 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
5:12:12.962008 PROGRESS: ============================= Precursor FDR =============================
5:12:12.962138 PROGRESS: Total precursors accumulated: 763
5:12:12.962216 PROGRESS: Target precursors: 695 (91.09%)
5:12:12.962284 PROGRESS: Decoy precursors: 68 (8.91%)
5:12:12.962347 PROGRESS: 
5:12:12.962418 PROGRESS: Precursor Summary:
5:12:12.964118 PROGRESS: Channel   0:	 0.05 FDR:   415; 0.01 FDR:   258; 0.001 FDR:   187
5:12:12.964251 PROGRESS: 
5:12:12.964325 PROGRESS: Protein Summary:
5:12:12.966319 PROGRESS: Channel   0:	 0.05 FDR:   399; 0.01 FDR:   248; 0.001 FDR:   179
5:12:12.966434 PROGRESS: =========================================================================
5:12:12.967456 PROGRESS: === Epoch 7, step 5, extracting elution groups 31000 to 63000 ===
5:12:13.104109 PROGRESS: Extracting batch of 63252 precursors
5:12:13.124550 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:12:13.124660 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:12:13.124697 INFO: FWHM in RT is 15.24 seconds, sigma is 0.55
5:12:13.124741 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:12:13.124989 INFO: Starting candidate selection
5:12:18.659422 INFO: Starting candidate scoring
5:12:20.543414 INFO: Finished candidate processing
5:12:20.543505 INFO: Collecting candidate features
5:12:22.923272 WARNING: intensity_correlation has 99 NaNs ( 0.17 % out of 59688)
5:12:22.933221 INFO: Collecting fragment features
5:12:23.656119 INFO: Finished candidate scoring
5:12:24.007011 PROGRESS: === Epoch 7, step 5, extracted 59688 precursors and 315064 fragments ===
5:12:24.007377 INFO: performing precursor FDR with 47 features
5:12:24.007425 INFO: Decoy channel: -1
5:12:24.007451 INFO: Competetive: True
5:12:24.144249 WARNING: dropped 99 target PSMs due to missing features
5:12:24.144367 WARNING: dropped 112 decoy PSMs due to missing features
5:12:27.989197 INFO: Test AUC: 0.552
5:12:27.989319 INFO: Train AUC: 0.607
5:12:27.989374 INFO: AUC difference: 9.07%
5:12:27.989403 WARNING: AUC difference > 5%. This may indicate overfitting.
5:12:28.126202 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
5:12:28.127483 PROGRESS: ============================= Precursor FDR =============================
5:12:28.127627 PROGRESS: Total precursors accumulated: 1,189
5:12:28.127707 PROGRESS: Target precursors: 1,084 (91.17%)
5:12:28.127778 PROGRESS: Decoy precursors: 105 (8.83%)
5:12:28.127842 PROGRESS: 
5:12:28.127904 PROGRESS: Precursor Summary:
5:12:28.129778 PROGRESS: Channel   0:	 0.05 FDR:   704; 0.01 FDR:   476; 0.001 FDR:   380
5:12:28.129915 PROGRESS: 
5:12:28.129989 PROGRESS: Protein Summary:
5:12:28.132242 PROGRESS: Channel   0:	 0.05 FDR:   665; 0.01 FDR:   443; 0.001 FDR:   354
5:12:28.132354 PROGRESS: =========================================================================
5:12:28.133524 PROGRESS: === Epoch 7, step 6, extracting elution groups 63000 to 127000 ===
5:12:28.312652 PROGRESS: Extracting batch of 126490 precursors
5:12:28.351355 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:12:28.351470 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:12:28.351507 INFO: FWHM in RT is 15.24 seconds, sigma is 0.55
5:12:28.351549 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:12:28.351802 INFO: Starting candidate selection
5:12:35.207169 INFO: Starting candidate scoring
5:12:37.712131 INFO: Finished candidate processing
5:12:37.712221 INFO: Collecting candidate features
5:12:40.240359 WARNING: intensity_correlation has 287 NaNs ( 0.24 % out of 119319)
5:12:40.254158 INFO: Collecting fragment features
5:12:41.025588 INFO: Finished candidate scoring
5:12:41.449374 PROGRESS: === Epoch 7, step 6, extracted 119319 precursors and 628076 fragments ===
5:12:41.449729 INFO: performing precursor FDR with 47 features
5:12:41.449786 INFO: Decoy channel: -1
5:12:41.449813 INFO: Competetive: True
5:12:41.722979 WARNING: dropped 258 target PSMs due to missing features
5:12:41.723098 WARNING: dropped 240 decoy PSMs due to missing features
5:12:49.934399 INFO: Test AUC: 0.551
5:12:49.934548 INFO: Train AUC: 0.592
5:12:49.934606 INFO: AUC difference: 6.93%
5:12:49.934655 WARNING: AUC difference > 5%. This may indicate overfitting.
5:12:50.092002 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
5:12:50.093588 PROGRESS: ============================= Precursor FDR =============================
5:12:50.093726 PROGRESS: Total precursors accumulated: 2,149
5:12:50.093857 PROGRESS: Target precursors: 1,963 (91.34%)
5:12:50.093948 PROGRESS: Decoy precursors: 186 (8.66%)
5:12:50.094030 PROGRESS: 
5:12:50.094111 PROGRESS: Precursor Summary:
5:12:50.096310 PROGRESS: Channel   0:	 0.05 FDR: 1,393; 0.01 FDR:   840; 0.001 FDR:   687
5:12:50.096436 PROGRESS: 
5:12:50.096535 PROGRESS: Protein Summary:
5:12:50.100310 PROGRESS: Channel   0:	 0.05 FDR: 1,226; 0.01 FDR:   726; 0.001 FDR:   598
5:12:50.100444 PROGRESS: =========================================================================
5:12:50.101827 PROGRESS: === Epoch 7, step 7, extracting elution groups 127000 to 255000 ===
5:12:50.325870 PROGRESS: Extracting batch of 252905 precursors
5:12:50.398366 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:12:50.398499 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:12:50.398557 INFO: FWHM in RT is 15.24 seconds, sigma is 0.55
5:12:50.398604 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:12:50.398879 INFO: Starting candidate selection
5:12:59.911170 INFO: Starting candidate scoring
5:13:03.692655 INFO: Finished candidate processing
5:13:03.692751 INFO: Collecting candidate features
5:13:06.658717 WARNING: intensity_correlation has 460 NaNs ( 0.19 % out of 238456)
5:13:06.678718 INFO: Collecting fragment features
5:13:07.563147 INFO: Finished candidate scoring
5:13:08.142368 PROGRESS: === Epoch 7, step 7, extracted 238456 precursors and 1253278 fragments ===
5:13:08.142732 INFO: performing precursor FDR with 47 features
5:13:08.142779 INFO: Decoy channel: -1
5:13:08.142806 INFO: Competetive: True
5:13:08.741063 WARNING: dropped 490 target PSMs due to missing features
5:13:08.741185 WARNING: dropped 468 decoy PSMs due to missing features
5:13:26.195717 INFO: Test AUC: 0.551
5:13:26.195847 INFO: Train AUC: 0.578
5:13:26.195902 INFO: AUC difference: 4.58%
5:13:26.378941 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
5:13:26.380890 PROGRESS: ============================= Precursor FDR =============================
5:13:26.381027 PROGRESS: Total precursors accumulated: 3,556
5:13:26.381107 PROGRESS: Target precursors: 3,247 (91.31%)
5:13:26.381175 PROGRESS: Decoy precursors: 309 (8.69%)
5:13:26.381236 PROGRESS: 
5:13:26.381296 PROGRESS: Precursor Summary:
5:13:26.383994 PROGRESS: Channel   0:	 0.05 FDR: 2,496; 0.01 FDR: 1,822; 0.001 FDR: 1,395
5:13:26.384131 PROGRESS: 
5:13:26.384204 PROGRESS: Protein Summary:
5:13:26.387801 PROGRESS: Channel   0:	 0.05 FDR: 1,996; 0.01 FDR: 1,424; 0.001 FDR: 1,107
5:13:26.387908 PROGRESS: =========================================================================
5:13:26.390980 INFO: calibration group: precursor, fitting rt estimator 
5:13:26.631188 INFO: calibration group: fragment, fitting mz estimator 
5:13:27.218538 INFO: === checking if epoch conditions were reached ===
5:13:27.218729 INFO: ✅ ms2_error      : 7.0000 <= 7
5:13:27.218818 INFO: ❌ rt_error       : 204.9690 > 100
5:13:27.218891 INFO: ✅ current_epoch  : 7 >= 3
5:13:27.218965 INFO: ==============================================
5:13:27.436033 INFO: calibration group: precursor, predicting mz
5:13:27.436297 WARNING: mz prediction was skipped as it has not been fitted yet
5:13:27.436340 INFO: calibration group: precursor, predicting rt
5:13:34.201183 INFO: calibration group: fragment, predicting mz
5:13:52.173506 PROGRESS: === Epoch 8, step 0, extracting elution groups 0 to 1000 ===
5:13:52.261475 PROGRESS: Extracting batch of 1978 precursors
5:13:52.263193 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:13:52.263268 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:13:52.263306 INFO: FWHM in RT is 15.17 seconds, sigma is 0.55
5:13:52.263351 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:13:52.263579 INFO: Starting candidate selection
5:13:56.965934 INFO: Starting candidate scoring
5:13:58.274817 INFO: Finished candidate processing
5:13:58.274907 INFO: Collecting candidate features
5:14:00.454921 WARNING: intensity_correlation has 6 NaNs ( 0.32 % out of 1856)
5:14:00.460952 INFO: Collecting fragment features
5:14:01.094518 INFO: Finished candidate scoring
5:14:01.408736 PROGRESS: === Epoch 8, step 0, extracted 1856 precursors and 9904 fragments ===
5:14:01.409071 INFO: performing precursor FDR with 47 features
5:14:01.409112 INFO: Decoy channel: -1
5:14:01.409140 INFO: Competetive: True
5:14:01.413841 WARNING: dropped 1 target PSMs due to missing features
5:14:01.413916 WARNING: dropped 5 decoy PSMs due to missing features
5:14:01.441825 INFO: Test AUC: 0.566
5:14:01.441920 INFO: Train AUC: 0.549
5:14:01.441964 INFO: AUC difference: 3.06%
5:14:01.560857 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
5:14:01.561587 PROGRESS: ============================= Precursor FDR =============================
5:14:01.561700 PROGRESS: Total precursors accumulated: 12
5:14:01.561783 PROGRESS: Target precursors: 11 (91.67%)
5:14:01.561870 PROGRESS: Decoy precursors: 1 (8.33%)
5:14:01.561933 PROGRESS: 
5:14:01.561994 PROGRESS: Precursor Summary:
5:14:01.563393 PROGRESS: Channel   0:	 0.05 FDR:    10; 0.01 FDR:    10; 0.001 FDR:    10
5:14:01.563501 PROGRESS: 
5:14:01.563572 PROGRESS: Protein Summary:
5:14:01.565118 PROGRESS: Channel   0:	 0.05 FDR:    10; 0.01 FDR:    10; 0.001 FDR:    10
5:14:01.565226 PROGRESS: =========================================================================
5:14:01.566085 PROGRESS: === Epoch 8, step 1, extracting elution groups 1000 to 3000 ===
5:14:01.643365 PROGRESS: Extracting batch of 3950 precursors
5:14:01.645472 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:14:01.645533 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:14:01.645571 INFO: FWHM in RT is 15.17 seconds, sigma is 0.55
5:14:01.645601 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:14:01.645832 INFO: Starting candidate selection
5:14:06.015453 INFO: Starting candidate scoring
5:14:07.347203 INFO: Finished candidate processing
5:14:07.347294 INFO: Collecting candidate features
5:14:09.508959 WARNING: intensity_correlation has 5 NaNs ( 0.13 % out of 3739)
5:14:09.515816 INFO: Collecting fragment features
5:14:10.157640 INFO: Finished candidate scoring
5:14:10.437889 PROGRESS: === Epoch 8, step 1, extracted 3739 precursors and 19962 fragments ===
5:14:10.438154 INFO: performing precursor FDR with 47 features
5:14:10.438202 INFO: Decoy channel: -1
5:14:10.438229 INFO: Competetive: True
5:14:10.446812 WARNING: dropped 6 target PSMs due to missing features
5:14:10.446899 WARNING: dropped 5 decoy PSMs due to missing features
5:14:10.484069 INFO: Test AUC: 0.538
5:14:10.484189 INFO: Train AUC: 0.546
5:14:10.484237 INFO: AUC difference: 1.55%
5:14:10.602621 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
5:14:10.603393 PROGRESS: ============================= Precursor FDR =============================
5:14:10.603525 PROGRESS: Total precursors accumulated: 34
5:14:10.603605 PROGRESS: Target precursors: 31 (91.18%)
5:14:10.603674 PROGRESS: Decoy precursors: 3 (8.82%)
5:14:10.603738 PROGRESS: 
5:14:10.603805 PROGRESS: Precursor Summary:
5:14:10.605223 PROGRESS: Channel   0:	 0.05 FDR:    25; 0.01 FDR:    25; 0.001 FDR:    25
5:14:10.605347 PROGRESS: 
5:14:10.605421 PROGRESS: Protein Summary:
5:14:10.607048 PROGRESS: Channel   0:	 0.05 FDR:    25; 0.01 FDR:    25; 0.001 FDR:    25
5:14:10.607159 PROGRESS: =========================================================================
5:14:10.608011 PROGRESS: === Epoch 8, step 2, extracting elution groups 3000 to 7000 ===
5:14:10.690935 PROGRESS: Extracting batch of 7884 precursors
5:14:10.694188 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:14:10.694255 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:14:10.694294 INFO: FWHM in RT is 15.17 seconds, sigma is 0.55
5:14:10.694324 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:14:10.694543 INFO: Starting candidate selection
5:14:15.145442 INFO: Starting candidate scoring
5:14:16.516058 INFO: Finished candidate processing
5:14:16.516153 INFO: Collecting candidate features
5:14:18.692049 WARNING: intensity_correlation has 14 NaNs ( 0.19 % out of 7466)
5:14:18.697587 INFO: Collecting fragment features
5:14:19.348800 INFO: Finished candidate scoring
5:14:19.634612 PROGRESS: === Epoch 8, step 2, extracted 7466 precursors and 39010 fragments ===
5:14:19.634944 INFO: performing precursor FDR with 47 features
5:14:19.634989 INFO: Decoy channel: -1
5:14:19.635016 INFO: Competetive: True
5:14:19.650023 WARNING: dropped 10 target PSMs due to missing features
5:14:19.650142 WARNING: dropped 15 decoy PSMs due to missing features
5:14:19.865823 INFO: Test AUC: 0.524
5:14:19.865966 INFO: Train AUC: 0.587
5:14:19.866026 INFO: AUC difference: 10.82%
5:14:19.866071 WARNING: AUC difference > 5%. This may indicate overfitting.
5:14:19.991549 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
5:14:19.992407 PROGRESS: ============================= Precursor FDR =============================
5:14:19.992531 PROGRESS: Total precursors accumulated: 89
5:14:19.992607 PROGRESS: Target precursors: 81 (91.01%)
5:14:19.992675 PROGRESS: Decoy precursors: 8 (8.99%)
5:14:19.992737 PROGRESS: 
5:14:19.992799 PROGRESS: Precursor Summary:
5:14:19.994267 PROGRESS: Channel   0:	 0.05 FDR:    57; 0.01 FDR:    53; 0.001 FDR:    53
5:14:19.994390 PROGRESS: 
5:14:19.994465 PROGRESS: Protein Summary:
5:14:19.996116 PROGRESS: Channel   0:	 0.05 FDR:    57; 0.01 FDR:    53; 0.001 FDR:    53
5:14:19.996226 PROGRESS: =========================================================================
5:14:19.997097 PROGRESS: === Epoch 8, step 3, extracting elution groups 7000 to 15000 ===
5:14:20.088007 PROGRESS: Extracting batch of 15788 precursors
5:14:20.093528 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:14:20.093597 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:14:20.093632 INFO: FWHM in RT is 15.17 seconds, sigma is 0.55
5:14:20.093673 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:14:20.093903 INFO: Starting candidate selection
5:14:24.665492 INFO: Starting candidate scoring
5:14:26.084662 INFO: Finished candidate processing
5:14:26.084759 INFO: Collecting candidate features
5:14:28.287245 WARNING: intensity_correlation has 24 NaNs ( 0.16 % out of 14976)
5:14:28.293118 INFO: Collecting fragment features
5:14:28.952622 INFO: Finished candidate scoring
5:14:29.247207 PROGRESS: === Epoch 8, step 3, extracted 14976 precursors and 78844 fragments ===
5:14:29.247559 INFO: performing precursor FDR with 47 features
5:14:29.247605 INFO: Decoy channel: -1
5:14:29.247632 INFO: Competetive: True
5:14:29.276572 WARNING: dropped 23 target PSMs due to missing features
5:14:29.276706 WARNING: dropped 26 decoy PSMs due to missing features
5:14:30.017935 INFO: Test AUC: 0.545
5:14:30.018120 INFO: Train AUC: 0.601
5:14:30.018171 INFO: AUC difference: 9.25%
5:14:30.018207 WARNING: AUC difference > 5%. This may indicate overfitting.
5:14:30.153128 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
5:14:30.154037 PROGRESS: ============================= Precursor FDR =============================
5:14:30.154178 PROGRESS: Total precursors accumulated: 157
5:14:30.154257 PROGRESS: Target precursors: 145 (92.36%)
5:14:30.154326 PROGRESS: Decoy precursors: 12 (7.64%)
5:14:30.154388 PROGRESS: 
5:14:30.154449 PROGRESS: Precursor Summary:
5:14:30.155961 PROGRESS: Channel   0:	 0.05 FDR:   128; 0.01 FDR:    77; 0.001 FDR:    77
5:14:30.156089 PROGRESS: 
5:14:30.156163 PROGRESS: Protein Summary:
5:14:30.157896 PROGRESS: Channel   0:	 0.05 FDR:   126; 0.01 FDR:    76; 0.001 FDR:    76
5:14:30.158009 PROGRESS: =========================================================================
5:14:30.158907 PROGRESS: === Epoch 8, step 4, extracting elution groups 15000 to 31000 ===
5:14:30.266858 PROGRESS: Extracting batch of 31590 precursors
5:14:30.277489 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:14:30.277600 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:14:30.277639 INFO: FWHM in RT is 15.17 seconds, sigma is 0.55
5:14:30.277665 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:14:30.277916 INFO: Starting candidate selection
5:14:35.200190 INFO: Starting candidate scoring
5:14:36.791416 INFO: Finished candidate processing
5:14:36.791509 INFO: Collecting candidate features
5:14:39.070869 WARNING: intensity_correlation has 50 NaNs ( 0.17 % out of 29964)
5:14:39.077735 INFO: Collecting fragment features
5:14:39.763090 INFO: Finished candidate scoring
5:14:40.078302 PROGRESS: === Epoch 8, step 4, extracted 29964 precursors and 158025 fragments ===
5:14:40.078628 INFO: performing precursor FDR with 47 features
5:14:40.078675 INFO: Decoy channel: -1
5:14:40.078703 INFO: Competetive: True
5:14:40.138748 WARNING: dropped 54 target PSMs due to missing features
5:14:40.138862 WARNING: dropped 45 decoy PSMs due to missing features
5:14:41.886700 INFO: Test AUC: 0.553
5:14:41.886851 INFO: Train AUC: 0.606
5:14:41.886898 INFO: AUC difference: 8.75%
5:14:41.886932 WARNING: AUC difference > 5%. This may indicate overfitting.
5:14:42.013828 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
5:14:42.014929 PROGRESS: ============================= Precursor FDR =============================
5:14:42.015082 PROGRESS: Total precursors accumulated: 651
5:14:42.015159 PROGRESS: Target precursors: 594 (91.24%)
5:14:42.015226 PROGRESS: Decoy precursors: 57 (8.76%)
5:14:42.015288 PROGRESS: 
5:14:42.015348 PROGRESS: Precursor Summary:
5:14:42.016963 PROGRESS: Channel   0:	 0.05 FDR:   304; 0.01 FDR:   190; 0.001 FDR:   166
5:14:42.017091 PROGRESS: 
5:14:42.017165 PROGRESS: Protein Summary:
5:14:42.019070 PROGRESS: Channel   0:	 0.05 FDR:   297; 0.01 FDR:   183; 0.001 FDR:   161
5:14:42.019181 PROGRESS: =========================================================================
5:14:42.020152 PROGRESS: === Epoch 8, step 5, extracting elution groups 31000 to 63000 ===
5:14:42.156263 PROGRESS: Extracting batch of 63258 precursors
5:14:42.176491 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:14:42.176598 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:14:42.176637 INFO: FWHM in RT is 15.17 seconds, sigma is 0.55
5:14:42.176679 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:14:42.176926 INFO: Starting candidate selection
5:14:47.710870 INFO: Starting candidate scoring
5:14:49.602237 INFO: Finished candidate processing
5:14:49.602416 INFO: Collecting candidate features
5:14:51.951347 WARNING: intensity_correlation has 113 NaNs ( 0.19 % out of 59943)
5:14:51.960930 INFO: Collecting fragment features
5:14:52.670893 INFO: Finished candidate scoring
5:14:53.019022 PROGRESS: === Epoch 8, step 5, extracted 59943 precursors and 315096 fragments ===
5:14:53.019383 INFO: performing precursor FDR with 47 features
5:14:53.020077 INFO: Decoy channel: -1
5:14:53.020168 INFO: Competetive: True
5:14:53.153609 WARNING: dropped 110 target PSMs due to missing features
5:14:53.153727 WARNING: dropped 102 decoy PSMs due to missing features
5:14:57.192802 INFO: Test AUC: 0.556
5:14:57.192938 INFO: Train AUC: 0.605
5:14:57.192994 INFO: AUC difference: 8.09%
5:14:57.193022 WARNING: AUC difference > 5%. This may indicate overfitting.
5:14:57.329904 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
5:14:57.331241 PROGRESS: ============================= Precursor FDR =============================
5:14:57.331362 PROGRESS: Total precursors accumulated: 1,370
5:14:57.331450 PROGRESS: Target precursors: 1,248 (91.09%)
5:14:57.331518 PROGRESS: Decoy precursors: 122 (8.91%)
5:14:57.331579 PROGRESS: 
5:14:57.331639 PROGRESS: Precursor Summary:
5:14:57.333501 PROGRESS: Channel   0:	 0.05 FDR:   814; 0.01 FDR:   529; 0.001 FDR:   425
5:14:57.333613 PROGRESS: 
5:14:57.333684 PROGRESS: Protein Summary:
5:14:57.336008 PROGRESS: Channel   0:	 0.05 FDR:   767; 0.01 FDR:   490; 0.001 FDR:   393
5:14:57.336120 PROGRESS: =========================================================================
5:14:57.337273 PROGRESS: === Epoch 8, step 6, extracting elution groups 63000 to 127000 ===
5:14:57.514402 PROGRESS: Extracting batch of 126536 precursors
5:14:57.555914 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:14:57.556030 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:14:57.556071 INFO: FWHM in RT is 15.17 seconds, sigma is 0.55
5:14:57.556115 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:14:57.556378 INFO: Starting candidate selection
5:15:04.384018 INFO: Starting candidate scoring
5:15:06.916947 INFO: Finished candidate processing
5:15:06.917134 INFO: Collecting candidate features
5:15:09.480188 WARNING: intensity_correlation has 216 NaNs ( 0.18 % out of 119847)
5:15:09.494223 INFO: Collecting fragment features
5:15:10.271324 INFO: Finished candidate scoring
5:15:10.700257 PROGRESS: === Epoch 8, step 6, extracted 119847 precursors and 631351 fragments ===
5:15:10.700631 INFO: performing precursor FDR with 47 features
5:15:10.700682 INFO: Decoy channel: -1
5:15:10.700712 INFO: Competetive: True
5:15:10.978119 WARNING: dropped 218 target PSMs due to missing features
5:15:10.978255 WARNING: dropped 210 decoy PSMs due to missing features
5:15:19.493045 INFO: Test AUC: 0.551
5:15:19.493175 INFO: Train AUC: 0.590
5:15:19.493231 INFO: AUC difference: 6.67%
5:15:19.493260 WARNING: AUC difference > 5%. This may indicate overfitting.
5:15:19.648741 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
5:15:19.650344 PROGRESS: ============================= Precursor FDR =============================
5:15:19.650475 PROGRESS: Total precursors accumulated: 2,209
5:15:19.650552 PROGRESS: Target precursors: 2,012 (91.08%)
5:15:19.650620 PROGRESS: Decoy precursors: 197 (8.92%)
5:15:19.650682 PROGRESS: 
5:15:19.650743 PROGRESS: Precursor Summary:
5:15:19.653015 PROGRESS: Channel   0:	 0.05 FDR: 1,472; 0.01 FDR: 1,018; 0.001 FDR:   766
5:15:19.653138 PROGRESS: 
5:15:19.653223 PROGRESS: Protein Summary:
5:15:19.656078 PROGRESS: Channel   0:	 0.05 FDR: 1,302; 0.01 FDR:   905; 0.001 FDR:   691
5:15:19.656188 PROGRESS: =========================================================================
5:15:19.657646 PROGRESS: === Epoch 8, step 7, extracting elution groups 127000 to 255000 ===
5:15:19.882915 PROGRESS: Extracting batch of 252991 precursors
5:15:19.954865 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:15:19.954982 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:15:19.955021 INFO: FWHM in RT is 15.17 seconds, sigma is 0.55
5:15:19.955065 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:15:19.955319 INFO: Starting candidate selection
5:15:29.385830 INFO: Starting candidate scoring
5:15:33.178484 INFO: Finished candidate processing
5:15:33.178671 INFO: Collecting candidate features
5:15:36.150844 WARNING: intensity_correlation has 433 NaNs ( 0.18 % out of 239857)
5:15:36.171710 INFO: Collecting fragment features
5:15:37.064955 INFO: Finished candidate scoring
5:15:37.656030 PROGRESS: === Epoch 8, step 7, extracted 239857 precursors and 1265840 fragments ===
5:15:37.656404 INFO: performing precursor FDR with 47 features
5:15:37.656464 INFO: Decoy channel: -1
5:15:37.656492 INFO: Competetive: True
5:15:38.264041 WARNING: dropped 443 target PSMs due to missing features
5:15:38.264163 WARNING: dropped 418 decoy PSMs due to missing features
5:15:55.576590 INFO: Test AUC: 0.551
5:15:55.576720 INFO: Train AUC: 0.578
5:15:55.576775 INFO: AUC difference: 4.73%
5:16:00.325974 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
5:16:00.328208 PROGRESS: ============================= Precursor FDR =============================
5:16:00.328368 PROGRESS: Total precursors accumulated: 4,028
5:16:00.328445 PROGRESS: Target precursors: 3,667 (91.04%)
5:16:00.328511 PROGRESS: Decoy precursors: 361 (8.96%)
5:16:00.328573 PROGRESS: 
5:16:00.328633 PROGRESS: Precursor Summary:
5:16:00.331610 PROGRESS: Channel   0:	 0.05 FDR: 2,833; 0.01 FDR: 1,948; 0.001 FDR: 1,083
5:16:00.331762 PROGRESS: 
5:16:00.331835 PROGRESS: Protein Summary:
5:16:00.335757 PROGRESS: Channel   0:	 0.05 FDR: 2,275; 0.01 FDR: 1,551; 0.001 FDR:   919
5:16:00.335897 PROGRESS: =========================================================================
5:16:00.339246 INFO: calibration group: precursor, fitting rt estimator 
5:16:00.592317 INFO: calibration group: fragment, fitting mz estimator 
5:16:01.199845 INFO: === checking if epoch conditions were reached ===
5:16:01.200022 INFO: ✅ ms2_error      : 7.0000 <= 7
5:16:01.200233 INFO: ❌ rt_error       : 200.5902 > 100
5:16:01.200312 INFO: ✅ current_epoch  : 8 >= 3
5:16:01.200378 INFO: ==============================================
5:16:01.419285 INFO: calibration group: precursor, predicting mz
5:16:01.419591 WARNING: mz prediction was skipped as it has not been fitted yet
5:16:01.419633 INFO: calibration group: precursor, predicting rt
5:16:08.172099 INFO: calibration group: fragment, predicting mz
5:16:26.113308 PROGRESS: === Epoch 9, step 0, extracting elution groups 0 to 1000 ===
5:16:26.201815 PROGRESS: Extracting batch of 1977 precursors
5:16:26.203663 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:16:26.203740 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:16:26.203782 INFO: FWHM in RT is 14.75 seconds, sigma is 0.54
5:16:26.203828 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:16:26.204061 INFO: Starting candidate selection
5:16:30.954743 INFO: Starting candidate scoring
5:16:32.246545 INFO: Finished candidate processing
5:16:32.246639 INFO: Collecting candidate features
5:16:34.399370 WARNING: intensity_correlation has 4 NaNs ( 0.21 % out of 1897)
5:16:34.405315 INFO: Collecting fragment features
5:16:35.042939 INFO: Finished candidate scoring
5:16:35.361277 PROGRESS: === Epoch 9, step 0, extracted 1897 precursors and 10044 fragments ===
5:16:35.361849 INFO: performing precursor FDR with 47 features
5:16:35.361896 INFO: Decoy channel: -1
5:16:35.361923 INFO: Competetive: True
5:16:35.366887 WARNING: dropped 3 target PSMs due to missing features
5:16:35.366955 WARNING: dropped 1 decoy PSMs due to missing features
5:16:35.395879 INFO: Test AUC: 0.536
5:16:35.395977 INFO: Train AUC: 0.566
5:16:35.396020 INFO: AUC difference: 5.33%
5:16:35.396055 WARNING: AUC difference > 5%. This may indicate overfitting.
5:16:35.516262 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
5:16:35.517051 PROGRESS: ============================= Precursor FDR =============================
5:16:35.517174 PROGRESS: Total precursors accumulated: 7
5:16:35.517252 PROGRESS: Target precursors: 7 (100.00%)
5:16:35.517319 PROGRESS: Decoy precursors: 0 (0.00%)
5:16:35.517381 PROGRESS: 
5:16:35.517442 PROGRESS: Precursor Summary:
5:16:35.518927 PROGRESS: Channel   0:	 0.05 FDR:     7; 0.01 FDR:     7; 0.001 FDR:     7
5:16:35.519054 PROGRESS: 
5:16:35.519140 PROGRESS: Protein Summary:
5:16:35.520806 PROGRESS: Channel   0:	 0.05 FDR:     7; 0.01 FDR:     7; 0.001 FDR:     7
5:16:35.520916 PROGRESS: =========================================================================
5:16:35.521806 PROGRESS: === Epoch 9, step 1, extracting elution groups 1000 to 3000 ===
5:16:35.599617 PROGRESS: Extracting batch of 3951 precursors
5:16:35.601901 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:16:35.601965 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:16:35.602005 INFO: FWHM in RT is 14.75 seconds, sigma is 0.54
5:16:35.602035 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:16:35.602257 INFO: Starting candidate selection
5:16:40.012628 INFO: Starting candidate scoring
5:16:41.334502 INFO: Finished candidate processing
5:16:41.334687 INFO: Collecting candidate features
5:16:43.523588 WARNING: intensity_correlation has 5 NaNs ( 0.13 % out of 3769)
5:16:43.529618 INFO: Collecting fragment features
5:16:44.180341 INFO: Finished candidate scoring
5:16:44.467036 PROGRESS: === Epoch 9, step 1, extracted 3769 precursors and 19972 fragments ===
5:16:44.467345 INFO: performing precursor FDR with 47 features
5:16:44.467389 INFO: Decoy channel: -1
5:16:44.467416 INFO: Competetive: True
5:16:44.476648 WARNING: dropped 6 target PSMs due to missing features
5:16:44.476741 WARNING: dropped 3 decoy PSMs due to missing features
5:16:44.515888 INFO: Test AUC: 0.546
5:16:44.516008 INFO: Train AUC: 0.550
5:16:44.516054 INFO: AUC difference: 0.77%
5:16:44.635522 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
5:16:44.636311 PROGRESS: ============================= Precursor FDR =============================
5:16:44.636434 PROGRESS: Total precursors accumulated: 27
5:16:44.636511 PROGRESS: Target precursors: 25 (92.59%)
5:16:44.636580 PROGRESS: Decoy precursors: 2 (7.41%)
5:16:44.636643 PROGRESS: 
5:16:44.636705 PROGRESS: Precursor Summary:
5:16:44.638149 PROGRESS: Channel   0:	 0.05 FDR:    25; 0.01 FDR:    16; 0.001 FDR:    16
5:16:44.638262 PROGRESS: 
5:16:44.638336 PROGRESS: Protein Summary:
5:16:44.639940 PROGRESS: Channel   0:	 0.05 FDR:    25; 0.01 FDR:    16; 0.001 FDR:    16
5:16:44.640048 PROGRESS: =========================================================================
5:16:44.640900 PROGRESS: === Epoch 9, step 2, extracting elution groups 3000 to 7000 ===
5:16:44.724057 PROGRESS: Extracting batch of 7911 precursors
5:16:44.727628 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:16:44.727693 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:16:44.727733 INFO: FWHM in RT is 14.75 seconds, sigma is 0.54
5:16:44.727780 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:16:44.728005 INFO: Starting candidate selection
5:16:49.258788 INFO: Starting candidate scoring
5:16:50.634704 INFO: Finished candidate processing
5:16:50.634845 INFO: Collecting candidate features
5:16:52.842434 WARNING: intensity_correlation has 12 NaNs ( 0.16 % out of 7467)
5:16:52.848228 INFO: Collecting fragment features
5:16:53.504828 INFO: Finished candidate scoring
5:16:53.797624 PROGRESS: === Epoch 9, step 2, extracted 7467 precursors and 39201 fragments ===
5:16:53.798018 INFO: performing precursor FDR with 47 features
5:16:53.798068 INFO: Decoy channel: -1
5:16:53.798095 INFO: Competetive: True
5:16:53.814130 WARNING: dropped 11 target PSMs due to missing features
5:16:53.814236 WARNING: dropped 10 decoy PSMs due to missing features
5:16:54.062285 INFO: Test AUC: 0.535
5:16:54.062418 INFO: Train AUC: 0.584
5:16:54.062463 INFO: AUC difference: 8.48%
5:16:54.062497 WARNING: AUC difference > 5%. This may indicate overfitting.
5:16:54.190194 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
5:16:54.191071 PROGRESS: ============================= Precursor FDR =============================
5:16:54.191189 PROGRESS: Total precursors accumulated: 99
5:16:54.191263 PROGRESS: Target precursors: 91 (91.92%)
5:16:54.191328 PROGRESS: Decoy precursors: 8 (8.08%)
5:16:54.191388 PROGRESS: 
5:16:54.191447 PROGRESS: Precursor Summary:
5:16:54.192902 PROGRESS: Channel   0:	 0.05 FDR:    63; 0.01 FDR:    43; 0.001 FDR:    43
5:16:54.193014 PROGRESS: 
5:16:54.193086 PROGRESS: Protein Summary:
5:16:54.194756 PROGRESS: Channel   0:	 0.05 FDR:    63; 0.01 FDR:    43; 0.001 FDR:    43
5:16:54.194879 PROGRESS: =========================================================================
5:16:54.195741 PROGRESS: === Epoch 9, step 3, extracting elution groups 7000 to 15000 ===
5:16:54.288155 PROGRESS: Extracting batch of 15837 precursors
5:16:54.293975 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:16:54.294063 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:16:54.294098 INFO: FWHM in RT is 14.75 seconds, sigma is 0.54
5:16:54.294125 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:16:54.294349 INFO: Starting candidate selection
5:16:58.954383 INFO: Starting candidate scoring
5:17:00.398504 INFO: Finished candidate processing
5:17:00.398597 INFO: Collecting candidate features
5:17:02.626758 WARNING: intensity_correlation has 26 NaNs ( 0.17 % out of 15078)
5:17:02.632769 INFO: Collecting fragment features
5:17:03.298434 INFO: Finished candidate scoring
5:17:03.601448 PROGRESS: === Epoch 9, step 3, extracted 15078 precursors and 79375 fragments ===
5:17:03.601864 INFO: performing precursor FDR with 47 features
5:17:03.601915 INFO: Decoy channel: -1
5:17:03.601942 INFO: Competetive: True
5:17:03.633094 WARNING: dropped 25 target PSMs due to missing features
5:17:03.633227 WARNING: dropped 22 decoy PSMs due to missing features
5:17:04.404786 INFO: Test AUC: 0.552
5:17:04.404945 INFO: Train AUC: 0.592
5:17:04.404990 INFO: AUC difference: 6.61%
5:17:04.405023 WARNING: AUC difference > 5%. This may indicate overfitting.
5:17:04.533608 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
5:17:04.534654 PROGRESS: ============================= Precursor FDR =============================
5:17:04.534794 PROGRESS: Total precursors accumulated: 259
5:17:04.534882 PROGRESS: Target precursors: 236 (91.12%)
5:17:04.534968 PROGRESS: Decoy precursors: 23 (8.88%)
5:17:04.535046 PROGRESS: 
5:17:04.535116 PROGRESS: Precursor Summary:
5:17:04.536689 PROGRESS: Channel   0:	 0.05 FDR:   154; 0.01 FDR:   118; 0.001 FDR:    60
5:17:04.536820 PROGRESS: 
5:17:04.536911 PROGRESS: Protein Summary:
5:17:04.539361 PROGRESS: Channel   0:	 0.05 FDR:   153; 0.01 FDR:   117; 0.001 FDR:    59
5:17:04.539484 PROGRESS: =========================================================================
5:17:04.540437 PROGRESS: === Epoch 9, step 4, extracting elution groups 15000 to 31000 ===
5:17:04.649071 PROGRESS: Extracting batch of 31615 precursors
5:17:04.660073 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:17:04.660181 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:17:04.660226 INFO: FWHM in RT is 14.75 seconds, sigma is 0.54
5:17:04.660256 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:17:04.660514 INFO: Starting candidate selection
5:17:09.654793 INFO: Starting candidate scoring
5:17:11.259744 INFO: Finished candidate processing
5:17:11.259876 INFO: Collecting candidate features
5:17:13.526508 WARNING: intensity_correlation has 48 NaNs ( 0.16 % out of 30061)
5:17:13.533438 INFO: Collecting fragment features
5:17:14.213264 INFO: Finished candidate scoring
5:17:14.531848 PROGRESS: === Epoch 9, step 4, extracted 30061 precursors and 158319 fragments ===
5:17:14.539098 INFO: performing precursor FDR with 47 features
5:17:14.539255 INFO: Decoy channel: -1
5:17:14.539345 INFO: Competetive: True
5:17:14.601125 WARNING: dropped 48 target PSMs due to missing features
5:17:14.601233 WARNING: dropped 47 decoy PSMs due to missing features
5:17:16.429085 INFO: Test AUC: 0.542
5:17:16.429232 INFO: Train AUC: 0.609
5:17:16.429279 INFO: AUC difference: 10.97%
5:17:16.429314 WARNING: AUC difference > 5%. This may indicate overfitting.
5:17:16.558054 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
5:17:16.559227 PROGRESS: ============================= Precursor FDR =============================
5:17:16.559438 PROGRESS: Total precursors accumulated: 650
5:17:16.559518 PROGRESS: Target precursors: 592 (91.08%)
5:17:16.559587 PROGRESS: Decoy precursors: 58 (8.92%)
5:17:16.559663 PROGRESS: 
5:17:16.559725 PROGRESS: Precursor Summary:
5:17:16.561498 PROGRESS: Channel   0:	 0.05 FDR:   397; 0.01 FDR:   232; 0.001 FDR:   175
5:17:16.561644 PROGRESS: 
5:17:16.561719 PROGRESS: Protein Summary:
5:17:16.563794 PROGRESS: Channel   0:	 0.05 FDR:   390; 0.01 FDR:   227; 0.001 FDR:   171
5:17:16.563910 PROGRESS: =========================================================================
5:17:16.564965 PROGRESS: === Epoch 9, step 5, extracting elution groups 31000 to 63000 ===
5:17:16.702157 PROGRESS: Extracting batch of 63238 precursors
5:17:16.722629 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:17:16.722740 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:17:16.722779 INFO: FWHM in RT is 14.75 seconds, sigma is 0.54
5:17:16.722807 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:17:16.723064 INFO: Starting candidate selection
5:17:22.351150 INFO: Starting candidate scoring
5:17:24.255429 INFO: Finished candidate processing
5:17:24.255535 INFO: Collecting candidate features
5:17:26.609104 WARNING: intensity_correlation has 91 NaNs ( 0.15 % out of 60003)
5:17:26.618368 INFO: Collecting fragment features
5:17:27.325399 INFO: Finished candidate scoring
5:17:27.680586 PROGRESS: === Epoch 9, step 5, extracted 60003 precursors and 315307 fragments ===
5:17:27.680968 INFO: performing precursor FDR with 47 features
5:17:27.681016 INFO: Decoy channel: -1
5:17:27.681043 INFO: Competetive: True
5:17:27.817323 WARNING: dropped 94 target PSMs due to missing features
5:17:27.817437 WARNING: dropped 92 decoy PSMs due to missing features
5:17:31.951948 INFO: Test AUC: 0.551
5:17:31.952078 INFO: Train AUC: 0.597
5:17:31.952154 INFO: AUC difference: 7.81%
5:17:31.952191 WARNING: AUC difference > 5%. This may indicate overfitting.
5:17:32.092431 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
5:17:32.093862 PROGRESS: ============================= Precursor FDR =============================
5:17:32.094007 PROGRESS: Total precursors accumulated: 1,288
5:17:32.094098 PROGRESS: Target precursors: 1,174 (91.15%)
5:17:32.094177 PROGRESS: Decoy precursors: 114 (8.85%)
5:17:32.094260 PROGRESS: 
5:17:32.094347 PROGRESS: Precursor Summary:
5:17:32.096373 PROGRESS: Channel   0:	 0.05 FDR:   745; 0.01 FDR:   471; 0.001 FDR:   361
5:17:32.096527 PROGRESS: 
5:17:32.096620 PROGRESS: Protein Summary:
5:17:32.099840 PROGRESS: Channel   0:	 0.05 FDR:   706; 0.01 FDR:   444; 0.001 FDR:   340
5:17:32.099971 PROGRESS: =========================================================================
5:17:32.101166 PROGRESS: === Epoch 9, step 6, extracting elution groups 63000 to 127000 ===
5:17:32.277453 PROGRESS: Extracting batch of 126474 precursors
5:17:32.316837 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:17:32.316962 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:17:32.317007 INFO: FWHM in RT is 14.75 seconds, sigma is 0.54
5:17:32.317036 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:17:32.317307 INFO: Starting candidate selection
5:17:39.272306 INFO: Starting candidate scoring
5:17:41.826021 INFO: Finished candidate processing
5:17:41.826144 INFO: Collecting candidate features
5:17:44.378919 WARNING: intensity_correlation has 166 NaNs ( 0.14 % out of 120009)
5:17:44.391964 INFO: Collecting fragment features
5:17:45.162116 INFO: Finished candidate scoring
5:17:45.594140 PROGRESS: === Epoch 9, step 6, extracted 120009 precursors and 633238 fragments ===
5:17:45.594521 INFO: performing precursor FDR with 47 features
5:17:45.594570 INFO: Decoy channel: -1
5:17:45.594599 INFO: Competetive: True
5:17:45.871411 WARNING: dropped 170 target PSMs due to missing features
5:17:45.871526 WARNING: dropped 182 decoy PSMs due to missing features
5:17:54.954358 INFO: Test AUC: 0.549
5:17:54.954504 INFO: Train AUC: 0.589
5:17:54.954546 INFO: AUC difference: 6.85%
5:17:54.954575 WARNING: AUC difference > 5%. This may indicate overfitting.
5:17:55.129117 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
5:17:55.130897 PROGRESS: ============================= Precursor FDR =============================
5:17:55.131061 PROGRESS: Total precursors accumulated: 2,217
5:17:55.131142 PROGRESS: Target precursors: 2,022 (91.20%)
5:17:55.131212 PROGRESS: Decoy precursors: 195 (8.80%)
5:17:55.131276 PROGRESS: 
5:17:55.131337 PROGRESS: Precursor Summary:
5:17:55.133653 PROGRESS: Channel   0:	 0.05 FDR: 1,389; 0.01 FDR:   866; 0.001 FDR:   612
5:17:55.133806 PROGRESS: 
5:17:55.133884 PROGRESS: Protein Summary:
5:17:55.136825 PROGRESS: Channel   0:	 0.05 FDR: 1,246; 0.01 FDR:   763; 0.001 FDR:   540
5:17:55.136941 PROGRESS: =========================================================================
5:17:55.138405 PROGRESS: === Epoch 9, step 7, extracting elution groups 127000 to 255000 ===
5:17:55.363097 PROGRESS: Extracting batch of 252880 precursors
5:17:55.435617 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:17:55.435751 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:17:55.435792 INFO: FWHM in RT is 14.75 seconds, sigma is 0.54
5:17:55.435819 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:17:55.436097 INFO: Starting candidate selection
5:18:04.956223 INFO: Starting candidate scoring
5:18:08.778007 INFO: Finished candidate processing
5:18:08.778197 INFO: Collecting candidate features
5:18:11.724208 WARNING: intensity_correlation has 344 NaNs ( 0.14 % out of 239984)
5:18:11.745030 INFO: Collecting fragment features
5:18:12.627168 INFO: Finished candidate scoring
5:18:13.214927 PROGRESS: === Epoch 9, step 7, extracted 239984 precursors and 1261512 fragments ===
5:18:13.215322 INFO: performing precursor FDR with 47 features
5:18:13.215371 INFO: Decoy channel: -1
5:18:13.215397 INFO: Competetive: True
5:18:13.814868 WARNING: dropped 339 target PSMs due to missing features
5:18:13.814991 WARNING: dropped 357 decoy PSMs due to missing features
5:18:31.349891 INFO: Test AUC: 0.548
5:18:31.350033 INFO: Train AUC: 0.575
5:18:31.350074 INFO: AUC difference: 4.72%
5:18:31.535727 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
5:18:31.538092 PROGRESS: ============================= Precursor FDR =============================
5:18:31.538265 PROGRESS: Total precursors accumulated: 3,930
5:18:31.538354 PROGRESS: Target precursors: 3,582 (91.15%)
5:18:31.538422 PROGRESS: Decoy precursors: 348 (8.85%)
5:18:31.538498 PROGRESS: 
5:18:31.538560 PROGRESS: Precursor Summary:
5:18:31.541446 PROGRESS: Channel   0:	 0.05 FDR: 2,581; 0.01 FDR: 1,720; 0.001 FDR: 1,314
5:18:31.541604 PROGRESS: 
5:18:31.541677 PROGRESS: Protein Summary:
5:18:31.545539 PROGRESS: Channel   0:	 0.05 FDR: 2,114; 0.01 FDR: 1,403; 0.001 FDR: 1,074
5:18:31.545684 PROGRESS: =========================================================================
5:18:31.547559 PROGRESS: === Epoch 9, step 8, extracting elution groups 255000 to 511000 ===
5:18:31.850615 PROGRESS: Extracting batch of 505980 precursors
5:18:31.982404 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:18:31.982524 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:18:31.982563 INFO: FWHM in RT is 14.75 seconds, sigma is 0.54
5:18:31.982606 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:18:31.982884 INFO: Starting candidate selection
5:18:46.677245 INFO: Starting candidate scoring
5:18:53.035423 INFO: Finished candidate processing
5:18:53.035621 INFO: Collecting candidate features
5:18:56.738949 WARNING: intensity_correlation has 688 NaNs ( 0.14 % out of 480121)
5:18:56.774816 INFO: Collecting fragment features
5:18:57.860624 INFO: Finished candidate scoring
5:18:58.770430 PROGRESS: === Epoch 9, step 8, extracted 480121 precursors and 2525281 fragments ===
5:18:58.770819 INFO: performing precursor FDR with 47 features
5:18:58.770866 INFO: Decoy channel: -1
5:18:58.770894 INFO: Competetive: True
5:18:59.935441 WARNING: dropped 709 target PSMs due to missing features
5:18:59.935561 WARNING: dropped 675 decoy PSMs due to missing features
5:19:36.205689 INFO: Test AUC: 0.548
5:19:36.205875 INFO: Train AUC: 0.567
5:19:36.205914 INFO: AUC difference: 3.40%
5:19:36.451336 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
5:19:36.454516 PROGRESS: ============================= Precursor FDR =============================
5:19:36.454696 PROGRESS: Total precursors accumulated: 7,017
5:19:36.454776 PROGRESS: Target precursors: 6,396 (91.15%)
5:19:36.454844 PROGRESS: Decoy precursors: 621 (8.85%)
5:19:36.454917 PROGRESS: 
5:19:36.454977 PROGRESS: Precursor Summary:
5:19:36.458734 PROGRESS: Channel   0:	 0.05 FDR: 5,027; 0.01 FDR: 3,573; 0.001 FDR: 1,319
5:19:36.458885 PROGRESS: 
5:19:36.458959 PROGRESS: Protein Summary:
5:19:36.464299 PROGRESS: Channel   0:	 0.05 FDR: 3,446; 0.01 FDR: 2,409; 0.001 FDR: 1,022
5:19:36.464462 PROGRESS: =========================================================================
5:19:36.469092 INFO: calibration group: precursor, fitting rt estimator 
5:19:36.895598 INFO: calibration group: fragment, fitting mz estimator 
5:19:37.483699 INFO: === checking if epoch conditions were reached ===
5:19:37.483934 INFO: ✅ ms2_error      : 7.0000 <= 7
5:19:37.484024 INFO: ❌ rt_error       : 200.6231 > 100
5:19:37.484098 INFO: ✅ current_epoch  : 9 >= 3
5:19:37.484164 INFO: ==============================================
5:19:37.701558 INFO: calibration group: precursor, predicting mz
5:19:37.701900 WARNING: mz prediction was skipped as it has not been fitted yet
5:19:37.701941 INFO: calibration group: precursor, predicting rt
5:19:44.439471 INFO: calibration group: fragment, predicting mz
5:20:02.438215 PROGRESS: === Epoch 10, step 0, extracting elution groups 0 to 1000 ===
5:20:02.536261 PROGRESS: Extracting batch of 1972 precursors
5:20:02.538095 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:20:02.538185 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:20:02.538243 INFO: FWHM in RT is 15.21 seconds, sigma is 0.55
5:20:02.538273 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:20:02.538508 INFO: Starting candidate selection
5:20:07.243138 INFO: Starting candidate scoring
5:20:08.519343 INFO: Finished candidate processing
5:20:08.519434 INFO: Collecting candidate features
5:20:10.674914 WARNING: intensity_correlation has 2 NaNs ( 0.11 % out of 1881)
5:20:10.680936 INFO: Collecting fragment features
5:20:11.314183 INFO: Finished candidate scoring
5:20:11.638424 PROGRESS: === Epoch 10, step 0, extracted 1881 precursors and 9791 fragments ===
5:20:11.638739 INFO: performing precursor FDR with 47 features
5:20:11.638783 INFO: Decoy channel: -1
5:20:11.638809 INFO: Competetive: True
5:20:11.643768 WARNING: dropped 2 target PSMs due to missing features
5:20:11.672712 INFO: Test AUC: 0.541
5:20:11.672812 INFO: Train AUC: 0.570
5:20:11.672857 INFO: AUC difference: 5.03%
5:20:11.672892 WARNING: AUC difference > 5%. This may indicate overfitting.
5:20:11.792519 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
5:20:11.793289 PROGRESS: ============================= Precursor FDR =============================
5:20:11.793414 PROGRESS: Total precursors accumulated: 13
5:20:11.793492 PROGRESS: Target precursors: 12 (92.31%)
5:20:11.793560 PROGRESS: Decoy precursors: 1 (7.69%)
5:20:11.793623 PROGRESS: 
5:20:11.793697 PROGRESS: Precursor Summary:
5:20:11.795116 PROGRESS: Channel   0:	 0.05 FDR:    10; 0.01 FDR:    10; 0.001 FDR:    10
5:20:11.795227 PROGRESS: 
5:20:11.795317 PROGRESS: Protein Summary:
5:20:11.796903 PROGRESS: Channel   0:	 0.05 FDR:    10; 0.01 FDR:    10; 0.001 FDR:    10
5:20:11.797012 PROGRESS: =========================================================================
5:20:11.797864 PROGRESS: === Epoch 10, step 1, extracting elution groups 1000 to 3000 ===
5:20:11.883481 PROGRESS: Extracting batch of 3950 precursors
5:20:11.885850 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:20:11.885930 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:20:11.885973 INFO: FWHM in RT is 15.21 seconds, sigma is 0.55
5:20:11.886018 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:20:11.886251 INFO: Starting candidate selection
5:20:16.267152 INFO: Starting candidate scoring
5:20:17.584746 INFO: Finished candidate processing
5:20:17.584900 INFO: Collecting candidate features
5:20:19.745514 WARNING: intensity_correlation has 6 NaNs ( 0.16 % out of 3768)
5:20:19.751753 INFO: Collecting fragment features
5:20:20.387114 INFO: Finished candidate scoring
5:20:20.668486 PROGRESS: === Epoch 10, step 1, extracted 3768 precursors and 19851 fragments ===
5:20:20.668782 INFO: performing precursor FDR with 47 features
5:20:20.668828 INFO: Decoy channel: -1
5:20:20.668854 INFO: Competetive: True
5:20:20.677916 WARNING: dropped 4 target PSMs due to missing features
5:20:20.678025 WARNING: dropped 4 decoy PSMs due to missing features
5:20:20.716629 INFO: Test AUC: 0.536
5:20:20.716749 INFO: Train AUC: 0.566
5:20:20.716795 INFO: AUC difference: 5.41%
5:20:20.716830 WARNING: AUC difference > 5%. This may indicate overfitting.
5:20:20.835806 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
5:20:20.836564 PROGRESS: ============================= Precursor FDR =============================
5:20:20.836682 PROGRESS: Total precursors accumulated: 28
5:20:20.836758 PROGRESS: Target precursors: 26 (92.86%)
5:20:20.836823 PROGRESS: Decoy precursors: 2 (7.14%)
5:20:20.836883 PROGRESS: 
5:20:20.836943 PROGRESS: Precursor Summary:
5:20:20.838378 PROGRESS: Channel   0:	 0.05 FDR:    23; 0.01 FDR:    20; 0.001 FDR:    20
5:20:20.838494 PROGRESS: 
5:20:20.838568 PROGRESS: Protein Summary:
5:20:20.840155 PROGRESS: Channel   0:	 0.05 FDR:    23; 0.01 FDR:    20; 0.001 FDR:    20
5:20:20.840263 PROGRESS: =========================================================================
5:20:20.841108 PROGRESS: === Epoch 10, step 2, extracting elution groups 3000 to 7000 ===
5:20:20.925275 PROGRESS: Extracting batch of 7904 precursors
5:20:20.928917 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:20:20.928987 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:20:20.929024 INFO: FWHM in RT is 15.21 seconds, sigma is 0.55
5:20:20.929070 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:20:20.929294 INFO: Starting candidate selection
5:20:25.365196 INFO: Starting candidate scoring
5:20:26.712506 INFO: Finished candidate processing
5:20:26.712597 INFO: Collecting candidate features
5:20:28.892205 WARNING: intensity_correlation has 18 NaNs ( 0.24 % out of 7520)
5:20:28.899402 INFO: Collecting fragment features
5:20:29.564758 INFO: Finished candidate scoring
5:20:29.854629 PROGRESS: === Epoch 10, step 2, extracted 7520 precursors and 39766 fragments ===
5:20:29.854968 INFO: performing precursor FDR with 47 features
5:20:29.855017 INFO: Decoy channel: -1
5:20:29.855043 INFO: Competetive: True
5:20:29.871300 WARNING: dropped 12 target PSMs due to missing features
5:20:29.871418 WARNING: dropped 14 decoy PSMs due to missing features
5:20:30.147207 INFO: Test AUC: 0.540
5:20:30.147341 INFO: Train AUC: 0.580
5:20:30.147387 INFO: AUC difference: 6.83%
5:20:30.147423 WARNING: AUC difference > 5%. This may indicate overfitting.
5:20:30.268176 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
5:20:30.269052 PROGRESS: ============================= Precursor FDR =============================
5:20:30.269176 PROGRESS: Total precursors accumulated: 107
5:20:30.269254 PROGRESS: Target precursors: 98 (91.59%)
5:20:30.269322 PROGRESS: Decoy precursors: 9 (8.41%)
5:20:30.269386 PROGRESS: 
5:20:30.269448 PROGRESS: Precursor Summary:
5:20:30.271016 PROGRESS: Channel   0:	 0.05 FDR:    86; 0.01 FDR:    62; 0.001 FDR:    62
5:20:30.271154 PROGRESS: 
5:20:30.271229 PROGRESS: Protein Summary:
5:20:30.272949 PROGRESS: Channel   0:	 0.05 FDR:    86; 0.01 FDR:    62; 0.001 FDR:    62
5:20:30.273075 PROGRESS: =========================================================================
5:20:30.273980 PROGRESS: === Epoch 10, step 3, extracting elution groups 7000 to 15000 ===
5:20:30.365575 PROGRESS: Extracting batch of 15798 precursors
5:20:30.378461 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:20:30.378556 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:20:30.378596 INFO: FWHM in RT is 15.21 seconds, sigma is 0.55
5:20:30.378624 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:20:30.378854 INFO: Starting candidate selection
5:20:35.020427 INFO: Starting candidate scoring
5:20:36.457162 INFO: Finished candidate processing
5:20:36.457259 INFO: Collecting candidate features
5:20:38.659201 WARNING: intensity_correlation has 29 NaNs ( 0.19 % out of 14984)
5:20:38.665110 INFO: Collecting fragment features
5:20:39.333820 INFO: Finished candidate scoring
5:20:39.631152 PROGRESS: === Epoch 10, step 3, extracted 14984 precursors and 79774 fragments ===
5:20:39.631557 INFO: performing precursor FDR with 47 features
5:20:39.631606 INFO: Decoy channel: -1
5:20:39.631633 INFO: Competetive: True
5:20:39.661818 WARNING: dropped 27 target PSMs due to missing features
5:20:39.661928 WARNING: dropped 28 decoy PSMs due to missing features
5:20:40.426792 INFO: Test AUC: 0.560
5:20:40.426938 INFO: Train AUC: 0.597
5:20:40.426985 INFO: AUC difference: 6.29%
5:20:40.427021 WARNING: AUC difference > 5%. This may indicate overfitting.
5:20:40.553322 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
5:20:40.554369 PROGRESS: ============================= Precursor FDR =============================
5:20:40.554497 PROGRESS: Total precursors accumulated: 280
5:20:40.554574 PROGRESS: Target precursors: 255 (91.07%)
5:20:40.554642 PROGRESS: Decoy precursors: 25 (8.93%)
5:20:40.554704 PROGRESS: 
5:20:40.554765 PROGRESS: Precursor Summary:
5:20:40.556378 PROGRESS: Channel   0:	 0.05 FDR:   166; 0.01 FDR:   128; 0.001 FDR:   120
5:20:40.556511 PROGRESS: 
5:20:40.556584 PROGRESS: Protein Summary:
5:20:40.558430 PROGRESS: Channel   0:	 0.05 FDR:   164; 0.01 FDR:   126; 0.001 FDR:   118
5:20:40.558541 PROGRESS: =========================================================================
5:20:40.559482 PROGRESS: === Epoch 10, step 4, extracting elution groups 15000 to 31000 ===
5:20:40.667793 PROGRESS: Extracting batch of 31624 precursors
5:20:40.678514 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:20:40.678609 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:20:40.678648 INFO: FWHM in RT is 15.21 seconds, sigma is 0.55
5:20:40.678676 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:20:40.678943 INFO: Starting candidate selection
5:20:45.593320 INFO: Starting candidate scoring
5:20:47.174491 INFO: Finished candidate processing
5:20:47.174671 INFO: Collecting candidate features
5:20:49.453761 WARNING: intensity_correlation has 47 NaNs ( 0.16 % out of 29967)
5:20:49.460781 INFO: Collecting fragment features
5:20:50.149634 INFO: Finished candidate scoring
5:20:50.467070 PROGRESS: === Epoch 10, step 4, extracted 29967 precursors and 157850 fragments ===
5:20:50.467438 INFO: performing precursor FDR with 47 features
5:20:50.467486 INFO: Decoy channel: -1
5:20:50.467513 INFO: Competetive: True
5:20:50.528347 WARNING: dropped 51 target PSMs due to missing features
5:20:50.528459 WARNING: dropped 51 decoy PSMs due to missing features
5:20:52.477674 INFO: Test AUC: 0.560
5:20:52.477828 INFO: Train AUC: 0.605
5:20:52.477879 INFO: AUC difference: 7.33%
5:20:52.477918 WARNING: AUC difference > 5%. This may indicate overfitting.
5:20:52.610322 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
5:20:52.611531 PROGRESS: ============================= Precursor FDR =============================
5:20:52.611704 PROGRESS: Total precursors accumulated: 716
5:20:52.611782 PROGRESS: Target precursors: 651 (90.92%)
5:20:52.611849 PROGRESS: Decoy precursors: 65 (9.08%)
5:20:52.611912 PROGRESS: 
5:20:52.611971 PROGRESS: Precursor Summary:
5:20:52.613682 PROGRESS: Channel   0:	 0.05 FDR:   352; 0.01 FDR:   213; 0.001 FDR:   128
5:20:52.613829 PROGRESS: 
5:20:52.613905 PROGRESS: Protein Summary:
5:20:52.615861 PROGRESS: Channel   0:	 0.05 FDR:   338; 0.01 FDR:   204; 0.001 FDR:   124
5:20:52.615995 PROGRESS: =========================================================================
5:20:52.617016 PROGRESS: === Epoch 10, step 5, extracting elution groups 31000 to 63000 ===
5:20:52.752430 PROGRESS: Extracting batch of 63219 precursors
5:20:52.772656 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:20:52.772767 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:20:52.772805 INFO: FWHM in RT is 15.21 seconds, sigma is 0.55
5:20:52.772848 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:20:52.773101 INFO: Starting candidate selection
5:20:58.374794 INFO: Starting candidate scoring
5:21:00.281394 INFO: Finished candidate processing
5:21:00.281522 INFO: Collecting candidate features
5:21:02.661888 WARNING: intensity_correlation has 110 NaNs ( 0.18 % out of 59939)
5:21:02.671523 INFO: Collecting fragment features
5:21:03.393964 INFO: Finished candidate scoring
5:21:03.755499 PROGRESS: === Epoch 10, step 5, extracted 59939 precursors and 316096 fragments ===
5:21:03.755866 INFO: performing precursor FDR with 47 features
5:21:03.755922 INFO: Decoy channel: -1
5:21:03.755952 INFO: Competetive: True
5:21:03.897539 WARNING: dropped 112 target PSMs due to missing features
5:21:03.897674 WARNING: dropped 100 decoy PSMs due to missing features
5:21:07.838942 INFO: Test AUC: 0.549
5:21:07.839061 INFO: Train AUC: 0.603
5:21:07.839149 INFO: AUC difference: 8.92%
5:21:07.839180 WARNING: AUC difference > 5%. This may indicate overfitting.
5:21:07.976238 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
5:21:07.977636 PROGRESS: ============================= Precursor FDR =============================
5:21:07.977808 PROGRESS: Total precursors accumulated: 1,232
5:21:07.977890 PROGRESS: Target precursors: 1,121 (90.99%)
5:21:07.977960 PROGRESS: Decoy precursors: 111 (9.01%)
5:21:07.978025 PROGRESS: 
5:21:07.978087 PROGRESS: Precursor Summary:
5:21:07.979995 PROGRESS: Channel   0:	 0.05 FDR:   683; 0.01 FDR:   446; 0.001 FDR:   237
5:21:07.980133 PROGRESS: 
5:21:07.980208 PROGRESS: Protein Summary:
5:21:07.982482 PROGRESS: Channel   0:	 0.05 FDR:   637; 0.01 FDR:   414; 0.001 FDR:   220
5:21:07.982595 PROGRESS: =========================================================================
5:21:07.983767 PROGRESS: === Epoch 10, step 6, extracting elution groups 63000 to 127000 ===
5:21:08.158930 PROGRESS: Extracting batch of 126519 precursors
5:21:08.198066 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:21:08.198173 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:21:08.198214 INFO: FWHM in RT is 15.21 seconds, sigma is 0.55
5:21:08.198242 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:21:08.198498 INFO: Starting candidate selection
5:21:15.061176 INFO: Starting candidate scoring
5:21:17.598582 INFO: Finished candidate processing
5:21:17.598674 INFO: Collecting candidate features
5:21:20.125036 WARNING: intensity_correlation has 242 NaNs ( 0.20 % out of 119902)
5:21:20.138033 INFO: Collecting fragment features
5:21:20.909561 INFO: Finished candidate scoring
5:21:21.336784 PROGRESS: === Epoch 10, step 6, extracted 119902 precursors and 633673 fragments ===
5:21:21.337190 INFO: performing precursor FDR with 47 features
5:21:21.337237 INFO: Decoy channel: -1
5:21:21.337265 INFO: Competetive: True
5:21:21.612441 WARNING: dropped 229 target PSMs due to missing features
5:21:21.612559 WARNING: dropped 225 decoy PSMs due to missing features
5:21:30.138261 INFO: Test AUC: 0.554
5:21:30.138389 INFO: Train AUC: 0.591
5:21:30.138430 INFO: AUC difference: 6.29%
5:21:30.138459 WARNING: AUC difference > 5%. This may indicate overfitting.
5:21:30.293442 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
5:21:30.295220 PROGRESS: ============================= Precursor FDR =============================
5:21:30.295386 PROGRESS: Total precursors accumulated: 2,397
5:21:30.295466 PROGRESS: Target precursors: 2,182 (91.03%)
5:21:30.295547 PROGRESS: Decoy precursors: 215 (8.97%)
5:21:30.295611 PROGRESS: 
5:21:30.295672 PROGRESS: Precursor Summary:
5:21:30.297966 PROGRESS: Channel   0:	 0.05 FDR: 1,442; 0.01 FDR:   967; 0.001 FDR:   421
5:21:30.298097 PROGRESS: 
5:21:30.298172 PROGRESS: Protein Summary:
5:21:30.301007 PROGRESS: Channel   0:	 0.05 FDR: 1,278; 0.01 FDR:   848; 0.001 FDR:   385
5:21:30.301127 PROGRESS: =========================================================================
5:21:30.302624 PROGRESS: === Epoch 10, step 7, extracting elution groups 127000 to 255000 ===
5:21:30.527480 PROGRESS: Extracting batch of 252927 precursors
5:21:30.600638 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:21:30.600764 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:21:30.600806 INFO: FWHM in RT is 15.21 seconds, sigma is 0.55
5:21:30.600834 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:21:30.601100 INFO: Starting candidate selection
5:21:40.096360 INFO: Starting candidate scoring
5:21:43.916388 INFO: Finished candidate processing
5:21:43.916531 INFO: Collecting candidate features
5:21:46.889919 WARNING: intensity_correlation has 438 NaNs ( 0.18 % out of 240182)
5:21:46.911552 INFO: Collecting fragment features
5:21:47.789604 INFO: Finished candidate scoring
5:21:48.378973 PROGRESS: === Epoch 10, step 7, extracted 240182 precursors and 1267466 fragments ===
5:21:48.379361 INFO: performing precursor FDR with 47 features
5:21:48.379409 INFO: Decoy channel: -1
5:21:48.379436 INFO: Competetive: True
5:21:48.976303 WARNING: dropped 458 target PSMs due to missing features
5:21:48.976427 WARNING: dropped 434 decoy PSMs due to missing features
5:22:06.583861 INFO: Test AUC: 0.551
5:22:06.583991 INFO: Train AUC: 0.576
5:22:06.584048 INFO: AUC difference: 4.33%
5:22:06.770707 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
5:22:06.773087 PROGRESS: ============================= Precursor FDR =============================
5:22:06.773266 PROGRESS: Total precursors accumulated: 4,159
5:22:06.773345 PROGRESS: Target precursors: 3,787 (91.06%)
5:22:06.773410 PROGRESS: Decoy precursors: 372 (8.94%)
5:22:06.773470 PROGRESS: 
5:22:06.773529 PROGRESS: Precursor Summary:
5:22:06.776465 PROGRESS: Channel   0:	 0.05 FDR: 2,947; 0.01 FDR: 2,058; 0.001 FDR: 1,214
5:22:06.776615 PROGRESS: 
5:22:06.776689 PROGRESS: Protein Summary:
5:22:06.780653 PROGRESS: Channel   0:	 0.05 FDR: 2,376; 0.01 FDR: 1,622; 0.001 FDR:   977
5:22:06.780789 PROGRESS: =========================================================================
5:22:06.782843 PROGRESS: === Epoch 10, step 8, extracting elution groups 255000 to 511000 ===
5:22:07.085682 PROGRESS: Extracting batch of 505677 precursors
5:22:07.218376 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:22:07.218492 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:22:07.218531 INFO: FWHM in RT is 15.21 seconds, sigma is 0.55
5:22:07.218574 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:22:07.218844 INFO: Starting candidate selection
5:22:21.854077 INFO: Starting candidate scoring
5:22:28.203170 INFO: Finished candidate processing
5:22:28.203364 INFO: Collecting candidate features
5:22:31.902223 WARNING: intensity_correlation has 931 NaNs ( 0.19 % out of 479887)
5:22:31.937711 INFO: Collecting fragment features
5:22:33.022348 INFO: Finished candidate scoring
5:22:33.932566 PROGRESS: === Epoch 10, step 8, extracted 479887 precursors and 2535053 fragments ===
5:22:33.932969 INFO: performing precursor FDR with 47 features
5:22:33.933016 INFO: Decoy channel: -1
5:22:33.933043 INFO: Competetive: True
5:22:35.098619 WARNING: dropped 939 target PSMs due to missing features
5:22:35.098744 WARNING: dropped 884 decoy PSMs due to missing features
5:23:11.315502 INFO: Test AUC: 0.551
5:23:11.315628 INFO: Train AUC: 0.569
5:23:11.315682 INFO: AUC difference: 3.12%
5:23:11.561378 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
5:23:11.564436 PROGRESS: ============================= Precursor FDR =============================
5:23:11.564618 PROGRESS: Total precursors accumulated: 7,373
5:23:11.564696 PROGRESS: Target precursors: 6,730 (91.28%)
5:23:11.564763 PROGRESS: Decoy precursors: 643 (8.72%)
5:23:11.564825 PROGRESS: 
5:23:11.564885 PROGRESS: Precursor Summary:
5:23:11.569046 PROGRESS: Channel   0:	 0.05 FDR: 5,417; 0.01 FDR: 3,975; 0.001 FDR: 2,884
5:23:11.569224 PROGRESS: 
5:23:11.569297 PROGRESS: Protein Summary:
5:23:11.575387 PROGRESS: Channel   0:	 0.05 FDR: 3,704; 0.01 FDR: 2,648; 0.001 FDR: 1,955
5:23:11.575538 PROGRESS: =========================================================================
5:23:11.580469 INFO: calibration group: precursor, fitting rt estimator 
5:23:12.051812 INFO: calibration group: fragment, fitting mz estimator 
5:23:12.641065 INFO: === checking if epoch conditions were reached ===
5:23:12.641353 INFO: ✅ ms2_error      : 7.0000 <= 7
5:23:12.641444 INFO: ❌ rt_error       : 200.9169 > 100
5:23:12.641517 INFO: ✅ current_epoch  : 10 >= 3
5:23:12.641581 INFO: ==============================================
5:23:12.859695 INFO: calibration group: precursor, predicting mz
5:23:12.859988 WARNING: mz prediction was skipped as it has not been fitted yet
5:23:12.860029 INFO: calibration group: precursor, predicting rt
5:23:19.608558 INFO: calibration group: fragment, predicting mz
5:23:37.595395 PROGRESS: === Epoch 11, step 0, extracting elution groups 0 to 1000 ===
5:23:37.694828 PROGRESS: Extracting batch of 1979 precursors
5:23:37.696691 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:23:37.696768 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:23:37.696806 INFO: FWHM in RT is 15.23 seconds, sigma is 0.55
5:23:37.696851 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:23:37.697086 INFO: Starting candidate selection
5:23:42.447770 INFO: Starting candidate scoring
5:23:43.749524 INFO: Finished candidate processing
5:23:43.749618 INFO: Collecting candidate features
5:23:45.937089 WARNING: intensity_correlation has 4 NaNs ( 0.22 % out of 1853)
5:23:45.943095 INFO: Collecting fragment features
5:23:46.588459 INFO: Finished candidate scoring
5:23:46.915465 PROGRESS: === Epoch 11, step 0, extracted 1853 precursors and 9794 fragments ===
5:23:46.915797 INFO: performing precursor FDR with 47 features
5:23:46.915840 INFO: Decoy channel: -1
5:23:46.915868 INFO: Competetive: True
5:23:46.920661 WARNING: dropped 4 decoy PSMs due to missing features
5:23:46.949594 INFO: Test AUC: 0.567
5:23:46.949692 INFO: Train AUC: 0.559
5:23:46.949737 INFO: AUC difference: 1.42%
5:23:47.096421 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
5:23:47.097229 PROGRESS: ============================= Precursor FDR =============================
5:23:47.097366 PROGRESS: Total precursors accumulated: 9
5:23:47.097447 PROGRESS: Target precursors: 9 (100.00%)
5:23:47.097515 PROGRESS: Decoy precursors: 0 (0.00%)
5:23:47.097579 PROGRESS: 
5:23:47.097640 PROGRESS: Precursor Summary:
5:23:47.099450 PROGRESS: Channel   0:	 0.05 FDR:     9; 0.01 FDR:     9; 0.001 FDR:     9
5:23:47.099584 PROGRESS: 
5:23:47.099670 PROGRESS: Protein Summary:
5:23:47.101602 PROGRESS: Channel   0:	 0.05 FDR:     9; 0.01 FDR:     9; 0.001 FDR:     9
5:23:47.101725 PROGRESS: =========================================================================
5:23:47.102764 PROGRESS: === Epoch 11, step 1, extracting elution groups 1000 to 3000 ===
5:23:47.180610 PROGRESS: Extracting batch of 3964 precursors
5:23:47.182884 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:23:47.182946 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:23:47.182985 INFO: FWHM in RT is 15.23 seconds, sigma is 0.55
5:23:47.183030 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:23:47.183242 INFO: Starting candidate selection
5:23:51.536051 INFO: Starting candidate scoring
5:23:52.851022 INFO: Finished candidate processing
5:23:52.851204 INFO: Collecting candidate features
5:23:55.062397 WARNING: intensity_correlation has 13 NaNs ( 0.34 % out of 3779)
5:23:55.069200 INFO: Collecting fragment features
5:23:55.709455 INFO: Finished candidate scoring
5:23:55.989728 PROGRESS: === Epoch 11, step 1, extracted 3779 precursors and 20100 fragments ===
5:23:55.990040 INFO: performing precursor FDR with 47 features
5:23:55.990087 INFO: Decoy channel: -1
5:23:55.990112 INFO: Competetive: True
5:23:55.999026 WARNING: dropped 5 target PSMs due to missing features
5:23:55.999117 WARNING: dropped 12 decoy PSMs due to missing features
5:23:56.037419 INFO: Test AUC: 0.542
5:23:56.037541 INFO: Train AUC: 0.556
5:23:56.037587 INFO: AUC difference: 2.54%
5:23:56.159276 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
5:23:56.160069 PROGRESS: ============================= Precursor FDR =============================
5:23:56.160194 PROGRESS: Total precursors accumulated: 37
5:23:56.160273 PROGRESS: Target precursors: 34 (91.89%)
5:23:56.160343 PROGRESS: Decoy precursors: 3 (8.11%)
5:23:56.160406 PROGRESS: 
5:23:56.160468 PROGRESS: Precursor Summary:
5:23:56.161921 PROGRESS: Channel   0:	 0.05 FDR:    24; 0.01 FDR:    23; 0.001 FDR:    23
5:23:56.162050 PROGRESS: 
5:23:56.162126 PROGRESS: Protein Summary:
5:23:56.163735 PROGRESS: Channel   0:	 0.05 FDR:    24; 0.01 FDR:    23; 0.001 FDR:    23
5:23:56.163845 PROGRESS: =========================================================================
5:23:56.164704 PROGRESS: === Epoch 11, step 2, extracting elution groups 3000 to 7000 ===
5:23:56.246663 PROGRESS: Extracting batch of 7913 precursors
5:23:56.250107 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:23:56.250175 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:23:56.250215 INFO: FWHM in RT is 15.23 seconds, sigma is 0.55
5:23:56.250245 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:23:56.250475 INFO: Starting candidate selection
5:24:00.670328 INFO: Starting candidate scoring
5:24:02.016809 INFO: Finished candidate processing
5:24:02.016992 INFO: Collecting candidate features
5:24:04.193824 WARNING: intensity_correlation has 18 NaNs ( 0.24 % out of 7505)
5:24:04.199592 INFO: Collecting fragment features
5:24:04.844354 INFO: Finished candidate scoring
5:24:05.129925 PROGRESS: === Epoch 11, step 2, extracted 7505 precursors and 39476 fragments ===
5:24:05.130267 INFO: performing precursor FDR with 47 features
5:24:05.130317 INFO: Decoy channel: -1
5:24:05.130344 INFO: Competetive: True
5:24:05.146256 WARNING: dropped 14 target PSMs due to missing features
5:24:05.146374 WARNING: dropped 21 decoy PSMs due to missing features
5:24:05.489625 INFO: Test AUC: 0.536
5:24:05.489759 INFO: Train AUC: 0.578
5:24:05.489814 INFO: AUC difference: 7.22%
5:24:05.489849 WARNING: AUC difference > 5%. This may indicate overfitting.
5:24:05.612584 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
5:24:05.613436 PROGRESS: ============================= Precursor FDR =============================
5:24:05.613556 PROGRESS: Total precursors accumulated: 111
5:24:05.613634 PROGRESS: Target precursors: 101 (90.99%)
5:24:05.613703 PROGRESS: Decoy precursors: 10 (9.01%)
5:24:05.613765 PROGRESS: 
5:24:05.613837 PROGRESS: Precursor Summary:
5:24:05.615281 PROGRESS: Channel   0:	 0.05 FDR:    51; 0.01 FDR:    33; 0.001 FDR:    33
5:24:05.615410 PROGRESS: 
5:24:05.615484 PROGRESS: Protein Summary:
5:24:05.617122 PROGRESS: Channel   0:	 0.05 FDR:    51; 0.01 FDR:    33; 0.001 FDR:    33
5:24:05.617232 PROGRESS: =========================================================================
5:24:05.618117 PROGRESS: === Epoch 11, step 3, extracting elution groups 7000 to 15000 ===
5:24:05.710874 PROGRESS: Extracting batch of 15809 precursors
5:24:05.724153 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:24:05.724251 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:24:05.724290 INFO: FWHM in RT is 15.23 seconds, sigma is 0.55
5:24:05.724317 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:24:05.724536 INFO: Starting candidate selection
5:24:10.301179 INFO: Starting candidate scoring
5:24:11.713194 INFO: Finished candidate processing
5:24:11.713285 INFO: Collecting candidate features
5:24:13.916422 WARNING: intensity_correlation has 34 NaNs ( 0.23 % out of 14913)
5:24:13.922495 INFO: Collecting fragment features
5:24:14.581074 INFO: Finished candidate scoring
5:24:14.877136 PROGRESS: === Epoch 11, step 3, extracted 14913 precursors and 78210 fragments ===
5:24:14.877516 INFO: performing precursor FDR with 47 features
5:24:14.877563 INFO: Decoy channel: -1
5:24:14.877589 INFO: Competetive: True
5:24:14.907336 WARNING: dropped 35 target PSMs due to missing features
5:24:14.907449 WARNING: dropped 34 decoy PSMs due to missing features
5:24:15.633584 INFO: Test AUC: 0.535
5:24:15.633729 INFO: Train AUC: 0.596
5:24:15.633779 INFO: AUC difference: 10.31%
5:24:15.633816 WARNING: AUC difference > 5%. This may indicate overfitting.
5:24:15.761175 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
5:24:15.762197 PROGRESS: ============================= Precursor FDR =============================
5:24:15.762331 PROGRESS: Total precursors accumulated: 297
5:24:15.762419 PROGRESS: Target precursors: 273 (91.92%)
5:24:15.762497 PROGRESS: Decoy precursors: 24 (8.08%)
5:24:15.762570 PROGRESS: 
5:24:15.762639 PROGRESS: Precursor Summary:
5:24:15.764195 PROGRESS: Channel   0:	 0.05 FDR:   142; 0.01 FDR:   127; 0.001 FDR:    91
5:24:15.764320 PROGRESS: 
5:24:15.764412 PROGRESS: Protein Summary:
5:24:15.766505 PROGRESS: Channel   0:	 0.05 FDR:   142; 0.01 FDR:   127; 0.001 FDR:    91
5:24:15.766621 PROGRESS: =========================================================================
5:24:15.767550 PROGRESS: === Epoch 11, step 4, extracting elution groups 15000 to 31000 ===
5:24:15.875497 PROGRESS: Extracting batch of 31610 precursors
5:24:15.886241 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:24:15.886349 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:24:15.886395 INFO: FWHM in RT is 15.23 seconds, sigma is 0.55
5:24:15.886428 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:24:15.886677 INFO: Starting candidate selection
5:24:20.845208 INFO: Starting candidate scoring
5:24:22.450059 INFO: Finished candidate processing
5:24:22.450146 INFO: Collecting candidate features
5:24:24.729164 WARNING: intensity_correlation has 59 NaNs ( 0.20 % out of 29968)
5:24:24.736230 INFO: Collecting fragment features
5:24:25.420742 INFO: Finished candidate scoring
5:24:25.737380 PROGRESS: === Epoch 11, step 4, extracted 29968 precursors and 157985 fragments ===
5:24:25.737740 INFO: performing precursor FDR with 47 features
5:24:25.737803 INFO: Decoy channel: -1
5:24:25.737830 INFO: Competetive: True
5:24:25.798440 WARNING: dropped 68 target PSMs due to missing features
5:24:25.798570 WARNING: dropped 60 decoy PSMs due to missing features
5:24:27.703933 INFO: Test AUC: 0.554
5:24:27.704087 INFO: Train AUC: 0.601
5:24:27.704134 INFO: AUC difference: 7.86%
5:24:27.704170 WARNING: AUC difference > 5%. This may indicate overfitting.
5:24:27.855454 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
5:24:27.857572 PROGRESS: ============================= Precursor FDR =============================
5:24:27.857810 PROGRESS: Total precursors accumulated: 1,026
5:24:27.857990 PROGRESS: Target precursors: 937 (91.33%)
5:24:27.858132 PROGRESS: Decoy precursors: 89 (8.67%)
5:24:27.858263 PROGRESS: 
5:24:27.858387 PROGRESS: Precursor Summary:
5:24:27.861597 PROGRESS: Channel   0:	 0.05 FDR:   463; 0.01 FDR:   214; 0.001 FDR:   158
5:24:27.861729 PROGRESS: 
5:24:27.861811 PROGRESS: Protein Summary:
5:24:27.863804 PROGRESS: Channel   0:	 0.05 FDR:   447; 0.01 FDR:   207; 0.001 FDR:   154
5:24:27.863912 PROGRESS: =========================================================================
5:24:27.864945 PROGRESS: === Epoch 11, step 5, extracting elution groups 31000 to 63000 ===
5:24:28.000505 PROGRESS: Extracting batch of 63229 precursors
5:24:28.020717 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:24:28.020842 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:24:28.020899 INFO: FWHM in RT is 15.23 seconds, sigma is 0.55
5:24:28.020926 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:24:28.021176 INFO: Starting candidate selection
5:24:33.643308 INFO: Starting candidate scoring
5:24:35.573319 INFO: Finished candidate processing
5:24:35.573501 INFO: Collecting candidate features
5:24:37.957638 WARNING: intensity_correlation has 124 NaNs ( 0.21 % out of 59774)
5:24:37.966731 INFO: Collecting fragment features
5:24:38.699985 INFO: Finished candidate scoring
5:24:39.052907 PROGRESS: === Epoch 11, step 5, extracted 59774 precursors and 315692 fragments ===
5:24:39.053272 INFO: performing precursor FDR with 47 features
5:24:39.053319 INFO: Decoy channel: -1
5:24:39.053345 INFO: Competetive: True
5:24:39.189785 WARNING: dropped 131 target PSMs due to missing features
5:24:39.189916 WARNING: dropped 121 decoy PSMs due to missing features
5:24:43.160310 INFO: Test AUC: 0.546
5:24:43.160431 INFO: Train AUC: 0.597
5:24:43.160516 INFO: AUC difference: 8.49%
5:24:43.160548 WARNING: AUC difference > 5%. This may indicate overfitting.
5:24:43.300221 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
5:24:43.301624 PROGRESS: ============================= Precursor FDR =============================
5:24:43.301779 PROGRESS: Total precursors accumulated: 1,299
5:24:43.301872 PROGRESS: Target precursors: 1,184 (91.15%)
5:24:43.301941 PROGRESS: Decoy precursors: 115 (8.85%)
5:24:43.302003 PROGRESS: 
5:24:43.302063 PROGRESS: Precursor Summary:
5:24:43.304023 PROGRESS: Channel   0:	 0.05 FDR:   741; 0.01 FDR:   459; 0.001 FDR:   223
5:24:43.304138 PROGRESS: 
5:24:43.304236 PROGRESS: Protein Summary:
5:24:43.306536 PROGRESS: Channel   0:	 0.05 FDR:   703; 0.01 FDR:   432; 0.001 FDR:   214
5:24:43.306650 PROGRESS: =========================================================================
5:24:43.307815 PROGRESS: === Epoch 11, step 6, extracting elution groups 63000 to 127000 ===
5:24:43.484238 PROGRESS: Extracting batch of 126453 precursors
5:24:43.522939 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:24:43.523062 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:24:43.523108 INFO: FWHM in RT is 15.23 seconds, sigma is 0.55
5:24:43.523140 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:24:43.523394 INFO: Starting candidate selection
5:24:50.407290 INFO: Starting candidate scoring
5:24:52.940766 INFO: Finished candidate processing
5:24:52.940947 INFO: Collecting candidate features
5:24:55.508136 WARNING: intensity_correlation has 252 NaNs ( 0.21 % out of 119545)
5:24:55.521333 INFO: Collecting fragment features
5:24:56.298893 INFO: Finished candidate scoring
5:24:56.729026 PROGRESS: === Epoch 11, step 6, extracted 119545 precursors and 631294 fragments ===
5:24:56.729389 INFO: performing precursor FDR with 47 features
5:24:56.729434 INFO: Decoy channel: -1
5:24:56.729459 INFO: Competetive: True
5:24:57.008543 WARNING: dropped 257 target PSMs due to missing features
5:24:57.008657 WARNING: dropped 247 decoy PSMs due to missing features
5:25:05.363106 INFO: Test AUC: 0.555
5:25:05.363230 INFO: Train AUC: 0.587
5:25:05.363286 INFO: AUC difference: 5.42%
5:25:05.363314 WARNING: AUC difference > 5%. This may indicate overfitting.
5:25:05.540869 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
5:25:05.542634 PROGRESS: ============================= Precursor FDR =============================
5:25:05.542798 PROGRESS: Total precursors accumulated: 2,445
5:25:05.542878 PROGRESS: Target precursors: 2,234 (91.37%)
5:25:05.542955 PROGRESS: Decoy precursors: 211 (8.63%)
5:25:05.543017 PROGRESS: 
5:25:05.543077 PROGRESS: Precursor Summary:
5:25:05.545317 PROGRESS: Channel   0:	 0.05 FDR: 1,389; 0.01 FDR:   938; 0.001 FDR:   544
5:25:05.545447 PROGRESS: 
5:25:05.545537 PROGRESS: Protein Summary:
5:25:05.548392 PROGRESS: Channel   0:	 0.05 FDR: 1,263; 0.01 FDR:   851; 0.001 FDR:   506
5:25:05.548527 PROGRESS: =========================================================================
5:25:05.550057 PROGRESS: === Epoch 11, step 7, extracting elution groups 127000 to 255000 ===
5:25:05.776484 PROGRESS: Extracting batch of 253006 precursors
5:25:05.849376 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:25:05.849490 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:25:05.849529 INFO: FWHM in RT is 15.23 seconds, sigma is 0.55
5:25:05.849572 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:25:05.849842 INFO: Starting candidate selection
5:25:15.350770 INFO: Starting candidate scoring
5:25:19.152608 INFO: Finished candidate processing
5:25:19.152704 INFO: Collecting candidate features
5:25:22.088620 WARNING: intensity_correlation has 479 NaNs ( 0.20 % out of 239251)
5:25:22.109499 INFO: Collecting fragment features
5:25:22.984179 INFO: Finished candidate scoring
5:25:23.568708 PROGRESS: === Epoch 11, step 7, extracted 239251 precursors and 1263510 fragments ===
5:25:23.569078 INFO: performing precursor FDR with 47 features
5:25:23.569126 INFO: Decoy channel: -1
5:25:23.569153 INFO: Competetive: True
5:25:24.166114 WARNING: dropped 485 target PSMs due to missing features
5:25:24.166255 WARNING: dropped 498 decoy PSMs due to missing features
5:25:42.027283 INFO: Test AUC: 0.551
5:25:42.027415 INFO: Train AUC: 0.576
5:25:42.027456 INFO: AUC difference: 4.45%
5:25:42.213386 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
5:25:42.215828 PROGRESS: ============================= Precursor FDR =============================
5:25:42.215976 PROGRESS: Total precursors accumulated: 4,723
5:25:42.216054 PROGRESS: Target precursors: 4,307 (91.19%)
5:25:42.216121 PROGRESS: Decoy precursors: 416 (8.81%)
5:25:42.216184 PROGRESS: 
5:25:42.216245 PROGRESS: Precursor Summary:
5:25:42.219294 PROGRESS: Channel   0:	 0.05 FDR: 3,003; 0.01 FDR: 2,104; 0.001 FDR: 1,216
5:25:42.219448 PROGRESS: 
5:25:42.219522 PROGRESS: Protein Summary:
5:25:42.223579 PROGRESS: Channel   0:	 0.05 FDR: 2,482; 0.01 FDR: 1,724; 0.001 FDR: 1,024
5:25:42.223713 PROGRESS: =========================================================================
5:25:42.225710 PROGRESS: === Epoch 11, step 8, extracting elution groups 255000 to 511000 ===
5:25:42.528647 PROGRESS: Extracting batch of 505874 precursors
5:25:42.661030 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:25:42.661144 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:25:42.661184 INFO: FWHM in RT is 15.23 seconds, sigma is 0.55
5:25:42.661228 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:25:42.661493 INFO: Starting candidate selection
5:25:57.362073 INFO: Starting candidate scoring
5:26:03.778661 INFO: Finished candidate processing
5:26:03.778853 INFO: Collecting candidate features
5:26:07.477429 WARNING: intensity_correlation has 917 NaNs ( 0.19 % out of 478621)
5:26:07.513696 INFO: Collecting fragment features
5:26:08.600121 INFO: Finished candidate scoring
5:26:09.506413 PROGRESS: === Epoch 11, step 8, extracted 478621 precursors and 2527934 fragments ===
5:26:09.506794 INFO: performing precursor FDR with 47 features
5:26:09.506840 INFO: Decoy channel: -1
5:26:09.506867 INFO: Competetive: True
5:26:10.671197 WARNING: dropped 963 target PSMs due to missing features
5:26:10.671321 WARNING: dropped 937 decoy PSMs due to missing features
5:26:46.487142 INFO: Test AUC: 0.553
5:26:46.487275 INFO: Train AUC: 0.568
5:26:46.487332 INFO: AUC difference: 2.56%
5:26:46.735380 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
5:26:46.738718 PROGRESS: ============================= Precursor FDR =============================
5:26:46.738909 PROGRESS: Total precursors accumulated: 7,754
5:26:46.738988 PROGRESS: Target precursors: 7,079 (91.29%)
5:26:46.739069 PROGRESS: Decoy precursors: 675 (8.71%)
5:26:46.739133 PROGRESS: 
5:26:46.739194 PROGRESS: Precursor Summary:
5:26:46.743303 PROGRESS: Channel   0:	 0.05 FDR: 5,504; 0.01 FDR: 3,858; 0.001 FDR: 2,612
5:26:46.743501 PROGRESS: 
5:26:46.743585 PROGRESS: Protein Summary:
5:26:46.749517 PROGRESS: Channel   0:	 0.05 FDR: 3,825; 0.01 FDR: 2,596; 0.001 FDR: 1,832
5:26:46.749669 PROGRESS: =========================================================================
5:26:46.754552 INFO: calibration group: precursor, fitting rt estimator 
5:26:47.215240 INFO: calibration group: fragment, fitting mz estimator 
5:26:47.803008 INFO: === checking if epoch conditions were reached ===
5:26:47.803268 INFO: ✅ ms2_error      : 7.0000 <= 7
5:26:47.803358 INFO: ❌ rt_error       : 200.5740 > 100
5:26:47.803431 INFO: ✅ current_epoch  : 11 >= 3
5:26:47.803497 INFO: ==============================================
5:26:48.022036 INFO: calibration group: precursor, predicting mz
5:26:48.022337 WARNING: mz prediction was skipped as it has not been fitted yet
5:26:48.022382 INFO: calibration group: precursor, predicting rt
5:26:54.851562 INFO: calibration group: fragment, predicting mz
5:27:12.609102 PROGRESS: === Epoch 12, step 0, extracting elution groups 0 to 1000 ===
5:27:12.707720 PROGRESS: Extracting batch of 1982 precursors
5:27:12.709463 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:27:12.709545 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:27:12.709591 INFO: FWHM in RT is 15.16 seconds, sigma is 0.55
5:27:12.709625 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:27:12.709882 INFO: Starting candidate selection
5:27:17.437061 INFO: Starting candidate scoring
5:27:18.741174 INFO: Finished candidate processing
5:27:18.741268 INFO: Collecting candidate features
5:27:20.923068 WARNING: intensity_correlation has 3 NaNs ( 0.16 % out of 1865)
5:27:20.928943 INFO: Collecting fragment features
5:27:21.574328 INFO: Finished candidate scoring
5:27:21.900961 PROGRESS: === Epoch 12, step 0, extracted 1865 precursors and 9814 fragments ===
5:27:21.901302 INFO: performing precursor FDR with 47 features
5:27:21.901343 INFO: Decoy channel: -1
5:27:21.901369 INFO: Competetive: True
5:27:21.906364 WARNING: dropped 2 target PSMs due to missing features
5:27:21.906454 WARNING: dropped 1 decoy PSMs due to missing features
5:27:21.935105 INFO: Test AUC: 0.584
5:27:21.935203 INFO: Train AUC: 0.549
5:27:21.935247 INFO: AUC difference: 6.49%
5:27:21.935281 WARNING: AUC difference > 5%. This may indicate overfitting.
5:27:22.055410 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
5:27:22.056217 PROGRESS: ============================= Precursor FDR =============================
5:27:22.056339 PROGRESS: Total precursors accumulated: 6
5:27:22.056418 PROGRESS: Target precursors: 6 (100.00%)
5:27:22.056487 PROGRESS: Decoy precursors: 0 (0.00%)
5:27:22.056550 PROGRESS: 
5:27:22.056610 PROGRESS: Precursor Summary:
5:27:22.058145 PROGRESS: Channel   0:	 0.05 FDR:     6; 0.01 FDR:     6; 0.001 FDR:     6
5:27:22.058259 PROGRESS: 
5:27:22.058333 PROGRESS: Protein Summary:
5:27:22.060022 PROGRESS: Channel   0:	 0.05 FDR:     6; 0.01 FDR:     6; 0.001 FDR:     6
5:27:22.060149 PROGRESS: =========================================================================
5:27:22.061036 PROGRESS: === Epoch 12, step 1, extracting elution groups 1000 to 3000 ===
5:27:22.139332 PROGRESS: Extracting batch of 3950 precursors
5:27:22.141573 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:27:22.141635 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:27:22.141673 INFO: FWHM in RT is 15.16 seconds, sigma is 0.55
5:27:22.141719 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:27:22.141993 INFO: Starting candidate selection
5:27:26.523298 INFO: Starting candidate scoring
5:27:27.850133 INFO: Finished candidate processing
5:27:27.850221 INFO: Collecting candidate features
5:27:30.039388 WARNING: intensity_correlation has 11 NaNs ( 0.30 % out of 3705)
5:27:30.045480 INFO: Collecting fragment features
5:27:30.695888 INFO: Finished candidate scoring
5:27:30.978343 PROGRESS: === Epoch 12, step 1, extracted 3705 precursors and 19419 fragments ===
5:27:30.978638 INFO: performing precursor FDR with 47 features
5:27:30.978696 INFO: Decoy channel: -1
5:27:30.978724 INFO: Competetive: True
5:27:30.987746 WARNING: dropped 8 target PSMs due to missing features
5:27:30.987836 WARNING: dropped 6 decoy PSMs due to missing features
5:27:31.026355 INFO: Test AUC: 0.541
5:27:31.026476 INFO: Train AUC: 0.552
5:27:31.026521 INFO: AUC difference: 1.92%
5:27:31.147179 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
5:27:31.147961 PROGRESS: ============================= Precursor FDR =============================
5:27:31.148080 PROGRESS: Total precursors accumulated: 24
5:27:31.148159 PROGRESS: Target precursors: 22 (91.67%)
5:27:31.148227 PROGRESS: Decoy precursors: 2 (8.33%)
5:27:31.148304 PROGRESS: 
5:27:31.148369 PROGRESS: Precursor Summary:
5:27:31.149853 PROGRESS: Channel   0:	 0.05 FDR:    21; 0.01 FDR:    16; 0.001 FDR:    16
5:27:31.149970 PROGRESS: 
5:27:31.150043 PROGRESS: Protein Summary:
5:27:31.151659 PROGRESS: Channel   0:	 0.05 FDR:    21; 0.01 FDR:    16; 0.001 FDR:    16
5:27:31.151771 PROGRESS: =========================================================================
5:27:31.152626 PROGRESS: === Epoch 12, step 2, extracting elution groups 3000 to 7000 ===
5:27:31.234540 PROGRESS: Extracting batch of 7902 precursors
5:27:31.237973 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:27:31.238040 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:27:31.238080 INFO: FWHM in RT is 15.16 seconds, sigma is 0.55
5:27:31.238110 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:27:31.238335 INFO: Starting candidate selection
5:27:35.655621 INFO: Starting candidate scoring
5:27:36.989915 INFO: Finished candidate processing
5:27:36.990024 INFO: Collecting candidate features
5:27:39.162044 WARNING: intensity_correlation has 14 NaNs ( 0.19 % out of 7472)
5:27:39.169019 INFO: Collecting fragment features
5:27:39.814095 INFO: Finished candidate scoring
5:27:40.099926 PROGRESS: === Epoch 12, step 2, extracted 7472 precursors and 39506 fragments ===
5:27:40.100270 INFO: performing precursor FDR with 47 features
5:27:40.100313 INFO: Decoy channel: -1
5:27:40.100340 INFO: Competetive: True
5:27:40.116016 WARNING: dropped 18 target PSMs due to missing features
5:27:40.116117 WARNING: dropped 10 decoy PSMs due to missing features
5:27:40.408389 INFO: Test AUC: 0.549
5:27:40.408523 INFO: Train AUC: 0.580
5:27:40.408569 INFO: AUC difference: 5.45%
5:27:40.408604 WARNING: AUC difference > 5%. This may indicate overfitting.
5:27:40.535154 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
5:27:40.536013 PROGRESS: ============================= Precursor FDR =============================
5:27:40.536135 PROGRESS: Total precursors accumulated: 106
5:27:40.536212 PROGRESS: Target precursors: 97 (91.51%)
5:27:40.536280 PROGRESS: Decoy precursors: 9 (8.49%)
5:27:40.536343 PROGRESS: 
5:27:40.536404 PROGRESS: Precursor Summary:
5:27:40.537899 PROGRESS: Channel   0:	 0.05 FDR:    65; 0.01 FDR:    49; 0.001 FDR:    49
5:27:40.538013 PROGRESS: 
5:27:40.538088 PROGRESS: Protein Summary:
5:27:40.539745 PROGRESS: Channel   0:	 0.05 FDR:    65; 0.01 FDR:    49; 0.001 FDR:    49
5:27:40.539866 PROGRESS: =========================================================================
5:27:40.540743 PROGRESS: === Epoch 12, step 3, extracting elution groups 7000 to 15000 ===
5:27:40.632919 PROGRESS: Extracting batch of 15807 precursors
5:27:40.638570 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:27:40.638657 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:27:40.638694 INFO: FWHM in RT is 15.16 seconds, sigma is 0.55
5:27:40.638721 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:27:40.638943 INFO: Starting candidate selection
5:27:45.230701 INFO: Starting candidate scoring
5:27:46.662678 INFO: Finished candidate processing
5:27:46.662807 INFO: Collecting candidate features
5:27:48.888525 WARNING: intensity_correlation has 38 NaNs ( 0.25 % out of 14958)
5:27:48.894645 INFO: Collecting fragment features
5:27:49.570156 INFO: Finished candidate scoring
5:27:49.867761 PROGRESS: === Epoch 12, step 3, extracted 14958 precursors and 78429 fragments ===
5:27:49.868149 INFO: performing precursor FDR with 47 features
5:27:49.868199 INFO: Decoy channel: -1
5:27:49.868225 INFO: Competetive: True
5:27:49.898021 WARNING: dropped 34 target PSMs due to missing features
5:27:49.898134 WARNING: dropped 32 decoy PSMs due to missing features
5:27:50.643675 INFO: Test AUC: 0.559
5:27:50.643820 INFO: Train AUC: 0.595
5:27:50.643866 INFO: AUC difference: 6.01%
5:27:50.643902 WARNING: AUC difference > 5%. This may indicate overfitting.
5:27:50.769659 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
5:27:50.770809 PROGRESS: ============================= Precursor FDR =============================
5:27:50.770934 PROGRESS: Total precursors accumulated: 277
5:27:50.771013 PROGRESS: Target precursors: 252 (90.97%)
5:27:50.771082 PROGRESS: Decoy precursors: 25 (9.03%)
5:27:50.771147 PROGRESS: 
5:27:50.771211 PROGRESS: Precursor Summary:
5:27:50.772762 PROGRESS: Channel   0:	 0.05 FDR:   129; 0.01 FDR:   108; 0.001 FDR:    91
5:27:50.772893 PROGRESS: 
5:27:50.772968 PROGRESS: Protein Summary:
5:27:50.774773 PROGRESS: Channel   0:	 0.05 FDR:   129; 0.01 FDR:   108; 0.001 FDR:    91
5:27:50.774886 PROGRESS: =========================================================================
5:27:50.775818 PROGRESS: === Epoch 12, step 4, extracting elution groups 15000 to 31000 ===
5:27:50.884038 PROGRESS: Extracting batch of 31594 precursors
5:27:50.894964 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:27:50.895076 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:27:50.895120 INFO: FWHM in RT is 15.16 seconds, sigma is 0.55
5:27:50.895148 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:27:50.895403 INFO: Starting candidate selection
5:27:55.806845 INFO: Starting candidate scoring
5:27:57.378320 INFO: Finished candidate processing
5:27:57.378418 INFO: Collecting candidate features
5:27:59.660701 WARNING: intensity_correlation has 68 NaNs ( 0.23 % out of 29909)
5:27:59.667650 INFO: Collecting fragment features
5:28:00.342889 INFO: Finished candidate scoring
5:28:00.655733 PROGRESS: === Epoch 12, step 4, extracted 29909 precursors and 158082 fragments ===
5:28:00.656107 INFO: performing precursor FDR with 47 features
5:28:00.656157 INFO: Decoy channel: -1
5:28:00.656183 INFO: Competetive: True
5:28:00.715398 WARNING: dropped 64 target PSMs due to missing features
5:28:00.715509 WARNING: dropped 70 decoy PSMs due to missing features
5:28:02.605977 INFO: Test AUC: 0.560
5:28:02.606127 INFO: Train AUC: 0.604
5:28:02.606174 INFO: AUC difference: 7.22%
5:28:02.606208 WARNING: AUC difference > 5%. This may indicate overfitting.
5:28:02.733967 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
5:28:02.735229 PROGRESS: ============================= Precursor FDR =============================
5:28:02.735370 PROGRESS: Total precursors accumulated: 1,077
5:28:02.735447 PROGRESS: Target precursors: 983 (91.27%)
5:28:02.735515 PROGRESS: Decoy precursors: 94 (8.73%)
5:28:02.735578 PROGRESS: 
5:28:02.735639 PROGRESS: Precursor Summary:
5:28:02.737359 PROGRESS: Channel   0:	 0.05 FDR:   442; 0.01 FDR:   236; 0.001 FDR:   173
5:28:02.737492 PROGRESS: 
5:28:02.737567 PROGRESS: Protein Summary:
5:28:02.739578 PROGRESS: Channel   0:	 0.05 FDR:   431; 0.01 FDR:   229; 0.001 FDR:   166
5:28:02.739691 PROGRESS: =========================================================================
5:28:02.740710 PROGRESS: === Epoch 12, step 5, extracting elution groups 31000 to 63000 ===
5:28:02.876595 PROGRESS: Extracting batch of 63193 precursors
5:28:02.896786 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:28:02.896912 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:28:02.896952 INFO: FWHM in RT is 15.16 seconds, sigma is 0.55
5:28:02.896979 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:28:02.897229 INFO: Starting candidate selection
5:28:08.452621 INFO: Starting candidate scoring
5:28:10.353185 INFO: Finished candidate processing
5:28:10.353291 INFO: Collecting candidate features
5:28:12.729640 WARNING: intensity_correlation has 108 NaNs ( 0.18 % out of 59844)
5:28:12.739331 INFO: Collecting fragment features
5:28:13.459955 INFO: Finished candidate scoring
5:28:13.811308 PROGRESS: === Epoch 12, step 5, extracted 59844 precursors and 315791 fragments ===
5:28:13.811681 INFO: performing precursor FDR with 47 features
5:28:13.811728 INFO: Decoy channel: -1
5:28:13.811755 INFO: Competetive: True
5:28:13.947573 WARNING: dropped 119 target PSMs due to missing features
5:28:13.947688 WARNING: dropped 123 decoy PSMs due to missing features
5:28:17.691099 INFO: Test AUC: 0.556
5:28:17.691220 INFO: Train AUC: 0.599
5:28:17.691262 INFO: AUC difference: 7.19%
5:28:17.691290 WARNING: AUC difference > 5%. This may indicate overfitting.
5:28:17.828763 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
5:28:17.836989 PROGRESS: ============================= Precursor FDR =============================
5:28:17.837132 PROGRESS: Total precursors accumulated: 1,566
5:28:17.837213 PROGRESS: Target precursors: 1,428 (91.19%)
5:28:17.837283 PROGRESS: Decoy precursors: 138 (8.81%)
5:28:17.837361 PROGRESS: 
5:28:17.837424 PROGRESS: Precursor Summary:
5:28:17.839372 PROGRESS: Channel   0:	 0.05 FDR:   926; 0.01 FDR:   437; 0.001 FDR:   307
5:28:17.839508 PROGRESS: 
5:28:17.839583 PROGRESS: Protein Summary:
5:28:17.841910 PROGRESS: Channel   0:	 0.05 FDR:   879; 0.01 FDR:   415; 0.001 FDR:   292
5:28:17.842021 PROGRESS: =========================================================================
5:28:17.843163 PROGRESS: === Epoch 12, step 6, extracting elution groups 63000 to 127000 ===
5:28:18.018578 PROGRESS: Extracting batch of 126409 precursors
5:28:18.056409 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:28:18.056524 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:28:18.056561 INFO: FWHM in RT is 15.16 seconds, sigma is 0.55
5:28:18.056604 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:28:18.056860 INFO: Starting candidate selection
5:28:24.912159 INFO: Starting candidate scoring
5:28:27.437119 INFO: Finished candidate processing
5:28:27.437239 INFO: Collecting candidate features
5:28:29.997892 WARNING: intensity_correlation has 227 NaNs ( 0.19 % out of 119581)
5:28:30.011126 INFO: Collecting fragment features
5:28:30.788438 INFO: Finished candidate scoring
5:28:31.216716 PROGRESS: === Epoch 12, step 6, extracted 119581 precursors and 631786 fragments ===
5:28:31.217098 INFO: performing precursor FDR with 47 features
5:28:31.217144 INFO: Decoy channel: -1
5:28:31.217170 INFO: Competetive: True
5:28:31.493854 WARNING: dropped 233 target PSMs due to missing features
5:28:31.493970 WARNING: dropped 236 decoy PSMs due to missing features
5:28:39.875576 INFO: Test AUC: 0.551
5:28:39.875705 INFO: Train AUC: 0.589
5:28:39.875762 INFO: AUC difference: 6.40%
5:28:39.875789 WARNING: AUC difference > 5%. This may indicate overfitting.
5:28:40.044330 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
5:28:40.046295 PROGRESS: ============================= Precursor FDR =============================
5:28:40.046433 PROGRESS: Total precursors accumulated: 2,951
5:28:40.046512 PROGRESS: Target precursors: 2,688 (91.09%)
5:28:40.046581 PROGRESS: Decoy precursors: 263 (8.91%)
5:28:40.046644 PROGRESS: 
5:28:40.046706 PROGRESS: Precursor Summary:
5:28:40.049024 PROGRESS: Channel   0:	 0.05 FDR: 1,712; 0.01 FDR:   930; 0.001 FDR:   554
5:28:40.049172 PROGRESS: 
5:28:40.049249 PROGRESS: Protein Summary:
5:28:40.052202 PROGRESS: Channel   0:	 0.05 FDR: 1,574; 0.01 FDR:   850; 0.001 FDR:   512
5:28:40.052346 PROGRESS: =========================================================================
5:28:40.053839 PROGRESS: === Epoch 12, step 7, extracting elution groups 127000 to 255000 ===
5:28:40.280639 PROGRESS: Extracting batch of 252992 precursors
5:28:40.354656 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:28:40.354805 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:28:40.354849 INFO: FWHM in RT is 15.16 seconds, sigma is 0.55
5:28:40.354877 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:28:40.355142 INFO: Starting candidate selection
5:28:49.847446 INFO: Starting candidate scoring
5:28:53.660322 INFO: Finished candidate processing
5:28:53.660507 INFO: Collecting candidate features
5:28:56.612787 WARNING: intensity_correlation has 428 NaNs ( 0.18 % out of 239446)
5:28:56.633361 INFO: Collecting fragment features
5:28:57.510474 INFO: Finished candidate scoring
5:28:58.094890 PROGRESS: === Epoch 12, step 7, extracted 239446 precursors and 1264853 fragments ===
5:28:58.095253 INFO: performing precursor FDR with 47 features
5:28:58.095301 INFO: Decoy channel: -1
5:28:58.095328 INFO: Competetive: True
5:28:58.693068 WARNING: dropped 473 target PSMs due to missing features
5:28:58.693190 WARNING: dropped 424 decoy PSMs due to missing features
5:29:16.046074 INFO: Test AUC: 0.552
5:29:16.046218 INFO: Train AUC: 0.576
5:29:16.046259 INFO: AUC difference: 4.25%
5:29:16.237216 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
5:29:16.239733 PROGRESS: ============================= Precursor FDR =============================
5:29:16.239895 PROGRESS: Total precursors accumulated: 4,935
5:29:16.239982 PROGRESS: Target precursors: 4,498 (91.14%)
5:29:16.240059 PROGRESS: Decoy precursors: 437 (8.86%)
5:29:16.240128 PROGRESS: 
5:29:16.240195 PROGRESS: Precursor Summary:
5:29:16.243227 PROGRESS: Channel   0:	 0.05 FDR: 3,148; 0.01 FDR: 2,046; 0.001 FDR: 1,546
5:29:16.243359 PROGRESS: 
5:29:16.243446 PROGRESS: Protein Summary:
5:29:16.248087 PROGRESS: Channel   0:	 0.05 FDR: 2,593; 0.01 FDR: 1,653; 0.001 FDR: 1,248
5:29:16.248207 PROGRESS: =========================================================================
5:29:16.250169 PROGRESS: === Epoch 12, step 8, extracting elution groups 255000 to 511000 ===
5:29:16.556540 PROGRESS: Extracting batch of 505794 precursors
5:29:16.690402 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:29:16.690542 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:29:16.690592 INFO: FWHM in RT is 15.16 seconds, sigma is 0.55
5:29:16.690626 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:29:16.690916 INFO: Starting candidate selection
5:29:31.322698 INFO: Starting candidate scoring
5:29:37.617491 INFO: Finished candidate processing
5:29:37.617682 INFO: Collecting candidate features
5:29:41.264689 WARNING: intensity_correlation has 930 NaNs ( 0.19 % out of 478453)
5:29:41.298564 INFO: Collecting fragment features
5:29:42.371000 INFO: Finished candidate scoring
5:29:43.262899 PROGRESS: === Epoch 12, step 8, extracted 478453 precursors and 2526586 fragments ===
5:29:43.263283 INFO: performing precursor FDR with 47 features
5:29:43.269930 INFO: Decoy channel: -1
5:29:43.270085 INFO: Competetive: True
5:29:44.408770 WARNING: dropped 911 target PSMs due to missing features
5:29:44.408893 WARNING: dropped 916 decoy PSMs due to missing features
5:30:20.011354 INFO: Test AUC: 0.553
5:30:20.011484 INFO: Train AUC: 0.568
5:30:20.011538 INFO: AUC difference: 2.65%
5:30:20.255363 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
5:30:20.258767 PROGRESS: ============================= Precursor FDR =============================
5:30:20.258931 PROGRESS: Total precursors accumulated: 8,018
5:30:20.259011 PROGRESS: Target precursors: 7,305 (91.11%)
5:30:20.259078 PROGRESS: Decoy precursors: 713 (8.89%)
5:30:20.259141 PROGRESS: 
5:30:20.259200 PROGRESS: Precursor Summary:
5:30:20.263282 PROGRESS: Channel   0:	 0.05 FDR: 5,513; 0.01 FDR: 3,810; 0.001 FDR: 2,497
5:30:20.263452 PROGRESS: 
5:30:20.263525 PROGRESS: Protein Summary:
5:30:20.269370 PROGRESS: Channel   0:	 0.05 FDR: 3,880; 0.01 FDR: 2,580; 0.001 FDR: 1,765
5:30:20.269517 PROGRESS: =========================================================================
5:30:20.274279 INFO: calibration group: precursor, fitting rt estimator 
5:30:20.725504 INFO: calibration group: fragment, fitting mz estimator 
5:30:21.320343 INFO: === checking if epoch conditions were reached ===
5:30:21.320587 INFO: ✅ ms2_error      : 7.0000 <= 7
5:30:21.320678 INFO: ❌ rt_error       : 199.0713 > 100
5:30:21.320750 INFO: ✅ current_epoch  : 12 >= 3
5:30:21.320815 INFO: ==============================================
5:30:21.540607 INFO: calibration group: precursor, predicting mz
5:30:21.540906 WARNING: mz prediction was skipped as it has not been fitted yet
5:30:21.540948 INFO: calibration group: precursor, predicting rt
5:30:28.356139 INFO: calibration group: fragment, predicting mz
5:30:46.190573 PROGRESS: === Epoch 13, step 0, extracting elution groups 0 to 1000 ===
5:30:46.289109 PROGRESS: Extracting batch of 1970 precursors
5:30:46.290963 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:30:46.291039 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:30:46.291077 INFO: FWHM in RT is 15.06 seconds, sigma is 0.55
5:30:46.291122 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:30:46.291352 INFO: Starting candidate selection
5:30:51.055938 INFO: Starting candidate scoring
5:30:52.350769 INFO: Finished candidate processing
5:30:52.350861 INFO: Collecting candidate features
5:30:54.524389 WARNING: intensity_correlation has 3 NaNs ( 0.16 % out of 1867)
5:30:54.530313 INFO: Collecting fragment features
5:30:55.172039 INFO: Finished candidate scoring
5:30:55.519580 PROGRESS: === Epoch 13, step 0, extracted 1867 precursors and 9836 fragments ===
5:30:55.519906 INFO: performing precursor FDR with 47 features
5:30:55.519959 INFO: Decoy channel: -1
5:30:55.520005 INFO: Competetive: True
5:30:55.524677 WARNING: dropped 3 decoy PSMs due to missing features
5:30:55.553288 INFO: Test AUC: 0.530
5:30:55.553391 INFO: Train AUC: 0.540
5:30:55.553441 INFO: AUC difference: 1.88%
5:30:55.673371 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
5:30:55.674159 PROGRESS: ============================= Precursor FDR =============================
5:30:55.674282 PROGRESS: Total precursors accumulated: 15
5:30:55.674360 PROGRESS: Target precursors: 14 (93.33%)
5:30:55.674428 PROGRESS: Decoy precursors: 1 (6.67%)
5:30:55.674491 PROGRESS: 
5:30:55.674552 PROGRESS: Precursor Summary:
5:30:55.675975 PROGRESS: Channel   0:	 0.05 FDR:    12; 0.01 FDR:    12; 0.001 FDR:    12
5:30:55.676088 PROGRESS: 
5:30:55.676179 PROGRESS: Protein Summary:
5:30:55.677780 PROGRESS: Channel   0:	 0.05 FDR:    12; 0.01 FDR:    12; 0.001 FDR:    12
5:30:55.677909 PROGRESS: =========================================================================
5:30:55.678766 PROGRESS: === Epoch 13, step 1, extracting elution groups 1000 to 3000 ===
5:30:55.756312 PROGRESS: Extracting batch of 3940 precursors
5:30:55.758584 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:30:55.758662 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:30:55.758703 INFO: FWHM in RT is 15.06 seconds, sigma is 0.55
5:30:55.758733 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:30:55.758949 INFO: Starting candidate selection
5:31:00.161867 INFO: Starting candidate scoring
5:31:01.495951 INFO: Finished candidate processing
5:31:01.496133 INFO: Collecting candidate features
5:31:03.663635 WARNING: intensity_correlation has 9 NaNs ( 0.24 % out of 3730)
5:31:03.669647 INFO: Collecting fragment features
5:31:04.309326 INFO: Finished candidate scoring
5:31:04.590225 PROGRESS: === Epoch 13, step 1, extracted 3730 precursors and 19518 fragments ===
5:31:04.590508 INFO: performing precursor FDR with 47 features
5:31:04.590554 INFO: Decoy channel: -1
5:31:04.590580 INFO: Competetive: True
5:31:04.599465 WARNING: dropped 3 target PSMs due to missing features
5:31:04.599556 WARNING: dropped 9 decoy PSMs due to missing features
5:31:04.637650 INFO: Test AUC: 0.537
5:31:04.637766 INFO: Train AUC: 0.558
5:31:04.637820 INFO: AUC difference: 3.78%
5:31:04.759043 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
5:31:04.759845 PROGRESS: ============================= Precursor FDR =============================
5:31:04.759966 PROGRESS: Total precursors accumulated: 39
5:31:04.760044 PROGRESS: Target precursors: 36 (92.31%)
5:31:04.760113 PROGRESS: Decoy precursors: 3 (7.69%)
5:31:04.760176 PROGRESS: 
5:31:04.760237 PROGRESS: Precursor Summary:
5:31:04.761665 PROGRESS: Channel   0:	 0.05 FDR:    33; 0.01 FDR:    31; 0.001 FDR:    31
5:31:04.761803 PROGRESS: 
5:31:04.761880 PROGRESS: Protein Summary:
5:31:04.763503 PROGRESS: Channel   0:	 0.05 FDR:    33; 0.01 FDR:    31; 0.001 FDR:    31
5:31:04.763614 PROGRESS: =========================================================================
5:31:04.764469 PROGRESS: === Epoch 13, step 2, extracting elution groups 3000 to 7000 ===
5:31:04.847301 PROGRESS: Extracting batch of 7918 precursors
5:31:04.850748 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:31:04.850814 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:31:04.850856 INFO: FWHM in RT is 15.06 seconds, sigma is 0.55
5:31:04.850888 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:31:04.851124 INFO: Starting candidate selection
5:31:09.302132 INFO: Starting candidate scoring
5:31:10.646784 INFO: Finished candidate processing
5:31:10.646877 INFO: Collecting candidate features
5:31:12.845974 WARNING: intensity_correlation has 13 NaNs ( 0.17 % out of 7451)
5:31:12.852766 INFO: Collecting fragment features
5:31:13.508556 INFO: Finished candidate scoring
5:31:13.797452 PROGRESS: === Epoch 13, step 2, extracted 7451 precursors and 39592 fragments ===
5:31:13.797804 INFO: performing precursor FDR with 47 features
5:31:13.797852 INFO: Decoy channel: -1
5:31:13.797880 INFO: Competetive: True
5:31:13.813490 WARNING: dropped 9 target PSMs due to missing features
5:31:13.813592 WARNING: dropped 16 decoy PSMs due to missing features
5:31:14.059901 INFO: Test AUC: 0.540
5:31:14.060037 INFO: Train AUC: 0.583
5:31:14.060081 INFO: AUC difference: 7.37%
5:31:14.060115 WARNING: AUC difference > 5%. This may indicate overfitting.
5:31:14.183460 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
5:31:14.184308 PROGRESS: ============================= Precursor FDR =============================
5:31:14.184433 PROGRESS: Total precursors accumulated: 89
5:31:14.184512 PROGRESS: Target precursors: 81 (91.01%)
5:31:14.184582 PROGRESS: Decoy precursors: 8 (8.99%)
5:31:14.184646 PROGRESS: 
5:31:14.184707 PROGRESS: Precursor Summary:
5:31:14.186220 PROGRESS: Channel   0:	 0.05 FDR:    64; 0.01 FDR:    49; 0.001 FDR:    49
5:31:14.186335 PROGRESS: 
5:31:14.186409 PROGRESS: Protein Summary:
5:31:14.188072 PROGRESS: Channel   0:	 0.05 FDR:    64; 0.01 FDR:    49; 0.001 FDR:    49
5:31:14.188185 PROGRESS: =========================================================================
5:31:14.189062 PROGRESS: === Epoch 13, step 3, extracting elution groups 7000 to 15000 ===
5:31:14.280458 PROGRESS: Extracting batch of 15795 precursors
5:31:14.286198 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:31:14.286284 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:31:14.286321 INFO: FWHM in RT is 15.06 seconds, sigma is 0.55
5:31:14.286348 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:31:14.286567 INFO: Starting candidate selection
5:31:18.968955 INFO: Starting candidate scoring
5:31:20.416547 INFO: Finished candidate processing
5:31:20.416644 INFO: Collecting candidate features
5:31:22.654025 WARNING: intensity_correlation has 27 NaNs ( 0.18 % out of 14932)
5:31:22.660104 INFO: Collecting fragment features
5:31:23.325960 INFO: Finished candidate scoring
5:31:23.623660 PROGRESS: === Epoch 13, step 3, extracted 14932 precursors and 79061 fragments ===
5:31:23.624036 INFO: performing precursor FDR with 47 features
5:31:23.624083 INFO: Decoy channel: -1
5:31:23.624109 INFO: Competetive: True
5:31:23.653661 WARNING: dropped 27 target PSMs due to missing features
5:31:23.653783 WARNING: dropped 25 decoy PSMs due to missing features
5:31:24.356968 INFO: Test AUC: 0.556
5:31:24.357114 INFO: Train AUC: 0.598
5:31:24.357159 INFO: AUC difference: 6.99%
5:31:24.357193 WARNING: AUC difference > 5%. This may indicate overfitting.
5:31:24.484897 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
5:31:24.485869 PROGRESS: ============================= Precursor FDR =============================
5:31:24.485997 PROGRESS: Total precursors accumulated: 279
5:31:24.486077 PROGRESS: Target precursors: 256 (91.76%)
5:31:24.486145 PROGRESS: Decoy precursors: 23 (8.24%)
5:31:24.486208 PROGRESS: 
5:31:24.486268 PROGRESS: Precursor Summary:
5:31:24.487822 PROGRESS: Channel   0:	 0.05 FDR:   172; 0.01 FDR:   120; 0.001 FDR:   102
5:31:24.487934 PROGRESS: 
5:31:24.488024 PROGRESS: Protein Summary:
5:31:24.489814 PROGRESS: Channel   0:	 0.05 FDR:   170; 0.01 FDR:   118; 0.001 FDR:   100
5:31:24.489927 PROGRESS: =========================================================================
5:31:24.490870 PROGRESS: === Epoch 13, step 4, extracting elution groups 15000 to 31000 ===
5:31:24.598979 PROGRESS: Extracting batch of 31598 precursors
5:31:24.609732 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:31:24.609858 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:31:24.609896 INFO: FWHM in RT is 15.06 seconds, sigma is 0.55
5:31:24.609923 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:31:24.610165 INFO: Starting candidate selection
5:31:29.587260 INFO: Starting candidate scoring
5:31:31.162101 INFO: Finished candidate processing
5:31:31.162196 INFO: Collecting candidate features
5:31:33.446722 WARNING: intensity_correlation has 51 NaNs ( 0.17 % out of 29920)
5:31:33.453700 INFO: Collecting fragment features
5:31:34.138462 INFO: Finished candidate scoring
5:31:34.452969 PROGRESS: === Epoch 13, step 4, extracted 29920 precursors and 157792 fragments ===
5:31:34.460231 INFO: performing precursor FDR with 47 features
5:31:34.460390 INFO: Decoy channel: -1
5:31:34.460486 INFO: Competetive: True
5:31:34.520577 WARNING: dropped 51 target PSMs due to missing features
5:31:34.520685 WARNING: dropped 52 decoy PSMs due to missing features
5:31:36.425924 INFO: Test AUC: 0.553
5:31:36.426070 INFO: Train AUC: 0.607
5:31:36.426114 INFO: AUC difference: 8.91%
5:31:36.426147 WARNING: AUC difference > 5%. This may indicate overfitting.
5:31:36.555181 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
5:31:36.556305 PROGRESS: ============================= Precursor FDR =============================
5:31:36.556429 PROGRESS: Total precursors accumulated: 729
5:31:36.556508 PROGRESS: Target precursors: 666 (91.36%)
5:31:36.556581 PROGRESS: Decoy precursors: 63 (8.64%)
5:31:36.556643 PROGRESS: 
5:31:36.556703 PROGRESS: Precursor Summary:
5:31:36.558385 PROGRESS: Channel   0:	 0.05 FDR:   341; 0.01 FDR:   238; 0.001 FDR:   167
5:31:36.558501 PROGRESS: 
5:31:36.558575 PROGRESS: Protein Summary:
5:31:36.560520 PROGRESS: Channel   0:	 0.05 FDR:   336; 0.01 FDR:   233; 0.001 FDR:   163
5:31:36.560632 PROGRESS: =========================================================================
5:31:36.561644 PROGRESS: === Epoch 13, step 5, extracting elution groups 31000 to 63000 ===
5:31:36.698078 PROGRESS: Extracting batch of 63206 precursors
5:31:36.718104 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:31:36.718210 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:31:36.718266 INFO: FWHM in RT is 15.06 seconds, sigma is 0.55
5:31:36.718293 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:31:36.718539 INFO: Starting candidate selection
5:31:42.353216 INFO: Starting candidate scoring
5:31:44.273630 INFO: Finished candidate processing
5:31:44.273838 INFO: Collecting candidate features
5:31:46.621975 WARNING: intensity_correlation has 108 NaNs ( 0.18 % out of 59976)
5:31:46.630841 INFO: Collecting fragment features
5:31:47.342767 INFO: Finished candidate scoring
5:31:47.690603 PROGRESS: === Epoch 13, step 5, extracted 59976 precursors and 316934 fragments ===
5:31:47.690982 INFO: performing precursor FDR with 47 features
5:31:47.691666 INFO: Decoy channel: -1
5:31:47.691755 INFO: Competetive: True
5:31:47.825466 WARNING: dropped 103 target PSMs due to missing features
5:31:47.825581 WARNING: dropped 108 decoy PSMs due to missing features
5:31:51.684895 INFO: Test AUC: 0.554
5:31:51.685013 INFO: Train AUC: 0.599
5:31:51.685069 INFO: AUC difference: 7.49%
5:31:51.685098 WARNING: AUC difference > 5%. This may indicate overfitting.
5:31:51.821536 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
5:31:51.823008 PROGRESS: ============================= Precursor FDR =============================
5:31:51.823172 PROGRESS: Total precursors accumulated: 1,633
5:31:51.823251 PROGRESS: Target precursors: 1,488 (91.12%)
5:31:51.823318 PROGRESS: Decoy precursors: 145 (8.88%)
5:31:51.823380 PROGRESS: 
5:31:51.823440 PROGRESS: Precursor Summary:
5:31:51.825306 PROGRESS: Channel   0:	 0.05 FDR:   826; 0.01 FDR:   397; 0.001 FDR:   356
5:31:51.825438 PROGRESS: 
5:31:51.825513 PROGRESS: Protein Summary:
5:31:51.827782 PROGRESS: Channel   0:	 0.05 FDR:   785; 0.01 FDR:   380; 0.001 FDR:   342
5:31:51.827911 PROGRESS: =========================================================================
5:31:51.829026 PROGRESS: === Epoch 13, step 6, extracting elution groups 63000 to 127000 ===
5:31:52.005359 PROGRESS: Extracting batch of 126465 precursors
5:31:52.043781 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:31:52.043897 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:31:52.043934 INFO: FWHM in RT is 15.06 seconds, sigma is 0.55
5:31:52.043978 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:31:52.044239 INFO: Starting candidate selection
5:31:58.939728 INFO: Starting candidate scoring
5:32:01.475320 INFO: Finished candidate processing
5:32:01.475508 INFO: Collecting candidate features
5:32:04.009486 WARNING: intensity_correlation has 225 NaNs ( 0.19 % out of 119646)
5:32:04.022290 INFO: Collecting fragment features
5:32:04.789683 INFO: Finished candidate scoring
5:32:05.217835 PROGRESS: === Epoch 13, step 6, extracted 119646 precursors and 630532 fragments ===
5:32:05.218180 INFO: performing precursor FDR with 47 features
5:32:05.218225 INFO: Decoy channel: -1
5:32:05.218252 INFO: Competetive: True
5:32:05.492213 WARNING: dropped 220 target PSMs due to missing features
5:32:05.492328 WARNING: dropped 216 decoy PSMs due to missing features
5:32:13.991823 INFO: Test AUC: 0.553
5:32:13.991952 INFO: Train AUC: 0.588
5:32:13.992009 INFO: AUC difference: 5.94%
5:32:13.992035 WARNING: AUC difference > 5%. This may indicate overfitting.
5:32:14.147058 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
5:32:14.148875 PROGRESS: ============================= Precursor FDR =============================
5:32:14.149026 PROGRESS: Total precursors accumulated: 2,801
5:32:14.149103 PROGRESS: Target precursors: 2,551 (91.07%)
5:32:14.149170 PROGRESS: Decoy precursors: 250 (8.93%)
5:32:14.149231 PROGRESS: 
5:32:14.149293 PROGRESS: Precursor Summary:
5:32:14.151532 PROGRESS: Channel   0:	 0.05 FDR: 1,604; 0.01 FDR:   979; 0.001 FDR:   509
5:32:14.151681 PROGRESS: 
5:32:14.151757 PROGRESS: Protein Summary:
5:32:14.154609 PROGRESS: Channel   0:	 0.05 FDR: 1,449; 0.01 FDR:   877; 0.001 FDR:   465
5:32:14.154723 PROGRESS: =========================================================================
5:32:14.156170 PROGRESS: === Epoch 13, step 7, extracting elution groups 127000 to 255000 ===
5:32:14.380161 PROGRESS: Extracting batch of 252949 precursors
5:32:14.452232 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:32:14.452350 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:32:14.452388 INFO: FWHM in RT is 15.06 seconds, sigma is 0.55
5:32:14.452431 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:32:14.452689 INFO: Starting candidate selection
5:32:23.921926 INFO: Starting candidate scoring
5:32:27.738384 INFO: Finished candidate processing
5:32:27.738490 INFO: Collecting candidate features
5:32:30.684507 WARNING: intensity_correlation has 439 NaNs ( 0.18 % out of 239595)
5:32:30.705546 INFO: Collecting fragment features
5:32:31.587004 INFO: Finished candidate scoring
5:32:32.168226 PROGRESS: === Epoch 13, step 7, extracted 239595 precursors and 1262135 fragments ===
5:32:32.168620 INFO: performing precursor FDR with 47 features
5:32:32.168666 INFO: Decoy channel: -1
5:32:32.168693 INFO: Competetive: True
5:32:32.765891 WARNING: dropped 437 target PSMs due to missing features
5:32:32.766013 WARNING: dropped 438 decoy PSMs due to missing features
5:32:50.246146 INFO: Test AUC: 0.553
5:32:50.246294 INFO: Train AUC: 0.575
5:32:50.246334 INFO: AUC difference: 3.81%
5:32:50.429160 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
5:32:50.431439 PROGRESS: ============================= Precursor FDR =============================
5:32:50.431594 PROGRESS: Total precursors accumulated: 4,062
5:32:50.431676 PROGRESS: Target precursors: 3,698 (91.04%)
5:32:50.431744 PROGRESS: Decoy precursors: 364 (8.96%)
5:32:50.431808 PROGRESS: 
5:32:50.431869 PROGRESS: Precursor Summary:
5:32:50.434690 PROGRESS: Channel   0:	 0.05 FDR: 2,589; 0.01 FDR: 1,815; 0.001 FDR: 1,299
5:32:50.434826 PROGRESS: 
5:32:50.434898 PROGRESS: Protein Summary:
5:32:50.438600 PROGRESS: Channel   0:	 0.05 FDR: 2,148; 0.01 FDR: 1,491; 0.001 FDR: 1,086
5:32:50.438720 PROGRESS: =========================================================================
5:32:50.440549 PROGRESS: === Epoch 13, step 8, extracting elution groups 255000 to 511000 ===
5:32:50.743455 PROGRESS: Extracting batch of 505899 precursors
5:32:50.875161 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:32:50.875274 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:32:50.875311 INFO: FWHM in RT is 15.06 seconds, sigma is 0.55
5:32:50.875355 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:32:50.875618 INFO: Starting candidate selection
5:33:05.567132 INFO: Starting candidate scoring
5:33:11.896171 INFO: Finished candidate processing
5:33:11.896364 INFO: Collecting candidate features
5:33:15.591681 WARNING: intensity_correlation has 870 NaNs ( 0.18 % out of 479047)
5:33:15.627586 INFO: Collecting fragment features
5:33:16.711172 INFO: Finished candidate scoring
5:33:17.618186 PROGRESS: === Epoch 13, step 8, extracted 479047 precursors and 2525302 fragments ===
5:33:17.618551 INFO: performing precursor FDR with 47 features
5:33:17.618599 INFO: Decoy channel: -1
5:33:17.618626 INFO: Competetive: True
5:33:18.788496 WARNING: dropped 879 target PSMs due to missing features
5:33:18.788623 WARNING: dropped 866 decoy PSMs due to missing features
5:33:54.882664 INFO: Test AUC: 0.552
5:33:54.882803 INFO: Train AUC: 0.569
5:33:54.882839 INFO: AUC difference: 3.09%
5:33:55.124767 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
5:33:55.127892 PROGRESS: ============================= Precursor FDR =============================
5:33:55.128054 PROGRESS: Total precursors accumulated: 7,502
5:33:55.128132 PROGRESS: Target precursors: 6,856 (91.39%)
5:33:55.128198 PROGRESS: Decoy precursors: 646 (8.61%)
5:33:55.128259 PROGRESS: 
5:33:55.128319 PROGRESS: Precursor Summary:
5:33:55.131900 PROGRESS: Channel   0:	 0.05 FDR: 5,454; 0.01 FDR: 3,859; 0.001 FDR:   574
5:33:55.132042 PROGRESS: 
5:33:55.132114 PROGRESS: Protein Summary:
5:33:55.137166 PROGRESS: Channel   0:	 0.05 FDR: 3,760; 0.01 FDR: 2,605; 0.001 FDR:   506
5:33:55.137281 PROGRESS: =========================================================================
5:33:55.141954 INFO: calibration group: precursor, fitting rt estimator 
5:33:55.599195 INFO: calibration group: fragment, fitting mz estimator 
5:33:56.201277 INFO: === checking if epoch conditions were reached ===
5:33:56.201488 INFO: ✅ ms2_error      : 7.0000 <= 7
5:33:56.201575 INFO: ❌ rt_error       : 201.0846 > 100
5:33:56.201647 INFO: ✅ current_epoch  : 13 >= 3
5:33:56.201718 INFO: ==============================================
5:33:56.419120 INFO: calibration group: precursor, predicting mz
5:33:56.419420 WARNING: mz prediction was skipped as it has not been fitted yet
5:33:56.419463 INFO: calibration group: precursor, predicting rt
5:34:03.222502 INFO: calibration group: fragment, predicting mz
5:34:21.036442 PROGRESS: === Epoch 14, step 0, extracting elution groups 0 to 1000 ===
5:34:21.135001 PROGRESS: Extracting batch of 1978 precursors
5:34:21.136711 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:34:21.136785 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:34:21.136823 INFO: FWHM in RT is 14.83 seconds, sigma is 0.54
5:34:21.136869 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:34:21.137094 INFO: Starting candidate selection
5:34:25.837421 INFO: Starting candidate scoring
5:34:27.113980 INFO: Finished candidate processing
5:34:27.114072 INFO: Collecting candidate features
5:34:29.265657 WARNING: intensity_correlation has 5 NaNs ( 0.27 % out of 1882)
5:34:29.271502 INFO: Collecting fragment features
5:34:29.902531 INFO: Finished candidate scoring
5:34:30.226371 PROGRESS: === Epoch 14, step 0, extracted 1882 precursors and 9876 fragments ===
5:34:30.226685 INFO: performing precursor FDR with 47 features
5:34:30.226726 INFO: Decoy channel: -1
5:34:30.226752 INFO: Competetive: True
5:34:30.231490 WARNING: dropped 3 target PSMs due to missing features
5:34:30.231565 WARNING: dropped 2 decoy PSMs due to missing features
5:34:30.259216 INFO: Test AUC: 0.522
5:34:30.259312 INFO: Train AUC: 0.548
5:34:30.259356 INFO: AUC difference: 4.74%
5:34:30.378802 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
5:34:30.379562 PROGRESS: ============================= Precursor FDR =============================
5:34:30.379680 PROGRESS: Total precursors accumulated: 7
5:34:30.379756 PROGRESS: Target precursors: 7 (100.00%)
5:34:30.379823 PROGRESS: Decoy precursors: 0 (0.00%)
5:34:30.379884 PROGRESS: 
5:34:30.379943 PROGRESS: Precursor Summary:
5:34:30.381384 PROGRESS: Channel   0:	 0.05 FDR:     7; 0.01 FDR:     7; 0.001 FDR:     7
5:34:30.381496 PROGRESS: 
5:34:30.381568 PROGRESS: Protein Summary:
5:34:30.383268 PROGRESS: Channel   0:	 0.05 FDR:     7; 0.01 FDR:     7; 0.001 FDR:     7
5:34:30.383377 PROGRESS: =========================================================================
5:34:30.384238 PROGRESS: === Epoch 14, step 1, extracting elution groups 1000 to 3000 ===
5:34:30.461335 PROGRESS: Extracting batch of 3952 precursors
5:34:30.463509 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:34:30.463573 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:34:30.463611 INFO: FWHM in RT is 14.83 seconds, sigma is 0.54
5:34:30.463640 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:34:30.463845 INFO: Starting candidate selection
5:34:34.891708 INFO: Starting candidate scoring
5:34:36.230152 INFO: Finished candidate processing
5:34:36.230255 INFO: Collecting candidate features
5:34:38.392730 WARNING: intensity_correlation has 7 NaNs ( 0.19 % out of 3717)
5:34:38.398705 INFO: Collecting fragment features
5:34:39.039750 INFO: Finished candidate scoring
5:34:39.319025 PROGRESS: === Epoch 14, step 1, extracted 3717 precursors and 19590 fragments ===
5:34:39.319309 INFO: performing precursor FDR with 47 features
5:34:39.319356 INFO: Decoy channel: -1
5:34:39.319383 INFO: Competetive: True
5:34:39.327984 WARNING: dropped 7 target PSMs due to missing features
5:34:39.328073 WARNING: dropped 5 decoy PSMs due to missing features
5:34:39.365651 INFO: Test AUC: 0.547
5:34:39.365767 INFO: Train AUC: 0.544
5:34:39.365822 INFO: AUC difference: 0.56%
5:34:39.484955 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
5:34:39.485729 PROGRESS: ============================= Precursor FDR =============================
5:34:39.485860 PROGRESS: Total precursors accumulated: 23
5:34:39.485939 PROGRESS: Target precursors: 21 (91.30%)
5:34:39.486007 PROGRESS: Decoy precursors: 2 (8.70%)
5:34:39.486071 PROGRESS: 
5:34:39.486144 PROGRESS: Precursor Summary:
5:34:39.487566 PROGRESS: Channel   0:	 0.05 FDR:    21; 0.01 FDR:    18; 0.001 FDR:    18
5:34:39.487678 PROGRESS: 
5:34:39.487751 PROGRESS: Protein Summary:
5:34:39.489363 PROGRESS: Channel   0:	 0.05 FDR:    21; 0.01 FDR:    18; 0.001 FDR:    18
5:34:39.489473 PROGRESS: =========================================================================
5:34:39.490332 PROGRESS: === Epoch 14, step 2, extracting elution groups 3000 to 7000 ===
5:34:39.572307 PROGRESS: Extracting batch of 7903 precursors
5:34:39.575700 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:34:39.575765 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:34:39.575802 INFO: FWHM in RT is 14.83 seconds, sigma is 0.54
5:34:39.575847 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:34:39.576064 INFO: Starting candidate selection
5:34:44.035515 INFO: Starting candidate scoring
5:34:45.377626 INFO: Finished candidate processing
5:34:45.377716 INFO: Collecting candidate features
5:34:47.576642 WARNING: intensity_correlation has 12 NaNs ( 0.16 % out of 7472)
5:34:47.583159 INFO: Collecting fragment features
5:34:48.242715 INFO: Finished candidate scoring
5:34:48.529819 PROGRESS: === Epoch 14, step 2, extracted 7472 precursors and 39779 fragments ===
5:34:48.530156 INFO: performing precursor FDR with 47 features
5:34:48.530203 INFO: Decoy channel: -1
5:34:48.530229 INFO: Competetive: True
5:34:48.545654 WARNING: dropped 13 target PSMs due to missing features
5:34:48.545756 WARNING: dropped 11 decoy PSMs due to missing features
5:34:48.841811 INFO: Test AUC: 0.540
5:34:48.841943 INFO: Train AUC: 0.577
5:34:48.841987 INFO: AUC difference: 6.54%
5:34:48.842021 WARNING: AUC difference > 5%. This may indicate overfitting.
5:34:48.963892 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
5:34:48.964727 PROGRESS: ============================= Precursor FDR =============================
5:34:48.964847 PROGRESS: Total precursors accumulated: 78
5:34:48.964924 PROGRESS: Target precursors: 71 (91.03%)
5:34:48.965003 PROGRESS: Decoy precursors: 7 (8.97%)
5:34:48.965068 PROGRESS: 
5:34:48.965129 PROGRESS: Precursor Summary:
5:34:48.966575 PROGRESS: Channel   0:	 0.05 FDR:    48; 0.01 FDR:    34; 0.001 FDR:    34
5:34:48.966687 PROGRESS: 
5:34:48.966760 PROGRESS: Protein Summary:
5:34:48.968385 PROGRESS: Channel   0:	 0.05 FDR:    48; 0.01 FDR:    34; 0.001 FDR:    34
5:34:48.968493 PROGRESS: =========================================================================
5:34:48.969343 PROGRESS: === Epoch 14, step 3, extracting elution groups 7000 to 15000 ===
5:34:49.062994 PROGRESS: Extracting batch of 15815 precursors
5:34:49.068506 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:34:49.068578 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:34:49.068613 INFO: FWHM in RT is 14.83 seconds, sigma is 0.54
5:34:49.068655 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:34:49.068875 INFO: Starting candidate selection
5:34:53.706252 INFO: Starting candidate scoring
5:34:55.140728 INFO: Finished candidate processing
5:34:55.140867 INFO: Collecting candidate features
5:34:57.374121 WARNING: intensity_correlation has 24 NaNs ( 0.16 % out of 15028)
5:34:57.380123 INFO: Collecting fragment features
5:34:58.048642 INFO: Finished candidate scoring
5:34:58.346114 PROGRESS: === Epoch 14, step 3, extracted 15028 precursors and 79291 fragments ===
5:34:58.346468 INFO: performing precursor FDR with 47 features
5:34:58.346517 INFO: Decoy channel: -1
5:34:58.346544 INFO: Competetive: True
5:34:58.376349 WARNING: dropped 28 target PSMs due to missing features
5:34:58.376470 WARNING: dropped 20 decoy PSMs due to missing features
5:34:59.190896 INFO: Test AUC: 0.552
5:34:59.191039 INFO: Train AUC: 0.593
5:34:59.191104 INFO: AUC difference: 7.03%
5:34:59.191148 WARNING: AUC difference > 5%. This may indicate overfitting.
5:34:59.327764 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
5:34:59.328679 PROGRESS: ============================= Precursor FDR =============================
5:34:59.328814 PROGRESS: Total precursors accumulated: 286
5:34:59.328892 PROGRESS: Target precursors: 261 (91.26%)
5:34:59.328960 PROGRESS: Decoy precursors: 25 (8.74%)
5:34:59.329020 PROGRESS: 
5:34:59.329079 PROGRESS: Precursor Summary:
5:34:59.330616 PROGRESS: Channel   0:	 0.05 FDR:   111; 0.01 FDR:    93; 0.001 FDR:    93
5:34:59.330732 PROGRESS: 
5:34:59.330814 PROGRESS: Protein Summary:
5:34:59.332595 PROGRESS: Channel   0:	 0.05 FDR:   110; 0.01 FDR:    92; 0.001 FDR:    92
5:34:59.332708 PROGRESS: =========================================================================
5:34:59.333630 PROGRESS: === Epoch 14, step 4, extracting elution groups 15000 to 31000 ===
5:34:59.444250 PROGRESS: Extracting batch of 31597 precursors
5:34:59.454848 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:34:59.454946 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:34:59.454984 INFO: FWHM in RT is 14.83 seconds, sigma is 0.54
5:34:59.455012 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:34:59.455258 INFO: Starting candidate selection
5:35:04.424090 INFO: Starting candidate scoring
5:35:06.001632 INFO: Finished candidate processing
5:35:06.001726 INFO: Collecting candidate features
5:35:08.283990 WARNING: intensity_correlation has 40 NaNs ( 0.13 % out of 29971)
5:35:08.291135 INFO: Collecting fragment features
5:35:08.974946 INFO: Finished candidate scoring
5:35:09.290317 PROGRESS: === Epoch 14, step 4, extracted 29971 precursors and 158113 fragments ===
5:35:09.290646 INFO: performing precursor FDR with 47 features
5:35:09.290693 INFO: Decoy channel: -1
5:35:09.290720 INFO: Competetive: True
5:35:09.351221 WARNING: dropped 50 target PSMs due to missing features
5:35:09.351329 WARNING: dropped 38 decoy PSMs due to missing features
5:35:11.292305 INFO: Test AUC: 0.554
5:35:11.292479 INFO: Train AUC: 0.601
5:35:11.292530 INFO: AUC difference: 7.83%
5:35:11.292566 WARNING: AUC difference > 5%. This may indicate overfitting.
5:35:11.416375 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
5:35:11.417529 PROGRESS: ============================= Precursor FDR =============================
5:35:11.417679 PROGRESS: Total precursors accumulated: 937
5:35:11.417756 PROGRESS: Target precursors: 853 (91.04%)
5:35:11.417837 PROGRESS: Decoy precursors: 84 (8.96%)
5:35:11.417900 PROGRESS: 
5:35:11.417960 PROGRESS: Precursor Summary:
5:35:11.419636 PROGRESS: Channel   0:	 0.05 FDR:   427; 0.01 FDR:   241; 0.001 FDR:   211
5:35:11.419767 PROGRESS: 
5:35:11.419841 PROGRESS: Protein Summary:
5:35:11.421826 PROGRESS: Channel   0:	 0.05 FDR:   418; 0.01 FDR:   236; 0.001 FDR:   206
5:35:11.421938 PROGRESS: =========================================================================
5:35:11.422939 PROGRESS: === Epoch 14, step 5, extracting elution groups 31000 to 63000 ===
5:35:11.559311 PROGRESS: Extracting batch of 63209 precursors
5:35:11.579742 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:35:11.579846 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:35:11.579882 INFO: FWHM in RT is 14.83 seconds, sigma is 0.54
5:35:11.579925 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:35:11.580173 INFO: Starting candidate selection
5:35:17.231265 INFO: Starting candidate scoring
5:35:19.144671 INFO: Finished candidate processing
5:35:19.144769 INFO: Collecting candidate features
5:35:21.507841 WARNING: intensity_correlation has 75 NaNs ( 0.13 % out of 59905)
5:35:21.516719 INFO: Collecting fragment features
5:35:22.228147 INFO: Finished candidate scoring
5:35:22.576339 PROGRESS: === Epoch 14, step 5, extracted 59905 precursors and 315660 fragments ===
5:35:22.576698 INFO: performing precursor FDR with 47 features
5:35:22.576743 INFO: Decoy channel: -1
5:35:22.576770 INFO: Competetive: True
5:35:22.709937 WARNING: dropped 96 target PSMs due to missing features
5:35:22.710052 WARNING: dropped 67 decoy PSMs due to missing features
5:35:26.621827 INFO: Test AUC: 0.554
5:35:26.621964 INFO: Train AUC: 0.601
5:35:26.622010 INFO: AUC difference: 7.71%
5:35:26.622040 WARNING: AUC difference > 5%. This may indicate overfitting.
5:35:26.765258 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
5:35:26.766612 PROGRESS: ============================= Precursor FDR =============================
5:35:26.766739 PROGRESS: Total precursors accumulated: 1,355
5:35:26.766817 PROGRESS: Target precursors: 1,236 (91.22%)
5:35:26.766886 PROGRESS: Decoy precursors: 119 (8.78%)
5:35:26.766948 PROGRESS: 
5:35:26.767010 PROGRESS: Precursor Summary:
5:35:26.768933 PROGRESS: Channel   0:	 0.05 FDR:   917; 0.01 FDR:   513; 0.001 FDR:   376
5:35:26.769060 PROGRESS: 
5:35:26.769133 PROGRESS: Protein Summary:
5:35:26.771486 PROGRESS: Channel   0:	 0.05 FDR:   870; 0.01 FDR:   490; 0.001 FDR:   359
5:35:26.771597 PROGRESS: =========================================================================
5:35:26.772779 PROGRESS: === Epoch 14, step 6, extracting elution groups 63000 to 127000 ===
5:35:26.948071 PROGRESS: Extracting batch of 126526 precursors
5:35:26.985940 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:35:26.986071 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:35:26.986111 INFO: FWHM in RT is 14.83 seconds, sigma is 0.54
5:35:26.986139 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:35:26.986394 INFO: Starting candidate selection
5:35:33.912950 INFO: Starting candidate scoring
5:35:36.450235 INFO: Finished candidate processing
5:35:36.450386 INFO: Collecting candidate features
5:35:38.998362 WARNING: intensity_correlation has 181 NaNs ( 0.15 % out of 119972)
5:35:39.011292 INFO: Collecting fragment features
5:35:39.781047 INFO: Finished candidate scoring
5:35:40.204617 PROGRESS: === Epoch 14, step 6, extracted 119972 precursors and 631965 fragments ===
5:35:40.205014 INFO: performing precursor FDR with 47 features
5:35:40.205062 INFO: Decoy channel: -1
5:35:40.205088 INFO: Competetive: True
5:35:40.477972 WARNING: dropped 186 target PSMs due to missing features
5:35:40.478104 WARNING: dropped 158 decoy PSMs due to missing features
5:35:49.037309 INFO: Test AUC: 0.552
5:35:49.037440 INFO: Train AUC: 0.591
5:35:49.037497 INFO: AUC difference: 6.50%
5:35:49.037524 WARNING: AUC difference > 5%. This may indicate overfitting.
5:35:49.191954 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
5:35:49.193625 PROGRESS: ============================= Precursor FDR =============================
5:35:49.193774 PROGRESS: Total precursors accumulated: 2,380
5:35:49.193857 PROGRESS: Target precursors: 2,168 (91.09%)
5:35:49.193937 PROGRESS: Decoy precursors: 212 (8.91%)
5:35:49.194002 PROGRESS: 
5:35:49.194064 PROGRESS: Precursor Summary:
5:35:49.196240 PROGRESS: Channel   0:	 0.05 FDR: 1,486; 0.01 FDR:   890; 0.001 FDR:   452
5:35:49.196380 PROGRESS: 
5:35:49.196455 PROGRESS: Protein Summary:
5:35:49.199241 PROGRESS: Channel   0:	 0.05 FDR: 1,336; 0.01 FDR:   796; 0.001 FDR:   418
5:35:49.199374 PROGRESS: =========================================================================
5:35:49.200772 PROGRESS: === Epoch 14, step 7, extracting elution groups 127000 to 255000 ===
5:35:49.424866 PROGRESS: Extracting batch of 252936 precursors
5:35:49.497566 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:35:49.497681 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:35:49.497719 INFO: FWHM in RT is 14.83 seconds, sigma is 0.54
5:35:49.497762 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:35:49.498037 INFO: Starting candidate selection
5:35:59.018837 INFO: Starting candidate scoring
5:36:02.820075 INFO: Finished candidate processing
5:36:02.820316 INFO: Collecting candidate features
5:36:05.805544 WARNING: intensity_correlation has 340 NaNs ( 0.14 % out of 240222)
5:36:05.827431 INFO: Collecting fragment features
5:36:06.713043 INFO: Finished candidate scoring
5:36:07.301402 PROGRESS: === Epoch 14, step 7, extracted 240222 precursors and 1266954 fragments ===
5:36:07.301767 INFO: performing precursor FDR with 47 features
5:36:07.301828 INFO: Decoy channel: -1
5:36:07.301854 INFO: Competetive: True
5:36:07.914130 WARNING: dropped 352 target PSMs due to missing features
5:36:07.914256 WARNING: dropped 332 decoy PSMs due to missing features
5:36:25.326646 INFO: Test AUC: 0.546
5:36:25.326791 INFO: Train AUC: 0.579
5:36:25.326832 INFO: AUC difference: 5.56%
5:36:25.326860 WARNING: AUC difference > 5%. This may indicate overfitting.
5:36:25.538699 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
5:36:25.540897 PROGRESS: ============================= Precursor FDR =============================
5:36:25.541047 PROGRESS: Total precursors accumulated: 4,270
5:36:25.541125 PROGRESS: Target precursors: 3,887 (91.03%)
5:36:25.541193 PROGRESS: Decoy precursors: 383 (8.97%)
5:36:25.541256 PROGRESS: 
5:36:25.541316 PROGRESS: Precursor Summary:
5:36:25.544157 PROGRESS: Channel   0:	 0.05 FDR: 2,752; 0.01 FDR: 1,896; 0.001 FDR: 1,113
5:36:25.544290 PROGRESS: 
5:36:25.544363 PROGRESS: Protein Summary:
5:36:25.548094 PROGRESS: Channel   0:	 0.05 FDR: 2,223; 0.01 FDR: 1,500; 0.001 FDR:   921
5:36:25.548220 PROGRESS: =========================================================================
5:36:25.550120 PROGRESS: === Epoch 14, step 8, extracting elution groups 255000 to 511000 ===
5:36:25.859867 PROGRESS: Extracting batch of 505857 precursors
5:36:25.992034 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:36:25.992144 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:36:25.992184 INFO: FWHM in RT is 14.83 seconds, sigma is 0.54
5:36:25.992228 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:36:25.992493 INFO: Starting candidate selection
5:36:40.665174 INFO: Starting candidate scoring
5:36:46.948062 INFO: Finished candidate processing
5:36:46.948252 INFO: Collecting candidate features
5:36:50.607322 WARNING: intensity_correlation has 732 NaNs ( 0.15 % out of 480373)
5:36:50.643156 INFO: Collecting fragment features
5:36:51.711051 INFO: Finished candidate scoring
5:36:52.609138 PROGRESS: === Epoch 14, step 8, extracted 480373 precursors and 2529977 fragments ===
5:36:52.609502 INFO: performing precursor FDR with 47 features
5:36:52.609551 INFO: Decoy channel: -1
5:36:52.609579 INFO: Competetive: True
5:36:53.751396 WARNING: dropped 714 target PSMs due to missing features
5:36:53.751520 WARNING: dropped 702 decoy PSMs due to missing features
5:37:29.730917 INFO: Test AUC: 0.552
5:37:29.731047 INFO: Train AUC: 0.570
5:37:29.731112 INFO: AUC difference: 3.28%
5:37:29.993684 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
5:37:29.996828 PROGRESS: ============================= Precursor FDR =============================
5:37:29.996987 PROGRESS: Total precursors accumulated: 7,519
5:37:29.997066 PROGRESS: Target precursors: 6,853 (91.14%)
5:37:29.997131 PROGRESS: Decoy precursors: 666 (8.86%)
5:37:29.997192 PROGRESS: 
5:37:29.997252 PROGRESS: Precursor Summary:
5:37:30.000999 PROGRESS: Channel   0:	 0.05 FDR: 5,428; 0.01 FDR: 3,804; 0.001 FDR: 1,837
5:37:30.001149 PROGRESS: 
5:37:30.001222 PROGRESS: Protein Summary:
5:37:30.006608 PROGRESS: Channel   0:	 0.05 FDR: 3,755; 0.01 FDR: 2,533; 0.001 FDR: 1,375
5:37:30.006739 PROGRESS: =========================================================================
5:37:30.011370 INFO: calibration group: precursor, fitting rt estimator 
5:37:30.478336 INFO: calibration group: fragment, fitting mz estimator 
5:37:31.060616 INFO: === checking if epoch conditions were reached ===
5:37:31.060853 INFO: ✅ ms2_error      : 7.0000 <= 7
5:37:31.060944 INFO: ❌ rt_error       : 200.9560 > 100
5:37:31.061017 INFO: ✅ current_epoch  : 14 >= 3
5:37:31.061081 INFO: ==============================================
5:37:31.278649 INFO: calibration group: precursor, predicting mz
5:37:31.278940 WARNING: mz prediction was skipped as it has not been fitted yet
5:37:31.278984 INFO: calibration group: precursor, predicting rt
5:37:38.035734 INFO: calibration group: fragment, predicting mz
5:37:55.765431 PROGRESS: === Epoch 15, step 0, extracting elution groups 0 to 1000 ===
5:37:55.863571 PROGRESS: Extracting batch of 1979 precursors
5:37:55.865301 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:37:55.865377 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:37:55.865416 INFO: FWHM in RT is 14.73 seconds, sigma is 0.54
5:37:55.865461 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:37:55.865690 INFO: Starting candidate selection
5:38:00.638402 INFO: Starting candidate scoring
5:38:01.940230 INFO: Finished candidate processing
5:38:01.940316 INFO: Collecting candidate features
5:38:04.118659 WARNING: intensity_correlation has 3 NaNs ( 0.16 % out of 1887)
5:38:04.124474 INFO: Collecting fragment features
5:38:04.763760 INFO: Finished candidate scoring
5:38:05.091166 PROGRESS: === Epoch 15, step 0, extracted 1887 precursors and 9984 fragments ===
5:38:05.091490 INFO: performing precursor FDR with 47 features
5:38:05.091533 INFO: Decoy channel: -1
5:38:05.091559 INFO: Competetive: True
5:38:05.096198 WARNING: dropped 3 target PSMs due to missing features
5:38:05.127377 INFO: Test AUC: 0.579
5:38:05.127475 INFO: Train AUC: 0.547
5:38:05.127520 INFO: AUC difference: 5.80%
5:38:05.127555 WARNING: AUC difference > 5%. This may indicate overfitting.
5:38:05.248598 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
5:38:05.249357 PROGRESS: ============================= Precursor FDR =============================
5:38:05.249476 PROGRESS: Total precursors accumulated: 15
5:38:05.249554 PROGRESS: Target precursors: 14 (93.33%)
5:38:05.249623 PROGRESS: Decoy precursors: 1 (6.67%)
5:38:05.249685 PROGRESS: 
5:38:05.249747 PROGRESS: Precursor Summary:
5:38:05.251159 PROGRESS: Channel   0:	 0.05 FDR:    11; 0.01 FDR:    11; 0.001 FDR:    11
5:38:05.251268 PROGRESS: 
5:38:05.251357 PROGRESS: Protein Summary:
5:38:05.252935 PROGRESS: Channel   0:	 0.05 FDR:    10; 0.01 FDR:    10; 0.001 FDR:    10
5:38:05.253071 PROGRESS: =========================================================================
5:38:05.253931 PROGRESS: === Epoch 15, step 1, extracting elution groups 1000 to 3000 ===
5:38:05.331211 PROGRESS: Extracting batch of 3969 precursors
5:38:05.333363 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:38:05.333424 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:38:05.333462 INFO: FWHM in RT is 14.73 seconds, sigma is 0.54
5:38:05.333508 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:38:05.333718 INFO: Starting candidate selection
5:38:09.775008 INFO: Starting candidate scoring
5:38:11.109120 INFO: Finished candidate processing
5:38:11.109207 INFO: Collecting candidate features
5:38:13.294836 WARNING: intensity_correlation has 3 NaNs ( 0.08 % out of 3756)
5:38:13.301478 INFO: Collecting fragment features
5:38:13.943815 INFO: Finished candidate scoring
5:38:14.226795 PROGRESS: === Epoch 15, step 1, extracted 3756 precursors and 19747 fragments ===
5:38:14.227072 INFO: performing precursor FDR with 47 features
5:38:14.227118 INFO: Decoy channel: -1
5:38:14.227145 INFO: Competetive: True
5:38:14.235965 WARNING: dropped 5 target PSMs due to missing features
5:38:14.236053 WARNING: dropped 1 decoy PSMs due to missing features
5:38:14.273991 INFO: Test AUC: 0.556
5:38:14.274107 INFO: Train AUC: 0.547
5:38:14.274152 INFO: AUC difference: 1.67%
5:38:14.408964 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
5:38:14.409781 PROGRESS: ============================= Precursor FDR =============================
5:38:14.409907 PROGRESS: Total precursors accumulated: 30
5:38:14.409985 PROGRESS: Target precursors: 28 (93.33%)
5:38:14.410053 PROGRESS: Decoy precursors: 2 (6.67%)
5:38:14.410116 PROGRESS: 
5:38:14.410177 PROGRESS: Precursor Summary:
5:38:14.411602 PROGRESS: Channel   0:	 0.05 FDR:    22; 0.01 FDR:    22; 0.001 FDR:    22
5:38:14.411731 PROGRESS: 
5:38:14.411805 PROGRESS: Protein Summary:
5:38:14.413426 PROGRESS: Channel   0:	 0.05 FDR:    21; 0.01 FDR:    21; 0.001 FDR:    21
5:38:14.413567 PROGRESS: =========================================================================
5:38:14.414447 PROGRESS: === Epoch 15, step 2, extracting elution groups 3000 to 7000 ===
5:38:14.498371 PROGRESS: Extracting batch of 7901 precursors
5:38:14.501684 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:38:14.501749 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:38:14.501799 INFO: FWHM in RT is 14.73 seconds, sigma is 0.54
5:38:14.501862 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:38:14.502088 INFO: Starting candidate selection
5:38:19.030062 INFO: Starting candidate scoring
5:38:20.397354 INFO: Finished candidate processing
5:38:20.397446 INFO: Collecting candidate features
5:38:22.595240 WARNING: intensity_correlation has 7 NaNs ( 0.09 % out of 7469)
5:38:22.600853 INFO: Collecting fragment features
5:38:23.250017 INFO: Finished candidate scoring
5:38:23.537384 PROGRESS: === Epoch 15, step 2, extracted 7469 precursors and 39091 fragments ===
5:38:23.537709 INFO: performing precursor FDR with 47 features
5:38:23.537755 INFO: Decoy channel: -1
5:38:23.537789 INFO: Competetive: True
5:38:23.553467 WARNING: dropped 11 target PSMs due to missing features
5:38:23.553569 WARNING: dropped 2 decoy PSMs due to missing features
5:38:23.819337 INFO: Test AUC: 0.549
5:38:23.819472 INFO: Train AUC: 0.582
5:38:23.819517 INFO: AUC difference: 5.64%
5:38:23.819551 WARNING: AUC difference > 5%. This may indicate overfitting.
5:38:23.939353 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
5:38:23.940235 PROGRESS: ============================= Precursor FDR =============================
5:38:23.940362 PROGRESS: Total precursors accumulated: 117
5:38:23.940441 PROGRESS: Target precursors: 108 (92.31%)
5:38:23.940510 PROGRESS: Decoy precursors: 9 (7.69%)
5:38:23.940573 PROGRESS: 
5:38:23.940634 PROGRESS: Precursor Summary:
5:38:23.942158 PROGRESS: Channel   0:	 0.05 FDR:    89; 0.01 FDR:    64; 0.001 FDR:    64
5:38:23.942275 PROGRESS: 
5:38:23.942349 PROGRESS: Protein Summary:
5:38:23.944034 PROGRESS: Channel   0:	 0.05 FDR:    88; 0.01 FDR:    63; 0.001 FDR:    63
5:38:23.944162 PROGRESS: =========================================================================
5:38:23.945042 PROGRESS: === Epoch 15, step 3, extracting elution groups 7000 to 15000 ===
5:38:24.036484 PROGRESS: Extracting batch of 15824 precursors
5:38:24.049470 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:38:24.049548 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:38:24.049583 INFO: FWHM in RT is 14.73 seconds, sigma is 0.54
5:38:24.049625 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:38:24.049865 INFO: Starting candidate selection
5:38:28.720734 INFO: Starting candidate scoring
5:38:30.149486 INFO: Finished candidate processing
5:38:30.149648 INFO: Collecting candidate features
5:38:32.382788 WARNING: intensity_correlation has 13 NaNs ( 0.09 % out of 15049)
5:38:32.388790 INFO: Collecting fragment features
5:38:33.048357 INFO: Finished candidate scoring
5:38:33.345573 PROGRESS: === Epoch 15, step 3, extracted 15049 precursors and 79682 fragments ===
5:38:33.345946 INFO: performing precursor FDR with 47 features
5:38:33.345997 INFO: Decoy channel: -1
5:38:33.346023 INFO: Competetive: True
5:38:33.375840 WARNING: dropped 14 target PSMs due to missing features
5:38:33.375960 WARNING: dropped 12 decoy PSMs due to missing features
5:38:34.204454 INFO: Test AUC: 0.550
5:38:34.204613 INFO: Train AUC: 0.599
5:38:34.204679 INFO: AUC difference: 8.08%
5:38:34.204729 WARNING: AUC difference > 5%. This may indicate overfitting.
5:38:34.328839 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
5:38:34.329780 PROGRESS: ============================= Precursor FDR =============================
5:38:34.329918 PROGRESS: Total precursors accumulated: 331
5:38:34.329995 PROGRESS: Target precursors: 303 (91.54%)
5:38:34.330062 PROGRESS: Decoy precursors: 28 (8.46%)
5:38:34.330137 PROGRESS: 
5:38:34.330202 PROGRESS: Precursor Summary:
5:38:34.331730 PROGRESS: Channel   0:	 0.05 FDR:   206; 0.01 FDR:   103; 0.001 FDR:    99
5:38:34.331860 PROGRESS: 
5:38:34.331933 PROGRESS: Protein Summary:
5:38:34.333693 PROGRESS: Channel   0:	 0.05 FDR:   199; 0.01 FDR:    98; 0.001 FDR:    94
5:38:34.333827 PROGRESS: =========================================================================
5:38:34.334740 PROGRESS: === Epoch 15, step 4, extracting elution groups 15000 to 31000 ===
5:38:34.443437 PROGRESS: Extracting batch of 31632 precursors
5:38:34.453979 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:38:34.454079 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:38:34.454118 INFO: FWHM in RT is 14.73 seconds, sigma is 0.54
5:38:34.454146 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:38:34.454386 INFO: Starting candidate selection
5:38:39.457086 INFO: Starting candidate scoring
5:38:41.059643 INFO: Finished candidate processing
5:38:41.059737 INFO: Collecting candidate features
5:38:43.339345 WARNING: intensity_correlation has 45 NaNs ( 0.15 % out of 29932)
5:38:43.346382 INFO: Collecting fragment features
5:38:44.024926 INFO: Finished candidate scoring
5:38:44.340038 PROGRESS: === Epoch 15, step 4, extracted 29932 precursors and 157380 fragments ===
5:38:44.340380 INFO: performing precursor FDR with 47 features
5:38:44.340429 INFO: Decoy channel: -1
5:38:44.340455 INFO: Competetive: True
5:38:44.400869 WARNING: dropped 38 target PSMs due to missing features
5:38:44.400979 WARNING: dropped 33 decoy PSMs due to missing features
5:38:46.193537 INFO: Test AUC: 0.551
5:38:46.193693 INFO: Train AUC: 0.607
5:38:46.193740 INFO: AUC difference: 9.34%
5:38:46.193781 WARNING: AUC difference > 5%. This may indicate overfitting.
5:38:46.347845 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
5:38:46.348955 PROGRESS: ============================= Precursor FDR =============================
5:38:46.349080 PROGRESS: Total precursors accumulated: 734
5:38:46.349157 PROGRESS: Target precursors: 668 (91.01%)
5:38:46.349224 PROGRESS: Decoy precursors: 66 (8.99%)
5:38:46.349287 PROGRESS: 
5:38:46.349348 PROGRESS: Precursor Summary:
5:38:46.350974 PROGRESS: Channel   0:	 0.05 FDR:   325; 0.01 FDR:   155; 0.001 FDR:   134
5:38:46.351105 PROGRESS: 
5:38:46.351179 PROGRESS: Protein Summary:
5:38:46.353040 PROGRESS: Channel   0:	 0.05 FDR:   314; 0.01 FDR:   148; 0.001 FDR:   129
5:38:46.353148 PROGRESS: =========================================================================
5:38:46.354116 PROGRESS: === Epoch 15, step 5, extracting elution groups 31000 to 63000 ===
5:38:46.490772 PROGRESS: Extracting batch of 63241 precursors
5:38:46.510590 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:38:46.510716 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:38:46.510757 INFO: FWHM in RT is 14.73 seconds, sigma is 0.54
5:38:46.510785 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:38:46.511037 INFO: Starting candidate selection
5:38:52.127358 INFO: Starting candidate scoring
5:38:54.022255 INFO: Finished candidate processing
5:38:54.022346 INFO: Collecting candidate features
5:38:56.397340 WARNING: intensity_correlation has 77 NaNs ( 0.13 % out of 59914)
5:38:56.407164 INFO: Collecting fragment features
5:38:57.122886 INFO: Finished candidate scoring
5:38:57.474123 PROGRESS: === Epoch 15, step 5, extracted 59914 precursors and 316565 fragments ===
5:38:57.474485 INFO: performing precursor FDR with 47 features
5:38:57.474532 INFO: Decoy channel: -1
5:38:57.474559 INFO: Competetive: True
5:38:57.608845 WARNING: dropped 74 target PSMs due to missing features
5:38:57.608964 WARNING: dropped 74 decoy PSMs due to missing features
5:39:01.500443 INFO: Test AUC: 0.555
5:39:01.500566 INFO: Train AUC: 0.603
5:39:01.500625 INFO: AUC difference: 8.01%
5:39:01.500696 WARNING: AUC difference > 5%. This may indicate overfitting.
5:39:01.636869 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
5:39:01.638334 PROGRESS: ============================= Precursor FDR =============================
5:39:01.638466 PROGRESS: Total precursors accumulated: 1,551
5:39:01.638544 PROGRESS: Target precursors: 1,413 (91.10%)
5:39:01.638611 PROGRESS: Decoy precursors: 138 (8.90%)
5:39:01.638673 PROGRESS: 
5:39:01.638733 PROGRESS: Precursor Summary:
5:39:01.640641 PROGRESS: Channel   0:	 0.05 FDR:   944; 0.01 FDR:   454; 0.001 FDR:   336
5:39:01.640775 PROGRESS: 
5:39:01.640850 PROGRESS: Protein Summary:
5:39:01.643188 PROGRESS: Channel   0:	 0.05 FDR:   888; 0.01 FDR:   422; 0.001 FDR:   312
5:39:01.643303 PROGRESS: =========================================================================
5:39:01.644446 PROGRESS: === Epoch 15, step 6, extracting elution groups 63000 to 127000 ===
5:39:01.820922 PROGRESS: Extracting batch of 126442 precursors
5:39:01.859644 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:39:01.859760 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:39:01.859798 INFO: FWHM in RT is 14.73 seconds, sigma is 0.54
5:39:01.859840 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:39:01.860092 INFO: Starting candidate selection
5:39:08.783249 INFO: Starting candidate scoring
5:39:11.305656 INFO: Finished candidate processing
5:39:11.305994 INFO: Collecting candidate features
5:39:13.834000 WARNING: intensity_correlation has 143 NaNs ( 0.12 % out of 119732)
5:39:13.847716 INFO: Collecting fragment features
5:39:14.610641 INFO: Finished candidate scoring
5:39:15.038801 PROGRESS: === Epoch 15, step 6, extracted 119732 precursors and 631373 fragments ===
5:39:15.039204 INFO: performing precursor FDR with 47 features
5:39:15.039254 INFO: Decoy channel: -1
5:39:15.039280 INFO: Competetive: True
5:39:15.314734 WARNING: dropped 147 target PSMs due to missing features
5:39:15.314868 WARNING: dropped 144 decoy PSMs due to missing features
5:39:23.872715 INFO: Test AUC: 0.557
5:39:23.872842 INFO: Train AUC: 0.589
5:39:23.872897 INFO: AUC difference: 5.50%
5:39:23.872925 WARNING: AUC difference > 5%. This may indicate overfitting.
5:39:24.028605 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
5:39:24.030427 PROGRESS: ============================= Precursor FDR =============================
5:39:24.030561 PROGRESS: Total precursors accumulated: 2,709
5:39:24.030638 PROGRESS: Target precursors: 2,467 (91.07%)
5:39:24.030706 PROGRESS: Decoy precursors: 242 (8.93%)
5:39:24.030769 PROGRESS: 
5:39:24.030830 PROGRESS: Precursor Summary:
5:39:24.033040 PROGRESS: Channel   0:	 0.05 FDR: 1,461; 0.01 FDR:   910; 0.001 FDR:   720
5:39:24.033182 PROGRESS: 
5:39:24.033256 PROGRESS: Protein Summary:
5:39:24.036113 PROGRESS: Channel   0:	 0.05 FDR: 1,308; 0.01 FDR:   805; 0.001 FDR:   635
5:39:24.036228 PROGRESS: =========================================================================
5:39:24.037633 PROGRESS: === Epoch 15, step 7, extracting elution groups 127000 to 255000 ===
5:39:24.263655 PROGRESS: Extracting batch of 252826 precursors
5:39:24.336727 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:39:24.336842 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:39:24.336882 INFO: FWHM in RT is 14.73 seconds, sigma is 0.54
5:39:24.336924 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:39:24.337195 INFO: Starting candidate selection
5:39:33.861934 INFO: Starting candidate scoring
5:39:37.678647 INFO: Finished candidate processing
5:39:37.678836 INFO: Collecting candidate features
5:39:40.656054 WARNING: intensity_correlation has 376 NaNs ( 0.16 % out of 239559)
5:39:40.677140 INFO: Collecting fragment features
5:39:41.563329 INFO: Finished candidate scoring
5:39:42.157049 PROGRESS: === Epoch 15, step 7, extracted 239559 precursors and 1264127 fragments ===
5:39:42.157411 INFO: performing precursor FDR with 47 features
5:39:42.157455 INFO: Decoy channel: -1
5:39:42.157481 INFO: Competetive: True
5:39:42.766592 WARNING: dropped 340 target PSMs due to missing features
5:39:42.766718 WARNING: dropped 327 decoy PSMs due to missing features
5:40:00.114819 INFO: Test AUC: 0.554
5:40:00.114950 INFO: Train AUC: 0.579
5:40:00.115005 INFO: AUC difference: 4.42%
5:40:00.298667 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
5:40:00.300948 PROGRESS: ============================= Precursor FDR =============================
5:40:00.301079 PROGRESS: Total precursors accumulated: 4,449
5:40:00.301173 PROGRESS: Target precursors: 4,055 (91.14%)
5:40:00.301241 PROGRESS: Decoy precursors: 394 (8.86%)
5:40:00.301304 PROGRESS: 
5:40:00.301364 PROGRESS: Precursor Summary:
5:40:00.304151 PROGRESS: Channel   0:	 0.05 FDR: 2,963; 0.01 FDR: 1,825; 0.001 FDR: 1,205
5:40:00.304291 PROGRESS: 
5:40:00.304363 PROGRESS: Protein Summary:
5:40:00.308100 PROGRESS: Channel   0:	 0.05 FDR: 2,448; 0.01 FDR: 1,459; 0.001 FDR:   972
5:40:00.308227 PROGRESS: =========================================================================
5:40:00.310083 PROGRESS: === Epoch 15, step 8, extracting elution groups 255000 to 511000 ===
5:40:00.613571 PROGRESS: Extracting batch of 505809 precursors
5:40:00.745158 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:40:00.745270 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:40:00.745308 INFO: FWHM in RT is 14.73 seconds, sigma is 0.54
5:40:00.745351 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:40:00.745619 INFO: Starting candidate selection
5:40:15.437214 INFO: Starting candidate scoring
5:40:21.714715 INFO: Finished candidate processing
5:40:21.714907 INFO: Collecting candidate features
5:40:25.406100 WARNING: intensity_correlation has 667 NaNs ( 0.14 % out of 478832)
5:40:25.440102 INFO: Collecting fragment features
5:40:26.522980 INFO: Finished candidate scoring
5:40:27.431592 PROGRESS: === Epoch 15, step 8, extracted 478832 precursors and 2523781 fragments ===
5:40:27.431959 INFO: performing precursor FDR with 47 features
5:40:27.438673 INFO: Decoy channel: -1
5:40:27.438787 INFO: Competetive: True
5:40:28.614819 WARNING: dropped 685 target PSMs due to missing features
5:40:28.614954 WARNING: dropped 649 decoy PSMs due to missing features
5:41:04.681312 INFO: Test AUC: 0.553
5:41:04.681452 INFO: Train AUC: 0.570
5:41:04.681504 INFO: AUC difference: 2.98%
5:41:04.924284 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
5:41:04.927287 PROGRESS: ============================= Precursor FDR =============================
5:41:04.927448 PROGRESS: Total precursors accumulated: 7,287
5:41:04.927526 PROGRESS: Target precursors: 6,646 (91.20%)
5:41:04.927593 PROGRESS: Decoy precursors: 641 (8.80%)
5:41:04.927655 PROGRESS: 
5:41:04.927714 PROGRESS: Precursor Summary:
5:41:04.931469 PROGRESS: Channel   0:	 0.05 FDR: 5,146; 0.01 FDR: 3,820; 0.001 FDR: 2,418
5:41:04.931625 PROGRESS: 
5:41:04.931697 PROGRESS: Protein Summary:
5:41:04.937015 PROGRESS: Channel   0:	 0.05 FDR: 3,551; 0.01 FDR: 2,562; 0.001 FDR: 1,700
5:41:04.937127 PROGRESS: =========================================================================
5:41:04.941673 INFO: calibration group: precursor, fitting rt estimator 
5:41:05.395828 INFO: calibration group: fragment, fitting mz estimator 
5:41:05.979973 INFO: === checking if epoch conditions were reached ===
5:41:05.980157 INFO: ✅ ms2_error      : 7.0000 <= 7
5:41:05.980234 INFO: ❌ rt_error       : 201.3659 > 100
5:41:05.980297 INFO: ✅ current_epoch  : 15 >= 3
5:41:05.980355 INFO: ==============================================
5:41:06.221858 INFO: calibration group: precursor, predicting mz
5:41:06.222152 WARNING: mz prediction was skipped as it has not been fitted yet
5:41:06.222193 INFO: calibration group: precursor, predicting rt
5:41:12.963561 INFO: calibration group: fragment, predicting mz
5:41:30.704326 PROGRESS: === Epoch 16, step 0, extracting elution groups 0 to 1000 ===
5:41:30.802774 PROGRESS: Extracting batch of 1976 precursors
5:41:30.804525 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:41:30.804597 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:41:30.804648 INFO: FWHM in RT is 14.87 seconds, sigma is 0.54
5:41:30.804693 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:41:30.804922 INFO: Starting candidate selection
5:41:35.533532 INFO: Starting candidate scoring
5:41:36.814330 INFO: Finished candidate processing
5:41:36.814421 INFO: Collecting candidate features
5:41:38.965191 WARNING: intensity_correlation has 2 NaNs ( 0.11 % out of 1884)
5:41:38.971177 INFO: Collecting fragment features
5:41:39.608613 INFO: Finished candidate scoring
5:41:39.952086 PROGRESS: === Epoch 16, step 0, extracted 1884 precursors and 9974 fragments ===
5:41:39.952418 INFO: performing precursor FDR with 47 features
5:41:39.952461 INFO: Decoy channel: -1
5:41:39.952487 INFO: Competetive: True
5:41:39.957076 WARNING: dropped 2 decoy PSMs due to missing features
5:41:39.985969 INFO: Test AUC: 0.555
5:41:39.986066 INFO: Train AUC: 0.539
5:41:39.986110 INFO: AUC difference: 2.83%
5:41:40.106817 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
5:41:40.107623 PROGRESS: ============================= Precursor FDR =============================
5:41:40.107743 PROGRESS: Total precursors accumulated: 5
5:41:40.107821 PROGRESS: Target precursors: 5 (100.00%)
5:41:40.107892 PROGRESS: Decoy precursors: 0 (0.00%)
5:41:40.107957 PROGRESS: 
5:41:40.108018 PROGRESS: Precursor Summary:
5:41:40.109492 PROGRESS: Channel   0:	 0.05 FDR:     5; 0.01 FDR:     5; 0.001 FDR:     5
5:41:40.109627 PROGRESS: 
5:41:40.109702 PROGRESS: Protein Summary:
5:41:40.111376 PROGRESS: Channel   0:	 0.05 FDR:     5; 0.01 FDR:     5; 0.001 FDR:     5
5:41:40.111487 PROGRESS: =========================================================================
5:41:40.112365 PROGRESS: === Epoch 16, step 1, extracting elution groups 1000 to 3000 ===
5:41:40.189726 PROGRESS: Extracting batch of 3951 precursors
5:41:40.191858 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:41:40.191917 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:41:40.191955 INFO: FWHM in RT is 14.87 seconds, sigma is 0.54
5:41:40.192000 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:41:40.192208 INFO: Starting candidate selection
5:41:44.645125 INFO: Starting candidate scoring
5:41:45.989723 INFO: Finished candidate processing
5:41:45.989825 INFO: Collecting candidate features
5:41:48.149100 WARNING: intensity_correlation has 8 NaNs ( 0.21 % out of 3727)
5:41:48.156113 INFO: Collecting fragment features
5:41:48.798562 INFO: Finished candidate scoring
5:41:49.078334 PROGRESS: === Epoch 16, step 1, extracted 3727 precursors and 19775 fragments ===
5:41:49.078619 INFO: performing precursor FDR with 47 features
5:41:49.078664 INFO: Decoy channel: -1
5:41:49.078691 INFO: Competetive: True
5:41:49.087374 WARNING: dropped 3 target PSMs due to missing features
5:41:49.087461 WARNING: dropped 7 decoy PSMs due to missing features
5:41:49.124434 INFO: Test AUC: 0.582
5:41:49.124548 INFO: Train AUC: 0.540
5:41:49.124594 INFO: AUC difference: 7.84%
5:41:49.124629 WARNING: AUC difference > 5%. This may indicate overfitting.
5:41:49.244612 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
5:41:49.245386 PROGRESS: ============================= Precursor FDR =============================
5:41:49.245511 PROGRESS: Total precursors accumulated: 29
5:41:49.245590 PROGRESS: Target precursors: 27 (93.10%)
5:41:49.245659 PROGRESS: Decoy precursors: 2 (6.90%)
5:41:49.245722 PROGRESS: 
5:41:49.245791 PROGRESS: Precursor Summary:
5:41:49.247218 PROGRESS: Channel   0:	 0.05 FDR:    27; 0.01 FDR:    27; 0.001 FDR:    27
5:41:49.247344 PROGRESS: 
5:41:49.247418 PROGRESS: Protein Summary:
5:41:49.249031 PROGRESS: Channel   0:	 0.05 FDR:    27; 0.01 FDR:    27; 0.001 FDR:    27
5:41:49.249141 PROGRESS: =========================================================================
5:41:49.250012 PROGRESS: === Epoch 16, step 2, extracting elution groups 3000 to 7000 ===
5:41:49.331905 PROGRESS: Extracting batch of 7905 precursors
5:41:49.335238 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:41:49.335313 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:41:49.335371 INFO: FWHM in RT is 14.87 seconds, sigma is 0.54
5:41:49.335402 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:41:49.335623 INFO: Starting candidate selection
5:41:53.853873 INFO: Starting candidate scoring
5:41:55.212152 INFO: Finished candidate processing
5:41:55.212352 INFO: Collecting candidate features
5:41:57.413346 WARNING: intensity_correlation has 11 NaNs ( 0.15 % out of 7515)
5:41:57.419066 INFO: Collecting fragment features
5:41:58.070683 INFO: Finished candidate scoring
5:41:58.358432 PROGRESS: === Epoch 16, step 2, extracted 7515 precursors and 39581 fragments ===
5:41:58.358746 INFO: performing precursor FDR with 47 features
5:41:58.358794 INFO: Decoy channel: -1
5:41:58.358820 INFO: Competetive: True
5:41:58.374268 WARNING: dropped 10 target PSMs due to missing features
5:41:58.374387 WARNING: dropped 11 decoy PSMs due to missing features
5:41:58.642845 INFO: Test AUC: 0.545
5:41:58.642981 INFO: Train AUC: 0.583
5:41:58.643027 INFO: AUC difference: 6.55%
5:41:58.643061 WARNING: AUC difference > 5%. This may indicate overfitting.
5:41:58.761724 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
5:41:58.762587 PROGRESS: ============================= Precursor FDR =============================
5:41:58.762710 PROGRESS: Total precursors accumulated: 85
5:41:58.762789 PROGRESS: Target precursors: 78 (91.76%)
5:41:58.762857 PROGRESS: Decoy precursors: 7 (8.24%)
5:41:58.762920 PROGRESS: 
5:41:58.762982 PROGRESS: Precursor Summary:
5:41:58.764430 PROGRESS: Channel   0:	 0.05 FDR:    55; 0.01 FDR:    48; 0.001 FDR:    48
5:41:58.764560 PROGRESS: 
5:41:58.764636 PROGRESS: Protein Summary:
5:41:58.766313 PROGRESS: Channel   0:	 0.05 FDR:    55; 0.01 FDR:    48; 0.001 FDR:    48
5:41:58.766427 PROGRESS: =========================================================================
5:41:58.767302 PROGRESS: === Epoch 16, step 3, extracting elution groups 7000 to 15000 ===
5:41:58.859922 PROGRESS: Extracting batch of 15804 precursors
5:41:58.867195 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:41:58.867277 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:41:58.867311 INFO: FWHM in RT is 14.87 seconds, sigma is 0.54
5:41:58.867337 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:41:58.867551 INFO: Starting candidate selection
5:42:03.577035 INFO: Starting candidate scoring
5:42:05.029692 INFO: Finished candidate processing
5:42:05.029933 INFO: Collecting candidate features
5:42:07.261342 WARNING: intensity_correlation has 26 NaNs ( 0.17 % out of 14949)
5:42:07.267464 INFO: Collecting fragment features
5:42:07.934423 INFO: Finished candidate scoring
5:42:08.231470 PROGRESS: === Epoch 16, step 3, extracted 14949 precursors and 78750 fragments ===
5:42:08.231823 INFO: performing precursor FDR with 47 features
5:42:08.231874 INFO: Decoy channel: -1
5:42:08.231901 INFO: Competetive: True
5:42:08.261443 WARNING: dropped 21 target PSMs due to missing features
5:42:08.261554 WARNING: dropped 26 decoy PSMs due to missing features
5:42:09.005918 INFO: Test AUC: 0.559
5:42:09.006072 INFO: Train AUC: 0.599
5:42:09.006134 INFO: AUC difference: 6.73%
5:42:09.006178 WARNING: AUC difference > 5%. This may indicate overfitting.
5:42:09.130441 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
5:42:09.131347 PROGRESS: ============================= Precursor FDR =============================
5:42:09.131490 PROGRESS: Total precursors accumulated: 185
5:42:09.131597 PROGRESS: Target precursors: 169 (91.35%)
5:42:09.131685 PROGRESS: Decoy precursors: 16 (8.65%)
5:42:09.131765 PROGRESS: 
5:42:09.131841 PROGRESS: Precursor Summary:
5:42:09.133320 PROGRESS: Channel   0:	 0.05 FDR:   108; 0.01 FDR:    78; 0.001 FDR:    78
5:42:09.133444 PROGRESS: 
5:42:09.133543 PROGRESS: Protein Summary:
5:42:09.135872 PROGRESS: Channel   0:	 0.05 FDR:   108; 0.01 FDR:    78; 0.001 FDR:    78
5:42:09.136003 PROGRESS: =========================================================================
5:42:09.137042 PROGRESS: === Epoch 16, step 4, extracting elution groups 15000 to 31000 ===
5:42:09.245761 PROGRESS: Extracting batch of 31637 precursors
5:42:09.256559 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:42:09.256658 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:42:09.256699 INFO: FWHM in RT is 14.87 seconds, sigma is 0.54
5:42:09.256737 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:42:09.256989 INFO: Starting candidate selection
5:42:14.250243 INFO: Starting candidate scoring
5:42:15.843184 INFO: Finished candidate processing
5:42:15.843292 INFO: Collecting candidate features
5:42:18.113750 WARNING: intensity_correlation has 48 NaNs ( 0.16 % out of 29910)
5:42:18.120726 INFO: Collecting fragment features
5:42:18.797661 INFO: Finished candidate scoring
5:42:19.108980 PROGRESS: === Epoch 16, step 4, extracted 29910 precursors and 157497 fragments ===
5:42:19.109341 INFO: performing precursor FDR with 47 features
5:42:19.109390 INFO: Decoy channel: -1
5:42:19.109416 INFO: Competetive: True
5:42:19.167607 WARNING: dropped 39 target PSMs due to missing features
5:42:19.167719 WARNING: dropped 56 decoy PSMs due to missing features
5:42:21.084189 INFO: Test AUC: 0.553
5:42:21.084346 INFO: Train AUC: 0.609
5:42:21.084392 INFO: AUC difference: 9.30%
5:42:21.084426 WARNING: AUC difference > 5%. This may indicate overfitting.
5:42:21.216021 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
5:42:21.217057 PROGRESS: ============================= Precursor FDR =============================
5:42:21.217181 PROGRESS: Total precursors accumulated: 518
5:42:21.217257 PROGRESS: Target precursors: 474 (91.51%)
5:42:21.217325 PROGRESS: Decoy precursors: 44 (8.49%)
5:42:21.217389 PROGRESS: 
5:42:21.217451 PROGRESS: Precursor Summary:
5:42:21.219095 PROGRESS: Channel   0:	 0.05 FDR:   304; 0.01 FDR:   243; 0.001 FDR:   200
5:42:21.219235 PROGRESS: 
5:42:21.219312 PROGRESS: Protein Summary:
5:42:21.221211 PROGRESS: Channel   0:	 0.05 FDR:   295; 0.01 FDR:   235; 0.001 FDR:   193
5:42:21.221338 PROGRESS: =========================================================================
5:42:21.222343 PROGRESS: === Epoch 16, step 5, extracting elution groups 31000 to 63000 ===
5:42:21.358230 PROGRESS: Extracting batch of 63202 precursors
5:42:21.378475 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:42:21.378600 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:42:21.378641 INFO: FWHM in RT is 14.87 seconds, sigma is 0.54
5:42:21.378668 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:42:21.378923 INFO: Starting candidate selection
5:42:27.016154 INFO: Starting candidate scoring
5:42:28.898434 INFO: Finished candidate processing
5:42:28.898526 INFO: Collecting candidate features
5:42:31.270751 WARNING: intensity_correlation has 79 NaNs ( 0.13 % out of 59888)
5:42:31.279660 INFO: Collecting fragment features
5:42:32.002182 INFO: Finished candidate scoring
5:42:32.352833 PROGRESS: === Epoch 16, step 5, extracted 59888 precursors and 314933 fragments ===
5:42:32.353194 INFO: performing precursor FDR with 47 features
5:42:32.353240 INFO: Decoy channel: -1
5:42:32.353266 INFO: Competetive: True
5:42:32.489954 WARNING: dropped 87 target PSMs due to missing features
5:42:32.490070 WARNING: dropped 87 decoy PSMs due to missing features
5:42:36.495874 INFO: Test AUC: 0.548
5:42:36.495992 INFO: Train AUC: 0.603
5:42:36.496046 INFO: AUC difference: 9.08%
5:42:36.502899 WARNING: AUC difference > 5%. This may indicate overfitting.
5:42:36.642027 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
5:42:36.643303 PROGRESS: ============================= Precursor FDR =============================
5:42:36.643425 PROGRESS: Total precursors accumulated: 1,268
5:42:36.643501 PROGRESS: Target precursors: 1,157 (91.25%)
5:42:36.643569 PROGRESS: Decoy precursors: 111 (8.75%)
5:42:36.643629 PROGRESS: 
5:42:36.643687 PROGRESS: Precursor Summary:
5:42:36.645518 PROGRESS: Channel   0:	 0.05 FDR:   686; 0.01 FDR:   481; 0.001 FDR:   445
5:42:36.645630 PROGRESS: 
5:42:36.645701 PROGRESS: Protein Summary:
5:42:36.647948 PROGRESS: Channel   0:	 0.05 FDR:   647; 0.01 FDR:   457; 0.001 FDR:   425
5:42:36.648075 PROGRESS: =========================================================================
5:42:36.649221 PROGRESS: === Epoch 16, step 6, extracting elution groups 63000 to 127000 ===
5:42:36.825760 PROGRESS: Extracting batch of 126454 precursors
5:42:36.864434 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:42:36.864562 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:42:36.864603 INFO: FWHM in RT is 14.87 seconds, sigma is 0.54
5:42:36.864632 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:42:36.864894 INFO: Starting candidate selection
5:42:43.776072 INFO: Starting candidate scoring
5:42:46.304771 INFO: Finished candidate processing
5:42:46.304955 INFO: Collecting candidate features
5:42:48.836813 WARNING: intensity_correlation has 181 NaNs ( 0.15 % out of 119757)
5:42:48.850766 INFO: Collecting fragment features
5:42:49.623252 INFO: Finished candidate scoring
5:42:50.046577 PROGRESS: === Epoch 16, step 6, extracted 119757 precursors and 630545 fragments ===
5:42:50.046934 INFO: performing precursor FDR with 47 features
5:42:50.046981 INFO: Decoy channel: -1
5:42:50.047008 INFO: Competetive: True
5:42:50.321115 WARNING: dropped 169 target PSMs due to missing features
5:42:50.321229 WARNING: dropped 186 decoy PSMs due to missing features
5:42:58.785143 INFO: Test AUC: 0.554
5:42:58.785268 INFO: Train AUC: 0.589
5:42:58.785324 INFO: AUC difference: 6.07%
5:42:58.785354 WARNING: AUC difference > 5%. This may indicate overfitting.
5:42:58.939621 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
5:42:58.941383 PROGRESS: ============================= Precursor FDR =============================
5:42:58.941525 PROGRESS: Total precursors accumulated: 2,727
5:42:58.941604 PROGRESS: Target precursors: 2,489 (91.27%)
5:42:58.941671 PROGRESS: Decoy precursors: 238 (8.73%)
5:42:58.941734 PROGRESS: 
5:42:58.941829 PROGRESS: Precursor Summary:
5:42:58.944047 PROGRESS: Channel   0:	 0.05 FDR: 1,489; 0.01 FDR:   985; 0.001 FDR:   755
5:42:58.944188 PROGRESS: 
5:42:58.944263 PROGRESS: Protein Summary:
5:42:58.947156 PROGRESS: Channel   0:	 0.05 FDR: 1,340; 0.01 FDR:   885; 0.001 FDR:   685
5:42:58.947268 PROGRESS: =========================================================================
5:42:58.948713 PROGRESS: === Epoch 16, step 7, extracting elution groups 127000 to 255000 ===
5:42:59.173925 PROGRESS: Extracting batch of 252937 precursors
5:42:59.246058 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:42:59.246191 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:42:59.246232 INFO: FWHM in RT is 14.87 seconds, sigma is 0.54
5:42:59.246261 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:42:59.246522 INFO: Starting candidate selection
5:43:08.762656 INFO: Starting candidate scoring
5:43:12.573090 INFO: Finished candidate processing
5:43:12.573273 INFO: Collecting candidate features
5:43:15.516699 WARNING: intensity_correlation has 368 NaNs ( 0.15 % out of 239583)
5:43:15.538396 INFO: Collecting fragment features
5:43:16.411185 INFO: Finished candidate scoring
5:43:16.994454 PROGRESS: === Epoch 16, step 7, extracted 239583 precursors and 1265673 fragments ===
5:43:16.994809 INFO: performing precursor FDR with 47 features
5:43:16.994855 INFO: Decoy channel: -1
5:43:16.994881 INFO: Competetive: True
5:43:17.589855 WARNING: dropped 341 target PSMs due to missing features
5:43:17.589979 WARNING: dropped 382 decoy PSMs due to missing features
5:43:34.993230 INFO: Test AUC: 0.548
5:43:34.993357 INFO: Train AUC: 0.578
5:43:34.993414 INFO: AUC difference: 5.22%
5:43:34.993441 WARNING: AUC difference > 5%. This may indicate overfitting.
5:43:35.177791 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
5:43:35.180012 PROGRESS: ============================= Precursor FDR =============================
5:43:35.180159 PROGRESS: Total precursors accumulated: 4,401
5:43:35.180249 PROGRESS: Target precursors: 4,013 (91.18%)
5:43:35.180316 PROGRESS: Decoy precursors: 388 (8.82%)
5:43:35.180377 PROGRESS: 
5:43:35.180435 PROGRESS: Precursor Summary:
5:43:35.183114 PROGRESS: Channel   0:	 0.05 FDR: 2,912; 0.01 FDR: 1,937; 0.001 FDR: 1,166
5:43:35.183227 PROGRESS: 
5:43:35.183314 PROGRESS: Protein Summary:
5:43:35.187023 PROGRESS: Channel   0:	 0.05 FDR: 2,373; 0.01 FDR: 1,560; 0.001 FDR:   977
5:43:35.187150 PROGRESS: =========================================================================
5:43:35.188983 PROGRESS: === Epoch 16, step 8, extracting elution groups 255000 to 511000 ===
5:43:35.491536 PROGRESS: Extracting batch of 505846 precursors
5:43:35.623052 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:43:35.623166 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:43:35.623227 INFO: FWHM in RT is 14.87 seconds, sigma is 0.54
5:43:35.623259 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:43:35.623517 INFO: Starting candidate selection
5:43:50.352664 INFO: Starting candidate scoring
5:43:56.649370 INFO: Finished candidate processing
5:43:56.649561 INFO: Collecting candidate features
5:44:00.300833 WARNING: intensity_correlation has 742 NaNs ( 0.15 % out of 479017)
5:44:00.334622 INFO: Collecting fragment features
5:44:01.399736 INFO: Finished candidate scoring
5:44:02.288108 PROGRESS: === Epoch 16, step 8, extracted 479017 precursors and 2531104 fragments ===
5:44:02.288471 INFO: performing precursor FDR with 47 features
5:44:02.295210 INFO: Decoy channel: -1
5:44:02.295365 INFO: Competetive: True
5:44:03.435905 WARNING: dropped 736 target PSMs due to missing features
5:44:03.436031 WARNING: dropped 729 decoy PSMs due to missing features
5:44:38.226825 INFO: Test AUC: 0.552
5:44:38.226983 INFO: Train AUC: 0.569
5:44:38.227024 INFO: AUC difference: 2.99%
5:44:38.466330 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
5:44:38.469416 PROGRESS: ============================= Precursor FDR =============================
5:44:38.469572 PROGRESS: Total precursors accumulated: 7,664
5:44:38.469649 PROGRESS: Target precursors: 6,983 (91.11%)
5:44:38.469715 PROGRESS: Decoy precursors: 681 (8.89%)
5:44:38.469784 PROGRESS: 
5:44:38.469866 PROGRESS: Precursor Summary:
5:44:38.473531 PROGRESS: Channel   0:	 0.05 FDR: 5,408; 0.01 FDR: 3,623; 0.001 FDR: 2,177
5:44:38.473685 PROGRESS: 
5:44:38.473777 PROGRESS: Protein Summary:
5:44:38.479191 PROGRESS: Channel   0:	 0.05 FDR: 3,792; 0.01 FDR: 2,456; 0.001 FDR: 1,587
5:44:38.479307 PROGRESS: =========================================================================
5:44:38.483718 INFO: calibration group: precursor, fitting rt estimator 
5:44:38.911036 INFO: calibration group: fragment, fitting mz estimator 
5:44:39.509369 INFO: === checking if epoch conditions were reached ===
5:44:39.509569 INFO: ✅ ms2_error      : 7.0000 <= 7
5:44:39.509659 INFO: ❌ rt_error       : 202.7148 > 100
5:44:39.509733 INFO: ✅ current_epoch  : 16 >= 3
5:44:39.509808 INFO: ==============================================
5:44:39.729658 INFO: calibration group: precursor, predicting mz
5:44:39.729942 WARNING: mz prediction was skipped as it has not been fitted yet
5:44:39.729986 INFO: calibration group: precursor, predicting rt
5:44:46.494903 INFO: calibration group: fragment, predicting mz
5:45:04.141515 PROGRESS: === Epoch 17, step 0, extracting elution groups 0 to 1000 ===
5:45:04.241090 PROGRESS: Extracting batch of 1980 precursors
5:45:04.242875 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:45:04.242948 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:45:04.242988 INFO: FWHM in RT is 14.95 seconds, sigma is 0.54
5:45:04.243036 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:45:04.243267 INFO: Starting candidate selection
5:45:08.974978 INFO: Starting candidate scoring
5:45:10.256541 INFO: Finished candidate processing
5:45:10.256648 INFO: Collecting candidate features
5:45:12.407292 WARNING: intensity_correlation has 1 NaNs ( 0.05 % out of 1880)
5:45:12.413309 INFO: Collecting fragment features
5:45:13.044865 INFO: Finished candidate scoring
5:45:13.388350 PROGRESS: === Epoch 17, step 0, extracted 1880 precursors and 9854 fragments ===
5:45:13.388673 INFO: performing precursor FDR with 47 features
5:45:13.388716 INFO: Decoy channel: -1
5:45:13.388742 INFO: Competetive: True
5:45:13.393310 WARNING: dropped 1 target PSMs due to missing features
5:45:13.421203 INFO: Test AUC: 0.556
5:45:13.421298 INFO: Train AUC: 0.570
5:45:13.421345 INFO: AUC difference: 2.39%
5:45:13.542891 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
5:45:13.543651 PROGRESS: ============================= Precursor FDR =============================
5:45:13.543773 PROGRESS: Total precursors accumulated: 20
5:45:13.543850 PROGRESS: Target precursors: 19 (95.00%)
5:45:13.543930 PROGRESS: Decoy precursors: 1 (5.00%)
5:45:13.543994 PROGRESS: 
5:45:13.544056 PROGRESS: Precursor Summary:
5:45:13.545459 PROGRESS: Channel   0:	 0.05 FDR:    15; 0.01 FDR:    15; 0.001 FDR:    15
5:45:13.545588 PROGRESS: 
5:45:13.545660 PROGRESS: Protein Summary:
5:45:13.547256 PROGRESS: Channel   0:	 0.05 FDR:    15; 0.01 FDR:    15; 0.001 FDR:    15
5:45:13.547367 PROGRESS: =========================================================================
5:45:13.548214 PROGRESS: === Epoch 17, step 1, extracting elution groups 1000 to 3000 ===
5:45:13.625669 PROGRESS: Extracting batch of 3952 precursors
5:45:13.627731 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:45:13.627787 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:45:13.627824 INFO: FWHM in RT is 14.95 seconds, sigma is 0.54
5:45:13.627868 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:45:13.628073 INFO: Starting candidate selection
5:45:18.088861 INFO: Starting candidate scoring
5:45:19.419661 INFO: Finished candidate processing
5:45:19.419840 INFO: Collecting candidate features
5:45:21.604218 WARNING: intensity_correlation has 5 NaNs ( 0.13 % out of 3744)
5:45:21.611238 INFO: Collecting fragment features
5:45:22.252861 INFO: Finished candidate scoring
5:45:22.535106 PROGRESS: === Epoch 17, step 1, extracted 3744 precursors and 19779 fragments ===
5:45:22.535395 INFO: performing precursor FDR with 47 features
5:45:22.535442 INFO: Decoy channel: -1
5:45:22.535469 INFO: Competetive: True
5:45:22.544318 WARNING: dropped 4 target PSMs due to missing features
5:45:22.544410 WARNING: dropped 2 decoy PSMs due to missing features
5:45:22.582219 INFO: Test AUC: 0.564
5:45:22.582339 INFO: Train AUC: 0.554
5:45:22.582385 INFO: AUC difference: 1.79%
5:45:22.704623 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
5:45:22.705416 PROGRESS: ============================= Precursor FDR =============================
5:45:22.705537 PROGRESS: Total precursors accumulated: 41
5:45:22.705616 PROGRESS: Target precursors: 38 (92.68%)
5:45:22.705684 PROGRESS: Decoy precursors: 3 (7.32%)
5:45:22.705747 PROGRESS: 
5:45:22.705821 PROGRESS: Precursor Summary:
5:45:22.707254 PROGRESS: Channel   0:	 0.05 FDR:    34; 0.01 FDR:    31; 0.001 FDR:    31
5:45:22.707381 PROGRESS: 
5:45:22.707455 PROGRESS: Protein Summary:
5:45:22.709092 PROGRESS: Channel   0:	 0.05 FDR:    34; 0.01 FDR:    31; 0.001 FDR:    31
5:45:22.709221 PROGRESS: =========================================================================
5:45:22.710094 PROGRESS: === Epoch 17, step 2, extracting elution groups 3000 to 7000 ===
5:45:22.792579 PROGRESS: Extracting batch of 7894 precursors
5:45:22.795789 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:45:22.795851 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:45:22.795889 INFO: FWHM in RT is 14.95 seconds, sigma is 0.54
5:45:22.795934 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:45:22.796145 INFO: Starting candidate selection
5:45:27.317417 INFO: Starting candidate scoring
5:45:28.670241 INFO: Finished candidate processing
5:45:28.670328 INFO: Collecting candidate features
5:45:30.836639 WARNING: intensity_correlation has 4 NaNs ( 0.05 % out of 7489)
5:45:30.842137 INFO: Collecting fragment features
5:45:31.485764 INFO: Finished candidate scoring
5:45:31.770672 PROGRESS: === Epoch 17, step 2, extracted 7489 precursors and 39452 fragments ===
5:45:31.770995 INFO: performing precursor FDR with 47 features
5:45:31.771041 INFO: Decoy channel: -1
5:45:31.771066 INFO: Competetive: True
5:45:31.785880 WARNING: dropped 6 target PSMs due to missing features
5:45:31.785977 WARNING: dropped 4 decoy PSMs due to missing features
5:45:32.028597 INFO: Test AUC: 0.542
5:45:32.028726 INFO: Train AUC: 0.583
5:45:32.028772 INFO: AUC difference: 7.12%
5:45:32.028806 WARNING: AUC difference > 5%. This may indicate overfitting.
5:45:32.148435 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
5:45:32.149272 PROGRESS: ============================= Precursor FDR =============================
5:45:32.149391 PROGRESS: Total precursors accumulated: 103
5:45:32.149469 PROGRESS: Target precursors: 94 (91.26%)
5:45:32.149537 PROGRESS: Decoy precursors: 9 (8.74%)
5:45:32.149601 PROGRESS: 
5:45:32.149663 PROGRESS: Precursor Summary:
5:45:32.151145 PROGRESS: Channel   0:	 0.05 FDR:    74; 0.01 FDR:    63; 0.001 FDR:    63
5:45:32.151274 PROGRESS: 
5:45:32.151348 PROGRESS: Protein Summary:
5:45:32.153011 PROGRESS: Channel   0:	 0.05 FDR:    74; 0.01 FDR:    63; 0.001 FDR:    63
5:45:32.153121 PROGRESS: =========================================================================
5:45:32.154008 PROGRESS: === Epoch 17, step 3, extracting elution groups 7000 to 15000 ===
5:45:32.246335 PROGRESS: Extracting batch of 15802 precursors
5:45:32.251684 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:45:32.251749 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:45:32.251782 INFO: FWHM in RT is 14.95 seconds, sigma is 0.54
5:45:32.251823 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:45:32.252040 INFO: Starting candidate selection
5:45:36.939284 INFO: Starting candidate scoring
5:45:38.379806 INFO: Finished candidate processing
5:45:38.379971 INFO: Collecting candidate features
5:45:40.583388 WARNING: intensity_correlation has 34 NaNs ( 0.23 % out of 15042)
5:45:40.589296 INFO: Collecting fragment features
5:45:41.244410 INFO: Finished candidate scoring
5:45:41.537808 PROGRESS: === Epoch 17, step 3, extracted 15042 precursors and 79482 fragments ===
5:45:41.538184 INFO: performing precursor FDR with 47 features
5:45:41.538233 INFO: Decoy channel: -1
5:45:41.538260 INFO: Competetive: True
5:45:41.566906 WARNING: dropped 19 target PSMs due to missing features
5:45:41.567020 WARNING: dropped 25 decoy PSMs due to missing features
5:45:42.350538 INFO: Test AUC: 0.541
5:45:42.350679 INFO: Train AUC: 0.599
5:45:42.350726 INFO: AUC difference: 9.67%
5:45:42.350761 WARNING: AUC difference > 5%. This may indicate overfitting.
5:45:42.473784 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
5:45:42.474720 PROGRESS: ============================= Precursor FDR =============================
5:45:42.474843 PROGRESS: Total precursors accumulated: 284
5:45:42.474922 PROGRESS: Target precursors: 259 (91.20%)
5:45:42.474991 PROGRESS: Decoy precursors: 25 (8.80%)
5:45:42.475054 PROGRESS: 
5:45:42.475114 PROGRESS: Precursor Summary:
5:45:42.476640 PROGRESS: Channel   0:	 0.05 FDR:   164; 0.01 FDR:   112; 0.001 FDR:    96
5:45:42.476768 PROGRESS: 
5:45:42.476843 PROGRESS: Protein Summary:
5:45:42.478624 PROGRESS: Channel   0:	 0.05 FDR:   161; 0.01 FDR:   111; 0.001 FDR:    95
5:45:42.478735 PROGRESS: =========================================================================
5:45:42.479656 PROGRESS: === Epoch 17, step 4, extracting elution groups 15000 to 31000 ===
5:45:42.587632 PROGRESS: Extracting batch of 31648 precursors
5:45:42.598066 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:45:42.598161 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:45:42.598214 INFO: FWHM in RT is 14.95 seconds, sigma is 0.54
5:45:42.598243 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:45:42.598482 INFO: Starting candidate selection
5:45:47.624695 INFO: Starting candidate scoring
5:45:49.233030 INFO: Finished candidate processing
5:45:49.233169 INFO: Collecting candidate features
5:45:51.493707 WARNING: intensity_correlation has 42 NaNs ( 0.14 % out of 30027)
5:45:51.501121 INFO: Collecting fragment features
5:45:52.175043 INFO: Finished candidate scoring
5:45:52.485504 PROGRESS: === Epoch 17, step 4, extracted 30027 precursors and 158648 fragments ===
5:45:52.485866 INFO: performing precursor FDR with 47 features
5:45:52.492805 INFO: Decoy channel: -1
5:45:52.492955 INFO: Competetive: True
5:45:52.552666 WARNING: dropped 43 target PSMs due to missing features
5:45:52.552776 WARNING: dropped 43 decoy PSMs due to missing features
5:45:54.426824 INFO: Test AUC: 0.549
5:45:54.426971 INFO: Train AUC: 0.607
5:45:54.427018 INFO: AUC difference: 9.61%
5:45:54.427053 WARNING: AUC difference > 5%. This may indicate overfitting.
5:45:59.651950 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
5:45:59.653163 PROGRESS: ============================= Precursor FDR =============================
5:45:59.653318 PROGRESS: Total precursors accumulated: 732
5:45:59.653394 PROGRESS: Target precursors: 667 (91.12%)
5:45:59.653461 PROGRESS: Decoy precursors: 65 (8.88%)
5:45:59.653537 PROGRESS: 
5:45:59.653599 PROGRESS: Precursor Summary:
5:45:59.655369 PROGRESS: Channel   0:	 0.05 FDR:   456; 0.01 FDR:   230; 0.001 FDR:   175
5:45:59.655515 PROGRESS: 
5:45:59.655590 PROGRESS: Protein Summary:
5:45:59.657640 PROGRESS: Channel   0:	 0.05 FDR:   443; 0.01 FDR:   223; 0.001 FDR:   170
5:45:59.657777 PROGRESS: =========================================================================
5:45:59.658841 PROGRESS: === Epoch 17, step 5, extracting elution groups 31000 to 63000 ===
5:45:59.795805 PROGRESS: Extracting batch of 63202 precursors
5:45:59.815991 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:45:59.816120 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:45:59.816161 INFO: FWHM in RT is 14.95 seconds, sigma is 0.54
5:45:59.816187 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:45:59.816444 INFO: Starting candidate selection
5:46:05.552999 INFO: Starting candidate scoring
5:46:07.452407 INFO: Finished candidate processing
5:46:07.452595 INFO: Collecting candidate features
5:46:09.829665 WARNING: intensity_correlation has 120 NaNs ( 0.20 % out of 60010)
5:46:09.838440 INFO: Collecting fragment features
5:46:10.556845 INFO: Finished candidate scoring
5:46:10.921533 PROGRESS: === Epoch 17, step 5, extracted 60010 precursors and 316474 fragments ===
5:46:10.921969 INFO: performing precursor FDR with 47 features
5:46:10.922019 INFO: Decoy channel: -1
5:46:10.922045 INFO: Competetive: True
5:46:11.059597 WARNING: dropped 110 target PSMs due to missing features
5:46:11.059713 WARNING: dropped 96 decoy PSMs due to missing features
5:46:15.053735 INFO: Test AUC: 0.562
5:46:15.053886 INFO: Train AUC: 0.600
5:46:15.053934 INFO: AUC difference: 6.29%
5:46:15.053963 WARNING: AUC difference > 5%. This may indicate overfitting.
5:46:15.194153 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
5:46:15.195763 PROGRESS: ============================= Precursor FDR =============================
5:46:15.195950 PROGRESS: Total precursors accumulated: 1,797
5:46:15.196031 PROGRESS: Target precursors: 1,636 (91.04%)
5:46:15.196098 PROGRESS: Decoy precursors: 161 (8.96%)
5:46:15.196162 PROGRESS: 
5:46:15.196222 PROGRESS: Precursor Summary:
5:46:15.198335 PROGRESS: Channel   0:	 0.05 FDR:   912; 0.01 FDR:   605; 0.001 FDR:   380
5:46:15.198473 PROGRESS: 
5:46:15.198547 PROGRESS: Protein Summary:
5:46:15.201082 PROGRESS: Channel   0:	 0.05 FDR:   866; 0.01 FDR:   570; 0.001 FDR:   358
5:46:15.201224 PROGRESS: =========================================================================
5:46:15.202551 PROGRESS: === Epoch 17, step 6, extracting elution groups 63000 to 127000 ===
5:46:15.379051 PROGRESS: Extracting batch of 126467 precursors
5:46:15.418753 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:46:15.418870 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:46:15.418909 INFO: FWHM in RT is 14.95 seconds, sigma is 0.54
5:46:15.418936 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:46:15.419203 INFO: Starting candidate selection
5:46:22.483889 INFO: Starting candidate scoring
5:46:25.023081 INFO: Finished candidate processing
5:46:25.023260 INFO: Collecting candidate features
5:46:27.585165 WARNING: intensity_correlation has 186 NaNs ( 0.16 % out of 119669)
5:46:27.599289 INFO: Collecting fragment features
5:46:28.378771 INFO: Finished candidate scoring
5:46:28.816560 PROGRESS: === Epoch 17, step 6, extracted 119669 precursors and 631696 fragments ===
5:46:28.816949 INFO: performing precursor FDR with 47 features
5:46:28.816998 INFO: Decoy channel: -1
5:46:28.817025 INFO: Competetive: True
5:46:29.097151 WARNING: dropped 204 target PSMs due to missing features
5:46:29.097262 WARNING: dropped 188 decoy PSMs due to missing features
5:46:38.202558 INFO: Test AUC: 0.555
5:46:38.202703 INFO: Train AUC: 0.589
5:46:38.202743 INFO: AUC difference: 5.79%
5:46:38.202771 WARNING: AUC difference > 5%. This may indicate overfitting.
5:46:38.362521 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
5:46:38.364434 PROGRESS: ============================= Precursor FDR =============================
5:46:38.364595 PROGRESS: Total precursors accumulated: 2,701
5:46:38.364676 PROGRESS: Target precursors: 2,458 (91.00%)
5:46:38.364748 PROGRESS: Decoy precursors: 243 (9.00%)
5:46:38.364810 PROGRESS: 
5:46:38.364871 PROGRESS: Precursor Summary:
5:46:38.367341 PROGRESS: Channel   0:	 0.05 FDR: 1,624; 0.01 FDR:   912; 0.001 FDR:   807
5:46:38.367497 PROGRESS: 
5:46:38.367572 PROGRESS: Protein Summary:
5:46:38.370710 PROGRESS: Channel   0:	 0.05 FDR: 1,485; 0.01 FDR:   808; 0.001 FDR:   716
5:46:38.370830 PROGRESS: =========================================================================
5:46:38.372321 PROGRESS: === Epoch 17, step 7, extracting elution groups 127000 to 255000 ===
5:46:38.597338 PROGRESS: Extracting batch of 252928 precursors
5:46:38.670135 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:46:38.670249 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:46:38.670289 INFO: FWHM in RT is 14.95 seconds, sigma is 0.54
5:46:38.670316 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:46:38.670592 INFO: Starting candidate selection
5:46:48.323109 INFO: Starting candidate scoring
5:46:52.122627 INFO: Finished candidate processing
5:46:52.122812 INFO: Collecting candidate features
5:46:55.103750 WARNING: intensity_correlation has 414 NaNs ( 0.17 % out of 239545)
5:46:55.125360 INFO: Collecting fragment features
5:46:56.022418 INFO: Finished candidate scoring
5:46:56.619438 PROGRESS: === Epoch 17, step 7, extracted 239545 precursors and 1263572 fragments ===
5:46:56.619819 INFO: performing precursor FDR with 47 features
5:46:56.619865 INFO: Decoy channel: -1
5:46:56.619892 INFO: Competetive: True
5:46:57.234959 WARNING: dropped 415 target PSMs due to missing features
5:46:57.235081 WARNING: dropped 391 decoy PSMs due to missing features
5:47:15.255485 INFO: Test AUC: 0.551
5:47:15.255614 INFO: Train AUC: 0.577
5:47:15.255671 INFO: AUC difference: 4.59%
5:47:15.454067 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
5:47:15.456671 PROGRESS: ============================= Precursor FDR =============================
5:47:15.456848 PROGRESS: Total precursors accumulated: 4,707
5:47:15.456927 PROGRESS: Target precursors: 4,292 (91.18%)
5:47:15.456992 PROGRESS: Decoy precursors: 415 (8.82%)
5:47:15.457053 PROGRESS: 
5:47:15.457111 PROGRESS: Precursor Summary:
5:47:15.460245 PROGRESS: Channel   0:	 0.05 FDR: 3,009; 0.01 FDR: 1,844; 0.001 FDR: 1,409
5:47:15.460421 PROGRESS: 
5:47:15.460495 PROGRESS: Protein Summary:
5:47:15.464658 PROGRESS: Channel   0:	 0.05 FDR: 2,493; 0.01 FDR: 1,494; 0.001 FDR: 1,139
5:47:15.464803 PROGRESS: =========================================================================
5:47:15.466826 PROGRESS: === Epoch 17, step 8, extracting elution groups 255000 to 511000 ===
5:47:15.774630 PROGRESS: Extracting batch of 505770 precursors
5:47:15.909368 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:47:15.909485 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:47:15.909524 INFO: FWHM in RT is 14.95 seconds, sigma is 0.54
5:47:15.909567 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:47:15.909870 INFO: Starting candidate selection
5:47:30.750698 INFO: Starting candidate scoring
5:47:37.029256 INFO: Finished candidate processing
5:47:37.029449 INFO: Collecting candidate features
5:47:40.723465 WARNING: intensity_correlation has 830 NaNs ( 0.17 % out of 479020)
5:47:40.758229 INFO: Collecting fragment features
5:47:41.843337 INFO: Finished candidate scoring
5:47:42.751797 PROGRESS: === Epoch 17, step 8, extracted 479020 precursors and 2524454 fragments ===
5:47:42.752226 INFO: performing precursor FDR with 47 features
5:47:42.752270 INFO: Decoy channel: -1
5:47:42.752296 INFO: Competetive: True
5:47:43.919737 WARNING: dropped 844 target PSMs due to missing features
5:47:43.919861 WARNING: dropped 792 decoy PSMs due to missing features
5:48:20.006474 INFO: Test AUC: 0.552
5:48:20.006606 INFO: Train AUC: 0.568
5:48:20.006647 INFO: AUC difference: 2.80%
5:48:20.251636 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
5:48:20.254886 PROGRESS: ============================= Precursor FDR =============================
5:48:20.255069 PROGRESS: Total precursors accumulated: 7,515
5:48:20.255149 PROGRESS: Target precursors: 6,850 (91.15%)
5:48:20.255220 PROGRESS: Decoy precursors: 665 (8.85%)
5:48:20.255283 PROGRESS: 
5:48:20.255355 PROGRESS: Precursor Summary:
5:48:20.259448 PROGRESS: Channel   0:	 0.05 FDR: 5,109; 0.01 FDR: 3,821; 0.001 FDR: 2,653
5:48:20.259661 PROGRESS: 
5:48:20.259735 PROGRESS: Protein Summary:
5:48:20.265541 PROGRESS: Channel   0:	 0.05 FDR: 3,511; 0.01 FDR: 2,574; 0.001 FDR: 1,864
5:48:20.265704 PROGRESS: =========================================================================
5:48:20.270495 INFO: calibration group: precursor, fitting rt estimator 
5:48:20.723276 INFO: calibration group: fragment, fitting mz estimator 
5:48:21.313874 INFO: === checking if epoch conditions were reached ===
5:48:21.314052 INFO: ✅ ms2_error      : 7.0000 <= 7
5:48:21.314226 INFO: ❌ rt_error       : 198.6081 > 100
5:48:21.314304 INFO: ✅ current_epoch  : 17 >= 3
5:48:21.314369 INFO: ==============================================
5:48:21.530742 INFO: calibration group: precursor, predicting mz
5:48:21.531092 WARNING: mz prediction was skipped as it has not been fitted yet
5:48:21.531135 INFO: calibration group: precursor, predicting rt
5:48:28.297364 INFO: calibration group: fragment, predicting mz
5:48:46.138802 PROGRESS: === Epoch 18, step 0, extracting elution groups 0 to 1000 ===
5:48:46.238035 PROGRESS: Extracting batch of 1981 precursors
5:48:46.239941 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:48:46.240016 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:48:46.240055 INFO: FWHM in RT is 14.96 seconds, sigma is 0.54
5:48:46.240100 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:48:46.240335 INFO: Starting candidate selection
5:48:51.088036 INFO: Starting candidate scoring
5:48:52.374215 INFO: Finished candidate processing
5:48:52.374302 INFO: Collecting candidate features
5:48:54.554528 WARNING: intensity_correlation has 8 NaNs ( 0.43 % out of 1880)
5:48:54.560777 INFO: Collecting fragment features
5:48:55.209324 INFO: Finished candidate scoring
5:48:55.557016 PROGRESS: === Epoch 18, step 0, extracted 1880 precursors and 9782 fragments ===
5:48:55.557363 INFO: performing precursor FDR with 47 features
5:48:55.557415 INFO: Decoy channel: -1
5:48:55.557442 INFO: Competetive: True
5:48:55.562810 WARNING: dropped 4 target PSMs due to missing features
5:48:55.562896 WARNING: dropped 4 decoy PSMs due to missing features
5:48:55.592273 INFO: Test AUC: 0.509
5:48:55.592374 INFO: Train AUC: 0.542
5:48:55.592419 INFO: AUC difference: 6.20%
5:48:55.592453 WARNING: AUC difference > 5%. This may indicate overfitting.
5:48:55.713306 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
5:48:55.714424 PROGRESS: ============================= Precursor FDR =============================
5:48:55.714598 PROGRESS: Total precursors accumulated: 26
5:48:55.714715 PROGRESS: Target precursors: 24 (92.31%)
5:48:55.714819 PROGRESS: Decoy precursors: 2 (7.69%)
5:48:55.714915 PROGRESS: 
5:48:55.715008 PROGRESS: Precursor Summary:
5:48:55.716705 PROGRESS: Channel   0:	 0.05 FDR:    13; 0.01 FDR:    13; 0.001 FDR:    13
5:48:55.716833 PROGRESS: 
5:48:55.716906 PROGRESS: Protein Summary:
5:48:55.718505 PROGRESS: Channel   0:	 0.05 FDR:    13; 0.01 FDR:    13; 0.001 FDR:    13
5:48:55.718618 PROGRESS: =========================================================================
5:48:55.719468 PROGRESS: === Epoch 18, step 1, extracting elution groups 1000 to 3000 ===
5:48:55.796609 PROGRESS: Extracting batch of 3950 precursors
5:48:55.799047 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:48:55.799107 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:48:55.799160 INFO: FWHM in RT is 14.96 seconds, sigma is 0.54
5:48:55.799189 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:48:55.799407 INFO: Starting candidate selection
5:49:00.340000 INFO: Starting candidate scoring
5:49:01.678546 INFO: Finished candidate processing
5:49:01.678735 INFO: Collecting candidate features
5:49:03.845829 WARNING: intensity_correlation has 8 NaNs ( 0.21 % out of 3753)
5:49:03.852610 INFO: Collecting fragment features
5:49:04.495550 INFO: Finished candidate scoring
5:49:04.778484 PROGRESS: === Epoch 18, step 1, extracted 3753 precursors and 19734 fragments ===
5:49:04.778798 INFO: performing precursor FDR with 47 features
5:49:04.778848 INFO: Decoy channel: -1
5:49:04.778875 INFO: Competetive: True
5:49:04.788053 WARNING: dropped 9 target PSMs due to missing features
5:49:04.788142 WARNING: dropped 7 decoy PSMs due to missing features
5:49:04.827068 INFO: Test AUC: 0.545
5:49:04.827189 INFO: Train AUC: 0.535
5:49:04.827234 INFO: AUC difference: 1.90%
5:49:04.948470 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
5:49:04.949258 PROGRESS: ============================= Precursor FDR =============================
5:49:04.949382 PROGRESS: Total precursors accumulated: 28
5:49:04.949462 PROGRESS: Target precursors: 26 (92.86%)
5:49:04.949531 PROGRESS: Decoy precursors: 2 (7.14%)
5:49:04.949594 PROGRESS: 
5:49:04.949656 PROGRESS: Precursor Summary:
5:49:04.951093 PROGRESS: Channel   0:	 0.05 FDR:    25; 0.01 FDR:    25; 0.001 FDR:    25
5:49:04.951223 PROGRESS: 
5:49:04.951299 PROGRESS: Protein Summary:
5:49:04.952892 PROGRESS: Channel   0:	 0.05 FDR:    25; 0.01 FDR:    25; 0.001 FDR:    25
5:49:04.953017 PROGRESS: =========================================================================
5:49:04.953874 PROGRESS: === Epoch 18, step 2, extracting elution groups 3000 to 7000 ===
5:49:05.035800 PROGRESS: Extracting batch of 7902 precursors
5:49:05.039337 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:49:05.039399 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:49:05.039438 INFO: FWHM in RT is 14.96 seconds, sigma is 0.54
5:49:05.039483 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:49:05.039707 INFO: Starting candidate selection
5:49:09.595722 INFO: Starting candidate scoring
5:49:10.944573 INFO: Finished candidate processing
5:49:10.944671 INFO: Collecting candidate features
5:49:13.120844 WARNING: intensity_correlation has 9 NaNs ( 0.12 % out of 7465)
5:49:13.126702 INFO: Collecting fragment features
5:49:13.773836 INFO: Finished candidate scoring
5:49:14.061781 PROGRESS: === Epoch 18, step 2, extracted 7465 precursors and 39505 fragments ===
5:49:14.062155 INFO: performing precursor FDR with 47 features
5:49:14.062199 INFO: Decoy channel: -1
5:49:14.062226 INFO: Competetive: True
5:49:14.078347 WARNING: dropped 12 target PSMs due to missing features
5:49:14.078450 WARNING: dropped 13 decoy PSMs due to missing features
5:49:14.368409 INFO: Test AUC: 0.534
5:49:14.368543 INFO: Train AUC: 0.576
5:49:14.368591 INFO: AUC difference: 7.30%
5:49:14.368626 WARNING: AUC difference > 5%. This may indicate overfitting.
5:49:14.491019 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
5:49:14.491917 PROGRESS: ============================= Precursor FDR =============================
5:49:14.492037 PROGRESS: Total precursors accumulated: 132
5:49:14.492115 PROGRESS: Target precursors: 121 (91.67%)
5:49:14.492182 PROGRESS: Decoy precursors: 11 (8.33%)
5:49:14.492245 PROGRESS: 
5:49:14.492306 PROGRESS: Precursor Summary:
5:49:14.493833 PROGRESS: Channel   0:	 0.05 FDR:    67; 0.01 FDR:    51; 0.001 FDR:    51
5:49:14.493965 PROGRESS: 
5:49:14.494040 PROGRESS: Protein Summary:
5:49:14.495745 PROGRESS: Channel   0:	 0.05 FDR:    67; 0.01 FDR:    51; 0.001 FDR:    51
5:49:14.495875 PROGRESS: =========================================================================
5:49:14.496773 PROGRESS: === Epoch 18, step 3, extracting elution groups 7000 to 15000 ===
5:49:14.588908 PROGRESS: Extracting batch of 15819 precursors
5:49:14.594978 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:49:14.595057 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:49:14.595091 INFO: FWHM in RT is 14.96 seconds, sigma is 0.54
5:49:14.596956 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:49:14.597555 INFO: Starting candidate selection
5:49:19.313585 INFO: Starting candidate scoring
5:49:20.738412 INFO: Finished candidate processing
5:49:20.738586 INFO: Collecting candidate features
5:49:22.971405 WARNING: intensity_correlation has 28 NaNs ( 0.19 % out of 15002)
5:49:22.977451 INFO: Collecting fragment features
5:49:23.642366 INFO: Finished candidate scoring
5:49:23.943942 PROGRESS: === Epoch 18, step 3, extracted 15002 precursors and 78922 fragments ===
5:49:23.944359 INFO: performing precursor FDR with 47 features
5:49:23.944410 INFO: Decoy channel: -1
5:49:23.944436 INFO: Competetive: True
5:49:23.975413 WARNING: dropped 28 target PSMs due to missing features
5:49:23.975539 WARNING: dropped 25 decoy PSMs due to missing features
5:49:24.757571 INFO: Test AUC: 0.536
5:49:24.757720 INFO: Train AUC: 0.597
5:49:24.757766 INFO: AUC difference: 10.25%
5:49:24.757811 WARNING: AUC difference > 5%. This may indicate overfitting.
5:49:24.883415 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
5:49:24.884440 PROGRESS: ============================= Precursor FDR =============================
5:49:24.884566 PROGRESS: Total precursors accumulated: 274
5:49:24.884644 PROGRESS: Target precursors: 250 (91.24%)
5:49:24.884711 PROGRESS: Decoy precursors: 24 (8.76%)
5:49:24.884773 PROGRESS: 
5:49:24.884833 PROGRESS: Precursor Summary:
5:49:24.886459 PROGRESS: Channel   0:	 0.05 FDR:   184; 0.01 FDR:   114; 0.001 FDR:   111
5:49:24.886578 PROGRESS: 
5:49:24.886655 PROGRESS: Protein Summary:
5:49:24.888484 PROGRESS: Channel   0:	 0.05 FDR:   182; 0.01 FDR:   113; 0.001 FDR:   110
5:49:24.888596 PROGRESS: =========================================================================
5:49:24.889533 PROGRESS: === Epoch 18, step 4, extracting elution groups 15000 to 31000 ===
5:49:24.998018 PROGRESS: Extracting batch of 31637 precursors
5:49:25.008903 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:49:25.009016 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:49:25.009055 INFO: FWHM in RT is 14.96 seconds, sigma is 0.54
5:49:25.009083 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:49:25.009331 INFO: Starting candidate selection
5:49:30.062036 INFO: Starting candidate scoring
5:49:31.658274 INFO: Finished candidate processing
5:49:31.658385 INFO: Collecting candidate features
5:49:33.910606 WARNING: intensity_correlation has 39 NaNs ( 0.13 % out of 30091)
5:49:33.917508 INFO: Collecting fragment features
5:49:34.607916 INFO: Finished candidate scoring
5:49:34.924016 PROGRESS: === Epoch 18, step 4, extracted 30091 precursors and 159484 fragments ===
5:49:34.924393 INFO: performing precursor FDR with 47 features
5:49:34.924445 INFO: Decoy channel: -1
5:49:34.924471 INFO: Competetive: True
5:49:34.985054 WARNING: dropped 45 target PSMs due to missing features
5:49:34.985163 WARNING: dropped 47 decoy PSMs due to missing features
5:49:36.922386 INFO: Test AUC: 0.553
5:49:36.922537 INFO: Train AUC: 0.601
5:49:36.922583 INFO: AUC difference: 7.99%
5:49:36.922617 WARNING: AUC difference > 5%. This may indicate overfitting.
5:49:37.052537 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
5:49:37.053709 PROGRESS: ============================= Precursor FDR =============================
5:49:37.053891 PROGRESS: Total precursors accumulated: 709
5:49:37.053975 PROGRESS: Target precursors: 646 (91.11%)
5:49:37.054044 PROGRESS: Decoy precursors: 63 (8.89%)
5:49:37.054108 PROGRESS: 
5:49:37.054168 PROGRESS: Precursor Summary:
5:49:37.055919 PROGRESS: Channel   0:	 0.05 FDR:   379; 0.01 FDR:   235; 0.001 FDR:   154
5:49:37.056052 PROGRESS: 
5:49:37.056125 PROGRESS: Protein Summary:
5:49:37.058160 PROGRESS: Channel   0:	 0.05 FDR:   364; 0.01 FDR:   224; 0.001 FDR:   148
5:49:37.058277 PROGRESS: =========================================================================
5:49:37.059329 PROGRESS: === Epoch 18, step 5, extracting elution groups 31000 to 63000 ===
5:49:37.196707 PROGRESS: Extracting batch of 63228 precursors
5:49:37.217154 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:49:37.217264 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:49:37.217317 INFO: FWHM in RT is 14.96 seconds, sigma is 0.54
5:49:37.217344 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:49:37.217605 INFO: Starting candidate selection
5:49:42.917333 INFO: Starting candidate scoring
5:49:44.818720 INFO: Finished candidate processing
5:49:44.818859 INFO: Collecting candidate features
5:49:47.195785 WARNING: intensity_correlation has 100 NaNs ( 0.17 % out of 59976)
5:49:47.205281 INFO: Collecting fragment features
5:49:47.926439 INFO: Finished candidate scoring
5:49:48.284890 PROGRESS: === Epoch 18, step 5, extracted 59976 precursors and 316290 fragments ===
5:49:48.285285 INFO: performing precursor FDR with 47 features
5:49:48.285331 INFO: Decoy channel: -1
5:49:48.285357 INFO: Competetive: True
5:49:48.423955 WARNING: dropped 97 target PSMs due to missing features
5:49:48.424074 WARNING: dropped 95 decoy PSMs due to missing features
5:49:52.381500 INFO: Test AUC: 0.552
5:49:52.381621 INFO: Train AUC: 0.601
5:49:52.381699 INFO: AUC difference: 8.15%
5:49:52.381730 WARNING: AUC difference > 5%. This may indicate overfitting.
5:49:52.518492 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
5:49:52.520051 PROGRESS: ============================= Precursor FDR =============================
5:49:52.520201 PROGRESS: Total precursors accumulated: 1,657
5:49:52.520279 PROGRESS: Target precursors: 1,512 (91.25%)
5:49:52.520349 PROGRESS: Decoy precursors: 145 (8.75%)
5:49:52.520414 PROGRESS: 
5:49:52.520475 PROGRESS: Precursor Summary:
5:49:52.522527 PROGRESS: Channel   0:	 0.05 FDR:   774; 0.01 FDR:   417; 0.001 FDR:   228
5:49:52.522655 PROGRESS: 
5:49:52.522730 PROGRESS: Protein Summary:
5:49:52.525070 PROGRESS: Channel   0:	 0.05 FDR:   724; 0.01 FDR:   395; 0.001 FDR:   219
5:49:52.525182 PROGRESS: =========================================================================
5:49:52.526350 PROGRESS: === Epoch 18, step 6, extracting elution groups 63000 to 127000 ===
5:49:52.701705 PROGRESS: Extracting batch of 126422 precursors
5:49:52.740846 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:49:52.740975 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:49:52.741030 INFO: FWHM in RT is 14.96 seconds, sigma is 0.54
5:49:52.741058 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:49:52.741313 INFO: Starting candidate selection
5:49:59.713392 INFO: Starting candidate scoring
5:50:02.255908 INFO: Finished candidate processing
5:50:02.256051 INFO: Collecting candidate features
5:50:04.815862 WARNING: intensity_correlation has 196 NaNs ( 0.16 % out of 119812)
5:50:04.828944 INFO: Collecting fragment features
5:50:05.609383 INFO: Finished candidate scoring
5:50:06.043069 PROGRESS: === Epoch 18, step 6, extracted 119812 precursors and 632188 fragments ===
5:50:06.043459 INFO: performing precursor FDR with 47 features
5:50:06.043508 INFO: Decoy channel: -1
5:50:06.043535 INFO: Competetive: True
5:50:06.324295 WARNING: dropped 196 target PSMs due to missing features
5:50:06.324434 WARNING: dropped 192 decoy PSMs due to missing features
5:50:14.701515 INFO: Test AUC: 0.551
5:50:14.701647 INFO: Train AUC: 0.590
5:50:14.701704 INFO: AUC difference: 6.63%
5:50:14.701732 WARNING: AUC difference > 5%. This may indicate overfitting.
5:50:14.868018 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
5:50:14.869939 PROGRESS: ============================= Precursor FDR =============================
5:50:14.870091 PROGRESS: Total precursors accumulated: 2,593
5:50:14.870172 PROGRESS: Target precursors: 2,362 (91.09%)
5:50:14.870240 PROGRESS: Decoy precursors: 231 (8.91%)
5:50:14.870303 PROGRESS: 
5:50:14.870364 PROGRESS: Precursor Summary:
5:50:14.872751 PROGRESS: Channel   0:	 0.05 FDR: 1,549; 0.01 FDR:   886; 0.001 FDR:   639
5:50:14.872905 PROGRESS: 
5:50:14.872980 PROGRESS: Protein Summary:
5:50:14.876033 PROGRESS: Channel   0:	 0.05 FDR: 1,381; 0.01 FDR:   784; 0.001 FDR:   570
5:50:14.876158 PROGRESS: =========================================================================
5:50:14.877642 PROGRESS: === Epoch 18, step 7, extracting elution groups 127000 to 255000 ===
5:50:15.104002 PROGRESS: Extracting batch of 252893 precursors
5:50:15.177642 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:50:15.177761 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:50:15.177811 INFO: FWHM in RT is 14.96 seconds, sigma is 0.54
5:50:15.177856 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:50:15.178125 INFO: Starting candidate selection
5:50:24.792363 INFO: Starting candidate scoring
5:50:28.637865 INFO: Finished candidate processing
5:50:28.638054 INFO: Collecting candidate features
5:50:31.620829 WARNING: intensity_correlation has 379 NaNs ( 0.16 % out of 239878)
5:50:31.642515 INFO: Collecting fragment features
5:50:32.531427 INFO: Finished candidate scoring
5:50:33.124781 PROGRESS: === Epoch 18, step 7, extracted 239878 precursors and 1264727 fragments ===
5:50:33.125171 INFO: performing precursor FDR with 47 features
5:50:33.125218 INFO: Decoy channel: -1
5:50:33.125244 INFO: Competetive: True
5:50:33.735373 WARNING: dropped 405 target PSMs due to missing features
5:50:33.735494 WARNING: dropped 362 decoy PSMs due to missing features
5:50:51.827595 INFO: Test AUC: 0.551
5:50:51.827726 INFO: Train AUC: 0.578
5:50:51.827783 INFO: AUC difference: 4.63%
5:50:52.034284 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
5:50:52.036803 PROGRESS: ============================= Precursor FDR =============================
5:50:52.036959 PROGRESS: Total precursors accumulated: 4,698
5:50:52.037040 PROGRESS: Target precursors: 4,279 (91.08%)
5:50:52.037107 PROGRESS: Decoy precursors: 419 (8.92%)
5:50:52.037171 PROGRESS: 
5:50:52.037232 PROGRESS: Precursor Summary:
5:50:52.040291 PROGRESS: Channel   0:	 0.05 FDR: 3,032; 0.01 FDR: 1,956; 0.001 FDR: 1,261
5:50:52.040442 PROGRESS: 
5:50:52.040515 PROGRESS: Protein Summary:
5:50:52.044592 PROGRESS: Channel   0:	 0.05 FDR: 2,477; 0.01 FDR: 1,566; 0.001 FDR: 1,030
5:50:52.044737 PROGRESS: =========================================================================
5:50:52.046783 PROGRESS: === Epoch 18, step 8, extracting elution groups 255000 to 511000 ===
5:50:52.353944 PROGRESS: Extracting batch of 505902 precursors
5:50:52.488495 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:50:52.488608 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:50:52.488649 INFO: FWHM in RT is 14.96 seconds, sigma is 0.54
5:50:52.488677 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:50:52.488955 INFO: Starting candidate selection
5:51:07.255754 INFO: Starting candidate scoring
5:51:13.565551 INFO: Finished candidate processing
5:51:13.565746 INFO: Collecting candidate features
5:51:17.273409 WARNING: intensity_correlation has 828 NaNs ( 0.17 % out of 480130)
5:51:17.309120 INFO: Collecting fragment features
5:51:18.394301 INFO: Finished candidate scoring
5:51:19.302673 PROGRESS: === Epoch 18, step 8, extracted 480130 precursors and 2534674 fragments ===
5:51:19.303081 INFO: performing precursor FDR with 47 features
5:51:19.309825 INFO: Decoy channel: -1
5:51:19.309979 INFO: Competetive: True
5:51:20.473889 WARNING: dropped 825 target PSMs due to missing features
5:51:20.474013 WARNING: dropped 770 decoy PSMs due to missing features
5:51:56.868276 INFO: Test AUC: 0.552
5:51:56.868404 INFO: Train AUC: 0.568
5:51:56.868441 INFO: AUC difference: 2.88%
5:51:57.117602 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
5:51:57.120974 PROGRESS: ============================= Precursor FDR =============================
5:51:57.121150 PROGRESS: Total precursors accumulated: 7,822
5:51:57.121228 PROGRESS: Target precursors: 7,131 (91.17%)
5:51:57.121296 PROGRESS: Decoy precursors: 691 (8.83%)
5:51:57.121357 PROGRESS: 
5:51:57.121416 PROGRESS: Precursor Summary:
5:51:57.125517 PROGRESS: Channel   0:	 0.05 FDR: 5,385; 0.01 FDR: 3,716; 0.001 FDR: 2,486
5:51:57.125678 PROGRESS: 
5:51:57.125751 PROGRESS: Protein Summary:
5:51:57.131707 PROGRESS: Channel   0:	 0.05 FDR: 3,754; 0.01 FDR: 2,508; 0.001 FDR: 1,734
5:51:57.131862 PROGRESS: =========================================================================
5:51:57.134754 PROGRESS: === Epoch 18, step 9, extracting elution groups 511000 to 1023000 ===
5:51:57.561318 PROGRESS: Extracting batch of 1011723 precursors
5:51:57.836540 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:51:57.836649 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:51:57.836705 INFO: FWHM in RT is 14.96 seconds, sigma is 0.54
5:51:57.836732 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:51:57.837004 INFO: Starting candidate selection
5:52:22.987989 INFO: Starting candidate scoring
5:52:34.531843 INFO: Finished candidate processing
5:52:34.532035 INFO: Collecting candidate features
5:52:39.499970 WARNING: intensity_correlation has 1653 NaNs ( 0.17 % out of 960424)
5:52:39.563502 INFO: Collecting fragment features
5:52:41.251691 INFO: Finished candidate scoring
5:52:42.886574 PROGRESS: === Epoch 18, step 9, extracted 960424 precursors and 5067924 fragments ===
5:52:42.886919 INFO: performing precursor FDR with 47 features
5:52:42.886968 INFO: Decoy channel: -1
5:52:42.886994 INFO: Competetive: True
5:52:45.238370 WARNING: dropped 1664 target PSMs due to missing features
5:52:45.238502 WARNING: dropped 1584 decoy PSMs due to missing features
5:53:58.671511 INFO: Test AUC: 0.553
5:53:58.671640 INFO: Train AUC: 0.563
5:53:58.671692 INFO: AUC difference: 1.89%
5:53:59.028314 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
5:53:59.032970 PROGRESS: ============================= Precursor FDR =============================
5:53:59.033185 PROGRESS: Total precursors accumulated: 12,804
5:53:59.033263 PROGRESS: Target precursors: 11,683 (91.24%)
5:53:59.033330 PROGRESS: Decoy precursors: 1,121 (8.76%)
5:53:59.033393 PROGRESS: 
5:53:59.033454 PROGRESS: Precursor Summary:
5:53:59.039478 PROGRESS: Channel   0:	 0.05 FDR: 9,709; 0.01 FDR: 7,469; 0.001 FDR: 5,135
5:53:59.039719 PROGRESS: 
5:53:59.039797 PROGRESS: Protein Summary:
5:53:59.048648 PROGRESS: Channel   0:	 0.05 FDR: 5,136; 0.01 FDR: 3,886; 0.001 FDR: 2,841
5:53:59.048836 PROGRESS: =========================================================================
5:53:59.056230 INFO: calibration group: precursor, fitting rt estimator 
5:54:00.239755 INFO: calibration group: fragment, fitting mz estimator 
5:54:00.840919 INFO: === checking if epoch conditions were reached ===
5:54:00.841158 INFO: ✅ ms2_error      : 7.0000 <= 7
5:54:00.841240 INFO: ❌ rt_error       : 199.9332 > 100
5:54:00.841303 INFO: ✅ current_epoch  : 18 >= 3
5:54:00.841359 INFO: ==============================================
5:54:01.058760 INFO: calibration group: precursor, predicting mz
5:54:01.059090 WARNING: mz prediction was skipped as it has not been fitted yet
5:54:01.059132 INFO: calibration group: precursor, predicting rt
5:54:07.851210 INFO: calibration group: fragment, predicting mz
5:54:25.396438 PROGRESS: === Epoch 19, step 0, extracting elution groups 0 to 1000 ===
5:54:25.517712 PROGRESS: Extracting batch of 1983 precursors
5:54:25.519592 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:54:25.519667 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:54:25.519704 INFO: FWHM in RT is 15.06 seconds, sigma is 0.55
5:54:25.519733 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:54:25.519958 INFO: Starting candidate selection
5:54:30.309705 INFO: Starting candidate scoring
5:54:31.591018 INFO: Finished candidate processing
5:54:31.591109 INFO: Collecting candidate features
5:54:33.744420 WARNING: intensity_correlation has 5 NaNs ( 0.27 % out of 1873)
5:54:33.750518 INFO: Collecting fragment features
5:54:34.389296 INFO: Finished candidate scoring
5:54:34.753270 PROGRESS: === Epoch 19, step 0, extracted 1873 precursors and 9635 fragments ===
5:54:34.753578 INFO: performing precursor FDR with 47 features
5:54:34.753623 INFO: Decoy channel: -1
5:54:34.753649 INFO: Competetive: True
5:54:34.758847 WARNING: dropped 2 target PSMs due to missing features
5:54:34.758962 WARNING: dropped 3 decoy PSMs due to missing features
5:54:34.788018 INFO: Test AUC: 0.561
5:54:34.788116 INFO: Train AUC: 0.548
5:54:34.788160 INFO: AUC difference: 2.50%
5:54:34.909220 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
5:54:34.910024 PROGRESS: ============================= Precursor FDR =============================
5:54:34.910144 PROGRESS: Total precursors accumulated: 8
5:54:34.910235 PROGRESS: Target precursors: 8 (100.00%)
5:54:34.910305 PROGRESS: Decoy precursors: 0 (0.00%)
5:54:34.910368 PROGRESS: 
5:54:34.910429 PROGRESS: Precursor Summary:
5:54:34.911913 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
5:54:34.912022 PROGRESS: 
5:54:34.912111 PROGRESS: Protein Summary:
5:54:34.913811 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
5:54:34.913921 PROGRESS: =========================================================================
5:54:34.914803 PROGRESS: === Epoch 19, step 1, extracting elution groups 1000 to 3000 ===
5:54:34.991458 PROGRESS: Extracting batch of 3959 precursors
5:54:34.993725 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:54:34.993793 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:54:34.993851 INFO: FWHM in RT is 15.06 seconds, sigma is 0.55
5:54:34.993881 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:54:34.994102 INFO: Starting candidate selection
5:54:39.420543 INFO: Starting candidate scoring
5:54:40.732770 INFO: Finished candidate processing
5:54:40.732867 INFO: Collecting candidate features
5:54:42.920739 WARNING: intensity_correlation has 5 NaNs ( 0.13 % out of 3755)
5:54:42.926921 INFO: Collecting fragment features
5:54:43.574811 INFO: Finished candidate scoring
5:54:43.858709 PROGRESS: === Epoch 19, step 1, extracted 3755 precursors and 19865 fragments ===
5:54:43.858992 INFO: performing precursor FDR with 47 features
5:54:43.859040 INFO: Decoy channel: -1
5:54:43.859067 INFO: Competetive: True
5:54:43.868461 WARNING: dropped 5 target PSMs due to missing features
5:54:43.868565 WARNING: dropped 5 decoy PSMs due to missing features
5:54:43.908160 INFO: Test AUC: 0.554
5:54:43.908281 INFO: Train AUC: 0.564
5:54:43.908327 INFO: AUC difference: 1.65%
5:54:44.045570 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
5:54:44.046361 PROGRESS: ============================= Precursor FDR =============================
5:54:44.046484 PROGRESS: Total precursors accumulated: 25
5:54:44.046563 PROGRESS: Target precursors: 23 (92.00%)
5:54:44.046632 PROGRESS: Decoy precursors: 2 (8.00%)
5:54:44.046695 PROGRESS: 
5:54:44.046758 PROGRESS: Precursor Summary:
5:54:44.048168 PROGRESS: Channel   0:	 0.05 FDR:    14; 0.01 FDR:    14; 0.001 FDR:    14
5:54:44.048299 PROGRESS: 
5:54:44.048383 PROGRESS: Protein Summary:
5:54:44.050003 PROGRESS: Channel   0:	 0.05 FDR:    14; 0.01 FDR:    14; 0.001 FDR:    14
5:54:44.050117 PROGRESS: =========================================================================
5:54:44.050971 PROGRESS: === Epoch 19, step 2, extracting elution groups 3000 to 7000 ===
5:54:44.133621 PROGRESS: Extracting batch of 7888 precursors
5:54:44.137157 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:54:44.137223 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:54:44.137260 INFO: FWHM in RT is 15.06 seconds, sigma is 0.55
5:54:44.137288 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:54:44.137537 INFO: Starting candidate selection
5:54:48.694045 INFO: Starting candidate scoring
5:54:50.036293 INFO: Finished candidate processing
5:54:50.036390 INFO: Collecting candidate features
5:54:52.237995 WARNING: intensity_correlation has 15 NaNs ( 0.20 % out of 7486)
5:54:52.244952 INFO: Collecting fragment features
5:54:52.901068 INFO: Finished candidate scoring
5:54:53.189656 PROGRESS: === Epoch 19, step 2, extracted 7486 precursors and 39751 fragments ===
5:54:53.190051 INFO: performing precursor FDR with 47 features
5:54:53.190099 INFO: Decoy channel: -1
5:54:53.190126 INFO: Competetive: True
5:54:53.206412 WARNING: dropped 12 target PSMs due to missing features
5:54:53.206531 WARNING: dropped 13 decoy PSMs due to missing features
5:54:53.505147 INFO: Test AUC: 0.551
5:54:53.505284 INFO: Train AUC: 0.588
5:54:53.505329 INFO: AUC difference: 6.19%
5:54:53.505364 WARNING: AUC difference > 5%. This may indicate overfitting.
5:54:53.644323 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
5:54:53.645182 PROGRESS: ============================= Precursor FDR =============================
5:54:53.645304 PROGRESS: Total precursors accumulated: 123
5:54:53.645381 PROGRESS: Target precursors: 114 (92.68%)
5:54:53.645450 PROGRESS: Decoy precursors: 9 (7.32%)
5:54:53.645513 PROGRESS: 
5:54:53.645575 PROGRESS: Precursor Summary:
5:54:53.647074 PROGRESS: Channel   0:	 0.05 FDR:    62; 0.01 FDR:    32; 0.001 FDR:    32
5:54:53.647202 PROGRESS: 
5:54:53.647277 PROGRESS: Protein Summary:
5:54:53.648953 PROGRESS: Channel   0:	 0.05 FDR:    62; 0.01 FDR:    32; 0.001 FDR:    32
5:54:53.649062 PROGRESS: =========================================================================
5:54:53.649938 PROGRESS: === Epoch 19, step 3, extracting elution groups 7000 to 15000 ===
5:54:53.742449 PROGRESS: Extracting batch of 15817 precursors
5:54:53.750513 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:54:53.750645 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:54:53.750729 INFO: FWHM in RT is 15.06 seconds, sigma is 0.55
5:54:53.750792 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:54:53.751176 INFO: Starting candidate selection
5:54:58.435903 INFO: Starting candidate scoring
5:54:59.859766 INFO: Finished candidate processing
5:54:59.859951 INFO: Collecting candidate features
5:55:02.095276 WARNING: intensity_correlation has 31 NaNs ( 0.21 % out of 15035)
5:55:02.101414 INFO: Collecting fragment features
5:55:02.768462 INFO: Finished candidate scoring
5:55:03.066762 PROGRESS: === Epoch 19, step 3, extracted 15035 precursors and 79256 fragments ===
5:55:03.067184 INFO: performing precursor FDR with 47 features
5:55:03.067233 INFO: Decoy channel: -1
5:55:03.067260 INFO: Competetive: True
5:55:03.097961 WARNING: dropped 27 target PSMs due to missing features
5:55:03.098075 WARNING: dropped 29 decoy PSMs due to missing features
5:55:03.892470 INFO: Test AUC: 0.551
5:55:03.892621 INFO: Train AUC: 0.596
5:55:03.892667 INFO: AUC difference: 7.65%
5:55:03.892702 WARNING: AUC difference > 5%. This may indicate overfitting.
5:55:04.020073 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
5:55:04.021063 PROGRESS: ============================= Precursor FDR =============================
5:55:04.021188 PROGRESS: Total precursors accumulated: 261
5:55:04.021265 PROGRESS: Target precursors: 239 (91.57%)
5:55:04.021332 PROGRESS: Decoy precursors: 22 (8.43%)
5:55:04.021395 PROGRESS: 
5:55:04.021456 PROGRESS: Precursor Summary:
5:55:04.023019 PROGRESS: Channel   0:	 0.05 FDR:   127; 0.01 FDR:    67; 0.001 FDR:    67
5:55:04.023152 PROGRESS: 
5:55:04.023226 PROGRESS: Protein Summary:
5:55:04.024982 PROGRESS: Channel   0:	 0.05 FDR:   127; 0.01 FDR:    67; 0.001 FDR:    67
5:55:04.025093 PROGRESS: =========================================================================
5:55:04.026023 PROGRESS: === Epoch 19, step 4, extracting elution groups 15000 to 31000 ===
5:55:04.134178 PROGRESS: Extracting batch of 31655 precursors
5:55:04.144932 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:55:04.145045 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:55:04.145089 INFO: FWHM in RT is 15.06 seconds, sigma is 0.55
5:55:04.145116 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:55:04.145359 INFO: Starting candidate selection
5:55:09.217839 INFO: Starting candidate scoring
5:55:10.826286 INFO: Finished candidate processing
5:55:10.826476 INFO: Collecting candidate features
5:55:13.082555 WARNING: intensity_correlation has 67 NaNs ( 0.22 % out of 30036)
5:55:13.089510 INFO: Collecting fragment features
5:55:13.769602 INFO: Finished candidate scoring
5:55:14.082618 PROGRESS: === Epoch 19, step 4, extracted 30036 precursors and 158929 fragments ===
5:55:14.082999 INFO: performing precursor FDR with 47 features
5:55:14.083047 INFO: Decoy channel: -1
5:55:14.083075 INFO: Competetive: True
5:55:14.144796 WARNING: dropped 62 target PSMs due to missing features
5:55:14.144906 WARNING: dropped 61 decoy PSMs due to missing features
5:55:16.163045 INFO: Test AUC: 0.554
5:55:16.163198 INFO: Train AUC: 0.605
5:55:16.163246 INFO: AUC difference: 8.44%
5:55:16.163281 WARNING: AUC difference > 5%. This may indicate overfitting.
5:55:16.292756 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
5:55:16.293955 PROGRESS: ============================= Precursor FDR =============================
5:55:16.294111 PROGRESS: Total precursors accumulated: 694
5:55:16.294190 PROGRESS: Target precursors: 634 (91.35%)
5:55:16.294271 PROGRESS: Decoy precursors: 60 (8.65%)
5:55:16.294334 PROGRESS: 
5:55:16.294395 PROGRESS: Precursor Summary:
5:55:16.296151 PROGRESS: Channel   0:	 0.05 FDR:   401; 0.01 FDR:   267; 0.001 FDR:   178
5:55:16.296290 PROGRESS: 
5:55:16.296365 PROGRESS: Protein Summary:
5:55:16.298432 PROGRESS: Channel   0:	 0.05 FDR:   396; 0.01 FDR:   264; 0.001 FDR:   176
5:55:16.298550 PROGRESS: =========================================================================
5:55:16.299635 PROGRESS: === Epoch 19, step 5, extracting elution groups 31000 to 63000 ===
5:55:16.437953 PROGRESS: Extracting batch of 63243 precursors
5:55:16.458265 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:55:16.458389 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:55:16.458430 INFO: FWHM in RT is 15.06 seconds, sigma is 0.55
5:55:16.458459 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:55:16.458708 INFO: Starting candidate selection
5:55:22.188785 INFO: Starting candidate scoring
5:55:24.108087 INFO: Finished candidate processing
5:55:24.108271 INFO: Collecting candidate features
5:55:26.459391 WARNING: intensity_correlation has 110 NaNs ( 0.18 % out of 60093)
5:55:26.468478 INFO: Collecting fragment features
5:55:27.186321 INFO: Finished candidate scoring
5:55:27.537420 PROGRESS: === Epoch 19, step 5, extracted 60093 precursors and 317074 fragments ===
5:55:27.537848 INFO: performing precursor FDR with 47 features
5:55:27.537903 INFO: Decoy channel: -1
5:55:27.537929 INFO: Competetive: True
5:55:27.673882 WARNING: dropped 130 target PSMs due to missing features
5:55:27.673997 WARNING: dropped 103 decoy PSMs due to missing features
5:55:31.706043 INFO: Test AUC: 0.563
5:55:31.706164 INFO: Train AUC: 0.603
5:55:31.707077 INFO: AUC difference: 6.68%
5:55:31.707165 WARNING: AUC difference > 5%. This may indicate overfitting.
5:55:31.847219 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
5:55:31.848650 PROGRESS: ============================= Precursor FDR =============================
5:55:31.848797 PROGRESS: Total precursors accumulated: 1,348
5:55:31.848874 PROGRESS: Target precursors: 1,229 (91.17%)
5:55:31.848943 PROGRESS: Decoy precursors: 119 (8.83%)
5:55:31.849006 PROGRESS: 
5:55:31.849066 PROGRESS: Precursor Summary:
5:55:31.851064 PROGRESS: Channel   0:	 0.05 FDR:   851; 0.01 FDR:   497; 0.001 FDR:   308
5:55:31.851220 PROGRESS: 
5:55:31.851295 PROGRESS: Protein Summary:
5:55:31.853670 PROGRESS: Channel   0:	 0.05 FDR:   810; 0.01 FDR:   475; 0.001 FDR:   299
5:55:31.853817 PROGRESS: =========================================================================
5:55:31.855018 PROGRESS: === Epoch 19, step 6, extracting elution groups 63000 to 127000 ===
5:55:32.030918 PROGRESS: Extracting batch of 126443 precursors
5:55:32.070092 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:55:32.070224 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:55:32.070265 INFO: FWHM in RT is 15.06 seconds, sigma is 0.55
5:55:32.070292 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:55:32.070558 INFO: Starting candidate selection
5:55:39.043457 INFO: Starting candidate scoring
5:55:41.565524 INFO: Finished candidate processing
5:55:41.565698 INFO: Collecting candidate features
5:55:44.097346 WARNING: intensity_correlation has 209 NaNs ( 0.17 % out of 119826)
5:55:44.110513 INFO: Collecting fragment features
5:55:44.880414 INFO: Finished candidate scoring
5:55:45.307748 PROGRESS: === Epoch 19, step 6, extracted 119826 precursors and 632594 fragments ===
5:55:45.308114 INFO: performing precursor FDR with 47 features
5:55:45.308159 INFO: Decoy channel: -1
5:55:45.308185 INFO: Competetive: True
5:55:45.583910 WARNING: dropped 250 target PSMs due to missing features
5:55:45.584027 WARNING: dropped 192 decoy PSMs due to missing features
5:55:54.282105 INFO: Test AUC: 0.555
5:55:54.282251 INFO: Train AUC: 0.594
5:55:54.282293 INFO: AUC difference: 6.65%
5:55:54.282323 WARNING: AUC difference > 5%. This may indicate overfitting.
5:55:54.453861 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
5:55:54.455793 PROGRESS: ============================= Precursor FDR =============================
5:55:54.455945 PROGRESS: Total precursors accumulated: 2,743
5:55:54.456024 PROGRESS: Target precursors: 2,498 (91.07%)
5:55:54.456092 PROGRESS: Decoy precursors: 245 (8.93%)
5:55:54.456156 PROGRESS: 
5:55:54.456218 PROGRESS: Precursor Summary:
5:55:54.458658 PROGRESS: Channel   0:	 0.05 FDR: 1,616; 0.01 FDR:   942; 0.001 FDR:   723
5:55:54.458821 PROGRESS: 
5:55:54.458899 PROGRESS: Protein Summary:
5:55:54.461965 PROGRESS: Channel   0:	 0.05 FDR: 1,461; 0.01 FDR:   834; 0.001 FDR:   649
5:55:54.462093 PROGRESS: =========================================================================
5:55:54.463589 PROGRESS: === Epoch 19, step 7, extracting elution groups 127000 to 255000 ===
5:55:54.686292 PROGRESS: Extracting batch of 252858 precursors
5:55:54.758312 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:55:54.758429 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:55:54.758499 INFO: FWHM in RT is 15.06 seconds, sigma is 0.55
5:55:54.758529 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:55:54.758801 INFO: Starting candidate selection
5:56:04.305042 INFO: Starting candidate scoring
5:56:08.107230 INFO: Finished candidate processing
5:56:08.107410 INFO: Collecting candidate features
5:56:11.079695 WARNING: intensity_correlation has 446 NaNs ( 0.19 % out of 239850)
5:56:11.101255 INFO: Collecting fragment features
5:56:11.975596 INFO: Finished candidate scoring
5:56:12.558111 PROGRESS: === Epoch 19, step 7, extracted 239850 precursors and 1266266 fragments ===
5:56:12.558500 INFO: performing precursor FDR with 47 features
5:56:12.558546 INFO: Decoy channel: -1
5:56:12.558573 INFO: Competetive: True
5:56:13.157279 WARNING: dropped 475 target PSMs due to missing features
5:56:13.157402 WARNING: dropped 413 decoy PSMs due to missing features
5:56:30.885020 INFO: Test AUC: 0.552
5:56:30.885157 INFO: Train AUC: 0.582
5:56:30.885195 INFO: AUC difference: 5.07%
5:56:30.885241 WARNING: AUC difference > 5%. This may indicate overfitting.
5:56:31.071138 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
5:56:31.073622 PROGRESS: ============================= Precursor FDR =============================
5:56:31.073808 PROGRESS: Total precursors accumulated: 4,517
5:56:31.073894 PROGRESS: Target precursors: 4,110 (90.99%)
5:56:31.073964 PROGRESS: Decoy precursors: 407 (9.01%)
5:56:31.074040 PROGRESS: 
5:56:31.074101 PROGRESS: Precursor Summary:
5:56:31.077164 PROGRESS: Channel   0:	 0.05 FDR: 2,936; 0.01 FDR: 1,947; 0.001 FDR: 1,587
5:56:31.077308 PROGRESS: 
5:56:31.077382 PROGRESS: Protein Summary:
5:56:31.081489 PROGRESS: Channel   0:	 0.05 FDR: 2,445; 0.01 FDR: 1,587; 0.001 FDR: 1,297
5:56:31.081636 PROGRESS: =========================================================================
5:56:31.083608 PROGRESS: === Epoch 19, step 8, extracting elution groups 255000 to 511000 ===
5:56:31.388263 PROGRESS: Extracting batch of 505716 precursors
5:56:31.521184 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:56:31.521303 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:56:31.521342 INFO: FWHM in RT is 15.06 seconds, sigma is 0.55
5:56:31.521386 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:56:31.521687 INFO: Starting candidate selection
5:56:46.353419 INFO: Starting candidate scoring
5:56:52.686692 INFO: Finished candidate processing
5:56:52.686874 INFO: Collecting candidate features
5:56:56.382370 WARNING: intensity_correlation has 835 NaNs ( 0.17 % out of 479638)
5:56:56.416598 INFO: Collecting fragment features
5:56:57.495369 INFO: Finished candidate scoring
5:56:58.387944 PROGRESS: === Epoch 19, step 8, extracted 479638 precursors and 2528148 fragments ===
5:56:58.388353 INFO: performing precursor FDR with 47 features
5:56:58.395077 INFO: Decoy channel: -1
5:56:58.395240 INFO: Competetive: True
5:56:59.537534 WARNING: dropped 900 target PSMs due to missing features
5:56:59.537662 WARNING: dropped 823 decoy PSMs due to missing features
5:57:35.532137 INFO: Test AUC: 0.552
5:57:35.532271 INFO: Train AUC: 0.571
5:57:35.532336 INFO: AUC difference: 3.31%
5:57:35.778035 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
5:57:35.781302 PROGRESS: ============================= Precursor FDR =============================
5:57:35.781476 PROGRESS: Total precursors accumulated: 7,626
5:57:35.781556 PROGRESS: Target precursors: 6,951 (91.15%)
5:57:35.781636 PROGRESS: Decoy precursors: 675 (8.85%)
5:57:35.781701 PROGRESS: 
5:57:35.781761 PROGRESS: Precursor Summary:
5:57:35.785934 PROGRESS: Channel   0:	 0.05 FDR: 5,203; 0.01 FDR: 3,701; 0.001 FDR: 3,051
5:57:35.786113 PROGRESS: 
5:57:35.786190 PROGRESS: Protein Summary:
5:57:35.792280 PROGRESS: Channel   0:	 0.05 FDR: 3,650; 0.01 FDR: 2,513; 0.001 FDR: 2,109
5:57:35.792434 PROGRESS: =========================================================================
5:57:35.795338 PROGRESS: === Epoch 19, step 9, extracting elution groups 511000 to 1023000 ===
5:57:36.227816 PROGRESS: Extracting batch of 1011737 precursors
5:57:36.507043 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
5:57:36.507172 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
5:57:36.507214 INFO: FWHM in RT is 15.06 seconds, sigma is 0.55
5:57:36.507241 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
5:57:36.507511 INFO: Starting candidate selection
5:58:01.649545 INFO: Starting candidate scoring
5:58:13.149703 INFO: Finished candidate processing
5:58:13.149917 INFO: Collecting candidate features
5:58:18.085293 WARNING: intensity_correlation has 1726 NaNs ( 0.18 % out of 959927)
5:58:18.146684 INFO: Collecting fragment features
5:58:19.824360 INFO: Finished candidate scoring
5:58:21.423822 PROGRESS: === Epoch 19, step 9, extracted 959927 precursors and 5062281 fragments ===
5:58:21.424206 INFO: performing precursor FDR with 47 features
5:58:21.424253 INFO: Decoy channel: -1
5:58:21.424278 INFO: Competetive: True
5:58:23.730291 WARNING: dropped 1769 target PSMs due to missing features
5:58:23.730411 WARNING: dropped 1680 decoy PSMs due to missing features
5:59:36.750946 INFO: Test AUC: 0.553
5:59:36.751068 INFO: Train AUC: 0.565
5:59:36.751122 INFO: AUC difference: 2.22%
5:59:37.107443 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
5:59:37.112204 PROGRESS: ============================= Precursor FDR =============================
5:59:37.112407 PROGRESS: Total precursors accumulated: 12,970
5:59:37.112487 PROGRESS: Target precursors: 11,832 (91.23%)
5:59:37.112553 PROGRESS: Decoy precursors: 1,138 (8.77%)
5:59:37.112616 PROGRESS: 
5:59:37.112677 PROGRESS: Precursor Summary:
5:59:37.118514 PROGRESS: Channel   0:	 0.05 FDR: 9,768; 0.01 FDR: 7,319; 0.001 FDR: 4,391
5:59:37.118716 PROGRESS: 
5:59:37.118793 PROGRESS: Protein Summary:
5:59:37.127453 PROGRESS: Channel   0:	 0.05 FDR: 5,325; 0.01 FDR: 3,880; 0.001 FDR: 2,576
5:59:37.127656 PROGRESS: =========================================================================
5:59:37.134959 INFO: calibration group: precursor, fitting rt estimator 
5:59:38.284714 INFO: calibration group: fragment, fitting mz estimator 
5:59:39.083673 INFO: calibration group: precursor, predicting mz
5:59:39.084676 WARNING: mz prediction was skipped as it has not been fitted yet
5:59:39.084724 INFO: calibration group: precursor, predicting rt
5:59:45.845519 INFO: calibration group: fragment, predicting mz
6:00:03.539193 PROGRESS: Extracting batch of 9950763 precursors
6:00:06.244453 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:00:06.244569 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:00:06.244607 INFO: FWHM in RT is 14.95 seconds, sigma is 0.54
6:00:06.244650 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:00:06.244926 INFO: Starting candidate selection
6:03:16.401989 INFO: Applying score cutoff of 52.386590454101565
6:03:16.612913 INFO: Removed 6163255 precursors with score below cutoff
6:03:19.059585 INFO: Starting candidate scoring
6:04:00.660010 INFO: Finished candidate processing
6:04:00.660255 INFO: Collecting candidate features
6:04:11.343424 WARNING: intensity_correlation has 26 NaNs ( 0.00 % out of 3491630)
6:04:11.539785 INFO: Collecting fragment features
6:04:16.369896 INFO: Finished candidate scoring
6:04:19.995416 INFO: performing precursor FDR with 47 features
6:04:19.995531 INFO: Decoy channel: -1
6:04:19.995558 INFO: Competetive: True
6:04:23.009804 WARNING: dropped 14 target PSMs due to missing features
6:04:23.009931 WARNING: dropped 12 decoy PSMs due to missing features
6:06:36.991669 INFO: Test AUC: 0.566
6:06:36.991797 INFO: Train AUC: 0.572
6:06:36.991851 INFO: AUC difference: 1.18%
6:06:37.468411 INFO: Removing fragments below FDR threshold
6:06:37.763708 PROGRESS: ============================= Precursor FDR =============================
6:06:37.763977 PROGRESS: Total precursors accumulated: 25,457
6:06:37.764069 PROGRESS: Target precursors: 25,205 (99.01%)
6:06:37.764142 PROGRESS: Decoy precursors: 252 (0.99%)
6:06:37.764217 PROGRESS: 
6:06:37.764278 PROGRESS: Precursor Summary:
6:06:37.780106 PROGRESS: Channel   0:	 0.05 FDR: 25,205; 0.01 FDR: 25,205; 0.001 FDR: 17,082
6:06:37.780395 PROGRESS: 
6:06:37.780473 PROGRESS: Protein Summary:
6:06:37.802215 PROGRESS: Channel   0:	 0.05 FDR: 6,948; 0.01 FDR: 6,948; 0.001 FDR: 5,281
6:06:37.802490 PROGRESS: =========================================================================
6:06:38.230832 INFO: Finished workflow for LFQ_Orbitrap_AIF_Condition_B_Sample_Alpha_02
6:06:38.755545 PROGRESS: Loading raw file 6/6: LFQ_Orbitrap_AIF_Condition_A_Sample_Alpha_03
6:06:38.755731 INFO: Creating workflow folder for LFQ_Orbitrap_AIF_Condition_A_Sample_Alpha_03 at output/.progress/LFQ_Orbitrap_AIF_Condition_A_Sample_Alpha_03
6:07:08.287568 INFO: Determining DIA cycle
6:07:08.301557 WARNING: Failed to determine DIA cycle, will retry without MS1 spectra.
6:07:08.307412 INFO: Determining DIA cycle
6:07:08.324763 INFO: Found cycle with start 0.00 min and length 151.
6:07:08.462862 INFO: ============ Raw file stats ============
6:07:08.463263 INFO: RT (min)            : 0.0 - 150.0
6:07:08.463342 INFO: RT duration (sec)   : 8999.7
6:07:08.463372 INFO: RT duration (min)   : 150.0
6:07:08.463472 INFO: Cycle len (scans)   : 151
6:07:08.463513 INFO: Cycle len (sec)     : 5.84
6:07:08.463542 INFO: Number of cycles    : 1542
6:07:08.463598 INFO: MS2 range (m/z)     : 396.4 - 1004.7
6:07:08.463630 INFO: ========================================
6:07:10.681946 INFO: Initializing CalibrationManager
6:07:10.682214 INFO: Loading calibration config
6:07:10.682649 INFO: Calibration config: [{'name': 'fragment', 'estimators': [{'name': 'mz', 'model': 'LOESSRegression', 'model_args': {'n_kernels': 2}, 'input_columns': ['mz_library'], 'target_columns': ['mz_observed'], 'output_columns': ['mz_calibrated'], 'transform_deviation': '1e6', 'function': LOESSRegression(n_kernels=2)}]}, {'name': 'precursor', 'estimators': [{'name': 'mz', 'model': 'LOESSRegression', 'model_args': {'n_kernels': 2}, 'input_columns': ['mz_library'], 'target_columns': ['mz_observed'], 'output_columns': ['mz_calibrated'], 'transform_deviation': '1e6', 'function': LOESSRegression(n_kernels=2)}, {'name': 'rt', 'model': 'LOESSRegression', 'model_args': {'n_kernels': 6}, 'input_columns': ['rt_library'], 'target_columns': ['rt_observed'], 'output_columns': ['rt_calibrated'], 'function': LOESSRegression()}, {'name': 'mobility', 'model': 'LOESSRegression', 'model_args': {'n_kernels': 2}, 'input_columns': ['mobility_library'], 'target_columns': ['mobility_observed'], 'output_columns': ['mobility_calibrated'], 'function': LOESSRegression(n_kernels=2)}]}]
6:07:10.682754 INFO: Calibration group :fragment, found 1 estimator(s)
6:07:10.682832 INFO: Calibration group :precursor, found 3 estimator(s)
6:07:10.682910 INFO: Disabling ion mobility calibration
6:07:10.682942 INFO: removed mobility estimator from group precursor
6:07:10.683017 INFO: Initializing OptimizationManager
6:07:10.683104 INFO: initial parameter: fwhm_rt = 5
6:07:10.683160 INFO: initial parameter: fwhm_mobility = 0.01
6:07:10.683213 INFO: initial parameter: score_cutoff = 0
6:07:10.683305 PROGRESS: Initializing workflow LFQ_Orbitrap_AIF_Condition_A_Sample_Alpha_03
6:07:10.683375 INFO: Initializing OptimizationManager
6:07:10.683403 INFO: initial parameter: current_epoch = 0
6:07:10.683426 INFO: initial parameter: current_step = 0
6:07:10.683447 INFO: initial parameter: ms1_error = 10
6:07:10.683471 INFO: initial parameter: ms2_error = 10
6:07:10.683491 INFO: initial parameter: rt_error = 240
6:07:10.683512 INFO: initial parameter: mobility_error = 0.08
6:07:10.683532 INFO: initial parameter: column_type = library
6:07:10.683553 INFO: initial parameter: num_candidates = 1
6:07:10.683572 INFO: initial parameter: recalibration_target = 200
6:07:10.683593 INFO: initial parameter: accumulated_precursors = 0
6:07:10.683613 INFO: initial parameter: accumulated_precursors_01FDR = 0
6:07:10.683634 INFO: initial parameter: accumulated_precursors_001FDR = 0
6:07:10.683662 INFO: Initializing FDRManager
6:07:10.683698 INFO: Loading classifier store from /home/alphadia/miniconda3/envs/alphadia172/lib/python3.11/site-packages/alphadia/constants/classifier
6:07:10.686518 PROGRESS: Applying channel filter using only: [0]
6:07:12.659298 PROGRESS: 4,989,882 target precursors potentially observable (188,089 removed)
6:07:16.182667 INFO: === checking if epoch conditions were reached ===
6:07:16.182935 INFO: ❌ ms2_error      : 10.0000 > 7
6:07:16.183020 INFO: ❌ rt_error       : 240.0000 > 100
6:07:16.183084 INFO: ❌ current_epoch  : 0 < 3
6:07:16.183140 INFO: ==============================================
6:07:16.396089 INFO: calibration group: precursor, predicting mz
6:07:16.396389 WARNING: mz prediction was skipped as it has not been fitted yet
6:07:16.396431 INFO: calibration group: precursor, predicting rt
6:07:16.396490 WARNING: rt prediction was skipped as it has not been fitted yet
6:07:16.396523 INFO: calibration group: fragment, predicting mz
6:07:16.396577 WARNING: mz prediction was skipped as it has not been fitted yet
6:07:16.396611 PROGRESS: === Epoch 0, step 0, extracting elution groups 0 to 1000 ===
6:07:16.468909 PROGRESS: Extracting batch of 1979 precursors
6:07:16.470691 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:07:16.470787 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:07:16.470829 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
6:07:16.470859 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
6:07:16.471093 INFO: Starting candidate selection
6:07:20.470363 INFO: Starting candidate scoring
6:07:21.557858 INFO: Finished candidate processing
6:07:21.557951 INFO: Collecting candidate features
6:07:23.701960 INFO: Collecting fragment features
6:07:24.334697 INFO: Finished candidate scoring
6:07:24.612519 PROGRESS: === Epoch 0, step 0, extracted 1692 precursors and 8141 fragments ===
6:07:24.612800 INFO: performing precursor FDR with 47 features
6:07:24.612846 INFO: Decoy channel: -1
6:07:24.612873 INFO: Competetive: True
6:07:24.650177 INFO: Test AUC: 0.509
6:07:24.650287 INFO: Train AUC: 0.523
6:07:24.650332 INFO: AUC difference: 2.74%
6:07:24.768237 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
6:07:24.769346 PROGRESS: ============================= Precursor FDR =============================
6:07:24.769503 PROGRESS: Total precursors accumulated: 878
6:07:24.769582 PROGRESS: Target precursors: 471 (53.64%)
6:07:24.769651 PROGRESS: Decoy precursors: 407 (46.36%)
6:07:24.769725 PROGRESS: 
6:07:24.769799 PROGRESS: Precursor Summary:
6:07:24.771205 PROGRESS: Channel   0:	 0.05 FDR:     0; 0.01 FDR:     0; 0.001 FDR:     0
6:07:24.771336 PROGRESS: 
6:07:24.771410 PROGRESS: Protein Summary:
6:07:24.772964 PROGRESS: Channel   0:	 0.05 FDR:     0; 0.01 FDR:     0; 0.001 FDR:     0
6:07:24.773090 PROGRESS: =========================================================================
6:07:24.773934 PROGRESS: === Epoch 0, step 1, extracting elution groups 1000 to 3000 ===
6:07:24.851533 PROGRESS: Extracting batch of 3944 precursors
6:07:24.853812 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:07:24.853874 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:07:24.853930 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
6:07:24.853961 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
6:07:24.854185 INFO: Starting candidate selection
6:07:28.819749 INFO: Starting candidate scoring
6:07:29.913685 INFO: Finished candidate processing
6:07:29.913781 INFO: Collecting candidate features
6:07:32.060852 INFO: Collecting fragment features
6:07:32.693996 INFO: Finished candidate scoring
6:07:32.975663 PROGRESS: === Epoch 0, step 1, extracted 3373 precursors and 16150 fragments ===
6:07:32.975940 INFO: performing precursor FDR with 47 features
6:07:32.975985 INFO: Decoy channel: -1
6:07:32.976011 INFO: Competetive: True
6:07:33.043656 INFO: Test AUC: 0.543
6:07:33.043779 INFO: Train AUC: 0.505
6:07:33.043824 INFO: AUC difference: 7.67%
6:07:33.043859 WARNING: AUC difference > 5%. This may indicate overfitting.
6:07:33.165057 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
6:07:33.166792 PROGRESS: ============================= Precursor FDR =============================
6:07:33.166998 PROGRESS: Total precursors accumulated: 2,629
6:07:33.167075 PROGRESS: Target precursors: 1,356 (51.58%)
6:07:33.167143 PROGRESS: Decoy precursors: 1,273 (48.42%)
6:07:33.167205 PROGRESS: 
6:07:33.167265 PROGRESS: Precursor Summary:
6:07:33.168713 PROGRESS: Channel   0:	 0.05 FDR:     0; 0.01 FDR:     0; 0.001 FDR:     0
6:07:33.168842 PROGRESS: 
6:07:33.168915 PROGRESS: Protein Summary:
6:07:33.170526 PROGRESS: Channel   0:	 0.05 FDR:     0; 0.01 FDR:     0; 0.001 FDR:     0
6:07:33.170646 PROGRESS: =========================================================================
6:07:33.171489 PROGRESS: === Epoch 0, step 2, extracting elution groups 3000 to 7000 ===
6:07:33.254125 PROGRESS: Extracting batch of 7907 precursors
6:07:33.257465 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:07:33.257527 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:07:33.257565 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
6:07:33.257610 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
6:07:33.257872 INFO: Starting candidate selection
6:07:37.300729 INFO: Starting candidate scoring
6:07:38.432358 INFO: Finished candidate processing
6:07:38.432452 INFO: Collecting candidate features
6:07:40.615353 WARNING: intensity_correlation has 1 NaNs ( 0.01 % out of 6737)
6:07:40.622218 INFO: Collecting fragment features
6:07:41.274802 INFO: Finished candidate scoring
6:07:41.563063 PROGRESS: === Epoch 0, step 2, extracted 6737 precursors and 32600 fragments ===
6:07:41.563421 INFO: performing precursor FDR with 47 features
6:07:41.563469 INFO: Decoy channel: -1
6:07:41.563496 INFO: Competetive: True
6:07:41.577639 WARNING: dropped 1 decoy PSMs due to missing features
6:07:41.632797 INFO: Test AUC: 0.498
6:07:41.632931 INFO: Train AUC: 0.508
6:07:41.632977 INFO: AUC difference: 1.99%
6:07:41.753562 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
6:07:41.754466 PROGRESS: ============================= Precursor FDR =============================
6:07:41.754597 PROGRESS: Total precursors accumulated: 1
6:07:41.754673 PROGRESS: Target precursors: 1 (100.00%)
6:07:41.754742 PROGRESS: Decoy precursors: 0 (0.00%)
6:07:41.754804 PROGRESS: 
6:07:41.754865 PROGRESS: Precursor Summary:
6:07:41.756367 PROGRESS: Channel   0:	 0.05 FDR:     1; 0.01 FDR:     1; 0.001 FDR:     1
6:07:41.756492 PROGRESS: 
6:07:41.756566 PROGRESS: Protein Summary:
6:07:41.758276 PROGRESS: Channel   0:	 0.05 FDR:     1; 0.01 FDR:     1; 0.001 FDR:     1
6:07:41.758389 PROGRESS: =========================================================================
6:07:41.759284 PROGRESS: === Epoch 0, step 3, extracting elution groups 7000 to 15000 ===
6:07:41.850818 PROGRESS: Extracting batch of 15828 precursors
6:07:41.856501 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:07:41.856574 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:07:41.856610 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
6:07:41.856652 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
6:07:41.856878 INFO: Starting candidate selection
6:07:46.154168 INFO: Starting candidate scoring
6:07:47.370598 INFO: Finished candidate processing
6:07:47.370692 INFO: Collecting candidate features
6:07:49.576021 WARNING: intensity_correlation has 1 NaNs ( 0.01 % out of 13563)
6:07:49.582097 INFO: Collecting fragment features
6:07:50.240816 INFO: Finished candidate scoring
6:07:50.538099 PROGRESS: === Epoch 0, step 3, extracted 13563 precursors and 64813 fragments ===
6:07:50.538470 INFO: performing precursor FDR with 47 features
6:07:50.538518 INFO: Decoy channel: -1
6:07:50.538545 INFO: Competetive: True
6:07:50.565647 WARNING: dropped 1 target PSMs due to missing features
6:07:50.565760 WARNING: dropped 1 decoy PSMs due to missing features
6:07:51.190843 INFO: Test AUC: 0.507
6:07:51.190993 INFO: Train AUC: 0.505
6:07:51.197824 INFO: AUC difference: 0.37%
6:07:51.318528 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
6:07:51.319427 PROGRESS: ============================= Precursor FDR =============================
6:07:51.319548 PROGRESS: Total precursors accumulated: 2
6:07:51.319626 PROGRESS: Target precursors: 2 (100.00%)
6:07:51.319694 PROGRESS: Decoy precursors: 0 (0.00%)
6:07:51.319757 PROGRESS: 
6:07:51.319817 PROGRESS: Precursor Summary:
6:07:51.321314 PROGRESS: Channel   0:	 0.05 FDR:     2; 0.01 FDR:     2; 0.001 FDR:     2
6:07:51.321438 PROGRESS: 
6:07:51.321511 PROGRESS: Protein Summary:
6:07:51.323208 PROGRESS: Channel   0:	 0.05 FDR:     2; 0.01 FDR:     2; 0.001 FDR:     2
6:07:51.323319 PROGRESS: =========================================================================
6:07:51.324202 PROGRESS: === Epoch 0, step 4, extracting elution groups 15000 to 31000 ===
6:07:51.432585 PROGRESS: Extracting batch of 31597 precursors
6:07:51.443235 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:07:51.443333 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:07:51.443372 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
6:07:51.443399 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
6:07:51.443637 INFO: Starting candidate selection
6:07:56.031522 INFO: Starting candidate scoring
6:07:57.369243 INFO: Finished candidate processing
6:07:57.369345 INFO: Collecting candidate features
6:07:59.604630 INFO: Collecting fragment features
6:08:00.275945 INFO: Finished candidate scoring
6:08:00.588227 PROGRESS: === Epoch 0, step 4, extracted 26966 precursors and 128912 fragments ===
6:08:00.588573 INFO: performing precursor FDR with 47 features
6:08:00.588620 INFO: Decoy channel: -1
6:08:00.588647 INFO: Competetive: True
6:08:00.642706 WARNING: dropped 1 target PSMs due to missing features
6:08:00.642833 WARNING: dropped 1 decoy PSMs due to missing features
6:08:02.374507 INFO: Test AUC: 0.528
6:08:02.374661 INFO: Train AUC: 0.545
6:08:02.374709 INFO: AUC difference: 3.13%
6:08:02.502913 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
6:08:02.503841 PROGRESS: ============================= Precursor FDR =============================
6:08:02.503967 PROGRESS: Total precursors accumulated: 6
6:08:02.504044 PROGRESS: Target precursors: 6 (100.00%)
6:08:02.504112 PROGRESS: Decoy precursors: 0 (0.00%)
6:08:02.504174 PROGRESS: 
6:08:02.504237 PROGRESS: Precursor Summary:
6:08:02.505752 PROGRESS: Channel   0:	 0.05 FDR:     6; 0.01 FDR:     6; 0.001 FDR:     6
6:08:02.505888 PROGRESS: 
6:08:02.505962 PROGRESS: Protein Summary:
6:08:02.507679 PROGRESS: Channel   0:	 0.05 FDR:     6; 0.01 FDR:     6; 0.001 FDR:     6
6:08:02.507789 PROGRESS: =========================================================================
6:08:02.508676 PROGRESS: === Epoch 0, step 5, extracting elution groups 31000 to 63000 ===
6:08:02.646382 PROGRESS: Extracting batch of 63242 precursors
6:08:02.666708 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:08:02.666818 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:08:02.666858 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
6:08:02.666886 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
6:08:02.667138 INFO: Starting candidate selection
6:08:07.940643 INFO: Starting candidate scoring
6:08:09.546094 INFO: Finished candidate processing
6:08:09.546198 INFO: Collecting candidate features
6:08:11.889019 WARNING: intensity_correlation has 1 NaNs ( 0.00 % out of 54085)
6:08:11.897652 INFO: Collecting fragment features
6:08:12.605193 INFO: Finished candidate scoring
6:08:12.953838 PROGRESS: === Epoch 0, step 5, extracted 54085 precursors and 259746 fragments ===
6:08:12.954191 INFO: performing precursor FDR with 47 features
6:08:12.954240 INFO: Decoy channel: -1
6:08:12.954269 INFO: Competetive: True
6:08:13.075324 WARNING: dropped 1 target PSMs due to missing features
6:08:13.075438 WARNING: dropped 2 decoy PSMs due to missing features
6:08:16.733535 INFO: Test AUC: 0.533
6:08:16.733657 INFO: Train AUC: 0.555
6:08:16.733708 INFO: AUC difference: 4.06%
6:08:16.867928 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
6:08:16.868916 PROGRESS: ============================= Precursor FDR =============================
6:08:16.869036 PROGRESS: Total precursors accumulated: 316
6:08:16.869113 PROGRESS: Target precursors: 289 (91.46%)
6:08:16.869179 PROGRESS: Decoy precursors: 27 (8.54%)
6:08:16.869240 PROGRESS: 
6:08:16.869300 PROGRESS: Precursor Summary:
6:08:16.870941 PROGRESS: Channel   0:	 0.05 FDR:   249; 0.01 FDR:   133; 0.001 FDR:   101
6:08:16.871059 PROGRESS: 
6:08:16.871132 PROGRESS: Protein Summary:
6:08:16.872946 PROGRESS: Channel   0:	 0.05 FDR:   240; 0.01 FDR:   131; 0.001 FDR:    99
6:08:16.873056 PROGRESS: =========================================================================
6:08:16.874048 PROGRESS: === Epoch 0, step 6, extracting elution groups 63000 to 127000 ===
6:08:17.049119 PROGRESS: Extracting batch of 126350 precursors
6:08:17.087357 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:08:17.087474 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:08:17.087512 INFO: FWHM in RT is 5.00 seconds, sigma is 0.18
6:08:17.087538 INFO: FWHM in mobility is 0.010 1/K_0, sigma is 1.00
6:08:17.087821 INFO: Starting candidate selection
6:08:23.742289 INFO: Starting candidate scoring
6:08:25.891879 INFO: Finished candidate processing
6:08:25.891970 INFO: Collecting candidate features
6:08:28.381880 INFO: Collecting fragment features
6:08:29.137430 INFO: Finished candidate scoring
6:08:29.552218 PROGRESS: === Epoch 0, step 6, extracted 107976 precursors and 518986 fragments ===
6:08:29.552619 INFO: performing precursor FDR with 47 features
6:08:29.552667 INFO: Decoy channel: -1
6:08:29.552693 INFO: Competetive: True
6:08:29.802186 WARNING: dropped 1 target PSMs due to missing features
6:08:29.802319 WARNING: dropped 2 decoy PSMs due to missing features
6:08:37.448773 INFO: Test AUC: 0.546
6:08:37.448903 INFO: Train AUC: 0.559
6:08:37.448958 INFO: AUC difference: 2.25%
6:08:37.600309 PROGRESS: === checking if recalibration conditions were reached, target 200 precursors ===
6:08:37.601466 PROGRESS: ============================= Precursor FDR =============================
6:08:37.601602 PROGRESS: Total precursors accumulated: 650
6:08:37.601679 PROGRESS: Target precursors: 592 (91.08%)
6:08:37.601746 PROGRESS: Decoy precursors: 58 (8.92%)
6:08:37.601827 PROGRESS: 
6:08:37.601890 PROGRESS: Precursor Summary:
6:08:37.603689 PROGRESS: Channel   0:	 0.05 FDR:   516; 0.01 FDR:   330; 0.001 FDR:   232
6:08:37.603815 PROGRESS: 
6:08:37.603890 PROGRESS: Protein Summary:
6:08:37.606016 PROGRESS: Channel   0:	 0.05 FDR:   479; 0.01 FDR:   311; 0.001 FDR:   225
6:08:37.606128 PROGRESS: =========================================================================
6:08:37.607901 INFO: calibration group: precursor, fitting rt estimator 
6:08:37.719795 INFO: calibration group: fragment, fitting mz estimator 
6:08:38.107406 INFO: === checking if epoch conditions were reached ===
6:08:38.107558 INFO: ✅ ms2_error      : 7.0000 <= 7
6:08:38.107644 INFO: ❌ rt_error       : 243.1235 > 100
6:08:38.107723 INFO: ❌ current_epoch  : 0 < 3
6:08:38.107789 INFO: ==============================================
6:08:38.353242 INFO: calibration group: precursor, predicting mz
6:08:38.353530 WARNING: mz prediction was skipped as it has not been fitted yet
6:08:38.353569 INFO: calibration group: precursor, predicting rt
6:08:45.570383 INFO: calibration group: fragment, predicting mz
6:09:03.037168 PROGRESS: === Epoch 1, step 0, extracting elution groups 0 to 1000 ===
6:09:03.118744 PROGRESS: Extracting batch of 1980 precursors
6:09:03.120518 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:09:03.120593 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:09:03.120632 INFO: FWHM in RT is 15.78 seconds, sigma is 0.57
6:09:03.120678 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:09:03.120901 INFO: Starting candidate selection
6:09:07.884671 INFO: Starting candidate scoring
6:09:09.170079 INFO: Finished candidate processing
6:09:09.170167 INFO: Collecting candidate features
6:09:11.345068 WARNING: intensity_correlation has 6 NaNs ( 0.36 % out of 1663)
6:09:11.351098 INFO: Collecting fragment features
6:09:11.987097 INFO: Finished candidate scoring
6:09:12.277976 PROGRESS: === Epoch 1, step 0, extracted 1663 precursors and 7774 fragments ===
6:09:12.278275 INFO: performing precursor FDR with 47 features
6:09:12.278318 INFO: Decoy channel: -1
6:09:12.278345 INFO: Competetive: True
6:09:12.283182 WARNING: dropped 2 target PSMs due to missing features
6:09:12.283260 WARNING: dropped 4 decoy PSMs due to missing features
6:09:12.311563 INFO: Test AUC: 0.535
6:09:12.311658 INFO: Train AUC: 0.553
6:09:12.311702 INFO: AUC difference: 3.40%
6:09:12.431070 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
6:09:12.431861 PROGRESS: ============================= Precursor FDR =============================
6:09:12.431981 PROGRESS: Total precursors accumulated: 5
6:09:12.432059 PROGRESS: Target precursors: 5 (100.00%)
6:09:12.432128 PROGRESS: Decoy precursors: 0 (0.00%)
6:09:12.432193 PROGRESS: 
6:09:12.432255 PROGRESS: Precursor Summary:
6:09:12.433740 PROGRESS: Channel   0:	 0.05 FDR:     5; 0.01 FDR:     5; 0.001 FDR:     5
6:09:12.433879 PROGRESS: 
6:09:12.433955 PROGRESS: Protein Summary:
6:09:12.435628 PROGRESS: Channel   0:	 0.05 FDR:     5; 0.01 FDR:     5; 0.001 FDR:     5
6:09:12.435755 PROGRESS: =========================================================================
6:09:12.436640 PROGRESS: === Epoch 1, step 1, extracting elution groups 1000 to 3000 ===
6:09:12.514096 PROGRESS: Extracting batch of 3955 precursors
6:09:12.516348 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:09:12.516414 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:09:12.516452 INFO: FWHM in RT is 15.78 seconds, sigma is 0.57
6:09:12.516498 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:09:12.516720 INFO: Starting candidate selection
6:09:16.945915 INFO: Starting candidate scoring
6:09:18.250088 INFO: Finished candidate processing
6:09:18.250178 INFO: Collecting candidate features
6:09:20.440470 WARNING: intensity_correlation has 14 NaNs ( 0.40 % out of 3460)
6:09:20.446623 INFO: Collecting fragment features
6:09:21.092389 INFO: Finished candidate scoring
6:09:21.376496 PROGRESS: === Epoch 1, step 1, extracted 3460 precursors and 16257 fragments ===
6:09:21.376791 INFO: performing precursor FDR with 47 features
6:09:21.376839 INFO: Decoy channel: -1
6:09:21.376866 INFO: Competetive: True
6:09:21.385560 WARNING: dropped 11 target PSMs due to missing features
6:09:21.385657 WARNING: dropped 9 decoy PSMs due to missing features
6:09:21.422574 INFO: Test AUC: 0.527
6:09:21.422694 INFO: Train AUC: 0.545
6:09:21.422740 INFO: AUC difference: 3.31%
6:09:21.543634 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
6:09:21.544391 PROGRESS: ============================= Precursor FDR =============================
6:09:21.544511 PROGRESS: Total precursors accumulated: 16
6:09:21.544589 PROGRESS: Target precursors: 15 (93.75%)
6:09:21.544656 PROGRESS: Decoy precursors: 1 (6.25%)
6:09:21.544718 PROGRESS: 
6:09:21.544778 PROGRESS: Precursor Summary:
6:09:21.546208 PROGRESS: Channel   0:	 0.05 FDR:    14; 0.01 FDR:    14; 0.001 FDR:    14
6:09:21.546343 PROGRESS: 
6:09:21.546418 PROGRESS: Protein Summary:
6:09:21.548007 PROGRESS: Channel   0:	 0.05 FDR:    14; 0.01 FDR:    14; 0.001 FDR:    14
6:09:21.548117 PROGRESS: =========================================================================
6:09:21.548955 PROGRESS: === Epoch 1, step 2, extracting elution groups 3000 to 7000 ===
6:09:21.631430 PROGRESS: Extracting batch of 7915 precursors
6:09:21.634915 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:09:21.634981 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:09:21.635019 INFO: FWHM in RT is 15.78 seconds, sigma is 0.57
6:09:21.635065 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:09:21.635312 INFO: Starting candidate selection
6:09:26.214007 INFO: Starting candidate scoring
6:09:27.574495 INFO: Finished candidate processing
6:09:27.574589 INFO: Collecting candidate features
6:09:29.747227 WARNING: intensity_correlation has 26 NaNs ( 0.39 % out of 6726)
6:09:29.754318 INFO: Collecting fragment features
6:09:30.399649 INFO: Finished candidate scoring
6:09:30.685483 PROGRESS: === Epoch 1, step 2, extracted 6726 precursors and 32082 fragments ===
6:09:30.685833 INFO: performing precursor FDR with 47 features
6:09:30.685883 INFO: Decoy channel: -1
6:09:30.685909 INFO: Competetive: True
6:09:30.700208 WARNING: dropped 22 target PSMs due to missing features
6:09:30.700309 WARNING: dropped 24 decoy PSMs due to missing features
6:09:30.756192 INFO: Test AUC: 0.556
6:09:30.756329 INFO: Train AUC: 0.541
6:09:30.756374 INFO: AUC difference: 2.82%
6:09:30.879083 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
6:09:30.879869 PROGRESS: ============================= Precursor FDR =============================
6:09:30.879985 PROGRESS: Total precursors accumulated: 38
6:09:30.880071 PROGRESS: Target precursors: 36 (94.74%)
6:09:30.880139 PROGRESS: Decoy precursors: 2 (5.26%)
6:09:30.880200 PROGRESS: 
6:09:30.880259 PROGRESS: Precursor Summary:
6:09:30.881659 PROGRESS: Channel   0:	 0.05 FDR:    31; 0.01 FDR:    20; 0.001 FDR:    20
6:09:30.881777 PROGRESS: 
6:09:30.881871 PROGRESS: Protein Summary:
6:09:30.883487 PROGRESS: Channel   0:	 0.05 FDR:    31; 0.01 FDR:    20; 0.001 FDR:    20
6:09:30.883595 PROGRESS: =========================================================================
6:09:30.884431 PROGRESS: === Epoch 1, step 3, extracting elution groups 7000 to 15000 ===
6:09:30.975753 PROGRESS: Extracting batch of 15799 precursors
6:09:30.981361 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:09:30.981431 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:09:30.981468 INFO: FWHM in RT is 15.78 seconds, sigma is 0.57
6:09:30.981510 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:09:30.981735 INFO: Starting candidate selection
6:09:35.736837 INFO: Starting candidate scoring
6:09:37.170288 INFO: Finished candidate processing
6:09:37.170377 INFO: Collecting candidate features
6:09:39.374079 WARNING: intensity_correlation has 35 NaNs ( 0.26 % out of 13637)
6:09:39.380013 INFO: Collecting fragment features
6:09:40.038182 INFO: Finished candidate scoring
6:09:40.333833 PROGRESS: === Epoch 1, step 3, extracted 13637 precursors and 64773 fragments ===
6:09:40.334185 INFO: performing precursor FDR with 47 features
6:09:40.334228 INFO: Decoy channel: -1
6:09:40.334255 INFO: Competetive: True
6:09:40.360980 WARNING: dropped 45 target PSMs due to missing features
6:09:40.361097 WARNING: dropped 36 decoy PSMs due to missing features
6:09:41.012828 INFO: Test AUC: 0.555
6:09:41.013021 INFO: Train AUC: 0.565
6:09:41.013079 INFO: AUC difference: 1.88%
6:09:41.137373 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
6:09:41.138274 PROGRESS: ============================= Precursor FDR =============================
6:09:41.138400 PROGRESS: Total precursors accumulated: 122
6:09:41.138482 PROGRESS: Target precursors: 113 (92.62%)
6:09:41.138550 PROGRESS: Decoy precursors: 9 (7.38%)
6:09:41.138614 PROGRESS: 
6:09:41.138674 PROGRESS: Precursor Summary:
6:09:41.140148 PROGRESS: Channel   0:	 0.05 FDR:    84; 0.01 FDR:    57; 0.001 FDR:    57
6:09:41.140293 PROGRESS: 
6:09:41.140370 PROGRESS: Protein Summary:
6:09:41.142064 PROGRESS: Channel   0:	 0.05 FDR:    84; 0.01 FDR:    57; 0.001 FDR:    57
6:09:41.142179 PROGRESS: =========================================================================
6:09:41.143064 PROGRESS: === Epoch 1, step 4, extracting elution groups 15000 to 31000 ===
6:09:41.252443 PROGRESS: Extracting batch of 31613 precursors
6:09:41.263395 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:09:41.263513 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:09:41.263566 INFO: FWHM in RT is 15.78 seconds, sigma is 0.57
6:09:41.263595 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:09:41.263859 INFO: Starting candidate selection
6:09:46.313877 INFO: Starting candidate scoring
6:09:47.860317 INFO: Finished candidate processing
6:09:47.860408 INFO: Collecting candidate features
6:09:50.135745 WARNING: intensity_correlation has 73 NaNs ( 0.27 % out of 27246)
6:09:50.142850 INFO: Collecting fragment features
6:09:50.825997 INFO: Finished candidate scoring
6:09:51.142121 PROGRESS: === Epoch 1, step 4, extracted 27246 precursors and 129456 fragments ===
6:09:51.142464 INFO: performing precursor FDR with 47 features
6:09:51.142513 INFO: Decoy channel: -1
6:09:51.142540 INFO: Competetive: True
6:09:51.197364 WARNING: dropped 79 target PSMs due to missing features
6:09:51.197477 WARNING: dropped 75 decoy PSMs due to missing features
6:09:52.884433 INFO: Test AUC: 0.536
6:09:52.884581 INFO: Train AUC: 0.577
6:09:52.884625 INFO: AUC difference: 7.00%
6:09:52.884659 WARNING: AUC difference > 5%. This may indicate overfitting.
6:09:53.008525 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
6:09:53.009476 PROGRESS: ============================= Precursor FDR =============================
6:09:53.009604 PROGRESS: Total precursors accumulated: 237
6:09:53.009682 PROGRESS: Target precursors: 218 (91.98%)
6:09:53.009751 PROGRESS: Decoy precursors: 19 (8.02%)
6:09:53.009826 PROGRESS: 
6:09:53.009889 PROGRESS: Precursor Summary:
6:09:53.011453 PROGRESS: Channel   0:	 0.05 FDR:   205; 0.01 FDR:   133; 0.001 FDR:   120
6:09:53.011585 PROGRESS: 
6:09:53.011659 PROGRESS: Protein Summary:
6:09:53.013465 PROGRESS: Channel   0:	 0.05 FDR:   199; 0.01 FDR:   131; 0.001 FDR:   118
6:09:53.013607 PROGRESS: =========================================================================
6:09:53.014564 PROGRESS: === Epoch 1, step 5, extracting elution groups 31000 to 63000 ===
6:09:53.151042 PROGRESS: Extracting batch of 63206 precursors
6:09:53.171504 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:09:53.171619 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:09:53.171674 INFO: FWHM in RT is 15.78 seconds, sigma is 0.57
6:09:53.171702 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:09:53.171979 INFO: Starting candidate selection
6:09:58.921280 INFO: Starting candidate scoring
6:10:00.747968 INFO: Finished candidate processing
6:10:00.748149 INFO: Collecting candidate features
6:10:03.122832 WARNING: intensity_correlation has 149 NaNs ( 0.27 % out of 54528)
6:10:03.131661 INFO: Collecting fragment features
6:10:03.846784 INFO: Finished candidate scoring
6:10:04.194772 PROGRESS: === Epoch 1, step 5, extracted 54528 precursors and 258655 fragments ===
6:10:04.195158 INFO: performing precursor FDR with 47 features
6:10:04.195205 INFO: Decoy channel: -1
6:10:04.195231 INFO: Competetive: True
6:10:04.316525 WARNING: dropped 165 target PSMs due to missing features
6:10:04.316641 WARNING: dropped 138 decoy PSMs due to missing features
6:10:07.770061 INFO: Test AUC: 0.550
6:10:07.770177 INFO: Train AUC: 0.573
6:10:07.770221 INFO: AUC difference: 4.06%
6:10:07.900896 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
6:10:07.901992 PROGRESS: ============================= Precursor FDR =============================
6:10:07.902121 PROGRESS: Total precursors accumulated: 596
6:10:07.902200 PROGRESS: Target precursors: 549 (92.11%)
6:10:07.902269 PROGRESS: Decoy precursors: 47 (7.89%)
6:10:07.902332 PROGRESS: 
6:10:07.902393 PROGRESS: Precursor Summary:
6:10:07.904108 PROGRESS: Channel   0:	 0.05 FDR:   422; 0.01 FDR:   326; 0.001 FDR:   261
6:10:07.904242 PROGRESS: 
6:10:07.904317 PROGRESS: Protein Summary:
6:10:07.906375 PROGRESS: Channel   0:	 0.05 FDR:   400; 0.01 FDR:   313; 0.001 FDR:   252
6:10:07.906490 PROGRESS: =========================================================================
6:10:07.907568 PROGRESS: === Epoch 1, step 6, extracting elution groups 63000 to 127000 ===
6:10:08.083156 PROGRESS: Extracting batch of 126475 precursors
6:10:08.121652 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:10:08.121791 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:10:08.121832 INFO: FWHM in RT is 15.78 seconds, sigma is 0.57
6:10:08.121859 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:10:08.122148 INFO: Starting candidate selection
6:10:15.299428 INFO: Starting candidate scoring
6:10:17.712815 INFO: Finished candidate processing
6:10:17.712932 INFO: Collecting candidate features
6:10:20.217352 WARNING: intensity_correlation has 335 NaNs ( 0.31 % out of 108655)
6:10:20.229482 INFO: Collecting fragment features
6:10:20.987436 INFO: Finished candidate scoring
6:10:21.401680 PROGRESS: === Epoch 1, step 6, extracted 108655 precursors and 516029 fragments ===
6:10:21.402073 INFO: performing precursor FDR with 47 features
6:10:21.402123 INFO: Decoy channel: -1
6:10:21.402149 INFO: Competetive: True
6:10:21.655411 WARNING: dropped 333 target PSMs due to missing features
6:10:21.655525 WARNING: dropped 305 decoy PSMs due to missing features
6:10:29.340013 INFO: Test AUC: 0.549
6:10:29.340139 INFO: Train AUC: 0.572
6:10:29.340197 INFO: AUC difference: 4.09%
6:10:29.488938 PROGRESS: === checking if recalibration conditions were reached, target 400 precursors ===
6:10:29.490315 PROGRESS: ============================= Precursor FDR =============================
6:10:29.490453 PROGRESS: Total precursors accumulated: 1,194
6:10:29.490544 PROGRESS: Target precursors: 1,092 (91.46%)
6:10:29.490614 PROGRESS: Decoy precursors: 102 (8.54%)
6:10:29.490677 PROGRESS: 
6:10:29.490738 PROGRESS: Precursor Summary:
6:10:29.492733 PROGRESS: Channel   0:	 0.05 FDR:   935; 0.01 FDR:   612; 0.001 FDR:   259
6:10:29.492877 PROGRESS: 
6:10:29.492952 PROGRESS: Protein Summary:
6:10:29.495406 PROGRESS: Channel   0:	 0.05 FDR:   845; 0.01 FDR:   548; 0.001 FDR:   241
6:10:29.495522 PROGRESS: =========================================================================
6:10:29.497616 INFO: calibration group: precursor, fitting rt estimator 
6:10:29.665977 INFO: calibration group: fragment, fitting mz estimator 
6:10:30.253128 INFO: === checking if epoch conditions were reached ===
6:10:30.253296 INFO: ✅ ms2_error      : 7.0000 <= 7
6:10:30.253387 INFO: ❌ rt_error       : 227.1998 > 100
6:10:30.253460 INFO: ❌ current_epoch  : 1 < 3
6:10:30.253526 INFO: ==============================================
6:10:30.472020 INFO: calibration group: precursor, predicting mz
6:10:30.472324 WARNING: mz prediction was skipped as it has not been fitted yet
6:10:30.472368 INFO: calibration group: precursor, predicting rt
6:10:37.546424 INFO: calibration group: fragment, predicting mz
6:10:55.338274 PROGRESS: === Epoch 2, step 0, extracting elution groups 0 to 1000 ===
6:10:55.420722 PROGRESS: Extracting batch of 1976 precursors
6:10:55.422570 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:10:55.422652 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:10:55.422692 INFO: FWHM in RT is 14.84 seconds, sigma is 0.54
6:10:55.422738 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:10:55.422981 INFO: Starting candidate selection
6:11:00.274362 INFO: Starting candidate scoring
6:11:01.569200 INFO: Finished candidate processing
6:11:01.569396 INFO: Collecting candidate features
6:11:03.733566 WARNING: intensity_correlation has 3 NaNs ( 0.18 % out of 1676)
6:11:03.739387 INFO: Collecting fragment features
6:11:04.369399 INFO: Finished candidate scoring
6:11:04.665879 PROGRESS: === Epoch 2, step 0, extracted 1676 precursors and 7738 fragments ===
6:11:04.666175 INFO: performing precursor FDR with 47 features
6:11:04.666220 INFO: Decoy channel: -1
6:11:04.666246 INFO: Competetive: True
6:11:04.671029 WARNING: dropped 1 target PSMs due to missing features
6:11:04.671099 WARNING: dropped 2 decoy PSMs due to missing features
6:11:04.699289 INFO: Test AUC: 0.530
6:11:04.699380 INFO: Train AUC: 0.558
6:11:04.699425 INFO: AUC difference: 4.90%
6:11:04.815692 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
6:11:04.816478 PROGRESS: ============================= Precursor FDR =============================
6:11:04.816601 PROGRESS: Total precursors accumulated: 4
6:11:04.816678 PROGRESS: Target precursors: 4 (100.00%)
6:11:04.816746 PROGRESS: Decoy precursors: 0 (0.00%)
6:11:04.816809 PROGRESS: 
6:11:04.816871 PROGRESS: Precursor Summary:
6:11:04.818371 PROGRESS: Channel   0:	 0.05 FDR:     4; 0.01 FDR:     4; 0.001 FDR:     4
6:11:04.818501 PROGRESS: 
6:11:04.818575 PROGRESS: Protein Summary:
6:11:04.820256 PROGRESS: Channel   0:	 0.05 FDR:     4; 0.01 FDR:     4; 0.001 FDR:     4
6:11:04.820369 PROGRESS: =========================================================================
6:11:04.821253 PROGRESS: === Epoch 2, step 1, extracting elution groups 1000 to 3000 ===
6:11:04.899082 PROGRESS: Extracting batch of 3948 precursors
6:11:04.901288 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:11:04.901347 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:11:04.901385 INFO: FWHM in RT is 14.84 seconds, sigma is 0.54
6:11:04.901431 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:11:04.901641 INFO: Starting candidate selection
6:11:09.369437 INFO: Starting candidate scoring
6:11:10.674636 INFO: Finished candidate processing
6:11:10.674724 INFO: Collecting candidate features
6:11:12.841305 WARNING: intensity_correlation has 11 NaNs ( 0.32 % out of 3421)
6:11:12.847183 INFO: Collecting fragment features
6:11:13.483085 INFO: Finished candidate scoring
6:11:13.764523 PROGRESS: === Epoch 2, step 1, extracted 3421 precursors and 15971 fragments ===
6:11:13.764812 INFO: performing precursor FDR with 47 features
6:11:13.764855 INFO: Decoy channel: -1
6:11:13.764882 INFO: Competetive: True
6:11:13.773324 WARNING: dropped 6 target PSMs due to missing features
6:11:13.773412 WARNING: dropped 8 decoy PSMs due to missing features
6:11:13.809911 INFO: Test AUC: 0.511
6:11:13.810027 INFO: Train AUC: 0.538
6:11:13.810072 INFO: AUC difference: 5.01%
6:11:13.810106 WARNING: AUC difference > 5%. This may indicate overfitting.
6:11:13.927797 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
6:11:13.928576 PROGRESS: ============================= Precursor FDR =============================
6:11:13.928698 PROGRESS: Total precursors accumulated: 26
6:11:13.928777 PROGRESS: Target precursors: 24 (92.31%)
6:11:13.928859 PROGRESS: Decoy precursors: 2 (7.69%)
6:11:13.928924 PROGRESS: 
6:11:13.928985 PROGRESS: Precursor Summary:
6:11:13.930411 PROGRESS: Channel   0:	 0.05 FDR:    21; 0.01 FDR:    19; 0.001 FDR:    19
6:11:13.930524 PROGRESS: 
6:11:13.930596 PROGRESS: Protein Summary:
6:11:13.932208 PROGRESS: Channel   0:	 0.05 FDR:    21; 0.01 FDR:    19; 0.001 FDR:    19
6:11:13.932317 PROGRESS: =========================================================================
6:11:13.933164 PROGRESS: === Epoch 2, step 2, extracting elution groups 3000 to 7000 ===
6:11:14.015147 PROGRESS: Extracting batch of 7895 precursors
6:11:14.018494 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:11:14.018561 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:11:14.018617 INFO: FWHM in RT is 14.84 seconds, sigma is 0.54
6:11:14.018649 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:11:14.018875 INFO: Starting candidate selection
6:11:18.609083 INFO: Starting candidate scoring
6:11:19.969965 INFO: Finished candidate processing
6:11:19.970057 INFO: Collecting candidate features
6:11:22.174906 WARNING: intensity_correlation has 9 NaNs ( 0.13 % out of 6811)
6:11:22.180520 INFO: Collecting fragment features
6:11:22.828213 INFO: Finished candidate scoring
6:11:23.116827 PROGRESS: === Epoch 2, step 2, extracted 6811 precursors and 31900 fragments ===
6:11:23.117179 INFO: performing precursor FDR with 47 features
6:11:23.117226 INFO: Decoy channel: -1
6:11:23.117252 INFO: Competetive: True
6:11:23.131961 WARNING: dropped 12 target PSMs due to missing features
6:11:23.132061 WARNING: dropped 11 decoy PSMs due to missing features
6:11:23.191253 INFO: Test AUC: 0.558
6:11:23.191386 INFO: Train AUC: 0.541
6:11:23.191434 INFO: AUC difference: 3.16%
6:11:23.332131 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
6:11:23.332946 PROGRESS: ============================= Precursor FDR =============================
6:11:23.333066 PROGRESS: Total precursors accumulated: 70
6:11:23.333143 PROGRESS: Target precursors: 64 (91.43%)
6:11:23.333210 PROGRESS: Decoy precursors: 6 (8.57%)
6:11:23.333272 PROGRESS: 
6:11:23.333332 PROGRESS: Precursor Summary:
6:11:23.334802 PROGRESS: Channel   0:	 0.05 FDR:    58; 0.01 FDR:    46; 0.001 FDR:    46
6:11:23.334928 PROGRESS: 
6:11:23.335000 PROGRESS: Protein Summary:
6:11:23.336640 PROGRESS: Channel   0:	 0.05 FDR:    58; 0.01 FDR:    46; 0.001 FDR:    46
6:11:23.336750 PROGRESS: =========================================================================
6:11:23.337612 PROGRESS: === Epoch 2, step 3, extracting elution groups 7000 to 15000 ===
6:11:23.429835 PROGRESS: Extracting batch of 15799 precursors
6:11:23.435454 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:11:23.435525 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:11:23.435560 INFO: FWHM in RT is 14.84 seconds, sigma is 0.54
6:11:23.435586 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:11:23.435801 INFO: Starting candidate selection
6:11:28.207694 INFO: Starting candidate scoring
6:11:29.641298 INFO: Finished candidate processing
6:11:29.641484 INFO: Collecting candidate features
6:11:31.865637 WARNING: intensity_correlation has 30 NaNs ( 0.22 % out of 13593)
6:11:31.871651 INFO: Collecting fragment features
6:11:32.529436 INFO: Finished candidate scoring
6:11:32.825998 PROGRESS: === Epoch 2, step 3, extracted 13593 precursors and 63279 fragments ===
6:11:32.826351 INFO: performing precursor FDR with 47 features
6:11:32.826400 INFO: Decoy channel: -1
6:11:32.826427 INFO: Competetive: True
6:11:32.853510 WARNING: dropped 26 target PSMs due to missing features
6:11:32.853620 WARNING: dropped 27 decoy PSMs due to missing features
6:11:33.644014 INFO: Test AUC: 0.531
6:11:33.644166 INFO: Train AUC: 0.586
6:11:33.644213 INFO: AUC difference: 9.29%
6:11:33.644246 WARNING: AUC difference > 5%. This may indicate overfitting.
6:11:33.776561 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
6:11:33.777449 PROGRESS: ============================= Precursor FDR =============================
6:11:33.777569 PROGRESS: Total precursors accumulated: 147
6:11:33.777648 PROGRESS: Target precursors: 134 (91.16%)
6:11:33.777720 PROGRESS: Decoy precursors: 13 (8.84%)
6:11:33.777792 PROGRESS: 
6:11:33.777855 PROGRESS: Precursor Summary:
6:11:33.779350 PROGRESS: Channel   0:	 0.05 FDR:   118; 0.01 FDR:   111; 0.001 FDR:    83
6:11:33.779476 PROGRESS: 
6:11:33.779550 PROGRESS: Protein Summary:
6:11:33.781268 PROGRESS: Channel   0:	 0.05 FDR:   117; 0.01 FDR:   110; 0.001 FDR:    82
6:11:33.781394 PROGRESS: =========================================================================
6:11:33.782321 PROGRESS: === Epoch 2, step 4, extracting elution groups 15000 to 31000 ===
6:11:33.892722 PROGRESS: Extracting batch of 31578 precursors
6:11:33.903461 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:11:33.903562 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:11:33.903600 INFO: FWHM in RT is 14.84 seconds, sigma is 0.54
6:11:33.903627 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:11:33.903870 INFO: Starting candidate selection
6:11:38.947921 INFO: Starting candidate scoring
6:11:40.507831 INFO: Finished candidate processing
6:11:40.507922 INFO: Collecting candidate features
6:11:42.756627 WARNING: intensity_correlation has 56 NaNs ( 0.21 % out of 26993)
6:11:42.763462 INFO: Collecting fragment features
6:11:43.433200 INFO: Finished candidate scoring
6:11:43.745205 PROGRESS: === Epoch 2, step 4, extracted 26993 precursors and 126999 fragments ===
6:11:43.745572 INFO: performing precursor FDR with 47 features
6:11:43.745627 INFO: Decoy channel: -1
6:11:43.745655 INFO: Competetive: True
6:11:43.799414 WARNING: dropped 60 target PSMs due to missing features
6:11:43.799525 WARNING: dropped 49 decoy PSMs due to missing features
6:11:45.488426 INFO: Test AUC: 0.544
6:11:45.488573 INFO: Train AUC: 0.587
6:11:45.488621 INFO: AUC difference: 7.25%
6:11:45.488655 WARNING: AUC difference > 5%. This may indicate overfitting.
6:11:45.613003 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
6:11:45.613972 PROGRESS: ============================= Precursor FDR =============================
6:11:45.614094 PROGRESS: Total precursors accumulated: 287
6:11:45.614171 PROGRESS: Target precursors: 262 (91.29%)
6:11:45.614238 PROGRESS: Decoy precursors: 25 (8.71%)
6:11:45.614301 PROGRESS: 
6:11:45.614362 PROGRESS: Precursor Summary:
6:11:45.615956 PROGRESS: Channel   0:	 0.05 FDR:   242; 0.01 FDR:   182; 0.001 FDR:   151
6:11:45.616089 PROGRESS: 
6:11:45.616163 PROGRESS: Protein Summary:
6:11:45.618053 PROGRESS: Channel   0:	 0.05 FDR:   237; 0.01 FDR:   178; 0.001 FDR:   147
6:11:45.618165 PROGRESS: =========================================================================
6:11:45.619148 PROGRESS: === Epoch 2, step 5, extracting elution groups 31000 to 63000 ===
6:11:45.757182 PROGRESS: Extracting batch of 63175 precursors
6:11:45.777450 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:11:45.777559 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:11:45.777597 INFO: FWHM in RT is 14.84 seconds, sigma is 0.54
6:11:45.777640 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:11:45.777903 INFO: Starting candidate selection
6:11:51.446645 INFO: Starting candidate scoring
6:11:53.278518 INFO: Finished candidate processing
6:11:53.278614 INFO: Collecting candidate features
6:11:55.634975 WARNING: intensity_correlation has 133 NaNs ( 0.25 % out of 54065)
6:11:55.643517 INFO: Collecting fragment features
6:11:56.351890 INFO: Finished candidate scoring
6:11:56.700191 PROGRESS: === Epoch 2, step 5, extracted 54065 precursors and 254053 fragments ===
6:11:56.700562 INFO: performing precursor FDR with 47 features
6:11:56.701253 INFO: Decoy channel: -1
6:11:56.701342 INFO: Competetive: True
6:11:56.822257 WARNING: dropped 125 target PSMs due to missing features
6:11:56.822374 WARNING: dropped 117 decoy PSMs due to missing features
6:12:00.306924 INFO: Test AUC: 0.551
6:12:00.307035 INFO: Train AUC: 0.582
6:12:00.307073 INFO: AUC difference: 5.34%
6:12:00.307118 WARNING: AUC difference > 5%. This may indicate overfitting.
6:12:00.449204 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
6:12:00.450319 PROGRESS: ============================= Precursor FDR =============================
6:12:00.450449 PROGRESS: Total precursors accumulated: 574
6:12:00.450528 PROGRESS: Target precursors: 523 (91.11%)
6:12:00.450599 PROGRESS: Decoy precursors: 51 (8.89%)
6:12:00.450676 PROGRESS: 
6:12:00.450740 PROGRESS: Precursor Summary:
6:12:00.452497 PROGRESS: Channel   0:	 0.05 FDR:   463; 0.01 FDR:   275; 0.001 FDR:   265
6:12:00.452632 PROGRESS: 
6:12:00.452706 PROGRESS: Protein Summary:
6:12:00.454787 PROGRESS: Channel   0:	 0.05 FDR:   437; 0.01 FDR:   257; 0.001 FDR:   247
6:12:00.454903 PROGRESS: =========================================================================
6:12:00.455960 PROGRESS: === Epoch 2, step 6, extracting elution groups 63000 to 127000 ===
6:12:00.632490 PROGRESS: Extracting batch of 126514 precursors
6:12:00.670838 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:12:00.670978 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:12:00.671021 INFO: FWHM in RT is 14.84 seconds, sigma is 0.54
6:12:00.671049 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:12:00.671313 INFO: Starting candidate selection
6:12:07.633657 INFO: Starting candidate scoring
6:12:10.054534 INFO: Finished candidate processing
6:12:10.054672 INFO: Collecting candidate features
6:12:12.555032 WARNING: intensity_correlation has 230 NaNs ( 0.21 % out of 108204)
6:12:12.567973 INFO: Collecting fragment features
6:12:13.322936 INFO: Finished candidate scoring
6:12:13.737858 PROGRESS: === Epoch 2, step 6, extracted 108204 precursors and 508138 fragments ===
6:12:13.738228 INFO: performing precursor FDR with 47 features
6:12:13.738276 INFO: Decoy channel: -1
6:12:13.738302 INFO: Competetive: True
6:12:13.988969 WARNING: dropped 248 target PSMs due to missing features
6:12:13.989080 WARNING: dropped 224 decoy PSMs due to missing features
6:12:21.869106 INFO: Test AUC: 0.546
6:12:21.869233 INFO: Train AUC: 0.577
6:12:21.869293 INFO: AUC difference: 5.26%
6:12:21.869321 WARNING: AUC difference > 5%. This may indicate overfitting.
6:12:22.018283 PROGRESS: === checking if recalibration conditions were reached, target 600 precursors ===
6:12:22.019552 PROGRESS: ============================= Precursor FDR =============================
6:12:22.019675 PROGRESS: Total precursors accumulated: 1,136
6:12:22.019752 PROGRESS: Target precursors: 1,036 (91.20%)
6:12:22.019820 PROGRESS: Decoy precursors: 100 (8.80%)
6:12:22.019883 PROGRESS: 
6:12:22.019945 PROGRESS: Precursor Summary:
6:12:22.021971 PROGRESS: Channel   0:	 0.05 FDR:   926; 0.01 FDR:   678; 0.001 FDR:   591
6:12:22.022095 PROGRESS: 
6:12:22.022170 PROGRESS: Protein Summary:
6:12:22.024646 PROGRESS: Channel   0:	 0.05 FDR:   828; 0.01 FDR:   608; 0.001 FDR:   534
6:12:22.024765 PROGRESS: =========================================================================
6:12:22.026894 INFO: calibration group: precursor, fitting rt estimator 
6:12:22.162038 INFO: calibration group: fragment, fitting mz estimator 
6:12:22.754308 INFO: === checking if epoch conditions were reached ===
6:12:22.754468 INFO: ✅ ms2_error      : 7.0000 <= 7
6:12:22.754556 INFO: ❌ rt_error       : 212.1255 > 100
6:12:22.754629 INFO: ✅ current_epoch  : 2 >= 3
6:12:22.754693 INFO: ==============================================
6:12:22.997928 INFO: calibration group: precursor, predicting mz
6:12:22.998228 WARNING: mz prediction was skipped as it has not been fitted yet
6:12:22.998270 INFO: calibration group: precursor, predicting rt
6:12:29.960308 INFO: calibration group: fragment, predicting mz
6:12:47.415362 PROGRESS: === Epoch 3, step 0, extracting elution groups 0 to 1000 ===
6:12:47.496897 PROGRESS: Extracting batch of 1983 precursors
6:12:47.498668 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:12:47.498763 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:12:47.498808 INFO: FWHM in RT is 14.40 seconds, sigma is 0.52
6:12:47.498837 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:12:47.499064 INFO: Starting candidate selection
6:12:52.333191 INFO: Starting candidate scoring
6:12:53.629792 INFO: Finished candidate processing
6:12:53.629889 INFO: Collecting candidate features
6:12:55.805644 WARNING: intensity_correlation has 2 NaNs ( 0.12 % out of 1705)
6:12:55.811561 INFO: Collecting fragment features
6:12:56.461298 INFO: Finished candidate scoring
6:12:56.751589 PROGRESS: === Epoch 3, step 0, extracted 1705 precursors and 7936 fragments ===
6:12:56.751901 INFO: performing precursor FDR with 47 features
6:12:56.751945 INFO: Decoy channel: -1
6:12:56.751970 INFO: Competetive: True
6:12:56.756613 WARNING: dropped 1 target PSMs due to missing features
6:12:56.756688 WARNING: dropped 1 decoy PSMs due to missing features
6:12:56.785393 INFO: Test AUC: 0.549
6:12:56.785487 INFO: Train AUC: 0.526
6:12:56.785532 INFO: AUC difference: 4.42%
6:12:56.902708 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
6:12:56.903496 PROGRESS: ============================= Precursor FDR =============================
6:12:56.903620 PROGRESS: Total precursors accumulated: 4
6:12:56.903697 PROGRESS: Target precursors: 4 (100.00%)
6:12:56.903764 PROGRESS: Decoy precursors: 0 (0.00%)
6:12:56.903828 PROGRESS: 
6:12:56.903901 PROGRESS: Precursor Summary:
6:12:56.905392 PROGRESS: Channel   0:	 0.05 FDR:     4; 0.01 FDR:     4; 0.001 FDR:     4
6:12:56.905513 PROGRESS: 
6:12:56.905602 PROGRESS: Protein Summary:
6:12:56.907296 PROGRESS: Channel   0:	 0.05 FDR:     4; 0.01 FDR:     4; 0.001 FDR:     4
6:12:56.907424 PROGRESS: =========================================================================
6:12:56.908305 PROGRESS: === Epoch 3, step 1, extracting elution groups 1000 to 3000 ===
6:12:56.985795 PROGRESS: Extracting batch of 3949 precursors
6:12:56.987973 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:12:56.988034 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:12:56.988071 INFO: FWHM in RT is 14.40 seconds, sigma is 0.52
6:12:56.988115 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:12:56.988326 INFO: Starting candidate selection
6:13:01.503849 INFO: Starting candidate scoring
6:13:02.829576 INFO: Finished candidate processing
6:13:02.829669 INFO: Collecting candidate features
6:13:05.021231 WARNING: intensity_correlation has 7 NaNs ( 0.21 % out of 3381)
6:13:05.027137 INFO: Collecting fragment features
6:13:05.673947 INFO: Finished candidate scoring
6:13:05.956887 PROGRESS: === Epoch 3, step 1, extracted 3381 precursors and 15755 fragments ===
6:13:05.957181 INFO: performing precursor FDR with 47 features
6:13:05.957225 INFO: Decoy channel: -1
6:13:05.957252 INFO: Competetive: True
6:13:05.965483 WARNING: dropped 5 target PSMs due to missing features
6:13:05.965571 WARNING: dropped 4 decoy PSMs due to missing features
6:13:06.002829 INFO: Test AUC: 0.526
6:13:06.002949 INFO: Train AUC: 0.541
6:13:06.002995 INFO: AUC difference: 2.77%
6:13:06.126803 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
6:13:06.127629 PROGRESS: ============================= Precursor FDR =============================
6:13:06.127756 PROGRESS: Total precursors accumulated: 8
6:13:06.127834 PROGRESS: Target precursors: 8 (100.00%)
6:13:06.127902 PROGRESS: Decoy precursors: 0 (0.00%)
6:13:06.127964 PROGRESS: 
6:13:06.128026 PROGRESS: Precursor Summary:
6:13:06.129511 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
6:13:06.129618 PROGRESS: 
6:13:06.129709 PROGRESS: Protein Summary:
6:13:06.131398 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
6:13:06.131525 PROGRESS: =========================================================================
6:13:06.132420 PROGRESS: === Epoch 3, step 2, extracting elution groups 3000 to 7000 ===
6:13:06.214399 PROGRESS: Extracting batch of 7894 precursors
6:13:06.217643 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:13:06.217706 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:13:06.217746 INFO: FWHM in RT is 14.40 seconds, sigma is 0.52
6:13:06.217804 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:13:06.218024 INFO: Starting candidate selection
6:13:10.826652 INFO: Starting candidate scoring
6:13:12.191955 INFO: Finished candidate processing
6:13:12.192050 INFO: Collecting candidate features
6:13:14.397201 WARNING: intensity_correlation has 10 NaNs ( 0.15 % out of 6833)
6:13:14.404516 INFO: Collecting fragment features
6:13:15.058316 INFO: Finished candidate scoring
6:13:15.347040 PROGRESS: === Epoch 3, step 2, extracted 6833 precursors and 32012 fragments ===
6:13:15.347393 INFO: performing precursor FDR with 47 features
6:13:15.347441 INFO: Decoy channel: -1
6:13:15.347468 INFO: Competetive: True
6:13:15.362391 WARNING: dropped 10 target PSMs due to missing features
6:13:15.362496 WARNING: dropped 9 decoy PSMs due to missing features
6:13:15.418762 INFO: Test AUC: 0.517
6:13:15.418892 INFO: Train AUC: 0.540
6:13:15.418938 INFO: AUC difference: 4.30%
6:13:15.564299 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
6:13:15.565101 PROGRESS: ============================= Precursor FDR =============================
6:13:15.565220 PROGRESS: Total precursors accumulated: 56
6:13:15.565298 PROGRESS: Target precursors: 52 (92.86%)
6:13:15.565365 PROGRESS: Decoy precursors: 4 (7.14%)
6:13:15.565427 PROGRESS: 
6:13:15.565488 PROGRESS: Precursor Summary:
6:13:15.566960 PROGRESS: Channel   0:	 0.05 FDR:    32; 0.01 FDR:    28; 0.001 FDR:    28
6:13:15.567087 PROGRESS: 
6:13:15.567161 PROGRESS: Protein Summary:
6:13:15.568792 PROGRESS: Channel   0:	 0.05 FDR:    31; 0.01 FDR:    27; 0.001 FDR:    27
6:13:15.568901 PROGRESS: =========================================================================
6:13:15.569756 PROGRESS: === Epoch 3, step 3, extracting elution groups 7000 to 15000 ===
6:13:15.662002 PROGRESS: Extracting batch of 15794 precursors
6:13:15.667597 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:13:15.667668 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:13:15.667702 INFO: FWHM in RT is 14.40 seconds, sigma is 0.52
6:13:15.667745 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:13:15.667965 INFO: Starting candidate selection
6:13:20.391829 INFO: Starting candidate scoring
6:13:21.806184 INFO: Finished candidate processing
6:13:21.806282 INFO: Collecting candidate features
6:13:24.007804 WARNING: intensity_correlation has 17 NaNs ( 0.12 % out of 13668)
6:13:24.013698 INFO: Collecting fragment features
6:13:24.671267 INFO: Finished candidate scoring
6:13:24.966313 PROGRESS: === Epoch 3, step 3, extracted 13668 precursors and 63745 fragments ===
6:13:24.966659 INFO: performing precursor FDR with 47 features
6:13:24.966703 INFO: Decoy channel: -1
6:13:24.966729 INFO: Competetive: True
6:13:24.993426 WARNING: dropped 20 target PSMs due to missing features
6:13:24.993531 WARNING: dropped 16 decoy PSMs due to missing features
6:13:25.749833 INFO: Test AUC: 0.530
6:13:25.749978 INFO: Train AUC: 0.588
6:13:25.750024 INFO: AUC difference: 10.02%
6:13:25.750058 WARNING: AUC difference > 5%. This may indicate overfitting.
6:13:25.872221 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
6:13:25.873075 PROGRESS: ============================= Precursor FDR =============================
6:13:25.873203 PROGRESS: Total precursors accumulated: 157
6:13:25.873281 PROGRESS: Target precursors: 143 (91.08%)
6:13:25.873347 PROGRESS: Decoy precursors: 14 (8.92%)
6:13:25.873408 PROGRESS: 
6:13:25.873467 PROGRESS: Precursor Summary:
6:13:25.875012 PROGRESS: Channel   0:	 0.05 FDR:   118; 0.01 FDR:    86; 0.001 FDR:    86
6:13:25.875127 PROGRESS: 
6:13:25.875201 PROGRESS: Protein Summary:
6:13:25.876925 PROGRESS: Channel   0:	 0.05 FDR:   116; 0.01 FDR:    85; 0.001 FDR:    85
6:13:25.877032 PROGRESS: =========================================================================
6:13:25.877930 PROGRESS: === Epoch 3, step 4, extracting elution groups 15000 to 31000 ===
6:13:25.992692 PROGRESS: Extracting batch of 31597 precursors
6:13:26.003331 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:13:26.003445 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:13:26.003483 INFO: FWHM in RT is 14.40 seconds, sigma is 0.52
6:13:26.003510 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:13:26.003748 INFO: Starting candidate selection
6:13:31.051704 INFO: Starting candidate scoring
6:13:32.599261 INFO: Finished candidate processing
6:13:32.599348 INFO: Collecting candidate features
6:13:34.877647 WARNING: intensity_correlation has 34 NaNs ( 0.12 % out of 27348)
6:13:34.884460 INFO: Collecting fragment features
6:13:35.570205 INFO: Finished candidate scoring
6:13:35.884069 PROGRESS: === Epoch 3, step 4, extracted 27348 precursors and 128201 fragments ===
6:13:35.884408 INFO: performing precursor FDR with 47 features
6:13:35.884455 INFO: Decoy channel: -1
6:13:35.884482 INFO: Competetive: True
6:13:35.939441 WARNING: dropped 41 target PSMs due to missing features
6:13:35.939556 WARNING: dropped 29 decoy PSMs due to missing features
6:13:37.628091 INFO: Test AUC: 0.546
6:13:37.628245 INFO: Train AUC: 0.589
6:13:37.628293 INFO: AUC difference: 7.34%
6:13:37.628327 WARNING: AUC difference > 5%. This may indicate overfitting.
6:13:37.753794 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
6:13:37.754799 PROGRESS: ============================= Precursor FDR =============================
6:13:37.754929 PROGRESS: Total precursors accumulated: 350
6:13:37.755006 PROGRESS: Target precursors: 320 (91.43%)
6:13:37.755075 PROGRESS: Decoy precursors: 30 (8.57%)
6:13:37.755138 PROGRESS: 
6:13:37.755200 PROGRESS: Precursor Summary:
6:13:37.756792 PROGRESS: Channel   0:	 0.05 FDR:   245; 0.01 FDR:   170; 0.001 FDR:   154
6:13:37.756918 PROGRESS: 
6:13:37.756992 PROGRESS: Protein Summary:
6:13:37.758872 PROGRESS: Channel   0:	 0.05 FDR:   238; 0.01 FDR:   164; 0.001 FDR:   149
6:13:37.758983 PROGRESS: =========================================================================
6:13:37.759953 PROGRESS: === Epoch 3, step 5, extracting elution groups 31000 to 63000 ===
6:13:37.896881 PROGRESS: Extracting batch of 63263 precursors
6:13:37.916868 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:13:37.916975 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:13:37.917011 INFO: FWHM in RT is 14.40 seconds, sigma is 0.52
6:13:37.917053 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:13:37.917307 INFO: Starting candidate selection
6:13:43.581111 INFO: Starting candidate scoring
6:13:45.415086 INFO: Finished candidate processing
6:13:45.415177 INFO: Collecting candidate features
6:13:47.751701 WARNING: intensity_correlation has 71 NaNs ( 0.13 % out of 54854)
6:13:47.752077 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 54854)
6:13:47.767568 INFO: Collecting fragment features
6:13:48.473620 INFO: Finished candidate scoring
6:13:48.818618 PROGRESS: === Epoch 3, step 5, extracted 54854 precursors and 257544 fragments ===
6:13:48.818956 INFO: performing precursor FDR with 47 features
6:13:48.819000 INFO: Decoy channel: -1
6:13:48.819027 INFO: Competetive: True
6:13:48.939009 WARNING: dropped 79 target PSMs due to missing features
6:13:48.939128 WARNING: dropped 62 decoy PSMs due to missing features
6:13:52.759149 INFO: Test AUC: 0.545
6:13:52.759284 INFO: Train AUC: 0.587
6:13:52.759332 INFO: AUC difference: 7.11%
6:13:52.766248 WARNING: AUC difference > 5%. This may indicate overfitting.
6:13:52.898803 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
6:13:52.899902 PROGRESS: ============================= Precursor FDR =============================
6:13:52.900023 PROGRESS: Total precursors accumulated: 651
6:13:52.900100 PROGRESS: Target precursors: 594 (91.24%)
6:13:52.900169 PROGRESS: Decoy precursors: 57 (8.76%)
6:13:52.900231 PROGRESS: 
6:13:52.900292 PROGRESS: Precursor Summary:
6:13:52.902032 PROGRESS: Channel   0:	 0.05 FDR:   487; 0.01 FDR:   370; 0.001 FDR:   153
6:13:52.902147 PROGRESS: 
6:13:52.902220 PROGRESS: Protein Summary:
6:13:52.904266 PROGRESS: Channel   0:	 0.05 FDR:   458; 0.01 FDR:   347; 0.001 FDR:   150
6:13:52.904377 PROGRESS: =========================================================================
6:13:52.905473 PROGRESS: === Epoch 3, step 6, extracting elution groups 63000 to 127000 ===
6:13:53.080985 PROGRESS: Extracting batch of 126543 precursors
6:13:53.118855 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:13:53.118972 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:13:53.119011 INFO: FWHM in RT is 14.40 seconds, sigma is 0.52
6:13:53.119053 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:13:53.119306 INFO: Starting candidate selection
6:14:00.046137 INFO: Starting candidate scoring
6:14:02.434493 INFO: Finished candidate processing
6:14:02.434616 INFO: Collecting candidate features
6:14:04.939864 WARNING: intensity_correlation has 150 NaNs ( 0.14 % out of 109919)
6:14:04.952514 INFO: Collecting fragment features
6:14:05.711070 INFO: Finished candidate scoring
6:14:06.126110 PROGRESS: === Epoch 3, step 6, extracted 109919 precursors and 516794 fragments ===
6:14:06.126472 INFO: performing precursor FDR with 47 features
6:14:06.126518 INFO: Decoy channel: -1
6:14:06.126544 INFO: Competetive: True
6:14:06.380432 WARNING: dropped 160 target PSMs due to missing features
6:14:06.380547 WARNING: dropped 131 decoy PSMs due to missing features
6:14:13.968092 INFO: Test AUC: 0.546
6:14:13.968216 INFO: Train AUC: 0.579
6:14:13.968272 INFO: AUC difference: 5.67%
6:14:13.968299 WARNING: AUC difference > 5%. This may indicate overfitting.
6:14:14.116832 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
6:14:14.118198 PROGRESS: ============================= Precursor FDR =============================
6:14:14.118345 PROGRESS: Total precursors accumulated: 1,318
6:14:14.118424 PROGRESS: Target precursors: 1,205 (91.43%)
6:14:14.118492 PROGRESS: Decoy precursors: 113 (8.57%)
6:14:14.118553 PROGRESS: 
6:14:14.118616 PROGRESS: Precursor Summary:
6:14:14.120591 PROGRESS: Channel   0:	 0.05 FDR:   951; 0.01 FDR:   653; 0.001 FDR:   389
6:14:14.120722 PROGRESS: 
6:14:14.120797 PROGRESS: Protein Summary:
6:14:14.123240 PROGRESS: Channel   0:	 0.05 FDR:   847; 0.01 FDR:   579; 0.001 FDR:   361
6:14:14.123352 PROGRESS: =========================================================================
6:14:14.124617 PROGRESS: === Epoch 3, step 7, extracting elution groups 127000 to 255000 ===
6:14:14.349300 PROGRESS: Extracting batch of 252893 precursors
6:14:14.421897 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:14:14.422028 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:14:14.422067 INFO: FWHM in RT is 14.40 seconds, sigma is 0.52
6:14:14.422095 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:14:14.422358 INFO: Starting candidate selection
6:14:23.860093 INFO: Starting candidate scoring
6:14:27.394046 INFO: Finished candidate processing
6:14:27.394237 INFO: Collecting candidate features
6:14:30.288028 WARNING: intensity_correlation has 277 NaNs ( 0.13 % out of 219555)
6:14:30.307992 INFO: Collecting fragment features
6:14:31.159764 INFO: Finished candidate scoring
6:14:31.722737 PROGRESS: === Epoch 3, step 7, extracted 219555 precursors and 1032817 fragments ===
6:14:31.723143 INFO: performing precursor FDR with 47 features
6:14:31.723188 INFO: Decoy channel: -1
6:14:31.723214 INFO: Competetive: True
6:14:32.278266 WARNING: dropped 307 target PSMs due to missing features
6:14:32.278389 WARNING: dropped 261 decoy PSMs due to missing features
6:14:48.283053 INFO: Test AUC: 0.551
6:14:48.283182 INFO: Train AUC: 0.570
6:14:48.283238 INFO: AUC difference: 3.38%
6:14:48.459634 PROGRESS: === checking if recalibration conditions were reached, target 800 precursors ===
6:14:48.461371 PROGRESS: ============================= Precursor FDR =============================
6:14:48.461529 PROGRESS: Total precursors accumulated: 2,476
6:14:48.461642 PROGRESS: Target precursors: 2,262 (91.36%)
6:14:48.461740 PROGRESS: Decoy precursors: 214 (8.64%)
6:14:48.461900 PROGRESS: 
6:14:48.461986 PROGRESS: Precursor Summary:
6:14:48.464514 PROGRESS: Channel   0:	 0.05 FDR: 1,955; 0.01 FDR: 1,523; 0.001 FDR:   945
6:14:48.464654 PROGRESS: 
6:14:48.464745 PROGRESS: Protein Summary:
6:14:48.468255 PROGRESS: Channel   0:	 0.05 FDR: 1,602; 0.01 FDR: 1,242; 0.001 FDR:   794
6:14:48.468372 PROGRESS: =========================================================================
6:14:48.471390 INFO: calibration group: precursor, fitting rt estimator 
6:14:48.690642 INFO: calibration group: fragment, fitting mz estimator 
6:14:49.284474 INFO: === checking if epoch conditions were reached ===
6:14:49.284672 INFO: ✅ ms2_error      : 7.0000 <= 7
6:14:49.284767 INFO: ❌ rt_error       : 198.0305 > 100
6:14:49.284850 INFO: ✅ current_epoch  : 3 >= 3
6:14:49.284922 INFO: ==============================================
6:14:49.503406 INFO: calibration group: precursor, predicting mz
6:14:49.503678 WARNING: mz prediction was skipped as it has not been fitted yet
6:14:49.503736 INFO: calibration group: precursor, predicting rt
6:14:56.361520 INFO: calibration group: fragment, predicting mz
6:15:14.309338 PROGRESS: === Epoch 4, step 0, extracting elution groups 0 to 1000 ===
6:15:14.398405 PROGRESS: Extracting batch of 1972 precursors
6:15:14.400166 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:15:14.400240 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:15:14.400309 INFO: FWHM in RT is 14.42 seconds, sigma is 0.52
6:15:14.400339 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:15:14.400571 INFO: Starting candidate selection
6:15:19.233315 INFO: Starting candidate scoring
6:15:20.522536 INFO: Finished candidate processing
6:15:20.522623 INFO: Collecting candidate features
6:15:22.678077 WARNING: intensity_correlation has 7 NaNs ( 0.40 % out of 1746)
6:15:22.683837 INFO: Collecting fragment features
6:15:23.314535 INFO: Finished candidate scoring
6:15:23.617755 PROGRESS: === Epoch 4, step 0, extracted 1746 precursors and 8092 fragments ===
6:15:23.618097 INFO: performing precursor FDR with 47 features
6:15:23.618136 INFO: Decoy channel: -1
6:15:23.618162 INFO: Competetive: True
6:15:23.622808 WARNING: dropped 3 target PSMs due to missing features
6:15:23.622882 WARNING: dropped 4 decoy PSMs due to missing features
6:15:23.649788 INFO: Test AUC: 0.565
6:15:23.649881 INFO: Train AUC: 0.570
6:15:23.649925 INFO: AUC difference: 0.87%
6:15:23.768339 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
6:15:23.769115 PROGRESS: ============================= Precursor FDR =============================
6:15:23.769233 PROGRESS: Total precursors accumulated: 8
6:15:23.769309 PROGRESS: Target precursors: 8 (100.00%)
6:15:23.769377 PROGRESS: Decoy precursors: 0 (0.00%)
6:15:23.769438 PROGRESS: 
6:15:23.769497 PROGRESS: Precursor Summary:
6:15:23.771005 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
6:15:23.771117 PROGRESS: 
6:15:23.771188 PROGRESS: Protein Summary:
6:15:23.772829 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
6:15:23.772937 PROGRESS: =========================================================================
6:15:23.773823 PROGRESS: === Epoch 4, step 1, extracting elution groups 1000 to 3000 ===
6:15:23.851211 PROGRESS: Extracting batch of 3953 precursors
6:15:23.853343 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:15:23.853402 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:15:23.853439 INFO: FWHM in RT is 14.42 seconds, sigma is 0.52
6:15:23.853484 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:15:23.853692 INFO: Starting candidate selection
6:15:28.347369 INFO: Starting candidate scoring
6:15:29.662740 INFO: Finished candidate processing
6:15:29.662921 INFO: Collecting candidate features
6:15:31.822245 WARNING: intensity_correlation has 10 NaNs ( 0.28 % out of 3531)
6:15:31.828190 INFO: Collecting fragment features
6:15:32.463275 INFO: Finished candidate scoring
6:15:32.744696 PROGRESS: === Epoch 4, step 1, extracted 3531 precursors and 16607 fragments ===
6:15:32.744984 INFO: performing precursor FDR with 47 features
6:15:32.745030 INFO: Decoy channel: -1
6:15:32.745055 INFO: Competetive: True
6:15:32.753585 WARNING: dropped 10 target PSMs due to missing features
6:15:32.753676 WARNING: dropped 7 decoy PSMs due to missing features
6:15:32.790282 INFO: Test AUC: 0.584
6:15:32.790402 INFO: Train AUC: 0.540
6:15:32.790448 INFO: AUC difference: 8.11%
6:15:32.790482 WARNING: AUC difference > 5%. This may indicate overfitting.
6:15:32.909289 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
6:15:32.910080 PROGRESS: ============================= Precursor FDR =============================
6:15:32.910202 PROGRESS: Total precursors accumulated: 18
6:15:32.910289 PROGRESS: Target precursors: 17 (94.44%)
6:15:32.910358 PROGRESS: Decoy precursors: 1 (5.56%)
6:15:32.910420 PROGRESS: 
6:15:32.910480 PROGRESS: Precursor Summary:
6:15:32.911871 PROGRESS: Channel   0:	 0.05 FDR:    13; 0.01 FDR:    13; 0.001 FDR:    13
6:15:32.911979 PROGRESS: 
6:15:32.912052 PROGRESS: Protein Summary:
6:15:32.913610 PROGRESS: Channel   0:	 0.05 FDR:    13; 0.01 FDR:    13; 0.001 FDR:    13
6:15:32.913717 PROGRESS: =========================================================================
6:15:32.914590 PROGRESS: === Epoch 4, step 2, extracting elution groups 3000 to 7000 ===
6:15:32.996700 PROGRESS: Extracting batch of 7894 precursors
6:15:32.999886 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:15:32.999949 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:15:33.000007 INFO: FWHM in RT is 14.42 seconds, sigma is 0.52
6:15:33.000036 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:15:33.000252 INFO: Starting candidate selection
6:15:37.561478 INFO: Starting candidate scoring
6:15:38.905184 INFO: Finished candidate processing
6:15:38.905277 INFO: Collecting candidate features
6:15:41.081347 WARNING: intensity_correlation has 9 NaNs ( 0.13 % out of 6989)
6:15:41.087705 INFO: Collecting fragment features
6:15:41.728246 INFO: Finished candidate scoring
6:15:42.013961 PROGRESS: === Epoch 4, step 2, extracted 6989 precursors and 32723 fragments ===
6:15:42.014297 INFO: performing precursor FDR with 47 features
6:15:42.014340 INFO: Decoy channel: -1
6:15:42.014367 INFO: Competetive: True
6:15:42.028830 WARNING: dropped 16 target PSMs due to missing features
6:15:42.028924 WARNING: dropped 10 decoy PSMs due to missing features
6:15:42.087596 INFO: Test AUC: 0.545
6:15:42.087721 INFO: Train AUC: 0.544
6:15:42.087766 INFO: AUC difference: 0.07%
6:15:42.210890 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
6:15:42.211746 PROGRESS: ============================= Precursor FDR =============================
6:15:42.211867 PROGRESS: Total precursors accumulated: 50
6:15:42.211945 PROGRESS: Target precursors: 46 (92.00%)
6:15:42.212013 PROGRESS: Decoy precursors: 4 (8.00%)
6:15:42.212076 PROGRESS: 
6:15:42.212137 PROGRESS: Precursor Summary:
6:15:42.213582 PROGRESS: Channel   0:	 0.05 FDR:    35; 0.01 FDR:    32; 0.001 FDR:    32
6:15:42.213711 PROGRESS: 
6:15:42.213803 PROGRESS: Protein Summary:
6:15:42.215443 PROGRESS: Channel   0:	 0.05 FDR:    35; 0.01 FDR:    32; 0.001 FDR:    32
6:15:42.215553 PROGRESS: =========================================================================
6:15:42.216413 PROGRESS: === Epoch 4, step 3, extracting elution groups 7000 to 15000 ===
6:15:42.308415 PROGRESS: Extracting batch of 15807 precursors
6:15:42.313976 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:15:42.314045 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:15:42.314081 INFO: FWHM in RT is 14.42 seconds, sigma is 0.52
6:15:42.314108 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:15:42.314326 INFO: Starting candidate selection
6:15:47.039051 INFO: Starting candidate scoring
6:15:48.451064 INFO: Finished candidate processing
6:15:48.451155 INFO: Collecting candidate features
6:15:50.647881 WARNING: intensity_correlation has 19 NaNs ( 0.14 % out of 13967)
6:15:50.653763 INFO: Collecting fragment features
6:15:51.304669 INFO: Finished candidate scoring
6:15:51.599658 PROGRESS: === Epoch 4, step 3, extracted 13967 precursors and 66235 fragments ===
6:15:51.599998 INFO: performing precursor FDR with 47 features
6:15:51.600044 INFO: Decoy channel: -1
6:15:51.600070 INFO: Competetive: True
6:15:51.627186 WARNING: dropped 27 target PSMs due to missing features
6:15:51.627298 WARNING: dropped 18 decoy PSMs due to missing features
6:15:52.310764 INFO: Test AUC: 0.540
6:15:52.310985 INFO: Train AUC: 0.587
6:15:52.311036 INFO: AUC difference: 8.07%
6:15:52.311071 WARNING: AUC difference > 5%. This may indicate overfitting.
6:15:52.434129 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
6:15:52.434995 PROGRESS: ============================= Precursor FDR =============================
6:15:52.435115 PROGRESS: Total precursors accumulated: 197
6:15:52.435192 PROGRESS: Target precursors: 180 (91.37%)
6:15:52.435259 PROGRESS: Decoy precursors: 17 (8.63%)
6:15:52.435323 PROGRESS: 
6:15:52.435384 PROGRESS: Precursor Summary:
6:15:52.436883 PROGRESS: Channel   0:	 0.05 FDR:   130; 0.01 FDR:    90; 0.001 FDR:    90
6:15:52.437008 PROGRESS: 
6:15:52.437083 PROGRESS: Protein Summary:
6:15:52.438820 PROGRESS: Channel   0:	 0.05 FDR:   129; 0.01 FDR:    89; 0.001 FDR:    89
6:15:52.438942 PROGRESS: =========================================================================
6:15:52.439841 PROGRESS: === Epoch 4, step 4, extracting elution groups 15000 to 31000 ===
6:15:52.547681 PROGRESS: Extracting batch of 31626 precursors
6:15:52.558233 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:15:52.558328 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:15:52.558365 INFO: FWHM in RT is 14.42 seconds, sigma is 0.52
6:15:52.558393 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:15:52.558636 INFO: Starting candidate selection
6:15:57.654038 INFO: Starting candidate scoring
6:15:59.233135 INFO: Finished candidate processing
6:15:59.233226 INFO: Collecting candidate features
6:16:01.481415 WARNING: intensity_correlation has 33 NaNs ( 0.12 % out of 27922)
6:16:01.488211 INFO: Collecting fragment features
6:16:02.159651 INFO: Finished candidate scoring
6:16:02.470968 PROGRESS: === Epoch 4, step 4, extracted 27922 precursors and 130920 fragments ===
6:16:02.478187 INFO: performing precursor FDR with 47 features
6:16:02.478320 INFO: Decoy channel: -1
6:16:02.478404 INFO: Competetive: True
6:16:02.533562 WARNING: dropped 44 target PSMs due to missing features
6:16:02.533675 WARNING: dropped 34 decoy PSMs due to missing features
6:16:04.182660 INFO: Test AUC: 0.548
6:16:04.182810 INFO: Train AUC: 0.596
6:16:04.182857 INFO: AUC difference: 8.14%
6:16:04.182891 WARNING: AUC difference > 5%. This may indicate overfitting.
6:16:04.307008 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
6:16:04.307991 PROGRESS: ============================= Precursor FDR =============================
6:16:04.308115 PROGRESS: Total precursors accumulated: 377
6:16:04.308193 PROGRESS: Target precursors: 344 (91.25%)
6:16:04.308260 PROGRESS: Decoy precursors: 33 (8.75%)
6:16:04.308321 PROGRESS: 
6:16:04.308382 PROGRESS: Precursor Summary:
6:16:04.309991 PROGRESS: Channel   0:	 0.05 FDR:   241; 0.01 FDR:   203; 0.001 FDR:   150
6:16:04.310106 PROGRESS: 
6:16:04.310180 PROGRESS: Protein Summary:
6:16:04.312031 PROGRESS: Channel   0:	 0.05 FDR:   230; 0.01 FDR:   192; 0.001 FDR:   141
6:16:04.312141 PROGRESS: =========================================================================
6:16:04.313117 PROGRESS: === Epoch 4, step 5, extracting elution groups 31000 to 63000 ===
6:16:04.449799 PROGRESS: Extracting batch of 63202 precursors
6:16:04.469639 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:16:04.469743 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:16:04.469806 INFO: FWHM in RT is 14.42 seconds, sigma is 0.52
6:16:04.469835 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:16:04.470083 INFO: Starting candidate selection
6:16:10.204588 INFO: Starting candidate scoring
6:16:12.074695 INFO: Finished candidate processing
6:16:12.074830 INFO: Collecting candidate features
6:16:14.426016 WARNING: intensity_correlation has 60 NaNs ( 0.11 % out of 55825)
6:16:14.434580 INFO: Collecting fragment features
6:16:15.148144 INFO: Finished candidate scoring
6:16:15.493976 PROGRESS: === Epoch 4, step 5, extracted 55825 precursors and 262795 fragments ===
6:16:15.494323 INFO: performing precursor FDR with 47 features
6:16:15.494370 INFO: Decoy channel: -1
6:16:15.494395 INFO: Competetive: True
6:16:15.616911 WARNING: dropped 73 target PSMs due to missing features
6:16:15.617023 WARNING: dropped 65 decoy PSMs due to missing features
6:16:19.331801 INFO: Test AUC: 0.549
6:16:19.331924 INFO: Train AUC: 0.592
6:16:19.331981 INFO: AUC difference: 7.31%
6:16:19.332010 WARNING: AUC difference > 5%. This may indicate overfitting.
6:16:19.463244 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
6:16:19.464362 PROGRESS: ============================= Precursor FDR =============================
6:16:19.464491 PROGRESS: Total precursors accumulated: 739
6:16:19.464569 PROGRESS: Target precursors: 675 (91.34%)
6:16:19.464649 PROGRESS: Decoy precursors: 64 (8.66%)
6:16:19.464719 PROGRESS: 
6:16:19.464780 PROGRESS: Precursor Summary:
6:16:19.466570 PROGRESS: Channel   0:	 0.05 FDR:   523; 0.01 FDR:   410; 0.001 FDR:   338
6:16:19.466692 PROGRESS: 
6:16:19.466767 PROGRESS: Protein Summary:
6:16:19.468882 PROGRESS: Channel   0:	 0.05 FDR:   488; 0.01 FDR:   379; 0.001 FDR:   311
6:16:19.468992 PROGRESS: =========================================================================
6:16:19.470104 PROGRESS: === Epoch 4, step 6, extracting elution groups 63000 to 127000 ===
6:16:19.645663 PROGRESS: Extracting batch of 126470 precursors
6:16:19.683793 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:16:19.683909 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:16:19.683946 INFO: FWHM in RT is 14.42 seconds, sigma is 0.52
6:16:19.683990 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:16:19.684245 INFO: Starting candidate selection
6:16:26.657873 INFO: Starting candidate scoring
6:16:29.077621 INFO: Finished candidate processing
6:16:29.078120 INFO: Collecting candidate features
6:16:31.586232 WARNING: intensity_correlation has 152 NaNs ( 0.14 % out of 111772)
6:16:31.599383 INFO: Collecting fragment features
6:16:32.352952 INFO: Finished candidate scoring
6:16:32.769389 PROGRESS: === Epoch 4, step 6, extracted 111772 precursors and 527369 fragments ===
6:16:32.769742 INFO: performing precursor FDR with 47 features
6:16:32.769797 INFO: Decoy channel: -1
6:16:32.769824 INFO: Competetive: True
6:16:33.026827 WARNING: dropped 146 target PSMs due to missing features
6:16:33.026940 WARNING: dropped 144 decoy PSMs due to missing features
6:16:41.032503 INFO: Test AUC: 0.550
6:16:41.032634 INFO: Train AUC: 0.584
6:16:41.032689 INFO: AUC difference: 5.82%
6:16:41.032717 WARNING: AUC difference > 5%. This may indicate overfitting.
6:16:41.184831 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
6:16:41.186195 PROGRESS: ============================= Precursor FDR =============================
6:16:41.186326 PROGRESS: Total precursors accumulated: 1,376
6:16:41.186405 PROGRESS: Target precursors: 1,254 (91.13%)
6:16:41.186473 PROGRESS: Decoy precursors: 122 (8.87%)
6:16:41.186536 PROGRESS: 
6:16:41.186597 PROGRESS: Precursor Summary:
6:16:41.188653 PROGRESS: Channel   0:	 0.05 FDR: 1,033; 0.01 FDR:   732; 0.001 FDR:   603
6:16:41.188802 PROGRESS: 
6:16:41.188877 PROGRESS: Protein Summary:
6:16:41.191459 PROGRESS: Channel   0:	 0.05 FDR:   925; 0.01 FDR:   648; 0.001 FDR:   537
6:16:41.191573 PROGRESS: =========================================================================
6:16:41.192885 PROGRESS: === Epoch 4, step 7, extracting elution groups 127000 to 255000 ===
6:16:41.419188 PROGRESS: Extracting batch of 252962 precursors
6:16:41.492318 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:16:41.492431 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:16:41.492490 INFO: FWHM in RT is 14.42 seconds, sigma is 0.52
6:16:41.492517 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:16:41.492781 INFO: Starting candidate selection
6:16:51.018960 INFO: Starting candidate scoring
6:16:54.646680 INFO: Finished candidate processing
6:16:54.646868 INFO: Collecting candidate features
6:16:57.586389 WARNING: intensity_correlation has 281 NaNs ( 0.13 % out of 223539)
6:16:57.606550 INFO: Collecting fragment features
6:16:58.464486 INFO: Finished candidate scoring
6:16:59.039800 PROGRESS: === Epoch 4, step 7, extracted 223539 precursors and 1054923 fragments ===
6:16:59.040180 INFO: performing precursor FDR with 47 features
6:16:59.040228 INFO: Decoy channel: -1
6:16:59.040254 INFO: Competetive: True
6:16:59.608916 WARNING: dropped 287 target PSMs due to missing features
6:16:59.609034 WARNING: dropped 284 decoy PSMs due to missing features
6:17:15.471662 INFO: Test AUC: 0.549
6:17:15.471791 INFO: Train AUC: 0.575
6:17:15.471847 INFO: AUC difference: 4.52%
6:17:15.652609 PROGRESS: === checking if recalibration conditions were reached, target 1000 precursors ===
6:17:15.654357 PROGRESS: ============================= Precursor FDR =============================
6:17:15.654502 PROGRESS: Total precursors accumulated: 2,528
6:17:15.654581 PROGRESS: Target precursors: 2,306 (91.22%)
6:17:15.654650 PROGRESS: Decoy precursors: 222 (8.78%)
6:17:15.654713 PROGRESS: 
6:17:15.654773 PROGRESS: Precursor Summary:
6:17:15.657056 PROGRESS: Channel   0:	 0.05 FDR: 1,935; 0.01 FDR: 1,576; 0.001 FDR:    39
6:17:15.657187 PROGRESS: 
6:17:15.657260 PROGRESS: Protein Summary:
6:17:15.660177 PROGRESS: Channel   0:	 0.05 FDR: 1,535; 0.01 FDR: 1,249; 0.001 FDR:    38
6:17:15.660301 PROGRESS: =========================================================================
6:17:15.663149 INFO: calibration group: precursor, fitting rt estimator 
6:17:15.892580 INFO: calibration group: fragment, fitting mz estimator 
6:17:16.478130 INFO: === checking if epoch conditions were reached ===
6:17:16.478287 INFO: ✅ ms2_error      : 7.0000 <= 7
6:17:16.478374 INFO: ❌ rt_error       : 200.8291 > 100
6:17:16.478446 INFO: ✅ current_epoch  : 4 >= 3
6:17:16.478511 INFO: ==============================================
6:17:16.721727 INFO: calibration group: precursor, predicting mz
6:17:16.722000 WARNING: mz prediction was skipped as it has not been fitted yet
6:17:16.722042 INFO: calibration group: precursor, predicting rt
6:17:23.544867 INFO: calibration group: fragment, predicting mz
6:17:41.297304 PROGRESS: === Epoch 5, step 0, extracting elution groups 0 to 1000 ===
6:17:41.386246 PROGRESS: Extracting batch of 1975 precursors
6:17:41.387943 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:17:41.388019 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:17:41.388057 INFO: FWHM in RT is 14.44 seconds, sigma is 0.53
6:17:41.388103 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:17:41.388329 INFO: Starting candidate selection
6:17:46.232503 INFO: Starting candidate scoring
6:17:47.527841 INFO: Finished candidate processing
6:17:47.527929 INFO: Collecting candidate features
6:17:49.714333 WARNING: intensity_correlation has 2 NaNs ( 0.11 % out of 1803)
6:17:49.720141 INFO: Collecting fragment features
6:17:50.356560 INFO: Finished candidate scoring
6:17:50.672326 PROGRESS: === Epoch 5, step 0, extracted 1803 precursors and 8327 fragments ===
6:17:50.672657 INFO: performing precursor FDR with 47 features
6:17:50.672700 INFO: Decoy channel: -1
6:17:50.672727 INFO: Competetive: True
6:17:50.677250 WARNING: dropped 2 target PSMs due to missing features
6:17:50.705436 INFO: Test AUC: 0.553
6:17:50.705531 INFO: Train AUC: 0.547
6:17:50.705576 INFO: AUC difference: 1.04%
6:17:50.823993 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
6:17:50.824821 PROGRESS: ============================= Precursor FDR =============================
6:17:50.824961 PROGRESS: Total precursors accumulated: 17
6:17:50.825055 PROGRESS: Target precursors: 16 (94.12%)
6:17:50.825141 PROGRESS: Decoy precursors: 1 (5.88%)
6:17:50.825219 PROGRESS: 
6:17:50.825295 PROGRESS: Precursor Summary:
6:17:50.826747 PROGRESS: Channel   0:	 0.05 FDR:     4; 0.01 FDR:     4; 0.001 FDR:     4
6:17:50.826870 PROGRESS: 
6:17:50.826984 PROGRESS: Protein Summary:
6:17:50.829074 PROGRESS: Channel   0:	 0.05 FDR:     4; 0.01 FDR:     4; 0.001 FDR:     4
6:17:50.829212 PROGRESS: =========================================================================
6:17:50.830109 PROGRESS: === Epoch 5, step 1, extracting elution groups 1000 to 3000 ===
6:17:50.907418 PROGRESS: Extracting batch of 3944 precursors
6:17:50.909560 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:17:50.909621 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:17:50.909661 INFO: FWHM in RT is 14.44 seconds, sigma is 0.53
6:17:50.909707 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:17:50.909973 INFO: Starting candidate selection
6:17:55.410252 INFO: Starting candidate scoring
6:17:56.721569 INFO: Finished candidate processing
6:17:56.721667 INFO: Collecting candidate features
6:17:58.888376 WARNING: intensity_correlation has 4 NaNs ( 0.11 % out of 3564)
6:17:58.895427 INFO: Collecting fragment features
6:17:59.534367 INFO: Finished candidate scoring
6:17:59.815495 PROGRESS: === Epoch 5, step 1, extracted 3564 precursors and 16597 fragments ===
6:17:59.815788 INFO: performing precursor FDR with 47 features
6:17:59.815833 INFO: Decoy channel: -1
6:17:59.815858 INFO: Competetive: True
6:17:59.824304 WARNING: dropped 4 target PSMs due to missing features
6:17:59.824394 WARNING: dropped 2 decoy PSMs due to missing features
6:17:59.860843 INFO: Test AUC: 0.545
6:17:59.860969 INFO: Train AUC: 0.549
6:17:59.861014 INFO: AUC difference: 0.60%
6:17:59.980493 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
6:17:59.981285 PROGRESS: ============================= Precursor FDR =============================
6:17:59.981408 PROGRESS: Total precursors accumulated: 48
6:17:59.981485 PROGRESS: Target precursors: 44 (91.67%)
6:17:59.981553 PROGRESS: Decoy precursors: 4 (8.33%)
6:17:59.981618 PROGRESS: 
6:17:59.981678 PROGRESS: Precursor Summary:
6:17:59.983102 PROGRESS: Channel   0:	 0.05 FDR:    37; 0.01 FDR:    17; 0.001 FDR:    17
6:17:59.983213 PROGRESS: 
6:17:59.983303 PROGRESS: Protein Summary:
6:17:59.984909 PROGRESS: Channel   0:	 0.05 FDR:    37; 0.01 FDR:    17; 0.001 FDR:    17
6:17:59.985019 PROGRESS: =========================================================================
6:17:59.985876 PROGRESS: === Epoch 5, step 2, extracting elution groups 3000 to 7000 ===
6:18:00.067719 PROGRESS: Extracting batch of 7914 precursors
6:18:00.070888 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:18:00.070951 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:18:00.070991 INFO: FWHM in RT is 14.44 seconds, sigma is 0.53
6:18:00.071021 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:18:00.071233 INFO: Starting candidate selection
6:18:04.665784 INFO: Starting candidate scoring
6:18:06.025491 INFO: Finished candidate processing
6:18:06.025586 INFO: Collecting candidate features
6:18:08.229789 WARNING: intensity_correlation has 10 NaNs ( 0.14 % out of 7232)
6:18:08.235211 INFO: Collecting fragment features
6:18:08.888935 INFO: Finished candidate scoring
6:18:09.178007 PROGRESS: === Epoch 5, step 2, extracted 7232 precursors and 34449 fragments ===
6:18:09.178342 INFO: performing precursor FDR with 47 features
6:18:09.178385 INFO: Decoy channel: -1
6:18:09.178411 INFO: Competetive: True
6:18:09.193458 WARNING: dropped 8 target PSMs due to missing features
6:18:09.193556 WARNING: dropped 8 decoy PSMs due to missing features
6:18:09.460004 INFO: Test AUC: 0.554
6:18:09.460138 INFO: Train AUC: 0.592
6:18:09.460182 INFO: AUC difference: 6.37%
6:18:09.460217 WARNING: AUC difference > 5%. This may indicate overfitting.
6:18:09.583987 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
6:18:09.584845 PROGRESS: ============================= Precursor FDR =============================
6:18:09.584967 PROGRESS: Total precursors accumulated: 94
6:18:09.585044 PROGRESS: Target precursors: 86 (91.49%)
6:18:09.585112 PROGRESS: Decoy precursors: 8 (8.51%)
6:18:09.585175 PROGRESS: 
6:18:09.585236 PROGRESS: Precursor Summary:
6:18:09.586701 PROGRESS: Channel   0:	 0.05 FDR:    51; 0.01 FDR:    35; 0.001 FDR:    35
6:18:09.586815 PROGRESS: 
6:18:09.586890 PROGRESS: Protein Summary:
6:18:09.588534 PROGRESS: Channel   0:	 0.05 FDR:    50; 0.01 FDR:    34; 0.001 FDR:    34
6:18:09.588642 PROGRESS: =========================================================================
6:18:09.589506 PROGRESS: === Epoch 5, step 3, extracting elution groups 7000 to 15000 ===
6:18:09.680894 PROGRESS: Extracting batch of 15790 precursors
6:18:09.686335 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:18:09.686421 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:18:09.686457 INFO: FWHM in RT is 14.44 seconds, sigma is 0.53
6:18:09.686484 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:18:09.686698 INFO: Starting candidate selection
6:18:14.403911 INFO: Starting candidate scoring
6:18:15.822226 INFO: Finished candidate processing
6:18:15.822356 INFO: Collecting candidate features
6:18:18.033539 WARNING: intensity_correlation has 25 NaNs ( 0.17 % out of 14349)
6:18:18.039455 INFO: Collecting fragment features
6:18:18.696342 INFO: Finished candidate scoring
6:18:18.991318 PROGRESS: === Epoch 5, step 3, extracted 14349 precursors and 67108 fragments ===
6:18:18.991660 INFO: performing precursor FDR with 47 features
6:18:18.991707 INFO: Decoy channel: -1
6:18:18.991733 INFO: Competetive: True
6:18:19.020108 WARNING: dropped 25 target PSMs due to missing features
6:18:19.020220 WARNING: dropped 16 decoy PSMs due to missing features
6:18:19.829985 INFO: Test AUC: 0.552
6:18:19.830134 INFO: Train AUC: 0.597
6:18:19.830180 INFO: AUC difference: 7.56%
6:18:19.830216 WARNING: AUC difference > 5%. This may indicate overfitting.
6:18:19.954177 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
6:18:19.955085 PROGRESS: ============================= Precursor FDR =============================
6:18:19.955212 PROGRESS: Total precursors accumulated: 211
6:18:19.955291 PROGRESS: Target precursors: 192 (91.00%)
6:18:19.955360 PROGRESS: Decoy precursors: 19 (9.00%)
6:18:19.955424 PROGRESS: 
6:18:19.955486 PROGRESS: Precursor Summary:
6:18:19.957013 PROGRESS: Channel   0:	 0.05 FDR:   134; 0.01 FDR:   105; 0.001 FDR:    86
6:18:19.957142 PROGRESS: 
6:18:19.957217 PROGRESS: Protein Summary:
6:18:19.958973 PROGRESS: Channel   0:	 0.05 FDR:   132; 0.01 FDR:   104; 0.001 FDR:    85
6:18:19.959088 PROGRESS: =========================================================================
6:18:19.960008 PROGRESS: === Epoch 5, step 4, extracting elution groups 15000 to 31000 ===
6:18:20.067874 PROGRESS: Extracting batch of 31613 precursors
6:18:20.078482 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:18:20.078581 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:18:20.078620 INFO: FWHM in RT is 14.44 seconds, sigma is 0.53
6:18:20.078648 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:18:20.078891 INFO: Starting candidate selection
6:18:25.148063 INFO: Starting candidate scoring
6:18:26.716595 INFO: Finished candidate processing
6:18:26.716689 INFO: Collecting candidate features
6:18:28.996623 WARNING: intensity_correlation has 41 NaNs ( 0.14 % out of 28708)
6:18:29.003572 INFO: Collecting fragment features
6:18:29.686990 INFO: Finished candidate scoring
6:18:30.001732 PROGRESS: === Epoch 5, step 4, extracted 28708 precursors and 135380 fragments ===
6:18:30.002088 INFO: performing precursor FDR with 47 features
6:18:30.002137 INFO: Decoy channel: -1
6:18:30.002163 INFO: Competetive: True
6:18:30.060527 WARNING: dropped 43 target PSMs due to missing features
6:18:30.060637 WARNING: dropped 39 decoy PSMs due to missing features
6:18:31.783898 INFO: Test AUC: 0.550
6:18:31.784042 INFO: Train AUC: 0.600
6:18:31.784088 INFO: AUC difference: 8.23%
6:18:31.784123 WARNING: AUC difference > 5%. This may indicate overfitting.
6:18:31.909377 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
6:18:31.910370 PROGRESS: ============================= Precursor FDR =============================
6:18:31.910495 PROGRESS: Total precursors accumulated: 437
6:18:31.910572 PROGRESS: Target precursors: 400 (91.53%)
6:18:31.910639 PROGRESS: Decoy precursors: 37 (8.47%)
6:18:31.910702 PROGRESS: 
6:18:31.910762 PROGRESS: Precursor Summary:
6:18:31.912317 PROGRESS: Channel   0:	 0.05 FDR:   268; 0.01 FDR:   210; 0.001 FDR:   153
6:18:31.912427 PROGRESS: 
6:18:31.912499 PROGRESS: Protein Summary:
6:18:31.914345 PROGRESS: Channel   0:	 0.05 FDR:   257; 0.01 FDR:   200; 0.001 FDR:   146
6:18:31.914455 PROGRESS: =========================================================================
6:18:31.915430 PROGRESS: === Epoch 5, step 5, extracting elution groups 31000 to 63000 ===
6:18:32.051458 PROGRESS: Extracting batch of 63238 precursors
6:18:32.071079 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:18:32.071185 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:18:32.071251 INFO: FWHM in RT is 14.44 seconds, sigma is 0.53
6:18:32.071279 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:18:32.071532 INFO: Starting candidate selection
6:18:37.742493 INFO: Starting candidate scoring
6:18:39.599023 INFO: Finished candidate processing
6:18:39.599113 INFO: Collecting candidate features
6:18:41.974738 WARNING: intensity_correlation has 82 NaNs ( 0.14 % out of 57541)
6:18:41.983537 INFO: Collecting fragment features
6:18:42.700845 INFO: Finished candidate scoring
6:18:43.051097 PROGRESS: === Epoch 5, step 5, extracted 57541 precursors and 269680 fragments ===
6:18:43.051445 INFO: performing precursor FDR with 47 features
6:18:43.051496 INFO: Decoy channel: -1
6:18:43.051522 INFO: Competetive: True
6:18:43.178640 WARNING: dropped 84 target PSMs due to missing features
6:18:43.178775 WARNING: dropped 80 decoy PSMs due to missing features
6:18:47.294984 INFO: Test AUC: 0.547
6:18:47.295104 INFO: Train AUC: 0.600
6:18:47.295157 INFO: AUC difference: 8.96%
6:18:47.296044 WARNING: AUC difference > 5%. This may indicate overfitting.
6:18:47.429715 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
6:18:47.430875 PROGRESS: ============================= Precursor FDR =============================
6:18:47.431027 PROGRESS: Total precursors accumulated: 824
6:18:47.431105 PROGRESS: Target precursors: 752 (91.26%)
6:18:47.431171 PROGRESS: Decoy precursors: 72 (8.74%)
6:18:47.431233 PROGRESS: 
6:18:47.431294 PROGRESS: Precursor Summary:
6:18:47.433109 PROGRESS: Channel   0:	 0.05 FDR:   596; 0.01 FDR:   445; 0.001 FDR:   389
6:18:47.433244 PROGRESS: 
6:18:47.433317 PROGRESS: Protein Summary:
6:18:47.435504 PROGRESS: Channel   0:	 0.05 FDR:   559; 0.01 FDR:   412; 0.001 FDR:   361
6:18:47.435620 PROGRESS: =========================================================================
6:18:47.436746 PROGRESS: === Epoch 5, step 6, extracting elution groups 63000 to 127000 ===
6:18:47.612003 PROGRESS: Extracting batch of 126508 precursors
6:18:47.649947 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:18:47.650062 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:18:47.650100 INFO: FWHM in RT is 14.44 seconds, sigma is 0.53
6:18:47.650142 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:18:47.650398 INFO: Starting candidate selection
6:18:54.641104 INFO: Starting candidate scoring
6:18:57.095851 INFO: Finished candidate processing
6:18:57.095959 INFO: Collecting candidate features
6:18:59.625224 WARNING: intensity_correlation has 184 NaNs ( 0.16 % out of 114847)
6:18:59.638670 INFO: Collecting fragment features
6:19:00.402729 INFO: Finished candidate scoring
6:19:00.823838 PROGRESS: === Epoch 5, step 6, extracted 114847 precursors and 540036 fragments ===
6:19:00.824214 INFO: performing precursor FDR with 47 features
6:19:00.824260 INFO: Decoy channel: -1
6:19:00.824286 INFO: Competetive: True
6:19:01.087803 WARNING: dropped 164 target PSMs due to missing features
6:19:01.087913 WARNING: dropped 184 decoy PSMs due to missing features
6:19:09.085856 INFO: Test AUC: 0.551
6:19:09.085997 INFO: Train AUC: 0.589
6:19:09.086040 INFO: AUC difference: 6.50%
6:19:09.086069 WARNING: AUC difference > 5%. This may indicate overfitting.
6:19:09.236306 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
6:19:09.237715 PROGRESS: ============================= Precursor FDR =============================
6:19:09.237880 PROGRESS: Total precursors accumulated: 1,579
6:19:09.237959 PROGRESS: Target precursors: 1,447 (91.64%)
6:19:09.238026 PROGRESS: Decoy precursors: 132 (8.36%)
6:19:09.238089 PROGRESS: 
6:19:09.238150 PROGRESS: Precursor Summary:
6:19:09.240224 PROGRESS: Channel   0:	 0.05 FDR: 1,125; 0.01 FDR:   801; 0.001 FDR:   659
6:19:09.240362 PROGRESS: 
6:19:09.240435 PROGRESS: Protein Summary:
6:19:09.243094 PROGRESS: Channel   0:	 0.05 FDR:   992; 0.01 FDR:   700; 0.001 FDR:   581
6:19:09.243222 PROGRESS: =========================================================================
6:19:09.244558 PROGRESS: === Epoch 5, step 7, extracting elution groups 127000 to 255000 ===
6:19:09.468561 PROGRESS: Extracting batch of 252982 precursors
6:19:09.541841 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:19:09.541971 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:19:09.542012 INFO: FWHM in RT is 14.44 seconds, sigma is 0.53
6:19:09.542038 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:19:09.542302 INFO: Starting candidate selection
6:19:19.112536 INFO: Starting candidate scoring
6:19:22.805902 INFO: Finished candidate processing
6:19:22.806087 INFO: Collecting candidate features
6:19:25.772071 WARNING: intensity_correlation has 332 NaNs ( 0.14 % out of 230090)
6:19:25.772757 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 230090)
6:19:25.792097 INFO: Collecting fragment features
6:19:26.650854 INFO: Finished candidate scoring
6:19:27.234672 PROGRESS: === Epoch 5, step 7, extracted 230090 precursors and 1081610 fragments ===
6:19:27.235063 INFO: performing precursor FDR with 47 features
6:19:27.235118 INFO: Decoy channel: -1
6:19:27.235152 INFO: Competetive: True
6:19:27.812954 WARNING: dropped 325 target PSMs due to missing features
6:19:27.813091 WARNING: dropped 355 decoy PSMs due to missing features
6:19:44.880635 INFO: Test AUC: 0.552
6:19:44.880768 INFO: Train AUC: 0.580
6:19:44.880808 INFO: AUC difference: 4.89%
6:19:45.059820 PROGRESS: === checking if recalibration conditions were reached, target 1200 precursors ===
6:19:45.061671 PROGRESS: ============================= Precursor FDR =============================
6:19:45.061829 PROGRESS: Total precursors accumulated: 3,054
6:19:45.061912 PROGRESS: Target precursors: 2,793 (91.45%)
6:19:45.061981 PROGRESS: Decoy precursors: 261 (8.55%)
6:19:45.062046 PROGRESS: 
6:19:45.062109 PROGRESS: Precursor Summary:
6:19:45.064712 PROGRESS: Channel   0:	 0.05 FDR: 2,328; 0.01 FDR: 1,717; 0.001 FDR: 1,275
6:19:45.064834 PROGRESS: 
6:19:45.064907 PROGRESS: Protein Summary:
6:19:45.068330 PROGRESS: Channel   0:	 0.05 FDR: 1,863; 0.01 FDR: 1,367; 0.001 FDR: 1,045
6:19:45.068441 PROGRESS: =========================================================================
6:19:45.071335 INFO: calibration group: precursor, fitting rt estimator 
6:19:45.310215 INFO: calibration group: fragment, fitting mz estimator 
6:19:45.896858 INFO: === checking if epoch conditions were reached ===
6:19:45.897034 INFO: ✅ ms2_error      : 7.0000 <= 7
6:19:45.897122 INFO: ❌ rt_error       : 198.1087 > 100
6:19:45.897187 INFO: ✅ current_epoch  : 5 >= 3
6:19:45.897243 INFO: ==============================================
6:19:46.114511 INFO: calibration group: precursor, predicting mz
6:19:46.114779 WARNING: mz prediction was skipped as it has not been fitted yet
6:19:46.114822 INFO: calibration group: precursor, predicting rt
6:19:52.900476 INFO: calibration group: fragment, predicting mz
6:20:10.586413 PROGRESS: === Epoch 6, step 0, extracting elution groups 0 to 1000 ===
6:20:10.675079 PROGRESS: Extracting batch of 1974 precursors
6:20:10.676750 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:20:10.676825 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:20:10.676863 INFO: FWHM in RT is 14.19 seconds, sigma is 0.52
6:20:10.676908 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:20:10.677133 INFO: Starting candidate selection
6:20:15.545360 INFO: Starting candidate scoring
6:20:16.848622 INFO: Finished candidate processing
6:20:16.848740 INFO: Collecting candidate features
6:20:19.036990 WARNING: intensity_correlation has 1 NaNs ( 0.05 % out of 1840)
6:20:19.042882 INFO: Collecting fragment features
6:20:19.681209 INFO: Finished candidate scoring
6:20:19.996465 PROGRESS: === Epoch 6, step 0, extracted 1840 precursors and 8780 fragments ===
6:20:19.996791 INFO: performing precursor FDR with 47 features
6:20:19.996831 INFO: Decoy channel: -1
6:20:19.996857 INFO: Competetive: True
6:20:20.001348 WARNING: dropped 1 decoy PSMs due to missing features
6:20:20.029528 INFO: Test AUC: 0.548
6:20:20.029624 INFO: Train AUC: 0.537
6:20:20.029670 INFO: AUC difference: 2.10%
6:20:20.147320 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
6:20:20.148072 PROGRESS: ============================= Precursor FDR =============================
6:20:20.148188 PROGRESS: Total precursors accumulated: 14
6:20:20.148275 PROGRESS: Target precursors: 13 (92.86%)
6:20:20.148345 PROGRESS: Decoy precursors: 1 (7.14%)
6:20:20.148408 PROGRESS: 
6:20:20.148469 PROGRESS: Precursor Summary:
6:20:20.149903 PROGRESS: Channel   0:	 0.05 FDR:    11; 0.01 FDR:    11; 0.001 FDR:    11
6:20:20.150015 PROGRESS: 
6:20:20.150089 PROGRESS: Protein Summary:
6:20:20.151671 PROGRESS: Channel   0:	 0.05 FDR:    11; 0.01 FDR:    11; 0.001 FDR:    11
6:20:20.151782 PROGRESS: =========================================================================
6:20:20.152624 PROGRESS: === Epoch 6, step 1, extracting elution groups 1000 to 3000 ===
6:20:20.230591 PROGRESS: Extracting batch of 3964 precursors
6:20:20.232660 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:20:20.232733 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:20:20.232772 INFO: FWHM in RT is 14.19 seconds, sigma is 0.52
6:20:20.232819 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:20:20.233032 INFO: Starting candidate selection
6:20:24.795379 INFO: Starting candidate scoring
6:20:26.134136 INFO: Finished candidate processing
6:20:26.134227 INFO: Collecting candidate features
6:20:28.294780 WARNING: intensity_correlation has 1 NaNs ( 0.03 % out of 3690)
6:20:28.301603 INFO: Collecting fragment features
6:20:28.937832 INFO: Finished candidate scoring
6:20:29.218777 PROGRESS: === Epoch 6, step 1, extracted 3690 precursors and 17224 fragments ===
6:20:29.219079 INFO: performing precursor FDR with 47 features
6:20:29.219123 INFO: Decoy channel: -1
6:20:29.219149 INFO: Competetive: True
6:20:29.227463 WARNING: dropped 2 decoy PSMs due to missing features
6:20:29.263855 INFO: Test AUC: 0.562
6:20:29.263975 INFO: Train AUC: 0.549
6:20:29.264020 INFO: AUC difference: 2.43%
6:20:29.383509 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
6:20:29.384297 PROGRESS: ============================= Precursor FDR =============================
6:20:29.384422 PROGRESS: Total precursors accumulated: 45
6:20:29.384500 PROGRESS: Target precursors: 41 (91.11%)
6:20:29.384570 PROGRESS: Decoy precursors: 4 (8.89%)
6:20:29.384633 PROGRESS: 
6:20:29.384694 PROGRESS: Precursor Summary:
6:20:29.386168 PROGRESS: Channel   0:	 0.05 FDR:    32; 0.01 FDR:    29; 0.001 FDR:    29
6:20:29.386290 PROGRESS: 
6:20:29.386365 PROGRESS: Protein Summary:
6:20:29.387989 PROGRESS: Channel   0:	 0.05 FDR:    32; 0.01 FDR:    29; 0.001 FDR:    29
6:20:29.388097 PROGRESS: =========================================================================
6:20:29.388955 PROGRESS: === Epoch 6, step 2, extracting elution groups 3000 to 7000 ===
6:20:29.472111 PROGRESS: Extracting batch of 7895 precursors
6:20:29.475405 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:20:29.475471 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:20:29.475510 INFO: FWHM in RT is 14.19 seconds, sigma is 0.52
6:20:29.475556 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:20:29.475776 INFO: Starting candidate selection
6:20:34.102632 INFO: Starting candidate scoring
6:20:35.478973 INFO: Finished candidate processing
6:20:35.479060 INFO: Collecting candidate features
6:20:37.682848 WARNING: intensity_correlation has 9 NaNs ( 0.12 % out of 7363)
6:20:37.688402 INFO: Collecting fragment features
6:20:38.337494 INFO: Finished candidate scoring
6:20:38.627454 PROGRESS: === Epoch 6, step 2, extracted 7363 precursors and 34291 fragments ===
6:20:38.627789 INFO: performing precursor FDR with 47 features
6:20:38.627834 INFO: Decoy channel: -1
6:20:38.627860 INFO: Competetive: True
6:20:38.643267 WARNING: dropped 6 target PSMs due to missing features
6:20:38.643363 WARNING: dropped 5 decoy PSMs due to missing features
6:20:38.933329 INFO: Test AUC: 0.550
6:20:38.933462 INFO: Train AUC: 0.587
6:20:38.933507 INFO: AUC difference: 6.30%
6:20:38.933543 WARNING: AUC difference > 5%. This may indicate overfitting.
6:20:39.077028 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
6:20:39.078541 PROGRESS: ============================= Precursor FDR =============================
6:20:39.078761 PROGRESS: Total precursors accumulated: 72
6:20:39.078918 PROGRESS: Target precursors: 66 (91.67%)
6:20:39.079059 PROGRESS: Decoy precursors: 6 (8.33%)
6:20:39.079189 PROGRESS: 
6:20:39.079314 PROGRESS: Precursor Summary:
6:20:39.081321 PROGRESS: Channel   0:	 0.05 FDR:    57; 0.01 FDR:    54; 0.001 FDR:    54
6:20:39.081430 PROGRESS: 
6:20:39.081501 PROGRESS: Protein Summary:
6:20:39.083131 PROGRESS: Channel   0:	 0.05 FDR:    56; 0.01 FDR:    53; 0.001 FDR:    53
6:20:39.083239 PROGRESS: =========================================================================
6:20:39.084093 PROGRESS: === Epoch 6, step 3, extracting elution groups 7000 to 15000 ===
6:20:39.175750 PROGRESS: Extracting batch of 15811 precursors
6:20:39.188394 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:20:39.188468 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:20:39.188504 INFO: FWHM in RT is 14.19 seconds, sigma is 0.52
6:20:39.188546 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:20:39.188771 INFO: Starting candidate selection
6:20:43.943140 INFO: Starting candidate scoring
6:20:45.368508 INFO: Finished candidate processing
6:20:45.368636 INFO: Collecting candidate features
6:20:47.565032 WARNING: intensity_correlation has 17 NaNs ( 0.12 % out of 14714)
6:20:47.570970 INFO: Collecting fragment features
6:20:48.221314 INFO: Finished candidate scoring
6:20:48.515311 PROGRESS: === Epoch 6, step 3, extracted 14714 precursors and 68772 fragments ===
6:20:48.515647 INFO: performing precursor FDR with 47 features
6:20:48.515694 INFO: Decoy channel: -1
6:20:48.515721 INFO: Competetive: True
6:20:48.544126 WARNING: dropped 15 target PSMs due to missing features
6:20:48.544245 WARNING: dropped 13 decoy PSMs due to missing features
6:20:49.260365 INFO: Test AUC: 0.545
6:20:49.260515 INFO: Train AUC: 0.604
6:20:49.260562 INFO: AUC difference: 9.70%
6:20:49.260598 WARNING: AUC difference > 5%. This may indicate overfitting.
6:20:49.386147 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
6:20:49.387077 PROGRESS: ============================= Precursor FDR =============================
6:20:49.387200 PROGRESS: Total precursors accumulated: 257
6:20:49.387278 PROGRESS: Target precursors: 234 (91.05%)
6:20:49.387346 PROGRESS: Decoy precursors: 23 (8.95%)
6:20:49.387409 PROGRESS: 
6:20:49.387471 PROGRESS: Precursor Summary:
6:20:49.388997 PROGRESS: Channel   0:	 0.05 FDR:   143; 0.01 FDR:   110; 0.001 FDR:   108
6:20:49.389127 PROGRESS: 
6:20:49.389203 PROGRESS: Protein Summary:
6:20:49.390981 PROGRESS: Channel   0:	 0.05 FDR:   142; 0.01 FDR:   109; 0.001 FDR:   107
6:20:49.391111 PROGRESS: =========================================================================
6:20:49.392032 PROGRESS: === Epoch 6, step 4, extracting elution groups 15000 to 31000 ===
6:20:49.500216 PROGRESS: Extracting batch of 31607 precursors
6:20:49.510732 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:20:49.510832 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:20:49.510870 INFO: FWHM in RT is 14.19 seconds, sigma is 0.52
6:20:49.510898 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:20:49.511137 INFO: Starting candidate selection
6:20:54.627507 INFO: Starting candidate scoring
6:20:56.223754 INFO: Finished candidate processing
6:20:56.223846 INFO: Collecting candidate features
6:20:58.480510 WARNING: intensity_correlation has 30 NaNs ( 0.10 % out of 29347)
6:20:58.487486 INFO: Collecting fragment features
6:20:59.157607 INFO: Finished candidate scoring
6:20:59.470247 PROGRESS: === Epoch 6, step 4, extracted 29347 precursors and 136900 fragments ===
6:20:59.470599 INFO: performing precursor FDR with 47 features
6:20:59.470648 INFO: Decoy channel: -1
6:20:59.470673 INFO: Competetive: True
6:20:59.528973 WARNING: dropped 26 target PSMs due to missing features
6:20:59.529088 WARNING: dropped 32 decoy PSMs due to missing features
6:21:01.327051 INFO: Test AUC: 0.560
6:21:01.327199 INFO: Train AUC: 0.610
6:21:01.327245 INFO: AUC difference: 8.17%
6:21:01.327280 WARNING: AUC difference > 5%. This may indicate overfitting.
6:21:01.454620 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
6:21:01.455675 PROGRESS: ============================= Precursor FDR =============================
6:21:01.455804 PROGRESS: Total precursors accumulated: 532
6:21:01.455883 PROGRESS: Target precursors: 485 (91.17%)
6:21:01.455961 PROGRESS: Decoy precursors: 47 (8.83%)
6:21:01.456026 PROGRESS: 
6:21:01.456087 PROGRESS: Precursor Summary:
6:21:01.457708 PROGRESS: Channel   0:	 0.05 FDR:   355; 0.01 FDR:   227; 0.001 FDR:    99
6:21:01.457847 PROGRESS: 
6:21:01.457923 PROGRESS: Protein Summary:
6:21:01.459812 PROGRESS: Channel   0:	 0.05 FDR:   349; 0.01 FDR:   222; 0.001 FDR:    98
6:21:01.459939 PROGRESS: =========================================================================
6:21:01.460925 PROGRESS: === Epoch 6, step 5, extracting elution groups 31000 to 63000 ===
6:21:01.600304 PROGRESS: Extracting batch of 63250 precursors
6:21:01.621687 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:21:01.621804 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:21:01.621865 INFO: FWHM in RT is 14.19 seconds, sigma is 0.52
6:21:01.621897 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:21:01.622152 INFO: Starting candidate selection
6:21:07.311556 INFO: Starting candidate scoring
6:21:09.185647 INFO: Finished candidate processing
6:21:09.185752 INFO: Collecting candidate features
6:21:11.527695 WARNING: intensity_correlation has 45 NaNs ( 0.08 % out of 58810)
6:21:11.537450 INFO: Collecting fragment features
6:21:12.242793 INFO: Finished candidate scoring
6:21:12.590235 PROGRESS: === Epoch 6, step 5, extracted 58810 precursors and 275125 fragments ===
6:21:12.590576 INFO: performing precursor FDR with 47 features
6:21:12.590624 INFO: Decoy channel: -1
6:21:12.590650 INFO: Competetive: True
6:21:12.719032 WARNING: dropped 53 target PSMs due to missing features
6:21:12.719146 WARNING: dropped 50 decoy PSMs due to missing features
6:21:16.508464 INFO: Test AUC: 0.550
6:21:16.508586 INFO: Train AUC: 0.604
6:21:16.508643 INFO: AUC difference: 8.81%
6:21:16.508671 WARNING: AUC difference > 5%. This may indicate overfitting.
6:21:16.644553 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
6:21:16.645767 PROGRESS: ============================= Precursor FDR =============================
6:21:16.645905 PROGRESS: Total precursors accumulated: 1,020
6:21:16.645983 PROGRESS: Target precursors: 931 (91.27%)
6:21:16.646051 PROGRESS: Decoy precursors: 89 (8.73%)
6:21:16.646114 PROGRESS: 
6:21:16.646175 PROGRESS: Precursor Summary:
6:21:16.647993 PROGRESS: Channel   0:	 0.05 FDR:   685; 0.01 FDR:   459; 0.001 FDR:   215
6:21:16.648112 PROGRESS: 
6:21:16.648186 PROGRESS: Protein Summary:
6:21:16.650395 PROGRESS: Channel   0:	 0.05 FDR:   641; 0.01 FDR:   429; 0.001 FDR:   203
6:21:16.650509 PROGRESS: =========================================================================
6:21:16.651655 PROGRESS: === Epoch 6, step 6, extracting elution groups 63000 to 127000 ===
6:21:16.828138 PROGRESS: Extracting batch of 126488 precursors
6:21:16.866885 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:21:16.867002 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:21:16.867057 INFO: FWHM in RT is 14.19 seconds, sigma is 0.52
6:21:16.867085 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:21:16.867344 INFO: Starting candidate selection
6:21:23.898811 INFO: Starting candidate scoring
6:21:26.412555 INFO: Finished candidate processing
6:21:26.412733 INFO: Collecting candidate features
6:21:28.947198 WARNING: intensity_correlation has 96 NaNs ( 0.08 % out of 117596)
6:21:28.959880 INFO: Collecting fragment features
6:21:29.730104 INFO: Finished candidate scoring
6:21:30.153661 PROGRESS: === Epoch 6, step 6, extracted 117596 precursors and 547963 fragments ===
6:21:30.154041 INFO: performing precursor FDR with 47 features
6:21:30.154088 INFO: Decoy channel: -1
6:21:30.154115 INFO: Competetive: True
6:21:30.422005 WARNING: dropped 104 target PSMs due to missing features
6:21:30.422137 WARNING: dropped 95 decoy PSMs due to missing features
6:21:38.607369 INFO: Test AUC: 0.548
6:21:38.607493 INFO: Train AUC: 0.591
6:21:38.607548 INFO: AUC difference: 7.26%
6:21:38.607574 WARNING: AUC difference > 5%. This may indicate overfitting.
6:21:38.760773 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
6:21:38.762249 PROGRESS: ============================= Precursor FDR =============================
6:21:38.762376 PROGRESS: Total precursors accumulated: 1,773
6:21:38.762455 PROGRESS: Target precursors: 1,617 (91.20%)
6:21:38.762522 PROGRESS: Decoy precursors: 156 (8.80%)
6:21:38.762585 PROGRESS: 
6:21:38.762645 PROGRESS: Precursor Summary:
6:21:38.764731 PROGRESS: Channel   0:	 0.05 FDR: 1,313; 0.01 FDR:   950; 0.001 FDR:   348
6:21:38.764863 PROGRESS: 
6:21:38.764939 PROGRESS: Protein Summary:
6:21:38.767569 PROGRESS: Channel   0:	 0.05 FDR: 1,157; 0.01 FDR:   836; 0.001 FDR:   327
6:21:38.767699 PROGRESS: =========================================================================
6:21:38.769108 PROGRESS: === Epoch 6, step 7, extracting elution groups 127000 to 255000 ===
6:21:38.994847 PROGRESS: Extracting batch of 252984 precursors
6:21:39.067328 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:21:39.067446 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:21:39.067487 INFO: FWHM in RT is 14.19 seconds, sigma is 0.52
6:21:39.067531 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:21:39.067788 INFO: Starting candidate selection
6:21:48.671210 INFO: Starting candidate scoring
6:21:52.357236 INFO: Finished candidate processing
6:21:52.357367 INFO: Collecting candidate features
6:21:55.328863 WARNING: intensity_correlation has 224 NaNs ( 0.10 % out of 235421)
6:21:55.349474 INFO: Collecting fragment features
6:21:56.211995 INFO: Finished candidate scoring
6:21:56.801791 PROGRESS: === Epoch 6, step 7, extracted 235421 precursors and 1099040 fragments ===
6:21:56.802164 INFO: performing precursor FDR with 47 features
6:21:56.802212 INFO: Decoy channel: -1
6:21:56.802239 INFO: Competetive: True
6:21:57.401539 WARNING: dropped 218 target PSMs due to missing features
6:21:57.401663 WARNING: dropped 205 decoy PSMs due to missing features
6:22:14.667473 INFO: Test AUC: 0.547
6:22:14.667605 INFO: Train AUC: 0.579
6:22:14.667643 INFO: AUC difference: 5.50%
6:22:14.667686 WARNING: AUC difference > 5%. This may indicate overfitting.
6:22:14.847925 PROGRESS: === checking if recalibration conditions were reached, target 1400 precursors ===
6:22:14.849856 PROGRESS: ============================= Precursor FDR =============================
6:22:14.849991 PROGRESS: Total precursors accumulated: 3,255
6:22:14.850069 PROGRESS: Target precursors: 2,971 (91.27%)
6:22:14.850136 PROGRESS: Decoy precursors: 284 (8.73%)
6:22:14.850197 PROGRESS: 
6:22:14.850257 PROGRESS: Precursor Summary:
6:22:14.852934 PROGRESS: Channel   0:	 0.05 FDR: 2,428; 0.01 FDR: 1,906; 0.001 FDR: 1,263
6:22:14.853081 PROGRESS: 
6:22:14.853154 PROGRESS: Protein Summary:
6:22:14.856770 PROGRESS: Channel   0:	 0.05 FDR: 1,941; 0.01 FDR: 1,517; 0.001 FDR: 1,046
6:22:14.856885 PROGRESS: =========================================================================
6:22:14.860008 INFO: calibration group: precursor, fitting rt estimator 
6:22:15.104463 INFO: calibration group: fragment, fitting mz estimator 
6:22:15.690430 INFO: === checking if epoch conditions were reached ===
6:22:15.690616 INFO: ✅ ms2_error      : 7.0000 <= 7
6:22:15.690706 INFO: ❌ rt_error       : 197.1674 > 100
6:22:15.690790 INFO: ✅ current_epoch  : 6 >= 3
6:22:15.690856 INFO: ==============================================
6:22:15.935603 INFO: calibration group: precursor, predicting mz
6:22:15.935886 WARNING: mz prediction was skipped as it has not been fitted yet
6:22:15.935930 INFO: calibration group: precursor, predicting rt
6:22:22.701632 INFO: calibration group: fragment, predicting mz
6:22:40.462548 PROGRESS: === Epoch 7, step 0, extracting elution groups 0 to 1000 ===
6:22:40.549586 PROGRESS: Extracting batch of 1977 precursors
6:22:40.551271 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:22:40.551345 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:22:40.551383 INFO: FWHM in RT is 13.86 seconds, sigma is 0.50
6:22:40.551429 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:22:40.551656 INFO: Starting candidate selection
6:22:45.409735 INFO: Starting candidate scoring
6:22:46.697934 INFO: Finished candidate processing
6:22:46.698026 INFO: Collecting candidate features
6:22:48.853523 WARNING: intensity_correlation has 1 NaNs ( 0.05 % out of 1839)
6:22:48.859308 INFO: Collecting fragment features
6:22:49.496623 INFO: Finished candidate scoring
6:22:49.809508 PROGRESS: === Epoch 7, step 0, extracted 1839 precursors and 8746 fragments ===
6:22:49.809853 INFO: performing precursor FDR with 47 features
6:22:49.809901 INFO: Decoy channel: -1
6:22:49.809927 INFO: Competetive: True
6:22:49.814377 WARNING: dropped 1 decoy PSMs due to missing features
6:22:49.842001 INFO: Test AUC: 0.548
6:22:49.842091 INFO: Train AUC: 0.550
6:22:49.842134 INFO: AUC difference: 0.48%
6:22:49.961180 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
6:22:49.961939 PROGRESS: ============================= Precursor FDR =============================
6:22:49.962063 PROGRESS: Total precursors accumulated: 27
6:22:49.962140 PROGRESS: Target precursors: 25 (92.59%)
6:22:49.962209 PROGRESS: Decoy precursors: 2 (7.41%)
6:22:49.962274 PROGRESS: 
6:22:49.962336 PROGRESS: Precursor Summary:
6:22:49.963729 PROGRESS: Channel   0:	 0.05 FDR:    15; 0.01 FDR:    15; 0.001 FDR:    15
6:22:49.963841 PROGRESS: 
6:22:49.963913 PROGRESS: Protein Summary:
6:22:49.965463 PROGRESS: Channel   0:	 0.05 FDR:    15; 0.01 FDR:    15; 0.001 FDR:    15
6:22:49.965571 PROGRESS: =========================================================================
6:22:49.966444 PROGRESS: === Epoch 7, step 1, extracting elution groups 1000 to 3000 ===
6:22:50.043983 PROGRESS: Extracting batch of 3950 precursors
6:22:50.046067 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:22:50.046144 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:22:50.046184 INFO: FWHM in RT is 13.86 seconds, sigma is 0.50
6:22:50.046213 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:22:50.046420 INFO: Starting candidate selection
6:22:54.600785 INFO: Starting candidate scoring
6:22:55.931010 INFO: Finished candidate processing
6:22:55.931103 INFO: Collecting candidate features
6:22:58.123648 WARNING: intensity_correlation has 3 NaNs ( 0.08 % out of 3716)
6:22:58.129655 INFO: Collecting fragment features
6:22:58.777667 INFO: Finished candidate scoring
6:22:59.060846 PROGRESS: === Epoch 7, step 1, extracted 3716 precursors and 17384 fragments ===
6:22:59.061145 INFO: performing precursor FDR with 47 features
6:22:59.061192 INFO: Decoy channel: -1
6:22:59.061218 INFO: Competetive: True
6:22:59.069927 WARNING: dropped 3 target PSMs due to missing features
6:22:59.070018 WARNING: dropped 1 decoy PSMs due to missing features
6:22:59.108040 INFO: Test AUC: 0.537
6:22:59.108157 INFO: Train AUC: 0.552
6:22:59.108201 INFO: AUC difference: 2.64%
6:22:59.225762 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
6:22:59.226567 PROGRESS: ============================= Precursor FDR =============================
6:22:59.226691 PROGRESS: Total precursors accumulated: 34
6:22:59.226769 PROGRESS: Target precursors: 31 (91.18%)
6:22:59.226838 PROGRESS: Decoy precursors: 3 (8.82%)
6:22:59.226916 PROGRESS: 
6:22:59.226979 PROGRESS: Precursor Summary:
6:22:59.228420 PROGRESS: Channel   0:	 0.05 FDR:    28; 0.01 FDR:    27; 0.001 FDR:    27
6:22:59.228550 PROGRESS: 
6:22:59.228623 PROGRESS: Protein Summary:
6:22:59.230268 PROGRESS: Channel   0:	 0.05 FDR:    28; 0.01 FDR:    27; 0.001 FDR:    27
6:22:59.230381 PROGRESS: =========================================================================
6:22:59.231245 PROGRESS: === Epoch 7, step 2, extracting elution groups 3000 to 7000 ===
6:22:59.314276 PROGRESS: Extracting batch of 7913 precursors
6:22:59.317612 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:22:59.317692 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:22:59.317733 INFO: FWHM in RT is 13.86 seconds, sigma is 0.50
6:22:59.317763 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:22:59.318007 INFO: Starting candidate selection
6:23:03.962399 INFO: Starting candidate scoring
6:23:05.311062 INFO: Finished candidate processing
6:23:05.311157 INFO: Collecting candidate features
6:23:07.520337 WARNING: intensity_correlation has 3 NaNs ( 0.04 % out of 7448)
6:23:07.525868 INFO: Collecting fragment features
6:23:08.180317 INFO: Finished candidate scoring
6:23:08.468531 PROGRESS: === Epoch 7, step 2, extracted 7448 precursors and 34874 fragments ===
6:23:08.468849 INFO: performing precursor FDR with 47 features
6:23:08.468894 INFO: Decoy channel: -1
6:23:08.468921 INFO: Competetive: True
6:23:08.484738 WARNING: dropped 5 target PSMs due to missing features
6:23:08.484854 WARNING: dropped 2 decoy PSMs due to missing features
6:23:08.676895 INFO: Test AUC: 0.541
6:23:08.677049 INFO: Train AUC: 0.583
6:23:08.677106 INFO: AUC difference: 7.12%
6:23:08.677149 WARNING: AUC difference > 5%. This may indicate overfitting.
6:23:08.799762 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
6:23:08.800601 PROGRESS: ============================= Precursor FDR =============================
6:23:08.800723 PROGRESS: Total precursors accumulated: 79
6:23:08.800801 PROGRESS: Target precursors: 72 (91.14%)
6:23:08.800870 PROGRESS: Decoy precursors: 7 (8.86%)
6:23:08.800936 PROGRESS: 
6:23:08.801008 PROGRESS: Precursor Summary:
6:23:08.802474 PROGRESS: Channel   0:	 0.05 FDR:    67; 0.01 FDR:    44; 0.001 FDR:    44
6:23:08.802588 PROGRESS: 
6:23:08.802662 PROGRESS: Protein Summary:
6:23:08.804309 PROGRESS: Channel   0:	 0.05 FDR:    66; 0.01 FDR:    43; 0.001 FDR:    43
6:23:08.804421 PROGRESS: =========================================================================
6:23:08.805287 PROGRESS: === Epoch 7, step 3, extracting elution groups 7000 to 15000 ===
6:23:08.904692 PROGRESS: Extracting batch of 15811 precursors
6:23:08.910414 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:23:08.910503 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:23:08.910540 INFO: FWHM in RT is 13.86 seconds, sigma is 0.50
6:23:08.910566 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:23:08.910783 INFO: Starting candidate selection
6:23:13.686264 INFO: Starting candidate scoring
6:23:15.097905 INFO: Finished candidate processing
6:23:15.098017 INFO: Collecting candidate features
6:23:17.306455 WARNING: intensity_correlation has 13 NaNs ( 0.09 % out of 14870)
6:23:17.312529 INFO: Collecting fragment features
6:23:17.970206 INFO: Finished candidate scoring
6:23:18.266034 PROGRESS: === Epoch 7, step 3, extracted 14870 precursors and 69494 fragments ===
6:23:18.266379 INFO: performing precursor FDR with 47 features
6:23:18.266434 INFO: Decoy channel: -1
6:23:18.266477 INFO: Competetive: True
6:23:18.295043 WARNING: dropped 13 target PSMs due to missing features
6:23:18.295153 WARNING: dropped 7 decoy PSMs due to missing features
6:23:18.975794 INFO: Test AUC: 0.530
6:23:18.975946 INFO: Train AUC: 0.606
6:23:18.975991 INFO: AUC difference: 12.64%
6:23:18.976025 WARNING: AUC difference > 5%. This may indicate overfitting.
6:23:19.099677 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
6:23:19.100599 PROGRESS: ============================= Precursor FDR =============================
6:23:19.100718 PROGRESS: Total precursors accumulated: 225
6:23:19.100795 PROGRESS: Target precursors: 206 (91.56%)
6:23:19.100863 PROGRESS: Decoy precursors: 19 (8.44%)
6:23:19.100926 PROGRESS: 
6:23:19.100987 PROGRESS: Precursor Summary:
6:23:19.102512 PROGRESS: Channel   0:	 0.05 FDR:   164; 0.01 FDR:   111; 0.001 FDR:    80
6:23:19.102626 PROGRESS: 
6:23:19.102700 PROGRESS: Protein Summary:
6:23:19.104447 PROGRESS: Channel   0:	 0.05 FDR:   161; 0.01 FDR:   109; 0.001 FDR:    78
6:23:19.104564 PROGRESS: =========================================================================
6:23:19.105472 PROGRESS: === Epoch 7, step 4, extracting elution groups 15000 to 31000 ===
6:23:19.213965 PROGRESS: Extracting batch of 31616 precursors
6:23:19.224598 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:23:19.224713 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:23:19.224751 INFO: FWHM in RT is 13.86 seconds, sigma is 0.50
6:23:19.224778 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:23:19.225016 INFO: Starting candidate selection
6:23:24.302787 INFO: Starting candidate scoring
6:23:25.885329 INFO: Finished candidate processing
6:23:25.885545 INFO: Collecting candidate features
6:23:28.174883 WARNING: intensity_correlation has 24 NaNs ( 0.08 % out of 29575)
6:23:28.181725 INFO: Collecting fragment features
6:23:28.866236 INFO: Finished candidate scoring
6:23:29.181413 PROGRESS: === Epoch 7, step 4, extracted 29575 precursors and 138244 fragments ===
6:23:29.188681 INFO: performing precursor FDR with 47 features
6:23:29.188840 INFO: Decoy channel: -1
6:23:29.188930 INFO: Competetive: True
6:23:29.248271 WARNING: dropped 21 target PSMs due to missing features
6:23:29.248386 WARNING: dropped 23 decoy PSMs due to missing features
6:23:31.126613 INFO: Test AUC: 0.554
6:23:31.126763 INFO: Train AUC: 0.611
6:23:31.126810 INFO: AUC difference: 9.34%
6:23:31.126844 WARNING: AUC difference > 5%. This may indicate overfitting.
6:23:36.792039 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
6:23:36.793192 PROGRESS: ============================= Precursor FDR =============================
6:23:36.793346 PROGRESS: Total precursors accumulated: 599
6:23:36.793423 PROGRESS: Target precursors: 546 (91.15%)
6:23:36.793488 PROGRESS: Decoy precursors: 53 (8.85%)
6:23:36.793548 PROGRESS: 
6:23:36.793606 PROGRESS: Precursor Summary:
6:23:36.795318 PROGRESS: Channel   0:	 0.05 FDR:   403; 0.01 FDR:   309; 0.001 FDR:   159
6:23:36.795460 PROGRESS: 
6:23:36.795532 PROGRESS: Protein Summary:
6:23:36.797537 PROGRESS: Channel   0:	 0.05 FDR:   388; 0.01 FDR:   297; 0.001 FDR:   153
6:23:36.797650 PROGRESS: =========================================================================
6:23:36.798759 PROGRESS: === Epoch 7, step 5, extracting elution groups 31000 to 63000 ===
6:23:36.934470 PROGRESS: Extracting batch of 63271 precursors
6:23:36.954769 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:23:36.954873 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:23:36.954909 INFO: FWHM in RT is 13.86 seconds, sigma is 0.50
6:23:36.954934 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:23:36.955204 INFO: Starting candidate selection
6:23:42.808423 INFO: Starting candidate scoring
6:23:44.692907 INFO: Finished candidate processing
6:23:44.693006 INFO: Collecting candidate features
6:23:47.082246 WARNING: intensity_correlation has 33 NaNs ( 0.06 % out of 59318)
6:23:47.091144 INFO: Collecting fragment features
6:23:47.814721 INFO: Finished candidate scoring
6:23:48.183359 PROGRESS: === Epoch 7, step 5, extracted 59318 precursors and 277836 fragments ===
6:23:48.183807 INFO: performing precursor FDR with 47 features
6:23:48.183856 INFO: Decoy channel: -1
6:23:48.183884 INFO: Competetive: True
6:23:48.321396 WARNING: dropped 39 target PSMs due to missing features
6:23:48.321510 WARNING: dropped 38 decoy PSMs due to missing features
6:23:52.533074 INFO: Test AUC: 0.556
6:23:52.533192 INFO: Train AUC: 0.606
6:23:52.533248 INFO: AUC difference: 8.23%
6:23:52.533276 WARNING: AUC difference > 5%. This may indicate overfitting.
6:23:52.672988 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
6:23:52.674345 PROGRESS: ============================= Precursor FDR =============================
6:23:52.674480 PROGRESS: Total precursors accumulated: 958
6:23:52.674558 PROGRESS: Target precursors: 873 (91.13%)
6:23:52.674626 PROGRESS: Decoy precursors: 85 (8.87%)
6:23:52.674688 PROGRESS: 
6:23:52.674748 PROGRESS: Precursor Summary:
6:23:52.676684 PROGRESS: Channel   0:	 0.05 FDR:   661; 0.01 FDR:   419; 0.001 FDR:   303
6:23:52.676827 PROGRESS: 
6:23:52.676902 PROGRESS: Protein Summary:
6:23:52.679218 PROGRESS: Channel   0:	 0.05 FDR:   617; 0.01 FDR:   395; 0.001 FDR:   288
6:23:52.679350 PROGRESS: =========================================================================
6:23:52.680509 PROGRESS: === Epoch 7, step 6, extracting elution groups 63000 to 127000 ===
6:23:52.857842 PROGRESS: Extracting batch of 126434 precursors
6:23:52.896898 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:23:52.897014 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:23:52.897071 INFO: FWHM in RT is 13.86 seconds, sigma is 0.50
6:23:52.897100 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:23:52.897406 INFO: Starting candidate selection
6:23:59.986715 INFO: Starting candidate scoring
6:24:02.477479 INFO: Finished candidate processing
6:24:02.477659 INFO: Collecting candidate features
6:24:05.050643 WARNING: intensity_correlation has 76 NaNs ( 0.06 % out of 118452)
6:24:05.065280 INFO: Collecting fragment features
6:24:05.843727 INFO: Finished candidate scoring
6:24:06.286245 PROGRESS: === Epoch 7, step 6, extracted 118452 precursors and 552188 fragments ===
6:24:06.286630 INFO: performing precursor FDR with 47 features
6:24:06.286676 INFO: Decoy channel: -1
6:24:06.286703 INFO: Competetive: True
6:24:06.564517 WARNING: dropped 74 target PSMs due to missing features
6:24:06.564628 WARNING: dropped 79 decoy PSMs due to missing features
6:24:15.365461 INFO: Test AUC: 0.553
6:24:15.365588 INFO: Train AUC: 0.594
6:24:15.365644 INFO: AUC difference: 6.91%
6:24:15.365673 WARNING: AUC difference > 5%. This may indicate overfitting.
6:24:15.522280 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
6:24:15.523884 PROGRESS: ============================= Precursor FDR =============================
6:24:15.524051 PROGRESS: Total precursors accumulated: 1,819
6:24:15.524132 PROGRESS: Target precursors: 1,657 (91.09%)
6:24:15.524200 PROGRESS: Decoy precursors: 162 (8.91%)
6:24:15.524262 PROGRESS: 
6:24:15.524323 PROGRESS: Precursor Summary:
6:24:15.526753 PROGRESS: Channel   0:	 0.05 FDR: 1,281; 0.01 FDR:   953; 0.001 FDR:   680
6:24:15.526895 PROGRESS: 
6:24:15.526971 PROGRESS: Protein Summary:
6:24:15.529996 PROGRESS: Channel   0:	 0.05 FDR: 1,123; 0.01 FDR:   831; 0.001 FDR:   600
6:24:15.530120 PROGRESS: =========================================================================
6:24:15.531647 PROGRESS: === Epoch 7, step 7, extracting elution groups 127000 to 255000 ===
6:24:15.759202 PROGRESS: Extracting batch of 252863 precursors
6:24:15.832259 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:24:15.832379 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:24:15.832436 INFO: FWHM in RT is 13.86 seconds, sigma is 0.50
6:24:15.832465 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:24:15.832742 INFO: Starting candidate selection
6:24:25.527291 INFO: Starting candidate scoring
6:24:29.227510 INFO: Finished candidate processing
6:24:29.227699 INFO: Collecting candidate features
6:24:32.253785 WARNING: intensity_correlation has 140 NaNs ( 0.06 % out of 237056)
6:24:32.254517 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 237056)
6:24:32.275085 INFO: Collecting fragment features
6:24:33.153725 INFO: Finished candidate scoring
6:24:33.754852 PROGRESS: === Epoch 7, step 7, extracted 237056 precursors and 1110364 fragments ===
6:24:33.755247 INFO: performing precursor FDR with 47 features
6:24:33.755296 INFO: Decoy channel: -1
6:24:33.755323 INFO: Competetive: True
6:24:34.363197 WARNING: dropped 149 target PSMs due to missing features
6:24:34.363325 WARNING: dropped 144 decoy PSMs due to missing features
6:24:51.905453 INFO: Test AUC: 0.551
6:24:51.905587 INFO: Train AUC: 0.581
6:24:51.905645 INFO: AUC difference: 5.15%
6:24:51.905673 WARNING: AUC difference > 5%. This may indicate overfitting.
6:24:52.092157 PROGRESS: === checking if recalibration conditions were reached, target 1600 precursors ===
6:24:52.094396 PROGRESS: ============================= Precursor FDR =============================
6:24:52.094560 PROGRESS: Total precursors accumulated: 3,152
6:24:52.094637 PROGRESS: Target precursors: 2,874 (91.18%)
6:24:52.094702 PROGRESS: Decoy precursors: 278 (8.82%)
6:24:52.094762 PROGRESS: 
6:24:52.094821 PROGRESS: Precursor Summary:
6:24:52.097706 PROGRESS: Channel   0:	 0.05 FDR: 2,348; 0.01 FDR: 1,827; 0.001 FDR: 1,305
6:24:52.097896 PROGRESS: 
6:24:52.097973 PROGRESS: Protein Summary:
6:24:52.101901 PROGRESS: Channel   0:	 0.05 FDR: 1,882; 0.01 FDR: 1,455; 0.001 FDR: 1,050
6:24:52.102041 PROGRESS: =========================================================================
6:24:52.105321 INFO: calibration group: precursor, fitting rt estimator 
6:24:52.363623 INFO: calibration group: fragment, fitting mz estimator 
6:24:52.963547 INFO: === checking if epoch conditions were reached ===
6:24:52.963706 INFO: ✅ ms2_error      : 7.0000 <= 7
6:24:52.963844 INFO: ❌ rt_error       : 200.7823 > 100
6:24:52.963917 INFO: ✅ current_epoch  : 7 >= 3
6:24:52.963980 INFO: ==============================================
6:24:53.172575 INFO: calibration group: precursor, predicting mz
6:24:53.172873 WARNING: mz prediction was skipped as it has not been fitted yet
6:24:53.172911 INFO: calibration group: precursor, predicting rt
6:24:59.888982 INFO: calibration group: fragment, predicting mz
6:25:17.741463 PROGRESS: === Epoch 8, step 0, extracting elution groups 0 to 1000 ===
6:25:17.830428 PROGRESS: Extracting batch of 1969 precursors
6:25:17.832297 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:25:17.832368 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:25:17.832407 INFO: FWHM in RT is 14.48 seconds, sigma is 0.53
6:25:17.832453 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:25:17.832689 INFO: Starting candidate selection
6:25:22.831067 INFO: Starting candidate scoring
6:25:24.149958 INFO: Finished candidate processing
6:25:24.150050 INFO: Collecting candidate features
6:25:26.337545 WARNING: intensity_correlation has 2 NaNs ( 0.11 % out of 1847)
6:25:26.343655 INFO: Collecting fragment features
6:25:26.990128 INFO: Finished candidate scoring
6:25:27.311772 PROGRESS: === Epoch 8, step 0, extracted 1847 precursors and 8563 fragments ===
6:25:27.312137 INFO: performing precursor FDR with 47 features
6:25:27.312178 INFO: Decoy channel: -1
6:25:27.312204 INFO: Competetive: True
6:25:27.317403 WARNING: dropped 1 target PSMs due to missing features
6:25:27.317472 WARNING: dropped 1 decoy PSMs due to missing features
6:25:27.346508 INFO: Test AUC: 0.587
6:25:27.346605 INFO: Train AUC: 0.519
6:25:27.346650 INFO: AUC difference: 13.01%
6:25:27.346683 WARNING: AUC difference > 5%. This may indicate overfitting.
6:25:27.467293 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
6:25:27.468094 PROGRESS: ============================= Precursor FDR =============================
6:25:27.468219 PROGRESS: Total precursors accumulated: 4
6:25:27.468296 PROGRESS: Target precursors: 4 (100.00%)
6:25:27.468365 PROGRESS: Decoy precursors: 0 (0.00%)
6:25:27.468429 PROGRESS: 
6:25:27.468490 PROGRESS: Precursor Summary:
6:25:27.469996 PROGRESS: Channel   0:	 0.05 FDR:     4; 0.01 FDR:     4; 0.001 FDR:     4
6:25:27.470111 PROGRESS: 
6:25:27.470186 PROGRESS: Protein Summary:
6:25:27.471853 PROGRESS: Channel   0:	 0.05 FDR:     4; 0.01 FDR:     4; 0.001 FDR:     4
6:25:27.471971 PROGRESS: =========================================================================
6:25:27.472843 PROGRESS: === Epoch 8, step 1, extracting elution groups 1000 to 3000 ===
6:25:27.550242 PROGRESS: Extracting batch of 3941 precursors
6:25:27.552630 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:25:27.552691 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:25:27.552729 INFO: FWHM in RT is 14.48 seconds, sigma is 0.53
6:25:27.552775 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:25:27.552993 INFO: Starting candidate selection
6:25:32.169831 INFO: Starting candidate scoring
6:25:33.490120 INFO: Finished candidate processing
6:25:33.490206 INFO: Collecting candidate features
6:25:35.658792 WARNING: intensity_correlation has 4 NaNs ( 0.11 % out of 3677)
6:25:35.664981 INFO: Collecting fragment features
6:25:36.306903 INFO: Finished candidate scoring
6:25:36.591366 PROGRESS: === Epoch 8, step 1, extracted 3677 precursors and 16963 fragments ===
6:25:36.591679 INFO: performing precursor FDR with 47 features
6:25:36.591724 INFO: Decoy channel: -1
6:25:36.591751 INFO: Competetive: True
6:25:36.601112 WARNING: dropped 3 target PSMs due to missing features
6:25:36.601203 WARNING: dropped 3 decoy PSMs due to missing features
6:25:36.639653 INFO: Test AUC: 0.544
6:25:36.639775 INFO: Train AUC: 0.536
6:25:36.639822 INFO: AUC difference: 1.58%
6:25:36.774901 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
6:25:36.775703 PROGRESS: ============================= Precursor FDR =============================
6:25:36.775827 PROGRESS: Total precursors accumulated: 29
6:25:36.775905 PROGRESS: Target precursors: 27 (93.10%)
6:25:36.775973 PROGRESS: Decoy precursors: 2 (6.90%)
6:25:36.776035 PROGRESS: 
6:25:36.776095 PROGRESS: Precursor Summary:
6:25:36.777526 PROGRESS: Channel   0:	 0.05 FDR:    23; 0.01 FDR:    18; 0.001 FDR:    18
6:25:36.777652 PROGRESS: 
6:25:36.777727 PROGRESS: Protein Summary:
6:25:36.779363 PROGRESS: Channel   0:	 0.05 FDR:    23; 0.01 FDR:    18; 0.001 FDR:    18
6:25:36.779478 PROGRESS: =========================================================================
6:25:36.780338 PROGRESS: === Epoch 8, step 2, extracting elution groups 3000 to 7000 ===
6:25:36.863563 PROGRESS: Extracting batch of 7919 precursors
6:25:36.867192 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:25:36.867255 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:25:36.867294 INFO: FWHM in RT is 14.48 seconds, sigma is 0.53
6:25:36.867339 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:25:36.867569 INFO: Starting candidate selection
6:25:41.595828 INFO: Starting candidate scoring
6:25:42.969257 INFO: Finished candidate processing
6:25:42.969435 INFO: Collecting candidate features
6:25:45.179123 WARNING: intensity_correlation has 6 NaNs ( 0.08 % out of 7410)
6:25:45.185046 INFO: Collecting fragment features
6:25:45.837941 INFO: Finished candidate scoring
6:25:46.132657 PROGRESS: === Epoch 8, step 2, extracted 7410 precursors and 34724 fragments ===
6:25:46.133055 INFO: performing precursor FDR with 47 features
6:25:46.133101 INFO: Decoy channel: -1
6:25:46.133127 INFO: Competetive: True
6:25:46.149495 WARNING: dropped 7 target PSMs due to missing features
6:25:46.149595 WARNING: dropped 5 decoy PSMs due to missing features
6:25:46.410633 INFO: Test AUC: 0.543
6:25:46.410780 INFO: Train AUC: 0.580
6:25:46.410844 INFO: AUC difference: 6.40%
6:25:46.410889 WARNING: AUC difference > 5%. This may indicate overfitting.
6:25:46.535790 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
6:25:46.536661 PROGRESS: ============================= Precursor FDR =============================
6:25:46.536790 PROGRESS: Total precursors accumulated: 100
6:25:46.536875 PROGRESS: Target precursors: 92 (92.00%)
6:25:46.536950 PROGRESS: Decoy precursors: 8 (8.00%)
6:25:46.537020 PROGRESS: 
6:25:46.537086 PROGRESS: Precursor Summary:
6:25:46.538626 PROGRESS: Channel   0:	 0.05 FDR:    67; 0.01 FDR:    59; 0.001 FDR:    59
6:25:46.538759 PROGRESS: 
6:25:46.538852 PROGRESS: Protein Summary:
6:25:46.541087 PROGRESS: Channel   0:	 0.05 FDR:    67; 0.01 FDR:    59; 0.001 FDR:    59
6:25:46.541204 PROGRESS: =========================================================================
6:25:46.542124 PROGRESS: === Epoch 8, step 3, extracting elution groups 7000 to 15000 ===
6:25:46.633548 PROGRESS: Extracting batch of 15798 precursors
6:25:46.639333 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:25:46.639410 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:25:46.639453 INFO: FWHM in RT is 14.48 seconds, sigma is 0.53
6:25:46.639482 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:25:46.639706 INFO: Starting candidate selection
6:25:51.479648 INFO: Starting candidate scoring
6:25:52.910208 INFO: Finished candidate processing
6:25:52.910298 INFO: Collecting candidate features
6:25:55.147599 WARNING: intensity_correlation has 21 NaNs ( 0.14 % out of 14767)
6:25:55.154008 INFO: Collecting fragment features
6:25:55.820192 INFO: Finished candidate scoring
6:25:56.125788 PROGRESS: === Epoch 8, step 3, extracted 14767 precursors and 69476 fragments ===
6:25:56.126147 INFO: performing precursor FDR with 47 features
6:25:56.126194 INFO: Decoy channel: -1
6:25:56.126221 INFO: Competetive: True
6:25:56.157176 WARNING: dropped 17 target PSMs due to missing features
6:25:56.157294 WARNING: dropped 16 decoy PSMs due to missing features
6:25:57.102440 INFO: Test AUC: 0.528
6:25:57.109406 INFO: Train AUC: 0.605
6:25:57.109540 INFO: AUC difference: 12.66%
6:25:57.109625 WARNING: AUC difference > 5%. This may indicate overfitting.
6:25:57.235154 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
6:25:57.236089 PROGRESS: ============================= Precursor FDR =============================
6:25:57.236222 PROGRESS: Total precursors accumulated: 193
6:25:57.236304 PROGRESS: Target precursors: 176 (91.19%)
6:25:57.236372 PROGRESS: Decoy precursors: 17 (8.81%)
6:25:57.236434 PROGRESS: 
6:25:57.236494 PROGRESS: Precursor Summary:
6:25:57.238040 PROGRESS: Channel   0:	 0.05 FDR:   127; 0.01 FDR:    72; 0.001 FDR:    72
6:25:57.238170 PROGRESS: 
6:25:57.238247 PROGRESS: Protein Summary:
6:25:57.239996 PROGRESS: Channel   0:	 0.05 FDR:   127; 0.01 FDR:    72; 0.001 FDR:    72
6:25:57.240110 PROGRESS: =========================================================================
6:25:57.241002 PROGRESS: === Epoch 8, step 4, extracting elution groups 15000 to 31000 ===
6:25:57.349419 PROGRESS: Extracting batch of 31620 precursors
6:25:57.360508 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:25:57.360621 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:25:57.360666 INFO: FWHM in RT is 14.48 seconds, sigma is 0.53
6:25:57.360693 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:25:57.360940 INFO: Starting candidate selection
6:26:02.572754 INFO: Starting candidate scoring
6:26:04.176794 INFO: Finished candidate processing
6:26:04.176962 INFO: Collecting candidate features
6:26:06.449321 WARNING: intensity_correlation has 42 NaNs ( 0.14 % out of 29643)
6:26:06.462106 INFO: Collecting fragment features
6:26:07.136531 INFO: Finished candidate scoring
6:26:07.466471 PROGRESS: === Epoch 8, step 4, extracted 29643 precursors and 139373 fragments ===
6:26:07.473739 INFO: performing precursor FDR with 47 features
6:26:07.473919 INFO: Decoy channel: -1
6:26:07.474010 INFO: Competetive: True
6:26:07.534194 WARNING: dropped 36 target PSMs due to missing features
6:26:07.534307 WARNING: dropped 39 decoy PSMs due to missing features
6:26:09.383361 INFO: Test AUC: 0.548
6:26:09.383518 INFO: Train AUC: 0.610
6:26:09.383565 INFO: AUC difference: 10.02%
6:26:09.383600 WARNING: AUC difference > 5%. This may indicate overfitting.
6:26:09.511271 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
6:26:09.512370 PROGRESS: ============================= Precursor FDR =============================
6:26:09.512512 PROGRESS: Total precursors accumulated: 497
6:26:09.512593 PROGRESS: Target precursors: 453 (91.15%)
6:26:09.512663 PROGRESS: Decoy precursors: 44 (8.85%)
6:26:09.512728 PROGRESS: 
6:26:09.512791 PROGRESS: Precursor Summary:
6:26:09.514583 PROGRESS: Channel   0:	 0.05 FDR:   313; 0.01 FDR:   241; 0.001 FDR:   177
6:26:09.514722 PROGRESS: 
6:26:09.514800 PROGRESS: Protein Summary:
6:26:09.516820 PROGRESS: Channel   0:	 0.05 FDR:   303; 0.01 FDR:   234; 0.001 FDR:   173
6:26:09.516932 PROGRESS: =========================================================================
6:26:09.517998 PROGRESS: === Epoch 8, step 5, extracting elution groups 31000 to 63000 ===
6:26:09.654701 PROGRESS: Extracting batch of 63216 precursors
6:26:09.675128 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:26:09.675231 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:26:09.675270 INFO: FWHM in RT is 14.48 seconds, sigma is 0.53
6:26:09.675313 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:26:09.675567 INFO: Starting candidate selection
6:26:15.526569 INFO: Starting candidate scoring
6:26:17.439131 INFO: Finished candidate processing
6:26:17.439232 INFO: Collecting candidate features
6:26:19.810510 WARNING: intensity_correlation has 83 NaNs ( 0.14 % out of 59173)
6:26:19.819580 INFO: Collecting fragment features
6:26:20.540802 INFO: Finished candidate scoring
6:26:20.898365 PROGRESS: === Epoch 8, step 5, extracted 59173 precursors and 277653 fragments ===
6:26:20.898749 INFO: performing precursor FDR with 47 features
6:26:20.898799 INFO: Decoy channel: -1
6:26:20.898825 INFO: Competetive: True
6:26:21.034330 WARNING: dropped 84 target PSMs due to missing features
6:26:21.034441 WARNING: dropped 74 decoy PSMs due to missing features
6:26:25.171705 INFO: Test AUC: 0.556
6:26:25.171828 INFO: Train AUC: 0.602
6:26:25.171882 INFO: AUC difference: 7.64%
6:26:25.178779 WARNING: AUC difference > 5%. This may indicate overfitting.
6:26:25.317655 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
6:26:25.319048 PROGRESS: ============================= Precursor FDR =============================
6:26:25.319198 PROGRESS: Total precursors accumulated: 1,189
6:26:25.319278 PROGRESS: Target precursors: 1,087 (91.42%)
6:26:25.319347 PROGRESS: Decoy precursors: 102 (8.58%)
6:26:25.319411 PROGRESS: 
6:26:25.319473 PROGRESS: Precursor Summary:
6:26:25.321471 PROGRESS: Channel   0:	 0.05 FDR:   750; 0.01 FDR:   471; 0.001 FDR:   207
6:26:25.321608 PROGRESS: 
6:26:25.321684 PROGRESS: Protein Summary:
6:26:25.324020 PROGRESS: Channel   0:	 0.05 FDR:   711; 0.01 FDR:   444; 0.001 FDR:   199
6:26:25.324151 PROGRESS: =========================================================================
6:26:25.325350 PROGRESS: === Epoch 8, step 6, extracting elution groups 63000 to 127000 ===
6:26:25.502095 PROGRESS: Extracting batch of 126450 precursors
6:26:25.541223 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:26:25.541336 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:26:25.541373 INFO: FWHM in RT is 14.48 seconds, sigma is 0.53
6:26:25.541416 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:26:25.541694 INFO: Starting candidate selection
6:26:32.621998 INFO: Starting candidate scoring
6:26:35.118000 INFO: Finished candidate processing
6:26:35.118180 INFO: Collecting candidate features
6:26:37.646866 WARNING: intensity_correlation has 179 NaNs ( 0.15 % out of 118379)
6:26:37.659799 INFO: Collecting fragment features
6:26:38.426082 INFO: Finished candidate scoring
6:26:38.858778 PROGRESS: === Epoch 8, step 6, extracted 118379 precursors and 555717 fragments ===
6:26:38.859206 INFO: performing precursor FDR with 47 features
6:26:38.859253 INFO: Decoy channel: -1
6:26:38.859280 INFO: Competetive: True
6:26:39.131725 WARNING: dropped 187 target PSMs due to missing features
6:26:39.131840 WARNING: dropped 150 decoy PSMs due to missing features
6:26:47.546219 INFO: Test AUC: 0.548
6:26:47.546365 INFO: Train AUC: 0.592
6:26:47.546417 INFO: AUC difference: 7.43%
6:26:47.546447 WARNING: AUC difference > 5%. This may indicate overfitting.
6:26:47.701933 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
6:26:47.703585 PROGRESS: ============================= Precursor FDR =============================
6:26:47.703742 PROGRESS: Total precursors accumulated: 2,004
6:26:47.703821 PROGRESS: Target precursors: 1,831 (91.37%)
6:26:47.703889 PROGRESS: Decoy precursors: 173 (8.63%)
6:26:47.703953 PROGRESS: 
6:26:47.704014 PROGRESS: Precursor Summary:
6:26:47.706443 PROGRESS: Channel   0:	 0.05 FDR: 1,405; 0.01 FDR:   938; 0.001 FDR:   731
6:26:47.706588 PROGRESS: 
6:26:47.706663 PROGRESS: Protein Summary:
6:26:47.709677 PROGRESS: Channel   0:	 0.05 FDR: 1,257; 0.01 FDR:   832; 0.001 FDR:   651
6:26:47.709827 PROGRESS: =========================================================================
6:26:47.711310 PROGRESS: === Epoch 8, step 7, extracting elution groups 127000 to 255000 ===
6:26:47.937162 PROGRESS: Extracting batch of 252886 precursors
6:26:48.009699 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:26:48.009825 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:26:48.009882 INFO: FWHM in RT is 14.48 seconds, sigma is 0.53
6:26:48.009909 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:26:48.010183 INFO: Starting candidate selection
6:26:57.591424 INFO: Starting candidate scoring
6:27:01.313926 INFO: Finished candidate processing
6:27:01.314034 INFO: Collecting candidate features
6:27:04.259325 WARNING: intensity_correlation has 362 NaNs ( 0.15 % out of 237057)
6:27:04.281361 INFO: Collecting fragment features
6:27:05.142771 INFO: Finished candidate scoring
6:27:05.729220 PROGRESS: === Epoch 8, step 7, extracted 237057 precursors and 1114525 fragments ===
6:27:05.729583 INFO: performing precursor FDR with 47 features
6:27:05.729632 INFO: Decoy channel: -1
6:27:05.729658 INFO: Competetive: True
6:27:06.323097 WARNING: dropped 375 target PSMs due to missing features
6:27:06.323220 WARNING: dropped 324 decoy PSMs due to missing features
6:27:23.574625 INFO: Test AUC: 0.550
6:27:23.574754 INFO: Train AUC: 0.579
6:27:23.574810 INFO: AUC difference: 5.07%
6:27:23.574838 WARNING: AUC difference > 5%. This may indicate overfitting.
6:27:23.758661 PROGRESS: === checking if recalibration conditions were reached, target 1800 precursors ===
6:27:23.760997 PROGRESS: ============================= Precursor FDR =============================
6:27:23.761157 PROGRESS: Total precursors accumulated: 3,795
6:27:23.761249 PROGRESS: Target precursors: 3,460 (91.17%)
6:27:23.761319 PROGRESS: Decoy precursors: 335 (8.83%)
6:27:23.761383 PROGRESS: 
6:27:23.761445 PROGRESS: Precursor Summary:
6:27:23.764477 PROGRESS: Channel   0:	 0.05 FDR: 2,602; 0.01 FDR: 1,819; 0.001 FDR: 1,425
6:27:23.764643 PROGRESS: 
6:27:23.764717 PROGRESS: Protein Summary:
6:27:23.768749 PROGRESS: Channel   0:	 0.05 FDR: 2,110; 0.01 FDR: 1,450; 0.001 FDR: 1,140
6:27:23.768892 PROGRESS: =========================================================================
6:27:23.772138 INFO: calibration group: precursor, fitting rt estimator 
6:27:24.013545 INFO: calibration group: fragment, fitting mz estimator 
6:27:24.607307 INFO: === checking if epoch conditions were reached ===
6:27:24.607508 INFO: ✅ ms2_error      : 7.0000 <= 7
6:27:24.607599 INFO: ❌ rt_error       : 199.9355 > 100
6:27:24.607675 INFO: ✅ current_epoch  : 8 >= 3
6:27:24.607743 INFO: ==============================================
6:27:24.824759 INFO: calibration group: precursor, predicting mz
6:27:24.825073 WARNING: mz prediction was skipped as it has not been fitted yet
6:27:24.825117 INFO: calibration group: precursor, predicting rt
6:27:31.571544 INFO: calibration group: fragment, predicting mz
6:27:49.227859 PROGRESS: === Epoch 9, step 0, extracting elution groups 0 to 1000 ===
6:27:49.315464 PROGRESS: Extracting batch of 1984 precursors
6:27:49.317331 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:27:49.317406 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:27:49.317472 INFO: FWHM in RT is 14.02 seconds, sigma is 0.51
6:27:49.317504 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:27:49.317735 INFO: Starting candidate selection
6:27:54.281987 INFO: Starting candidate scoring
6:27:55.597486 INFO: Finished candidate processing
6:27:55.597574 INFO: Collecting candidate features
6:27:57.783447 WARNING: intensity_correlation has 2 NaNs ( 0.11 % out of 1858)
6:27:57.789444 INFO: Collecting fragment features
6:27:58.434500 INFO: Finished candidate scoring
6:27:58.741282 PROGRESS: === Epoch 9, step 0, extracted 1858 precursors and 8703 fragments ===
6:27:58.741627 INFO: performing precursor FDR with 47 features
6:27:58.741668 INFO: Decoy channel: -1
6:27:58.741692 INFO: Competetive: True
6:27:58.746843 WARNING: dropped 1 target PSMs due to missing features
6:27:58.746913 WARNING: dropped 1 decoy PSMs due to missing features
6:27:58.776136 INFO: Test AUC: 0.503
6:27:58.776233 INFO: Train AUC: 0.562
6:27:58.776277 INFO: AUC difference: 10.48%
6:27:58.776311 WARNING: AUC difference > 5%. This may indicate overfitting.
6:27:58.903533 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
6:27:58.904317 PROGRESS: ============================= Precursor FDR =============================
6:27:58.904439 PROGRESS: Total precursors accumulated: 14
6:27:58.904516 PROGRESS: Target precursors: 13 (92.86%)
6:27:58.904585 PROGRESS: Decoy precursors: 1 (7.14%)
6:27:58.904648 PROGRESS: 
6:27:58.904709 PROGRESS: Precursor Summary:
6:27:58.906130 PROGRESS: Channel   0:	 0.05 FDR:     7; 0.01 FDR:     7; 0.001 FDR:     7
6:27:58.906246 PROGRESS: 
6:27:58.906321 PROGRESS: Protein Summary:
6:27:58.907922 PROGRESS: Channel   0:	 0.05 FDR:     7; 0.01 FDR:     7; 0.001 FDR:     7
6:27:58.908034 PROGRESS: =========================================================================
6:27:58.908889 PROGRESS: === Epoch 9, step 1, extracting elution groups 1000 to 3000 ===
6:27:58.986335 PROGRESS: Extracting batch of 3948 precursors
6:27:58.988696 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:27:58.988755 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:27:58.988792 INFO: FWHM in RT is 14.02 seconds, sigma is 0.51
6:27:58.988839 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:27:58.989058 INFO: Starting candidate selection
6:28:03.591510 INFO: Starting candidate scoring
6:28:04.910115 INFO: Finished candidate processing
6:28:04.910293 INFO: Collecting candidate features
6:28:07.115024 WARNING: intensity_correlation has 5 NaNs ( 0.14 % out of 3687)
6:28:07.121700 INFO: Collecting fragment features
6:28:07.770312 INFO: Finished candidate scoring
6:28:08.057139 PROGRESS: === Epoch 9, step 1, extracted 3687 precursors and 17412 fragments ===
6:28:08.057440 INFO: performing precursor FDR with 47 features
6:28:08.057486 INFO: Decoy channel: -1
6:28:08.057513 INFO: Competetive: True
6:28:08.067032 WARNING: dropped 6 target PSMs due to missing features
6:28:08.067122 WARNING: dropped 1 decoy PSMs due to missing features
6:28:08.106160 INFO: Test AUC: 0.565
6:28:08.106277 INFO: Train AUC: 0.545
6:28:08.106324 INFO: AUC difference: 3.59%
6:28:08.227479 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
6:28:08.228285 PROGRESS: ============================= Precursor FDR =============================
6:28:08.228412 PROGRESS: Total precursors accumulated: 46
6:28:08.228490 PROGRESS: Target precursors: 42 (91.30%)
6:28:08.228572 PROGRESS: Decoy precursors: 4 (8.70%)
6:28:08.228637 PROGRESS: 
6:28:08.228701 PROGRESS: Precursor Summary:
6:28:08.230187 PROGRESS: Channel   0:	 0.05 FDR:    33; 0.01 FDR:    33; 0.001 FDR:    33
6:28:08.230306 PROGRESS: 
6:28:08.230381 PROGRESS: Protein Summary:
6:28:08.232012 PROGRESS: Channel   0:	 0.05 FDR:    33; 0.01 FDR:    33; 0.001 FDR:    33
6:28:08.232125 PROGRESS: =========================================================================
6:28:08.232992 PROGRESS: === Epoch 9, step 2, extracting elution groups 3000 to 7000 ===
6:28:08.315360 PROGRESS: Extracting batch of 7897 precursors
6:28:08.318913 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:28:08.318976 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:28:08.319015 INFO: FWHM in RT is 14.02 seconds, sigma is 0.51
6:28:08.319060 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:28:08.319296 INFO: Starting candidate selection
6:28:13.030354 INFO: Starting candidate scoring
6:28:14.408384 INFO: Finished candidate processing
6:28:14.408520 INFO: Collecting candidate features
6:28:16.596597 WARNING: intensity_correlation has 7 NaNs ( 0.09 % out of 7407)
6:28:16.602529 INFO: Collecting fragment features
6:28:17.248129 INFO: Finished candidate scoring
6:28:17.536495 PROGRESS: === Epoch 9, step 2, extracted 7407 precursors and 35073 fragments ===
6:28:17.536871 INFO: performing precursor FDR with 47 features
6:28:17.536918 INFO: Decoy channel: -1
6:28:17.536944 INFO: Competetive: True
6:28:17.552404 WARNING: dropped 10 target PSMs due to missing features
6:28:17.552504 WARNING: dropped 4 decoy PSMs due to missing features
6:28:17.808644 INFO: Test AUC: 0.541
6:28:17.808778 INFO: Train AUC: 0.580
6:28:17.808823 INFO: AUC difference: 6.75%
6:28:17.808856 WARNING: AUC difference > 5%. This may indicate overfitting.
6:28:17.927989 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
6:28:17.928857 PROGRESS: ============================= Precursor FDR =============================
6:28:17.928979 PROGRESS: Total precursors accumulated: 103
6:28:17.929057 PROGRESS: Target precursors: 94 (91.26%)
6:28:17.929125 PROGRESS: Decoy precursors: 9 (8.74%)
6:28:17.929187 PROGRESS: 
6:28:17.929248 PROGRESS: Precursor Summary:
6:28:17.930780 PROGRESS: Channel   0:	 0.05 FDR:    81; 0.01 FDR:    52; 0.001 FDR:    52
6:28:17.930923 PROGRESS: 
6:28:17.930996 PROGRESS: Protein Summary:
6:28:17.932714 PROGRESS: Channel   0:	 0.05 FDR:    81; 0.01 FDR:    52; 0.001 FDR:    52
6:28:17.932826 PROGRESS: =========================================================================
6:28:17.933711 PROGRESS: === Epoch 9, step 3, extracting elution groups 7000 to 15000 ===
6:28:18.026331 PROGRESS: Extracting batch of 15809 precursors
6:28:18.032769 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:28:18.032857 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:28:18.032893 INFO: FWHM in RT is 14.02 seconds, sigma is 0.51
6:28:18.032921 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:28:18.033150 INFO: Starting candidate selection
6:28:22.842497 INFO: Starting candidate scoring
6:28:24.265036 INFO: Finished candidate processing
6:28:24.265211 INFO: Collecting candidate features
6:28:26.499217 WARNING: intensity_correlation has 14 NaNs ( 0.09 % out of 14807)
6:28:26.505452 INFO: Collecting fragment features
6:28:27.167679 INFO: Finished candidate scoring
6:28:27.468830 PROGRESS: === Epoch 9, step 3, extracted 14807 precursors and 69301 fragments ===
6:28:27.469198 INFO: performing precursor FDR with 47 features
6:28:27.469244 INFO: Decoy channel: -1
6:28:27.469271 INFO: Competetive: True
6:28:27.499688 WARNING: dropped 16 target PSMs due to missing features
6:28:27.499807 WARNING: dropped 12 decoy PSMs due to missing features
6:28:28.261547 INFO: Test AUC: 0.534
6:28:28.262540 INFO: Train AUC: 0.595
6:28:28.262591 INFO: AUC difference: 10.24%
6:28:28.262622 WARNING: AUC difference > 5%. This may indicate overfitting.
6:28:28.388239 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
6:28:28.389208 PROGRESS: ============================= Precursor FDR =============================
6:28:28.389332 PROGRESS: Total precursors accumulated: 251
6:28:28.389409 PROGRESS: Target precursors: 229 (91.24%)
6:28:28.389477 PROGRESS: Decoy precursors: 22 (8.76%)
6:28:28.389542 PROGRESS: 
6:28:28.389603 PROGRESS: Precursor Summary:
6:28:28.391236 PROGRESS: Channel   0:	 0.05 FDR:   134; 0.01 FDR:   123; 0.001 FDR:   106
6:28:28.391352 PROGRESS: 
6:28:28.391424 PROGRESS: Protein Summary:
6:28:28.393220 PROGRESS: Channel   0:	 0.05 FDR:   132; 0.01 FDR:   122; 0.001 FDR:   105
6:28:28.393331 PROGRESS: =========================================================================
6:28:28.394286 PROGRESS: === Epoch 9, step 4, extracting elution groups 15000 to 31000 ===
6:28:28.502385 PROGRESS: Extracting batch of 31623 precursors
6:28:28.513399 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:28:28.513515 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:28:28.513556 INFO: FWHM in RT is 14.02 seconds, sigma is 0.51
6:28:28.513584 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:28:28.513878 INFO: Starting candidate selection
6:28:33.695469 INFO: Starting candidate scoring
6:28:35.289718 INFO: Finished candidate processing
6:28:35.289852 INFO: Collecting candidate features
6:28:37.573742 WARNING: intensity_correlation has 32 NaNs ( 0.11 % out of 29706)
6:28:37.580712 INFO: Collecting fragment features
6:28:38.265629 INFO: Finished candidate scoring
6:28:38.587538 PROGRESS: === Epoch 9, step 4, extracted 29706 precursors and 139641 fragments ===
6:28:38.587913 INFO: performing precursor FDR with 47 features
6:28:38.587961 INFO: Decoy channel: -1
6:28:38.587987 INFO: Competetive: True
6:28:38.648189 WARNING: dropped 31 target PSMs due to missing features
6:28:38.648300 WARNING: dropped 29 decoy PSMs due to missing features
6:28:40.580899 INFO: Test AUC: 0.544
6:28:40.581049 INFO: Train AUC: 0.607
6:28:40.581096 INFO: AUC difference: 10.42%
6:28:40.581131 WARNING: AUC difference > 5%. This may indicate overfitting.
6:28:40.709430 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
6:28:40.710544 PROGRESS: ============================= Precursor FDR =============================
6:28:40.710674 PROGRESS: Total precursors accumulated: 563
6:28:40.710754 PROGRESS: Target precursors: 512 (90.94%)
6:28:40.710823 PROGRESS: Decoy precursors: 51 (9.06%)
6:28:40.710886 PROGRESS: 
6:28:40.710947 PROGRESS: Precursor Summary:
6:28:40.712708 PROGRESS: Channel   0:	 0.05 FDR:   329; 0.01 FDR:   231; 0.001 FDR:   206
6:28:40.712862 PROGRESS: 
6:28:40.712938 PROGRESS: Protein Summary:
6:28:40.714992 PROGRESS: Channel   0:	 0.05 FDR:   320; 0.01 FDR:   224; 0.001 FDR:   202
6:28:40.715120 PROGRESS: =========================================================================
6:28:40.716156 PROGRESS: === Epoch 9, step 5, extracting elution groups 31000 to 63000 ===
6:28:40.853993 PROGRESS: Extracting batch of 63207 precursors
6:28:40.874490 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:28:40.874602 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:28:40.874644 INFO: FWHM in RT is 14.02 seconds, sigma is 0.51
6:28:40.874672 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:28:40.874923 INFO: Starting candidate selection
6:28:46.678967 INFO: Starting candidate scoring
6:28:48.551714 INFO: Finished candidate processing
6:28:48.551801 INFO: Collecting candidate features
6:28:50.934384 WARNING: intensity_correlation has 50 NaNs ( 0.08 % out of 59249)
6:28:50.943442 INFO: Collecting fragment features
6:28:51.662651 INFO: Finished candidate scoring
6:28:52.019737 PROGRESS: === Epoch 9, step 5, extracted 59249 precursors and 278096 fragments ===
6:28:52.020127 INFO: performing precursor FDR with 47 features
6:28:52.020782 INFO: Decoy channel: -1
6:28:52.020874 INFO: Competetive: True
6:28:52.156482 WARNING: dropped 57 target PSMs due to missing features
6:28:52.156596 WARNING: dropped 53 decoy PSMs due to missing features
6:28:56.288942 INFO: Test AUC: 0.559
6:28:56.289058 INFO: Train AUC: 0.601
6:28:56.289115 INFO: AUC difference: 6.95%
6:28:56.289144 WARNING: AUC difference > 5%. This may indicate overfitting.
6:28:56.428471 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
6:28:56.429911 PROGRESS: ============================= Precursor FDR =============================
6:28:56.430045 PROGRESS: Total precursors accumulated: 1,198
6:28:56.430123 PROGRESS: Target precursors: 1,091 (91.07%)
6:28:56.430210 PROGRESS: Decoy precursors: 107 (8.93%)
6:28:56.430279 PROGRESS: 
6:28:56.430342 PROGRESS: Precursor Summary:
6:28:56.432410 PROGRESS: Channel   0:	 0.05 FDR:   773; 0.01 FDR:   477; 0.001 FDR:   401
6:28:56.432532 PROGRESS: 
6:28:56.432623 PROGRESS: Protein Summary:
6:28:56.435045 PROGRESS: Channel   0:	 0.05 FDR:   723; 0.01 FDR:   438; 0.001 FDR:   377
6:28:56.435163 PROGRESS: =========================================================================
6:28:56.436350 PROGRESS: === Epoch 9, step 6, extracting elution groups 63000 to 127000 ===
6:28:56.612876 PROGRESS: Extracting batch of 126441 precursors
6:28:56.652005 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:28:56.652122 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:28:56.652160 INFO: FWHM in RT is 14.02 seconds, sigma is 0.51
6:28:56.652202 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:28:56.652468 INFO: Starting candidate selection
6:29:03.741391 INFO: Starting candidate scoring
6:29:06.264350 INFO: Finished candidate processing
6:29:06.264533 INFO: Collecting candidate features
6:29:08.809426 WARNING: intensity_correlation has 80 NaNs ( 0.07 % out of 118478)
6:29:08.822652 INFO: Collecting fragment features
6:29:09.603209 INFO: Finished candidate scoring
6:29:10.037121 PROGRESS: === Epoch 9, step 6, extracted 118478 precursors and 556878 fragments ===
6:29:10.037509 INFO: performing precursor FDR with 47 features
6:29:10.037559 INFO: Decoy channel: -1
6:29:10.037585 INFO: Competetive: True
6:29:10.315101 WARNING: dropped 98 target PSMs due to missing features
6:29:10.315217 WARNING: dropped 92 decoy PSMs due to missing features
6:29:18.980304 INFO: Test AUC: 0.547
6:29:18.980436 INFO: Train AUC: 0.595
6:29:18.980495 INFO: AUC difference: 8.04%
6:29:18.980525 WARNING: AUC difference > 5%. This may indicate overfitting.
6:29:19.134678 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
6:29:19.136310 PROGRESS: ============================= Precursor FDR =============================
6:29:19.136467 PROGRESS: Total precursors accumulated: 1,948
6:29:19.136547 PROGRESS: Target precursors: 1,776 (91.17%)
6:29:19.136615 PROGRESS: Decoy precursors: 172 (8.83%)
6:29:19.136677 PROGRESS: 
6:29:19.136736 PROGRESS: Precursor Summary:
6:29:19.139104 PROGRESS: Channel   0:	 0.05 FDR: 1,312; 0.01 FDR:   958; 0.001 FDR:   602
6:29:19.139258 PROGRESS: 
6:29:19.139333 PROGRESS: Protein Summary:
6:29:19.142299 PROGRESS: Channel   0:	 0.05 FDR: 1,160; 0.01 FDR:   840; 0.001 FDR:   548
6:29:19.142419 PROGRESS: =========================================================================
6:29:19.143923 PROGRESS: === Epoch 9, step 7, extracting elution groups 127000 to 255000 ===
6:29:19.370413 PROGRESS: Extracting batch of 252850 precursors
6:29:19.443769 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:29:19.443902 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:29:19.443943 INFO: FWHM in RT is 14.02 seconds, sigma is 0.51
6:29:19.443971 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:29:19.444240 INFO: Starting candidate selection
6:29:29.102813 INFO: Starting candidate scoring
6:29:32.811254 INFO: Finished candidate processing
6:29:32.811404 INFO: Collecting candidate features
6:29:35.795294 WARNING: intensity_correlation has 184 NaNs ( 0.08 % out of 237425)
6:29:35.817647 INFO: Collecting fragment features
6:29:36.689926 INFO: Finished candidate scoring
6:29:37.281248 PROGRESS: === Epoch 9, step 7, extracted 237425 precursors and 1116152 fragments ===
6:29:37.281654 INFO: performing precursor FDR with 47 features
6:29:37.281700 INFO: Decoy channel: -1
6:29:37.281727 INFO: Competetive: True
6:29:37.893722 WARNING: dropped 197 target PSMs due to missing features
6:29:37.893880 WARNING: dropped 177 decoy PSMs due to missing features
6:29:55.370414 INFO: Test AUC: 0.549
6:29:55.370544 INFO: Train AUC: 0.580
6:29:55.370586 INFO: AUC difference: 5.36%
6:29:55.370615 WARNING: AUC difference > 5%. This may indicate overfitting.
6:29:55.556565 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
6:29:55.558810 PROGRESS: ============================= Precursor FDR =============================
6:29:55.558996 PROGRESS: Total precursors accumulated: 3,594
6:29:55.559090 PROGRESS: Target precursors: 3,278 (91.21%)
6:29:55.559158 PROGRESS: Decoy precursors: 316 (8.79%)
6:29:55.559221 PROGRESS: 
6:29:55.559282 PROGRESS: Precursor Summary:
6:29:55.562346 PROGRESS: Channel   0:	 0.05 FDR: 2,634; 0.01 FDR: 1,912; 0.001 FDR: 1,131
6:29:55.562510 PROGRESS: 
6:29:55.562585 PROGRESS: Protein Summary:
6:29:55.566555 PROGRESS: Channel   0:	 0.05 FDR: 2,127; 0.01 FDR: 1,536; 0.001 FDR:   949
6:29:55.566679 PROGRESS: =========================================================================
6:29:55.568650 PROGRESS: === Epoch 9, step 8, extracting elution groups 255000 to 511000 ===
6:29:55.879282 PROGRESS: Extracting batch of 506007 precursors
6:29:56.013481 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:29:56.013596 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:29:56.013636 INFO: FWHM in RT is 14.02 seconds, sigma is 0.51
6:29:56.013682 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:29:56.013975 INFO: Starting candidate selection
6:30:10.670721 INFO: Starting candidate scoring
6:30:16.785018 INFO: Finished candidate processing
6:30:16.785169 INFO: Collecting candidate features
6:30:20.432923 WARNING: intensity_correlation has 381 NaNs ( 0.08 % out of 474494)
6:30:20.433997 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 474494)
6:30:20.468150 INFO: Collecting fragment features
6:30:21.514538 INFO: Finished candidate scoring
6:30:22.403291 PROGRESS: === Epoch 9, step 8, extracted 474494 precursors and 2229271 fragments ===
6:30:22.403719 INFO: performing precursor FDR with 47 features
6:30:22.410378 INFO: Decoy channel: -1
6:30:22.410532 INFO: Competetive: True
6:30:23.541621 WARNING: dropped 375 target PSMs due to missing features
6:30:23.541741 WARNING: dropped 380 decoy PSMs due to missing features
6:30:59.387501 INFO: Test AUC: 0.550
6:30:59.387636 INFO: Train AUC: 0.570
6:30:59.387673 INFO: AUC difference: 3.57%
6:30:59.650381 PROGRESS: === checking if recalibration conditions were reached, target 2000 precursors ===
6:30:59.653358 PROGRESS: ============================= Precursor FDR =============================
6:30:59.653529 PROGRESS: Total precursors accumulated: 6,437
6:30:59.653611 PROGRESS: Target precursors: 5,876 (91.28%)
6:30:59.653678 PROGRESS: Decoy precursors: 561 (8.72%)
6:30:59.653742 PROGRESS: 
6:30:59.653831 PROGRESS: Precursor Summary:
6:30:59.657683 PROGRESS: Channel   0:	 0.05 FDR: 4,810; 0.01 FDR: 3,774; 0.001 FDR: 2,350
6:30:59.657853 PROGRESS: 
6:30:59.657931 PROGRESS: Protein Summary:
6:30:59.663592 PROGRESS: Channel   0:	 0.05 FDR: 3,254; 0.01 FDR: 2,495; 0.001 FDR: 1,651
6:30:59.663730 PROGRESS: =========================================================================
6:30:59.668488 INFO: calibration group: precursor, fitting rt estimator 
6:31:00.111455 INFO: calibration group: fragment, fitting mz estimator 
6:31:00.707806 INFO: === checking if epoch conditions were reached ===
6:31:00.708041 INFO: ✅ ms2_error      : 7.0000 <= 7
6:31:00.708128 INFO: ❌ rt_error       : 198.6683 > 100
6:31:00.708200 INFO: ✅ current_epoch  : 9 >= 3
6:31:00.708264 INFO: ==============================================
6:31:00.932051 INFO: calibration group: precursor, predicting mz
6:31:00.932354 WARNING: mz prediction was skipped as it has not been fitted yet
6:31:00.932393 INFO: calibration group: precursor, predicting rt
6:31:07.691653 INFO: calibration group: fragment, predicting mz
6:31:25.319459 PROGRESS: === Epoch 10, step 0, extracting elution groups 0 to 1000 ===
6:31:25.418196 PROGRESS: Extracting batch of 1969 precursors
6:31:25.420051 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:31:25.420124 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:31:25.420162 INFO: FWHM in RT is 13.98 seconds, sigma is 0.51
6:31:25.420221 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:31:25.420454 INFO: Starting candidate selection
6:31:30.315038 INFO: Starting candidate scoring
6:31:31.604990 INFO: Finished candidate processing
6:31:31.605075 INFO: Collecting candidate features
6:31:33.772637 INFO: Collecting fragment features
6:31:34.408851 INFO: Finished candidate scoring
6:31:34.733921 PROGRESS: === Epoch 10, step 0, extracted 1846 precursors and 8573 fragments ===
6:31:34.734238 INFO: performing precursor FDR with 47 features
6:31:34.734279 INFO: Decoy channel: -1
6:31:34.734306 INFO: Competetive: True
6:31:34.768016 INFO: Test AUC: 0.530
6:31:34.768125 INFO: Train AUC: 0.554
6:31:34.768169 INFO: AUC difference: 4.44%
6:31:34.886822 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
6:31:34.887587 PROGRESS: ============================= Precursor FDR =============================
6:31:34.887707 PROGRESS: Total precursors accumulated: 26
6:31:34.887785 PROGRESS: Target precursors: 24 (92.31%)
6:31:34.887853 PROGRESS: Decoy precursors: 2 (7.69%)
6:31:34.887917 PROGRESS: 
6:31:34.887978 PROGRESS: Precursor Summary:
6:31:34.889398 PROGRESS: Channel   0:	 0.05 FDR:    24; 0.01 FDR:    17; 0.001 FDR:    17
6:31:34.889526 PROGRESS: 
6:31:34.889599 PROGRESS: Protein Summary:
6:31:34.891213 PROGRESS: Channel   0:	 0.05 FDR:    24; 0.01 FDR:    17; 0.001 FDR:    17
6:31:34.891344 PROGRESS: =========================================================================
6:31:34.892195 PROGRESS: === Epoch 10, step 1, extracting elution groups 1000 to 3000 ===
6:31:34.969738 PROGRESS: Extracting batch of 3957 precursors
6:31:34.971996 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:31:34.972054 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:31:34.972091 INFO: FWHM in RT is 13.98 seconds, sigma is 0.51
6:31:34.972136 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:31:34.972353 INFO: Starting candidate selection
6:31:39.520423 INFO: Starting candidate scoring
6:31:40.838931 INFO: Finished candidate processing
6:31:40.839045 INFO: Collecting candidate features
6:31:43.011075 WARNING: intensity_correlation has 6 NaNs ( 0.16 % out of 3705)
6:31:43.017995 INFO: Collecting fragment features
6:31:43.660275 INFO: Finished candidate scoring
6:31:43.942193 PROGRESS: === Epoch 10, step 1, extracted 3705 precursors and 17466 fragments ===
6:31:43.942488 INFO: performing precursor FDR with 47 features
6:31:43.942531 INFO: Decoy channel: -1
6:31:43.942559 INFO: Competetive: True
6:31:43.951664 WARNING: dropped 2 target PSMs due to missing features
6:31:43.951753 WARNING: dropped 4 decoy PSMs due to missing features
6:31:43.990067 INFO: Test AUC: 0.558
6:31:43.990186 INFO: Train AUC: 0.547
6:31:43.990232 INFO: AUC difference: 2.03%
6:31:44.112886 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
6:31:44.113665 PROGRESS: ============================= Precursor FDR =============================
6:31:44.113790 PROGRESS: Total precursors accumulated: 40
6:31:44.113886 PROGRESS: Target precursors: 37 (92.50%)
6:31:44.113955 PROGRESS: Decoy precursors: 3 (7.50%)
6:31:44.114018 PROGRESS: 
6:31:44.114079 PROGRESS: Precursor Summary:
6:31:44.115507 PROGRESS: Channel   0:	 0.05 FDR:    35; 0.01 FDR:    34; 0.001 FDR:    34
6:31:44.115618 PROGRESS: 
6:31:44.115690 PROGRESS: Protein Summary:
6:31:44.117267 PROGRESS: Channel   0:	 0.05 FDR:    35; 0.01 FDR:    34; 0.001 FDR:    34
6:31:44.117375 PROGRESS: =========================================================================
6:31:44.118253 PROGRESS: === Epoch 10, step 2, extracting elution groups 3000 to 7000 ===
6:31:44.200219 PROGRESS: Extracting batch of 7893 precursors
6:31:44.203767 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:31:44.203832 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:31:44.203870 INFO: FWHM in RT is 13.98 seconds, sigma is 0.51
6:31:44.203915 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:31:44.204143 INFO: Starting candidate selection
6:31:48.866840 INFO: Starting candidate scoring
6:31:50.241502 INFO: Finished candidate processing
6:31:50.241686 INFO: Collecting candidate features
6:31:52.450615 WARNING: intensity_correlation has 9 NaNs ( 0.12 % out of 7378)
6:31:52.456524 INFO: Collecting fragment features
6:31:53.112690 INFO: Finished candidate scoring
6:31:53.403158 PROGRESS: === Epoch 10, step 2, extracted 7378 precursors and 34264 fragments ===
6:31:53.403544 INFO: performing precursor FDR with 47 features
6:31:53.403591 INFO: Decoy channel: -1
6:31:53.403622 INFO: Competetive: True
6:31:53.419557 WARNING: dropped 8 target PSMs due to missing features
6:31:53.419658 WARNING: dropped 7 decoy PSMs due to missing features
6:31:53.662642 INFO: Test AUC: 0.544
6:31:53.662778 INFO: Train AUC: 0.585
6:31:53.662824 INFO: AUC difference: 7.13%
6:31:53.662857 WARNING: AUC difference > 5%. This may indicate overfitting.
6:31:53.786767 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
6:31:53.787676 PROGRESS: ============================= Precursor FDR =============================
6:31:53.787802 PROGRESS: Total precursors accumulated: 113
6:31:53.787881 PROGRESS: Target precursors: 104 (92.04%)
6:31:53.787950 PROGRESS: Decoy precursors: 9 (7.96%)
6:31:53.788013 PROGRESS: 
6:31:53.788086 PROGRESS: Precursor Summary:
6:31:53.789586 PROGRESS: Channel   0:	 0.05 FDR:    87; 0.01 FDR:    77; 0.001 FDR:    77
6:31:53.789727 PROGRESS: 
6:31:53.789814 PROGRESS: Protein Summary:
6:31:53.791554 PROGRESS: Channel   0:	 0.05 FDR:    87; 0.01 FDR:    77; 0.001 FDR:    77
6:31:53.791666 PROGRESS: =========================================================================
6:31:53.792687 PROGRESS: === Epoch 10, step 3, extracting elution groups 7000 to 15000 ===
6:31:53.884980 PROGRESS: Extracting batch of 15814 precursors
6:31:53.890767 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:31:53.890859 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:31:53.890921 INFO: FWHM in RT is 13.98 seconds, sigma is 0.51
6:31:53.890949 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:31:53.891178 INFO: Starting candidate selection
6:31:58.725137 INFO: Starting candidate scoring
6:32:00.173091 INFO: Finished candidate processing
6:32:00.173240 INFO: Collecting candidate features
6:32:02.410227 WARNING: intensity_correlation has 11 NaNs ( 0.07 % out of 14854)
6:32:02.416289 INFO: Collecting fragment features
6:32:03.083524 INFO: Finished candidate scoring
6:32:03.384130 PROGRESS: === Epoch 10, step 3, extracted 14854 precursors and 69824 fragments ===
6:32:03.384478 INFO: performing precursor FDR with 47 features
6:32:03.384525 INFO: Decoy channel: -1
6:32:03.384551 INFO: Competetive: True
6:32:03.415225 WARNING: dropped 14 target PSMs due to missing features
6:32:03.415333 WARNING: dropped 12 decoy PSMs due to missing features
6:32:04.124410 INFO: Test AUC: 0.546
6:32:04.124582 INFO: Train AUC: 0.594
6:32:04.124634 INFO: AUC difference: 8.13%
6:32:04.124671 WARNING: AUC difference > 5%. This may indicate overfitting.
6:32:04.252073 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
6:32:04.253078 PROGRESS: ============================= Precursor FDR =============================
6:32:04.253203 PROGRESS: Total precursors accumulated: 258
6:32:04.253281 PROGRESS: Target precursors: 235 (91.09%)
6:32:04.253349 PROGRESS: Decoy precursors: 23 (8.91%)
6:32:04.253413 PROGRESS: 
6:32:04.253477 PROGRESS: Precursor Summary:
6:32:04.255079 PROGRESS: Channel   0:	 0.05 FDR:   161; 0.01 FDR:   135; 0.001 FDR:   106
6:32:04.255210 PROGRESS: 
6:32:04.255284 PROGRESS: Protein Summary:
6:32:04.257077 PROGRESS: Channel   0:	 0.05 FDR:   161; 0.01 FDR:   135; 0.001 FDR:   106
6:32:04.257188 PROGRESS: =========================================================================
6:32:04.258165 PROGRESS: === Epoch 10, step 4, extracting elution groups 15000 to 31000 ===
6:32:04.367547 PROGRESS: Extracting batch of 31598 precursors
6:32:04.378380 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:32:04.378492 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:32:04.378533 INFO: FWHM in RT is 13.98 seconds, sigma is 0.51
6:32:04.378561 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:32:04.378818 INFO: Starting candidate selection
6:32:09.500786 INFO: Starting candidate scoring
6:32:11.090822 INFO: Finished candidate processing
6:32:11.090915 INFO: Collecting candidate features
6:32:13.347840 WARNING: intensity_correlation has 26 NaNs ( 0.09 % out of 29582)
6:32:13.354813 INFO: Collecting fragment features
6:32:14.032251 INFO: Finished candidate scoring
6:32:14.349055 PROGRESS: === Epoch 10, step 4, extracted 29582 precursors and 139715 fragments ===
6:32:14.349406 INFO: performing precursor FDR with 47 features
6:32:14.349457 INFO: Decoy channel: -1
6:32:14.349483 INFO: Competetive: True
6:32:14.409788 WARNING: dropped 32 target PSMs due to missing features
6:32:14.409915 WARNING: dropped 20 decoy PSMs due to missing features
6:32:16.504730 INFO: Test AUC: 0.555
6:32:16.504896 INFO: Train AUC: 0.603
6:32:16.504952 INFO: AUC difference: 7.89%
6:32:16.504995 WARNING: AUC difference > 5%. This may indicate overfitting.
6:32:16.631686 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
6:32:16.632828 PROGRESS: ============================= Precursor FDR =============================
6:32:16.632989 PROGRESS: Total precursors accumulated: 649
6:32:16.633068 PROGRESS: Target precursors: 592 (91.22%)
6:32:16.633136 PROGRESS: Decoy precursors: 57 (8.78%)
6:32:16.633200 PROGRESS: 
6:32:16.633261 PROGRESS: Precursor Summary:
6:32:16.635018 PROGRESS: Channel   0:	 0.05 FDR:   401; 0.01 FDR:   189; 0.001 FDR:   152
6:32:16.635164 PROGRESS: 
6:32:16.635238 PROGRESS: Protein Summary:
6:32:16.637250 PROGRESS: Channel   0:	 0.05 FDR:   392; 0.01 FDR:   186; 0.001 FDR:   149
6:32:16.637364 PROGRESS: =========================================================================
6:32:16.638391 PROGRESS: === Epoch 10, step 5, extracting elution groups 31000 to 63000 ===
6:32:16.775553 PROGRESS: Extracting batch of 63183 precursors
6:32:16.796055 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:32:16.796165 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:32:16.796201 INFO: FWHM in RT is 13.98 seconds, sigma is 0.51
6:32:16.796244 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:32:16.796496 INFO: Starting candidate selection
6:32:22.607751 INFO: Starting candidate scoring
6:32:24.505905 INFO: Finished candidate processing
6:32:24.505994 INFO: Collecting candidate features
6:32:26.859634 WARNING: intensity_correlation has 41 NaNs ( 0.07 % out of 59267)
6:32:26.868613 INFO: Collecting fragment features
6:32:27.577286 INFO: Finished candidate scoring
6:32:27.930085 PROGRESS: === Epoch 10, step 5, extracted 59267 precursors and 279108 fragments ===
6:32:27.930460 INFO: performing precursor FDR with 47 features
6:32:27.930508 INFO: Decoy channel: -1
6:32:27.930534 INFO: Competetive: True
6:32:28.064057 WARNING: dropped 50 target PSMs due to missing features
6:32:28.064172 WARNING: dropped 43 decoy PSMs due to missing features
6:32:32.169108 INFO: Test AUC: 0.550
6:32:32.169227 INFO: Train AUC: 0.605
6:32:32.169292 INFO: AUC difference: 9.08%
6:32:32.176206 WARNING: AUC difference > 5%. This may indicate overfitting.
6:32:32.332672 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
6:32:32.334125 PROGRESS: ============================= Precursor FDR =============================
6:32:32.334260 PROGRESS: Total precursors accumulated: 1,360
6:32:32.334337 PROGRESS: Target precursors: 1,238 (91.03%)
6:32:32.334405 PROGRESS: Decoy precursors: 122 (8.97%)
6:32:32.334469 PROGRESS: 
6:32:32.334532 PROGRESS: Precursor Summary:
6:32:32.336439 PROGRESS: Channel   0:	 0.05 FDR:   604; 0.01 FDR:   454; 0.001 FDR:   367
6:32:32.336588 PROGRESS: 
6:32:32.336660 PROGRESS: Protein Summary:
6:32:32.338942 PROGRESS: Channel   0:	 0.05 FDR:   562; 0.01 FDR:   420; 0.001 FDR:   341
6:32:32.339059 PROGRESS: =========================================================================
6:32:32.340205 PROGRESS: === Epoch 10, step 6, extracting elution groups 63000 to 127000 ===
6:32:32.518977 PROGRESS: Extracting batch of 126438 precursors
6:32:32.557581 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:32:32.557695 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:32:32.557731 INFO: FWHM in RT is 13.98 seconds, sigma is 0.51
6:32:32.557782 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:32:32.558050 INFO: Starting candidate selection
6:32:39.648429 INFO: Starting candidate scoring
6:32:42.166796 INFO: Finished candidate processing
6:32:42.166980 INFO: Collecting candidate features
6:32:44.698740 WARNING: intensity_correlation has 81 NaNs ( 0.07 % out of 118239)
6:32:44.711429 INFO: Collecting fragment features
6:32:45.477224 INFO: Finished candidate scoring
6:32:45.903769 PROGRESS: === Epoch 10, step 6, extracted 118239 precursors and 554676 fragments ===
6:32:45.904182 INFO: performing precursor FDR with 47 features
6:32:45.904229 INFO: Decoy channel: -1
6:32:45.904255 INFO: Competetive: True
6:32:46.175727 WARNING: dropped 92 target PSMs due to missing features
6:32:46.175863 WARNING: dropped 82 decoy PSMs due to missing features
6:32:54.871736 INFO: Test AUC: 0.544
6:32:54.871867 INFO: Train AUC: 0.593
6:32:54.871926 INFO: AUC difference: 8.25%
6:32:54.871955 WARNING: AUC difference > 5%. This may indicate overfitting.
6:32:55.027395 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
6:32:55.029047 PROGRESS: ============================= Precursor FDR =============================
6:32:55.029198 PROGRESS: Total precursors accumulated: 2,030
6:32:55.029277 PROGRESS: Target precursors: 1,857 (91.48%)
6:32:55.029347 PROGRESS: Decoy precursors: 173 (8.52%)
6:32:55.029412 PROGRESS: 
6:32:55.029476 PROGRESS: Precursor Summary:
6:32:55.031801 PROGRESS: Channel   0:	 0.05 FDR: 1,322; 0.01 FDR:   902; 0.001 FDR:   729
6:32:55.031958 PROGRESS: 
6:32:55.032034 PROGRESS: Protein Summary:
6:32:55.035008 PROGRESS: Channel   0:	 0.05 FDR: 1,168; 0.01 FDR:   792; 0.001 FDR:   643
6:32:55.035147 PROGRESS: =========================================================================
6:32:55.036602 PROGRESS: === Epoch 10, step 7, extracting elution groups 127000 to 255000 ===
6:32:55.263201 PROGRESS: Extracting batch of 252918 precursors
6:32:55.336625 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:32:55.336759 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:32:55.336800 INFO: FWHM in RT is 13.98 seconds, sigma is 0.51
6:32:55.336827 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:32:55.337095 INFO: Starting candidate selection
6:33:04.946876 INFO: Starting candidate scoring
6:33:08.669077 INFO: Finished candidate processing
6:33:08.669267 INFO: Collecting candidate features
6:33:11.659008 WARNING: intensity_correlation has 176 NaNs ( 0.07 % out of 236575)
6:33:11.681044 INFO: Collecting fragment features
6:33:12.552418 INFO: Finished candidate scoring
6:33:13.143014 PROGRESS: === Epoch 10, step 7, extracted 236575 precursors and 1109872 fragments ===
6:33:13.143419 INFO: performing precursor FDR with 47 features
6:33:13.143466 INFO: Decoy channel: -1
6:33:13.143492 INFO: Competetive: True
6:33:13.750487 WARNING: dropped 179 target PSMs due to missing features
6:33:13.750623 WARNING: dropped 171 decoy PSMs due to missing features
6:33:31.285991 INFO: Test AUC: 0.552
6:33:31.286133 INFO: Train AUC: 0.580
6:33:31.286174 INFO: AUC difference: 4.82%
6:33:31.471030 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
6:33:31.473121 PROGRESS: ============================= Precursor FDR =============================
6:33:31.473289 PROGRESS: Total precursors accumulated: 3,455
6:33:31.473370 PROGRESS: Target precursors: 3,147 (91.09%)
6:33:31.473440 PROGRESS: Decoy precursors: 308 (8.91%)
6:33:31.473506 PROGRESS: 
6:33:31.473568 PROGRESS: Precursor Summary:
6:33:31.476402 PROGRESS: Channel   0:	 0.05 FDR: 2,405; 0.01 FDR: 1,679; 0.001 FDR: 1,297
6:33:31.476556 PROGRESS: 
6:33:31.476627 PROGRESS: Protein Summary:
6:33:31.480328 PROGRESS: Channel   0:	 0.05 FDR: 1,955; 0.01 FDR: 1,324; 0.001 FDR: 1,038
6:33:31.480451 PROGRESS: =========================================================================
6:33:31.482228 PROGRESS: === Epoch 10, step 8, extracting elution groups 255000 to 511000 ===
6:33:31.785651 PROGRESS: Extracting batch of 505897 precursors
6:33:31.918061 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:33:31.918194 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:33:31.918234 INFO: FWHM in RT is 13.98 seconds, sigma is 0.51
6:33:31.918260 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:33:31.918525 INFO: Starting candidate selection
6:33:46.587044 INFO: Starting candidate scoring
6:33:52.798782 INFO: Finished candidate processing
6:33:52.798880 INFO: Collecting candidate features
6:33:56.440301 WARNING: intensity_correlation has 318 NaNs ( 0.07 % out of 473954)
6:33:56.475508 INFO: Collecting fragment features
6:33:57.529498 INFO: Finished candidate scoring
6:33:58.414520 PROGRESS: === Epoch 10, step 8, extracted 473954 precursors and 2226362 fragments ===
6:33:58.414929 INFO: performing precursor FDR with 47 features
6:33:58.421600 INFO: Decoy channel: -1
6:33:58.421755 INFO: Competetive: True
6:33:59.572906 WARNING: dropped 349 target PSMs due to missing features
6:33:59.573026 WARNING: dropped 319 decoy PSMs due to missing features
6:34:34.149883 INFO: Test AUC: 0.549
6:34:34.150025 INFO: Train AUC: 0.571
6:34:34.150064 INFO: AUC difference: 3.83%
6:34:34.395157 PROGRESS: === checking if recalibration conditions were reached, target 2200 precursors ===
6:34:34.398158 PROGRESS: ============================= Precursor FDR =============================
6:34:34.398314 PROGRESS: Total precursors accumulated: 6,445
6:34:34.398392 PROGRESS: Target precursors: 5,879 (91.22%)
6:34:34.398459 PROGRESS: Decoy precursors: 566 (8.78%)
6:34:34.398523 PROGRESS: 
6:34:34.398584 PROGRESS: Precursor Summary:
6:34:34.402399 PROGRESS: Channel   0:	 0.05 FDR: 4,809; 0.01 FDR: 3,434; 0.001 FDR: 2,478
6:34:34.402564 PROGRESS: 
6:34:34.402639 PROGRESS: Protein Summary:
6:34:34.408117 PROGRESS: Channel   0:	 0.05 FDR: 3,281; 0.01 FDR: 2,284; 0.001 FDR: 1,727
6:34:34.408267 PROGRESS: =========================================================================
6:34:34.412682 INFO: calibration group: precursor, fitting rt estimator 
6:34:34.812686 INFO: calibration group: fragment, fitting mz estimator 
6:34:35.410196 INFO: === checking if epoch conditions were reached ===
6:34:35.410444 INFO: ✅ ms2_error      : 7.0000 <= 7
6:34:35.410537 INFO: ❌ rt_error       : 201.1678 > 100
6:34:35.410619 INFO: ✅ current_epoch  : 10 >= 3
6:34:35.410684 INFO: ==============================================
6:34:35.657534 INFO: calibration group: precursor, predicting mz
6:34:35.657829 WARNING: mz prediction was skipped as it has not been fitted yet
6:34:35.657871 INFO: calibration group: precursor, predicting rt
6:34:42.452651 INFO: calibration group: fragment, predicting mz
6:35:00.264033 PROGRESS: === Epoch 11, step 0, extracting elution groups 0 to 1000 ===
6:35:00.362792 PROGRESS: Extracting batch of 1976 precursors
6:35:00.364660 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:35:00.364737 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:35:00.364775 INFO: FWHM in RT is 13.80 seconds, sigma is 0.50
6:35:00.364821 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:35:00.365052 INFO: Starting candidate selection
6:35:05.331861 INFO: Starting candidate scoring
6:35:06.646403 INFO: Finished candidate processing
6:35:06.646580 INFO: Collecting candidate features
6:35:08.837532 INFO: Collecting fragment features
6:35:09.482540 INFO: Finished candidate scoring
6:35:09.810203 PROGRESS: === Epoch 11, step 0, extracted 1808 precursors and 8488 fragments ===
6:35:09.810552 INFO: performing precursor FDR with 47 features
6:35:09.810594 INFO: Decoy channel: -1
6:35:09.810631 INFO: Competetive: True
6:35:09.843719 INFO: Test AUC: 0.535
6:35:09.843826 INFO: Train AUC: 0.519
6:35:09.843870 INFO: AUC difference: 2.96%
6:35:09.966240 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
6:35:09.967026 PROGRESS: ============================= Precursor FDR =============================
6:35:09.967147 PROGRESS: Total precursors accumulated: 17
6:35:09.967226 PROGRESS: Target precursors: 16 (94.12%)
6:35:09.967296 PROGRESS: Decoy precursors: 1 (5.88%)
6:35:09.967359 PROGRESS: 
6:35:09.967421 PROGRESS: Precursor Summary:
6:35:09.968834 PROGRESS: Channel   0:	 0.05 FDR:    13; 0.01 FDR:    13; 0.001 FDR:    13
6:35:09.968962 PROGRESS: 
6:35:09.969037 PROGRESS: Protein Summary:
6:35:09.970657 PROGRESS: Channel   0:	 0.05 FDR:    13; 0.01 FDR:    13; 0.001 FDR:    13
6:35:09.970773 PROGRESS: =========================================================================
6:35:09.971631 PROGRESS: === Epoch 11, step 1, extracting elution groups 1000 to 3000 ===
6:35:10.048840 PROGRESS: Extracting batch of 3948 precursors
6:35:10.051244 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:35:10.051308 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:35:10.051347 INFO: FWHM in RT is 13.80 seconds, sigma is 0.50
6:35:10.051397 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:35:10.051616 INFO: Starting candidate selection
6:35:14.615444 INFO: Starting candidate scoring
6:35:15.932147 INFO: Finished candidate processing
6:35:15.932330 INFO: Collecting candidate features
6:35:18.110329 WARNING: intensity_correlation has 4 NaNs ( 0.11 % out of 3704)
6:35:18.117786 INFO: Collecting fragment features
6:35:18.765180 INFO: Finished candidate scoring
6:35:19.048514 PROGRESS: === Epoch 11, step 1, extracted 3704 precursors and 17507 fragments ===
6:35:19.048804 INFO: performing precursor FDR with 47 features
6:35:19.048852 INFO: Decoy channel: -1
6:35:19.048880 INFO: Competetive: True
6:35:19.058000 WARNING: dropped 1 target PSMs due to missing features
6:35:19.058093 WARNING: dropped 3 decoy PSMs due to missing features
6:35:19.096545 INFO: Test AUC: 0.521
6:35:19.096666 INFO: Train AUC: 0.534
6:35:19.096712 INFO: AUC difference: 2.54%
6:35:19.234297 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
6:35:19.235080 PROGRESS: ============================= Precursor FDR =============================
6:35:19.235198 PROGRESS: Total precursors accumulated: 34
6:35:19.235276 PROGRESS: Target precursors: 31 (91.18%)
6:35:19.235346 PROGRESS: Decoy precursors: 3 (8.82%)
6:35:19.235410 PROGRESS: 
6:35:19.235472 PROGRESS: Precursor Summary:
6:35:19.236894 PROGRESS: Channel   0:	 0.05 FDR:    26; 0.01 FDR:    18; 0.001 FDR:    18
6:35:19.237005 PROGRESS: 
6:35:19.237093 PROGRESS: Protein Summary:
6:35:19.238721 PROGRESS: Channel   0:	 0.05 FDR:    26; 0.01 FDR:    18; 0.001 FDR:    18
6:35:19.238833 PROGRESS: =========================================================================
6:35:19.239684 PROGRESS: === Epoch 11, step 2, extracting elution groups 3000 to 7000 ===
6:35:19.322171 PROGRESS: Extracting batch of 7893 precursors
6:35:19.325588 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:35:19.325652 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:35:19.325690 INFO: FWHM in RT is 13.80 seconds, sigma is 0.50
6:35:19.325736 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:35:19.326020 INFO: Starting candidate selection
6:35:23.978280 INFO: Starting candidate scoring
6:35:25.347544 INFO: Finished candidate processing
6:35:25.347635 INFO: Collecting candidate features
6:35:27.531171 WARNING: intensity_correlation has 7 NaNs ( 0.10 % out of 7332)
6:35:27.537026 INFO: Collecting fragment features
6:35:28.189210 INFO: Finished candidate scoring
6:35:28.476994 PROGRESS: === Epoch 11, step 2, extracted 7332 precursors and 34330 fragments ===
6:35:28.477357 INFO: performing precursor FDR with 47 features
6:35:28.477402 INFO: Decoy channel: -1
6:35:28.477428 INFO: Competetive: True
6:35:28.492844 WARNING: dropped 6 target PSMs due to missing features
6:35:28.492944 WARNING: dropped 5 decoy PSMs due to missing features
6:35:28.775129 INFO: Test AUC: 0.532
6:35:28.775261 INFO: Train AUC: 0.580
6:35:28.775306 INFO: AUC difference: 8.37%
6:35:28.775340 WARNING: AUC difference > 5%. This may indicate overfitting.
6:35:28.901714 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
6:35:28.902575 PROGRESS: ============================= Precursor FDR =============================
6:35:28.902701 PROGRESS: Total precursors accumulated: 93
6:35:28.902791 PROGRESS: Target precursors: 85 (91.40%)
6:35:28.902862 PROGRESS: Decoy precursors: 8 (8.60%)
6:35:28.902927 PROGRESS: 
6:35:28.902989 PROGRESS: Precursor Summary:
6:35:28.904442 PROGRESS: Channel   0:	 0.05 FDR:    39; 0.01 FDR:    38; 0.001 FDR:    38
6:35:28.904571 PROGRESS: 
6:35:28.904645 PROGRESS: Protein Summary:
6:35:28.906315 PROGRESS: Channel   0:	 0.05 FDR:    39; 0.01 FDR:    38; 0.001 FDR:    38
6:35:28.906429 PROGRESS: =========================================================================
6:35:28.907302 PROGRESS: === Epoch 11, step 3, extracting elution groups 7000 to 15000 ===
6:35:28.998909 PROGRESS: Extracting batch of 15802 precursors
6:35:29.011880 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:35:29.011960 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:35:29.012000 INFO: FWHM in RT is 13.80 seconds, sigma is 0.50
6:35:29.012031 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:35:29.012258 INFO: Starting candidate selection
6:35:33.866793 INFO: Starting candidate scoring
6:35:35.318223 INFO: Finished candidate processing
6:35:35.318320 INFO: Collecting candidate features
6:35:37.526880 WARNING: intensity_correlation has 12 NaNs ( 0.08 % out of 14740)
6:35:37.532959 INFO: Collecting fragment features
6:35:38.200721 INFO: Finished candidate scoring
6:35:38.496399 PROGRESS: === Epoch 11, step 3, extracted 14740 precursors and 69581 fragments ===
6:35:38.496735 INFO: performing precursor FDR with 47 features
6:35:38.496782 INFO: Decoy channel: -1
6:35:38.496808 INFO: Competetive: True
6:35:38.525856 WARNING: dropped 13 target PSMs due to missing features
6:35:38.525983 WARNING: dropped 10 decoy PSMs due to missing features
6:35:39.218948 INFO: Test AUC: 0.550
6:35:39.219098 INFO: Train AUC: 0.598
6:35:39.219144 INFO: AUC difference: 8.16%
6:35:39.219179 WARNING: AUC difference > 5%. This may indicate overfitting.
6:35:39.361431 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
6:35:39.362370 PROGRESS: ============================= Precursor FDR =============================
6:35:39.362496 PROGRESS: Total precursors accumulated: 171
6:35:39.362574 PROGRESS: Target precursors: 156 (91.23%)
6:35:39.362643 PROGRESS: Decoy precursors: 15 (8.77%)
6:35:39.362706 PROGRESS: 
6:35:39.362767 PROGRESS: Precursor Summary:
6:35:39.364277 PROGRESS: Channel   0:	 0.05 FDR:   105; 0.01 FDR:    56; 0.001 FDR:    56
6:35:39.364424 PROGRESS: 
6:35:39.364501 PROGRESS: Protein Summary:
6:35:39.366235 PROGRESS: Channel   0:	 0.05 FDR:   104; 0.01 FDR:    56; 0.001 FDR:    56
6:35:39.366351 PROGRESS: =========================================================================
6:35:39.367239 PROGRESS: === Epoch 11, step 4, extracting elution groups 15000 to 31000 ===
6:35:39.476312 PROGRESS: Extracting batch of 31617 precursors
6:35:39.487114 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:35:39.487227 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:35:39.487268 INFO: FWHM in RT is 13.80 seconds, sigma is 0.50
6:35:39.487295 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:35:39.487558 INFO: Starting candidate selection
6:35:44.618779 INFO: Starting candidate scoring
6:35:46.195747 INFO: Finished candidate processing
6:35:46.195931 INFO: Collecting candidate features
6:35:48.452935 WARNING: intensity_correlation has 14 NaNs ( 0.05 % out of 29514)
6:35:48.459947 INFO: Collecting fragment features
6:35:49.139077 INFO: Finished candidate scoring
6:35:49.453111 PROGRESS: === Epoch 11, step 4, extracted 29514 precursors and 138463 fragments ===
6:35:49.460401 INFO: performing precursor FDR with 47 features
6:35:49.460557 INFO: Decoy channel: -1
6:35:49.460648 INFO: Competetive: True
6:35:49.520593 WARNING: dropped 21 target PSMs due to missing features
6:35:49.520703 WARNING: dropped 16 decoy PSMs due to missing features
6:35:51.396795 INFO: Test AUC: 0.543
6:35:51.396940 INFO: Train AUC: 0.613
6:35:51.396986 INFO: AUC difference: 11.52%
6:35:51.397021 WARNING: AUC difference > 5%. This may indicate overfitting.
6:35:51.539746 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
6:35:51.540813 PROGRESS: ============================= Precursor FDR =============================
6:35:51.540936 PROGRESS: Total precursors accumulated: 510
6:35:51.541014 PROGRESS: Target precursors: 465 (91.18%)
6:35:51.541084 PROGRESS: Decoy precursors: 45 (8.82%)
6:35:51.541149 PROGRESS: 
6:35:51.541211 PROGRESS: Precursor Summary:
6:35:51.542878 PROGRESS: Channel   0:	 0.05 FDR:   314; 0.01 FDR:   129; 0.001 FDR:   110
6:35:51.543016 PROGRESS: 
6:35:51.543091 PROGRESS: Protein Summary:
6:35:51.544972 PROGRESS: Channel   0:	 0.05 FDR:   308; 0.01 FDR:   126; 0.001 FDR:   109
6:35:51.545095 PROGRESS: =========================================================================
6:35:51.546052 PROGRESS: === Epoch 11, step 5, extracting elution groups 31000 to 63000 ===
6:35:51.683061 PROGRESS: Extracting batch of 63212 precursors
6:35:51.703422 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:35:51.703533 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:35:51.703590 INFO: FWHM in RT is 13.80 seconds, sigma is 0.50
6:35:51.703618 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:35:51.703900 INFO: Starting candidate selection
6:35:57.495131 INFO: Starting candidate scoring
6:35:59.389813 INFO: Finished candidate processing
6:35:59.389922 INFO: Collecting candidate features
6:36:01.773228 WARNING: intensity_correlation has 33 NaNs ( 0.06 % out of 58917)
6:36:01.782392 INFO: Collecting fragment features
6:36:02.506508 INFO: Finished candidate scoring
6:36:02.860829 PROGRESS: === Epoch 11, step 5, extracted 58917 precursors and 276112 fragments ===
6:36:02.861188 INFO: performing precursor FDR with 47 features
6:36:02.861237 INFO: Decoy channel: -1
6:36:02.861266 INFO: Competetive: True
6:36:02.994814 WARNING: dropped 37 target PSMs due to missing features
6:36:02.994936 WARNING: dropped 33 decoy PSMs due to missing features
6:36:06.985583 INFO: Test AUC: 0.553
6:36:06.985706 INFO: Train AUC: 0.605
6:36:06.985761 INFO: AUC difference: 8.60%
6:36:06.985803 WARNING: AUC difference > 5%. This may indicate overfitting.
6:36:07.123047 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
6:36:07.124343 PROGRESS: ============================= Precursor FDR =============================
6:36:07.124472 PROGRESS: Total precursors accumulated: 1,111
6:36:07.124567 PROGRESS: Target precursors: 1,014 (91.27%)
6:36:07.124637 PROGRESS: Decoy precursors: 97 (8.73%)
6:36:07.124701 PROGRESS: 
6:36:07.124764 PROGRESS: Precursor Summary:
6:36:07.126708 PROGRESS: Channel   0:	 0.05 FDR:   708; 0.01 FDR:   407; 0.001 FDR:   343
6:36:07.126832 PROGRESS: 
6:36:07.126906 PROGRESS: Protein Summary:
6:36:07.129161 PROGRESS: Channel   0:	 0.05 FDR:   673; 0.01 FDR:   389; 0.001 FDR:   326
6:36:07.129289 PROGRESS: =========================================================================
6:36:07.130429 PROGRESS: === Epoch 11, step 6, extracting elution groups 63000 to 127000 ===
6:36:07.306038 PROGRESS: Extracting batch of 126387 precursors
6:36:07.345017 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:36:07.345134 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:36:07.345173 INFO: FWHM in RT is 13.80 seconds, sigma is 0.50
6:36:07.345216 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:36:07.345479 INFO: Starting candidate selection
6:36:14.387554 INFO: Starting candidate scoring
6:36:16.874731 INFO: Finished candidate processing
6:36:16.874916 INFO: Collecting candidate features
6:36:19.422244 WARNING: intensity_correlation has 73 NaNs ( 0.06 % out of 118053)
6:36:19.436285 INFO: Collecting fragment features
6:36:20.208063 INFO: Finished candidate scoring
6:36:20.634055 PROGRESS: === Epoch 11, step 6, extracted 118053 precursors and 553903 fragments ===
6:36:20.634423 INFO: performing precursor FDR with 47 features
6:36:20.634468 INFO: Decoy channel: -1
6:36:20.634493 INFO: Competetive: True
6:36:20.905473 WARNING: dropped 76 target PSMs due to missing features
6:36:20.905589 WARNING: dropped 67 decoy PSMs due to missing features
6:36:29.874788 INFO: Test AUC: 0.547
6:36:29.874940 INFO: Train AUC: 0.594
6:36:29.874996 INFO: AUC difference: 7.85%
6:36:29.875025 WARNING: AUC difference > 5%. This may indicate overfitting.
6:36:30.027589 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
6:36:30.029274 PROGRESS: ============================= Precursor FDR =============================
6:36:30.029430 PROGRESS: Total precursors accumulated: 2,249
6:36:30.029520 PROGRESS: Target precursors: 2,049 (91.11%)
6:36:30.029589 PROGRESS: Decoy precursors: 200 (8.89%)
6:36:30.029653 PROGRESS: 
6:36:30.029714 PROGRESS: Precursor Summary:
6:36:30.031916 PROGRESS: Channel   0:	 0.05 FDR: 1,396; 0.01 FDR:   835; 0.001 FDR:   553
6:36:30.032062 PROGRESS: 
6:36:30.032137 PROGRESS: Protein Summary:
6:36:30.034933 PROGRESS: Channel   0:	 0.05 FDR: 1,267; 0.01 FDR:   746; 0.001 FDR:   501
6:36:30.035065 PROGRESS: =========================================================================
6:36:30.036435 PROGRESS: === Epoch 11, step 7, extracting elution groups 127000 to 255000 ===
6:36:30.261317 PROGRESS: Extracting batch of 252959 precursors
6:36:30.333659 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:36:30.333782 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:36:30.333838 INFO: FWHM in RT is 13.80 seconds, sigma is 0.50
6:36:30.333865 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:36:30.334126 INFO: Starting candidate selection
6:36:39.892035 INFO: Starting candidate scoring
6:36:43.608266 INFO: Finished candidate processing
6:36:43.608459 INFO: Collecting candidate features
6:36:46.596494 WARNING: intensity_correlation has 156 NaNs ( 0.07 % out of 235828)
6:36:46.619043 INFO: Collecting fragment features
6:36:47.493230 INFO: Finished candidate scoring
6:36:48.083463 PROGRESS: === Epoch 11, step 7, extracted 235828 precursors and 1105558 fragments ===
6:36:48.083865 INFO: performing precursor FDR with 47 features
6:36:48.083912 INFO: Decoy channel: -1
6:36:48.083939 INFO: Competetive: True
6:36:48.687094 WARNING: dropped 161 target PSMs due to missing features
6:36:48.687241 WARNING: dropped 138 decoy PSMs due to missing features
6:37:05.981383 INFO: Test AUC: 0.549
6:37:05.981514 INFO: Train AUC: 0.581
6:37:05.981569 INFO: AUC difference: 5.46%
6:37:05.981596 WARNING: AUC difference > 5%. This may indicate overfitting.
6:37:06.170350 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
6:37:06.172669 PROGRESS: ============================= Precursor FDR =============================
6:37:06.172823 PROGRESS: Total precursors accumulated: 3,957
6:37:06.172903 PROGRESS: Target precursors: 3,604 (91.08%)
6:37:06.172970 PROGRESS: Decoy precursors: 353 (8.92%)
6:37:06.173032 PROGRESS: 
6:37:06.173091 PROGRESS: Precursor Summary:
6:37:06.176082 PROGRESS: Channel   0:	 0.05 FDR: 2,724; 0.01 FDR: 1,912; 0.001 FDR: 1,307
6:37:06.176246 PROGRESS: 
6:37:06.176332 PROGRESS: Protein Summary:
6:37:06.180235 PROGRESS: Channel   0:	 0.05 FDR: 2,239; 0.01 FDR: 1,531; 0.001 FDR: 1,057
6:37:06.180366 PROGRESS: =========================================================================
6:37:06.182288 PROGRESS: === Epoch 11, step 8, extracting elution groups 255000 to 511000 ===
6:37:06.485331 PROGRESS: Extracting batch of 505855 precursors
6:37:06.617397 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:37:06.617523 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:37:06.617581 INFO: FWHM in RT is 13.80 seconds, sigma is 0.50
6:37:06.617609 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:37:06.617892 INFO: Starting candidate selection
6:37:21.285196 INFO: Starting candidate scoring
6:37:27.426923 INFO: Finished candidate processing
6:37:27.427114 INFO: Collecting candidate features
6:37:31.077255 WARNING: intensity_correlation has 273 NaNs ( 0.06 % out of 472315)
6:37:31.110857 INFO: Collecting fragment features
6:37:32.163478 INFO: Finished candidate scoring
6:37:33.046677 PROGRESS: === Epoch 11, step 8, extracted 472315 precursors and 2218071 fragments ===
6:37:33.047049 INFO: performing precursor FDR with 47 features
6:37:33.047091 INFO: Decoy channel: -1
6:37:33.047117 INFO: Competetive: True
6:37:34.170465 WARNING: dropped 299 target PSMs due to missing features
6:37:34.170593 WARNING: dropped 273 decoy PSMs due to missing features
6:38:09.826877 INFO: Test AUC: 0.551
6:38:09.827011 INFO: Train AUC: 0.571
6:38:09.827071 INFO: AUC difference: 3.44%
6:38:10.070791 PROGRESS: === checking if recalibration conditions were reached, target 2400 precursors ===
6:38:10.073900 PROGRESS: ============================= Precursor FDR =============================
6:38:10.074061 PROGRESS: Total precursors accumulated: 6,848
6:38:10.074145 PROGRESS: Target precursors: 6,247 (91.22%)
6:38:10.074214 PROGRESS: Decoy precursors: 601 (8.78%)
6:38:10.074277 PROGRESS: 
6:38:10.074338 PROGRESS: Precursor Summary:
6:38:10.078192 PROGRESS: Channel   0:	 0.05 FDR: 5,027; 0.01 FDR: 3,578; 0.001 FDR: 2,481
6:38:10.078354 PROGRESS: 
6:38:10.078427 PROGRESS: Protein Summary:
6:38:10.084059 PROGRESS: Channel   0:	 0.05 FDR: 3,481; 0.01 FDR: 2,426; 0.001 FDR: 1,763
6:38:10.084190 PROGRESS: =========================================================================
6:38:10.088772 INFO: calibration group: precursor, fitting rt estimator 
6:38:10.518337 INFO: calibration group: fragment, fitting mz estimator 
6:38:11.103840 INFO: === checking if epoch conditions were reached ===
6:38:11.104064 INFO: ✅ ms2_error      : 7.0000 <= 7
6:38:11.104156 INFO: ❌ rt_error       : 199.5757 > 100
6:38:11.104230 INFO: ✅ current_epoch  : 11 >= 3
6:38:11.104296 INFO: ==============================================
6:38:11.326561 INFO: calibration group: precursor, predicting mz
6:38:11.326850 WARNING: mz prediction was skipped as it has not been fitted yet
6:38:11.326893 INFO: calibration group: precursor, predicting rt
6:38:18.119695 INFO: calibration group: fragment, predicting mz
6:38:36.043349 PROGRESS: === Epoch 12, step 0, extracting elution groups 0 to 1000 ===
6:38:36.143266 PROGRESS: Extracting batch of 1978 precursors
6:38:36.145060 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:38:36.145131 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:38:36.145169 INFO: FWHM in RT is 13.99 seconds, sigma is 0.51
6:38:36.145215 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:38:36.145448 INFO: Starting candidate selection
6:38:41.079330 INFO: Starting candidate scoring
6:38:42.389391 INFO: Finished candidate processing
6:38:42.389576 INFO: Collecting candidate features
6:38:44.575754 WARNING: intensity_correlation has 2 NaNs ( 0.11 % out of 1835)
6:38:44.581659 INFO: Collecting fragment features
6:38:45.220558 INFO: Finished candidate scoring
6:38:45.582024 PROGRESS: === Epoch 12, step 0, extracted 1835 precursors and 8704 fragments ===
6:38:45.582343 INFO: performing precursor FDR with 47 features
6:38:45.582383 INFO: Decoy channel: -1
6:38:45.582409 INFO: Competetive: True
6:38:45.587174 WARNING: dropped 2 decoy PSMs due to missing features
6:38:45.615400 INFO: Test AUC: 0.530
6:38:45.615495 INFO: Train AUC: 0.531
6:38:45.615539 INFO: AUC difference: 0.23%
6:38:45.739769 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
6:38:45.740584 PROGRESS: ============================= Precursor FDR =============================
6:38:45.740720 PROGRESS: Total precursors accumulated: 6
6:38:45.740800 PROGRESS: Target precursors: 6 (100.00%)
6:38:45.740870 PROGRESS: Decoy precursors: 0 (0.00%)
6:38:45.740933 PROGRESS: 
6:38:45.740995 PROGRESS: Precursor Summary:
6:38:45.742508 PROGRESS: Channel   0:	 0.05 FDR:     6; 0.01 FDR:     6; 0.001 FDR:     6
6:38:45.742620 PROGRESS: 
6:38:45.742693 PROGRESS: Protein Summary:
6:38:45.744391 PROGRESS: Channel   0:	 0.05 FDR:     6; 0.01 FDR:     6; 0.001 FDR:     6
6:38:45.744503 PROGRESS: =========================================================================
6:38:45.745397 PROGRESS: === Epoch 12, step 1, extracting elution groups 1000 to 3000 ===
6:38:45.825568 PROGRESS: Extracting batch of 3961 precursors
6:38:45.827953 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:38:45.828022 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:38:45.828061 INFO: FWHM in RT is 13.99 seconds, sigma is 0.51
6:38:45.828106 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:38:45.828332 INFO: Starting candidate selection
6:38:50.404805 INFO: Starting candidate scoring
6:38:51.721735 INFO: Finished candidate processing
6:38:51.721836 INFO: Collecting candidate features
6:38:53.888790 WARNING: intensity_correlation has 4 NaNs ( 0.11 % out of 3707)
6:38:53.896155 INFO: Collecting fragment features
6:38:54.537574 INFO: Finished candidate scoring
6:38:54.819519 PROGRESS: === Epoch 12, step 1, extracted 3707 precursors and 17410 fragments ===
6:38:54.819808 INFO: performing precursor FDR with 47 features
6:38:54.819853 INFO: Decoy channel: -1
6:38:54.819880 INFO: Competetive: True
6:38:54.828336 WARNING: dropped 6 decoy PSMs due to missing features
6:38:54.866271 INFO: Test AUC: 0.559
6:38:54.866390 INFO: Train AUC: 0.528
6:38:54.866436 INFO: AUC difference: 5.86%
6:38:54.866470 WARNING: AUC difference > 5%. This may indicate overfitting.
6:38:55.003536 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
6:38:55.004333 PROGRESS: ============================= Precursor FDR =============================
6:38:55.004460 PROGRESS: Total precursors accumulated: 18
6:38:55.004539 PROGRESS: Target precursors: 17 (94.44%)
6:38:55.004610 PROGRESS: Decoy precursors: 1 (5.56%)
6:38:55.004674 PROGRESS: 
6:38:55.004735 PROGRESS: Precursor Summary:
6:38:55.006170 PROGRESS: Channel   0:	 0.05 FDR:    14; 0.01 FDR:    14; 0.001 FDR:    14
6:38:55.006287 PROGRESS: 
6:38:55.006361 PROGRESS: Protein Summary:
6:38:55.007964 PROGRESS: Channel   0:	 0.05 FDR:    14; 0.01 FDR:    14; 0.001 FDR:    14
6:38:55.008077 PROGRESS: =========================================================================
6:38:55.008933 PROGRESS: === Epoch 12, step 2, extracting elution groups 3000 to 7000 ===
6:38:55.091897 PROGRESS: Extracting batch of 7882 precursors
6:38:55.095378 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:38:55.095444 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:38:55.095483 INFO: FWHM in RT is 13.99 seconds, sigma is 0.51
6:38:55.095528 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:38:55.095752 INFO: Starting candidate selection
6:38:59.801542 INFO: Starting candidate scoring
6:39:01.176047 INFO: Finished candidate processing
6:39:01.176155 INFO: Collecting candidate features
6:39:03.354876 WARNING: intensity_correlation has 6 NaNs ( 0.08 % out of 7413)
6:39:03.360719 INFO: Collecting fragment features
6:39:04.010545 INFO: Finished candidate scoring
6:39:04.297838 PROGRESS: === Epoch 12, step 2, extracted 7413 precursors and 34685 fragments ===
6:39:04.298196 INFO: performing precursor FDR with 47 features
6:39:04.298240 INFO: Decoy channel: -1
6:39:04.298267 INFO: Competetive: True
6:39:04.313480 WARNING: dropped 3 target PSMs due to missing features
6:39:04.313579 WARNING: dropped 9 decoy PSMs due to missing features
6:39:04.543283 INFO: Test AUC: 0.542
6:39:04.543416 INFO: Train AUC: 0.577
6:39:04.543461 INFO: AUC difference: 6.06%
6:39:04.543494 WARNING: AUC difference > 5%. This may indicate overfitting.
6:39:04.669952 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
6:39:04.670773 PROGRESS: ============================= Precursor FDR =============================
6:39:04.670897 PROGRESS: Total precursors accumulated: 72
6:39:04.670975 PROGRESS: Target precursors: 66 (91.67%)
6:39:04.671043 PROGRESS: Decoy precursors: 6 (8.33%)
6:39:04.671105 PROGRESS: 
6:39:04.671166 PROGRESS: Precursor Summary:
6:39:04.672619 PROGRESS: Channel   0:	 0.05 FDR:    54; 0.01 FDR:    42; 0.001 FDR:    42
6:39:04.672730 PROGRESS: 
6:39:04.672805 PROGRESS: Protein Summary:
6:39:04.674458 PROGRESS: Channel   0:	 0.05 FDR:    54; 0.01 FDR:    42; 0.001 FDR:    42
6:39:04.674568 PROGRESS: =========================================================================
6:39:04.675438 PROGRESS: === Epoch 12, step 3, extracting elution groups 7000 to 15000 ===
6:39:04.767162 PROGRESS: Extracting batch of 15816 precursors
6:39:04.772919 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:39:04.773006 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:39:04.773041 INFO: FWHM in RT is 13.99 seconds, sigma is 0.51
6:39:04.773068 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:39:04.773288 INFO: Starting candidate selection
6:39:09.621149 INFO: Starting candidate scoring
6:39:11.071811 INFO: Finished candidate processing
6:39:11.071928 INFO: Collecting candidate features
6:39:13.305465 WARNING: intensity_correlation has 13 NaNs ( 0.09 % out of 14818)
6:39:13.311522 INFO: Collecting fragment features
6:39:13.977555 INFO: Finished candidate scoring
6:39:14.275632 PROGRESS: === Epoch 12, step 3, extracted 14818 precursors and 70098 fragments ===
6:39:14.275981 INFO: performing precursor FDR with 47 features
6:39:14.276026 INFO: Decoy channel: -1
6:39:14.276053 INFO: Competetive: True
6:39:14.305233 WARNING: dropped 11 target PSMs due to missing features
6:39:14.305348 WARNING: dropped 14 decoy PSMs due to missing features
6:39:15.082837 INFO: Test AUC: 0.551
6:39:15.082981 INFO: Train AUC: 0.595
6:39:15.083028 INFO: AUC difference: 7.41%
6:39:15.083062 WARNING: AUC difference > 5%. This may indicate overfitting.
6:39:15.209327 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
6:39:15.210261 PROGRESS: ============================= Precursor FDR =============================
6:39:15.210390 PROGRESS: Total precursors accumulated: 215
6:39:15.210469 PROGRESS: Target precursors: 196 (91.16%)
6:39:15.210536 PROGRESS: Decoy precursors: 19 (8.84%)
6:39:15.210612 PROGRESS: 
6:39:15.210674 PROGRESS: Precursor Summary:
6:39:15.212181 PROGRESS: Channel   0:	 0.05 FDR:   118; 0.01 FDR:   104; 0.001 FDR:    85
6:39:15.212294 PROGRESS: 
6:39:15.212383 PROGRESS: Protein Summary:
6:39:15.214128 PROGRESS: Channel   0:	 0.05 FDR:   116; 0.01 FDR:   104; 0.001 FDR:    85
6:39:15.214242 PROGRESS: =========================================================================
6:39:15.215159 PROGRESS: === Epoch 12, step 4, extracting elution groups 15000 to 31000 ===
6:39:15.322489 PROGRESS: Extracting batch of 31598 precursors
6:39:15.333446 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:39:15.333558 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:39:15.333597 INFO: FWHM in RT is 13.99 seconds, sigma is 0.51
6:39:15.333623 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:39:15.333910 INFO: Starting candidate selection
6:39:20.458925 INFO: Starting candidate scoring
6:39:22.030298 INFO: Finished candidate processing
6:39:22.030389 INFO: Collecting candidate features
6:39:24.328026 WARNING: intensity_correlation has 19 NaNs ( 0.06 % out of 29590)
6:39:24.335602 INFO: Collecting fragment features
6:39:25.020067 INFO: Finished candidate scoring
6:39:25.335976 PROGRESS: === Epoch 12, step 4, extracted 29590 precursors and 139662 fragments ===
6:39:25.343212 INFO: performing precursor FDR with 47 features
6:39:25.343368 INFO: Decoy channel: -1
6:39:25.343460 INFO: Competetive: True
6:39:25.402184 WARNING: dropped 20 target PSMs due to missing features
6:39:25.402329 WARNING: dropped 24 decoy PSMs due to missing features
6:39:27.309792 INFO: Test AUC: 0.553
6:39:27.309936 INFO: Train AUC: 0.608
6:39:27.309982 INFO: AUC difference: 9.13%
6:39:27.310017 WARNING: AUC difference > 5%. This may indicate overfitting.
6:39:27.441577 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
6:39:27.442717 PROGRESS: ============================= Precursor FDR =============================
6:39:27.442846 PROGRESS: Total precursors accumulated: 674
6:39:27.442925 PROGRESS: Target precursors: 615 (91.25%)
6:39:27.442996 PROGRESS: Decoy precursors: 59 (8.75%)
6:39:27.443060 PROGRESS: 
6:39:27.443122 PROGRESS: Precursor Summary:
6:39:27.444794 PROGRESS: Channel   0:	 0.05 FDR:   406; 0.01 FDR:   177; 0.001 FDR:   139
6:39:27.444908 PROGRESS: 
6:39:27.444998 PROGRESS: Protein Summary:
6:39:27.446956 PROGRESS: Channel   0:	 0.05 FDR:   389; 0.01 FDR:   167; 0.001 FDR:   133
6:39:27.447083 PROGRESS: =========================================================================
6:39:27.448071 PROGRESS: === Epoch 12, step 5, extracting elution groups 31000 to 63000 ===
6:39:27.585099 PROGRESS: Extracting batch of 63244 precursors
6:39:27.605105 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:39:27.605211 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:39:27.605247 INFO: FWHM in RT is 13.99 seconds, sigma is 0.51
6:39:27.605289 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:39:27.605555 INFO: Starting candidate selection
6:39:33.354018 INFO: Starting candidate scoring
6:39:35.224762 INFO: Finished candidate processing
6:39:35.224862 INFO: Collecting candidate features
6:39:37.572795 WARNING: intensity_correlation has 51 NaNs ( 0.09 % out of 59091)
6:39:37.581558 INFO: Collecting fragment features
6:39:38.290066 INFO: Finished candidate scoring
6:39:38.641143 PROGRESS: === Epoch 12, step 5, extracted 59091 precursors and 277153 fragments ===
6:39:38.641513 INFO: performing precursor FDR with 47 features
6:39:38.641565 INFO: Decoy channel: -1
6:39:38.641592 INFO: Competetive: True
6:39:38.774185 WARNING: dropped 40 target PSMs due to missing features
6:39:38.774304 WARNING: dropped 55 decoy PSMs due to missing features
6:39:42.876733 INFO: Test AUC: 0.554
6:39:42.876853 INFO: Train AUC: 0.605
6:39:42.876909 INFO: AUC difference: 8.50%
6:39:42.876982 WARNING: AUC difference > 5%. This may indicate overfitting.
6:39:43.010555 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
6:39:43.011893 PROGRESS: ============================= Precursor FDR =============================
6:39:43.012040 PROGRESS: Total precursors accumulated: 1,268
6:39:43.012118 PROGRESS: Target precursors: 1,156 (91.17%)
6:39:43.012186 PROGRESS: Decoy precursors: 112 (8.83%)
6:39:43.012248 PROGRESS: 
6:39:43.012310 PROGRESS: Precursor Summary:
6:39:43.014260 PROGRESS: Channel   0:	 0.05 FDR:   784; 0.01 FDR:   453; 0.001 FDR:   353
6:39:43.014382 PROGRESS: 
6:39:43.014457 PROGRESS: Protein Summary:
6:39:43.016750 PROGRESS: Channel   0:	 0.05 FDR:   736; 0.01 FDR:   421; 0.001 FDR:   329
6:39:43.016862 PROGRESS: =========================================================================
6:39:43.018017 PROGRESS: === Epoch 12, step 6, extracting elution groups 63000 to 127000 ===
6:39:43.194058 PROGRESS: Extracting batch of 126442 precursors
6:39:43.232151 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:39:43.232270 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:39:43.232309 INFO: FWHM in RT is 13.99 seconds, sigma is 0.51
6:39:43.232351 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:39:43.232607 INFO: Starting candidate selection
6:39:50.278939 INFO: Starting candidate scoring
6:39:52.767538 INFO: Finished candidate processing
6:39:52.767684 INFO: Collecting candidate features
6:39:55.326883 WARNING: intensity_correlation has 99 NaNs ( 0.08 % out of 118000)
6:39:55.341401 INFO: Collecting fragment features
6:39:56.117042 INFO: Finished candidate scoring
6:39:56.547143 PROGRESS: === Epoch 12, step 6, extracted 118000 precursors and 554166 fragments ===
6:39:56.547544 INFO: performing precursor FDR with 47 features
6:39:56.547594 INFO: Decoy channel: -1
6:39:56.547620 INFO: Competetive: True
6:39:56.822458 WARNING: dropped 84 target PSMs due to missing features
6:39:56.822593 WARNING: dropped 110 decoy PSMs due to missing features
6:40:05.173799 INFO: Test AUC: 0.553
6:40:05.173944 INFO: Train AUC: 0.593
6:40:05.173985 INFO: AUC difference: 6.76%
6:40:05.174013 WARNING: AUC difference > 5%. This may indicate overfitting.
6:40:05.327916 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
6:40:05.329627 PROGRESS: ============================= Precursor FDR =============================
6:40:05.329776 PROGRESS: Total precursors accumulated: 2,473
6:40:05.329875 PROGRESS: Target precursors: 2,255 (91.18%)
6:40:05.329943 PROGRESS: Decoy precursors: 218 (8.82%)
6:40:05.330005 PROGRESS: 
6:40:05.330066 PROGRESS: Precursor Summary:
6:40:05.332397 PROGRESS: Channel   0:	 0.05 FDR: 1,596; 0.01 FDR:   905; 0.001 FDR:   693
6:40:05.332523 PROGRESS: 
6:40:05.332599 PROGRESS: Protein Summary:
6:40:05.335538 PROGRESS: Channel   0:	 0.05 FDR: 1,429; 0.01 FDR:   804; 0.001 FDR:   616
6:40:05.335657 PROGRESS: =========================================================================
6:40:05.337083 PROGRESS: === Epoch 12, step 7, extracting elution groups 127000 to 255000 ===
6:40:05.563762 PROGRESS: Extracting batch of 252872 precursors
6:40:05.636791 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:40:05.636907 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:40:05.636945 INFO: FWHM in RT is 13.99 seconds, sigma is 0.51
6:40:05.636989 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:40:05.637254 INFO: Starting candidate selection
6:40:15.307284 INFO: Starting candidate scoring
6:40:19.037828 INFO: Finished candidate processing
6:40:19.038012 INFO: Collecting candidate features
6:40:21.983225 WARNING: intensity_correlation has 180 NaNs ( 0.08 % out of 236488)
6:40:21.983942 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 236488)
6:40:22.004053 INFO: Collecting fragment features
6:40:22.863008 INFO: Finished candidate scoring
6:40:23.441610 PROGRESS: === Epoch 12, step 7, extracted 236488 precursors and 1111616 fragments ===
6:40:23.441991 INFO: performing precursor FDR with 47 features
6:40:23.442037 INFO: Decoy channel: -1
6:40:23.442064 INFO: Competetive: True
6:40:24.035461 WARNING: dropped 164 target PSMs due to missing features
6:40:24.035585 WARNING: dropped 210 decoy PSMs due to missing features
6:40:40.950453 INFO: Test AUC: 0.555
6:40:40.950604 INFO: Train AUC: 0.582
6:40:40.950649 INFO: AUC difference: 4.60%
6:40:41.134139 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
6:40:41.136426 PROGRESS: ============================= Precursor FDR =============================
6:40:41.136577 PROGRESS: Total precursors accumulated: 4,190
6:40:41.136666 PROGRESS: Target precursors: 3,820 (91.17%)
6:40:41.136731 PROGRESS: Decoy precursors: 370 (8.83%)
6:40:41.136803 PROGRESS: 
6:40:41.136864 PROGRESS: Precursor Summary:
6:40:41.139816 PROGRESS: Channel   0:	 0.05 FDR: 2,846; 0.01 FDR: 2,038; 0.001 FDR: 1,624
6:40:41.139958 PROGRESS: 
6:40:41.140029 PROGRESS: Protein Summary:
6:40:41.143963 PROGRESS: Channel   0:	 0.05 FDR: 2,291; 0.01 FDR: 1,595; 0.001 FDR: 1,267
6:40:41.144092 PROGRESS: =========================================================================
6:40:41.146051 PROGRESS: === Epoch 12, step 8, extracting elution groups 255000 to 511000 ===
6:40:41.449337 PROGRESS: Extracting batch of 505880 precursors
6:40:41.582097 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:40:41.582214 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:40:41.582255 INFO: FWHM in RT is 13.99 seconds, sigma is 0.51
6:40:41.582284 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:40:41.582550 INFO: Starting candidate selection
6:40:56.324142 INFO: Starting candidate scoring
6:41:02.454962 INFO: Finished candidate processing
6:41:02.455154 INFO: Collecting candidate features
6:41:06.094373 WARNING: intensity_correlation has 351 NaNs ( 0.07 % out of 473281)
6:41:06.128795 INFO: Collecting fragment features
6:41:07.178454 INFO: Finished candidate scoring
6:41:08.057018 PROGRESS: === Epoch 12, step 8, extracted 473281 precursors and 2222838 fragments ===
6:41:08.057385 INFO: performing precursor FDR with 47 features
6:41:08.057431 INFO: Decoy channel: -1
6:41:08.057458 INFO: Competetive: True
6:41:09.198708 WARNING: dropped 338 target PSMs due to missing features
6:41:09.198831 WARNING: dropped 387 decoy PSMs due to missing features
6:41:44.187884 INFO: Test AUC: 0.551
6:41:44.188015 INFO: Train AUC: 0.571
6:41:44.188057 INFO: AUC difference: 3.51%
6:41:44.441805 PROGRESS: === checking if recalibration conditions were reached, target 2600 precursors ===
6:41:44.444775 PROGRESS: ============================= Precursor FDR =============================
6:41:44.444948 PROGRESS: Total precursors accumulated: 6,821
6:41:44.445025 PROGRESS: Target precursors: 6,217 (91.14%)
6:41:44.445092 PROGRESS: Decoy precursors: 604 (8.86%)
6:41:44.445153 PROGRESS: 
6:41:44.445212 PROGRESS: Precursor Summary:
6:41:44.448990 PROGRESS: Channel   0:	 0.05 FDR: 5,142; 0.01 FDR: 3,769; 0.001 FDR: 2,241
6:41:44.449147 PROGRESS: 
6:41:44.449222 PROGRESS: Protein Summary:
6:41:44.454690 PROGRESS: Channel   0:	 0.05 FDR: 3,485; 0.01 FDR: 2,468; 0.001 FDR: 1,572
6:41:44.454845 PROGRESS: =========================================================================
6:41:44.459419 INFO: calibration group: precursor, fitting rt estimator 
6:41:44.902861 INFO: calibration group: fragment, fitting mz estimator 
6:41:45.502250 INFO: === checking if epoch conditions were reached ===
6:41:45.502465 INFO: ✅ ms2_error      : 7.0000 <= 7
6:41:45.502556 INFO: ❌ rt_error       : 201.7076 > 100
6:41:45.502630 INFO: ✅ current_epoch  : 12 >= 3
6:41:45.502695 INFO: ==============================================
6:41:45.748557 INFO: calibration group: precursor, predicting mz
6:41:45.748842 WARNING: mz prediction was skipped as it has not been fitted yet
6:41:45.748883 INFO: calibration group: precursor, predicting rt
6:41:52.565474 INFO: calibration group: fragment, predicting mz
6:42:10.342928 PROGRESS: === Epoch 13, step 0, extracting elution groups 0 to 1000 ===
6:42:10.441802 PROGRESS: Extracting batch of 1981 precursors
6:42:10.443572 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:42:10.443648 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:42:10.443686 INFO: FWHM in RT is 13.84 seconds, sigma is 0.50
6:42:10.443731 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:42:10.443957 INFO: Starting candidate selection
6:42:15.398705 INFO: Starting candidate scoring
6:42:16.695683 INFO: Finished candidate processing
6:42:16.695775 INFO: Collecting candidate features
6:42:18.858370 INFO: Collecting fragment features
6:42:19.502233 INFO: Finished candidate scoring
6:42:19.847593 PROGRESS: === Epoch 13, step 0, extracted 1866 precursors and 8853 fragments ===
6:42:19.847899 INFO: performing precursor FDR with 47 features
6:42:19.847940 INFO: Decoy channel: -1
6:42:19.847967 INFO: Competetive: True
6:42:19.880513 INFO: Test AUC: 0.504
6:42:19.880621 INFO: Train AUC: 0.521
6:42:19.880666 INFO: AUC difference: 3.27%
6:42:20.002347 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
6:42:20.003153 PROGRESS: ============================= Precursor FDR =============================
6:42:20.003285 PROGRESS: Total precursors accumulated: 9
6:42:20.003371 PROGRESS: Target precursors: 9 (100.00%)
6:42:20.003448 PROGRESS: Decoy precursors: 0 (0.00%)
6:42:20.003530 PROGRESS: 
6:42:20.003610 PROGRESS: Precursor Summary:
6:42:20.005075 PROGRESS: Channel   0:	 0.05 FDR:     9; 0.01 FDR:     9; 0.001 FDR:     9
6:42:20.005195 PROGRESS: 
6:42:20.005287 PROGRESS: Protein Summary:
6:42:20.007616 PROGRESS: Channel   0:	 0.05 FDR:     9; 0.01 FDR:     9; 0.001 FDR:     9
6:42:20.007746 PROGRESS: =========================================================================
6:42:20.008632 PROGRESS: === Epoch 13, step 1, extracting elution groups 1000 to 3000 ===
6:42:20.086154 PROGRESS: Extracting batch of 3952 precursors
6:42:20.088387 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:42:20.088455 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:42:20.088502 INFO: FWHM in RT is 13.84 seconds, sigma is 0.50
6:42:20.088536 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:42:20.088750 INFO: Starting candidate selection
6:42:24.722355 INFO: Starting candidate scoring
6:42:26.064191 INFO: Finished candidate processing
6:42:26.064283 INFO: Collecting candidate features
6:42:28.246420 WARNING: intensity_correlation has 2 NaNs ( 0.05 % out of 3689)
6:42:28.253282 INFO: Collecting fragment features
6:42:28.916024 INFO: Finished candidate scoring
6:42:29.197199 PROGRESS: === Epoch 13, step 1, extracted 3689 precursors and 17463 fragments ===
6:42:29.197505 INFO: performing precursor FDR with 47 features
6:42:29.197550 INFO: Decoy channel: -1
6:42:29.197577 INFO: Competetive: True
6:42:29.205970 WARNING: dropped 2 decoy PSMs due to missing features
6:42:29.244704 INFO: Test AUC: 0.526
6:42:29.244829 INFO: Train AUC: 0.546
6:42:29.244874 INFO: AUC difference: 3.65%
6:42:29.381441 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
6:42:29.382230 PROGRESS: ============================= Precursor FDR =============================
6:42:29.382360 PROGRESS: Total precursors accumulated: 24
6:42:29.382439 PROGRESS: Target precursors: 22 (91.67%)
6:42:29.382509 PROGRESS: Decoy precursors: 2 (8.33%)
6:42:29.382573 PROGRESS: 
6:42:29.382634 PROGRESS: Precursor Summary:
6:42:29.384056 PROGRESS: Channel   0:	 0.05 FDR:    21; 0.01 FDR:    20; 0.001 FDR:    20
6:42:29.384182 PROGRESS: 
6:42:29.384255 PROGRESS: Protein Summary:
6:42:29.385881 PROGRESS: Channel   0:	 0.05 FDR:    21; 0.01 FDR:    20; 0.001 FDR:    20
6:42:29.385992 PROGRESS: =========================================================================
6:42:29.386868 PROGRESS: === Epoch 13, step 2, extracting elution groups 3000 to 7000 ===
6:42:29.468880 PROGRESS: Extracting batch of 7898 precursors
6:42:29.472230 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:42:29.472292 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:42:29.472332 INFO: FWHM in RT is 13.84 seconds, sigma is 0.50
6:42:29.472377 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:42:29.472598 INFO: Starting candidate selection
6:42:34.125737 INFO: Starting candidate scoring
6:42:35.474134 INFO: Finished candidate processing
6:42:35.474225 INFO: Collecting candidate features
6:42:37.665606 WARNING: intensity_correlation has 3 NaNs ( 0.04 % out of 7342)
6:42:37.671144 INFO: Collecting fragment features
6:42:38.325424 INFO: Finished candidate scoring
6:42:38.611936 PROGRESS: === Epoch 13, step 2, extracted 7342 precursors and 34675 fragments ===
6:42:38.612283 INFO: performing precursor FDR with 47 features
6:42:38.612336 INFO: Decoy channel: -1
6:42:38.612363 INFO: Competetive: True
6:42:38.627266 WARNING: dropped 5 decoy PSMs due to missing features
6:42:38.880032 INFO: Test AUC: 0.540
6:42:38.880179 INFO: Train AUC: 0.576
6:42:38.880244 INFO: AUC difference: 6.23%
6:42:38.880290 WARNING: AUC difference > 5%. This may indicate overfitting.
6:42:39.000569 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
6:42:39.001389 PROGRESS: ============================= Precursor FDR =============================
6:42:39.001512 PROGRESS: Total precursors accumulated: 103
6:42:39.001595 PROGRESS: Target precursors: 94 (91.26%)
6:42:39.001670 PROGRESS: Decoy precursors: 9 (8.74%)
6:42:39.001739 PROGRESS: 
6:42:39.001833 PROGRESS: Precursor Summary:
6:42:39.003315 PROGRESS: Channel   0:	 0.05 FDR:    84; 0.01 FDR:    61; 0.001 FDR:    61
6:42:39.003433 PROGRESS: 
6:42:39.003525 PROGRESS: Protein Summary:
6:42:39.005721 PROGRESS: Channel   0:	 0.05 FDR:    83; 0.01 FDR:    60; 0.001 FDR:    60
6:42:39.005884 PROGRESS: =========================================================================
6:42:39.006781 PROGRESS: === Epoch 13, step 3, extracting elution groups 7000 to 15000 ===
6:42:39.099581 PROGRESS: Extracting batch of 15822 precursors
6:42:39.105238 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:42:39.105308 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:42:39.105342 INFO: FWHM in RT is 13.84 seconds, sigma is 0.50
6:42:39.105385 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:42:39.105603 INFO: Starting candidate selection
6:42:43.980612 INFO: Starting candidate scoring
6:42:45.433478 INFO: Finished candidate processing
6:42:45.433568 INFO: Collecting candidate features
6:42:47.675342 WARNING: intensity_correlation has 11 NaNs ( 0.07 % out of 14716)
6:42:47.681330 INFO: Collecting fragment features
6:42:48.350660 INFO: Finished candidate scoring
6:42:48.650141 PROGRESS: === Epoch 13, step 3, extracted 14716 precursors and 69238 fragments ===
6:42:48.650482 INFO: performing precursor FDR with 47 features
6:42:48.650531 INFO: Decoy channel: -1
6:42:48.650557 INFO: Competetive: True
6:42:48.679840 WARNING: dropped 5 target PSMs due to missing features
6:42:48.679965 WARNING: dropped 11 decoy PSMs due to missing features
6:42:49.410319 INFO: Test AUC: 0.554
6:42:49.411317 INFO: Train AUC: 0.594
6:42:49.411364 INFO: AUC difference: 6.74%
6:42:49.411393 WARNING: AUC difference > 5%. This may indicate overfitting.
6:42:49.539292 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
6:42:49.540223 PROGRESS: ============================= Precursor FDR =============================
6:42:49.540361 PROGRESS: Total precursors accumulated: 237
6:42:49.540440 PROGRESS: Target precursors: 217 (91.56%)
6:42:49.540508 PROGRESS: Decoy precursors: 20 (8.44%)
6:42:49.540570 PROGRESS: 
6:42:49.540631 PROGRESS: Precursor Summary:
6:42:49.542231 PROGRESS: Channel   0:	 0.05 FDR:   163; 0.01 FDR:   106; 0.001 FDR:   101
6:42:49.542350 PROGRESS: 
6:42:49.542424 PROGRESS: Protein Summary:
6:42:49.544191 PROGRESS: Channel   0:	 0.05 FDR:   160; 0.01 FDR:   104; 0.001 FDR:    99
6:42:49.544320 PROGRESS: =========================================================================
6:42:49.545229 PROGRESS: === Epoch 13, step 4, extracting elution groups 15000 to 31000 ===
6:42:49.654114 PROGRESS: Extracting batch of 31592 precursors
6:42:49.665075 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:42:49.665186 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:42:49.665228 INFO: FWHM in RT is 13.84 seconds, sigma is 0.50
6:42:49.665255 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:42:49.665496 INFO: Starting candidate selection
6:42:54.804490 INFO: Starting candidate scoring
6:42:56.372687 INFO: Finished candidate processing
6:42:56.372781 INFO: Collecting candidate features
6:42:58.631765 WARNING: intensity_correlation has 22 NaNs ( 0.07 % out of 29503)
6:42:58.638717 INFO: Collecting fragment features
6:42:59.320246 INFO: Finished candidate scoring
6:42:59.634389 PROGRESS: === Epoch 13, step 4, extracted 29503 precursors and 139187 fragments ===
6:42:59.641563 INFO: performing precursor FDR with 47 features
6:42:59.641643 INFO: Decoy channel: -1
6:42:59.641670 INFO: Competetive: True
6:42:59.699805 WARNING: dropped 20 target PSMs due to missing features
6:42:59.699915 WARNING: dropped 18 decoy PSMs due to missing features
6:43:01.527514 INFO: Test AUC: 0.553
6:43:01.527663 INFO: Train AUC: 0.607
6:43:01.527709 INFO: AUC difference: 8.83%
6:43:01.527744 WARNING: AUC difference > 5%. This may indicate overfitting.
6:43:01.656145 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
6:43:01.657219 PROGRESS: ============================= Precursor FDR =============================
6:43:01.657345 PROGRESS: Total precursors accumulated: 549
6:43:01.657424 PROGRESS: Target precursors: 499 (90.89%)
6:43:01.657493 PROGRESS: Decoy precursors: 50 (9.11%)
6:43:01.657569 PROGRESS: 
6:43:01.657632 PROGRESS: Precursor Summary:
6:43:01.659287 PROGRESS: Channel   0:	 0.05 FDR:   325; 0.01 FDR:   201; 0.001 FDR:   177
6:43:01.659428 PROGRESS: 
6:43:01.659502 PROGRESS: Protein Summary:
6:43:01.661422 PROGRESS: Channel   0:	 0.05 FDR:   316; 0.01 FDR:   193; 0.001 FDR:   170
6:43:01.661534 PROGRESS: =========================================================================
6:43:01.662552 PROGRESS: === Epoch 13, step 5, extracting elution groups 31000 to 63000 ===
6:43:01.800026 PROGRESS: Extracting batch of 63205 precursors
6:43:01.820323 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:43:01.820434 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:43:01.820472 INFO: FWHM in RT is 13.84 seconds, sigma is 0.50
6:43:01.820514 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:43:01.820786 INFO: Starting candidate selection
6:43:07.625277 INFO: Starting candidate scoring
6:43:09.502771 INFO: Finished candidate processing
6:43:09.502955 INFO: Collecting candidate features
6:43:11.864922 WARNING: intensity_correlation has 40 NaNs ( 0.07 % out of 59232)
6:43:11.873706 INFO: Collecting fragment features
6:43:12.587411 INFO: Finished candidate scoring
6:43:12.937504 PROGRESS: === Epoch 13, step 5, extracted 59232 precursors and 277474 fragments ===
6:43:12.937866 INFO: performing precursor FDR with 47 features
6:43:12.937918 INFO: Decoy channel: -1
6:43:12.937944 INFO: Competetive: True
6:43:13.069266 WARNING: dropped 34 target PSMs due to missing features
6:43:13.069383 WARNING: dropped 44 decoy PSMs due to missing features
6:43:17.159774 INFO: Test AUC: 0.550
6:43:17.159895 INFO: Train AUC: 0.606
6:43:17.159972 INFO: AUC difference: 9.18%
6:43:17.160002 WARNING: AUC difference > 5%. This may indicate overfitting.
6:43:17.311209 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
6:43:17.312558 PROGRESS: ============================= Precursor FDR =============================
6:43:17.312683 PROGRESS: Total precursors accumulated: 1,309
6:43:17.312759 PROGRESS: Target precursors: 1,195 (91.29%)
6:43:17.312826 PROGRESS: Decoy precursors: 114 (8.71%)
6:43:17.312888 PROGRESS: 
6:43:17.312948 PROGRESS: Precursor Summary:
6:43:17.314838 PROGRESS: Channel   0:	 0.05 FDR:   777; 0.01 FDR:   445; 0.001 FDR:   318
6:43:17.314967 PROGRESS: 
6:43:17.315040 PROGRESS: Protein Summary:
6:43:17.317246 PROGRESS: Channel   0:	 0.05 FDR:   734; 0.01 FDR:   419; 0.001 FDR:   300
6:43:17.317356 PROGRESS: =========================================================================
6:43:17.318513 PROGRESS: === Epoch 13, step 6, extracting elution groups 63000 to 127000 ===
6:43:17.494988 PROGRESS: Extracting batch of 126537 precursors
6:43:17.533393 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:43:17.533524 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:43:17.533564 INFO: FWHM in RT is 13.84 seconds, sigma is 0.50
6:43:17.533591 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:43:17.533880 INFO: Starting candidate selection
6:43:24.613903 INFO: Starting candidate scoring
6:43:27.116062 INFO: Finished candidate processing
6:43:27.116149 INFO: Collecting candidate features
6:43:29.652769 WARNING: intensity_correlation has 70 NaNs ( 0.06 % out of 118102)
6:43:29.666382 INFO: Collecting fragment features
6:43:30.442808 INFO: Finished candidate scoring
6:43:30.865931 PROGRESS: === Epoch 13, step 6, extracted 118102 precursors and 553623 fragments ===
6:43:30.866283 INFO: performing precursor FDR with 47 features
6:43:30.866329 INFO: Decoy channel: -1
6:43:30.866355 INFO: Competetive: True
6:43:31.137867 WARNING: dropped 84 target PSMs due to missing features
6:43:31.137985 WARNING: dropped 64 decoy PSMs due to missing features
6:43:39.846939 INFO: Test AUC: 0.554
6:43:39.847087 INFO: Train AUC: 0.592
6:43:39.847144 INFO: AUC difference: 6.36%
6:43:39.847172 WARNING: AUC difference > 5%. This may indicate overfitting.
6:43:40.002384 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
6:43:40.004019 PROGRESS: ============================= Precursor FDR =============================
6:43:40.004177 PROGRESS: Total precursors accumulated: 2,241
6:43:40.004256 PROGRESS: Target precursors: 2,045 (91.25%)
6:43:40.004324 PROGRESS: Decoy precursors: 196 (8.75%)
6:43:40.004387 PROGRESS: 
6:43:40.004449 PROGRESS: Precursor Summary:
6:43:40.006677 PROGRESS: Channel   0:	 0.05 FDR: 1,505; 0.01 FDR:   884; 0.001 FDR:   622
6:43:40.006807 PROGRESS: 
6:43:40.006883 PROGRESS: Protein Summary:
6:43:40.009663 PROGRESS: Channel   0:	 0.05 FDR: 1,345; 0.01 FDR:   770; 0.001 FDR:   550
6:43:40.009781 PROGRESS: =========================================================================
6:43:40.011168 PROGRESS: === Epoch 13, step 7, extracting elution groups 127000 to 255000 ===
6:43:40.235604 PROGRESS: Extracting batch of 252805 precursors
6:43:40.308174 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:43:40.308292 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:43:40.308329 INFO: FWHM in RT is 13.84 seconds, sigma is 0.50
6:43:40.308371 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:43:40.308632 INFO: Starting candidate selection
6:43:49.923990 INFO: Starting candidate scoring
6:43:53.674747 INFO: Finished candidate processing
6:43:53.674931 INFO: Collecting candidate features
6:43:56.638954 WARNING: intensity_correlation has 140 NaNs ( 0.06 % out of 236305)
6:43:56.659548 INFO: Collecting fragment features
6:43:57.536674 INFO: Finished candidate scoring
6:43:58.119363 PROGRESS: === Epoch 13, step 7, extracted 236305 precursors and 1107171 fragments ===
6:43:58.119735 INFO: performing precursor FDR with 47 features
6:43:58.119780 INFO: Decoy channel: -1
6:43:58.119806 INFO: Competetive: True
6:43:58.713940 WARNING: dropped 148 target PSMs due to missing features
6:43:58.714079 WARNING: dropped 140 decoy PSMs due to missing features
6:44:15.979345 INFO: Test AUC: 0.549
6:44:15.979471 INFO: Train AUC: 0.580
6:44:15.979527 INFO: AUC difference: 5.29%
6:44:15.979573 WARNING: AUC difference > 5%. This may indicate overfitting.
6:44:16.161681 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
6:44:16.163800 PROGRESS: ============================= Precursor FDR =============================
6:44:16.163953 PROGRESS: Total precursors accumulated: 3,724
6:44:16.164049 PROGRESS: Target precursors: 3,399 (91.27%)
6:44:16.164134 PROGRESS: Decoy precursors: 325 (8.73%)
6:44:16.164212 PROGRESS: 
6:44:16.164289 PROGRESS: Precursor Summary:
6:44:16.167751 PROGRESS: Channel   0:	 0.05 FDR: 2,584; 0.01 FDR: 1,768; 0.001 FDR: 1,420
6:44:16.167903 PROGRESS: 
6:44:16.167995 PROGRESS: Protein Summary:
6:44:16.172070 PROGRESS: Channel   0:	 0.05 FDR: 2,092; 0.01 FDR: 1,403; 0.001 FDR: 1,149
6:44:16.172195 PROGRESS: =========================================================================
6:44:16.174055 PROGRESS: === Epoch 13, step 8, extracting elution groups 255000 to 511000 ===
6:44:16.477313 PROGRESS: Extracting batch of 505725 precursors
6:44:16.609477 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:44:16.609590 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:44:16.609633 INFO: FWHM in RT is 13.84 seconds, sigma is 0.50
6:44:16.609671 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:44:16.609973 INFO: Starting candidate selection
6:44:31.335113 INFO: Starting candidate scoring
6:44:37.412709 INFO: Finished candidate processing
6:44:37.412900 INFO: Collecting candidate features
6:44:41.063933 WARNING: intensity_correlation has 272 NaNs ( 0.06 % out of 472582)
6:44:41.097480 INFO: Collecting fragment features
6:44:42.150694 INFO: Finished candidate scoring
6:44:43.027020 PROGRESS: === Epoch 13, step 8, extracted 472582 precursors and 2218490 fragments ===
6:44:43.027441 INFO: performing precursor FDR with 47 features
6:44:43.033967 INFO: Decoy channel: -1
6:44:43.034131 INFO: Competetive: True
6:44:44.164006 WARNING: dropped 280 target PSMs due to missing features
6:44:44.164141 WARNING: dropped 280 decoy PSMs due to missing features
6:45:19.443064 INFO: Test AUC: 0.550
6:45:19.443197 INFO: Train AUC: 0.570
6:45:19.443252 INFO: AUC difference: 3.57%
6:45:19.717543 PROGRESS: === checking if recalibration conditions were reached, target 2800 precursors ===
6:45:19.720478 PROGRESS: ============================= Precursor FDR =============================
6:45:19.720619 PROGRESS: Total precursors accumulated: 6,383
6:45:19.720708 PROGRESS: Target precursors: 5,826 (91.27%)
6:45:19.720774 PROGRESS: Decoy precursors: 557 (8.73%)
6:45:19.720837 PROGRESS: 
6:45:19.720899 PROGRESS: Precursor Summary:
6:45:19.724397 PROGRESS: Channel   0:	 0.05 FDR: 4,718; 0.01 FDR: 3,339; 0.001 FDR: 1,582
6:45:19.724552 PROGRESS: 
6:45:19.724626 PROGRESS: Protein Summary:
6:45:19.729497 PROGRESS: Channel   0:	 0.05 FDR: 3,175; 0.01 FDR: 2,221; 0.001 FDR: 1,186
6:45:19.729633 PROGRESS: =========================================================================
6:45:19.733861 INFO: calibration group: precursor, fitting rt estimator 
6:45:20.124493 INFO: calibration group: fragment, fitting mz estimator 
6:45:20.723253 INFO: === checking if epoch conditions were reached ===
6:45:20.723474 INFO: ✅ ms2_error      : 7.0000 <= 7
6:45:20.723561 INFO: ❌ rt_error       : 200.6764 > 100
6:45:20.723633 INFO: ✅ current_epoch  : 13 >= 3
6:45:20.723697 INFO: ==============================================
6:45:20.945212 INFO: calibration group: precursor, predicting mz
6:45:20.945487 WARNING: mz prediction was skipped as it has not been fitted yet
6:45:20.945529 INFO: calibration group: precursor, predicting rt
6:45:27.707166 INFO: calibration group: fragment, predicting mz
6:45:45.155671 PROGRESS: === Epoch 14, step 0, extracting elution groups 0 to 1000 ===
6:45:45.255874 PROGRESS: Extracting batch of 1979 precursors
6:45:45.257605 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:45:45.257678 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:45:45.257716 INFO: FWHM in RT is 13.94 seconds, sigma is 0.51
6:45:45.257763 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:45:45.258001 INFO: Starting candidate selection
6:45:50.154294 INFO: Starting candidate scoring
6:45:51.435249 INFO: Finished candidate processing
6:45:51.435338 INFO: Collecting candidate features
6:45:53.584180 WARNING: intensity_correlation has 2 NaNs ( 0.11 % out of 1859)
6:45:53.589910 INFO: Collecting fragment features
6:45:54.218945 INFO: Finished candidate scoring
6:45:54.562353 PROGRESS: === Epoch 14, step 0, extracted 1859 precursors and 8735 fragments ===
6:45:54.562700 INFO: performing precursor FDR with 47 features
6:45:54.562751 INFO: Decoy channel: -1
6:45:54.562795 INFO: Competetive: True
6:45:54.567299 WARNING: dropped 2 decoy PSMs due to missing features
6:45:54.595659 INFO: Test AUC: 0.557
6:45:54.595752 INFO: Train AUC: 0.557
6:45:54.595797 INFO: AUC difference: 0.01%
6:45:54.712944 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
6:45:54.713724 PROGRESS: ============================= Precursor FDR =============================
6:45:54.713855 PROGRESS: Total precursors accumulated: 10
6:45:54.713944 PROGRESS: Target precursors: 10 (100.00%)
6:45:54.714014 PROGRESS: Decoy precursors: 0 (0.00%)
6:45:54.714076 PROGRESS: 
6:45:54.714136 PROGRESS: Precursor Summary:
6:45:54.715622 PROGRESS: Channel   0:	 0.05 FDR:    10; 0.01 FDR:    10; 0.001 FDR:    10
6:45:54.715750 PROGRESS: 
6:45:54.715822 PROGRESS: Protein Summary:
6:45:54.717497 PROGRESS: Channel   0:	 0.05 FDR:    10; 0.01 FDR:    10; 0.001 FDR:    10
6:45:54.717626 PROGRESS: =========================================================================
6:45:54.718516 PROGRESS: === Epoch 14, step 1, extracting elution groups 1000 to 3000 ===
6:45:54.795718 PROGRESS: Extracting batch of 3951 precursors
6:45:54.797887 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:45:54.797948 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:45:54.797989 INFO: FWHM in RT is 13.94 seconds, sigma is 0.51
6:45:54.798049 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:45:54.798265 INFO: Starting candidate selection
6:45:59.416707 INFO: Starting candidate scoring
6:46:00.733928 INFO: Finished candidate processing
6:46:00.734034 INFO: Collecting candidate features
6:46:02.900376 WARNING: intensity_correlation has 4 NaNs ( 0.11 % out of 3677)
6:46:02.906330 INFO: Collecting fragment features
6:46:03.546625 INFO: Finished candidate scoring
6:46:03.828231 PROGRESS: === Epoch 14, step 1, extracted 3677 precursors and 17084 fragments ===
6:46:03.828516 INFO: performing precursor FDR with 47 features
6:46:03.828560 INFO: Decoy channel: -1
6:46:03.828585 INFO: Competetive: True
6:46:03.837213 WARNING: dropped 4 target PSMs due to missing features
6:46:03.837305 WARNING: dropped 2 decoy PSMs due to missing features
6:46:03.875285 INFO: Test AUC: 0.541
6:46:03.875401 INFO: Train AUC: 0.557
6:46:03.875445 INFO: AUC difference: 2.78%
6:46:03.994908 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
6:46:03.995692 PROGRESS: ============================= Precursor FDR =============================
6:46:03.995813 PROGRESS: Total precursors accumulated: 27
6:46:03.995891 PROGRESS: Target precursors: 25 (92.59%)
6:46:03.995959 PROGRESS: Decoy precursors: 2 (7.41%)
6:46:03.996023 PROGRESS: 
6:46:03.996084 PROGRESS: Precursor Summary:
6:46:03.997511 PROGRESS: Channel   0:	 0.05 FDR:    25; 0.01 FDR:    24; 0.001 FDR:    24
6:46:03.997647 PROGRESS: 
6:46:03.997723 PROGRESS: Protein Summary:
6:46:03.999358 PROGRESS: Channel   0:	 0.05 FDR:    25; 0.01 FDR:    24; 0.001 FDR:    24
6:46:03.999467 PROGRESS: =========================================================================
6:46:04.000321 PROGRESS: === Epoch 14, step 2, extracting elution groups 3000 to 7000 ===
6:46:04.082240 PROGRESS: Extracting batch of 7910 precursors
6:46:04.085469 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:46:04.085535 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:46:04.085574 INFO: FWHM in RT is 13.94 seconds, sigma is 0.51
6:46:04.085619 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:46:04.085853 INFO: Starting candidate selection
6:46:08.726627 INFO: Starting candidate scoring
6:46:10.066211 INFO: Finished candidate processing
6:46:10.066438 INFO: Collecting candidate features
6:46:12.244354 WARNING: intensity_correlation has 3 NaNs ( 0.04 % out of 7397)
6:46:12.249988 INFO: Collecting fragment features
6:46:12.895271 INFO: Finished candidate scoring
6:46:13.181828 PROGRESS: === Epoch 14, step 2, extracted 7397 precursors and 34816 fragments ===
6:46:13.182167 INFO: performing precursor FDR with 47 features
6:46:13.182214 INFO: Decoy channel: -1
6:46:13.182239 INFO: Competetive: True
6:46:13.197352 WARNING: dropped 7 target PSMs due to missing features
6:46:13.197453 WARNING: dropped 2 decoy PSMs due to missing features
6:46:13.550345 INFO: Test AUC: 0.544
6:46:13.550478 INFO: Train AUC: 0.589
6:46:13.550524 INFO: AUC difference: 7.69%
6:46:13.550558 WARNING: AUC difference > 5%. This may indicate overfitting.
6:46:13.687045 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
6:46:13.687899 PROGRESS: ============================= Precursor FDR =============================
6:46:13.688025 PROGRESS: Total precursors accumulated: 90
6:46:13.688104 PROGRESS: Target precursors: 83 (92.22%)
6:46:13.688172 PROGRESS: Decoy precursors: 7 (7.78%)
6:46:13.688235 PROGRESS: 
6:46:13.688298 PROGRESS: Precursor Summary:
6:46:13.689776 PROGRESS: Channel   0:	 0.05 FDR:    69; 0.01 FDR:    50; 0.001 FDR:    50
6:46:13.689906 PROGRESS: 
6:46:13.689980 PROGRESS: Protein Summary:
6:46:13.691651 PROGRESS: Channel   0:	 0.05 FDR:    67; 0.01 FDR:    49; 0.001 FDR:    49
6:46:13.691763 PROGRESS: =========================================================================
6:46:13.692647 PROGRESS: === Epoch 14, step 3, extracting elution groups 7000 to 15000 ===
6:46:13.785398 PROGRESS: Extracting batch of 15817 precursors
6:46:13.800052 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:46:13.800140 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:46:13.800178 INFO: FWHM in RT is 13.94 seconds, sigma is 0.51
6:46:13.800220 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:46:13.800440 INFO: Starting candidate selection
6:46:18.677047 INFO: Starting candidate scoring
6:46:20.120567 INFO: Finished candidate processing
6:46:20.120665 INFO: Collecting candidate features
6:46:22.322787 WARNING: intensity_correlation has 16 NaNs ( 0.11 % out of 14746)
6:46:22.328717 INFO: Collecting fragment features
6:46:22.987086 INFO: Finished candidate scoring
6:46:23.282324 PROGRESS: === Epoch 14, step 3, extracted 14746 precursors and 69751 fragments ===
6:46:23.282659 INFO: performing precursor FDR with 47 features
6:46:23.282706 INFO: Decoy channel: -1
6:46:23.282733 INFO: Competetive: True
6:46:23.311247 WARNING: dropped 17 target PSMs due to missing features
6:46:23.311362 WARNING: dropped 8 decoy PSMs due to missing features
6:46:24.034768 INFO: Test AUC: 0.560
6:46:24.034913 INFO: Train AUC: 0.603
6:46:24.034959 INFO: AUC difference: 7.14%
6:46:24.034993 WARNING: AUC difference > 5%. This may indicate overfitting.
6:46:24.161198 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
6:46:24.162160 PROGRESS: ============================= Precursor FDR =============================
6:46:24.162282 PROGRESS: Total precursors accumulated: 278
6:46:24.162359 PROGRESS: Target precursors: 255 (91.73%)
6:46:24.162426 PROGRESS: Decoy precursors: 23 (8.27%)
6:46:24.162488 PROGRESS: 
6:46:24.162549 PROGRESS: Precursor Summary:
6:46:24.164061 PROGRESS: Channel   0:	 0.05 FDR:   183; 0.01 FDR:    87; 0.001 FDR:    87
6:46:24.164188 PROGRESS: 
6:46:24.164263 PROGRESS: Protein Summary:
6:46:24.166036 PROGRESS: Channel   0:	 0.05 FDR:   177; 0.01 FDR:    87; 0.001 FDR:    87
6:46:24.166147 PROGRESS: =========================================================================
6:46:24.167053 PROGRESS: === Epoch 14, step 4, extracting elution groups 15000 to 31000 ===
6:46:24.277161 PROGRESS: Extracting batch of 31629 precursors
6:46:24.287869 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:46:24.287984 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:46:24.288028 INFO: FWHM in RT is 13.94 seconds, sigma is 0.51
6:46:24.288055 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:46:24.288299 INFO: Starting candidate selection
6:46:29.510911 INFO: Starting candidate scoring
6:46:31.101361 INFO: Finished candidate processing
6:46:31.101455 INFO: Collecting candidate features
6:46:33.385184 WARNING: intensity_correlation has 23 NaNs ( 0.08 % out of 29618)
6:46:33.392187 INFO: Collecting fragment features
6:46:34.074275 INFO: Finished candidate scoring
6:46:34.390720 PROGRESS: === Epoch 14, step 4, extracted 29618 precursors and 138535 fragments ===
6:46:34.391064 INFO: performing precursor FDR with 47 features
6:46:34.391111 INFO: Decoy channel: -1
6:46:34.391137 INFO: Competetive: True
6:46:34.450344 WARNING: dropped 26 target PSMs due to missing features
6:46:34.450460 WARNING: dropped 22 decoy PSMs due to missing features
6:46:36.367223 INFO: Test AUC: 0.557
6:46:36.367372 INFO: Train AUC: 0.615
6:46:36.367415 INFO: AUC difference: 9.53%
6:46:36.367448 WARNING: AUC difference > 5%. This may indicate overfitting.
6:46:36.492838 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
6:46:36.493953 PROGRESS: ============================= Precursor FDR =============================
6:46:36.494077 PROGRESS: Total precursors accumulated: 742
6:46:36.494155 PROGRESS: Target precursors: 678 (91.37%)
6:46:36.494233 PROGRESS: Decoy precursors: 64 (8.63%)
6:46:36.494298 PROGRESS: 
6:46:36.494359 PROGRESS: Precursor Summary:
6:46:36.495996 PROGRESS: Channel   0:	 0.05 FDR:   411; 0.01 FDR:   234; 0.001 FDR:   103
6:46:36.496125 PROGRESS: 
6:46:36.496199 PROGRESS: Protein Summary:
6:46:36.498135 PROGRESS: Channel   0:	 0.05 FDR:   391; 0.01 FDR:   221; 0.001 FDR:   101
6:46:36.498254 PROGRESS: =========================================================================
6:46:36.499250 PROGRESS: === Epoch 14, step 5, extracting elution groups 31000 to 63000 ===
6:46:36.635915 PROGRESS: Extracting batch of 63253 precursors
6:46:36.655788 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:46:36.655895 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:46:36.655932 INFO: FWHM in RT is 13.94 seconds, sigma is 0.51
6:46:36.655973 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:46:36.656218 INFO: Starting candidate selection
6:46:42.503499 INFO: Starting candidate scoring
6:46:44.404083 INFO: Finished candidate processing
6:46:44.404184 INFO: Collecting candidate features
6:46:46.753748 WARNING: intensity_correlation has 38 NaNs ( 0.06 % out of 59030)
6:46:46.763578 INFO: Collecting fragment features
6:46:47.473264 INFO: Finished candidate scoring
6:46:47.821790 PROGRESS: === Epoch 14, step 5, extracted 59030 precursors and 278075 fragments ===
6:46:47.822154 INFO: performing precursor FDR with 47 features
6:46:47.822202 INFO: Decoy channel: -1
6:46:47.822230 INFO: Competetive: True
6:46:47.952498 WARNING: dropped 42 target PSMs due to missing features
6:46:47.952613 WARNING: dropped 44 decoy PSMs due to missing features
6:46:51.781463 INFO: Test AUC: 0.547
6:46:51.781584 INFO: Train AUC: 0.610
6:46:51.781652 INFO: AUC difference: 10.30%
6:46:51.781679 WARNING: AUC difference > 5%. This may indicate overfitting.
6:46:51.915053 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
6:46:51.916400 PROGRESS: ============================= Precursor FDR =============================
6:46:51.916542 PROGRESS: Total precursors accumulated: 1,367
6:46:51.916620 PROGRESS: Target precursors: 1,246 (91.15%)
6:46:51.916690 PROGRESS: Decoy precursors: 121 (8.85%)
6:46:51.916754 PROGRESS: 
6:46:51.916815 PROGRESS: Precursor Summary:
6:46:51.918684 PROGRESS: Channel   0:	 0.05 FDR:   805; 0.01 FDR:   503; 0.001 FDR:   192
6:46:51.918804 PROGRESS: 
6:46:51.918891 PROGRESS: Protein Summary:
6:46:51.921096 PROGRESS: Channel   0:	 0.05 FDR:   744; 0.01 FDR:   461; 0.001 FDR:   185
6:46:51.921227 PROGRESS: =========================================================================
6:46:51.922399 PROGRESS: === Epoch 14, step 6, extracting elution groups 63000 to 127000 ===
6:46:52.098799 PROGRESS: Extracting batch of 126497 precursors
6:46:52.137392 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:46:52.137506 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:46:52.137543 INFO: FWHM in RT is 13.94 seconds, sigma is 0.51
6:46:52.137586 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:46:52.137846 INFO: Starting candidate selection
6:46:59.258806 INFO: Starting candidate scoring
6:47:01.750808 INFO: Finished candidate processing
6:47:01.750907 INFO: Collecting candidate features
6:47:04.287116 WARNING: intensity_correlation has 82 NaNs ( 0.07 % out of 118226)
6:47:04.300474 INFO: Collecting fragment features
6:47:05.065573 INFO: Finished candidate scoring
6:47:05.490905 PROGRESS: === Epoch 14, step 6, extracted 118226 precursors and 554251 fragments ===
6:47:05.491268 INFO: performing precursor FDR with 47 features
6:47:05.491313 INFO: Decoy channel: -1
6:47:05.491340 INFO: Competetive: True
6:47:05.763357 WARNING: dropped 76 target PSMs due to missing features
6:47:05.763476 WARNING: dropped 92 decoy PSMs due to missing features
6:47:14.086482 INFO: Test AUC: 0.551
6:47:14.086629 INFO: Train AUC: 0.597
6:47:14.086669 INFO: AUC difference: 7.66%
6:47:14.086697 WARNING: AUC difference > 5%. This may indicate overfitting.
6:47:14.254097 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
6:47:14.255753 PROGRESS: ============================= Precursor FDR =============================
6:47:14.255879 PROGRESS: Total precursors accumulated: 2,374
6:47:14.255973 PROGRESS: Target precursors: 2,163 (91.11%)
6:47:14.256041 PROGRESS: Decoy precursors: 211 (8.89%)
6:47:14.256115 PROGRESS: 
6:47:14.256176 PROGRESS: Precursor Summary:
6:47:14.258420 PROGRESS: Channel   0:	 0.05 FDR: 1,470; 0.01 FDR:   921; 0.001 FDR:   454
6:47:14.258547 PROGRESS: 
6:47:14.258623 PROGRESS: Protein Summary:
6:47:14.261415 PROGRESS: Channel   0:	 0.05 FDR: 1,285; 0.01 FDR:   804; 0.001 FDR:   417
6:47:14.261546 PROGRESS: =========================================================================
6:47:14.262983 PROGRESS: === Epoch 14, step 7, extracting elution groups 127000 to 255000 ===
6:47:14.490802 PROGRESS: Extracting batch of 253011 precursors
6:47:14.563577 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:47:14.563690 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:47:14.563728 INFO: FWHM in RT is 13.94 seconds, sigma is 0.51
6:47:14.563771 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:47:14.564036 INFO: Starting candidate selection
6:47:24.220552 INFO: Starting candidate scoring
6:47:27.946162 INFO: Finished candidate processing
6:47:27.946365 INFO: Collecting candidate features
6:47:30.928847 WARNING: intensity_correlation has 153 NaNs ( 0.06 % out of 236087)
6:47:30.949953 INFO: Collecting fragment features
6:47:31.815689 INFO: Finished candidate scoring
6:47:32.393977 PROGRESS: === Epoch 14, step 7, extracted 236087 precursors and 1107941 fragments ===
6:47:32.394315 INFO: performing precursor FDR with 47 features
6:47:32.394359 INFO: Decoy channel: -1
6:47:32.394386 INFO: Competetive: True
6:47:32.987949 WARNING: dropped 160 target PSMs due to missing features
6:47:32.988071 WARNING: dropped 161 decoy PSMs due to missing features
6:47:50.631618 INFO: Test AUC: 0.552
6:47:50.631744 INFO: Train AUC: 0.582
6:47:50.631786 INFO: AUC difference: 5.04%
6:47:50.631832 WARNING: AUC difference > 5%. This may indicate overfitting.
6:47:50.814671 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
6:47:50.816844 PROGRESS: ============================= Precursor FDR =============================
6:47:50.817000 PROGRESS: Total precursors accumulated: 4,175
6:47:50.817080 PROGRESS: Target precursors: 3,806 (91.16%)
6:47:50.817160 PROGRESS: Decoy precursors: 369 (8.84%)
6:47:50.817221 PROGRESS: 
6:47:50.817280 PROGRESS: Precursor Summary:
6:47:50.820045 PROGRESS: Channel   0:	 0.05 FDR: 2,726; 0.01 FDR: 1,739; 0.001 FDR: 1,358
6:47:50.820191 PROGRESS: 
6:47:50.820264 PROGRESS: Protein Summary:
6:47:50.823940 PROGRESS: Channel   0:	 0.05 FDR: 2,190; 0.01 FDR: 1,379; 0.001 FDR: 1,104
6:47:50.824067 PROGRESS: =========================================================================
6:47:50.825849 PROGRESS: === Epoch 14, step 8, extracting elution groups 255000 to 511000 ===
6:47:51.127094 PROGRESS: Extracting batch of 505842 precursors
6:47:51.258856 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:47:51.258971 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:47:51.259009 INFO: FWHM in RT is 13.94 seconds, sigma is 0.51
6:47:51.259051 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:47:51.259314 INFO: Starting candidate selection
6:48:05.943365 INFO: Starting candidate scoring
6:48:12.006347 INFO: Finished candidate processing
6:48:12.006532 INFO: Collecting candidate features
6:48:15.641735 WARNING: intensity_correlation has 299 NaNs ( 0.06 % out of 472595)
6:48:15.675448 INFO: Collecting fragment features
6:48:16.724883 INFO: Finished candidate scoring
6:48:17.611981 PROGRESS: === Epoch 14, step 8, extracted 472595 precursors and 2220869 fragments ===
6:48:17.612368 INFO: performing precursor FDR with 47 features
6:48:17.612414 INFO: Decoy channel: -1
6:48:17.612441 INFO: Competetive: True
6:48:18.731633 WARNING: dropped 308 target PSMs due to missing features
6:48:18.731758 WARNING: dropped 312 decoy PSMs due to missing features
6:48:53.653534 INFO: Test AUC: 0.550
6:48:53.653660 INFO: Train AUC: 0.571
6:48:53.653712 INFO: AUC difference: 3.83%
6:48:53.894177 PROGRESS: === checking if recalibration conditions were reached, target 3000 precursors ===
6:48:53.897074 PROGRESS: ============================= Precursor FDR =============================
6:48:53.897241 PROGRESS: Total precursors accumulated: 7,015
6:48:53.897319 PROGRESS: Target precursors: 6,392 (91.12%)
6:48:53.897392 PROGRESS: Decoy precursors: 623 (8.88%)
6:48:53.897454 PROGRESS: 
6:48:53.897514 PROGRESS: Precursor Summary:
6:48:53.901150 PROGRESS: Channel   0:	 0.05 FDR: 4,983; 0.01 FDR: 3,675; 0.001 FDR: 2,779
6:48:53.901309 PROGRESS: 
6:48:53.901384 PROGRESS: Protein Summary:
6:48:53.906662 PROGRESS: Channel   0:	 0.05 FDR: 3,337; 0.01 FDR: 2,402; 0.001 FDR: 1,901
6:48:53.906786 PROGRESS: =========================================================================
6:48:53.911112 INFO: calibration group: precursor, fitting rt estimator 
6:48:54.343647 INFO: calibration group: fragment, fitting mz estimator 
6:48:54.932826 INFO: === checking if epoch conditions were reached ===
6:48:54.933035 INFO: ✅ ms2_error      : 7.0000 <= 7
6:48:54.933120 INFO: ❌ rt_error       : 199.8360 > 100
6:48:54.933190 INFO: ✅ current_epoch  : 14 >= 3
6:48:54.933253 INFO: ==============================================
6:48:55.149956 INFO: calibration group: precursor, predicting mz
6:48:55.150234 WARNING: mz prediction was skipped as it has not been fitted yet
6:48:55.150273 INFO: calibration group: precursor, predicting rt
6:49:01.937539 INFO: calibration group: fragment, predicting mz
6:49:19.559650 PROGRESS: === Epoch 15, step 0, extracting elution groups 0 to 1000 ===
6:49:19.658637 PROGRESS: Extracting batch of 1982 precursors
6:49:19.660304 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:49:19.660376 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:49:19.660415 INFO: FWHM in RT is 13.92 seconds, sigma is 0.51
6:49:19.660443 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:49:19.660661 INFO: Starting candidate selection
6:49:24.632156 INFO: Starting candidate scoring
6:49:25.938691 INFO: Finished candidate processing
6:49:25.938807 INFO: Collecting candidate features
6:49:28.108615 WARNING: intensity_correlation has 2 NaNs ( 0.11 % out of 1848)
6:49:28.114340 INFO: Collecting fragment features
6:49:28.751672 INFO: Finished candidate scoring
6:49:29.095681 PROGRESS: === Epoch 15, step 0, extracted 1848 precursors and 8640 fragments ===
6:49:29.096048 INFO: performing precursor FDR with 47 features
6:49:29.096089 INFO: Decoy channel: -1
6:49:29.096115 INFO: Competetive: True
6:49:29.100763 WARNING: dropped 2 target PSMs due to missing features
6:49:29.144720 INFO: Test AUC: 0.559
6:49:29.144817 INFO: Train AUC: 0.561
6:49:29.144862 INFO: AUC difference: 0.45%
6:49:29.264773 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
6:49:29.265525 PROGRESS: ============================= Precursor FDR =============================
6:49:29.265660 PROGRESS: Total precursors accumulated: 15
6:49:29.265754 PROGRESS: Target precursors: 14 (93.33%)
6:49:29.265868 PROGRESS: Decoy precursors: 1 (6.67%)
6:49:29.265951 PROGRESS: 
6:49:29.266030 PROGRESS: Precursor Summary:
6:49:29.267459 PROGRESS: Channel   0:	 0.05 FDR:    10; 0.01 FDR:    10; 0.001 FDR:    10
6:49:29.267585 PROGRESS: 
6:49:29.267682 PROGRESS: Protein Summary:
6:49:29.269796 PROGRESS: Channel   0:	 0.05 FDR:    10; 0.01 FDR:    10; 0.001 FDR:    10
6:49:29.269930 PROGRESS: =========================================================================
6:49:29.270798 PROGRESS: === Epoch 15, step 1, extracting elution groups 1000 to 3000 ===
6:49:29.348803 PROGRESS: Extracting batch of 3955 precursors
6:49:29.351012 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:49:29.351074 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:49:29.351123 INFO: FWHM in RT is 13.92 seconds, sigma is 0.51
6:49:29.351169 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:49:29.351394 INFO: Starting candidate selection
6:49:33.962891 INFO: Starting candidate scoring
6:49:35.275749 INFO: Finished candidate processing
6:49:35.275928 INFO: Collecting candidate features
6:49:37.472202 WARNING: intensity_correlation has 3 NaNs ( 0.08 % out of 3690)
6:49:37.478210 INFO: Collecting fragment features
6:49:38.122731 INFO: Finished candidate scoring
6:49:38.407109 PROGRESS: === Epoch 15, step 1, extracted 3690 precursors and 17204 fragments ===
6:49:38.407393 INFO: performing precursor FDR with 47 features
6:49:38.407439 INFO: Decoy channel: -1
6:49:38.407466 INFO: Competetive: True
6:49:38.416208 WARNING: dropped 3 target PSMs due to missing features
6:49:38.416294 WARNING: dropped 2 decoy PSMs due to missing features
6:49:38.453851 INFO: Test AUC: 0.566
6:49:38.453972 INFO: Train AUC: 0.550
6:49:38.454017 INFO: AUC difference: 2.99%
6:49:38.591650 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
6:49:38.592468 PROGRESS: ============================= Precursor FDR =============================
6:49:38.592593 PROGRESS: Total precursors accumulated: 28
6:49:38.592671 PROGRESS: Target precursors: 26 (92.86%)
6:49:38.592739 PROGRESS: Decoy precursors: 2 (7.14%)
6:49:38.592811 PROGRESS: 
6:49:38.592874 PROGRESS: Precursor Summary:
6:49:38.594317 PROGRESS: Channel   0:	 0.05 FDR:    23; 0.01 FDR:    19; 0.001 FDR:    19
6:49:38.594430 PROGRESS: 
6:49:38.594504 PROGRESS: Protein Summary:
6:49:38.596129 PROGRESS: Channel   0:	 0.05 FDR:    23; 0.01 FDR:    19; 0.001 FDR:    19
6:49:38.596241 PROGRESS: =========================================================================
6:49:38.597104 PROGRESS: === Epoch 15, step 2, extracting elution groups 3000 to 7000 ===
6:49:38.679993 PROGRESS: Extracting batch of 7893 precursors
6:49:38.683409 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:49:38.683476 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:49:38.683515 INFO: FWHM in RT is 13.92 seconds, sigma is 0.51
6:49:38.683561 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:49:38.683779 INFO: Starting candidate selection
6:49:43.359252 INFO: Starting candidate scoring
6:49:44.707200 INFO: Finished candidate processing
6:49:44.707296 INFO: Collecting candidate features
6:49:46.919195 WARNING: intensity_correlation has 8 NaNs ( 0.11 % out of 7406)
6:49:46.924811 INFO: Collecting fragment features
6:49:47.579237 INFO: Finished candidate scoring
6:49:47.868717 PROGRESS: === Epoch 15, step 2, extracted 7406 precursors and 34667 fragments ===
6:49:47.869052 INFO: performing precursor FDR with 47 features
6:49:47.869099 INFO: Decoy channel: -1
6:49:47.869126 INFO: Competetive: True
6:49:47.884387 WARNING: dropped 7 target PSMs due to missing features
6:49:47.884490 WARNING: dropped 6 decoy PSMs due to missing features
6:49:48.195250 INFO: Test AUC: 0.555
6:49:48.195382 INFO: Train AUC: 0.583
6:49:48.195427 INFO: AUC difference: 4.71%
6:49:48.319259 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
6:49:48.320107 PROGRESS: ============================= Precursor FDR =============================
6:49:48.320226 PROGRESS: Total precursors accumulated: 82
6:49:48.320302 PROGRESS: Target precursors: 76 (92.68%)
6:49:48.320369 PROGRESS: Decoy precursors: 6 (7.32%)
6:49:48.320432 PROGRESS: 
6:49:48.320493 PROGRESS: Precursor Summary:
6:49:48.321959 PROGRESS: Channel   0:	 0.05 FDR:    65; 0.01 FDR:    43; 0.001 FDR:    43
6:49:48.322072 PROGRESS: 
6:49:48.322145 PROGRESS: Protein Summary:
6:49:48.323785 PROGRESS: Channel   0:	 0.05 FDR:    65; 0.01 FDR:    43; 0.001 FDR:    43
6:49:48.323906 PROGRESS: =========================================================================
6:49:48.324778 PROGRESS: === Epoch 15, step 3, extracting elution groups 7000 to 15000 ===
6:49:48.416196 PROGRESS: Extracting batch of 15825 precursors
6:49:48.421697 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:49:48.421767 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:49:48.421829 INFO: FWHM in RT is 13.92 seconds, sigma is 0.51
6:49:48.421855 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:49:48.422079 INFO: Starting candidate selection
6:49:53.250196 INFO: Starting candidate scoring
6:49:54.668835 INFO: Finished candidate processing
6:49:54.668941 INFO: Collecting candidate features
6:49:56.880037 WARNING: intensity_correlation has 2 NaNs ( 0.01 % out of 14766)
6:49:56.886026 INFO: Collecting fragment features
6:49:57.543354 INFO: Finished candidate scoring
6:49:57.838778 PROGRESS: === Epoch 15, step 3, extracted 14766 precursors and 69347 fragments ===
6:49:57.839138 INFO: performing precursor FDR with 47 features
6:49:57.839187 INFO: Decoy channel: -1
6:49:57.839213 INFO: Competetive: True
6:49:57.868101 WARNING: dropped 7 target PSMs due to missing features
6:49:57.868228 WARNING: dropped 8 decoy PSMs due to missing features
6:49:58.659985 INFO: Test AUC: 0.558
6:49:58.660152 INFO: Train AUC: 0.601
6:49:58.660210 INFO: AUC difference: 7.19%
6:49:58.660255 WARNING: AUC difference > 5%. This may indicate overfitting.
6:49:58.812901 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
6:49:58.813829 PROGRESS: ============================= Precursor FDR =============================
6:49:58.813952 PROGRESS: Total precursors accumulated: 207
6:49:58.814029 PROGRESS: Target precursors: 189 (91.30%)
6:49:58.814097 PROGRESS: Decoy precursors: 18 (8.70%)
6:49:58.814160 PROGRESS: 
6:49:58.814221 PROGRESS: Precursor Summary:
6:49:58.815727 PROGRESS: Channel   0:	 0.05 FDR:   143; 0.01 FDR:   106; 0.001 FDR:   101
6:49:58.815856 PROGRESS: 
6:49:58.815929 PROGRESS: Protein Summary:
6:49:58.817651 PROGRESS: Channel   0:	 0.05 FDR:   140; 0.01 FDR:   103; 0.001 FDR:    98
6:49:58.817780 PROGRESS: =========================================================================
6:49:58.818685 PROGRESS: === Epoch 15, step 4, extracting elution groups 15000 to 31000 ===
6:49:58.928406 PROGRESS: Extracting batch of 31607 precursors
6:49:58.939243 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:49:58.939357 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:49:58.939398 INFO: FWHM in RT is 13.92 seconds, sigma is 0.51
6:49:58.939426 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:49:58.939667 INFO: Starting candidate selection
6:50:04.088596 INFO: Starting candidate scoring
6:50:05.653913 INFO: Finished candidate processing
6:50:05.654010 INFO: Collecting candidate features
6:50:07.934656 WARNING: intensity_correlation has 16 NaNs ( 0.05 % out of 29492)
6:50:07.942519 INFO: Collecting fragment features
6:50:08.625518 INFO: Finished candidate scoring
6:50:08.941647 PROGRESS: === Epoch 15, step 4, extracted 29492 precursors and 138441 fragments ===
6:50:08.942023 INFO: performing precursor FDR with 47 features
6:50:08.942074 INFO: Decoy channel: -1
6:50:08.942101 INFO: Competetive: True
6:50:09.001235 WARNING: dropped 16 target PSMs due to missing features
6:50:09.001343 WARNING: dropped 15 decoy PSMs due to missing features
6:50:10.785122 INFO: Test AUC: 0.555
6:50:10.785306 INFO: Train AUC: 0.610
6:50:10.785356 INFO: AUC difference: 9.05%
6:50:10.785391 WARNING: AUC difference > 5%. This may indicate overfitting.
6:50:10.913436 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
6:50:10.914516 PROGRESS: ============================= Precursor FDR =============================
6:50:10.914641 PROGRESS: Total precursors accumulated: 622
6:50:10.914718 PROGRESS: Target precursors: 566 (91.00%)
6:50:10.914786 PROGRESS: Decoy precursors: 56 (9.00%)
6:50:10.914848 PROGRESS: 
6:50:10.914909 PROGRESS: Precursor Summary:
6:50:10.916544 PROGRESS: Channel   0:	 0.05 FDR:   342; 0.01 FDR:   222; 0.001 FDR:   194
6:50:10.916655 PROGRESS: 
6:50:10.916747 PROGRESS: Protein Summary:
6:50:10.918684 PROGRESS: Channel   0:	 0.05 FDR:   333; 0.01 FDR:   214; 0.001 FDR:   186
6:50:10.918795 PROGRESS: =========================================================================
6:50:10.919784 PROGRESS: === Epoch 15, step 5, extracting elution groups 31000 to 63000 ===
6:50:11.056100 PROGRESS: Extracting batch of 63213 precursors
6:50:11.076126 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:50:11.076233 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:50:11.076301 INFO: FWHM in RT is 13.92 seconds, sigma is 0.51
6:50:11.076328 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:50:11.076577 INFO: Starting candidate selection
6:50:16.884356 INFO: Starting candidate scoring
6:50:18.761171 INFO: Finished candidate processing
6:50:18.761349 INFO: Collecting candidate features
6:50:21.133077 WARNING: intensity_correlation has 35 NaNs ( 0.06 % out of 59146)
6:50:21.142010 INFO: Collecting fragment features
6:50:21.857376 INFO: Finished candidate scoring
6:50:22.209420 PROGRESS: === Epoch 15, step 5, extracted 59146 precursors and 277834 fragments ===
6:50:22.209786 INFO: performing precursor FDR with 47 features
6:50:22.209839 INFO: Decoy channel: -1
6:50:22.209866 INFO: Competetive: True
6:50:22.341471 WARNING: dropped 29 target PSMs due to missing features
6:50:22.341588 WARNING: dropped 37 decoy PSMs due to missing features
6:50:26.207238 INFO: Test AUC: 0.552
6:50:26.207357 INFO: Train AUC: 0.606
6:50:26.207418 INFO: AUC difference: 8.88%
6:50:26.207452 WARNING: AUC difference > 5%. This may indicate overfitting.
6:50:26.343835 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
6:50:26.345162 PROGRESS: ============================= Precursor FDR =============================
6:50:26.345320 PROGRESS: Total precursors accumulated: 1,327
6:50:26.345398 PROGRESS: Target precursors: 1,208 (91.03%)
6:50:26.345467 PROGRESS: Decoy precursors: 119 (8.97%)
6:50:26.345531 PROGRESS: 
6:50:26.345605 PROGRESS: Precursor Summary:
6:50:26.347491 PROGRESS: Channel   0:	 0.05 FDR:   712; 0.01 FDR:   466; 0.001 FDR:   331
6:50:26.347612 PROGRESS: 
6:50:26.347686 PROGRESS: Protein Summary:
6:50:26.349926 PROGRESS: Channel   0:	 0.05 FDR:   667; 0.01 FDR:   433; 0.001 FDR:   309
6:50:26.350041 PROGRESS: =========================================================================
6:50:26.351182 PROGRESS: === Epoch 15, step 6, extracting elution groups 63000 to 127000 ===
6:50:26.526486 PROGRESS: Extracting batch of 126459 precursors
6:50:26.564898 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:50:26.565015 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:50:26.565052 INFO: FWHM in RT is 13.92 seconds, sigma is 0.51
6:50:26.565094 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:50:26.565356 INFO: Starting candidate selection
6:50:33.670749 INFO: Starting candidate scoring
6:50:36.172808 INFO: Finished candidate processing
6:50:36.172949 INFO: Collecting candidate features
6:50:38.702658 WARNING: intensity_correlation has 81 NaNs ( 0.07 % out of 117781)
6:50:38.715492 INFO: Collecting fragment features
6:50:39.477833 INFO: Finished candidate scoring
6:50:39.903188 PROGRESS: === Epoch 15, step 6, extracted 117781 precursors and 550298 fragments ===
6:50:39.903558 INFO: performing precursor FDR with 47 features
6:50:39.903606 INFO: Decoy channel: -1
6:50:39.903633 INFO: Competetive: True
6:50:40.172951 WARNING: dropped 67 target PSMs due to missing features
6:50:40.173064 WARNING: dropped 80 decoy PSMs due to missing features
6:50:48.604673 INFO: Test AUC: 0.553
6:50:48.604799 INFO: Train AUC: 0.592
6:50:48.604855 INFO: AUC difference: 6.57%
6:50:48.604882 WARNING: AUC difference > 5%. This may indicate overfitting.
6:50:48.781103 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
6:50:48.782825 PROGRESS: ============================= Precursor FDR =============================
6:50:48.782968 PROGRESS: Total precursors accumulated: 2,390
6:50:48.783062 PROGRESS: Target precursors: 2,182 (91.30%)
6:50:48.783129 PROGRESS: Decoy precursors: 208 (8.70%)
6:50:48.783191 PROGRESS: 
6:50:48.783252 PROGRESS: Precursor Summary:
6:50:48.785478 PROGRESS: Channel   0:	 0.05 FDR: 1,521; 0.01 FDR:   984; 0.001 FDR:   625
6:50:48.785623 PROGRESS: 
6:50:48.785698 PROGRESS: Protein Summary:
6:50:48.788548 PROGRESS: Channel   0:	 0.05 FDR: 1,339; 0.01 FDR:   848; 0.001 FDR:   558
6:50:48.788681 PROGRESS: =========================================================================
6:50:48.790181 PROGRESS: === Epoch 15, step 7, extracting elution groups 127000 to 255000 ===
6:50:49.017511 PROGRESS: Extracting batch of 253005 precursors
6:50:49.090563 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:50:49.090697 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:50:49.090740 INFO: FWHM in RT is 13.92 seconds, sigma is 0.51
6:50:49.090767 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:50:49.091028 INFO: Starting candidate selection
6:50:58.792936 INFO: Starting candidate scoring
6:51:02.499466 INFO: Finished candidate processing
6:51:02.499589 INFO: Collecting candidate features
6:51:05.457187 WARNING: intensity_correlation has 162 NaNs ( 0.07 % out of 236282)
6:51:05.478131 INFO: Collecting fragment features
6:51:06.337455 INFO: Finished candidate scoring
6:51:06.918123 PROGRESS: === Epoch 15, step 7, extracted 236282 precursors and 1109500 fragments ===
6:51:06.918464 INFO: performing precursor FDR with 47 features
6:51:06.918512 INFO: Decoy channel: -1
6:51:06.918538 INFO: Competetive: True
6:51:07.511286 WARNING: dropped 162 target PSMs due to missing features
6:51:07.511414 WARNING: dropped 147 decoy PSMs due to missing features
6:51:24.606402 INFO: Test AUC: 0.551
6:51:24.606538 INFO: Train AUC: 0.580
6:51:24.606580 INFO: AUC difference: 5.09%
6:51:24.606608 WARNING: AUC difference > 5%. This may indicate overfitting.
6:51:24.809031 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
6:51:24.811168 PROGRESS: ============================= Precursor FDR =============================
6:51:24.811320 PROGRESS: Total precursors accumulated: 3,945
6:51:24.811398 PROGRESS: Target precursors: 3,597 (91.18%)
6:51:24.811464 PROGRESS: Decoy precursors: 348 (8.82%)
6:51:24.811526 PROGRESS: 
6:51:24.811585 PROGRESS: Precursor Summary:
6:51:24.814457 PROGRESS: Channel   0:	 0.05 FDR: 2,725; 0.01 FDR: 1,909; 0.001 FDR: 1,368
6:51:24.814610 PROGRESS: 
6:51:24.814684 PROGRESS: Protein Summary:
6:51:24.818475 PROGRESS: Channel   0:	 0.05 FDR: 2,172; 0.01 FDR: 1,500; 0.001 FDR: 1,096
6:51:24.818591 PROGRESS: =========================================================================
6:51:24.820446 PROGRESS: === Epoch 15, step 8, extracting elution groups 255000 to 511000 ===
6:51:25.129152 PROGRESS: Extracting batch of 505725 precursors
6:51:25.261732 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:51:25.261867 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:51:25.261907 INFO: FWHM in RT is 13.92 seconds, sigma is 0.51
6:51:25.261934 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:51:25.262194 INFO: Starting candidate selection
6:51:40.005168 INFO: Starting candidate scoring
6:51:46.121580 INFO: Finished candidate processing
6:51:46.121730 INFO: Collecting candidate features
6:51:49.751603 WARNING: intensity_correlation has 289 NaNs ( 0.06 % out of 472358)
6:51:49.752664 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 472358)
6:51:49.785582 INFO: Collecting fragment features
6:51:50.834895 INFO: Finished candidate scoring
6:51:51.721839 PROGRESS: === Epoch 15, step 8, extracted 472358 precursors and 2218662 fragments ===
6:51:51.722202 INFO: performing precursor FDR with 47 features
6:51:51.722255 INFO: Decoy channel: -1
6:51:51.722287 INFO: Competetive: True
6:51:52.841026 WARNING: dropped 307 target PSMs due to missing features
6:51:52.841146 WARNING: dropped 291 decoy PSMs due to missing features
6:52:27.826432 INFO: Test AUC: 0.549
6:52:27.826589 INFO: Train AUC: 0.570
6:52:27.826638 INFO: AUC difference: 3.57%
6:52:28.076490 PROGRESS: === checking if recalibration conditions were reached, target 3200 precursors ===
6:52:28.079371 PROGRESS: ============================= Precursor FDR =============================
6:52:28.079525 PROGRESS: Total precursors accumulated: 7,186
6:52:28.079601 PROGRESS: Target precursors: 6,558 (91.26%)
6:52:28.079667 PROGRESS: Decoy precursors: 628 (8.74%)
6:52:28.079730 PROGRESS: 
6:52:28.079789 PROGRESS: Precursor Summary:
6:52:28.083493 PROGRESS: Channel   0:	 0.05 FDR: 5,232; 0.01 FDR: 3,916; 0.001 FDR: 2,386
6:52:28.083661 PROGRESS: 
6:52:28.083733 PROGRESS: Protein Summary:
6:52:28.089087 PROGRESS: Channel   0:	 0.05 FDR: 3,527; 0.01 FDR: 2,574; 0.001 FDR: 1,704
6:52:28.089221 PROGRESS: =========================================================================
6:52:28.093807 INFO: calibration group: precursor, fitting rt estimator 
6:52:28.552729 INFO: calibration group: fragment, fitting mz estimator 
6:52:29.139482 INFO: === checking if epoch conditions were reached ===
6:52:29.139669 INFO: ✅ ms2_error      : 7.0000 <= 7
6:52:29.139746 INFO: ❌ rt_error       : 198.6757 > 100
6:52:29.139809 INFO: ✅ current_epoch  : 15 >= 3
6:52:29.139865 INFO: ==============================================
6:52:29.357729 INFO: calibration group: precursor, predicting mz
6:52:29.358013 WARNING: mz prediction was skipped as it has not been fitted yet
6:52:29.358056 INFO: calibration group: precursor, predicting rt
6:52:36.116300 INFO: calibration group: fragment, predicting mz
6:52:53.700497 PROGRESS: === Epoch 16, step 0, extracting elution groups 0 to 1000 ===
6:52:53.799202 PROGRESS: Extracting batch of 1980 precursors
6:52:53.800905 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:52:53.800976 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:52:53.801014 INFO: FWHM in RT is 14.00 seconds, sigma is 0.51
6:52:53.801059 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:52:53.801283 INFO: Starting candidate selection
6:52:58.801178 INFO: Starting candidate scoring
6:53:00.095918 INFO: Finished candidate processing
6:53:00.096009 INFO: Collecting candidate features
6:53:02.288118 WARNING: intensity_correlation has 2 NaNs ( 0.11 % out of 1829)
6:53:02.294950 INFO: Collecting fragment features
6:53:02.938468 INFO: Finished candidate scoring
6:53:03.297540 PROGRESS: === Epoch 16, step 0, extracted 1829 precursors and 8536 fragments ===
6:53:03.297864 INFO: performing precursor FDR with 47 features
6:53:03.297913 INFO: Decoy channel: -1
6:53:03.297939 INFO: Competetive: True
6:53:03.302730 WARNING: dropped 1 target PSMs due to missing features
6:53:03.302825 WARNING: dropped 1 decoy PSMs due to missing features
6:53:03.331235 INFO: Test AUC: 0.575
6:53:03.331335 INFO: Train AUC: 0.546
6:53:03.331381 INFO: AUC difference: 5.39%
6:53:03.331416 WARNING: AUC difference > 5%. This may indicate overfitting.
6:53:03.484667 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
6:53:03.485428 PROGRESS: ============================= Precursor FDR =============================
6:53:03.485546 PROGRESS: Total precursors accumulated: 12
6:53:03.485623 PROGRESS: Target precursors: 11 (91.67%)
6:53:03.485693 PROGRESS: Decoy precursors: 1 (8.33%)
6:53:03.485756 PROGRESS: 
6:53:03.485828 PROGRESS: Precursor Summary:
6:53:03.487225 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
6:53:03.487335 PROGRESS: 
6:53:03.487424 PROGRESS: Protein Summary:
6:53:03.488993 PROGRESS: Channel   0:	 0.05 FDR:     8; 0.01 FDR:     8; 0.001 FDR:     8
6:53:03.489103 PROGRESS: =========================================================================
6:53:03.489967 PROGRESS: === Epoch 16, step 1, extracting elution groups 1000 to 3000 ===
6:53:03.566632 PROGRESS: Extracting batch of 3952 precursors
6:53:03.568756 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:53:03.568814 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:53:03.568852 INFO: FWHM in RT is 14.00 seconds, sigma is 0.51
6:53:03.568897 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:53:03.569106 INFO: Starting candidate selection
6:53:08.166090 INFO: Starting candidate scoring
6:53:09.460848 INFO: Finished candidate processing
6:53:09.460935 INFO: Collecting candidate features
6:53:11.625230 WARNING: intensity_correlation has 3 NaNs ( 0.08 % out of 3665)
6:53:11.631293 INFO: Collecting fragment features
6:53:12.271998 INFO: Finished candidate scoring
6:53:12.552743 PROGRESS: === Epoch 16, step 1, extracted 3665 precursors and 17304 fragments ===
6:53:12.553044 INFO: performing precursor FDR with 47 features
6:53:12.553090 INFO: Decoy channel: -1
6:53:12.553117 INFO: Competetive: True
6:53:12.561638 WARNING: dropped 2 target PSMs due to missing features
6:53:12.561722 WARNING: dropped 3 decoy PSMs due to missing features
6:53:12.598672 INFO: Test AUC: 0.526
6:53:12.598789 INFO: Train AUC: 0.557
6:53:12.598834 INFO: AUC difference: 5.60%
6:53:12.598867 WARNING: AUC difference > 5%. This may indicate overfitting.
6:53:12.719219 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
6:53:12.719998 PROGRESS: ============================= Precursor FDR =============================
6:53:12.720131 PROGRESS: Total precursors accumulated: 37
6:53:12.720210 PROGRESS: Target precursors: 34 (91.89%)
6:53:12.720277 PROGRESS: Decoy precursors: 3 (8.11%)
6:53:12.720339 PROGRESS: 
6:53:12.720400 PROGRESS: Precursor Summary:
6:53:12.721851 PROGRESS: Channel   0:	 0.05 FDR:    31; 0.01 FDR:    28; 0.001 FDR:    28
6:53:12.721965 PROGRESS: 
6:53:12.722039 PROGRESS: Protein Summary:
6:53:12.723655 PROGRESS: Channel   0:	 0.05 FDR:    31; 0.01 FDR:    28; 0.001 FDR:    28
6:53:12.723765 PROGRESS: =========================================================================
6:53:12.724623 PROGRESS: === Epoch 16, step 2, extracting elution groups 3000 to 7000 ===
6:53:12.807444 PROGRESS: Extracting batch of 7897 precursors
6:53:12.810660 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:53:12.810738 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:53:12.810779 INFO: FWHM in RT is 14.00 seconds, sigma is 0.51
6:53:12.810810 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:53:12.811039 INFO: Starting candidate selection
6:53:17.481325 INFO: Starting candidate scoring
6:53:18.822016 INFO: Finished candidate processing
6:53:18.822111 INFO: Collecting candidate features
6:53:20.995394 WARNING: intensity_correlation has 5 NaNs ( 0.07 % out of 7393)
6:53:21.000877 INFO: Collecting fragment features
6:53:21.648230 INFO: Finished candidate scoring
6:53:21.935024 PROGRESS: === Epoch 16, step 2, extracted 7393 precursors and 34684 fragments ===
6:53:21.935360 INFO: performing precursor FDR with 47 features
6:53:21.935405 INFO: Decoy channel: -1
6:53:21.935431 INFO: Competetive: True
6:53:21.950366 WARNING: dropped 3 target PSMs due to missing features
6:53:21.950468 WARNING: dropped 7 decoy PSMs due to missing features
6:53:22.261075 INFO: Test AUC: 0.550
6:53:22.261208 INFO: Train AUC: 0.582
6:53:22.261254 INFO: AUC difference: 5.63%
6:53:22.261289 WARNING: AUC difference > 5%. This may indicate overfitting.
6:53:22.381323 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
6:53:22.382194 PROGRESS: ============================= Precursor FDR =============================
6:53:22.382315 PROGRESS: Total precursors accumulated: 127
6:53:22.382393 PROGRESS: Target precursors: 117 (92.13%)
6:53:22.382461 PROGRESS: Decoy precursors: 10 (7.87%)
6:53:22.382525 PROGRESS: 
6:53:22.382587 PROGRESS: Precursor Summary:
6:53:22.384053 PROGRESS: Channel   0:	 0.05 FDR:    89; 0.01 FDR:    63; 0.001 FDR:    63
6:53:22.384190 PROGRESS: 
6:53:22.384264 PROGRESS: Protein Summary:
6:53:22.385957 PROGRESS: Channel   0:	 0.05 FDR:    89; 0.01 FDR:    63; 0.001 FDR:    63
6:53:22.386067 PROGRESS: =========================================================================
6:53:22.386951 PROGRESS: === Epoch 16, step 3, extracting elution groups 7000 to 15000 ===
6:53:22.478341 PROGRESS: Extracting batch of 15815 precursors
6:53:22.483843 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:53:22.483906 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:53:22.483939 INFO: FWHM in RT is 14.00 seconds, sigma is 0.51
6:53:22.483981 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:53:22.484195 INFO: Starting candidate selection
6:53:27.323512 INFO: Starting candidate scoring
6:53:28.750695 INFO: Finished candidate processing
6:53:28.750836 INFO: Collecting candidate features
6:53:30.986876 WARNING: intensity_correlation has 11 NaNs ( 0.07 % out of 14764)
6:53:30.992895 INFO: Collecting fragment features
6:53:31.660784 INFO: Finished candidate scoring
6:53:31.958497 PROGRESS: === Epoch 16, step 3, extracted 14764 precursors and 69461 fragments ===
6:53:31.958819 INFO: performing precursor FDR with 47 features
6:53:31.958864 INFO: Decoy channel: -1
6:53:31.958890 INFO: Competetive: True
6:53:31.987867 WARNING: dropped 9 target PSMs due to missing features
6:53:31.987980 WARNING: dropped 12 decoy PSMs due to missing features
6:53:32.814666 INFO: Test AUC: 0.556
6:53:32.814814 INFO: Train AUC: 0.604
6:53:32.814861 INFO: AUC difference: 8.00%
6:53:32.814896 WARNING: AUC difference > 5%. This may indicate overfitting.
6:53:32.939855 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
6:53:32.940775 PROGRESS: ============================= Precursor FDR =============================
6:53:32.940897 PROGRESS: Total precursors accumulated: 310
6:53:32.940972 PROGRESS: Target precursors: 282 (90.97%)
6:53:32.941039 PROGRESS: Decoy precursors: 28 (9.03%)
6:53:32.941100 PROGRESS: 
6:53:32.941159 PROGRESS: Precursor Summary:
6:53:32.942700 PROGRESS: Channel   0:	 0.05 FDR:   195; 0.01 FDR:   105; 0.001 FDR:    83
6:53:32.942812 PROGRESS: 
6:53:32.942898 PROGRESS: Protein Summary:
6:53:32.944619 PROGRESS: Channel   0:	 0.05 FDR:   192; 0.01 FDR:   102; 0.001 FDR:    81
6:53:32.944726 PROGRESS: =========================================================================
6:53:32.945616 PROGRESS: === Epoch 16, step 4, extracting elution groups 15000 to 31000 ===
6:53:33.053346 PROGRESS: Extracting batch of 31591 precursors
6:53:33.064013 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:53:33.064121 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:53:33.064162 INFO: FWHM in RT is 14.00 seconds, sigma is 0.51
6:53:33.064194 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:53:33.064434 INFO: Starting candidate selection
6:53:38.272003 INFO: Starting candidate scoring
6:53:39.875898 INFO: Finished candidate processing
6:53:39.876086 INFO: Collecting candidate features
6:53:42.138050 WARNING: intensity_correlation has 24 NaNs ( 0.08 % out of 29488)
6:53:42.144866 INFO: Collecting fragment features
6:53:42.819296 INFO: Finished candidate scoring
6:53:43.131706 PROGRESS: === Epoch 16, step 4, extracted 29488 precursors and 138572 fragments ===
6:53:43.132919 INFO: performing precursor FDR with 47 features
6:53:43.133043 INFO: Decoy channel: -1
6:53:43.133129 INFO: Competetive: True
6:53:43.191159 WARNING: dropped 24 target PSMs due to missing features
6:53:43.191271 WARNING: dropped 21 decoy PSMs due to missing features
6:53:44.975164 INFO: Test AUC: 0.556
6:53:44.975316 INFO: Train AUC: 0.613
6:53:44.975363 INFO: AUC difference: 9.25%
6:53:44.975398 WARNING: AUC difference > 5%. This may indicate overfitting.
6:53:45.115338 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
6:53:45.116454 PROGRESS: ============================= Precursor FDR =============================
6:53:45.116608 PROGRESS: Total precursors accumulated: 726
6:53:45.116686 PROGRESS: Target precursors: 662 (91.18%)
6:53:45.116755 PROGRESS: Decoy precursors: 64 (8.82%)
6:53:45.116819 PROGRESS: 
6:53:45.116879 PROGRESS: Precursor Summary:
6:53:45.118569 PROGRESS: Channel   0:	 0.05 FDR:   435; 0.01 FDR:   265; 0.001 FDR:   210
6:53:45.118688 PROGRESS: 
6:53:45.118763 PROGRESS: Protein Summary:
6:53:45.120747 PROGRESS: Channel   0:	 0.05 FDR:   423; 0.01 FDR:   257; 0.001 FDR:   203
6:53:45.120861 PROGRESS: =========================================================================
6:53:45.121891 PROGRESS: === Epoch 16, step 5, extracting elution groups 31000 to 63000 ===
6:53:45.260003 PROGRESS: Extracting batch of 63280 precursors
6:53:45.280188 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:53:45.280296 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:53:45.280333 INFO: FWHM in RT is 14.00 seconds, sigma is 0.51
6:53:45.280390 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:53:45.280639 INFO: Starting candidate selection
6:53:51.105100 INFO: Starting candidate scoring
6:53:52.973019 INFO: Finished candidate processing
6:53:52.973187 INFO: Collecting candidate features
6:53:55.364219 WARNING: intensity_correlation has 47 NaNs ( 0.08 % out of 59154)
6:53:55.374035 INFO: Collecting fragment features
6:53:56.092869 INFO: Finished candidate scoring
6:53:56.444917 PROGRESS: === Epoch 16, step 5, extracted 59154 precursors and 277335 fragments ===
6:53:56.445267 INFO: performing precursor FDR with 47 features
6:53:56.445314 INFO: Decoy channel: -1
6:53:56.445342 INFO: Competetive: True
6:53:56.583628 WARNING: dropped 49 target PSMs due to missing features
6:53:56.583744 WARNING: dropped 43 decoy PSMs due to missing features
6:54:00.453810 INFO: Test AUC: 0.560
6:54:00.453944 INFO: Train AUC: 0.607
6:54:00.454003 INFO: AUC difference: 7.69%
6:54:00.454031 WARNING: AUC difference > 5%. This may indicate overfitting.
6:54:00.589134 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
6:54:00.590423 PROGRESS: ============================= Precursor FDR =============================
6:54:00.590550 PROGRESS: Total precursors accumulated: 1,230
6:54:00.590640 PROGRESS: Target precursors: 1,123 (91.30%)
6:54:00.590709 PROGRESS: Decoy precursors: 107 (8.70%)
6:54:00.590772 PROGRESS: 
6:54:00.590832 PROGRESS: Precursor Summary:
6:54:00.592614 PROGRESS: Channel   0:	 0.05 FDR:   564; 0.01 FDR:   375; 0.001 FDR:   304
6:54:00.592729 PROGRESS: 
6:54:00.592820 PROGRESS: Protein Summary:
6:54:00.594978 PROGRESS: Channel   0:	 0.05 FDR:   533; 0.01 FDR:   355; 0.001 FDR:   290
6:54:00.595107 PROGRESS: =========================================================================
6:54:00.596206 PROGRESS: === Epoch 16, step 6, extracting elution groups 63000 to 127000 ===
6:54:00.772392 PROGRESS: Extracting batch of 126442 precursors
6:54:00.811395 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:54:00.811515 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:54:00.811554 INFO: FWHM in RT is 14.00 seconds, sigma is 0.51
6:54:00.811597 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:54:00.811858 INFO: Starting candidate selection
6:54:07.963468 INFO: Starting candidate scoring
6:54:10.442183 INFO: Finished candidate processing
6:54:10.442272 INFO: Collecting candidate features
6:54:13.009595 WARNING: intensity_correlation has 101 NaNs ( 0.09 % out of 117923)
6:54:13.022515 INFO: Collecting fragment features
6:54:13.795271 INFO: Finished candidate scoring
6:54:14.226936 PROGRESS: === Epoch 16, step 6, extracted 117923 precursors and 553782 fragments ===
6:54:14.227313 INFO: performing precursor FDR with 47 features
6:54:14.227361 INFO: Decoy channel: -1
6:54:14.227387 INFO: Competetive: True
6:54:14.503923 WARNING: dropped 96 target PSMs due to missing features
6:54:14.504039 WARNING: dropped 97 decoy PSMs due to missing features
6:54:22.987887 INFO: Test AUC: 0.550
6:54:22.988013 INFO: Train AUC: 0.595
6:54:22.988068 INFO: AUC difference: 7.54%
6:54:22.988096 WARNING: AUC difference > 5%. This may indicate overfitting.
6:54:23.140731 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
6:54:23.142388 PROGRESS: ============================= Precursor FDR =============================
6:54:23.142516 PROGRESS: Total precursors accumulated: 2,326
6:54:23.142593 PROGRESS: Target precursors: 2,119 (91.10%)
6:54:23.142661 PROGRESS: Decoy precursors: 207 (8.90%)
6:54:23.142725 PROGRESS: 
6:54:23.142785 PROGRESS: Precursor Summary:
6:54:23.144921 PROGRESS: Channel   0:	 0.05 FDR: 1,405; 0.01 FDR:   872; 0.001 FDR:   724
6:54:23.145054 PROGRESS: 
6:54:23.145127 PROGRESS: Protein Summary:
6:54:23.147903 PROGRESS: Channel   0:	 0.05 FDR: 1,260; 0.01 FDR:   773; 0.001 FDR:   645
6:54:23.148015 PROGRESS: =========================================================================
6:54:23.149359 PROGRESS: === Epoch 16, step 7, extracting elution groups 127000 to 255000 ===
6:54:23.376293 PROGRESS: Extracting batch of 252933 precursors
6:54:23.448584 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:54:23.448699 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:54:23.448738 INFO: FWHM in RT is 14.00 seconds, sigma is 0.51
6:54:23.448782 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:54:23.449043 INFO: Starting candidate selection
6:54:33.085115 INFO: Starting candidate scoring
6:54:36.771559 INFO: Finished candidate processing
6:54:36.771744 INFO: Collecting candidate features
6:54:39.765858 WARNING: intensity_correlation has 178 NaNs ( 0.08 % out of 236046)
6:54:39.787273 INFO: Collecting fragment features
6:54:40.655625 INFO: Finished candidate scoring
6:54:41.242224 PROGRESS: === Epoch 16, step 7, extracted 236046 precursors and 1110547 fragments ===
6:54:41.242581 INFO: performing precursor FDR with 47 features
6:54:41.242627 INFO: Decoy channel: -1
6:54:41.242652 INFO: Competetive: True
6:54:41.844222 WARNING: dropped 181 target PSMs due to missing features
6:54:41.844346 WARNING: dropped 190 decoy PSMs due to missing features
6:54:58.800313 INFO: Test AUC: 0.552
6:54:58.800446 INFO: Train AUC: 0.581
6:54:58.800504 INFO: AUC difference: 5.00%
6:54:58.981962 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
6:54:58.984073 PROGRESS: ============================= Precursor FDR =============================
6:54:58.984207 PROGRESS: Total precursors accumulated: 3,797
6:54:58.984285 PROGRESS: Target precursors: 3,458 (91.07%)
6:54:58.984352 PROGRESS: Decoy precursors: 339 (8.93%)
6:54:58.984414 PROGRESS: 
6:54:58.984473 PROGRESS: Precursor Summary:
6:54:58.987175 PROGRESS: Channel   0:	 0.05 FDR: 2,562; 0.01 FDR: 1,812; 0.001 FDR: 1,037
6:54:58.987299 PROGRESS: 
6:54:58.987393 PROGRESS: Protein Summary:
6:54:58.990951 PROGRESS: Channel   0:	 0.05 FDR: 2,084; 0.01 FDR: 1,447; 0.001 FDR:   870
6:54:58.991063 PROGRESS: =========================================================================
6:54:58.992891 PROGRESS: === Epoch 16, step 8, extracting elution groups 255000 to 511000 ===
6:54:59.300777 PROGRESS: Extracting batch of 505959 precursors
6:54:59.434371 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:54:59.434495 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:54:59.434537 INFO: FWHM in RT is 14.00 seconds, sigma is 0.51
6:54:59.434565 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:54:59.434834 INFO: Starting candidate selection
6:55:14.160536 INFO: Starting candidate scoring
6:55:20.347614 INFO: Finished candidate processing
6:55:20.347807 INFO: Collecting candidate features
6:55:23.985366 WARNING: intensity_correlation has 347 NaNs ( 0.07 % out of 472066)
6:55:23.986451 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 472066)
6:55:24.018850 INFO: Collecting fragment features
6:55:25.065405 INFO: Finished candidate scoring
6:55:25.953607 PROGRESS: === Epoch 16, step 8, extracted 472066 precursors and 2219130 fragments ===
6:55:25.954007 INFO: performing precursor FDR with 47 features
6:55:25.960603 INFO: Decoy channel: -1
6:55:25.960722 INFO: Competetive: True
6:55:27.084075 WARNING: dropped 350 target PSMs due to missing features
6:55:27.084201 WARNING: dropped 368 decoy PSMs due to missing features
6:56:02.123132 INFO: Test AUC: 0.549
6:56:02.123272 INFO: Train AUC: 0.570
6:56:02.123312 INFO: AUC difference: 3.84%
6:56:02.370122 PROGRESS: === checking if recalibration conditions were reached, target 3400 precursors ===
6:56:02.372967 PROGRESS: ============================= Precursor FDR =============================
6:56:02.373115 PROGRESS: Total precursors accumulated: 7,040
6:56:02.373200 PROGRESS: Target precursors: 6,417 (91.15%)
6:56:02.373272 PROGRESS: Decoy precursors: 623 (8.85%)
6:56:02.373338 PROGRESS: 
6:56:02.373413 PROGRESS: Precursor Summary:
6:56:02.377008 PROGRESS: Channel   0:	 0.05 FDR: 4,905; 0.01 FDR: 3,503; 0.001 FDR: 2,345
6:56:02.377149 PROGRESS: 
6:56:02.377236 PROGRESS: Protein Summary:
6:56:02.382414 PROGRESS: Channel   0:	 0.05 FDR: 3,374; 0.01 FDR: 2,379; 0.001 FDR: 1,706
6:56:02.382539 PROGRESS: =========================================================================
6:56:02.386760 INFO: calibration group: precursor, fitting rt estimator 
6:56:02.795702 INFO: calibration group: fragment, fitting mz estimator 
6:56:03.402069 INFO: === checking if epoch conditions were reached ===
6:56:03.402272 INFO: ✅ ms2_error      : 7.0000 <= 7
6:56:03.402363 INFO: ❌ rt_error       : 198.2149 > 100
6:56:03.402436 INFO: ✅ current_epoch  : 16 >= 3
6:56:03.402500 INFO: ==============================================
6:56:03.635241 INFO: calibration group: precursor, predicting mz
6:56:03.635507 WARNING: mz prediction was skipped as it has not been fitted yet
6:56:03.635551 INFO: calibration group: precursor, predicting rt
6:56:10.374715 INFO: calibration group: fragment, predicting mz
6:56:27.935248 PROGRESS: === Epoch 17, step 0, extracting elution groups 0 to 1000 ===
6:56:28.034400 PROGRESS: Extracting batch of 1971 precursors
6:56:28.036101 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:56:28.036176 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:56:28.036214 INFO: FWHM in RT is 13.80 seconds, sigma is 0.50
6:56:28.036258 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:56:28.036483 INFO: Starting candidate selection
6:56:33.001616 INFO: Starting candidate scoring
6:56:34.287332 INFO: Finished candidate processing
6:56:34.287422 INFO: Collecting candidate features
6:56:36.448198 INFO: Collecting fragment features
6:56:37.088249 INFO: Finished candidate scoring
6:56:37.438792 PROGRESS: === Epoch 17, step 0, extracted 1861 precursors and 8739 fragments ===
6:56:37.439134 INFO: performing precursor FDR with 47 features
6:56:37.439176 INFO: Decoy channel: -1
6:56:37.439202 INFO: Competetive: True
6:56:37.471074 INFO: Test AUC: 0.540
6:56:37.471178 INFO: Train AUC: 0.537
6:56:37.471222 INFO: AUC difference: 0.61%
6:56:37.589907 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
6:56:37.590683 PROGRESS: ============================= Precursor FDR =============================
6:56:37.590804 PROGRESS: Total precursors accumulated: 6
6:56:37.590880 PROGRESS: Target precursors: 6 (100.00%)
6:56:37.590947 PROGRESS: Decoy precursors: 0 (0.00%)
6:56:37.591010 PROGRESS: 
6:56:37.591074 PROGRESS: Precursor Summary:
6:56:37.592551 PROGRESS: Channel   0:	 0.05 FDR:     6; 0.01 FDR:     6; 0.001 FDR:     6
6:56:37.592677 PROGRESS: 
6:56:37.592750 PROGRESS: Protein Summary:
6:56:37.594454 PROGRESS: Channel   0:	 0.05 FDR:     6; 0.01 FDR:     6; 0.001 FDR:     6
6:56:37.594567 PROGRESS: =========================================================================
6:56:37.595453 PROGRESS: === Epoch 17, step 1, extracting elution groups 1000 to 3000 ===
6:56:37.672584 PROGRESS: Extracting batch of 3962 precursors
6:56:37.674772 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:56:37.674837 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:56:37.674879 INFO: FWHM in RT is 13.80 seconds, sigma is 0.50
6:56:37.674909 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:56:37.675124 INFO: Starting candidate selection
6:56:42.343601 INFO: Starting candidate scoring
6:56:43.678546 INFO: Finished candidate processing
6:56:43.678732 INFO: Collecting candidate features
6:56:45.867523 WARNING: intensity_correlation has 2 NaNs ( 0.05 % out of 3741)
6:56:45.873428 INFO: Collecting fragment features
6:56:46.514902 INFO: Finished candidate scoring
6:56:46.798425 PROGRESS: === Epoch 17, step 1, extracted 3741 precursors and 17702 fragments ===
6:56:46.798711 INFO: performing precursor FDR with 47 features
6:56:46.798758 INFO: Decoy channel: -1
6:56:46.798784 INFO: Competetive: True
6:56:46.807466 WARNING: dropped 1 target PSMs due to missing features
6:56:46.807553 WARNING: dropped 1 decoy PSMs due to missing features
6:56:46.846703 INFO: Test AUC: 0.530
6:56:46.846819 INFO: Train AUC: 0.540
6:56:46.846863 INFO: AUC difference: 1.87%
6:56:46.968663 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
6:56:46.969451 PROGRESS: ============================= Precursor FDR =============================
6:56:46.969576 PROGRESS: Total precursors accumulated: 20
6:56:46.969655 PROGRESS: Target precursors: 19 (95.00%)
6:56:46.969724 PROGRESS: Decoy precursors: 1 (5.00%)
6:56:46.969800 PROGRESS: 
6:56:46.969864 PROGRESS: Precursor Summary:
6:56:46.971291 PROGRESS: Channel   0:	 0.05 FDR:    19; 0.01 FDR:    19; 0.001 FDR:    19
6:56:46.971406 PROGRESS: 
6:56:46.971497 PROGRESS: Protein Summary:
6:56:46.973111 PROGRESS: Channel   0:	 0.05 FDR:    19; 0.01 FDR:    19; 0.001 FDR:    19
6:56:46.973224 PROGRESS: =========================================================================
6:56:46.974120 PROGRESS: === Epoch 17, step 2, extracting elution groups 3000 to 7000 ===
6:56:47.055988 PROGRESS: Extracting batch of 7926 precursors
6:56:47.059328 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:56:47.059393 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:56:47.059430 INFO: FWHM in RT is 13.80 seconds, sigma is 0.50
6:56:47.059476 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:56:47.059694 INFO: Starting candidate selection
6:56:51.765597 INFO: Starting candidate scoring
6:56:53.110480 INFO: Finished candidate processing
6:56:53.110628 INFO: Collecting candidate features
6:56:55.293839 WARNING: intensity_correlation has 6 NaNs ( 0.08 % out of 7385)
6:56:55.299351 INFO: Collecting fragment features
6:56:55.939704 INFO: Finished candidate scoring
6:56:56.225590 PROGRESS: === Epoch 17, step 2, extracted 7385 precursors and 34428 fragments ===
6:56:56.225925 INFO: performing precursor FDR with 47 features
6:56:56.225970 INFO: Decoy channel: -1
6:56:56.225996 INFO: Competetive: True
6:56:56.240881 WARNING: dropped 5 target PSMs due to missing features
6:56:56.240994 WARNING: dropped 3 decoy PSMs due to missing features
6:56:56.470649 INFO: Test AUC: 0.533
6:56:56.470780 INFO: Train AUC: 0.584
6:56:56.470826 INFO: AUC difference: 8.68%
6:56:56.470860 WARNING: AUC difference > 5%. This may indicate overfitting.
6:56:56.593570 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
6:56:56.594440 PROGRESS: ============================= Precursor FDR =============================
6:56:56.594563 PROGRESS: Total precursors accumulated: 80
6:56:56.594640 PROGRESS: Target precursors: 73 (91.25%)
6:56:56.594720 PROGRESS: Decoy precursors: 7 (8.75%)
6:56:56.594787 PROGRESS: 
6:56:56.594851 PROGRESS: Precursor Summary:
6:56:56.596292 PROGRESS: Channel   0:	 0.05 FDR:    63; 0.01 FDR:    47; 0.001 FDR:    47
6:56:56.596419 PROGRESS: 
6:56:56.596493 PROGRESS: Protein Summary:
6:56:56.598165 PROGRESS: Channel   0:	 0.05 FDR:    63; 0.01 FDR:    47; 0.001 FDR:    47
6:56:56.598277 PROGRESS: =========================================================================
6:56:56.599146 PROGRESS: === Epoch 17, step 3, extracting elution groups 7000 to 15000 ===
6:56:56.690541 PROGRESS: Extracting batch of 15810 precursors
6:56:56.696106 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:56:56.696173 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:56:56.696207 INFO: FWHM in RT is 13.80 seconds, sigma is 0.50
6:56:56.696249 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:56:56.696465 INFO: Starting candidate selection
6:57:01.558830 INFO: Starting candidate scoring
6:57:02.979981 INFO: Finished candidate processing
6:57:02.980075 INFO: Collecting candidate features
6:57:05.204838 WARNING: intensity_correlation has 8 NaNs ( 0.05 % out of 14676)
6:57:05.210799 INFO: Collecting fragment features
6:57:05.869935 INFO: Finished candidate scoring
6:57:06.167916 PROGRESS: === Epoch 17, step 3, extracted 14676 precursors and 68974 fragments ===
6:57:06.168243 INFO: performing precursor FDR with 47 features
6:57:06.168289 INFO: Decoy channel: -1
6:57:06.168316 INFO: Competetive: True
6:57:06.197430 WARNING: dropped 9 target PSMs due to missing features
6:57:06.197560 WARNING: dropped 7 decoy PSMs due to missing features
6:57:06.943549 INFO: Test AUC: 0.551
6:57:06.943696 INFO: Train AUC: 0.599
6:57:06.943742 INFO: AUC difference: 8.07%
6:57:06.943776 WARNING: AUC difference > 5%. This may indicate overfitting.
6:57:07.066274 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
6:57:07.067230 PROGRESS: ============================= Precursor FDR =============================
6:57:07.067354 PROGRESS: Total precursors accumulated: 308
6:57:07.067431 PROGRESS: Target precursors: 282 (91.56%)
6:57:07.067498 PROGRESS: Decoy precursors: 26 (8.44%)
6:57:07.067559 PROGRESS: 
6:57:07.067619 PROGRESS: Precursor Summary:
6:57:07.069155 PROGRESS: Channel   0:	 0.05 FDR:   230; 0.01 FDR:   115; 0.001 FDR:   109
6:57:07.069284 PROGRESS: 
6:57:07.069357 PROGRESS: Protein Summary:
6:57:07.071159 PROGRESS: Channel   0:	 0.05 FDR:   227; 0.01 FDR:   113; 0.001 FDR:   107
6:57:07.071270 PROGRESS: =========================================================================
6:57:07.072182 PROGRESS: === Epoch 17, step 4, extracting elution groups 15000 to 31000 ===
6:57:07.180640 PROGRESS: Extracting batch of 31608 precursors
6:57:07.191169 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:57:07.191278 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:57:07.191320 INFO: FWHM in RT is 13.80 seconds, sigma is 0.50
6:57:07.191347 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:57:07.191586 INFO: Starting candidate selection
6:57:12.354345 INFO: Starting candidate scoring
6:57:13.926199 INFO: Finished candidate processing
6:57:13.926288 INFO: Collecting candidate features
6:57:16.177160 WARNING: intensity_correlation has 12 NaNs ( 0.04 % out of 29362)
6:57:16.184020 INFO: Collecting fragment features
6:57:16.852436 INFO: Finished candidate scoring
6:57:17.165598 PROGRESS: === Epoch 17, step 4, extracted 29362 precursors and 137908 fragments ===
6:57:17.172909 INFO: performing precursor FDR with 47 features
6:57:17.173066 INFO: Decoy channel: -1
6:57:17.173158 INFO: Competetive: True
6:57:17.231613 WARNING: dropped 14 target PSMs due to missing features
6:57:17.231723 WARNING: dropped 14 decoy PSMs due to missing features
6:57:19.135775 INFO: Test AUC: 0.559
6:57:19.135923 INFO: Train AUC: 0.609
6:57:19.135969 INFO: AUC difference: 8.27%
6:57:19.136006 WARNING: AUC difference > 5%. This may indicate overfitting.
6:57:19.263958 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
6:57:19.265082 PROGRESS: ============================= Precursor FDR =============================
6:57:19.265242 PROGRESS: Total precursors accumulated: 772
6:57:19.265321 PROGRESS: Target precursors: 704 (91.19%)
6:57:19.265391 PROGRESS: Decoy precursors: 68 (8.81%)
6:57:19.265455 PROGRESS: 
6:57:19.265517 PROGRESS: Precursor Summary:
6:57:19.267190 PROGRESS: Channel   0:	 0.05 FDR:   356; 0.01 FDR:   288; 0.001 FDR:   235
6:57:19.267322 PROGRESS: 
6:57:19.267397 PROGRESS: Protein Summary:
6:57:19.269342 PROGRESS: Channel   0:	 0.05 FDR:   347; 0.01 FDR:   280; 0.001 FDR:   227
6:57:19.269470 PROGRESS: =========================================================================
6:57:19.270507 PROGRESS: === Epoch 17, step 5, extracting elution groups 31000 to 63000 ===
6:57:19.406552 PROGRESS: Extracting batch of 63197 precursors
6:57:19.426523 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:57:19.426647 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:57:19.426686 INFO: FWHM in RT is 13.80 seconds, sigma is 0.50
6:57:19.426713 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:57:19.426958 INFO: Starting candidate selection
6:57:25.283026 INFO: Starting candidate scoring
6:57:27.170978 INFO: Finished candidate processing
6:57:27.171067 INFO: Collecting candidate features
6:57:29.519029 WARNING: intensity_correlation has 33 NaNs ( 0.06 % out of 58877)
6:57:29.528138 INFO: Collecting fragment features
6:57:30.230088 INFO: Finished candidate scoring
6:57:30.578177 PROGRESS: === Epoch 17, step 5, extracted 58877 precursors and 276065 fragments ===
6:57:30.578515 INFO: performing precursor FDR with 47 features
6:57:30.578562 INFO: Decoy channel: -1
6:57:30.578588 INFO: Competetive: True
6:57:30.708177 WARNING: dropped 29 target PSMs due to missing features
6:57:30.708288 WARNING: dropped 32 decoy PSMs due to missing features
6:57:34.480615 INFO: Test AUC: 0.561
6:57:34.480731 INFO: Train AUC: 0.599
6:57:34.480789 INFO: AUC difference: 6.37%
6:57:34.480818 WARNING: AUC difference > 5%. This may indicate overfitting.
6:57:34.616045 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
6:57:34.617357 PROGRESS: ============================= Precursor FDR =============================
6:57:34.617512 PROGRESS: Total precursors accumulated: 1,291
6:57:34.617590 PROGRESS: Target precursors: 1,178 (91.25%)
6:57:34.617659 PROGRESS: Decoy precursors: 113 (8.75%)
6:57:34.617722 PROGRESS: 
6:57:34.617797 PROGRESS: Precursor Summary:
6:57:34.619668 PROGRESS: Channel   0:	 0.05 FDR:   826; 0.01 FDR:   440; 0.001 FDR:   295
6:57:34.619801 PROGRESS: 
6:57:34.619874 PROGRESS: Protein Summary:
6:57:34.622144 PROGRESS: Channel   0:	 0.05 FDR:   779; 0.01 FDR:   412; 0.001 FDR:   277
6:57:34.622259 PROGRESS: =========================================================================
6:57:34.623391 PROGRESS: === Epoch 17, step 6, extracting elution groups 63000 to 127000 ===
6:57:34.798897 PROGRESS: Extracting batch of 126460 precursors
6:57:34.837869 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:57:34.838003 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:57:34.838044 INFO: FWHM in RT is 13.80 seconds, sigma is 0.50
6:57:34.838071 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:57:34.838330 INFO: Starting candidate selection
6:57:41.931386 INFO: Starting candidate scoring
6:57:44.397693 INFO: Finished candidate processing
6:57:44.397869 INFO: Collecting candidate features
6:57:46.918841 WARNING: intensity_correlation has 67 NaNs ( 0.06 % out of 118047)
6:57:46.932323 INFO: Collecting fragment features
6:57:47.689633 INFO: Finished candidate scoring
6:57:48.113367 PROGRESS: === Epoch 17, step 6, extracted 118047 precursors and 553228 fragments ===
6:57:48.113752 INFO: performing precursor FDR with 47 features
6:57:48.113814 INFO: Decoy channel: -1
6:57:48.113839 INFO: Competetive: True
6:57:48.384759 WARNING: dropped 66 target PSMs due to missing features
6:57:48.384875 WARNING: dropped 62 decoy PSMs due to missing features
6:57:56.395139 INFO: Test AUC: 0.553
6:57:56.395267 INFO: Train AUC: 0.591
6:57:56.395323 INFO: AUC difference: 6.46%
6:57:56.395352 WARNING: AUC difference > 5%. This may indicate overfitting.
6:57:56.579033 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
6:57:56.580608 PROGRESS: ============================= Precursor FDR =============================
6:57:56.580750 PROGRESS: Total precursors accumulated: 2,193
6:57:56.580831 PROGRESS: Target precursors: 1,997 (91.06%)
6:57:56.580899 PROGRESS: Decoy precursors: 196 (8.94%)
6:57:56.580972 PROGRESS: 
6:57:56.581034 PROGRESS: Precursor Summary:
6:57:56.583158 PROGRESS: Channel   0:	 0.05 FDR: 1,424; 0.01 FDR:   988; 0.001 FDR:   312
6:57:56.583291 PROGRESS: 
6:57:56.583364 PROGRESS: Protein Summary:
6:57:56.586045 PROGRESS: Channel   0:	 0.05 FDR: 1,276; 0.01 FDR:   868; 0.001 FDR:   291
6:57:56.586160 PROGRESS: =========================================================================
6:57:56.587596 PROGRESS: === Epoch 17, step 7, extracting elution groups 127000 to 255000 ===
6:57:56.811098 PROGRESS: Extracting batch of 252876 precursors
6:57:56.883130 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:57:56.883243 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:57:56.883281 INFO: FWHM in RT is 13.80 seconds, sigma is 0.50
6:57:56.883323 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:57:56.883585 INFO: Starting candidate selection
6:58:12.712074 INFO: Starting candidate scoring
6:58:16.434520 INFO: Finished candidate processing
6:58:16.434700 INFO: Collecting candidate features
6:58:19.413477 WARNING: intensity_correlation has 149 NaNs ( 0.06 % out of 235667)
6:58:19.434649 INFO: Collecting fragment features
6:58:20.313021 INFO: Finished candidate scoring
6:58:20.909398 PROGRESS: === Epoch 17, step 7, extracted 235667 precursors and 1105162 fragments ===
6:58:20.909787 INFO: performing precursor FDR with 47 features
6:58:20.909837 INFO: Decoy channel: -1
6:58:20.909863 INFO: Competetive: True
6:58:21.504007 WARNING: dropped 142 target PSMs due to missing features
6:58:21.504131 WARNING: dropped 135 decoy PSMs due to missing features
6:58:39.019033 INFO: Test AUC: 0.551
6:58:39.019163 INFO: Train AUC: 0.578
6:58:39.019218 INFO: AUC difference: 4.71%
6:58:39.205289 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
6:58:39.207752 PROGRESS: ============================= Precursor FDR =============================
6:58:39.207910 PROGRESS: Total precursors accumulated: 4,036
6:58:39.208008 PROGRESS: Target precursors: 3,674 (91.03%)
6:58:39.208076 PROGRESS: Decoy precursors: 362 (8.97%)
6:58:39.208140 PROGRESS: 
6:58:39.208201 PROGRESS: Precursor Summary:
6:58:39.211110 PROGRESS: Channel   0:	 0.05 FDR: 2,472; 0.01 FDR: 1,740; 0.001 FDR:   754
6:58:39.211277 PROGRESS: 
6:58:39.211351 PROGRESS: Protein Summary:
6:58:39.215063 PROGRESS: Channel   0:	 0.05 FDR: 2,004; 0.01 FDR: 1,377; 0.001 FDR:   639
6:58:39.215211 PROGRESS: =========================================================================
6:58:39.217096 PROGRESS: === Epoch 17, step 8, extracting elution groups 255000 to 511000 ===
6:58:39.524303 PROGRESS: Extracting batch of 505979 precursors
6:58:39.659048 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
6:58:39.659162 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
6:58:39.659201 INFO: FWHM in RT is 13.80 seconds, sigma is 0.50
6:58:39.659245 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
6:58:39.659519 INFO: Starting candidate selection
6:58:54.524664 INFO: Starting candidate scoring
6:59:00.645454 INFO: Finished candidate processing
6:59:00.645647 INFO: Collecting candidate features
6:59:04.309266 WARNING: intensity_correlation has 289 NaNs ( 0.06 % out of 471498)
6:59:04.310353 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 471498)
6:59:04.342730 INFO: Collecting fragment features
6:59:05.393776 INFO: Finished candidate scoring
6:59:06.291049 PROGRESS: === Epoch 17, step 8, extracted 471498 precursors and 2213954 fragments ===
6:59:06.291487 INFO: performing precursor FDR with 47 features
6:59:06.298101 INFO: Decoy channel: -1
6:59:06.298257 INFO: Competetive: True
6:59:07.419341 WARNING: dropped 279 target PSMs due to missing features
6:59:07.419472 WARNING: dropped 287 decoy PSMs due to missing features
6:59:43.143532 INFO: Test AUC: 0.552
6:59:43.143658 INFO: Train AUC: 0.569
6:59:43.143714 INFO: AUC difference: 2.97%
6:59:43.387661 PROGRESS: === checking if recalibration conditions were reached, target 3600 precursors ===
6:59:43.390878 PROGRESS: ============================= Precursor FDR =============================
6:59:43.391065 PROGRESS: Total precursors accumulated: 6,858
6:59:43.391145 PROGRESS: Target precursors: 6,250 (91.13%)
6:59:43.391211 PROGRESS: Decoy precursors: 608 (8.87%)
6:59:43.391273 PROGRESS: 
6:59:43.391333 PROGRESS: Precursor Summary:
6:59:43.395360 PROGRESS: Channel   0:	 0.05 FDR: 4,950; 0.01 FDR: 3,650; 0.001 FDR: 2,475
6:59:43.395549 PROGRESS: 
6:59:43.395623 PROGRESS: Protein Summary:
6:59:43.401311 PROGRESS: Channel   0:	 0.05 FDR: 3,360; 0.01 FDR: 2,407; 0.001 FDR: 1,738
6:59:43.401470 PROGRESS: =========================================================================
6:59:43.406175 INFO: calibration group: precursor, fitting rt estimator 
6:59:43.836578 INFO: calibration group: fragment, fitting mz estimator 
6:59:44.425951 INFO: === checking if epoch conditions were reached ===
6:59:44.426125 INFO: ✅ ms2_error      : 7.0000 <= 7
6:59:44.426313 INFO: ❌ rt_error       : 199.0621 > 100
6:59:44.426400 INFO: ✅ current_epoch  : 17 >= 3
6:59:44.426466 INFO: ==============================================
6:59:44.647256 INFO: calibration group: precursor, predicting mz
6:59:44.647567 WARNING: mz prediction was skipped as it has not been fitted yet
6:59:44.647613 INFO: calibration group: precursor, predicting rt
6:59:51.464869 INFO: calibration group: fragment, predicting mz
7:00:09.012242 PROGRESS: === Epoch 18, step 0, extracting elution groups 0 to 1000 ===
7:00:09.111199 PROGRESS: Extracting batch of 1981 precursors
7:00:09.113113 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
7:00:09.113232 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
7:00:09.113273 INFO: FWHM in RT is 13.88 seconds, sigma is 0.51
7:00:09.113319 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
7:00:09.113560 INFO: Starting candidate selection
7:00:14.237475 INFO: Starting candidate scoring
7:00:15.550767 INFO: Finished candidate processing
7:00:15.550854 INFO: Collecting candidate features
7:00:17.740445 INFO: Collecting fragment features
7:00:18.384478 INFO: Finished candidate scoring
7:00:18.734726 PROGRESS: === Epoch 18, step 0, extracted 1859 precursors and 8678 fragments ===
7:00:18.735311 INFO: performing precursor FDR with 47 features
7:00:18.735359 INFO: Decoy channel: -1
7:00:18.735386 INFO: Competetive: True
7:00:18.785176 INFO: Test AUC: 0.493
7:00:18.785284 INFO: Train AUC: 0.557
7:00:18.785330 INFO: AUC difference: 11.54%
7:00:18.785363 WARNING: AUC difference > 5%. This may indicate overfitting.
7:00:18.909632 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
7:00:18.910455 PROGRESS: ============================= Precursor FDR =============================
7:00:18.910586 PROGRESS: Total precursors accumulated: 6
7:00:18.910672 PROGRESS: Target precursors: 6 (100.00%)
7:00:18.910749 PROGRESS: Decoy precursors: 0 (0.00%)
7:00:18.910820 PROGRESS: 
7:00:18.910898 PROGRESS: Precursor Summary:
7:00:18.912345 PROGRESS: Channel   0:	 0.05 FDR:     6; 0.01 FDR:     6; 0.001 FDR:     6
7:00:18.912459 PROGRESS: 
7:00:18.912551 PROGRESS: Protein Summary:
7:00:18.914559 PROGRESS: Channel   0:	 0.05 FDR:     6; 0.01 FDR:     6; 0.001 FDR:     6
7:00:18.914690 PROGRESS: =========================================================================
7:00:18.915576 PROGRESS: === Epoch 18, step 1, extracting elution groups 1000 to 3000 ===
7:00:18.995307 PROGRESS: Extracting batch of 3942 precursors
7:00:18.997644 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
7:00:18.997703 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
7:00:18.997742 INFO: FWHM in RT is 13.88 seconds, sigma is 0.51
7:00:18.997798 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
7:00:18.998030 INFO: Starting candidate selection
7:00:23.772501 INFO: Starting candidate scoring
7:00:25.112561 INFO: Finished candidate processing
7:00:25.112688 INFO: Collecting candidate features
7:00:27.307213 WARNING: intensity_correlation has 2 NaNs ( 0.05 % out of 3661)
7:00:27.313288 INFO: Collecting fragment features
7:00:27.963181 INFO: Finished candidate scoring
7:00:28.252067 PROGRESS: === Epoch 18, step 1, extracted 3661 precursors and 17302 fragments ===
7:00:28.252378 INFO: performing precursor FDR with 47 features
7:00:28.252425 INFO: Decoy channel: -1
7:00:28.252454 INFO: Competetive: True
7:00:28.261716 WARNING: dropped 2 target PSMs due to missing features
7:00:28.301757 INFO: Test AUC: 0.528
7:00:28.301886 INFO: Train AUC: 0.542
7:00:28.301931 INFO: AUC difference: 2.46%
7:00:28.422934 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
7:00:28.423730 PROGRESS: ============================= Precursor FDR =============================
7:00:28.423852 PROGRESS: Total precursors accumulated: 26
7:00:28.423930 PROGRESS: Target precursors: 24 (92.31%)
7:00:28.423999 PROGRESS: Decoy precursors: 2 (7.69%)
7:00:28.424062 PROGRESS: 
7:00:28.424123 PROGRESS: Precursor Summary:
7:00:28.425543 PROGRESS: Channel   0:	 0.05 FDR:    23; 0.01 FDR:    19; 0.001 FDR:    19
7:00:28.425687 PROGRESS: 
7:00:28.425762 PROGRESS: Protein Summary:
7:00:28.427396 PROGRESS: Channel   0:	 0.05 FDR:    22; 0.01 FDR:    18; 0.001 FDR:    18
7:00:28.427508 PROGRESS: =========================================================================
7:00:28.428365 PROGRESS: === Epoch 18, step 2, extracting elution groups 3000 to 7000 ===
7:00:28.510491 PROGRESS: Extracting batch of 7903 precursors
7:00:28.514118 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
7:00:28.514183 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
7:00:28.514223 INFO: FWHM in RT is 13.88 seconds, sigma is 0.51
7:00:28.514253 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
7:00:28.514493 INFO: Starting candidate selection
7:00:33.302707 INFO: Starting candidate scoring
7:00:34.652728 INFO: Finished candidate processing
7:00:34.652825 INFO: Collecting candidate features
7:00:36.832291 WARNING: intensity_correlation has 5 NaNs ( 0.07 % out of 7393)
7:00:36.838293 INFO: Collecting fragment features
7:00:37.484254 INFO: Finished candidate scoring
7:00:37.776178 PROGRESS: === Epoch 18, step 2, extracted 7393 precursors and 34790 fragments ===
7:00:37.776565 INFO: performing precursor FDR with 47 features
7:00:37.776614 INFO: Decoy channel: -1
7:00:37.776641 INFO: Competetive: True
7:00:37.792228 WARNING: dropped 6 target PSMs due to missing features
7:00:37.792327 WARNING: dropped 1 decoy PSMs due to missing features
7:00:38.044965 INFO: Test AUC: 0.546
7:00:38.045097 INFO: Train AUC: 0.578
7:00:38.045142 INFO: AUC difference: 5.46%
7:00:38.045177 WARNING: AUC difference > 5%. This may indicate overfitting.
7:00:38.168089 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
7:00:38.168998 PROGRESS: ============================= Precursor FDR =============================
7:00:38.169122 PROGRESS: Total precursors accumulated: 72
7:00:38.169199 PROGRESS: Target precursors: 66 (91.67%)
7:00:38.169268 PROGRESS: Decoy precursors: 6 (8.33%)
7:00:38.169330 PROGRESS: 
7:00:38.169391 PROGRESS: Precursor Summary:
7:00:38.170850 PROGRESS: Channel   0:	 0.05 FDR:    47; 0.01 FDR:    45; 0.001 FDR:    45
7:00:38.170989 PROGRESS: 
7:00:38.171063 PROGRESS: Protein Summary:
7:00:38.172693 PROGRESS: Channel   0:	 0.05 FDR:    46; 0.01 FDR:    44; 0.001 FDR:    44
7:00:38.172819 PROGRESS: =========================================================================
7:00:38.173690 PROGRESS: === Epoch 18, step 3, extracting elution groups 7000 to 15000 ===
7:00:38.265476 PROGRESS: Extracting batch of 15814 precursors
7:00:38.271215 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
7:00:38.271281 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
7:00:38.271316 INFO: FWHM in RT is 13.88 seconds, sigma is 0.51
7:00:38.271357 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
7:00:38.271582 INFO: Starting candidate selection
7:00:43.202496 INFO: Starting candidate scoring
7:00:44.631142 INFO: Finished candidate processing
7:00:44.631233 INFO: Collecting candidate features
7:00:46.837585 WARNING: intensity_correlation has 7 NaNs ( 0.05 % out of 14688)
7:00:46.843826 INFO: Collecting fragment features
7:00:47.499381 INFO: Finished candidate scoring
7:00:47.801383 PROGRESS: === Epoch 18, step 3, extracted 14688 precursors and 68799 fragments ===
7:00:47.801748 INFO: performing precursor FDR with 47 features
7:00:47.801811 INFO: Decoy channel: -1
7:00:47.801841 INFO: Competetive: True
7:00:47.832207 WARNING: dropped 7 target PSMs due to missing features
7:00:47.832325 WARNING: dropped 7 decoy PSMs due to missing features
7:00:48.563516 INFO: Test AUC: 0.546
7:00:48.563672 INFO: Train AUC: 0.599
7:00:48.563719 INFO: AUC difference: 8.89%
7:00:48.563754 WARNING: AUC difference > 5%. This may indicate overfitting.
7:00:48.691415 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
7:00:48.692401 PROGRESS: ============================= Precursor FDR =============================
7:00:48.692536 PROGRESS: Total precursors accumulated: 167
7:00:48.692613 PROGRESS: Target precursors: 154 (92.22%)
7:00:48.692681 PROGRESS: Decoy precursors: 13 (7.78%)
7:00:48.692743 PROGRESS: 
7:00:48.692803 PROGRESS: Precursor Summary:
7:00:48.694368 PROGRESS: Channel   0:	 0.05 FDR:   139; 0.01 FDR:    74; 0.001 FDR:    74
7:00:48.694496 PROGRESS: 
7:00:48.694572 PROGRESS: Protein Summary:
7:00:48.696381 PROGRESS: Channel   0:	 0.05 FDR:   138; 0.01 FDR:    73; 0.001 FDR:    73
7:00:48.696494 PROGRESS: =========================================================================
7:00:48.697402 PROGRESS: === Epoch 18, step 4, extracting elution groups 15000 to 31000 ===
7:00:48.805298 PROGRESS: Extracting batch of 31609 precursors
7:00:48.816183 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
7:00:48.816297 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
7:00:48.816338 INFO: FWHM in RT is 13.88 seconds, sigma is 0.51
7:00:48.816365 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
7:00:48.816617 INFO: Starting candidate selection
7:00:54.069556 INFO: Starting candidate scoring
7:00:55.646865 INFO: Finished candidate processing
7:00:55.646953 INFO: Collecting candidate features
7:00:57.902313 WARNING: intensity_correlation has 14 NaNs ( 0.05 % out of 29433)
7:00:57.909556 INFO: Collecting fragment features
7:00:58.588007 INFO: Finished candidate scoring
7:00:58.910745 PROGRESS: === Epoch 18, step 4, extracted 29433 precursors and 138098 fragments ===
7:00:58.911991 INFO: performing precursor FDR with 47 features
7:00:58.912126 INFO: Decoy channel: -1
7:00:58.912268 INFO: Competetive: True
7:00:58.972031 WARNING: dropped 13 target PSMs due to missing features
7:00:58.972141 WARNING: dropped 15 decoy PSMs due to missing features
7:01:00.931550 INFO: Test AUC: 0.559
7:01:00.931699 INFO: Train AUC: 0.607
7:01:00.931745 INFO: AUC difference: 7.97%
7:01:00.931780 WARNING: AUC difference > 5%. This may indicate overfitting.
7:01:01.059768 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
7:01:01.060955 PROGRESS: ============================= Precursor FDR =============================
7:01:01.061091 PROGRESS: Total precursors accumulated: 732
7:01:01.061168 PROGRESS: Target precursors: 667 (91.12%)
7:01:01.061236 PROGRESS: Decoy precursors: 65 (8.88%)
7:01:01.061296 PROGRESS: 
7:01:01.061356 PROGRESS: Precursor Summary:
7:01:01.063136 PROGRESS: Channel   0:	 0.05 FDR:   393; 0.01 FDR:   217; 0.001 FDR:   163
7:01:01.063271 PROGRESS: 
7:01:01.063345 PROGRESS: Protein Summary:
7:01:01.065333 PROGRESS: Channel   0:	 0.05 FDR:   375; 0.01 FDR:   205; 0.001 FDR:   152
7:01:01.065445 PROGRESS: =========================================================================
7:01:01.066532 PROGRESS: === Epoch 18, step 5, extracting elution groups 31000 to 63000 ===
7:01:01.203745 PROGRESS: Extracting batch of 63194 precursors
7:01:01.224586 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
7:01:01.224692 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
7:01:01.224729 INFO: FWHM in RT is 13.88 seconds, sigma is 0.51
7:01:01.224755 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
7:01:01.225003 INFO: Starting candidate selection
7:01:07.110077 INFO: Starting candidate scoring
7:01:08.983574 INFO: Finished candidate processing
7:01:08.983672 INFO: Collecting candidate features
7:01:11.366542 WARNING: intensity_correlation has 33 NaNs ( 0.06 % out of 58898)
7:01:11.375693 INFO: Collecting fragment features
7:01:12.093151 INFO: Finished candidate scoring
7:01:12.455735 PROGRESS: === Epoch 18, step 5, extracted 58898 precursors and 277492 fragments ===
7:01:12.456135 INFO: performing precursor FDR with 47 features
7:01:12.456184 INFO: Decoy channel: -1
7:01:12.456210 INFO: Competetive: True
7:01:12.591392 WARNING: dropped 32 target PSMs due to missing features
7:01:12.591512 WARNING: dropped 29 decoy PSMs due to missing features
7:01:16.497196 INFO: Test AUC: 0.559
7:01:16.497319 INFO: Train AUC: 0.599
7:01:16.497377 INFO: AUC difference: 6.58%
7:01:16.497422 WARNING: AUC difference > 5%. This may indicate overfitting.
7:01:16.633679 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
7:01:16.635103 PROGRESS: ============================= Precursor FDR =============================
7:01:16.635255 PROGRESS: Total precursors accumulated: 1,131
7:01:16.635334 PROGRESS: Target precursors: 1,030 (91.07%)
7:01:16.635403 PROGRESS: Decoy precursors: 101 (8.93%)
7:01:16.635466 PROGRESS: 
7:01:16.635527 PROGRESS: Precursor Summary:
7:01:16.637453 PROGRESS: Channel   0:	 0.05 FDR:   676; 0.01 FDR:   355; 0.001 FDR:   193
7:01:16.637604 PROGRESS: 
7:01:16.637680 PROGRESS: Protein Summary:
7:01:16.639945 PROGRESS: Channel   0:	 0.05 FDR:   631; 0.01 FDR:   332; 0.001 FDR:   182
7:01:16.640080 PROGRESS: =========================================================================
7:01:16.641232 PROGRESS: === Epoch 18, step 6, extracting elution groups 63000 to 127000 ===
7:01:16.817669 PROGRESS: Extracting batch of 126494 precursors
7:01:16.857317 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
7:01:16.857430 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
7:01:16.857468 INFO: FWHM in RT is 13.88 seconds, sigma is 0.51
7:01:16.857511 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
7:01:16.857815 INFO: Starting candidate selection
7:01:24.085056 INFO: Starting candidate scoring
7:01:26.550375 INFO: Finished candidate processing
7:01:26.550463 INFO: Collecting candidate features
7:01:29.114190 WARNING: intensity_correlation has 87 NaNs ( 0.07 % out of 117836)
7:01:29.128421 INFO: Collecting fragment features
7:01:29.902606 INFO: Finished candidate scoring
7:01:30.339621 PROGRESS: === Epoch 18, step 6, extracted 117836 precursors and 553191 fragments ===
7:01:30.340039 INFO: performing precursor FDR with 47 features
7:01:30.340086 INFO: Decoy channel: -1
7:01:30.340112 INFO: Competetive: True
7:01:30.615962 WARNING: dropped 70 target PSMs due to missing features
7:01:30.616095 WARNING: dropped 78 decoy PSMs due to missing features
7:01:38.947829 INFO: Test AUC: 0.549
7:01:38.947956 INFO: Train AUC: 0.591
7:01:38.948012 INFO: AUC difference: 7.12%
7:01:38.948040 WARNING: AUC difference > 5%. This may indicate overfitting.
7:01:39.102465 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
7:01:39.104212 PROGRESS: ============================= Precursor FDR =============================
7:01:39.104391 PROGRESS: Total precursors accumulated: 2,196
7:01:39.104471 PROGRESS: Target precursors: 2,000 (91.07%)
7:01:39.104538 PROGRESS: Decoy precursors: 196 (8.93%)
7:01:39.104602 PROGRESS: 
7:01:39.104662 PROGRESS: Precursor Summary:
7:01:39.107001 PROGRESS: Channel   0:	 0.05 FDR: 1,326; 0.01 FDR:   833; 0.001 FDR:   583
7:01:39.107148 PROGRESS: 
7:01:39.107224 PROGRESS: Protein Summary:
7:01:39.110100 PROGRESS: Channel   0:	 0.05 FDR: 1,192; 0.01 FDR:   734; 0.001 FDR:   523
7:01:39.110219 PROGRESS: =========================================================================
7:01:39.111664 PROGRESS: === Epoch 18, step 7, extracting elution groups 127000 to 255000 ===
7:01:39.336699 PROGRESS: Extracting batch of 252995 precursors
7:01:39.409623 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
7:01:39.409739 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
7:01:39.409801 INFO: FWHM in RT is 13.88 seconds, sigma is 0.51
7:01:39.409832 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
7:01:39.410108 INFO: Starting candidate selection
7:01:49.155329 INFO: Starting candidate scoring
7:01:52.907701 INFO: Finished candidate processing
7:01:52.907891 INFO: Collecting candidate features
7:01:55.849581 WARNING: intensity_correlation has 148 NaNs ( 0.06 % out of 235746)
7:01:55.850297 WARNING: height_correlation has 2 NaNs ( 0.00 % out of 235746)
7:01:55.871582 INFO: Collecting fragment features
7:01:56.730722 INFO: Finished candidate scoring
7:01:57.317481 PROGRESS: === Epoch 18, step 7, extracted 235746 precursors and 1106922 fragments ===
7:01:57.317880 INFO: performing precursor FDR with 47 features
7:01:57.317929 INFO: Decoy channel: -1
7:01:57.317955 INFO: Competetive: True
7:01:57.911891 WARNING: dropped 140 target PSMs due to missing features
7:01:57.912025 WARNING: dropped 156 decoy PSMs due to missing features
7:02:15.373193 INFO: Test AUC: 0.552
7:02:15.373322 INFO: Train AUC: 0.577
7:02:15.373363 INFO: AUC difference: 4.29%
7:02:15.559856 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
7:02:15.562181 PROGRESS: ============================= Precursor FDR =============================
7:02:15.562341 PROGRESS: Total precursors accumulated: 3,699
7:02:15.562420 PROGRESS: Target precursors: 3,370 (91.11%)
7:02:15.562487 PROGRESS: Decoy precursors: 329 (8.89%)
7:02:15.562549 PROGRESS: 
7:02:15.562611 PROGRESS: Precursor Summary:
7:02:15.565508 PROGRESS: Channel   0:	 0.05 FDR: 2,521; 0.01 FDR: 1,717; 0.001 FDR: 1,225
7:02:15.565670 PROGRESS: 
7:02:15.565744 PROGRESS: Protein Summary:
7:02:15.569675 PROGRESS: Channel   0:	 0.05 FDR: 2,056; 0.01 FDR: 1,372; 0.001 FDR: 1,001
7:02:15.569823 PROGRESS: =========================================================================
7:02:15.571699 PROGRESS: === Epoch 18, step 8, extracting elution groups 255000 to 511000 ===
7:02:15.879836 PROGRESS: Extracting batch of 505798 precursors
7:02:16.014728 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
7:02:16.014840 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
7:02:16.014881 INFO: FWHM in RT is 13.88 seconds, sigma is 0.51
7:02:16.014908 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
7:02:16.015189 INFO: Starting candidate selection
7:02:30.812521 INFO: Starting candidate scoring
7:02:36.879548 INFO: Finished candidate processing
7:02:36.879739 INFO: Collecting candidate features
7:02:40.523450 WARNING: intensity_correlation has 274 NaNs ( 0.06 % out of 471287)
7:02:40.558773 INFO: Collecting fragment features
7:02:41.623169 INFO: Finished candidate scoring
7:02:42.519219 PROGRESS: === Epoch 18, step 8, extracted 471287 precursors and 2216081 fragments ===
7:02:42.519615 INFO: performing precursor FDR with 47 features
7:02:42.519661 INFO: Decoy channel: -1
7:02:42.519687 INFO: Competetive: True
7:02:43.678007 WARNING: dropped 262 target PSMs due to missing features
7:02:43.678132 WARNING: dropped 308 decoy PSMs due to missing features
7:03:19.828382 INFO: Test AUC: 0.552
7:03:19.828522 INFO: Train AUC: 0.568
7:03:19.828558 INFO: AUC difference: 2.80%
7:03:20.072074 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
7:03:20.075238 PROGRESS: ============================= Precursor FDR =============================
7:03:20.075422 PROGRESS: Total precursors accumulated: 6,668
7:03:20.075501 PROGRESS: Target precursors: 6,083 (91.23%)
7:03:20.075568 PROGRESS: Decoy precursors: 585 (8.77%)
7:03:20.075631 PROGRESS: 
7:03:20.075691 PROGRESS: Precursor Summary:
7:03:20.079642 PROGRESS: Channel   0:	 0.05 FDR: 4,848; 0.01 FDR: 3,556; 0.001 FDR: 2,213
7:03:20.079816 PROGRESS: 
7:03:20.079889 PROGRESS: Protein Summary:
7:03:20.085433 PROGRESS: Channel   0:	 0.05 FDR: 3,393; 0.01 FDR: 2,416; 0.001 FDR: 1,611
7:03:20.085596 PROGRESS: =========================================================================
7:03:20.088446 PROGRESS: === Epoch 18, step 9, extracting elution groups 511000 to 1023000 ===
7:03:20.521943 PROGRESS: Extracting batch of 1011525 precursors
7:03:20.801444 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
7:03:20.801560 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
7:03:20.801602 INFO: FWHM in RT is 13.88 seconds, sigma is 0.51
7:03:20.801632 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
7:03:20.801925 INFO: Starting candidate selection
7:03:45.733023 INFO: Starting candidate scoring
7:03:56.804667 INFO: Finished candidate processing
7:03:56.804865 INFO: Collecting candidate features
7:04:01.748657 WARNING: intensity_correlation has 630 NaNs ( 0.07 % out of 942023)
7:04:01.750505 WARNING: height_correlation has 1 NaNs ( 0.00 % out of 942023)
7:04:01.810504 INFO: Collecting fragment features
7:04:03.458579 INFO: Finished candidate scoring
7:04:05.068843 PROGRESS: === Epoch 18, step 9, extracted 942023 precursors and 4422256 fragments ===
7:04:05.069220 INFO: performing precursor FDR with 47 features
7:04:05.069263 INFO: Decoy channel: -1
7:04:05.069287 INFO: Competetive: True
7:04:07.345563 WARNING: dropped 570 target PSMs due to missing features
7:04:07.345698 WARNING: dropped 630 decoy PSMs due to missing features
7:05:20.570400 INFO: Test AUC: 0.552
7:05:20.570549 INFO: Train AUC: 0.562
7:05:20.570588 INFO: AUC difference: 1.85%
7:05:20.925028 PROGRESS: === checking if recalibration conditions were reached, target 3800 precursors ===
7:05:20.929477 PROGRESS: ============================= Precursor FDR =============================
7:05:20.929707 PROGRESS: Total precursors accumulated: 11,986
7:05:20.929800 PROGRESS: Target precursors: 10,948 (91.34%)
7:05:20.929871 PROGRESS: Decoy precursors: 1,038 (8.66%)
7:05:20.929936 PROGRESS: 
7:05:20.929997 PROGRESS: Precursor Summary:
7:05:20.935945 PROGRESS: Channel   0:	 0.05 FDR: 9,400; 0.01 FDR: 7,259; 0.001 FDR: 4,790
7:05:20.936153 PROGRESS: 
7:05:20.936230 PROGRESS: Protein Summary:
7:05:20.944927 PROGRESS: Channel   0:	 0.05 FDR: 4,928; 0.01 FDR: 3,780; 0.001 FDR: 2,671
7:05:20.945131 PROGRESS: =========================================================================
7:05:20.952493 INFO: calibration group: precursor, fitting rt estimator 
7:05:22.081284 INFO: calibration group: fragment, fitting mz estimator 
7:05:22.678071 INFO: === checking if epoch conditions were reached ===
7:05:22.678345 INFO: ✅ ms2_error      : 7.0000 <= 7
7:05:22.678438 INFO: ❌ rt_error       : 200.5154 > 100
7:05:22.678512 INFO: ✅ current_epoch  : 18 >= 3
7:05:22.678584 INFO: ==============================================
7:05:22.896859 INFO: calibration group: precursor, predicting mz
7:05:22.897170 WARNING: mz prediction was skipped as it has not been fitted yet
7:05:22.897213 INFO: calibration group: precursor, predicting rt
7:05:29.681678 INFO: calibration group: fragment, predicting mz
7:05:47.439491 PROGRESS: === Epoch 19, step 0, extracting elution groups 0 to 1000 ===
7:05:47.560915 PROGRESS: Extracting batch of 1982 precursors
7:05:47.562884 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
7:05:47.562964 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
7:05:47.563002 INFO: FWHM in RT is 13.95 seconds, sigma is 0.51
7:05:47.563048 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
7:05:47.563280 INFO: Starting candidate selection
7:05:52.642828 INFO: Starting candidate scoring
7:05:53.951471 INFO: Finished candidate processing
7:05:53.951561 INFO: Collecting candidate features
7:05:56.141559 INFO: Collecting fragment features
7:05:56.781430 INFO: Finished candidate scoring
7:05:57.186234 PROGRESS: === Epoch 19, step 0, extracted 1846 precursors and 8862 fragments ===
7:05:57.186553 INFO: performing precursor FDR with 47 features
7:05:57.186599 INFO: Decoy channel: -1
7:05:57.186625 INFO: Competetive: True
7:05:57.220239 INFO: Test AUC: 0.545
7:05:57.220348 INFO: Train AUC: 0.556
7:05:57.220394 INFO: AUC difference: 2.12%
7:05:57.339417 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
7:05:57.340181 PROGRESS: ============================= Precursor FDR =============================
7:05:57.340303 PROGRESS: Total precursors accumulated: 25
7:05:57.340381 PROGRESS: Target precursors: 23 (92.00%)
7:05:57.340449 PROGRESS: Decoy precursors: 2 (8.00%)
7:05:57.340512 PROGRESS: 
7:05:57.340572 PROGRESS: Precursor Summary:
7:05:57.341989 PROGRESS: Channel   0:	 0.05 FDR:    11; 0.01 FDR:    11; 0.001 FDR:    11
7:05:57.342101 PROGRESS: 
7:05:57.342174 PROGRESS: Protein Summary:
7:05:57.343757 PROGRESS: Channel   0:	 0.05 FDR:    11; 0.01 FDR:    11; 0.001 FDR:    11
7:05:57.343882 PROGRESS: =========================================================================
7:05:57.344731 PROGRESS: === Epoch 19, step 1, extracting elution groups 1000 to 3000 ===
7:05:57.422364 PROGRESS: Extracting batch of 3961 precursors
7:05:57.424657 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
7:05:57.424716 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
7:05:57.424757 INFO: FWHM in RT is 13.95 seconds, sigma is 0.51
7:05:57.424803 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
7:05:57.425019 INFO: Starting candidate selection
7:06:02.094276 INFO: Starting candidate scoring
7:06:03.407404 INFO: Finished candidate processing
7:06:03.407495 INFO: Collecting candidate features
7:06:05.569918 WARNING: intensity_correlation has 5 NaNs ( 0.14 % out of 3677)
7:06:05.576141 INFO: Collecting fragment features
7:06:06.211978 INFO: Finished candidate scoring
7:06:06.495312 PROGRESS: === Epoch 19, step 1, extracted 3677 precursors and 17160 fragments ===
7:06:06.495621 INFO: performing precursor FDR with 47 features
7:06:06.495670 INFO: Decoy channel: -1
7:06:06.495696 INFO: Competetive: True
7:06:06.505132 WARNING: dropped 2 target PSMs due to missing features
7:06:06.505222 WARNING: dropped 3 decoy PSMs due to missing features
7:06:06.544949 INFO: Test AUC: 0.565
7:06:06.545071 INFO: Train AUC: 0.558
7:06:06.545117 INFO: AUC difference: 1.14%
7:06:06.666658 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
7:06:06.667467 PROGRESS: ============================= Precursor FDR =============================
7:06:06.667591 PROGRESS: Total precursors accumulated: 37
7:06:06.667669 PROGRESS: Target precursors: 34 (91.89%)
7:06:06.667738 PROGRESS: Decoy precursors: 3 (8.11%)
7:06:06.667802 PROGRESS: 
7:06:06.667863 PROGRESS: Precursor Summary:
7:06:06.669279 PROGRESS: Channel   0:	 0.05 FDR:    30; 0.01 FDR:    30; 0.001 FDR:    30
7:06:06.669406 PROGRESS: 
7:06:06.669479 PROGRESS: Protein Summary:
7:06:06.671109 PROGRESS: Channel   0:	 0.05 FDR:    30; 0.01 FDR:    30; 0.001 FDR:    30
7:06:06.671221 PROGRESS: =========================================================================
7:06:06.672084 PROGRESS: === Epoch 19, step 2, extracting elution groups 3000 to 7000 ===
7:06:06.754696 PROGRESS: Extracting batch of 7898 precursors
7:06:06.758288 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
7:06:06.758369 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
7:06:06.758414 INFO: FWHM in RT is 13.95 seconds, sigma is 0.51
7:06:06.758446 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
7:06:06.758682 INFO: Starting candidate selection
7:06:11.513994 INFO: Starting candidate scoring
7:06:12.866004 INFO: Finished candidate processing
7:06:12.866093 INFO: Collecting candidate features
7:06:15.040757 WARNING: intensity_correlation has 6 NaNs ( 0.08 % out of 7365)
7:06:15.046631 INFO: Collecting fragment features
7:06:15.690518 INFO: Finished candidate scoring
7:06:15.980199 PROGRESS: === Epoch 19, step 2, extracted 7365 precursors and 34889 fragments ===
7:06:15.980582 INFO: performing precursor FDR with 47 features
7:06:15.980624 INFO: Decoy channel: -1
7:06:15.980652 INFO: Competetive: True
7:06:15.996135 WARNING: dropped 5 target PSMs due to missing features
7:06:15.996234 WARNING: dropped 6 decoy PSMs due to missing features
7:06:16.281298 INFO: Test AUC: 0.538
7:06:16.281426 INFO: Train AUC: 0.582
7:06:16.281471 INFO: AUC difference: 7.62%
7:06:16.281506 WARNING: AUC difference > 5%. This may indicate overfitting.
7:06:16.403119 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
7:06:16.403991 PROGRESS: ============================= Precursor FDR =============================
7:06:16.404115 PROGRESS: Total precursors accumulated: 105
7:06:16.404205 PROGRESS: Target precursors: 96 (91.43%)
7:06:16.404276 PROGRESS: Decoy precursors: 9 (8.57%)
7:06:16.404340 PROGRESS: 
7:06:16.404402 PROGRESS: Precursor Summary:
7:06:16.405915 PROGRESS: Channel   0:	 0.05 FDR:    89; 0.01 FDR:    53; 0.001 FDR:    53
7:06:16.406031 PROGRESS: 
7:06:16.406106 PROGRESS: Protein Summary:
7:06:16.407796 PROGRESS: Channel   0:	 0.05 FDR:    88; 0.01 FDR:    52; 0.001 FDR:    52
7:06:16.407916 PROGRESS: =========================================================================
7:06:16.408784 PROGRESS: === Epoch 19, step 3, extracting elution groups 7000 to 15000 ===
7:06:16.500666 PROGRESS: Extracting batch of 15825 precursors
7:06:16.506502 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
7:06:16.506587 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
7:06:16.506627 INFO: FWHM in RT is 13.95 seconds, sigma is 0.51
7:06:16.506654 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
7:06:16.506876 INFO: Starting candidate selection
7:06:21.426129 INFO: Starting candidate scoring
7:06:22.855337 INFO: Finished candidate processing
7:06:22.855466 INFO: Collecting candidate features
7:06:25.059723 WARNING: intensity_correlation has 15 NaNs ( 0.10 % out of 14715)
7:06:25.065894 INFO: Collecting fragment features
7:06:25.717523 INFO: Finished candidate scoring
7:06:26.016590 PROGRESS: === Epoch 19, step 3, extracted 14715 precursors and 68801 fragments ===
7:06:26.016947 INFO: performing precursor FDR with 47 features
7:06:26.017008 INFO: Decoy channel: -1
7:06:26.017049 INFO: Competetive: True
7:06:26.047191 WARNING: dropped 12 target PSMs due to missing features
7:06:26.047328 WARNING: dropped 14 decoy PSMs due to missing features
7:06:26.855375 INFO: Test AUC: 0.555
7:06:26.855519 INFO: Train AUC: 0.598
7:06:26.855564 INFO: AUC difference: 7.24%
7:06:26.855598 WARNING: AUC difference > 5%. This may indicate overfitting.
7:06:26.982784 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
7:06:26.983747 PROGRESS: ============================= Precursor FDR =============================
7:06:26.983873 PROGRESS: Total precursors accumulated: 200
7:06:26.983950 PROGRESS: Target precursors: 182 (91.00%)
7:06:26.984018 PROGRESS: Decoy precursors: 18 (9.00%)
7:06:26.984081 PROGRESS: 
7:06:26.984142 PROGRESS: Precursor Summary:
7:06:26.985719 PROGRESS: Channel   0:	 0.05 FDR:   157; 0.01 FDR:   127; 0.001 FDR:   104
7:06:26.985859 PROGRESS: 
7:06:26.985946 PROGRESS: Protein Summary:
7:06:26.987760 PROGRESS: Channel   0:	 0.05 FDR:   154; 0.01 FDR:   124; 0.001 FDR:   101
7:06:26.987871 PROGRESS: =========================================================================
7:06:26.988802 PROGRESS: === Epoch 19, step 4, extracting elution groups 15000 to 31000 ===
7:06:27.096030 PROGRESS: Extracting batch of 31608 precursors
7:06:27.106766 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
7:06:27.106864 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
7:06:27.106902 INFO: FWHM in RT is 13.95 seconds, sigma is 0.51
7:06:27.106930 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
7:06:27.107192 INFO: Starting candidate selection
7:06:32.329756 INFO: Starting candidate scoring
7:06:33.896640 INFO: Finished candidate processing
7:06:33.896765 INFO: Collecting candidate features
7:06:36.148365 WARNING: intensity_correlation has 25 NaNs ( 0.08 % out of 29507)
7:06:36.155368 INFO: Collecting fragment features
7:06:36.825875 INFO: Finished candidate scoring
7:06:37.143304 PROGRESS: === Epoch 19, step 4, extracted 29507 precursors and 138872 fragments ===
7:06:37.150538 INFO: performing precursor FDR with 47 features
7:06:37.150609 INFO: Decoy channel: -1
7:06:37.150636 INFO: Competetive: True
7:06:37.210892 WARNING: dropped 23 target PSMs due to missing features
7:06:37.211018 WARNING: dropped 28 decoy PSMs due to missing features
7:06:39.117466 INFO: Test AUC: 0.554
7:06:39.117613 INFO: Train AUC: 0.610
7:06:39.117660 INFO: AUC difference: 9.17%
7:06:39.117694 WARNING: AUC difference > 5%. This may indicate overfitting.
7:06:39.246256 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
7:06:39.247391 PROGRESS: ============================= Precursor FDR =============================
7:06:39.247526 PROGRESS: Total precursors accumulated: 550
7:06:39.247604 PROGRESS: Target precursors: 502 (91.27%)
7:06:39.247671 PROGRESS: Decoy precursors: 48 (8.73%)
7:06:39.247749 PROGRESS: 
7:06:39.247810 PROGRESS: Precursor Summary:
7:06:39.249569 PROGRESS: Channel   0:	 0.05 FDR:   350; 0.01 FDR:   221; 0.001 FDR:   185
7:06:39.249721 PROGRESS: 
7:06:39.249804 PROGRESS: Protein Summary:
7:06:39.251808 PROGRESS: Channel   0:	 0.05 FDR:   335; 0.01 FDR:   209; 0.001 FDR:   174
7:06:39.251934 PROGRESS: =========================================================================
7:06:39.252974 PROGRESS: === Epoch 19, step 5, extracting elution groups 31000 to 63000 ===
7:06:39.388600 PROGRESS: Extracting batch of 63185 precursors
7:06:39.408669 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
7:06:39.408775 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
7:06:39.408813 INFO: FWHM in RT is 13.95 seconds, sigma is 0.51
7:06:39.408856 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
7:06:39.409132 INFO: Starting candidate selection
7:06:45.274761 INFO: Starting candidate scoring
7:06:47.140453 INFO: Finished candidate processing
7:06:47.140545 INFO: Collecting candidate features
7:06:49.481918 WARNING: intensity_correlation has 48 NaNs ( 0.08 % out of 58866)
7:06:49.490719 INFO: Collecting fragment features
7:06:50.197843 INFO: Finished candidate scoring
7:06:50.550219 PROGRESS: === Epoch 19, step 5, extracted 58866 precursors and 276860 fragments ===
7:06:50.550606 INFO: performing precursor FDR with 47 features
7:06:50.550651 INFO: Decoy channel: -1
7:06:50.550678 INFO: Competetive: True
7:06:50.682585 WARNING: dropped 47 target PSMs due to missing features
7:06:50.682720 WARNING: dropped 52 decoy PSMs due to missing features
7:06:54.651648 INFO: Test AUC: 0.554
7:06:54.651766 INFO: Train AUC: 0.608
7:06:54.651847 INFO: AUC difference: 8.84%
7:06:54.651879 WARNING: AUC difference > 5%. This may indicate overfitting.
7:06:54.789032 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
7:06:54.790382 PROGRESS: ============================= Precursor FDR =============================
7:06:54.790513 PROGRESS: Total precursors accumulated: 1,048
7:06:54.790593 PROGRESS: Target precursors: 956 (91.22%)
7:06:54.790661 PROGRESS: Decoy precursors: 92 (8.78%)
7:06:54.790725 PROGRESS: 
7:06:54.790786 PROGRESS: Precursor Summary:
7:06:54.792813 PROGRESS: Channel   0:	 0.05 FDR:   722; 0.01 FDR:   508; 0.001 FDR:   458
7:06:54.792954 PROGRESS: 
7:06:54.793029 PROGRESS: Protein Summary:
7:06:54.795413 PROGRESS: Channel   0:	 0.05 FDR:   679; 0.01 FDR:   473; 0.001 FDR:   428
7:06:54.795547 PROGRESS: =========================================================================
7:06:54.796749 PROGRESS: === Epoch 19, step 6, extracting elution groups 63000 to 127000 ===
7:06:54.972940 PROGRESS: Extracting batch of 126522 precursors
7:06:55.012352 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
7:06:55.012463 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
7:06:55.012517 INFO: FWHM in RT is 13.95 seconds, sigma is 0.51
7:06:55.012545 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
7:06:55.012808 INFO: Starting candidate selection
7:07:02.123766 INFO: Starting candidate scoring
7:07:04.588156 INFO: Finished candidate processing
7:07:04.588263 INFO: Collecting candidate features
7:07:07.141954 WARNING: intensity_correlation has 68 NaNs ( 0.06 % out of 117877)
7:07:07.156352 INFO: Collecting fragment features
7:07:07.917197 INFO: Finished candidate scoring
7:07:08.345196 PROGRESS: === Epoch 19, step 6, extracted 117877 precursors and 554120 fragments ===
7:07:08.345620 INFO: performing precursor FDR with 47 features
7:07:08.345668 INFO: Decoy channel: -1
7:07:08.345693 INFO: Competetive: True
7:07:08.614938 WARNING: dropped 78 target PSMs due to missing features
7:07:08.615067 WARNING: dropped 89 decoy PSMs due to missing features
7:07:17.284665 INFO: Test AUC: 0.554
7:07:17.284792 INFO: Train AUC: 0.596
7:07:17.284848 INFO: AUC difference: 7.17%
7:07:17.284876 WARNING: AUC difference > 5%. This may indicate overfitting.
7:07:17.439878 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
7:07:17.441635 PROGRESS: ============================= Precursor FDR =============================
7:07:17.441816 PROGRESS: Total precursors accumulated: 2,176
7:07:17.441897 PROGRESS: Target precursors: 1,985 (91.22%)
7:07:17.441972 PROGRESS: Decoy precursors: 191 (8.78%)
7:07:17.442036 PROGRESS: 
7:07:17.442097 PROGRESS: Precursor Summary:
7:07:17.444401 PROGRESS: Channel   0:	 0.05 FDR: 1,338; 0.01 FDR:   922; 0.001 FDR:   625
7:07:17.444571 PROGRESS: 
7:07:17.444645 PROGRESS: Protein Summary:
7:07:17.447548 PROGRESS: Channel   0:	 0.05 FDR: 1,182; 0.01 FDR:   809; 0.001 FDR:   557
7:07:17.447671 PROGRESS: =========================================================================
7:07:17.449139 PROGRESS: === Epoch 19, step 7, extracting elution groups 127000 to 255000 ===
7:07:17.674401 PROGRESS: Extracting batch of 252918 precursors
7:07:17.746451 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
7:07:17.746586 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
7:07:17.746627 INFO: FWHM in RT is 13.95 seconds, sigma is 0.51
7:07:17.746654 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
7:07:17.746919 INFO: Starting candidate selection
7:07:27.472272 INFO: Starting candidate scoring
7:07:31.177719 INFO: Finished candidate processing
7:07:31.177957 INFO: Collecting candidate features
7:07:34.158895 WARNING: intensity_correlation has 165 NaNs ( 0.07 % out of 235723)
7:07:34.181424 INFO: Collecting fragment features
7:07:35.047415 INFO: Finished candidate scoring
7:07:35.637280 PROGRESS: === Epoch 19, step 7, extracted 235723 precursors and 1105628 fragments ===
7:07:35.637694 INFO: performing precursor FDR with 47 features
7:07:35.637745 INFO: Decoy channel: -1
7:07:35.637782 INFO: Competetive: True
7:07:36.240447 WARNING: dropped 167 target PSMs due to missing features
7:07:36.240572 WARNING: dropped 165 decoy PSMs due to missing features
7:07:54.042675 INFO: Test AUC: 0.552
7:07:54.042824 INFO: Train AUC: 0.583
7:07:54.042864 INFO: AUC difference: 5.23%
7:07:54.042892 WARNING: AUC difference > 5%. This may indicate overfitting.
7:07:54.234101 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
7:07:54.236464 PROGRESS: ============================= Precursor FDR =============================
7:07:54.236634 PROGRESS: Total precursors accumulated: 4,034
7:07:54.236716 PROGRESS: Target precursors: 3,672 (91.03%)
7:07:54.236784 PROGRESS: Decoy precursors: 362 (8.97%)
7:07:54.236847 PROGRESS: 
7:07:54.236907 PROGRESS: Precursor Summary:
7:07:54.239926 PROGRESS: Channel   0:	 0.05 FDR: 2,684; 0.01 FDR: 1,935; 0.001 FDR: 1,198
7:07:54.240087 PROGRESS: 
7:07:54.240161 PROGRESS: Protein Summary:
7:07:54.244218 PROGRESS: Channel   0:	 0.05 FDR: 2,122; 0.01 FDR: 1,515; 0.001 FDR:   983
7:07:54.244360 PROGRESS: =========================================================================
7:07:54.246384 PROGRESS: === Epoch 19, step 8, extracting elution groups 255000 to 511000 ===
7:07:54.553712 PROGRESS: Extracting batch of 505867 precursors
7:07:54.688682 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
7:07:54.688797 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
7:07:54.688852 INFO: FWHM in RT is 13.95 seconds, sigma is 0.51
7:07:54.688879 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
7:07:54.689149 INFO: Starting candidate selection
7:08:09.436389 INFO: Starting candidate scoring
7:08:15.512835 INFO: Finished candidate processing
7:08:15.513027 INFO: Collecting candidate features
7:08:19.159689 WARNING: intensity_correlation has 336 NaNs ( 0.07 % out of 471414)
7:08:19.160731 WARNING: height_correlation has 3 NaNs ( 0.00 % out of 471414)
7:08:19.192760 INFO: Collecting fragment features
7:08:20.237844 INFO: Finished candidate scoring
7:08:21.127549 PROGRESS: === Epoch 19, step 8, extracted 471414 precursors and 2215983 fragments ===
7:08:21.127979 INFO: performing precursor FDR with 47 features
7:08:21.134660 INFO: Decoy channel: -1
7:08:21.134798 INFO: Competetive: True
7:08:22.272794 WARNING: dropped 318 target PSMs due to missing features
7:08:22.272931 WARNING: dropped 350 decoy PSMs due to missing features
7:08:58.011251 INFO: Test AUC: 0.553
7:08:58.011381 INFO: Train AUC: 0.572
7:08:58.011436 INFO: AUC difference: 3.32%
7:08:58.268389 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
7:08:58.271542 PROGRESS: ============================= Precursor FDR =============================
7:08:58.271713 PROGRESS: Total precursors accumulated: 6,853
7:08:58.271793 PROGRESS: Target precursors: 6,244 (91.11%)
7:08:58.271861 PROGRESS: Decoy precursors: 609 (8.89%)
7:08:58.271924 PROGRESS: 
7:08:58.271984 PROGRESS: Precursor Summary:
7:08:58.275822 PROGRESS: Channel   0:	 0.05 FDR: 4,917; 0.01 FDR: 3,505; 0.001 FDR: 2,290
7:08:58.275985 PROGRESS: 
7:08:58.276058 PROGRESS: Protein Summary:
7:08:58.281458 PROGRESS: Channel   0:	 0.05 FDR: 3,300; 0.01 FDR: 2,319; 0.001 FDR: 1,640
7:08:58.281612 PROGRESS: =========================================================================
7:08:58.284371 PROGRESS: === Epoch 19, step 9, extracting elution groups 511000 to 1023000 ===
7:08:58.711202 PROGRESS: Extracting batch of 1011689 precursors
7:08:58.987545 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
7:08:58.987655 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
7:08:58.987692 INFO: FWHM in RT is 13.95 seconds, sigma is 0.51
7:08:58.987735 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
7:08:58.988007 INFO: Starting candidate selection
7:09:23.904265 INFO: Starting candidate scoring
7:09:34.970788 INFO: Finished candidate processing
7:09:34.970987 INFO: Collecting candidate features
7:09:39.844257 WARNING: intensity_correlation has 652 NaNs ( 0.07 % out of 942780)
7:09:39.846054 WARNING: height_correlation has 2 NaNs ( 0.00 % out of 942780)
7:09:39.904083 INFO: Collecting fragment features
7:09:41.524221 INFO: Finished candidate scoring
7:09:43.112126 PROGRESS: === Epoch 19, step 9, extracted 942780 precursors and 4428254 fragments ===
7:09:43.112524 INFO: performing precursor FDR with 47 features
7:09:43.112575 INFO: Decoy channel: -1
7:09:43.112602 INFO: Competetive: True
7:09:45.382471 WARNING: dropped 647 target PSMs due to missing features
7:09:45.382598 WARNING: dropped 673 decoy PSMs due to missing features
7:10:56.015023 INFO: Test AUC: 0.552
7:10:56.015150 INFO: Train AUC: 0.564
7:10:56.015185 INFO: AUC difference: 2.14%
7:10:56.372213 PROGRESS: === checking if recalibration conditions were reached, target 4000 precursors ===
7:10:56.376750 PROGRESS: ============================= Precursor FDR =============================
7:10:56.376961 PROGRESS: Total precursors accumulated: 12,036
7:10:56.377041 PROGRESS: Target precursors: 10,985 (91.27%)
7:10:56.377107 PROGRESS: Decoy precursors: 1,051 (8.73%)
7:10:56.377169 PROGRESS: 
7:10:56.377229 PROGRESS: Precursor Summary:
7:10:56.383081 PROGRESS: Channel   0:	 0.05 FDR: 9,447; 0.01 FDR: 7,184; 0.001 FDR: 5,172
7:10:56.383308 PROGRESS: 
7:10:56.383382 PROGRESS: Protein Summary:
7:10:56.392020 PROGRESS: Channel   0:	 0.05 FDR: 4,975; 0.01 FDR: 3,680; 0.001 FDR: 2,815
7:10:56.392208 PROGRESS: =========================================================================
7:10:56.399395 INFO: calibration group: precursor, fitting rt estimator 
7:10:57.505456 INFO: calibration group: fragment, fitting mz estimator 
7:10:58.291857 INFO: calibration group: precursor, predicting mz
7:10:58.293005 WARNING: mz prediction was skipped as it has not been fitted yet
7:10:58.293058 INFO: calibration group: precursor, predicting rt
7:11:05.063204 INFO: calibration group: fragment, predicting mz
7:11:22.517702 PROGRESS: Extracting batch of 9950763 precursors
7:11:25.178132 INFO: Duty cycle consists of 151 frames, 5.84 seconds cycle time
7:11:25.178262 INFO: Duty cycle consists of 1 scans, 0.00000 1/K_0 resolution
7:11:25.178302 INFO: FWHM in RT is 13.97 seconds, sigma is 0.51
7:11:25.178329 INFO: FWHM in mobility is 0.000 1/K_0, sigma is 1.00
7:11:25.178598 INFO: Starting candidate selection
7:14:34.547603 INFO: Applying score cutoff of 48.938022994995116
7:14:34.729434 INFO: Removed 6839014 precursors with score below cutoff
7:14:37.172151 INFO: Starting candidate scoring
7:15:10.285881 INFO: Finished candidate processing
7:15:10.286007 INFO: Collecting candidate features
7:15:19.594623 WARNING: intensity_correlation has 29 NaNs ( 0.00 % out of 2846835)
7:15:19.760270 INFO: Collecting fragment features
7:15:23.807044 INFO: Finished candidate scoring
7:15:26.881522 INFO: performing precursor FDR with 47 features
7:15:26.881635 INFO: Decoy channel: -1
7:15:26.881661 INFO: Competetive: True
7:15:29.417812 WARNING: dropped 19 target PSMs due to missing features
7:15:29.417948 WARNING: dropped 10 decoy PSMs due to missing features
7:17:21.124665 INFO: Test AUC: 0.569
7:17:21.124787 INFO: Train AUC: 0.575
7:17:21.124841 INFO: AUC difference: 0.98%
7:17:21.546543 INFO: Removing fragments below FDR threshold
7:17:21.815490 PROGRESS: ============================= Precursor FDR =============================
7:17:21.815786 PROGRESS: Total precursors accumulated: 23,942
7:17:21.815880 PROGRESS: Target precursors: 23,705 (99.01%)
7:17:21.815950 PROGRESS: Decoy precursors: 237 (0.99%)
7:17:21.816016 PROGRESS: 
7:17:21.816077 PROGRESS: Precursor Summary:
7:17:21.831160 PROGRESS: Channel   0:	 0.05 FDR: 23,705; 0.01 FDR: 23,705; 0.001 FDR: 16,825
7:17:21.831468 PROGRESS: 
7:17:21.831547 PROGRESS: Protein Summary:
7:17:21.852005 PROGRESS: Channel   0:	 0.05 FDR: 6,672; 0.01 FDR: 6,672; 0.001 FDR: 5,192
7:17:21.852287 PROGRESS: =========================================================================
7:17:22.247014 INFO: Finished workflow for LFQ_Orbitrap_AIF_Condition_A_Sample_Alpha_03
7:17:47.641484 PROGRESS: Processing search outputs
7:17:47.641610 PROGRESS: Performing protein grouping and FDR
7:17:47.641644 INFO: Building output for LFQ_Orbitrap_AIF_Condition_B_Sample_Alpha_03
7:17:47.666983 INFO: Building output for LFQ_Orbitrap_AIF_Condition_A_Sample_Alpha_01
7:17:47.684679 INFO: Building output for LFQ_Orbitrap_AIF_Condition_B_Sample_Alpha_01
7:17:47.703085 INFO: Building output for LFQ_Orbitrap_AIF_Condition_A_Sample_Alpha_02
7:17:47.721588 INFO: Building output for LFQ_Orbitrap_AIF_Condition_B_Sample_Alpha_02
7:17:47.739989 INFO: Building output for LFQ_Orbitrap_AIF_Condition_A_Sample_Alpha_03
7:17:47.757106 INFO: Building combined output
7:17:48.206050 INFO: Performing protein inference
7:17:48.417325 INFO: Inference strategy: heuristic. Using maximum parsimony with grouping for protein inference
7:17:59.533328 INFO: Performing protein FDR
7:18:06.955246 INFO: Normalizing q-values using 9,022 targets and 1,051 decoys
7:18:06.967396 INFO: Test AUC: 0.909
7:18:06.967693 INFO: Train AUC: 0.893
7:18:06.967836 INFO: AUC difference: 1.84%
7:18:07.315099 PROGRESS: ================ Protein FDR =================
7:18:07.315231 PROGRESS: Unique protein groups in output
7:18:07.315264 PROGRESS:   1% protein FDR: 5,801
7:18:07.315305 PROGRESS: 
7:18:07.315328 PROGRESS: Unique precursor in output
7:18:07.315352 PROGRESS:   1% protein FDR: 37,512
7:18:07.315374 PROGRESS: ================================================
7:18:07.345705 PROGRESS: Building search statistics
7:18:07.465804 INFO: Writing stat output to disk
7:18:07.465939 INFO: Saving output/stat.tsv to disk
7:18:07.470121 PROGRESS: Performing label free quantification
7:18:07.505034 INFO: Accumulating fragment data
7:18:07.505178 INFO: reading frag file for LFQ_Orbitrap_AIF_Condition_B_Sample_Alpha_03
7:18:07.667694 INFO: reading frag file for LFQ_Orbitrap_AIF_Condition_A_Sample_Alpha_01
7:18:07.952509 INFO: reading frag file for LFQ_Orbitrap_AIF_Condition_B_Sample_Alpha_01
7:18:08.238945 INFO: reading frag file for LFQ_Orbitrap_AIF_Condition_A_Sample_Alpha_02
7:18:08.567793 INFO: reading frag file for LFQ_Orbitrap_AIF_Condition_B_Sample_Alpha_02
7:18:08.921667 INFO: reading frag file for LFQ_Orbitrap_AIF_Condition_A_Sample_Alpha_03
7:18:09.443797 PROGRESS: Performing label free quantification on the pg level
7:18:09.443915 INFO: Filtering fragments by quality
7:18:09.560389 INFO: Performing label-free quantification using directLFQ
7:18:10.811531 INFO: 5801 lfq-groups total
7:18:17.170768 INFO: using 24 processes
7:18:17.226757 INFO: lfq-object 0
7:18:17.323056 INFO: lfq-object 200
7:18:17.325838 INFO: lfq-object 100
7:18:17.404279 INFO: lfq-object 500
7:18:17.413645 INFO: lfq-object 400
7:18:17.432240 INFO: lfq-object 300
7:18:17.499979 INFO: lfq-object 600
7:18:17.547740 INFO: lfq-object 800
7:18:17.639951 INFO: lfq-object 700
7:18:17.665908 INFO: lfq-object 900
7:18:17.666797 INFO: lfq-object 1100
7:18:17.690444 INFO: lfq-object 1000
7:18:17.765237 INFO: lfq-object 1300
7:18:17.770597 INFO: lfq-object 1200
7:18:17.879842 INFO: lfq-object 1400
7:18:17.893404 INFO: lfq-object 1500
7:18:17.895241 INFO: lfq-object 1600
7:18:17.996022 INFO: lfq-object 1800
7:18:17.996788 INFO: lfq-object 1900
7:18:18.011939 INFO: lfq-object 1700
7:18:18.116646 INFO: lfq-object 2000
7:18:18.128464 INFO: lfq-object 2100
7:18:18.136069 INFO: lfq-object 2200
7:18:18.245200 INFO: lfq-object 2300
7:18:18.251683 INFO: lfq-object 2400
7:18:18.341915 INFO: lfq-object 2600
7:18:18.358819 INFO: lfq-object 2700
7:18:18.358905 INFO: lfq-object 2500
7:18:18.478746 INFO: lfq-object 2800
7:18:18.494099 INFO: lfq-object 2900
7:18:18.516701 INFO: lfq-object 3000
7:18:18.601836 INFO: lfq-object 3200
7:18:18.615873 INFO: lfq-object 3300
7:18:18.716254 INFO: lfq-object 3400
7:18:18.721922 INFO: lfq-object 3500
7:18:18.730885 INFO: lfq-object 3600
7:18:18.737229 INFO: lfq-object 3100
7:18:18.832086 INFO: lfq-object 3700
7:18:18.837562 INFO: lfq-object 3800
7:18:18.938765 INFO: lfq-object 3900
7:18:18.946519 INFO: lfq-object 4100
7:18:18.948851 INFO: lfq-object 4000
7:18:19.037363 INFO: lfq-object 4200
7:18:19.053181 INFO: lfq-object 4300
7:18:19.063573 INFO: lfq-object 4400
7:18:19.164191 INFO: lfq-object 4500
7:18:19.185263 INFO: lfq-object 4600
7:18:19.187516 INFO: lfq-object 4700
7:18:19.274371 INFO: lfq-object 4900
7:18:19.280136 INFO: lfq-object 4800
7:18:19.389562 INFO: lfq-object 5000
7:18:19.412154 INFO: lfq-object 5100
7:18:19.426296 INFO: lfq-object 5200
7:18:19.532908 INFO: lfq-object 5300
7:18:19.540344 INFO: lfq-object 5400
7:18:19.563873 INFO: lfq-object 5500
7:18:19.674830 INFO: lfq-object 5600
7:18:19.680550 INFO: lfq-object 5800
7:18:19.706037 INFO: lfq-object 5700
7:18:20.374238 INFO: Writing pg output to disk
7:18:20.374405 INFO: Saving output/pg.matrix.tsv to disk
7:18:20.511675 INFO: Writing psm output to disk
7:18:20.511812 INFO: Saving output/precursors.tsv to disk
7:18:28.825809 PROGRESS: Building spectral library
7:18:28.866738 INFO: Building MBR spectral library
7:18:28.866856 INFO: Running MbrLibraryBuilder
7:18:32.584275 INFO: MBR spectral library contains 37,512 precursors, 5,801 proteins
7:18:32.584395 INFO: Writing MBR spectral library to disk
7:18:32.892149 INFO: Writing MBR spectral library to disk
7:18:33.207257 PROGRESS: =================== Search Finished ===================
7:21:46.489460 WARNING: WARNING: Temp mmap arrays were written to /tmp/temp_mmap_lqu2qiw9. Cleanup of this folder is OS dependant, and might need to be triggered manually! Current space: 796,170,743,808
