Converts peptide/protein identification engine file formats.

potential predecessor tools	$\longrightarrow$ IDFileConverter $\longrightarrow$	potential successor tools
TPP tools: PeptideProphet, ProteinProphet		TPP tools: ProteinProphet (for conversion from idXML to pepXML)
Sequest protein identification engine

IDFileConverter can be used to convert identification results from external tools/pipelines (like TPP, Sequest, Mascot, OMSSA, X! Tandem) into other (OpenMS-specific) formats. For search engine results, it might be advisable to use the respective TOPP Adapters (e.g. OMSSAAdapter) to avoid the extra conversion step.

The most simple format accepted is '.tsv': A tab separated text file, which contains one or more peptide sequences per line. Each line represents one spectrum, i.e. is stored as a PeptideIdentification with one or more PeptideHits. Lines starting with "#" are ignored by the parser.

Conversion from the TPP file formats pepXML and protXML to OpenMS' idXML is quite comprehensive, to the extent that the original data can be represented in the simpler idXML format.

In contrast, support for converting from idXML to pepXML is limited. The purpose here is simply to create pepXML files containing the relevant information for the use of ProteinProphet. We use the following heuristic: if peptideprophet_analyzed is set, we take the scores from the idXML as is and assume the PeptideHits contain all necessary information. If peptideprophet is not set, we only provide ProteinProphet-compatible results with probability-based scores (i.e. Percolator with PEP score or scores from IDPosteriorErrorProbability). All secondary or non-probability main scores will be written as "search_scores" only.

Support for conversion to/from mzIdentML (.mzid) is still experimental and may lose information.

The xquest.xml format is very specific to Protein-Protein Cross-Linking MS (XL-MS) applications and is only considered useful for compatibility of OpenPepXL / OpenPepXLLF with the xQuest / xProphet / xTract pipeline. It will only have useful output when converting from idXML or mzid containg XL-MS data.

Details on additional parameters:

mz_file:@n Some search engine output files (like pepXML, mascotXML, Sequest .out files) may not contain retention times, only scan numbers or spectrum IDs. To be able to look up the actual RT values, the raw file has to be provided using the parameter mz_file. (If the identification results should be used later to annotate feature maps or consensus maps, it is critical that they contain RT values. See also IDMapper.)

mz_name:@n pepXML files can contain results from multiple experiments. However, the idXML format does not support this. The mz_name parameter (or mz_file, if given) thus serves to define what parts to extract from the pepXML.

scan_regex:@n This advanced parameter defines a spectrum reference format via a Perl-style regular expression. The reference format connects search hits to the MS2 spectra that were searched, and may be needed to look up e.g. retention times in the raw data (mz_file). See the documentation of class SpectrumLookup for details on how to specify spectrum reference formats. Note that it is not necessary to look up any information in the raw data if that information can be extracted directly from the spectrum reference, in which case mz_file is not needed.
For Mascot results exported to (Mascot) XML, scan numbers that can be used to look up retention times (via mz_file) should be given in the "pep_scan_title" XML elements, but the format can vary. Some default formats are defined in the Mascot XML reader, but if those fail to extract the scan numbers, scan_regex can be used to overwrite the defaults.
For pepXML, supplying scan_regex may be necessary for files exported from Mascot, but only if the default reference formats (same as for Mascot XML) do not match. The spectrum references to which scan_regex is applied are read from the "spectrum" attribute of the "spectrum_query" elements.
For Percolator tab-delimited output, information is extracted from the "PSMId" column. By default, extraction of scan numbers and charge states is supported for MS-GF+ Percolator results (retention times and precursor m/z values can then be looked up in the raw data via mz_file).
Some information about the supported input types:

The command line parameters of this tool are:

IDFileConverter -- Converts identification engine file formats.
Full documentation: http://www.openms.de/documentation/TOPP_IDFileConverter.html
Version: 2.5.0-nightly-2020-03-06 Mar  7 2020, 01:22:16, Revision: 84b1398
To cite OpenMS:
  Rost HL, Sachsenberg T, Aiche S, Bielow C et al.. OpenMS: a flexible open-source software platform for mass spectrometry data analysis. Nat Meth. 2016; 13, 9: 741-748. doi:10.1038/nmeth.3959.

Usage:
  IDFileConverter <options>

Options (mandatory options marked with '*'):
  -in <path/file>*           Input file or directory containing the data to convert. This may be:
                             - a single file in a multi-purpose XML format (.pepXML, .protXML, .idXML, .mzid
                             ),
                             - a single file in a search engine-specific format (Mascot: .mascotXML, OMSSA:
                             .omssaXML, X! Tandem: .xml, Percolator: .psms, xQuest: .xquest.xml),
                             - a single text file (tab separated) with one line for all peptide sequences ma
                             tching a spectrum (top N hits),
                             - for Sequest results, a directory containing .out files.
                             (valid formats: 'pepXML', 'protXML', 'mascotXML', 'omssaXML', 'xml', 'psms', '
                             tsv', 'idXML', 'mzid', 'xquest.xml')
  -out <file>*               Output file (valid formats: 'idXML', 'mzid', 'pepXML', 'FASTA', 'xquest.xml')
  -out_type <type>           Output file type (default: determined from file extension) (valid: 'idXML', 'mzi
                             d', 'pepXML', 'FASTA', 'xquest.xml')
                             
  -mz_file <file>            [pepXML, Sequest, Mascot, X! Tandem, mzid, Percolator only] Retention times and 
                             native spectrum ids (spectrum_references) will be looked up in this file (valid
                             formats: 'mzML', 'mzXML', 'mzData')
                             
  -mz_name <file>            [pepXML only] Experiment filename/path (extension will be removed) to match in 
                             the pepXML file ('base_name' attribute). Only necessary if different from 'mz_fi
                             le'.
  -peptideprophet_analyzed   [pepXML output only] Write output in the format of a PeptideProphet analysis 
                             result. By default a 'raw' pepXML is produced that contains only search engine
                             results.
  -score_type <choice>       [Percolator only] Which of the Percolator scores to report as 'the' score for a 
                             peptide hit (default: 'qvalue' valid: 'qvalue', 'PEP', 'score')
                             
Common TOPP options:
  -ini <file>                Use the given TOPP INI file
  -threads <n>               Sets the number of threads allowed to be used by the TOPP tool (default: '1')
  -write_ini <file>          Writes the default configuration file
  --help                     Shows options
  --helphelp                 Shows all options (including advanced)

INI file documentation of this tool:

Legend:

required parameter

advanced parameter

+IDFileConverterConverts identification engine file formats.

version2.5.0-nightly-2020-03-06 Version of the tool that generated this parameters file.

++1Instance '1' section for 'IDFileConverter'

in Input file or directory containing the data to convert. This may be:
- a single file in a multi-purpose XML format (.pepXML, .protXML, .idXML, .mzid),
- a single file in a search engine-specific format (Mascot: .mascotXML, OMSSA: .omssaXML, X! Tandem: .xml, Percolator: .psms, xQuest: .xquest.xml),
- a single text file (tab separated) with one line for all peptide sequences matching a spectrum (top N hits),
- for Sequest results, a directory containing .out files.
input file*.pepXML,*.protXML,*.mascotXML,*.omssaXML,*.xml,*.psms,*.tsv,*.idXML,*.mzid,*.xquest.xml

out Output fileoutput file*.idXML,*.mzid,*.pepXML,*.FASTA,*.xquest.xml

out_type Output file type (default: determined from file extension)idXML,mzid,pepXML,FASTA,xquest.xml

mz_file [pepXML, Sequest, Mascot, X! Tandem, mzid, Percolator only] Retention times and native spectrum ids (spectrum_references) will be looked up in this fileinput file*.mzML,*.mzXML,*.mzData

mz_name [pepXML only] Experiment filename/path (extension will be removed) to match in the pepXML file ('base_name' attribute). Only necessary if different from 'mz_file'.

peptideprophet_analyzedfalse [pepXML output only] Write output in the format of a PeptideProphet analysis result. By default a 'raw' pepXML is produced that contains only search engine results.true,false

score_typeqvalue [Percolator only] Which of the Percolator scores to report as 'the' score for a peptide hitqvalue,PEP,score

ignore_proteins_per_peptidefalse [Sequest only] Workaround to deal with .out files that contain e.g. "+1" in references column,
but do not list extra references in subsequent lines (try -debug 3 or 4)true,false

scan_regex [Mascot, pepXML, Percolator only] Regular expression used to extract the scan number or retention time. See documentation for details.

no_spectra_data_overridefalse [+mz_file only] Setting this flag will avoid overriding 'spectra_data' in ProteinIdentifications if mz_file is given and 'spectrum_reference's are added/updated. Use only if you are sure it is absolutely the same mz_file as used for identification.true,false

no_spectra_references_overridefalse [+mz_file only] Setting this flag will avoid overriding 'spectrum_reference' in PeptideIdentifications if mz_file is given and a 'spectrum_reference' is already present.true,false

add_ionmatch_annotation0.0 [+mz_file only] Will annotate the contained identifications with their matches in the given mz_file. Will take quite some while. Match tolerance is .4

log Name of log file (created only when specified)

debug0 Sets the debug level

threads1 Sets the number of threads allowed to be used by the TOPP tool

no_progressfalse Disables progress logging to command linetrue,false

forcefalse Overwrite tool specific checks.true,false

testfalse Enables the test mode (needed for internal use only)true,false