Skip to content

Aird format Conversion Client for Verdor File Conversion

License

Notifications You must be signed in to change notification settings

CSi-Studio/AirdPro

Repository files navigation

AirdPro V5 is now available at 2023.7

AirdPro V6 is now available at 2024.4

AirdPro

AirdPro is a GUI client for conversion from vendor files to Aird files. AirdPro is written in C# and is based on pwiz_bindings_cli.dll from the ProteoWizard project. AirdPro is opensource under the MulanPSL2 license

Version Description

V6.0.0

  • [New Feature] New Conversion List Viewer
  • [New Feature] 20% higher compression rate for ion mobility raw files
  • [New Feature] New distributed system by deploying multiple AirdPro nodes for multiple task conversion
  • [Stability improvement] Update to the latest tripartite dependency library
  • [Stability improvement] Resolves memory overflow issues during large-scale conversions

V5.1.0

  • [New Feature] New File Selection UI
  • [New Feature] Supporting MRM acquisition method
  • [New Feature] Supporting Wiff2 format

V4.4.X

  • [New Feature] Automatic identification for Acquisition methods
  • [New Feature] Batch Conversion: Scan the directory structure and convert automatically
  • [New Feature] Aird-Slice, Search-oriented MS data format, search speed increased 50–500 times for single m/z
  • [New Feature] New Acquisition Method Support: MRM/SRM

V4.0.X

  • [New Feature] XIC, Spectrum View for Aird
  • [New Feature] Remote Repository Async Tool for ProteomeXchange and MetaboLights
  • [New Feature] Support for mzML and mzXML conversion
  • [New Feature] Auto Acquisition Method Detect
  • [New Feature] Auto Client Update Checking for AirdPro

V3.0.0

  • [New Feature] New Compressor Strategy: Combinable Compressors for m/z, intensity and mobility
  • [New Feature] Integer-Purpose Compressors: Variable Byte, Binary Packing
  • [New Feature] General-Purpose Compressors: Brotli, Snappy, Zstd, and Zlib
  • [New Feature] Dynamic-Decider for Best ComboComp
  • [New Feature] New GUI for Version 3.0
  • [New Feature] New Conversion Config Panel
  • [New Feature] New Software Config Panel

V2.1.0

  • [New Feature] A new compression algorithm ZDVB is released, which has 10%-20% compression performance improvement compared with ZDPD kernel.Furthermore, ZDVB provides faster decoding speed than ZDPD.
  • [New Feature] PASEF mode support for both DDA and DIA

V2.0.0

  • [New Feature] New compression algorithm Stack-ZDPD is released, which has 5%-20% compression performance improvement compared with ZDPD kernel
  • [New Feature] PSI CV supoort as an option function
  • [Function Optimization] Output path of each conversion task is shown on the main list
  • [Stability improvement] Automatic retrial function for unknown conversion exception

V1.1.0

  • [New Feature] Distributed batch conversion function based on Redis
  • [New Feature] Custom Path UI for folder format vendor file like Agilent .d folder format

V1.0.0

  • Supporting SWATH/DIA Format
  • Supporting DDA Format
  • Supporting PRM Format
  • Supporting COMMON Format

What does Aird format like?

Aird Index File Suffix: .json
Aird Data File Suffix: .aird
Aird Index File and Aird Data File show be stored in the same directory with the same file name but with different suffix, so that AirdScanUtil.class can scan both of the two files with the same file name;
When dealing with Spectra, we advise that you should process with SWATH Window one by one so that we can control the Memory

Aird SDK

You can read the data using AirdSDK for secondary development. Visit AirdSDK project for more detail: https://github.com/CSi-Studio/Aird-SDK AirdSDK supports for Java, C#, Python

Papers related to Aird

Key papers:
Aird: a computation‑oriented mass spectrometry data format enables a higher compression ratio and less decoding time Aird, 2022
Here we first introduced "Aird", an opensource and computation-oriented format with controllable precision, flexible indexing strategies, and high compression rate. A novel combinable compressor, called Zlib-Diff-PforDelta(ZDPD), was included in this paper for m/z data compression, resulting a smaller compression file size and a faster decoding speed than these of using Zlib merely. Therefore, Aird is defined as a computing-oriented data format with high scalability, compression rate, and fast decoding speed.

StackZDPD: a novel encoding scheme for mass spectrometry data optimized for speed and compression ratio StackZDPD, 2022
On the basis of ZDPD from Aird, we further developed a novel encoding strategy, named Stack-ZDPD, for multiple m/z arrays compression. The m/z arrays from more than one spectrum are integrated together for compression as a whole, where each m/z value is containing a tag for remapping it to the corresponding spectrum. This approach is able to show higher compression rate than ZDPD by about 30% in Time of Flight-generated (TOF) data.

Column storage enables edge computation of biological big data on 5G networks Aird-Slice, 2023 Here we propose a column storage scheme for MS data, which greatly improves the calculation process based on XIC.

How Much Storage Precision Can Be Lost: Guidance for Near-Lossless Compression of Untargeted Metabolomics Mass Spectrometry Data Precision Control, 2024 We provide a comprehensive analysis of the correlation between precision values of mass-charge ratio and strength values, and their impact on the final identification results. Additionally, we propose a scientifically grounded recommendation for precision truncation, which has been successfully implemented in AirdPro as an optimal approach.

Batch Conversion Task with Redis

After install the Redis Server. You should input your custom Redis Server IP and Port in the Message Center InputBox and Click Connect button to see if the AirdPro has connnected to the Redis Server. In the AirdPro. We have already input a IP:Port string "192.168.31.88:6379" as an demo sample The Redis Channel is Database0, The redis key is "ConvertTask", the value should be a Set data structure of a specific json model called "ConvertJob". The detail of the "ConvertJob" object is described here:

String sourcePath    //the vendor file path, like  C:\vendor\test.raw
String targetPath    //the target output directory path, like D:\output
Double mzPrecision = 0.0001  //the needed precision, the default value is 0.0001
String type="DDA"    //the acquisition method of the vendor file. The value can be "DIA_SWATH", "DDA", "PRM", "COMMON"

Here is a Java demo code StringRedisTemplate stringRedisTemplate = new StringRedisTemplate(); //this is from spring-redis ConvertJob job = new ConvertJob(); job.sourcePath = "C:\vendor\test_for_swath.raw"; job.targetPath = "D:\output"; job.type="DIA_SWATH"; job.precision=0.0001; String jobJson = JSON.toJSONString(job); stringRedisTemplate.opsForSet().add("ConvertTask", jobJson);

Software Description

AirdPro is a software tool used for convert files from vendor format to Aird format. By using library from ProteoWizard MSConvert. AirdPro can convert all the vendor format that MSConvert supports to Aird format. You can download the AirdPro under the root package. After downloading the AirdPro zip package. Unzip the package file. Double-click the AirdPro.exe to run the software. Make sure that your operating system is Windows 7 or above with the .NET framework 4.7.2