Opened 3 years ago

Closed 3 years ago

Last modified 18 months ago

#508 closed enhancement (fixed)

Support loading of a wider variety of data files

Reported by: smk78 Owned by: krzywon
Priority: major Milestone: SasView 4.1.0
Component: SasView Keywords:
Cc: Work Package: SasView Framework Enhancements

Description (last modified by ajj)

Related to ticket #500

There are a number of commonly-produced reduced data formats that the SasView? loader does not currently support and which would significantly expand the SasView? user base if it did:

Single-file 1D Formats

  • files of the type exemplified by the ASCII output from DNDCAT (APS)
  • files of the type exemplified by the SAXSess PDH ASCII format (ticket #500)
  • (also check if the SESANS format is in the loader?)

Multiple-file 1D formats

  • files of the type used by FIT2D (ESRF): separate ASCII Q and I files (ticket #183)
  • the historic but still-used BSL/OTOKO format (Diamond): separate ASCII header + ½/3 binary files

Single-file 2D formats

  • the ISIS 2D ASCII format

Multiple-file 2D formats

  • the BerSANS 2D ASCII format (HZB/KWS)

We should up the priority for supporting these.

Attachments (18)

DNDCAT_format.txt (43.0 KB) - added by smk78 3 years ago.
DNDCAT format data file
SAXSess-PDH_format.txt (34.5 KB) - added by smk78 3 years ago.
SAXSess format data file
Anton-Paar_PDH_file_format.pdf (183.1 KB) - added by smk78 3 years ago.
Description of SAXSess format
FIT2D_format-Q.txt (7.2 KB) - added by smk78 3 years ago.
FIT2D format data file (Q)
FIT2D_format_I.txt (7.2 KB) - added by smk78 3 years ago.
FIT2D format data file (I)
OTOKO_I32000.QAX (258 bytes) - added by smk78 3 years ago.
OTOKO/BSL format data file (Q header)
OTOKO_I32001.QAX (2.9 KB) - added by smk78 3 years ago.
OTOKO/BSL format data file (Q data)
OTOKO_I32000.L1D (352 bytes) - added by smk78 3 years ago.
OTOKO/BSL format data file (I header)
OTOKO_I32001.L1D (2.9 KB) - added by smk78 3 years ago.
OTOKO/BSL format data file (I data)
OTOKO_I32002.L1D (2.9 KB) - added by smk78 3 years ago.
OTOKO/BSL format data file (calibration data)
ISIS_2D_format.txt (242.6 KB) - added by smk78 3 years ago.
ISIS 2D format data file
ISIS_2D_format_Fortran.TXT (18.1 KB) - added by smk78 3 years ago.
Fortran source for r/w ISIS 2D data file formats
KWS_2D_format-Q.txt (240.1 KB) - added by smk78 3 years ago.
KWS 2D data file format (Q data)
KWS_2D_format-I.txt (240.1 KB) - added by smk78 3 years ago.
KWS 2D data file format (I data)
KWS_2D_format-dI.txt (240.1 KB) - added by smk78 3 years ago.
KWS 2D data file format (dI data)
BerSANS_2D_format.txt (328.4 KB) - added by smk78 3 years ago.
BerSANS 2D data file format
load_otoko.py (5.9 KB) - added by smk78 3 years ago.
Peter Parkers Python routine for loading OTOKO format data files
load_otoko_test.py (304 bytes) - added by smk78 3 years ago.
Peter Parkers Python program for testing loading of OTOKO format data files

Download all attachments as: .zip

Change History (25)

Changed 3 years ago by smk78

DNDCAT format data file

Changed 3 years ago by smk78

SAXSess format data file

Changed 3 years ago by smk78

Description of SAXSess format

Changed 3 years ago by smk78

FIT2D format data file (Q)

Changed 3 years ago by smk78

FIT2D format data file (I)

Changed 3 years ago by smk78

OTOKO/BSL format data file (Q header)

Changed 3 years ago by smk78

OTOKO/BSL format data file (Q data)

Changed 3 years ago by smk78

OTOKO/BSL format data file (I header)

Changed 3 years ago by smk78

OTOKO/BSL format data file (I data)

Changed 3 years ago by smk78

OTOKO/BSL format data file (calibration data)

Changed 3 years ago by smk78

ISIS 2D format data file

Changed 3 years ago by smk78

Fortran source for r/w ISIS 2D data file formats

Changed 3 years ago by smk78

KWS 2D data file format (Q data)

Changed 3 years ago by smk78

KWS 2D data file format (I data)

Changed 3 years ago by smk78

KWS 2D data file format (dI data)

Changed 3 years ago by smk78

BerSANS 2D data file format

Changed 3 years ago by smk78

Peter Parkers Python routine for loading OTOKO format data files

Changed 3 years ago by smk78

Peter Parkers Python program for testing loading of OTOKO format data files

comment:1 Changed 3 years ago by krzywon

  • Owner set to krzywon
  • Status changed from new to assigned

comment:2 Changed 3 years ago by smk78

SK can supply more information about the OTOKO/BSL format, and the ISIS 2D format. MG was having a look at the KWS format for Ralf in April 2015.

But in terms of priority, I would say:

  • 1st: the FIT2D format (this type of format is remarkably common in the SAXS community)
  • 2nd: the ISIS 2D format (it is the only other 2D format written by Mantid)
  • 3rd: the SAXSess format (as it should be easy to code & would give us some cudos with A-P)
  • 4th: the OTOKO format (would give us traction with Diamond, but is more effort to implement)
  • 5th: the remaining formats

NB: the OTOKO format can handle single or multi-frame data. Because the latter can be huge (SK can provide an example - the attached OTOKO file is single frame) we might want to think about reading the number of frames from the header, and only loading that frame.

comment:3 Changed 3 years ago by ajj

  • Description modified (diff)

comment:4 Changed 3 years ago by butler

  • Milestone changed from SasView 4.0.0 to SasView Next Release +1
  • Priority changed from critical to major

comment:5 Changed 3 years ago by smk78

Of these formats:

  • files of the type exemplified by the ASCII output from DNDCAT (APS) are now supported by the ASCII loader in SasView 4.1 onwards (also see #183)
  • files of the type exemplified by the SAXSess PDH ASCII format are now supported by the ASCII loader in SasView 4.0 onwards (also see #500)
  • the SESANS format is now supported in the ASCII loader from SasView 4.1
  • files of the type used by FIT2D (ESRF) with separate ASCII Q and I files are now supported by the File Converter in SasView 4.1 onwards (also see #183)
  • files in the historic but still-used BSL/OTOKO format (Diamond) with separate ASCII header + ½/3 binary files are now supported by the File Converter in SasView 4.1 onwards
  • the ISIS 2D ASCII format is now superceded by the NXcanSAS format supported in Mantid and SasView 4.0 onwards
  • the BerSANS multiple file 2D ASCII format (HZB/KWS) remains unsupported (requirement moved into #729)

comment:6 Changed 3 years ago by smk78

  • Resolution set to fixed
  • Status changed from assigned to closed

comment:7 Changed 18 months ago by butler

  • Milestone changed from SasView Next Release +1 to SasView 4.1.0
Note: See TracTickets for help on using tickets.