# Leveraging Segmentation of Physical Units through a Newly Open Source Corpus

https://mdr.nims.go.jp/datasets/a8459ee7-63bd-4722-8e30-7995d520ad00

## File

- [presentation-jsap-2019.pdf](https://mdr.nims.go.jp/filesets/bda8619b-ea33-4328-b0bb-9b023b473a73/download) ([Detail](https://mdr.nims.go.jp/filesets/bda8619b-ea33-4328-b0bb-9b023b473a73.md))

## Id

a8459ee7-63bd-4722-8e30-7995d520ad00

## Local identifier



## Visibility

open_to_public

## State

published

## Created at

2021-08-05T16:20:12.459510Z

## Updated at

2022-10-02T16:53:43.477063Z

## Published at

2021-08-12T16:20:03.074433Z

## Doi

https://doi.org/10.34968/nims.1360

## First published url



## Date published

2019-10-18

## Recorded date published

18/10/2019

## Resource type

journal_article

## Manuscript type

authors_original

## Collection



## Title

- title: Leveraging Segmentation of Physical Units through a Newly Open Source Corpus
  title_type: original
  lang: en

## Description

- description: 'The identification of physical measurements is a recurrent task in
    material informatics (MI). Quantities and units are contained in unstructured
    text with ad-hoc conventions to convey their meaning: it is common to encounter
    new variations of existing units or new complex composed units which are not present
    in any unit dictionaries. By consequence, string matching and dictionary lookup
    are failing or generating false positive when the unit complexity grows. A generic
    unit segmentation system is therefore necessary. In this submission, we present
    our approach to unit representation that can be used to design generic unit normalisation
    systems. We introduce the public availability of a corpus of segmented physical
    units. This dataset, comprising about 2000 entries in XML format, can be used
    to train or evaluate sequence labelling models for unit segmentation. Through
    this contribution, we provide an Open Source (CC-BY licensed) corpus for segmenting
    physical units, a resource that can be used to evaluate and compare physical measurement
    segmentation systems.'
  description_type: abstract
  lang: en

## Creator

- name: ISHII, Masashi
  role: author
  orcid: https://orcid.org/0000-0003-0357-2832
- name: TANIFUJI, Mikiko
  role: author
  orcid: https://orcid.org/0000-0001-5284-6364
- name: FOPPIANO, Luca
  role: author
  orcid: https://orcid.org/0000-0002-6114-6164
- name: DIEB M. Thear
  role: author
  orcid: https://orcid.org/0000-0002-8111-2009
- name: SUZUKI, Akira
  role: author
  orcid: https://orcid.org/0000-0002-8167-0414

## Contact agent



## Publisher

organization: JSAP

## Managing organization



## Keyword

- subject: segmentation
  schema: not_defined
- subject: quantities
  schema: not_defined
- subject: measurements
  schema: not_defined
- subject: physical quantities
  schema: not_defined

## Rights

- description: Creative Commons BY Attribution 4.0 International
  identifier: https://creativecommons.org/licenses/by/4.0/

## Other identifier(s)



## Data origin



## Embargo



## Journal



## Conference



## Related item



## Funding



## Instrument



## Instrument operator



## Instrument managing organization



## Measurement method



## Specimen



## Chemical composition



## Structure for specimen



## Structural feature for specimen



## Specific property for specimen



## Process for specimen treatment



## Computational method



## Energy level/transition state



## Software



## Custom property



## Fileset

- id: bda8619b-ea33-4328-b0bb-9b023b473a73
  filename: presentation-jsap-2019.pdf
  content_type: application/pdf
  size: 1253543
  md5: 7f45e57a73886eca04526d611484494b

## Thumbnail

fileset_id: bda8619b-ea33-4328-b0bb-9b023b473a73
filename: presentation-jsap-2019.pdf