# Fileset [presentation-doceng-2019_reviewed.pdf](https://mdr.nims.go.jp/filesets/87c33bfa-98f7-4ab9-85bc-0c82d6128705/download) ## Creator [TANIFUJI, Mikiko](https://orcid.org/0000-0001-5284-6364), [FOPPIANO, Luca](https://orcid.org/0000-0002-6114-6164), [ISHII, Masashi](https://orcid.org/0000-0003-0357-2832), ROMARY, Laurent ## Rights ## Other metadata [Automatic Identification and Normalisation of Physical Measurements in Scientific Literature](https://mdr.nims.go.jp/datasets/d1fec39d-b106-4776-94c4-5f26e13e4474) ## Fulltext presentation-doceng-2019_reviewedAutomatic Identification and Normalisation of Physical Measurements in Scientific LiteratureLuca Foppiano1, Laurent Romary2, Masashi Ishii1 and Mikiko Tanifuji1 1Material Data and Integrated System (MaDIS), National Institute for Materials Science (NIMS), Japan 2Inria, team ALMAnaCH, France 1Content — Background and motivation — System overview — Sytem architecture — Evaluation — Conclusions 2Background Text and Data Mining is a growing discipline Collection of high quality data: — availability of large quantities of data — cheaper (and faster) than manual process Many other applications: — information retrieval — tagging and categorization — summarization 3Example: Material Informatics Automatic construction of superconductor database [1] using scientific articles describing experiments and results. 4Superconductors databasearticleSystemMaterial, class, shape, doping ratePhysical quantitiesCeOBiS2 -> Tc = 3.2K at 1.62GPa EuFBiS2 -> Tc = 2.1K at 0.7GPa …[1] L. Foppiano, T. M. Dieb, A. Suzuki, & M. Ishii (2019). Proposal for Automatic Extraction Framework of Superconductors Related Information from Scientific Literature. In Proposal for Automatic Extraction Framework of Superconductors Related Information from Scientific Literature (pp. 1-5). 信学技報, vol. 119, no. 66, SC2019-1 (no.66). Grobid-quantities — Grobid-quantities is an open-source system for automatic extraction and normalisation of physical quantities — Based on Grobid (Generation of Bibliographic data), a library for extracting and structuring text from PDFs of scientific literature — Developed in collaboration with Patrice Lopez (author of the Grobid library) — Tools and data are available on github http://github.com/kermitt2/grobid-quantities — Native support to PDF extraction and coordinates — Data processing via REST or local batch — Measurement normalisation is implemented using Unit of Measurement Java library (https://unitsofmeasurement.github.io/) Standard JSR-385 5http://github.com/kermitt2/grobid-quantitieshttp://github.com/kermitt2/grobid-quantitieshttp://github.com/kermitt2/grobid-quantitieshttp://github.com/kermitt2/grobid-quantitieshttps://unitsofmeasurement.github.io/Data in real life 6averaged weekly training programs included two running, two muscle strengthening, and four to six windsurfing sessions. The study was approved by the University ethics committee.Light wind (LW) and medium wind (MW) were defined as wind speeds ranging from 5 to 9 knots (2.57-4.63 mAEs )1 ), and 10 to 16 knots (5.14-8.23 mAEs )1 ), respectively. Some example how data looks like when is extracted from PDFs: Grobid-quantities and ML Machine Learning can assist to reduce the effect of noisy data Grobid-quantities uses Conditional Random Field (CRF) algorithm Machine Learning cascade architecture: — Maximise the efficiency/Minimise the effort of each component — Errors are propagated and (!!) amplified 7Cascade architecture 8Input […] we applied 50 µg/ml streptomycin, […]Quantities identification Identified quantitiesValue / Units sub-modelsResults sub-modelsNormalisationbaseUnit(g) = kgbaseUnit(L) = m3kg = 10-9 µgm3 = 106 mL50·10-9·106 kg·m3Result 0.05 kg·m3Quantities modelwe applied 50 µg/ml streptomycin […] […]Values model Units model50, NUMERIC µg·ml-1Quantities model Extract quantities as combination unit and values Works at token/word level Supports different type of quantities: atomic value, interval min/max, interval base+range, lists 9Units model Segmentation of Units works at character level Model based on product of triples (from the SI): prefix, pow and base. 10µg /ml.[(prefix, base, pow), (…)]Raw unit Tokenisation Labelling[(µ, g, 1), (m, l, 1)]µ g 1 / m l 1 .prefixprefixbasebasepowpowpowotherInvalid characterValues model Character level model 11Parsed valueRaw value Tokenisation LabellingParsing/Lookupfifteen50f i f t e e nf i f t e e n lookup(fifteen)2.5 1052500002 . 5 1 0 52 . 5 1 0 5 parse(fifteen)Features — General features: capital, digits, punctuation, etc.. — Unit Lexicon (standard notations, type, system, inflections, lemmas) — Typographical information (superscript, subscript, fonts, etc.) are ignored 12Evaluation experiment — Training and evaluation was done using 32 PDFs Open Access articles selected in domain of medicine, robotics, astronomy, and physiology (available on grobid-quantities github repository) and manually corrected. — Evaluation metrics (precision, recall and f1-score) were calculated using 10-fold cross-validation 13Evaluation evaluation results Promising results with CRF considering the small training corpus Unit evaluation is biased due to the nature of the data Evaluation with an independent evaluation corpus [1] resulted in 81% F1-Score. 14[1] Foppiano, L. & Suzuki, A. & Dieb, T. & Ishii, M. & Tanifuji, M. (2019). Leveraging Segmentation of Physical Units through a Newly Open Source Corpus. Demo 15Conclusions We presented an open-source application for extracting and normalizing physical quantities with promising results This application is engineered to support the processing of large quantities of data Currently used in a project for extraction of superconductors material related properties Future plans: — increase the amount of training data (!) — exploit typographical/layout information such as superscript/subscript/font — add more contextualized information (e.g. article domain) to solve units ambiguities 16Thank you 17