Comments (4)
see related globalbioticinteractions/nomer#90 .
from hmw.
with a first pass at Nomer's support for batnames (see globalbioticinteractions/nomer#91), you can now align hmw with batnames in less than 2 seconds:
$ time cat hmw.json | grep Chiroptera | jq --raw-output .name | sed 's/^/\t/g' | nomer append --include-header batnames | mlr --itsvlite --ocsv cat > hmw-batbase.csv
[main] INFO org.globalbioticinteractions.nomer.match.TermMatcherRegistry - using matcher [batnames]
real 0m1.595s
user 0m4.082s
sys 0m0.228s
See attached hmw-batnames.csv
hmw-batnames.csv
from hmw.
There appear to be 131 names in HMW that are not included in the batnames. Note however, that the current support for batnames does not include synonym matching.
$ cat hmw-batnames.tsv | grep NONE | cut -f2
yields
Nycteris madagascariensis
Carollia brevicaudum
Anoura aequatoris
Anoura peruana
Lophostoma silvicola
Tonatia saurophila
Leptonyctenis curasoae
Mucronycteris schmidtorum
Lonchorhina fernandez
Artibeus gnomus
Platyriunus aquilus
Platyrrhinus chocoensis
Artibeus toltecus
Artibeus phaeotis
Artibeus watsoni
Artibeus rosenbergi
Artibeus glaucus
Artibeus bogotensis
Artibeus aztecus
Artibeus ravus
Artibeus cinereus
Artibeus anderseni
Chiroderma vizottoi
Platyrrhainus brachycephalus
Chironax tumulus
Rousettus celebensis
Lissonycteris angolensis
Doryrhina semoni
Doryrhina muscinus
Doryrhina stenotis
Doryrhina wollastoni
Doryrhina edwardshilli
Doryrhina corynophyllus
Hipposideros pratti
Anthops omatus
Emballonura seni
Emballonura beccarli
Tadarida latouchet
Mops trevor
Chaerephon jobensis
Chaerephon nigeriae
Chaerephon major
Chaerephon tomensis
Chaerephon pumilus
Chaerephon russatus
Chaerephon pusillus
Chaerephon atsinanana
Chaerephon jobimena
Chaerephon bregullae
Chaerephon plicatus
Chaerephon johorensis
Chaerephon solomonis
Chaerephon bemmeleni
Chaerephon ansorgei
Chaerephon aloysiisabaudiae
Chaerephon gallagheri
Chaerephon chapini
Chaerephon bivittatus
Chaerephon leucogaster
Natalus lanatus
Chilonatalus tumaidifrons
Myotis browni
Myotis peninsularis
Myotis keenii
Myotis melanorhinus
Murina huttonii
Kerivoula malpasi
Kerivoula crypta
Plecotus christii
Rhogeessa gracilis
Rhogeessa alleni
Histiotus diaphanopterus
Histiotus humboldti
Histiotus velatus
Histiotus magellanicus
Histiotus laephotis
Histiotus alienus
Histiotus montanus
Histiotus macrotus
Glauconycteris poensts
Neoromicia helios
Neoromicia grandidieri
Neoromicia roseveari
Neoromicia isabella
Neoromicia rendalli
Neoromicia brunnea
Nycticeinops schlieffenii
Hypsugo bemainty
Hypsugo crassulus
Hypsugo anchieta
Neoromicia nanus
Neoromicia stanleyi
Neoromicia robertsi
Neoromicia matroka
Neoromicia capensis
Neoromicia malagasyensis
Hypsugo joffrei
Nyctophilus macrotis
Pipustrellus adamsi
Pipustrellus wattsi
Pipustrellus papuanus
Pipustrellus abramus
Puipustrellus raceyi
Pipustrellus aero
Pipustrellus rusticus
Pipustrellus hesperidus
Pipustrellus paterculus
Pipustrellus minahassae
Pipustrellus ceylonicus
Pipustrellus javanicus
Pipustrellus endoi
Pipustrellus sturdeei
Pipustrellus hanaki
Pipustrellus pipistrellus
Pipustrellus pygmaeus
Rhinolophus deckend
Rhinolophus alticolus
Rhinolophus gorongosae
Rhinolophus odami
Rhinolophus comutus
Rhinolophus achilles
Rhinolophus kahuzi
Rhinolophusarcuatus
Rhinolophus cognotus
Rhinolophus monticolus
Rhinolophus perniger
Miniopterus eschscholtzii
Miniopterus blepotis
Muniopterus mossambicus
Miniopterus arenarius
Genetta genetta
@ajacsherman are these results expected?
from hmw.
With this, you can also do alignments with other name lists, like @n8upham 's https://mammaldiversity.org@Nathan Upham (mammaldiversity.org) Please note you can now also make quick comparisons between MDD and batnames -
$ curl "https://raw.githubusercontent.com/mammaldiversity/mammaldiversity.github.io/master/_data/mdd.csv" | mlr --csv filter '$order == "CHIROPTERA"' | mlr --csv cut -f sciName | sed 's/_/ /g' | sed 's/^/\t/g' | nomer append batnames | grep NONE | head
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 5670k 100 5670k 0 0 17.8M 0 --:--:-- --:--:-- --:--:-- 17.8M
[main] INFO org.globalbioticinteractions.nomer.match.TermMatcherRegistry - using matcher [batnames]
sciName NONE sciName
Chironax tumulus NONE Chironax tumulus
Lissonycteris angolensis NONE Lissonycteris angolensis
Coelops hirsutus NONE Coelops hirsutus
Doryrhina corynophyllus NONE Doryrhina corynophyllus
Doryrhina edwardshilli NONE Doryrhina edwardshilli
Doryrhina muscinus NONE Doryrhina muscinus
Doryrhina semoni NONE Doryrhina semoni
Doryrhina stenotis NONE Doryrhina stenotis
Doryrhina wollastoni NONE Doryrhina wollastoni
61 names are defined in MDD that are not accepted in batnames.
according to
$ curl "https://raw.githubusercontent.com/mammaldiversity/mammaldiversity.github.io/master/_data/mdd.csv" | mlr --csv filter '$order == "CHIROPTERA"' | mlr --csv cut -f sciName | sed 's/_/ /g' | sed 's/^/\t/g' | tail -n+2 | nomer append batnames | grep NONE | wc -l
61
from hmw.
Related Issues (11)
- missing HMW species list HOT 17
- expected foodAndEating item for [Peropteryx pallidoptera] but found none HOT 6
- Eothenomys melanogaster / 03F06D13FFB3207908991339090DFEA8.xml does not contain "Status and Conservation" section HOT 4
- split hmw.csv into separate volumes for ease of processing HOT 4
- 3 non-family records with unexpected empty bibliography entries: Cuniculus paca, Lyroderma lyra, Aconaemys fuscus HOT 8
- 24 entries with missing information HOT 9
- create pre-populated feedback link in data HOT 1
- Spelling errors during Plazi extraction HOT 19
- expected _Eudiscoderma thongareeae_, _Macroderma gigas_ and _Rhinopoma macinnesi_ , but missing from the scans HOT 2
- create data publication for resources derived from plazi treatment-xml `hash://sha256/ec5fd314a06aba1a7b0b72f23e54ac625ae272bd98f82f1d01f4c09627d9e8e0`
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from hmw.