include more trait datasets incl. Std version

[fdschneider]

the package should provide more datasets from the living spreadshet (fdschneider/bexis_traits#20).

• identify data for integration
• write script to extract data upon call of data() (files are placed in 'data/' directory)
• include documnetation in package files 'R/data.R'

A standardised version of each dataset should be provided as well (linking to trait Thesauri and taxon Ontologies).

[caterinap]

No super sure about including more datasets in the package itself (I don't know if there is an "ideal" size for a package). If we do, they should be small, I guess.
We can alternatively/also provide a tutorial with more examples on how to handle different trait datasets using the package (not only the CC.0 ones).

[fdschneider]

Ha! Trick is, we're not including the datasets, just provide code to pull the datasets from their source:

See files in data.R. Only when you call data(carabids) the file is downloaded and made available for use. The package remains small. The user decides what to download.

The package vignette contains plenty of advice on how to harmonize own data, or data from other sources.

[caterinap]

Then it's all good!! Sorry, I need to dive a bit more into the package!

[caterinap]

@fdschneider I started to add more datasets in https://github.com/caterinap/traitdataform/tree/master/data. See if it's fine, I can continue adding more later in the week.
Also added more entries in the spreadsheet and a new column indicating if the dataset is in the package.

[Rekyt]

Hi @fdschneider, you're initiative seems really cool! I hope to use it soon ;)

A lot of work has been done by people who built Eco Data Retriever (http://www.data-retriever.org/, Github Repo) you can see the available datasets here.

I'm also thinking about the trait package by rOpenScience. Maybe you could use some wrappers to those already built tools?

[fdschneider]

@Rekyt Thanks. Yes, I looked into those. We basically use the same idea as Retriever when pulling example datasets from the original sources on Figshare or wherever. The 'traits' package is great for tapping APIs of more extensive databases. There is also the package 'TR8'.

It would be cool to have wrappers for these data sources that add harmonization on top.

[caterinap]

Ok, now all CC.0 are in the package, on the same form as the "carabids" one. On windows I did not get errors when building the package (only warnings).

Some remarks:

• I did not modify yet 3 datasets: biotraits, plantsBROT and plantsD3 because they have CC BY 4.0 license. For the moment they are still there and we can decide to remove or modify them later.
• In the heteroptera_raw I did not change the coordinates into decimal because we do not import any package to do so (as far as I saw)

Have a look and let me know if you want to add/remove/change anything!

[fdschneider]

Great, thanks.

I will pull and test it.

I wasn't aware that some of those datasets have so many traits. Great job mapping them to the ontologies.
However, I just noticed that the URIs in Nadjas list are not correct. They should correspond to the URL with headings: e.g. https://ecologicaltraitdata.github.io/TraitDataList/#age_at_reproduction.
We should fix this in the TraitDataList repository, @nadjasimons.

Furthermore, I thought that some of the cryptic trait names might be replaced by more intuitive trait names.
E.g. if the thesaurus call states

X10.2_SocialGrpSize = traitdataform::as.trait("social_group_size", expectedUnit = NA,
valueType = "numeric"),

The function standardize() will keep the original name in traitName but replace it with the easier one in traitNameStd.

The CC BY 4.0 data could be added in the future in just the same way, since we always state the correct reference.

I think the Ricklefs data on passerine birds can't be included since it is not labelled as public domain or CC by. Sorry, that license statement in the documentation is my fault, I guess. I already removed it from the current version.

[caterinap]

ok, so I will:

• change the URIs once they are fixed
• modify cryptic trait names
• add the CC BY 4.0 datasets (when I have a bit of time)

Concerning the passerine, I actually checked before adding it and in the metadata (which is a word file in the supplementary) he states:

3. Copyright restrictions: None
4. Proprietary restrictions: None
5. Costs: None

So I guess that we could keep it.

[fdschneider]

Ok, thanks. No pressure. Whenever you find time.

The passerines: I'm relieved. After I was assured that the data are open by a colleaque, I was desperately looking for this disclaimer but didn't find it. Great 'bad example' for open data labelling.

[nadjasimons]

I fixed URIs in the trait data list