sage wigeon
Suggest to list all available files (both .parquet and .csv) on the crypto data page, as well as making them available via CryptoAPI
https://crypto.numer.ai/data/v1.0
api = CryptoAPI()
api.list_datasets()
['crypto/v1.0/live_universe.parquet', 'crypto/v1.0/train_targets.parquet']
Live & Historical Crypto MM files not listed / available via CryptoAPI
violet token
Hi @sage wigeon - The files you've listed are the ones that we have for the crypto tournament right now. Could you please clarify exactly what files you're wanting/expecting? Thanks!
sage wigeon
These ones (in addition to the live and train targets). They are available via NumerAPI (specifying tournament 12) but not via CryptoAPI. They used to be available via CryptoAPI as well but not anymore for some reason.
'crypto/v1.0/historical_meta_models.csv',
'crypto/v1.0/historical_meta_models.parquet',
'crypto/v1.0/meta_model.csv',
'crypto/v1.0/meta_model.parquet',
From the docs.
violet token
Awesome thanks. Let me check on this and get back to you shortly.
violet token
We're going to add the meta model parquet files to the docs page, the csv files can be downloaded from: https://crypto.numer.ai/meta-model
As for the cryptoapi list_datasets function, when I run it, I get the following output:
['crypto/v1.0/historical_meta_models.csv', 'crypto/v1.0/historical_meta_models.parquet', 'crypto/v1.0/live_universe.parquet', 'crypto/v1.0/meta_model.csv', 'crypto/v1.0/meta_model.parquet', 'crypto/v1.0/train_targets.parquet']
Could you please re-run this and let me know if you're seeing the same thing? It's possible you ran this command when the files were being built and not available yet.
sage wigeon
Thank you! Looks like they are available using CryptoAPI as well now so all good. This is the notebook I was running. If you look at version 310 you can see that all the files weren't available before. https://www.kaggle.com/code/joebeachcapital/numerai-crypto-data-download
dry ether
We've added the meta model files to the crypto data page, so they should be viewable now.
sage wigeon
Thank you! However, I'm now back to only seeing these two files when running api.list_datasets() using CryptoAPI(). Maybe I'm doing something wrong?
It's a public notebook on Kaggle so you should be able to view/run it:
https://www.kaggle.com/code/joebeachcapital/numerai-crypto-data-download?scriptVersionId=253886356
sage wigeon
Also, the list_datasets method lists the files using the full path but when using the full path with the download datasets method it fails, and only works after removing the crypto/ prefix. Again, this is using CryptoAPI().
Available Crypto datasets:
Starting download of 2 Crypto datasets...
Downloading crypto/v1.0/live_universe.parquet...
Error downloading crypto/v1.0/live_universe.parquet: the requested file does not exist
Downloading crypto/v1.0/train_targets.parquet...
Error downloading crypto/v1.0/train_targets.parquet: the requested file does not exist
dry ether
Yeah meta model files for a given round only generate at the end of the round. To make it less confusing, we can update this logic to pull last rounds files if the round is still open.
sage wigeon
v2.0 missing live & historical MM preds.
mossy smelt
Yes, this was mentioned in the release
We don’t currently have meta_model files for v2.0 yet, but we will be starting to produce those before the cutoff date below.
sage wigeon
Got it, thank you!
winter elbow
meta_model file is currently missing?
dry ether
We don’t currently have meta_model files for v2.0 yet, but we will be starting to produce those before Nov 12
mossy smelt
We don’t currently have meta_model files for v2.0 yet, but we will be starting t...
v1.0 i missing from the image, not v2.0
analog saffron
yes please fix this, I need the meta model files
analog saffron
I accidentally deleted my historical meta model file (my script deletes it so that the new one can be downloaded it) and the file is missing so I don't have it 🙁
slim coral
same here ... whole pipeline stuck because some of my models rely on meta_model information ....
mossy smelt
same here ... whole pipeline stuck because some of my models rely on meta_model ...
I only caught it in time to re-run because of you thanks danzell
slim coral
Time to retire v1 I guess ...
mossy smelt
If Ark has his coffee soon maybe he will extend the round or re-open it. All my models failed because I download the file for the few that use it before kicking them all off. I was able to just skip the file and trigger them all manually except those that actually use the file.
mossy smelt
that PF 
slim coral
that PF <:rubbing_hands:1151952157596201101>
fingers crossed that it's a green round for you 🤞
smoky isle