-
Notifications
You must be signed in to change notification settings - Fork 25
Ingest modeled parameters sanghi23 #655
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Ingest modeled parameters sanghi23 #655
Conversation
|
This looks like great progress! Before adding new parameters, please add a test for the modeled parameters that counts the number of parameters with model = Null. |
|
Also update with main. It shouldn't impact this PR since it's all photometry and proper motions. |
|
I just edited pytest cases where I added one for checking which had a null value for model and also how many of each parameter was ingested (added one for L bol). I added counters in my script and have the number in the comments next to it and the pytest case numbers make sense when I do the math |
|
Just pushed the new pytest file. I have the JSON files (a little over 1000) ready to push whenever |
tests/test_data_modeled_params.py
Outdated
| if len(t) > 0: | ||
| print("\nEntries found without a model") | ||
| print(t) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This if statement is not needed since we expect some parameters to not have models.
| if len(t) > 0: | |
| print("\nEntries found without a model") | |
| print(t) |
|
Awesome progress!
|
Did you want the pytest case to check references for each parameter or just in general? |
|
For each parameter. How many Lbols from Fili15? How many Lbols from Sang24? |
| # delimiter: ',' | ||
| # schema: astropy-2.0 | ||
| Skipped,Reason | ||
| veryred-1527,"no source found, atmo model" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is there really a source name called "veryred-1527"? @cosmicoder, any insight on what source this is?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hi Kelle, that is an old internal name that accidentally propagated through. The source is PSO J243.9421+67.2075. Let me know if there are any others. They should be updated in the latest version of the UltracoolSheet
|
|
just did! Not sure if the pytest case is the most efficient way because it seems a little long but. Also, the csv files did not have a ref column so I just put sang23 for all of them. |
|
Yep, this looks great. Once you ingest the one skipped source (PSO J243.9421+67.2075), go ahead and push the JSONs! |
This reverts commit 29b3ae5.
|
just pushed |
kelle
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think this is done. Great work!!!
|
Ohhhh, adding the adopted column! Let's go ahead and do that now since you're already modifying the schema.
|
kelle
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Let's tweak the schema a bit more and add the adopted column.
|
Also, take a look at the ModeledParameters ingest template spreadsheet. Let's make sure what you're doing here is reflected in that template. |
|
Looking at the ingest template, let's also add the |
|
Just did everything looks good I think |
kelle
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Amazing fast work! You're knocking it out of the park!
Short description: Include what type of data being ingested and appropriate references.
Link to relevant issue: Closes #518 and Closes #484 .
For data ingests:
[ ] includes script used for ingest
[ ] includes modified JSON files
[ ] Add new tests
[ ] Update the Versions table