Write Spectra Fault

[Will-Cooper]

Some issue noticed in the apache error_log:

[Wed Jan 29 06:05:02.832658 2025] [wsgi:error] [pid 16337:tid 140178324723456] [remote 192.168.98.61:47386]   File "/var/www/webroot/simple_app/app_simple.py", line 335, in create_spectra_files_for_download
[Wed Jan 29 06:05:02.832661 2025] [wsgi:error] [pid 16337:tid 140178324723456] [remote 192.168.98.61:47386]     results: pd.DataFrame = getattr(everything, 'spectra')
[Wed Jan 29 06:05:02.832663 2025] [wsgi:error] [pid 16337:tid 140178324723456] [remote 192.168.98.61:47386] AttributeError: 'Inventory' object has no attribute 'spectra'
[Wed Jan 29 06:05:03.797069 2025] [wsgi:error] [pid 16337:tid 140178307938048] [remote 192.168.98.61:47558] [2025-01-29 06:05:03,796] ERROR in app: Exception on /write_spectra [GET]
[Wed Jan 29 06:05:03.797096 2025] [wsgi:error] [pid 16337:tid 140178307938048] [remote 192.168.98.61:47558] Traceback (most recent call last):
[Wed Jan 29 06:05:03.797099 2025] [wsgi:error] [pid 16337:tid 140178307938048] [remote 192.168.98.61:47558]   File "/var/www/webroot/.local/lib/python3.9/site-packages/flask/app.py", line 1463, in wsgi_app
[Wed Jan 29 06:05:03.797103 2025] [wsgi:error] [pid 16337:tid 140178307938048] [remote 192.168.98.61:47558]     response = self.full_dispatch_request()
[Wed Jan 29 06:05:03.797105 2025] [wsgi:error] [pid 16337:tid 140178307938048] [remote 192.168.98.61:47558]   File "/var/www/webroot/.local/lib/python3.9/site-packages/flask/app.py", line 872, in full_dispatch_request
[Wed Jan 29 06:05:03.797108 2025] [wsgi:error] [pid 16337:tid 140178307938048] [remote 192.168.98.61:47558]     rv = self.handle_user_exception(e)
[Wed Jan 29 06:05:03.797111 2025] [wsgi:error] [pid 16337:tid 140178307938048] [remote 192.168.98.61:47558]   File "/opt/jelastic-python39/lib/python3.9/site-packages/flask_cors/extension.py", line 176, in wrapped_function
[Wed Jan 29 06:05:03.797113 2025] [wsgi:error] [pid 16337:tid 140178307938048] [remote 192.168.98.61:47558]     return cors_after_request(app.make_response(f(*args, **kwargs)))
[Wed Jan 29 06:05:03.797116 2025] [wsgi:error] [pid 16337:tid 140178307938048] [remote 192.168.98.61:47558]   File "/var/www/webroot/.local/lib/python3.9/site-packages/flask/app.py", line 870, in full_dispatch_request
[Wed Jan 29 06:05:03.797118 2025] [wsgi:error] [pid 16337:tid 140178307938048] [remote 192.168.98.61:47558]     rv = self.dispatch_request()
[Wed Jan 29 06:05:03.797121 2025] [wsgi:error] [pid 16337:tid 140178307938048] [remote 192.168.98.61:47558]   File "/var/www/webroot/.local/lib/python3.9/site-packages/flask/app.py", line 855, in dispatch_request
[Wed Jan 29 06:05:03.797123 2025] [wsgi:error] [pid 16337:tid 140178307938048] [remote 192.168.98.61:47558]     return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args)  # type: ignore[no-any-return]
[Wed Jan 29 06:05:03.797126 2025] [wsgi:error] [pid 16337:tid 140178307938048] [remote 192.168.98.61:47558]   File "/var/www/webroot/simple_app/app_simple.py", line 335, in create_spectra_files_for_download
[Wed Jan 29 06:05:03.797128 2025] [wsgi:error] [pid 16337:tid 140178307938048] [remote 192.168.98.61:47558]     results: pd.DataFrame = getattr(everything, 'spectra')
[Wed Jan 29 06:05:03.797131 2025] [wsgi:error] [pid 16337:tid 140178307938048] [remote 192.168.98.61:47558] AttributeError: 'Inventory' object has no attribute 'spectra'

[Will-Cooper]

Okay, this is something very weird with astrodbkit @dr-rodriguez, the following lines have an inconsistent return:

query = curdoc().template_variables['query']
db = SimpleDB(db_file)
resultdict: dict = db.inventory(query)

Sometimes and not even consistently, resultdict is empty. This occurs in all of the writing functions, anywhere db.inventory is involved. Like, you can repeatedly try the same prompt, and sometimes it will work, and sometimes it will fail due to resultdict being empty.

This is probably due to the way curdoc works with bokeh/tornado competing, and especially on the multithreaded website.

[kelle]

Trying to review the PR which addresses this but I can't find the error_log. Any pointers?

[Will-Cooper]

Trying to review the PR which addresses this but I can't find the error_log. Any pointers?

On reclaim it's under the full path /var/log/httpd/error_log (hover over the Application Servers bit and click the page icon, then under the httpd folder); but in a codespace it would just cause those error messages to appear in the terminal. It's hard to reproduce because it's pretty random and mostly affects how apache works with bokeh on the main site.