diff --git a/src/explanation/data-pipelines.md b/src/explanation/data-pipelines.md index 23eb26d5..e1301fd6 100644 --- a/src/explanation/data-pipelines.md +++ b/src/explanation/data-pipelines.md @@ -10,12 +10,12 @@ A **scientific data pipeline** extends beyond a database with computations. It i ## Pipeline Architecture -A DataJoint pipeline integrates three core components: +At the heart of every DataJoint pipeline is an **open-source core** of three components that handle schema, computation, and storage. The managed **DataJoint Platform** extends this core with services for AI access, data ingestion, exploration, security, collaboration, and visualization. -![DataJoint Platform Architecture](../images/dj-platform.png/) +![DataJoint Platform Architecture](../images/dj-platform.svg/) -| Component | Purpose | -|-----------|---------| +| Open-Source Core | Purpose | +|------------------|---------| | **Code Repository** | Version-controlled pipeline definitions, `make` methods, configuration | | **Relational Database** | System of record for metadata, relationships, and integrity enforcement | | **Object Store** | Scalable storage for large scientific data (images, recordings, signals) | diff --git a/src/images/dj-platform.png b/src/images/dj-platform.png deleted file mode 100644 index b979013a..00000000 Binary files a/src/images/dj-platform.png and /dev/null differ diff --git a/src/images/dj-platform.svg b/src/images/dj-platform.svg new file mode 100644 index 00000000..773bdbc5 --- /dev/null +++ b/src/images/dj-platform.svg @@ -0,0 +1,159 @@ + + + + + + + + + + + + + + DataJoint Platform + + + + + + + + + + + AI Interface + + + + + + + + + + + + + + Pipeline + Explorer + + + + + + + + + Data Ingest + + Integration + + + + + + + + Security + Infra + + Compute + + + + + Open-Source Core + schema + workflow + + + + + + + + Relational + Database + + + + + </> + Code + Repo + + + + + + + + Object + Store + + + + + + + + + + + + + + Electronic + Lab Notebook + + + + + + + + + + Integrated Dev + Environment + + + + + + + + + + Visualization + Dashboard + + + + + + + + + + + + Collaboration + + Publishing + + + + + Reproducibility • Provenance • Integrity • Collaboration + + + The language for automated, reproducible research workflows +