@@ -109,7 +109,7 @@ Example output:
109109</figure >
110110</div >
111111
112- ## Orthogonal Transformation Learning
112+ ## Orthogonal Transformation Learning For R and B channels Swap
113113To study orthogonal transformations in feature space:
114114
1151151 . Generate dataset for ` google/siglip2-base-patch16-512 `
@@ -132,3 +132,52 @@ Example output:
132132 </div >
133133</figure >
134134</div >
135+
136+
137+ ## Linear Transformation Learning For B Channel Suppression
138+ To study linear transformations in feature space:
139+
140+ 1 . Generate dataset for ` google/siglip2-base-patch16-512 `
141+ 2 . Train reconstructor or use precomputed [ weights] ( https://drive.google.com/file/d/1i-B-5yBpSwcZL3_Z2Dz53jfxiY9T-fkb/view?usp=drive_link )
142+ 3 . Place weights at:
143+ ``` bash
144+ metrics_calculation/precalculated_weights/models--google--siglip2-base-patch16-512.pt
145+ ```
146+ 4 . Run the analysis notebook:
147+ ```
148+ metrics_calculation/b_channel_suppression/understanding_b_suppression.ipynb
149+ ```
150+
151+ Example output:
152+ <div align =" center " >
153+ <figure >
154+ <img src =" resources/b_suppression_all_transformations.png " width =" 600 " >
155+ <div >
156+ <figcaption>B Channel Suppression in Feature Space</figcaption>
157+ </div >
158+ </figure >
159+ </div >
160+
161+ ## Linear Transformation Learning For Colorization
162+ To study linear transformations in feature space:
163+
164+ 1 . Generate dataset for ` google/siglip2-base-patch16-512 `
165+ 2 . Train reconstructor or use precomputed [ weights] ( https://drive.google.com/file/d/1i-B-5yBpSwcZL3_Z2Dz53jfxiY9T-fkb/view?usp=drive_link )
166+ 3 . Place weights at:
167+ ``` bash
168+ metrics_calculation/precalculated_weights/models--google--siglip2-base-patch16-512.pt
169+ ```
170+ 4 . Run the analysis notebook:
171+ ```
172+ metrics_calculation/colorization/understanding_colorization.ipynb
173+ ```
174+
175+ Example output:
176+ <div align =" center " >
177+ <figure >
178+ <img src =" resources/colorized_all_examples.png " width =" 600 " >
179+ <div >
180+ <figcaption>Colorization in Feature Space</figcaption>
181+ </div >
182+ </figure >
183+ </div >
0 commit comments