a b/reproducibility/README.md 

  1
  
## Config Env File





  
  

  2
  





  
  

  3
  
```





  
  

  4
  
PC_CACHE_FOLDER: is the folder in which cached embeddings are saved





  
  

  5
  
PC_RESULTS_FOLDER: is the folder in which results are going to be saved





  
  

  6
  
PC_EVALUATION_DATA_ROOT_FOLDER: this folder should point to the folder in which there are the evaluation dataset





  
  

  7
  
PC_DEFAULT_BACKBONE: this should point at the backbone to use as default for PLIP





  
  

  8
  
PC_CLIP_ARCH: this is the architecture for PLIP and BLIP (e.g., "ViT-B/32")





  
  

  9
  
```





  
  

  10
  





  
  

  11
  
## Evaluation Scripts





  
  

  12
  





  
  

  13
  
All evaluation scripts are found in `path_eval/scripts`. They use the abstractions found in `path_eval/evaluation`





  
  

  14
  





  
  

  15
  
## Dataset Details





  
  

  16
  





  
  

  17
  
### Data Location (For internal use only)





  
  

  18
  





  
  

  19
  
Classification Task





  
  

  20
  
`/v2/evaluation_datasets/classification`





  
  

  21
  





  
  

  22
  
Retrieval Task





  
  

  23
  
`/v2/evaluation_datasets/image_retrieval`





  
  

  24
  





  
  

  25
  





  
  

  26
  
### Setup Images





  
  

  27
  





  
  

  28
  
Data has been generated by splitting using:





  
  

  29
  
`seed=1_trainratio=0.70_size=224`