# NAS Algorithms evaluated in [NATS-Bench](https://arxiv.org/abs/2009.00437)

The Python files in this folder are used to re-produce the results in ``NATS-Bench: Benchmarking NAS Algorithms for Architecture Topology and Size''.

- `[search-size.py](https://github.com/D-X-Y/AutoDL-Projects/blob/main/exps/NATS-algos/search-size.py)` contains codes for weight-sharing-based search on the size search space.
- `[search-cell.py](https://github.com/D-X-Y/AutoDL-Projects/blob/main/exps/NATS-algos/search-cell.py)` contains codes for weight-sharing-based search on the topology search space.
- `[bohb.py](https://github.com/D-X-Y/AutoDL-Projects/blob/main/exps/NATS-algos/bohb.py)` contains the BOHB algorithm for both size and topology search spaces.

## Citation

If you find that this project helps your research, please consider citing the related paper:
```
@article{dong2021nats,
  title   = {{NATS-Bench}: Benchmarking NAS Algorithms for Architecture Topology and Size},
  author  = {Dong, Xuanyi and Liu, Lu and Musial, Katarzyna and Gabrys, Bogdan},
  doi     = {10.1109/TPAMI.2021.3054824},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)},
  year    = {2021},
  note    = {\mbox{doi}:\url{10.1109/TPAMI.2021.3054824}}
}
```