Skip to content

Commit

Permalink
Anonymization : NOT FOR MERGE
Browse files Browse the repository at this point in the history
  • Loading branch information
eatpk committed May 15, 2024
1 parent 8021ad2 commit 73d9a14
Show file tree
Hide file tree
Showing 14 changed files with 23 additions and 187 deletions.
77 changes: 0 additions & 77 deletions CODE_OF_CONDUCT.md

This file was deleted.

75 changes: 0 additions & 75 deletions CONTRIBUTING.md

This file was deleted.

16 changes: 2 additions & 14 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,9 +1,3 @@
<p align="center">
<a href="https://github.com/sangkeun00/logix/">
<img src="assets/logo_light.png" alt="" width="40%" align="top" style="border-radius: 10px; padding-left: 120px; padding-right: 120px; background-color: white;">
</a>
</p>

<p align="center">
<em><strong>LogIX</strong>: Logging for Interpretable and Explainable AI <br></em>
</p>
Expand Down Expand Up @@ -131,19 +125,13 @@ billion-scale models. Below are a few features that LogIX currently supports:
## Contributing

We welcome contributions from the community. Please see our [contributing
guidelines](CONTRIBUTING.md) for details on how to contribute to LogIX.
guidelines(Deleted for Anonymization)](CONTRIBUTING.md) for details on how to contribute to LogIX.

## Citation
To cite this repository:

```
@software{logix2024github,
author = {Sang Keun Choe, Hwijeen Ahn, Juhan Bae, Minsoo Kang, Youngseog Chung, Kewen Zhao},
title = {{LogIX}: Scalable Logging and Analysis Tool for Neural Networks},
url = {http://github.com/sangkeun00/logix},
version = {0.0.1},
year = {2024},
}
@ deleted for anonymiztion
```

## License
Expand Down
Binary file removed assets/logo.png
Binary file not shown.
Binary file removed assets/logo_light.jpg
Binary file not shown.
Binary file removed assets/logo_light.png
Binary file not shown.
4 changes: 2 additions & 2 deletions examples/language_modeling/compute_influence.py
Original file line number Diff line number Diff line change
Expand Up @@ -23,12 +23,12 @@ def main():
parser.add_argument(
"--cache_dir",
type=str,
default="/data/tir/projects/tir3/users/sangkeuc/huggingface",
default="./huggingface",
)
parser.add_argument(
"--save_dir",
type=str,
default="/data/tir/projects/tir3/users/sangkeuc/gpt/results",
default="./gpt/results",
)
parser.add_argument("--model_name", type=str, default="gpt2-xl")
parser.add_argument("--data_path", type=str, default="wikitext")
Expand Down
2 changes: 1 addition & 1 deletion examples/language_modeling/extract_log.py
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,7 @@ def main():
parser.add_argument(
"--cache_dir",
type=str,
default="/data/tir/projects/tir3/users/sangkeuc/huggingface",
default="./huggingface",
)
parser.add_argument("--model_name", type=str, default="gpt2")
parser.add_argument("--data_path", type=str, default="wikitext")
Expand Down
6 changes: 3 additions & 3 deletions examples/language_modeling/scripts/alpaca.sh
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
#!/usr/bin/bash
#SBATCH --job-name=pythia
#SBATCH --output /home/sangkeuc/logs/\%j.out
#SBATCH --err /home/sangkeuc/logs/\%j.err
#SBATCH --output ./logs/\%j.out
#SBATCH --err ./logs/\%j.err
#SBATCH --nodes=1
#SBATCH --gres=gpu:A100_80GB:2
#SBATCH --mem=160GB
#SBATCH --time 24:00:00
#SBATCH --mail-user=[email protected]
#SBATCH --mail-user=//delete
#SBATCH --mail-type=START,END,FAIL
#SBATCH --partition=general

Expand Down
6 changes: 3 additions & 3 deletions examples/language_modeling/scripts/llama.sh
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
#!/usr/bin/bash
#SBATCH --job-name=pythia
#SBATCH --output /home/sangkeuc/logs/\%j.out
#SBATCH --err /home/sangkeuc/logs/\%j.err
#SBATCH --output ./logs/\%j.out
#SBATCH --err ./logs/\%j.err
#SBATCH --nodes=1
#SBATCH --gres=gpu:A100_80GB:2
#SBATCH --mem=160GB
#SBATCH --time 24:00:00
#SBATCH --mail-user=[email protected]
#SBATCH --mail-user=//delete
#SBATCH --mail-type=START,END,FAIL
#SBATCH --partition=general

Expand Down
6 changes: 3 additions & 3 deletions examples/language_modeling/scripts/llama3.sh
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
#!/usr/bin/bash
#SBATCH --job-name=pythia
#SBATCH --output /home/sangkeuc/logs/\%j.out
#SBATCH --err /home/sangkeuc/logs/\%j.err
#SBATCH --output ./logs/\%j.out
#SBATCH --err ./logs/\%j.err
#SBATCH --nodes=1
#SBATCH --gres=gpu:A100_80GB:1
#SBATCH --mem=80GB
#SBATCH --time 24:00:00
#SBATCH --mail-user=[email protected]
#SBATCH --mail-user=//delete
#SBATCH --mail-type=START,END,FAIL
#SBATCH --partition=general

Expand Down
6 changes: 3 additions & 3 deletions examples/language_modeling/scripts/mistral.sh
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
#!/usr/bin/bash
#SBATCH --job-name=pythia
#SBATCH --output /home/sangkeuc/logs/\%j.out
#SBATCH --err /home/sangkeuc/logs/\%j.err
#SBATCH --output ./logs/\%j.out
#SBATCH --err ./logs/\%j.err
#SBATCH --nodes=1
#SBATCH --gres=gpu:A100_80GB:1
#SBATCH --mem=80GB
#SBATCH --time 24:00:00
#SBATCH --mail-user=[email protected]
#SBATCH --mail-user=//delete
#SBATCH --mail-type=START,END,FAIL
#SBATCH --partition=general

Expand Down
6 changes: 3 additions & 3 deletions examples/language_modeling/scripts/mistral_instruct.sh
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
#!/usr/bin/bash
#SBATCH --job-name=pythia
#SBATCH --output /home/sangkeuc/logs/\%j.out
#SBATCH --err /home/sangkeuc/logs/\%j.err
#SBATCH --output ./logs/\%j.out
#SBATCH --err ./logs/\%j.err
#SBATCH --nodes=1
#SBATCH --gres=gpu:A100_80GB:2
#SBATCH --mem=120GB
#SBATCH --time 24:00:00
#SBATCH --mail-user=[email protected]
#SBATCH --mail-user=//delete
#SBATCH --mail-type=START,END,FAIL
#SBATCH --partition=general

Expand Down
6 changes: 3 additions & 3 deletions examples/language_modeling/scripts/tinyllama.sh
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
#!/usr/bin/bash
#SBATCH --job-name=pythia
#SBATCH --output /home/sangkeuc/logs/\%j.out
#SBATCH --err /home/sangkeuc/logs/\%j.err
#SBATCH --output ./logs/\%j.out
#SBATCH --err ./logs/\%j.err
#SBATCH --nodes=1
#SBATCH --gres=gpu:L40:4
#SBATCH --mem=128GB
#SBATCH --time 24:00:00
#SBATCH --mail-user=[email protected]
#SBATCH --mail-user=//delete
#SBATCH --mail-type=START,END,FAIL
#SBATCH --partition=general

Expand Down

0 comments on commit 73d9a14

Please sign in to comment.