Jumping Error to Error

Aborted Issue:

/var/spool/slurm/slurmd/job302340/slurm_script: line 36: 3229079 Aborted (core dumped) python test_starcoder_dataset.py

The error Aborted (core dumped) is a low-level system crash.

Test 1: Downloading

Downloading data: 9%

▉

81/863 [05:47<52:30, 4.03s/files](base) [kim@slurm-login t4]$

다운로드는 가능하지만 근본적인 해결책이 아님.

$ conda remove pyarrow datasets --force
$ conda install -c conda-forge "pyarrow" "datasets"

하니까,..

(pytorch310) [kim@slurm-login t3]$ conda list | grep -E “pyarrow|datasets” datasets 4.3.0 pypi_0 pypi pyarrow 21.0.0 pypi_0 pypi

에서

(pytorch310) [kim@slurm-login t3]$ conda list | grep -E “pyarrow|datasets” datasets 4.3.0 pyhcf101f3_0 conda-forge pyarrow 21.0.0 py310h505adc9_0

로 바뀌긴 했는데 영향이 따로 있는지 모르겠음.

+ supervisor는 내 이메일에 언제 답하려나.