[BERT/TF2] issue raised on NVIDIA github | NVIDIA | Page 1

shrewd orchid Feb 6, 2023, 5:03 AM

#

HI Folks
No activity and failed stack when pre-training starts
Below is the Issue link with all the details
https://github.com/NVIDIA/DeepLearningExamples/issues/1262

Please let me know if more details are required .
Any help or suggestion will affect me big , I am just stuck now 😦

GitHub

[BERT/TF2] No activity and failed stack when pre-training starts · ...

Related to Model/Framework(s) BERT/TF2 Describe the bug Below is the full trace from start of pre-training and no activity after that root@node001:~/bert_tf2# bash scripts/run_pretraining_lamb.sh 6...

shrewd orchid Feb 7, 2023, 1:28 AM

#

Anyone who can have a look at the issue

shrewd orchid Feb 9, 2023, 1:25 AM

#

anyone who can help ...guys

sly trail Feb 9, 2023, 7:50 AM

#

I blame tensorflow 🤢 does anyone actually still use it

#

Does TF even support Cuda 11.7? I thought the highest it went is 11.2, and unlike PyTorch, TF is super sensitive to these things

muted dust Feb 10, 2023, 2:34 AM

#

sly trail Does TF even support Cuda 11.7? I thought the highest it went is 11.2, and unlik...

TF doesn't officialy support anything above 11.2 last I checked

#[BERT/TF2] issue raised on NVIDIA github