Pretrained language models (PLM) have been very powerful, but their effectiveness on the dark web has been challenged. After all, the languages of the dark web and surface web are quite different.  

Will BERT, trained on the surface web, be optimized to understand dark web language? What if we trained a BERT-like transformer model on the dark web domain? 

We published an article for you to get to know DarkBERT better. 

☑️ Click here to learn more.