Skip to content

Tung M Phung's Blog

  • Home
  • About me

Category: Text Mining

Deep Learning, Machine Learning - Data Mining, Text Mining1 Comment

A review of pre-trained language models: from BERT, RoBERTa, to ELECTRA, DeBERTa, BigBird, and more

December 10, 2021March 26, 2023 Tung.M.Phung

Let us review a list of pretrained language models, including BERT, Transformer-XL, XLNet, RoBERTa, DistilBERT, ALBERT, BART, ELECTRA, ConvBERT, DeBERTa, and BigBird. Continue reading A review of pre-trained language models: from BERT, RoBERTa, to ELECTRA, DeBERTa, BigBird, and more

Machine Learning - Data Mining, Text MiningLeave a comment

Bit-parallel algorithms for generalized string matching

April 17, 2021July 14, 2021 Tung.M.Phung

The extended Shift-AND algorithm for generalized string patterns. Continue reading Bit-parallel algorithms for generalized string matching

Machine Learning - Data Mining, String, Text Mining1 Comment

Shift-AND algorithm for exact pattern matching

April 15, 2021April 17, 2021 Tung.M.Phung

A simple introduction to the Shift-AND algorithm for string matching with example. Continue reading Shift-AND algorithm for exact pattern matching

Machine Learning - Data Mining, Text MiningLeave a comment

Optimal alignment – Needleman Wunsch Algorithm

September 19, 2019July 31, 2020 Tung.M.Phung

Needleman Wunsch Algorithm utilizes Dynamic programming to align 2 sequences in the optimal way. Continue reading Optimal alignment – Needleman Wunsch Algorithm

Machine Learning - Data Mining, Text MiningLeave a comment

Basic Regular Expression

September 18, 2019July 31, 2020 Tung.M.Phung

The Regular expression (regex, or just re) is a means of representation, used for string matching and searching. Continue reading Basic Regular Expression