Requirements

• bag-of-words: pip install sklearn
• PyRuSH for segmentation:
  • Install package: pip install PyRuSH
  • Download built-in rule file: wget https://github.com/jianlins/PyRuSH/raw/master/conf/rush_rules.tsv -P conf