chainsawriot / rectr

💒 Reproducible Extraction of Cross-lingual Topics using R

Reproducible Extraction of Cross-lingual Topics using R.

rectr

Please cite this package as:

Chan, C.H., Zeng, J., Wessler, H., Jungblut, M., Welbers, K., Bajjalieh, J., van Atteveldt, W., & Althaus, S. (2020) Reproducible Extraction of Cross-lingual Topics. Communication Methods & Measures. DOI: 10.1080/19312458.2020.1812555

The rectr package contains an example dataset “wiki” with English and German articles from Wikipedia about programming languages and locations in Germany. This package uses the corpus data structure from the quanteda package.

require(rectr)

## Loading required package: rectr

require(tibble)

## Loading required package: tibble

require(dplyr)

## Loading required package: dplyr

## 
## Attaching package: 'dplyr'

## The following objects are masked from 'package:stats':
## 
##     filter, lag

## The following objects are masked from 'package:base':
## 
##     intersect, setdiff, setequal, union

wiki

## # A tibble: 342 × 3
##    title                                     content                       lang 
##    <chr>                                     <chr>                         <chr>
##  1 Wismar                                    "Die Hansestadt Wismar liegt… de   
##  2 Bamberg                                   "Bamberg (mittelalterlich: B… de   
##  3 Grube Messel                              "Die Grube Messel in Messel … de   
##  4 Adenine                                   "Adenine, benannt nach der N… de   
##  5 Haskell (programming language)            "Haskell /ˈhæskəl/ is a stan… en   
##  6 SPARQL                                    "SPARQL ist eine graph-basie… de   
##  7 Trier                                     "Trier (französisch Trèves, … de   
##  8 ATS (programming language)                "ATS (Applied Type System) i… en   
##  9 Nationalpark Niedersächsisches Wattenmeer "Der Nationalpark Niedersäch… de   
## 10 Wittenberg                                "Wittenberg, officially Luth… en   
## # ℹ 332 more rows

Currently, this package supports aligned fastText from Facebook Research and Multilingual BERT (MBERT) from Google Research. For easier integration, the PyTorch version of MBERT from Transformers is used.

Multilingual BERT

Step 1: Setup your conda environment

## setup a conda environment, default name: rectr_condaenv
mbert_env_setup()

Step 1: Download MBERT model

## default to your current directory
download_mbert(noise = TRUE)

Step 2: Create corpus

Create a multilingual corpus

wiki_corpus <- create_corpus(wiki$content, wiki$lang)

Step 2: Create bag-of-embeddings dfm

Create a multilingual dfm

## default
wiki_dfm <- transform_dfm_boe(wiki_corpus, noise = TRUE)
wiki_dfm

wiki_dfm <- readRDS("man/figures/wiki_dfm.RDS")

Step 3: Filter dfm

Filter the dfm for language differences

wiki_dfm_filtered <- filter_dfm(wiki_dfm, k = 2)
wiki_dfm_filtered

## dfm with a dimension of 342 x 5 and de/en language(s).
## Filtered with k =  2
## Aligned word embeddings: bert

Step 4: Estimate GMM

Estimate a Guassian Mixture Model

wiki_gmm <- calculate_gmm(wiki_dfm_filtered, seed = 46709394)
wiki_gmm

## 2-topic rectr model trained with a dfm with a dimension of 342 x 5 and de/en language(s).
## Filtered with k =  2
## Aligned word embeddings: bert

The document-topic matrix is available in wiki_gmm$theta.

Rank the articles according to the theta1.

wiki %>% mutate(theta1 = wiki_gmm$theta[,1]) %>% arrange(theta1) %>% select(title, lang, theta1) %>% print(n = 400)

## # A tibble: 342 × 3
##     title                                                        lang     theta1
##     <chr>                                                        <chr>     <dbl>
##   1 Lustre (Programmiersprache)                                  de    6.42e-118
##   2 Babelsberg                                                   en    2.67e-116
##   3 Tcllib                                                       de    2.91e-116
##   4 Haskell (programming language)                               en    2.63e-115
##   5 Erlang (Programmiersprache)                                  de    2.88e-115
##   6 Lustre (programming language)                                en    3.62e-114
##   7 Oz (Programmiersprache)                                      de    7.29e-114
##   8 Opal (programming language)                                  en    7.29e-114
##   9 Imperial Palace Ingelheim                                    en    9.88e-114
##  10 Rüdesheim am Rhein                                           en    1.05e-113
##  11 Euler (programming language)                                 en    1.06e-113
##  12 Großsiedlung Siemensstadt                                    en    1.10e-113
##  13 Gofer (programming language)                                 en    1.12e-113
##  14 Maple (Software)                                             de    1.25e-113
##  15 NewLISP                                                      en    4.23e-113
##  16 Lorch, Hesse                                                 en    5.83e-113
##  17 Muskau Park                                                  en    7.50e-113
##  18 Common Lisp                                                  de    8.19e-113
##  19 Tcl/Java                                                     en    2.62e-112
##  20 Rammelsberg                                                  de    3.80e-112
##  21 Maulbronn Monastery                                          en    3.87e-112
##  22 Coq (Software)                                               de    1.17e-111
##  23 Clean (programming language)                                 en    1.27e-111
##  24 Völklingen Ironworks                                         en    1.50e-111
##  25 XProc                                                        de    2.47e-111
##  26 GNU Pascal                                                   de    5.27e-111
##  27 Bamberg                                                      en    6.59e-111
##  28 Wismar                                                       en    1.35e-110
##  29 Imperial Abbey of Corvey                                     en    8.83e-109
##  30 Windows PowerShell                                           de    4.02e-108
##  31 Embedded SQL                                                 de    5.87e- 85
##  32 Embedded SQL                                                 en    1.28e- 80
##  33 F Sharp (programming language)                               en    6.70e- 69
##  34 StepTalk                                                     en    1.19e- 68
##  35 Python (programming language)                                en    3.75e- 67
##  36 StepTalk                                                     de    1.07e- 66
##  37 Java Command Language                                        de    3.10e- 65
##  38 Tcllib                                                       en    3.98e- 64
##  39 JavaScript                                                   de    4.13e- 64
##  40 QML                                                          de    5.93e- 64
##  41 PHP                                                          de    8.76e- 64
##  42 Extensible Application Markup Language                       de    1.11e- 63
##  43 Java (programming language)                                  en    1.72e- 63
##  44 XSL Transformation                                           de    2.37e- 63
##  45 Boo (programming language)                                   en    1.32e- 60
##  46 Ruby (Programmiersprache)                                    de    1.96e- 60
##  47 Standard ML                                                  en    1.13e- 59
##  48 Objective-C                                                  en    1.38e- 59
##  49 Erlang (programming language)                                en    3.43e- 59
##  50 Gofer                                                        de    6.05e- 59
##  51 DrRacket                                                     de    2.85e- 58
##  52 Objective-C                                                  de    2.08e- 57
##  53 C++                                                          de    8.11e- 57
##  54 Hack (programming language)                                  en    1.69e- 56
##  55 Lua                                                          de    1.93e- 56
##  56 Windows PowerShell                                           en    7.20e- 56
##  57 Scala (programming language)                                 en    2.37e- 55
##  58 Extensible Application Markup Language                       en    1.41e- 54
##  59 C (Programmiersprache)                                       de    3.72e- 54
##  60 C++                                                          en    4.69e- 54
##  61 JavaScript                                                   en    8.03e- 54
##  62 Synchronized Multimedia Integration Language                 de    1.47e- 53
##  63 Ruby (programming language)                                  en    1.54e- 53
##  64 Racket (programming language)                                en    5.75e- 53
##  65 PEARL                                                        de    6.48e- 53
##  66 Scala (Programmiersprache)                                   de    2.04e- 51
##  67 Clojure                                                      en    6.81e- 51
##  68 Vala (programming language)                                  en    1.64e- 50
##  69 Io (programming language)                                    en    9.30e- 50
##  70 MATLAB                                                       en    1.91e- 49
##  71 XSLT                                                         en    3.51e- 49
##  72 F-Logic                                                      de    8.00e- 49
##  73 C (programming language)                                     en    3.39e- 48
##  74 Objective CAML                                               de    3.64e- 48
##  75 PHP                                                          en    5.39e- 48
##  76 Smalltalk (Programmiersprache)                               de    5.96e- 48
##  77 Io (Programmiersprache)                                      de    1.23e- 47
##  78 Julia (programming language)                                 en    1.31e- 47
##  79 OCaml                                                        en    1.51e- 47
##  80 C Sharp (programming language)                               en    2.71e- 47
##  81 XQuery                                                       de    3.36e- 47
##  82 F-Sharp                                                      de    4.47e- 47
##  83 Vala (Programmiersprache)                                    de    3.13e- 46
##  84 Curl (programming language)                                  en    4.02e- 46
##  85 QML                                                          en    1.65e- 45
##  86 CycL                                                         en    2.53e- 45
##  87 Opal (Programmiersprache)                                    de    3.91e- 45
##  88 Haskell (Programmiersprache)                                 de    1.95e- 44
##  89 ATS (programming language)                                   en    2.32e- 44
##  90 C-Sharp                                                      de    4.65e- 44
##  91 Squeak                                                       en    5.03e- 44
##  92 XProc                                                        en    5.30e- 44
##  93 Java (Programmiersprache)                                    de    2.91e- 43
##  94 Pharo (Programmiersprache)                                   de    5.58e- 43
##  95 Lua (programming language)                                   en    7.40e- 43
##  96 ML (Programmiersprache)                                      de    6.78e- 42
##  97 Standard ML                                                  de    7.22e- 42
##  98 Common Lisp                                                  en    7.83e- 42
##  99 Pharo                                                        en    1.81e- 41
## 100 Ada (Programmiersprache)                                     de    4.89e- 41
## 101 ISWIM                                                        en    5.03e- 41
## 102 Miranda (Programmiersprache)                                 de    5.56e- 41
## 103 Synchronized Multimedia Integration Language                 en    5.92e- 41
## 104 Miranda (programming language)                               en    9.78e- 41
## 105 XQuery                                                       en    1.32e- 40
## 106 Self (programming language)                                  en    1.49e- 40
## 107 MetaPost                                                     en    1.59e- 40
## 108 Julia (Programmiersprache)                                   de    1.86e- 40
## 109 Strongtalk                                                   en    2.55e- 40
## 110 Adenine                                                      de    9.96e- 40
## 111 COBOL                                                        de    1.10e- 39
## 112 Clojure                                                      de    1.58e- 39
## 113 Applied Type System                                          de    2.72e- 39
## 114 Perl (Programmiersprache)                                    de    3.91e- 39
## 115 GNU Pascal                                                   en    6.08e- 39
## 116 Lout                                                         de    7.71e- 39
## 117 D (programming language)                                     en    2.67e- 38
## 118 F-logic                                                      en    2.67e- 38
## 119 Hack (Programmiersprache)                                    de    4.56e- 38
## 120 Adenine (programming language)                               en    5.60e- 38
## 121 J (programming language)                                     en    7.54e- 38
## 122 Mercury (programming language)                               en    9.97e- 38
## 123 Rebol                                                        en    3.02e- 36
## 124 Fortran                                                      de    3.71e- 36
## 125 SQL                                                          en    8.99e- 36
## 126 J (Programmiersprache)                                       de    2.86e- 35
## 127 Strongtalk                                                   de    1.39e- 34
## 128 MetaPost                                                     de    1.46e- 33
## 129 Tcl                                                          en    2.67e- 33
## 130 SPARQL                                                       de    3.51e- 33
## 131 Boo (Programmiersprache)                                     de    3.97e- 33
## 132 Prolog                                                       en    6.38e- 33
## 133 CycL                                                         de    1.06e- 32
## 134 Modelica                                                     en    2.30e- 32
## 135 SuperCollider                                                en    2.91e- 32
## 136 Mercury (Programmiersprache)                                 de    1.51e- 31
## 137 APL (programming language)                                   en    1.77e- 31
## 138 Python (Programmiersprache)                                  de    1.84e- 31
## 139 Web Ontology Language                                        de    2.20e- 31
## 140 Perl                                                         en    2.43e- 31
## 141 Tcl                                                          de    2.46e- 31
## 142 Lisp                                                         de    3.16e- 31
## 143 SPARQL                                                       en    8.71e- 31
## 144 METAFONT                                                     de    9.62e- 31
## 145 Self (Programmiersprache)                                    de    3.22e- 30
## 146 PEARL (programming language)                                 en    1.02e- 29
## 147 Modelica                                                     de    1.30e- 29
## 148 COBOL                                                        en    3.61e- 28
## 149 SuperCollider                                                de    4.07e- 28
## 150 Euler (Programmiersprache)                                   de    4.09e- 28
## 151 Curl (Programmiersprache)                                    de    5.98e- 28
## 152 MUMPS                                                        en    1.65e- 27
## 153 Matlab                                                       de    5.17e- 27
## 154 ML (programming language)                                    en    8.42e- 27
## 155 Fortran                                                      en    9.20e- 27
## 156 Lisp (programming language)                                  en    2.86e- 26
## 157 Web Ontology Language                                        en    3.07e- 26
## 158 Squeak                                                       de    5.05e- 26
## 159 Lout (software)                                              en    1.18e- 25
## 160 Go (programming language)                                    en    1.30e- 25
## 161 Clean (Programmiersprache)                                   de    1.63e- 25
## 162 Prolog (Programmiersprache)                                  de    6.92e- 25
## 163 Metafont                                                     en    9.85e- 25
## 164 REBOL                                                        de    1.39e- 24
## 165 MUMPS                                                        de    1.43e- 23
## 166 Datalog                                                      en    1.65e- 23
## 167 Logo (Programmiersprache)                                    de    3.55e- 23
## 168 Go (Programmiersprache)                                      de    3.86e- 23
## 169 Ada (programming language)                                   en    3.92e- 21
## 170 Joy (programming language)                                   en    7.41e- 21
## 171 D (Programmiersprache)                                       de    1.60e- 20
## 172 APL (Programmiersprache)                                     de    2.40e- 20
## 173 NewLISP                                                      de    6.25e- 20
## 174 Maple (software)                                             en    6.93e- 20
## 175 R (programming language)                                     en    1.03e- 19
## 176 Datalog                                                      de    9.08e- 19
## 177 Paul Graham (computer programmer)                            en    2.35e- 18
## 178 ISWIM                                                        de    2.29e- 17
## 179 Coq                                                          en    4.37e- 16
## 180 SQL                                                          de    4.43e- 16
## 181 Smalltalk                                                    en    4.68e- 16
## 182 Logo (programming language)                                  en    1.93e- 13
## 183 Oz (programming language)                                    en    3.18e- 13
## 184 Joy (Programmiersprache)                                     de    7.79e- 13
## 185 Paul Graham                                                  de    5.93e- 10
## 186 R (Programmiersprache)                                       de    5.68e-  9
## 187 Musterhaus Am Horn                                           de    1.00e+  0
## 188 Grube Messel                                                 de    1.00e+  0
## 189 Kulturlandschaft Dresdner Elbtal                             de    1.00e+  0
## 190 Fagus-Werk                                                   de    1.00e+  0
## 191 Bauhaus                                                      de    1.00e+  0
## 192 Wattenmeer (Nordsee)                                         de    1.00e+  0
## 193 Nationalpark Schleswig-Holsteinisches Wattenmeer             de    1.00e+  0
## 194 Prehistoric pile dwellings around the Alps                   en    1.00e+  0
## 195 Großsiedlung Siemensstadt                                    de    1.00e+  0
## 196 Oberharzer Wasserregal                                       de    1.00e+  0
## 197 Wadden Sea                                                   en    1.00e+  0
## 198 Limes (Grenzwall)                                            de    1.00e+  0
## 199 Primeval Beech Forests of the Carpathians and the Ancient B… en    1.00e+  0
## 200 Wismar                                                       de    1   e+  0
## 201 Bamberg                                                      de    1   e+  0
## 202 Trier                                                        de    1   e+  0
## 203 Nationalpark Niedersächsisches Wattenmeer                    de    1   e+  0
## 204 Wittenberg                                                   en    1   e+  0
## 205 Goslar                                                       de    1   e+  0
## 206 Margravial Opera House                                       en    1   e+  0
## 207 Weimar                                                       de    1   e+  0
## 208 Bremer Rathaus                                               de    1   e+  0
## 209 Würzburg Residence                                           en    1   e+  0
## 210 Glienicke Palace                                             en    1   e+  0
## 211 New Garden, Potsdam                                          en    1   e+  0
## 212 Upper Harz Water Regale                                      en    1   e+  0
## 213 Kloster Maulbronn                                            de    1   e+  0
## 214 Martin Luther's Birth House                                  en    1   e+  0
## 215 Speyer Cathedral                                             en    1   e+  0
## 216 Konstantinbasilika                                           de    1   e+  0
## 217 Welterbe in Deutschland                                      de    1   e+  0
## 218 Barbara Baths                                                en    1   e+  0
## 219 Lübeck                                                       de    1   e+  0
## 220 Herkules (Kassel)                                            de    1   e+  0
## 221 Lübeck                                                       en    1   e+  0
## 222 Dessau-Wörlitz Garden Realm                                  en    1   e+  0
## 223 Sanssouci                                                    de    1   e+  0
## 224 Klassisches Weimar                                           de    1   e+  0
## 225 Kaiserthermen (Trier)                                        de    1   e+  0
## 226 Rammelsberg                                                  en    1   e+  0
## 227 Ingelheimer Kaiserpfalz                                      de    1   e+  0
## 228 Zollverein Coal Mine Industrial Complex                      en    1   e+  0
## 229 Heilandskirche am Port von Sacrow                            de    1   e+  0
## 230 Porta Nigra                                                  en    1   e+  0
## 231 Pfaueninsel                                                  en    1   e+  0
## 232 Hildesheimer Dom                                             de    1   e+  0
## 233 Stadtkirche Lutherstadt Wittenberg                           de    1   e+  0
## 234 Dessau-Wörlitzer Gartenreich                                 de    1   e+  0
## 235 Hercules monument (Kassel)                                   en    1   e+  0
## 236 Prähistorische Pfahlbauten um die Alpen                      de    1   e+  0
## 237 Museum Island                                                en    1   e+  0
## 238 Aula Palatina                                                en    1   e+  0
## 239 Welterbe Römische Baudenkmäler, Dom und Liebfrauenkirche in… de    1   e+  0
## 240 Zeche Zollverein                                             de    1   e+  0
## 241 Bergpark Wilhelmshöhe                                        en    1   e+  0
## 242 Melanchthonhaus (Wittenberg)                                 en    1   e+  0
## 243 Reichenau (Insel)                                            de    1   e+  0
## 244 Bauhaus Dessau Foundation                                    en    1   e+  0
## 245 Stiftung Bauhaus Dessau                                      de    1   e+  0
## 246 Goslar                                                       en    1   e+  0
## 247 Aachen Cathedral Treasury                                    en    1   e+  0
## 248 Kloster Lorsch                                               de    1   e+  0
## 249 Trier Amphitheater                                           en    1   e+  0
## 250 Eibingen Abbey                                               en    1   e+  0
## 251 Roman Monuments, Cathedral of St. Peter and Church of Our L… en    1   e+  0
## 252 Lutherstadt Eisleben                                         de    1   e+  0
## 253 Porta Nigra                                                  de    1   e+  0
## 254 Trierer Dom                                                  de    1   e+  0
## 255 Reichenau Island                                             en    1   e+  0
## 256 Trier                                                        en    1   e+  0
## 257 Lower Saxon Wadden Sea National Park                         en    1   e+  0
## 258 Dresden Elbe Valley                                          en    1   e+  0
## 259 Trier Imperial Baths                                         en    1   e+  0
## 260 Wartburg                                                     en    1   e+  0
## 261 Bremen City Hall                                             en    1   e+  0
## 262 Speyerer Dom                                                 de    1   e+  0
## 263 Holstentor                                                   de    1   e+  0
## 264 Eisleben                                                     en    1   e+  0
## 265 Neuer Garten Potsdam                                         de    1   e+  0
## 266 Regensburg                                                   de    1   e+  0
## 267 Palaces and Parks of Potsdam and Berlin                      en    1   e+  0
## 268 Martin Luther's Death House                                  en    1   e+  0
## 269 Quedlinburg                                                  en    1   e+  0
## 270 Messel pit                                                   en    1   e+  0
## 271 Lorch (Rheingau)                                             de    1   e+  0
## 272 Berlin Modernism Housing Estates                             en    1   e+  0
## 273 Bauhaus                                                      en    1   e+  0
## 274 Cologne Cathedral                                            en    1   e+  0
## 275 List of World Heritage Sites in Germany                      en    1   e+  0
## 276 Museumsinsel (Berlin)                                        de    1   e+  0
## 277 Limes                                                        en    1   e+  0
## 278 Wieskirche                                                   de    1   e+  0
## 279 Augusteum und Lutherhaus Wittenberg                          de    1   e+  0
## 280 Imperial Palace of Goslar                                    en    1   e+  0
## 281 Lutherstadt Wittenberg                                       de    1   e+  0
## 282 Schlösser und Gärten von Potsdam und Berlin                  de    1   e+  0
## 283 Fürst-Pückler-Park Bad Muskau                                de    1   e+  0
## 284 Weimar                                                       en    1   e+  0
## 285 Stadtkirche Wittenberg                                       en    1   e+  0
## 286 Bremen Roland                                                en    1   e+  0
## 287 Buchenurwälder in den Karpaten und alte Buchenwälder in Deu… de    1   e+  0
## 288 Kaiserpfalz Goslar                                           de    1   e+  0
## 289 Stralsund                                                    de    1   e+  0
## 290 Lorsch Abbey                                                 en    1   e+  0
## 291 Babelsberg Palace                                            en    1   e+  0
## 292 Pfaueninsel                                                  de    1   e+  0
## 293 Obergermanisch-Raetischer Limes#Der Limes heute              de    1   e+  0
## 294 Abtei St. Hildegard (Rüdesheim am Rhein)                     de    1   e+  0
## 295 Haus am Horn                                                 en    1   e+  0
## 296 Rüdesheim am Rhein                                           de    1   e+  0
## 297 Cathedral of Trier                                           en    1   e+  0
## 298 Schlösser Augustusburg und Falkenlust                        de    1   e+  0
## 299 Wartburg                                                     de    1   e+  0
## 300 Igel Column                                                  en    1   e+  0
## 301 Quedlinburg                                                  de    1   e+  0
## 302 Babelsberg                                                   de    1   e+  0
## 303 Igeler Säule                                                 de    1   e+  0
## 304 St. Michael's Church, Hildesheim                             en    1   e+  0
## 305 Würzburger Residenz                                          de    1   e+  0
## 306 Liebfrauenkirche (Trier)                                     de    1   e+  0
## 307 Stift Corvey                                                 de    1   e+  0
## 308 Wieskirche                                                   en    1   e+  0
## 309 Classical Weimar (World Heritage Site)                       en    1   e+  0
## 310 Sanssouci                                                    en    1   e+  0
## 311 Kölner Dom                                                   de    1   e+  0
## 312 Schloss Glienicke                                            de    1   e+  0
## 313 Liebfrauenkirche, Trier                                      en    1   e+  0
## 314 St. Michael (Hildesheim)                                     de    1   e+  0
## 315 Welterbe Kulturlandschaft Oberes Mittelrheintal              de    1   e+  0
## 316 Bremer Roland                                                de    1   e+  0
## 317 Hildesheim Cathedral                                         en    1   e+  0
## 318 Limes Germanicus                                             en    1   e+  0
## 319 Siedlungen der Berliner Moderne                              de    1   e+  0
## 320 Martin Luthers Sterbehaus                                    de    1   e+  0
## 321 Rhine Gorge                                                  en    1   e+  0
## 322 Martin Luthers Geburtshaus                                   de    1   e+  0
## 323 Melanchthonhaus Wittenberg                                   de    1   e+  0
## 324 Regensburg                                                   en    1   e+  0
## 325 Aachener Dom                                                 de    1   e+  0
## 326 Fagus Factory                                                en    1   e+  0
## 327 Lutherhaus                                                   en    1   e+  0
## 328 Augustusburg and Falkenlust Palaces, Brühl                   en    1   e+  0
## 329 Hufeisensiedlung                                             de    1   e+  0
## 330 Völklinger Hütte                                             de    1   e+  0
## 331 Aachen Cathedral                                             en    1   e+  0
## 332 Schleswig-Holstein Wadden Sea National Park                  en    1   e+  0
## 333 Markgräfliches Opernhaus                                     de    1   e+  0
## 334 Schloss Babelsberg                                           de    1   e+  0
## 335 Hufeisensiedlung                                             en    1   e+  0
## 336 Amphitheater (Trier)                                         de    1   e+  0
## 337 Bergpark Wilhelmshöhe                                        de    1   e+  0
## 338 Barbarathermen                                               de    1   e+  0
## 339 Church of the Redeemer, Sacrow                               en    1   e+  0
## 340 Holstentor                                                   en    1   e+  0
## 341 Aachener Domschatzkammer                                     de    1   e+  0
## 342 Stralsund                                                    en    1   e+  0

Aligned fastText

Step 1: Download word embeddings

Download and preprocess fastText word embeddings from Facebook. Make sure you have at least 5G of disk space and a reasonably amount of RAM. It took around 20 minutes on my machine.

get_ft("en")
get_ft("de")

Step 1: Read the downloaded word embeddings

emb <- read_ft(c("en", "de"))

Step 2: Create corpus

Create a multilingual corpus

wiki_corpus <- create_corpus(wiki$content, wiki$lang)

Step 2: Create bag-of-embeddings dfm

Create a multilingual dfm

require(future)

## Loading required package: future

plan(multisession)
wiki_dfm <- transform_dfm_boe(wiki_corpus, emb, .progress = TRUE)
wiki_dfm

## dfm with a dimension of 342 x 300 and de/en language(s).
## 
## Aligned word embeddings: fasttext

Step 3: Filter dfm

Filter the dfm for language differences

wiki_dfm_filtered <- filter_dfm(wiki_dfm, k = 2)
wiki_dfm_filtered

## dfm with a dimension of 342 x 5 and de/en language(s).
## Filtered with k =  2
## Aligned word embeddings: fasttext

Step 4: Estimate GMM

Estimate a Guassian Mixture Model

wiki_gmm <- calculate_gmm(wiki_dfm_filtered, seed = 46709394)
wiki_gmm

## 2-topic rectr model trained with a dfm with a dimension of 342 x 5 and de/en language(s).
## Filtered with k =  2
## Aligned word embeddings: fasttext

The document-topic matrix is available in wiki_gmm$theta.

Rank the articles according to the theta1.

wiki %>% mutate(theta1 = wiki_gmm$theta[,1]) %>% arrange(theta1) %>% select(title, lang, theta1) %>% print(n = 400)

## # A tibble: 342 × 3
##     title                                                        lang     theta1
##     <chr>                                                        <chr>     <dbl>
##   1 Lustre (Programmiersprache)                                  de    3.36e-322
##   2 GNU Pascal                                                   de    3.80e-234
##   3 Pharo (Programmiersprache)                                   de    2.64e-194
##   4 Embedded SQL                                                 de    2.75e-163
##   5 Windows PowerShell                                           de    1.44e-159
##   6 Java Command Language                                        de    9.55e-137
##   7 Embedded SQL                                                 en    9.33e-130
##   8 Tcllib                                                       en    3.91e-129
##   9 Tcl/Java                                                     en    3.79e-127
##  10 StepTalk                                                     en    2.26e-116
##  11 StepTalk                                                     de    4.85e-110
##  12 QML                                                          de    4.60e-107
##  13 Extensible Application Markup Language                       de    3.19e-105
##  14 Lua (programming language)                                   en    3.62e-100
##  15 Java (programming language)                                  en    8.88e- 99
##  16 NewLISP                                                      en    4.55e- 98
##  17 Windows PowerShell                                           en    6.64e- 95
##  18 Synchronized Multimedia Integration Language                 en    7.21e- 94
##  19 XSL Transformation                                           de    1.11e- 91
##  20 Curl (programming language)                                  en    7.26e- 91
##  21 Clojure                                                      en    3.22e- 90
##  22 JavaScript                                                   de    5.74e- 90
##  23 C++                                                          de    7.51e- 90
##  24 Objective-C                                                  en    6.63e- 88
##  25 GNU Pascal                                                   en    2.94e- 86
##  26 C (Programmiersprache)                                       de    1.01e- 84
##  27 Extensible Application Markup Language                       en    1.82e- 84
##  28 JavaScript                                                   en    2.02e- 84
##  29 Synchronized Multimedia Integration Language                 de    1.30e- 80
##  30 Clojure                                                      de    2.78e- 80
##  31 Boo (Programmiersprache)                                     de    9.74e- 80
##  32 Oz (Programmiersprache)                                      de    1.80e- 79
##  33 Tcl                                                          en    9.18e- 79
##  34 Common Lisp                                                  en    2.27e- 78
##  35 Vala (Programmiersprache)                                    de    2.87e- 77
##  36 Boo (programming language)                                   en    4.38e- 77
##  37 Lua                                                          de    9.94e- 77
##  38 F Sharp (programming language)                               en    2.03e- 76
##  39 PHP                                                          de    1.97e- 75
##  40 Java (Programmiersprache)                                    de    1.18e- 74
##  41 QML                                                          en    1.34e- 74
##  42 Common Lisp                                                  de    2.29e- 74
##  43 Ada (Programmiersprache)                                     de    5.30e- 73
##  44 C-Sharp                                                      de    1.41e- 72
##  45 Python (programming language)                                en    3.85e- 72
##  46 PEARL                                                        de    3.87e- 72
##  47 Ruby (programming language)                                  en    3.92e- 72
##  48 XQuery                                                       de    4.73e- 71
##  49 SPARQL                                                       en    6.89e- 70
##  50 Go (programming language)                                    en    9.38e- 70
##  51 XSLT                                                         en    3.98e- 69
##  52 Hack (programming language)                                  en    1.92e- 68
##  53 XProc                                                        de    3.13e- 67
##  54 MATLAB                                                       en    4.76e- 67
##  55 DrRacket                                                     de    1.23e- 65
##  56 Tcllib                                                       de    1.56e- 65
##  57 Scala (programming language)                                 en    9.23e- 65
##  58 Squeak                                                       en    1.56e- 64
##  59 PHP                                                          en    2.24e- 64
##  60 Io (programming language)                                    en    3.50e- 64
##  61 OCaml                                                        en    5.50e- 64
##  62 Rebol                                                        en    3.25e- 63
##  63 Vala (programming language)                                  en    1.92e- 62
##  64 Objective-C                                                  de    2.59e- 62
##  65 C++                                                          en    2.71e- 62
##  66 Fortran                                                      en    3.25e- 61
##  67 Adenine                                                      de    5.17e- 61
##  68 COBOL                                                        de    1.67e- 60
##  69 Objective CAML                                               de    2.26e- 60
##  70 XQuery                                                       en    7.76e- 60
##  71 NewLISP                                                      de    3.05e- 58
##  72 Lout                                                         de    8.52e- 58
##  73 Opal (programming language)                                  en    1.47e- 57
##  74 Racket (programming language)                                en    2.26e- 57
##  75 C Sharp (programming language)                               en    3.14e- 57
##  76 Pharo                                                        en    8.07e- 57
##  77 Tcl                                                          de    9.30e- 57
##  78 Lisp                                                         de    1.81e- 56
##  79 Haskell (programming language)                               en    4.00e- 55
##  80 Gofer (programming language)                                 en    8.21e- 55
##  81 Smalltalk (Programmiersprache)                               de    1.16e- 54
##  82 Adenine (programming language)                               en    6.03e- 53
##  83 Ruby (Programmiersprache)                                    de    7.90e- 53
##  84 Smalltalk                                                    en    2.00e- 52
##  85 C (programming language)                                     en    3.90e- 52
##  86 Python (Programmiersprache)                                  de    3.19e- 51
##  87 MetaPost                                                     de    3.74e- 51
##  88 Fortran                                                      de    5.96e- 51
##  89 Ada (programming language)                                   en    3.77e- 50
##  90 Erlang (programming language)                                en    9.70e- 50
##  91 Clean (programming language)                                 en    1.20e- 49
##  92 Standard ML                                                  en    1.48e- 49
##  93 D (programming language)                                     en    7.29e- 49
##  94 Euler (programming language)                                 en    1.77e- 48
##  95 Perl                                                         en    3.90e- 48
##  96 Scala (Programmiersprache)                                   de    4.15e- 48
##  97 SQL                                                          en    4.50e- 48
##  98 Haskell (Programmiersprache)                                 de    1.19e- 47
##  99 ISWIM                                                        en    1.94e- 47
## 100 Miranda (programming language)                               en    2.09e- 46
## 101 ATS (programming language)                                   en    1.53e- 45
## 102 Io (Programmiersprache)                                      de    3.85e- 45
## 103 Mercury (programming language)                               en    4.23e- 45
## 104 Perl (Programmiersprache)                                    de    5.68e- 45
## 105 F-Sharp                                                      de    9.56e- 45
## 106 Lisp (programming language)                                  en    2.21e- 44
## 107 Paul Graham (computer programmer)                            en    3.17e- 44
## 108 Gofer                                                        de    3.69e- 44
## 109 Matlab                                                       de    5.11e- 44
## 110 Erlang (Programmiersprache)                                  de    1.43e- 43
## 111 XProc                                                        en    6.63e- 43
## 112 APL (programming language)                                   en    1.30e- 42
## 113 COBOL                                                        en    2.56e- 42
## 114 Miranda (Programmiersprache)                                 de    1.16e- 41
## 115 Lout (software)                                              en    5.72e- 41
## 116 Euler (Programmiersprache)                                   de    6.65e- 41
## 117 SuperCollider                                                en    6.80e- 41
## 118 Prolog                                                       en    1.97e- 40
## 119 Julia (programming language)                                 en    5.45e- 40
## 120 APL (Programmiersprache)                                     de    3.15e- 39
## 121 SQL                                                          de    7.29e- 39
## 122 PEARL (programming language)                                 en    2.05e- 38
## 123 MetaPost                                                     en    2.33e- 38
## 124 Metafont                                                     en    2.42e- 38
## 125 Lustre (programming language)                                en    1.59e- 37
## 126 Modelica                                                     en    2.06e- 37
## 127 Mercury (Programmiersprache)                                 de    2.80e- 37
## 128 Oz (programming language)                                    en    3.54e- 36
## 129 Datalog                                                      en    3.58e- 36
## 130 REBOL                                                        de    4.66e- 36
## 131 Logo (programming language)                                  en    2.14e- 35
## 132 J (Programmiersprache)                                       de    4.18e- 35
## 133 Go (Programmiersprache)                                      de    6.19e- 35
## 134 CycL                                                         en    7.74e- 35
## 135 Self (Programmiersprache)                                    de    1.50e- 34
## 136 SPARQL                                                       de    1.94e- 34
## 137 Curl (Programmiersprache)                                    de    2.30e- 34
## 138 ML (programming language)                                    en    3.70e- 34
## 139 Julia (Programmiersprache)                                   de    8.39e- 34
## 140 Self (programming language)                                  en    8.96e- 34
## 141 CycL                                                         de    1.72e- 33
## 142 MUMPS                                                        en    4.57e- 33
## 143 ML (Programmiersprache)                                      de    1.17e- 32
## 144 F-logic                                                      en    4.64e- 32
## 145 F-Logic                                                      de    1.50e- 31
## 146 Hack (Programmiersprache)                                    de    2.76e- 31
## 147 Standard ML                                                  de    3.55e- 31
## 148 J (programming language)                                     en    6.18e- 31
## 149 Opal (Programmiersprache)                                    de    1.12e- 30
## 150 Strongtalk                                                   en    1.82e- 30
## 151 Strongtalk                                                   de    1.51e- 29
## 152 Web Ontology Language                                        de    2.98e- 29
## 153 Prolog (Programmiersprache)                                  de    4.82e- 29
## 154 R (programming language)                                     en    1.08e- 28
## 155 D (Programmiersprache)                                       de    1.33e- 28
## 156 Coq                                                          en    1.50e- 27
## 157 Squeak                                                       de    1.89e- 27
## 158 MUMPS                                                        de    1.56e- 26
## 159 Maple (software)                                             en    1.82e- 26
## 160 SuperCollider                                                de    7.74e- 25
## 161 Maple (Software)                                             de    8.64e- 24
## 162 Applied Type System                                          de    2.06e- 23
## 163 Web Ontology Language                                        en    2.32e- 23
## 164 Logo (Programmiersprache)                                    de    1.88e- 22
## 165 Clean (Programmiersprache)                                   de    2.67e- 21
## 166 Joy (programming language)                                   en    7.22e- 21
## 167 METAFONT                                                     de    1.44e- 19
## 168 Modelica                                                     de    2.35e- 19
## 169 Datalog                                                      de    4.73e- 19
## 170 Paul Graham                                                  de    8.59e- 17
## 171 ISWIM                                                        de    8.66e- 16
## 172 R (Programmiersprache)                                       de    4.41e- 13
## 173 Joy (Programmiersprache)                                     de    7.50e- 10
## 174 Coq (Software)                                               de    1.61e-  9
## 175 Fagus Factory                                                en    1.00e+  0
## 176 Bauhaus                                                      en    1.00e+  0
## 177 Haus am Horn                                                 en    1.00e+  0
## 178 Berlin Modernism Housing Estates                             en    1.00e+  0
## 179 Martin Luther's Birth House                                  en    1.00e+  0
## 180 Musterhaus Am Horn                                           de    1.00e+  0
## 181 Bauhaus                                                      de    1.00e+  0
## 182 Prehistoric pile dwellings around the Alps                   en    1.00e+  0
## 183 Klassisches Weimar                                           de    1.00e+  0
## 184 Limes (Grenzwall)                                            de    1.00e+  0
## 185 Grube Messel                                                 de    1.00e+  0
## 186 Bauhaus Dessau Foundation                                    en    1.00e+  0
## 187 Limes                                                        en    1.00e+  0
## 188 Siedlungen der Berliner Moderne                              de    1.00e+  0
## 189 Hufeisensiedlung                                             en    1.00e+  0
## 190 Kulturlandschaft Dresdner Elbtal                             de    1.00e+  0
## 191 Dessau-Wörlitz Garden Realm                                  en    1.00e+  0
## 192 Sanssouci                                                    en    1.00e+  0
## 193 Zollverein Coal Mine Industrial Complex                      en    1.00e+  0
## 194 Lutherhaus                                                   en    1.00e+  0
## 195 Weimar                                                       en    1.00e+  0
## 196 Igel Column                                                  en    1.00e+  0
## 197 Wismar                                                       de    1   e+  0
## 198 Bamberg                                                      de    1   e+  0
## 199 Trier                                                        de    1   e+  0
## 200 Nationalpark Niedersächsisches Wattenmeer                    de    1   e+  0
## 201 Wittenberg                                                   en    1   e+  0
## 202 Goslar                                                       de    1   e+  0
## 203 Margravial Opera House                                       en    1   e+  0
## 204 Maulbronn Monastery                                          en    1   e+  0
## 205 Weimar                                                       de    1   e+  0
## 206 Wismar                                                       en    1   e+  0
## 207 Bremer Rathaus                                               de    1   e+  0
## 208 Würzburg Residence                                           en    1   e+  0
## 209 Glienicke Palace                                             en    1   e+  0
## 210 New Garden, Potsdam                                          en    1   e+  0
## 211 Upper Harz Water Regale                                      en    1   e+  0
## 212 Kloster Maulbronn                                            de    1   e+  0
## 213 Speyer Cathedral                                             en    1   e+  0
## 214 Lorch, Hesse                                                 en    1   e+  0
## 215 Konstantinbasilika                                           de    1   e+  0
## 216 Welterbe in Deutschland                                      de    1   e+  0
## 217 Barbara Baths                                                en    1   e+  0
## 218 Lübeck                                                       de    1   e+  0
## 219 Herkules (Kassel)                                            de    1   e+  0
## 220 Lübeck                                                       en    1   e+  0
## 221 Oberharzer Wasserregal                                       de    1   e+  0
## 222 Sanssouci                                                    de    1   e+  0
## 223 Kaiserthermen (Trier)                                        de    1   e+  0
## 224 Rammelsberg                                                  en    1   e+  0
## 225 Ingelheimer Kaiserpfalz                                      de    1   e+  0
## 226 Babelsberg                                                   en    1   e+  0
## 227 Heilandskirche am Port von Sacrow                            de    1   e+  0
## 228 Wattenmeer (Nordsee)                                         de    1   e+  0
## 229 Porta Nigra                                                  en    1   e+  0
## 230 Pfaueninsel                                                  en    1   e+  0
## 231 Hildesheimer Dom                                             de    1   e+  0
## 232 Stadtkirche Lutherstadt Wittenberg                           de    1   e+  0
## 233 Dessau-Wörlitzer Gartenreich                                 de    1   e+  0
## 234 Hercules monument (Kassel)                                   en    1   e+  0
## 235 Prähistorische Pfahlbauten um die Alpen                      de    1   e+  0
## 236 Museum Island                                                en    1   e+  0
## 237 Aula Palatina                                                en    1   e+  0
## 238 Muskau Park                                                  en    1   e+  0
## 239 Welterbe Römische Baudenkmäler, Dom und Liebfrauenkirche in… de    1   e+  0
## 240 Großsiedlung Siemensstadt                                    en    1   e+  0
## 241 Zeche Zollverein                                             de    1   e+  0
## 242 Bergpark Wilhelmshöhe                                        en    1   e+  0
## 243 Melanchthonhaus (Wittenberg)                                 en    1   e+  0
## 244 Reichenau (Insel)                                            de    1   e+  0
## 245 Stiftung Bauhaus Dessau                                      de    1   e+  0
## 246 Goslar                                                       en    1   e+  0
## 247 Aachen Cathedral Treasury                                    en    1   e+  0
## 248 Kloster Lorsch                                               de    1   e+  0
## 249 Trier Amphitheater                                           en    1   e+  0
## 250 Eibingen Abbey                                               en    1   e+  0
## 251 Roman Monuments, Cathedral of St. Peter and Church of Our L… en    1   e+  0
## 252 Rammelsberg                                                  de    1   e+  0
## 253 Lutherstadt Eisleben                                         de    1   e+  0
## 254 Porta Nigra                                                  de    1   e+  0
## 255 Trierer Dom                                                  de    1   e+  0
## 256 Reichenau Island                                             en    1   e+  0
## 257 Trier                                                        en    1   e+  0
## 258 Lower Saxon Wadden Sea National Park                         en    1   e+  0
## 259 Dresden Elbe Valley                                          en    1   e+  0
## 260 Trier Imperial Baths                                         en    1   e+  0
## 261 Wartburg                                                     en    1   e+  0
## 262 Bremen City Hall                                             en    1   e+  0
## 263 Speyerer Dom                                                 de    1   e+  0
## 264 Holstentor                                                   de    1   e+  0
## 265 Primeval Beech Forests of the Carpathians and the Ancient B… en    1   e+  0
## 266 Eisleben                                                     en    1   e+  0
## 267 Neuer Garten Potsdam                                         de    1   e+  0
## 268 Regensburg                                                   de    1   e+  0
## 269 Palaces and Parks of Potsdam and Berlin                      en    1   e+  0
## 270 Fagus-Werk                                                   de    1   e+  0
## 271 Martin Luther's Death House                                  en    1   e+  0
## 272 Quedlinburg                                                  en    1   e+  0
## 273 Messel pit                                                   en    1   e+  0
## 274 Lorch (Rheingau)                                             de    1   e+  0
## 275 Bamberg                                                      en    1   e+  0
## 276 Cologne Cathedral                                            en    1   e+  0
## 277 List of World Heritage Sites in Germany                      en    1   e+  0
## 278 Museumsinsel (Berlin)                                        de    1   e+  0
## 279 Wieskirche                                                   de    1   e+  0
## 280 Augusteum und Lutherhaus Wittenberg                          de    1   e+  0
## 281 Imperial Palace of Goslar                                    en    1   e+  0
## 282 Lutherstadt Wittenberg                                       de    1   e+  0
## 283 Schlösser und Gärten von Potsdam und Berlin                  de    1   e+  0
## 284 Fürst-Pückler-Park Bad Muskau                                de    1   e+  0
## 285 Stadtkirche Wittenberg                                       en    1   e+  0
## 286 Bremen Roland                                                en    1   e+  0
## 287 Buchenurwälder in den Karpaten und alte Buchenwälder in Deu… de    1   e+  0
## 288 Kaiserpfalz Goslar                                           de    1   e+  0
## 289 Stralsund                                                    de    1   e+  0
## 290 Lorsch Abbey                                                 en    1   e+  0
## 291 Babelsberg Palace                                            en    1   e+  0
## 292 Pfaueninsel                                                  de    1   e+  0
## 293 Obergermanisch-Raetischer Limes#Der Limes heute              de    1   e+  0
## 294 Nationalpark Schleswig-Holsteinisches Wattenmeer             de    1   e+  0
## 295 Abtei St. Hildegard (Rüdesheim am Rhein)                     de    1   e+  0
## 296 Völklingen Ironworks                                         en    1   e+  0
## 297 Rüdesheim am Rhein                                           de    1   e+  0
## 298 Cathedral of Trier                                           en    1   e+  0
## 299 Großsiedlung Siemensstadt                                    de    1   e+  0
## 300 Schlösser Augustusburg und Falkenlust                        de    1   e+  0
## 301 Wartburg                                                     de    1   e+  0
## 302 Quedlinburg                                                  de    1   e+  0
## 303 Babelsberg                                                   de    1   e+  0
## 304 Igeler Säule                                                 de    1   e+  0
## 305 St. Michael's Church, Hildesheim                             en    1   e+  0
## 306 Würzburger Residenz                                          de    1   e+  0
## 307 Imperial Palace Ingelheim                                    en    1   e+  0
## 308 Liebfrauenkirche (Trier)                                     de    1   e+  0
## 309 Stift Corvey                                                 de    1   e+  0
## 310 Wieskirche                                                   en    1   e+  0
## 311 Classical Weimar (World Heritage Site)                       en    1   e+  0
## 312 Wadden Sea                                                   en    1   e+  0
## 313 Kölner Dom                                                   de    1   e+  0
## 314 Imperial Abbey of Corvey                                     en    1   e+  0
## 315 Schloss Glienicke                                            de    1   e+  0
## 316 Liebfrauenkirche, Trier                                      en    1   e+  0
## 317 St. Michael (Hildesheim)                                     de    1   e+  0
## 318 Rüdesheim am Rhein                                           en    1   e+  0
## 319 Welterbe Kulturlandschaft Oberes Mittelrheintal              de    1   e+  0
## 320 Bremer Roland                                                de    1   e+  0
## 321 Hildesheim Cathedral                                         en    1   e+  0
## 322 Limes Germanicus                                             en    1   e+  0
## 323 Martin Luthers Sterbehaus                                    de    1   e+  0
## 324 Rhine Gorge                                                  en    1   e+  0
## 325 Martin Luthers Geburtshaus                                   de    1   e+  0
## 326 Melanchthonhaus Wittenberg                                   de    1   e+  0
## 327 Regensburg                                                   en    1   e+  0
## 328 Aachener Dom                                                 de    1   e+  0
## 329 Augustusburg and Falkenlust Palaces, Brühl                   en    1   e+  0
## 330 Hufeisensiedlung                                             de    1   e+  0
## 331 Völklinger Hütte                                             de    1   e+  0
## 332 Aachen Cathedral                                             en    1   e+  0
## 333 Schleswig-Holstein Wadden Sea National Park                  en    1   e+  0
## 334 Markgräfliches Opernhaus                                     de    1   e+  0
## 335 Schloss Babelsberg                                           de    1   e+  0
## 336 Amphitheater (Trier)                                         de    1   e+  0
## 337 Bergpark Wilhelmshöhe                                        de    1   e+  0
## 338 Barbarathermen                                               de    1   e+  0
## 339 Church of the Redeemer, Sacrow                               en    1   e+  0
## 340 Holstentor                                                   en    1   e+  0
## 341 Aachener Domschatzkammer                                     de    1   e+  0
## 342 Stralsund                                                    en    1   e+  0

SessionInfo

sessionInfo()

## R version 4.3.1 (2023-06-16)
## Platform: x86_64-pc-linux-gnu (64-bit)
## Running under: Ubuntu 22.04.2 LTS
## 
## Matrix products: default
## BLAS:   /usr/lib/x86_64-linux-gnu/blas/libblas.so.3.10.0 
## LAPACK: /usr/lib/x86_64-linux-gnu/lapack/liblapack.so.3.10.0
## 
## locale:
##  [1] LC_CTYPE=en_US.UTF-8       LC_NUMERIC=C              
##  [3] LC_TIME=en_US.UTF-8        LC_COLLATE=en_US.UTF-8    
##  [5] LC_MONETARY=en_US.UTF-8    LC_MESSAGES=en_US.UTF-8   
##  [7] LC_PAPER=en_US.UTF-8       LC_NAME=C                 
##  [9] LC_ADDRESS=C               LC_TELEPHONE=C            
## [11] LC_MEASUREMENT=en_US.UTF-8 LC_IDENTIFICATION=C       
## 
## time zone: Europe/Berlin
## tzcode source: system (glibc)
## 
## attached base packages:
## [1] stats     graphics  grDevices utils     datasets  methods   base     
## 
## other attached packages:
## [1] future_1.33.0 dplyr_1.1.2   tibble_3.2.1  rectr_0.1.3  
## 
## loaded via a namespace (and not attached):
##  [1] Matrix_1.5-4.1     compiler_4.3.1     stopwords_2.3      tidyselect_1.2.0  
##  [5] Rcpp_1.0.11        parallel_4.3.1     globals_0.16.2     yaml_2.3.7        
##  [9] fastmap_1.1.1      lattice_0.21-8     R6_2.5.1           generics_0.1.3    
## [13] knitr_1.43         nnet_7.3-18        pillar_1.9.0       rlang_1.1.1       
## [17] utf8_1.2.3         fastmatch_1.1-3    stringi_1.7.12     xfun_0.39         
## [21] modeltools_0.2-23  RcppParallel_5.1.7 cli_3.6.1          withr_2.5.0       
## [25] magrittr_2.0.3     digest_0.6.33      grid_4.3.1         mvtnorm_1.2-1     
## [29] flexmix_2.3-19     lifecycle_1.0.3    quanteda_3.3.1     vctrs_0.6.3       
## [33] RSpectra_0.16-1    evaluate_0.21      glue_1.6.2         furrr_0.3.1       
## [37] listenv_0.9.0      codetools_0.2-19   stats4_4.3.1       parallelly_1.36.0 
## [41] fansi_1.0.4        purrr_1.0.1        rmarkdown_2.22     tools_4.3.1       
## [45] pkgconfig_2.0.3    htmltools_0.5.5

rectr's Issues

Obtaining fine-grinded topics?

First of all, thanks for the groundbreak work!

I was trying to get more fine grinded topics with higher k both on the wiki corpus and the corpus of my own (around 60000 news article). However, even though I have set a higher k, I constantly get the following warning message:

Warning message:
In calculate_gmm(wiki_dfm_filtered, seed = 46709394) :
  Cannot converge with a model with k = 20.  Actual k = 3

I am not sure if the low number of topics is due to the dimension reduction in step 3 (filter_dfm()) or the GMM algorithm. I did try to change the multiplication_factor variable to retain more dimensions, but the result is no better.

Here's a reproducible example:

library("rectr")

wiki_corpus <- create_corpus(wiki$content, wiki$lang)
wiki_dfm <- transform_dfm_boe(wiki_corpus, noise = TRUE)
wiki_dfm

wiki_dfm_filtered <- filter_dfm(wiki_dfm, k = 20, multiplication_factor = 2)
wiki_dfm_filtered

wiki_gmm <- calculate_gmm(wiki_dfm_filtered, seed = 46709394)
wiki_gmm

Here's what I get:

20-topic rectr model trained with a dfm with a dimension of 342 x 41 and de/en language(s).
Filtered with k =  20
Aligned word embeddings: bert
Defacto k = 3

sessionInfo:

R version 4.0.2 (2020-06-22)
Platform: x86_64-apple-darwin17.0 (64-bit)
Running under: macOS Catalina 10.15.6

Matrix products: default
BLAS:   /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libBLAS.dylib
LAPACK: /Library/Frameworks/R.framework/Versions/4.0/Resources/lib/libRlapack.dylib

locale:
[1] en_GB.UTF-8/en_GB.UTF-8/en_GB.UTF-8/C/en_GB.UTF-8/en_GB.UTF-8

attached base packages:
[1] stats     graphics  grDevices utils     datasets  methods   base     

other attached packages:
[1] rectr_0.1.3

loaded via a namespace (and not attached):
 [1] reticulate_1.16    modeltools_0.2-23  tidyselect_1.1.0   remotes_2.2.0     
 [5] purrr_0.3.4        lattice_0.20-41    colorspace_1.4-1   vctrs_0.3.4       
 [9] generics_0.0.2     testthat_2.3.2     stats4_4.0.2       usethis_1.6.3     
[13] SnowballC_0.7.0    yaml_2.2.1         rlang_0.4.7        pkgbuild_1.1.0    
[17] pillar_1.4.6       glue_1.4.2         withr_2.3.0        sessioninfo_1.1.1 
[21] lifecycle_0.2.0    munsell_0.5.0      gtable_0.3.0       mvtnorm_1.1-1     
[25] devtools_2.3.2     memoise_1.1.0      callr_3.4.4        ps_1.3.4          
[29] flexmix_2.3-15     fansi_0.4.1        tokenizers_0.2.1   Rcpp_1.0.5        
[33] scales_1.1.1       backports_1.1.10   desc_1.2.0         pkgload_1.1.0     
[37] RcppParallel_5.0.2 jsonlite_1.7.1     RSpectra_0.16-0    fs_1.5.0          
[41] fastmatch_1.1-0    stopwords_2.0      ggplot2_3.3.2      digest_0.6.25     
[45] stringi_1.5.3      processx_3.4.4     dplyr_1.0.2        quanteda_2.1.1    
[49] grid_4.0.2         rprojroot_1.3-2    cli_2.0.2          tools_4.0.2       
[53] magrittr_1.5       tibble_3.0.3       crayon_1.3.4       pkgconfig_2.0.3   
[57] ellipsis_0.3.1     Matrix_1.2-18      data.table_1.13.0  prettyunits_1.1.1 
[61] assertthat_0.2.1   rstudioapi_0.11    R6_2.4.1           nnet_7.3-14       
[65] compiler_4.0.2  

I got similar results when I tried with my own corpus.

On a remotely related note, I am wondering if it would be possible to export the filtered dfm for other algorithrms that might produce fine grind topics? For example, Gaussian LDA, which is an adaptation of LDA that takes in word embeddings (here's python implementation: https://pypi.org/project/gaussianlda/ . I can't find any in R).

Once again, thanks a lot for the great work!

Problems in setup

Hello! Thank you for creating this package, it looks great!

I'm trying to get the setup ready to run some analyses, but I am encountering a problem with the mbert_env_setup() function. When running the function, I get this error:

sh: conda: command not found
Warning message:
In system2("conda", args = c("env", "create", paste0("-f=", system.file("python",  :
  error in running command

Premise: when running it the first time, I did not have Python installed on my computer. After having installed it, the error still pops up. Also, I am a new at Python, but I think that if this is really needed, having a small description about how to install it or how to make it work without any other thing than just following the script would be of great help!

I am not sure whether this is an actual issue of the function, such that this comment could be beneficial to improve it or make it more clear, or if it is my inexperience with Python at making it difficult. In any case, could you help me out with this?

These are my session info:

R version 3.6.3 (2020-02-29)
Platform: x86_64-apple-darwin15.6.0 (64-bit)
Running under: macOS Catalina 10.15.7

Matrix products: default
BLAS:   /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libBLAS.dylib
LAPACK: /Library/Frameworks/R.framework/Versions/3.6/Resources/lib/libRlapack.dylib

locale:
[1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8

attached base packages:
[1] stats     graphics  grDevices utils     datasets  methods   base     

loaded via a namespace (and not attached):
 [1] Rcpp_1.0.5       pillar_1.4.6     compiler_3.6.3   tools_3.6.3      digest_0.6.26    jsonlite_1.7.1  
 [7] evaluate_0.14    memoise_1.1.0    lifecycle_0.2.0  tibble_3.0.4     lattice_0.20-38  pkgconfig_2.0.3 
[13] rlang_0.4.8      Matrix_1.2-18    rstudioapi_0.11  crul_0.9.0       curl_4.3         yaml_2.2.1      
[19] xfun_0.18        httr_1.4.2.9000  dplyr_1.0.2      knitr_1.30       generics_0.0.2   fs_1.5.0        
[25] vctrs_0.3.4      cld3_1.3         grid_3.6.3       tidyselect_1.1.0 reticulate_1.17  glue_1.4.2      
[31] httpcode_0.3.0   R6_2.4.1         rmarkdown_2.4    pacman_0.5.1     rectr_0.1.3      purrr_0.3.4     
[37] magrittr_1.5     osfr_0.2.8.9000  ellipsis_0.3.1   htmltools_0.5.0  stringi_1.5.3    crayon_1.3.4

Add support for BERT

Incompatibility with new version of "future"

I use the FastText option with German and English language texts. When using the "transform_dfm_boe" function (mode="fasttext"), I receive an error.

"Strategy 'multiprocess' is defunct in future (>= 1.32.0) [2023-03-06]. Instead, explicitly specify either 'multisession' (recommended) or 'multicore'."

I tried to change the code for transform_dfm_boe manually to "multiprocess" instead of "multisession" but that leads to a different error, maybe because the new function is not tied to the rectr:: environment:

Error in purrr::as_mapper(fn) :
Object '.gen_doc_embedding' not found.

sessionInfo()

R version 4.2.3 (2023-03-15 ucrt)
Platform: x86_64-w64-mingw32/x64 (64-bit)
Running under: Windows 10 x64 (build 22621)

Matrix products: default

locale:
[1] LC_COLLATE=German_Germany.utf8 LC_CTYPE=German_Germany.utf8 LC_MONETARY=German_Germany.utf8 LC_NUMERIC=C LC_TIME=German_Germany.utf8

attached base packages:
[1] stats graphics grDevices utils datasets methods base

other attached packages:
[1] future_1.32.0 hunspell_3.0.2 rvest_1.0.3 gridExtra_2.3 pbapply_1.6-0 imputeTS_3.3 DescTools_0.99.47 matrixStats_0.62.0 reshape2_1.4.4 zoo_1.8-11
[11] readtext_0.81 stm_1.3.6 udpipe_0.8.10 forcats_0.5.2 purrr_0.3.5 readr_2.1.4 tidyr_1.2.1 ggplot2_3.3.6 tidyverse_1.3.2 stringr_1.5.0
[21] car_3.1-1 carData_3.0-5 quanteda_3.3.0 dplyr_1.0.10 tibble_3.1.8 rectr_0.1.3

loaded via a namespace (and not attached):
[1] googledrive_2.0.0 minqa_1.2.5 colorspace_2.0-3 class_7.3-21 fs_1.5.2 gridtext_0.1.5 ggtext_0.1.2 gld_2.6.6 rstudioapi_0.14
[10] proxy_0.4-27 furrr_0.3.1 listenv_0.9.0 bit64_4.0.5 fansi_1.0.3 mvtnorm_1.1-3 lubridate_1.8.0 ggpattern_1.0.0 xml2_1.3.4
[19] codetools_0.2-19 splines_4.2.3 rootSolve_1.8.2.3 jsonlite_1.8.4 nloptr_2.0.3 broom_1.0.1 dbplyr_2.2.1 png_0.1-8 compiler_4.2.3
[28] httr_1.4.4 backports_1.4.1 assertthat_0.2.1 Matrix_1.5-1 gargle_1.2.1 cli_3.4.1 tools_4.2.3 gtable_0.3.1 glue_1.6.2
[37] lmom_2.9 rappdirs_0.3.3 fastmatch_1.1-3 Rcpp_1.0.9 cellranger_1.1.0 fracdiff_1.5-1 vctrs_0.5.0 urca_1.3-3 nlme_3.1-160
[46] lmtest_0.9-40 timeDate_4021.106 globals_0.16.2 stopwords_2.3 lme4_1.1-30 lifecycle_1.0.3 googlesheets4_1.0.1 MASS_7.3-58.1 scales_1.2.1
[55] vroom_1.6.3 hms_1.1.3 parallel_4.2.3 expm_0.999-6 quantmod_0.4.20 curl_4.3.3 Exact_3.2 reticulate_1.28 stringi_1.7.12
[64] tseries_0.10-52 e1071_1.7-12 TTR_0.24.3 boot_1.3-28.1 rlang_1.0.6 pkgconfig_2.0.3 lattice_0.20-45 stinepack_1.4 bit_4.0.5
[73] tidyselect_1.2.0 parallelly_1.35.0 plyr_1.8.7 magrittr_2.0.3 R6_2.5.1 generics_0.1.3 DBI_1.1.3 pillar_1.9.0 haven_2.5.1
[82] withr_2.5.0 mgcv_1.8-41 xts_0.12.2 abind_1.4-5 nnet_7.3-18 modelr_0.1.9 crayon_1.5.2 utf8_1.2.2 tzdb_0.3.0
[91] grid_4.2.3 readxl_1.4.1 data.table_1.14.4 digest_0.6.30 reprex_2.0.2 forecast_8.18 RcppParallel_5.1.7 munsell_0.5.0 quadprog_1.5-8

function mbert_env_setup() not working on my windows 10 machine.

mbert_env_setup()

This function is not working correctly and there is little information about it on the documentation. It gives no errors but it doesn't create the conda environment. I tried to create a conda environment manually but I get multiple different errors through the process. I was hoping to get some insight on why it might not be setting up the environment on my windows machine.