fudge / infowars Goto Github PK

Hi, first of all, thank you for this amazing work!!! I'm about to do some analysis on this corpus but there is one issue: some transcripts do not have any punctuations, for example, 20150722_Wed_Alex.txt. And it seems to happen randomly? It might mess up some of my NLP pipelines. Do you have any insights into this issue, or if any amendments could be done? Thanks in advance!

https://github.com/Fudge/infowars/blob/a21ad52e789e5c9a2a99e8270795cb6fa0e23173/20210408_Thu_Alex.txt#L2702C10-L2702C10

mission impossible -> Mission Impossible

malthusian -> Malthusian

tom cruise -> Tom Cruise

salk -> ?

mceltra -> MK ultra

fritof capra -> ?

fritoff / fritof / frito -> Friedhoff (?)

arnold schwarzenegger -> Arnold Schwarzenegger

lsd -> LSD

cia -> CIA

mk -> MK

port detrick -> Fort Detrick

elf -> ELF

vlf -> VLF

claus -> Klaus

cheeto capra -> ?

arthur kessler / arthur kesler -> Arthur Kessler (?)

ghost in the machine -> Ghost In The Machine

9 11 -> 9/11

london 7 7 bombing -> london 7/7 bombing

the fizer consultant -> the Pfizer consultant (?)

norbert weiner -> ?

america -> America

info wars -> infowars

info war -> infowar

the un -> the UN

claus Schwab / claus wobb -> Klaus Schwab

davos -> Davos

will economic forum -> World Economic Forum

world economic forum -> World Economic Forum

johns hawkins -> Johns Hawkins (?)

bill berg -> Bilderberg

event 201 -> Event 201

lockstep -> Lockstep

crimson contagion -> Crimson Contagion (?)

glade clade x -> Glade Clade X

disease x -> Disease X

cdc -> CDC

pr names -> PR names

GMO cold virus -> GMO called "virus"

spars -> SARS

run DMC -> Run DMC

perembleh health -> ?

bill gates -> Bill Gates

us government -> US government

imf -> IMF

when you reach wobb -> when you read Schwab

buy the products and then forward store dot com -> buy the products at infowarsstore.com

infowarstore.com -> infowarsstore.com

alex jones -> Alex Jones

alex -> Alex

dr richard day -> Dr. Richard Day

the day tapes -> The Day Tapes

the doctor day tapes -> The Doctor Day Tapes

cia connected guys gordon -> ?

darpa -> DARPA

rockefeller foundation -> Rockefeller Foundation

planned parenthood -> Planned Parenthood

pro life league -> Pro Life League

catholic -> Catholic

there will be total societal societal breakdown -> there will be total societal breakdown

mind control conference -> Mind Control Conference

dr holger heiden -> Dr. Holger Heiden (?)

they're just they're just high level social engineered -> they're just high level social engineering