ipl-logo

Topic Modeling

.pdf
School
Virginia Tech**We aren't endorsed by this school
Course
JMC 4064
Subject
Industrial Engineering
Date
Dec 17, 2024
Pages
30
Uploaded by AgentElement15241
Topic Modeling
Background image
What are the major topics being discussed?
Background image
https://foundationinc.co/lab/reddit-statistics/
Background image
Topic Modeling
Background image
Background image
Background image
Background image
Latent Dirichlet Allocation (LDA)
Background image
Latent Dirichlet Allocation (LDA)
Background image
Latent Dirichlet Allocation (LDA)Multinomial distribution!!
Background image
Latent Dirichlet Allocation (LDA)
Background image
Latent Dirichlet Allocation (LDA)
Background image
Latent Dirichlet Allocation (LDA)
Background image
Latent Dirichlet Allocation (LDA)
Background image
Latent Dirichlet Allocation (LDA)
Background image
Latent Dirichlet Allocation (LDA)
Background image
Latent Dirichlet Allocation (LDA)
Background image
Background image
Background image
What parameters are we exactly learning?
Background image
Drawing Topic DistributionsDocument= Multinomial distribution of topics with alpha
Background image
Drawing Word DistributionsTopic = Multinomial distribution of words with beta
Background image
Alpha and Beta are just hyperparameters not something themodel learnt
Background image
Demo https://neptune.ai/blog/pyldavis-topic-modelling-exploration-tool-that-every-nlp-data-scientist-should-knowAny similarity with traditional ML techniques?
Background image
Qualitative analysis and feature engineeringRuijie Xi and Munindar P. Singh. "The Blame Game: Understanding Blame Assignment in Social Media." 6(((ADYNQ^UZNQPS[YP_V^UZ _V^U &_V]T`W\[NQ[YP_V^UNQ\S @_VPSYPNQ\S @`Z[RUL]TZ11, no. 2 (2023): 2267-2276.
Background image
Evaluation of TopicsCoherence metricThere is alsoan extrinsic versionhttps://qpleple.com/topic-coherence-to-evaluate-topic-models/
Background image
How to Decide Number of TopicsNumber of topicsCoherence
Background image
How to Decide Other HyperparametersOnce K is final:Iterate over different values of alpha and beta Choose the values giving the best coherence
Background image
Enjoy and let me enjoy as well!
Background image
Some Slides from Future MojoAcknowledgements
Background image