metadata

language: en
license: apache-2.0
library_name: setfit
tags:
  - setfit
  - sentence-transformers
  - text-classification
  - generated_from_setfit_trainer
base_model: sentence-transformers/paraphrase-mpnet-base-v2
metrics:
  - accuracy
  - precision
  - recall
  - f1
widget:
  - text: >-
      a cinematic masterpiece.. i can't believe my eyes what just i experienced
      in theatre, this movie is one of the best cinematic experience i've ever
      had.. from opening scene to end credit every second is worth it.. epic
      score by hans zimmer elevates the experience, filled with beautiful shots
      and cinematography to a great scrrenplay and some top notch acting by
      every cast member dune 2 will be remembered as one of the best films of
      this generation even after 50 years later that's my guarantee.. denis
      villeneuve is one of the best director of this generation who gave us
      masterpiece like blade runner 2049 and currently working on 3rd part of
      this trilogy which i can't wait to see.. action scenes were great
      featuring big ships, blasters laser guns and every other kind of weapons,
      sound effects were amazing but most importantly screenplay was well paced
      and story featuring blend of sci fi and fantasy elements is absolute best
      of the best even though it is an adaptation of 1965 novel of same name it
      is one of the best adaptations ever.. i loved both movies and can't wait
      to see what happens in future because i enjoy films about the chosen one
      prophecy like star wars, the matrix and now this.. i won't give any
      spoiler here and will not talk about anything shown in the movie since you
      need to see this movie for yourself to feel the magic.. don't miss it at
      any cost.. watch it on the biggest screen possible especially imax to
      enjoy epic sound effects and see the larger than life picture you'll love
      it..
  - text: >-
      hopeful for the future of this franchise this one's very personal for me
      since i've been invested in this franchise for years now and all the
      waiting throughout the production of both parts, considering the multiple
      delays, have been worthwhile and it only enriched the experience, so it's
      really hard for me to not sound like an absolute fanboy.every tidbit of
      news from the start of the production only fueled my excitement, from cast
      and crew announcements to first look reveals to teasers and trailers which
      i probably watched and obsessively dissected dozens of times. which always
      put at rest my lore obsessed brain because it all made sense, i could tell
      from the beginning that both parts were crafted by people who understood
      and cared about the source material without approaching it like some sort
      of sacred text. on that note i was quite surprised and pleased by the
      changes they did with characters, timeline and most specifically the
      ending, which only left me wanting more.despite the fact that
      unfortunately my local cinema doesn't have imax screens the experience was
      an absolute blast and i was nothing short of euphoric with a stupid grin
      the entire movie it felt surreal and overwhelming at times taking it all
      in. i loved how it expanded from the themes established in the first one,
      particularly the detailed exploration of fremen culture, how ominous and
      mysterious felt the bene gesserit, as for the harkonnens besides the
      obvious praise for how brutal, weird and cool they're portrayed i
      particularly appreciated the h. r giger inspired look of their black sun
      lit giedi prime. all while staying true to the essence of the story.with a
      chunky and lengthy runtime its impossible for me to pinpoint favorite
      moments. my jaw dropped at the sheer scale of many sequences, namely the
      opening scene with the orange hues and the levitating harkonnens, also the
      gladiator scene, the big feyd-rautha entrance was bonkers the fighting
      choreography felt natural and realistic and well thought out, tho i gotta
      admit i was iffy at first but ultimately pleasantly surprised by austin's
      feyd-rautha.overall, the performances, direction, music, sound design,
      cinematography, and production design were outstanding. the themes of
      fanaticism and the difficulty of reasoning with true believers resonated
      deeply with me. plus, getting to watch it with three of my favorite people
      made the movie watching experience even more lovely. dune part two
      exceeded my every expectations and left me eagerly awaiting the next
      installment. i can confidently say that this is the perfect dune
      adaptation.
  - text: >-
      disappointing like seriously... what the hell was that? :-( first part was
      mostly on point... but the second part?? why alter perfection?it totally
      missed in my opinion. the nukes were used for the shields, not for the
      spice. the water of life was meant to be used for the spice... the great
      houses came together with the emperor, why was this changed? where is the
      baby? where is the sister? why was the guild cut out all together? where
      is the scene between. gurney and lady jessica. all this gave context to
      the story what now went totally missing.as it was cut together now, the
      only thing truly great about the movie was the sound editing. this gave a
      great atmosphere. i in general like villeneuve alot, sicario is one of the
      top3 the greatest movies ever made, but this was disappointing.
  - text: >-
      dune 1 & 2 are probably the best sci-fi movies ever... yes, dune 1 & 2 are
      probably the best sci-fi movies ever. i can't really come up with anything
      else that would beat these anyway.part two was a nice continuation to part
      one, however i felt the last part of the movie could have been better or
      maybe it just went too fast. without spoiling its hard to explain. also
      missed some more insight about the mother and a lot of other things as
      well... imagine if this could have been a 20 episode serie with same
      quality!anyhow visually and the main cast were just excellent. i did
      expect more out of the emperor christofer walken.just love the tonality of
      the entire movie and the sound and music made it masterful.please more of
      these "adult" epic sci-fi movies and series!
  - text: >-
      great movie with holes in the plot dune 2 is a great movie that can be
      enjoyed despite some holes in the plot and questionable story elements.
      the movie is great visually and serves as an example of how cgi doesn't
      have to make a movie seem sterile and fake, or like watching a video game
      like the new brand of marvel movies and aquaman do.the cast is great -
      christopher walken should have had more scenes and other than it being
      him, his performance was not unique in any way - and there is a non
      credited appearance that i'm not going to spoil that is a wow!the movie is
      long, but there's a difference between long and too long, and any movie
      that wants to be an epic. 2 out of 5 found this helpful. was this review
      helpful? sign in to vote. permalink
pipeline_tag: text-classification
inference: true
model-index:
  - name: >-
      SetFit with sentence-transformers/paraphrase-mpnet-base-v2 on
      data/raw/15239678.jsonl
    results:
      - task:
          type: text-classification
          name: Text Classification
        dataset:
          name: data/raw/15239678.jsonl
          type: unknown
          split: test
        metrics:
          - type: accuracy
            value: 0.8246753246753247
            name: Accuracy
          - type: precision
            value: 0.9915611814345991
            name: Precision
          - type: recall
            value: 0.818815331010453
            name: Recall
          - type: f1
            value: 0.8969465648854962
            name: F1

SetFit with sentence-transformers/paraphrase-mpnet-base-v2 on data/raw/15239678.jsonl

This is a SetFit model that can be used for Text Classification. This SetFit model uses sentence-transformers/paraphrase-mpnet-base-v2 as the Sentence Transformer embedding model. A LogisticRegression instance is used for classification.

The model has been trained using an efficient few-shot learning technique that involves:

Fine-tuning a Sentence Transformer with contrastive learning.
Training a classification head with features from the fine-tuned Sentence Transformer.

Model Details

Model Description

Model Type: SetFit
Sentence Transformer body: sentence-transformers/paraphrase-mpnet-base-v2
Classification head: a LogisticRegression instance
Maximum Sequence Length: 512 tokens
Number of Classes: 2 classes
Language: en
License: apache-2.0

Model Sources

Repository: SetFit on GitHub
Paper: Efficient Few-Shot Learning Without Prompts
Blogpost: SetFit: Efficient Few-Shot Learning Without Prompts

Model Labels

Label	Examples
negative	"it's like watching a cult and not really a good movie. sorry not for me. all the characters gave justice on their roles, well executed. the pace of the story is so slow that it made me so sleepy in the middle of the film. actually the film made me bored coz i expected more but a lousy story. i would like to mention rebecca ferguson, she's a great actress and really fit to be the lady jessica itself. in the middle of the film, me and three of my friends wanted to go home coz it feels like we're watching a cult movie. not a good one for children's to watch. in this movie, nothing much to expect, such a waste of time and it was a very boring film fighting for a spice. 19 out of 100 found this helpful. was this review helpful? sign in to vote. permalink" 'the avengers-era "cinema" for a call of duty generation i watched dune: part two on imax (as seems befitting that sort of big-budget picture), in pretty good seats considering the house was packed with a diverse crowd of young adults for the late-night showing.my review of the first of denis villeneuve's adaptations was that it was pretty to look at, but basically uninteresting in its plot, a major let-down considering how hyped the books have been, when on the screen they're no better than star wars. this second one exhibits those same features, but worse.this is basically an action movie--a genre which i'm fundamentally uninterested in--which seems at odds with all the talk of dune being characterized by complex political & economic maneuvering--of which this film does include some, albeit parenthetically. the scenes are impressionistic in their pacing and content, and expressionistic in that the photography & score are more about attempting to convey emotionality, or at least get the adrenaline pumping, than any sort of profound characterizations or themes. this is lawrence of arabia in space but with the cold war as the contemporary allegory. that sort of story would still have been resonant during the post-9/11 era, but we've moved on from those wars by now into an altogether different geopolitics and political economy.the monumentalism of the shots can be impressive, and certainly the design of the mechanical vehicles is (in addition to the still-eye candy costumes), but there are too many moments where it's like watching a video game cut-scene, or even a video game playing out (c.f. the entire opening sequence). cinema is going backwards when that's the case. and there are some egregious dissonances in the sound design, most of all in the various accents the actors were allowed to use, which takes us out of the suspension of disbelief, but also in the over-application of non-diegetic score, which treats the audience as dumb emotions-receptacles, during scenes that by-and-large do not earn such responses.(the only outstanding sequence of the film is when paul attempts his first worm-ride, which is almost as exhilirating as the roller coaster ride it attempts to be for us on screen.)there are also weird dissonances in this film attempting to be humorous, as the on-again off-again nature of those lines (and how they're delivered) feel like a wink to the audience that this allegory of abrahamic religions co-opting a people's revolution--albeit against a totalitarian capitalist empire, mixing all kinds of economic stages of history, much as the genres of swords & planets and sci-fi and fantasy are mixed--is not to be taken too seriously in our secular times. but then, what are we to take from this "epic"?' "try as hard as you like i left feeling bored, and that's a bad sign for an epic sci-fi. i watched dune i and loved it, the deep sonorous sounds of an alien nation were exciting, and the dialogue kept minimal and thick. dune ii blasts you with ott noise, over the top effects, and piss poor dialogue... 'for the duke, and my friends' i felt this movie was aimed at a pre-teen audience with spiderman fetish and a heavy hand of americanism... the emperor was not an emperor. recommend putting a human written storyline first and leave ai/cgi to a bare minimum. i watched dune 20 years ago and loved it. i read dune 30 years ago and loved it. the actors tried hard with what they got but it wasn't enough to make it a masterpiece, it's more like an aprenticepiece."
positive	"best movie in recent years. the movie is a more impressive, more exciting and deeper production than the first part. give it 9 out of 10.the acting, visual effects, music and atmosphere in the movie are amazing. paul's evolution is perfectly demonstrated by timothee chalamet.the visual effects deliver a breathtaking rendering of arrakis' desert landscapes, giant worms, and battle scenes. you can smell the scent of a spice behind curtain.music adds soul to the film with the mastery of hans zimmer. the atmosphere is to keep tension and emotion at a high level throughout the film.while the film's script remains faithful to the book, it also offers some differences. while some changes make the film better, others do not fit the spirit of the book. however, i can honestly say that the changes made do not harm the film at all.dune: part two is one of the masterpieces of science fiction cinema. it's the best movie i've seen in nearly 15 years. maybe oppenheimer.nah, this movie is better." "best movie ever what a movie!!!!!!!!!!the whole movie is so good! the setting is amazing. the story is so good. and the plot and the premise is amazing my favorite characters are paul and chani. this whole movie is seeking revenge from the darkness and the evil that was causing the world to collapse. and following that they decide just like on star wars to choose what side they're on the light side or the dark side. and man the cliffhanger of the movie was the most shocking thing ever. the whole movie is a very well done movie. i love this movie so much it gave me chills. this movie will get the best picture next year for the oscars. 0 out of 0 found this helpful. was this review helpful? sign in to vote. permalink" "very spicey! undoubtedly one of the greatest cinematic experiences i've ever had. most movies nowadays try to wow you with either visuals, action, character development, and seemingly less and less so everyday with a reasonable plot. this movie manages to check off every box. it is hard to pinpoint an actor in it that wasn't superb in their role. the visual effects, especially in imax , are stunning and are not simply artistic in nature, but actually work to advance the plot.the film is pieced together so brilliantly with each act seamlessly fitting in with the last. the score by zimmer is unsurprisingly absolute perfection as well.for the length of the movie it actually feels quite short which is a huge achievement and shows how immersed you become in villneuve's world.however, i would have liked to see more of feyd rautha. they had an epic scene of his in the harkonnen arena, but not too much else to develop him for his final battle against paul. i also would have liked to see the sardaukar put up a little better of a fight. they somehow went from the empires greatest fighters to pretty pathetic. perhaps this was to show how strong paul and his forces had become, but it just seemed a bit too easy. still these are just personal aspects i would have liked to see and are not issues in the movie itself.overall, an epic movie, and the trilogy is likely to be sitting right alongside the lord of the rings and the original star wars movies when all is said and done.this is a can't miss in imax."

Label

Examples

negative

"it's like watching a cult and not really a good movie. sorry not for me. all the characters gave justice on their roles, well executed. the pace of the story is so slow that it made me so sleepy in the middle of the film. actually the film made me bored coz i expected more but a lousy story. i would like to mention rebecca ferguson, she's a great actress and really fit to be the lady jessica itself. in the middle of the film, me and three of my friends wanted to go home coz it feels like we're watching a cult movie. not a good one for children's to watch. in this movie, nothing much to expect, such a waste of time and it was a very boring film fighting for a spice. 19 out of 100 found this helpful. was this review helpful? sign in to vote. permalink"
'the avengers-era "cinema" for a call of duty generation i watched dune: part two on imax (as seems befitting that sort of big-budget picture), in pretty good seats considering the house was packed with a diverse crowd of young adults for the late-night showing.my review of the first of denis villeneuve's adaptations was that it was pretty to look at, but basically uninteresting in its plot, a major let-down considering how hyped the books have been, when on the screen they're no better than star wars. this second one exhibits those same features, but worse.this is basically an action movie--a genre which i'm fundamentally uninterested in--which seems at odds with all the talk of dune being characterized by complex political & economic maneuvering--of which this film does include some, albeit parenthetically. the scenes are impressionistic in their pacing and content, and expressionistic in that the photography & score are more about attempting to convey emotionality, or at least get the adrenaline pumping, than any sort of profound characterizations or themes. this is lawrence of arabia in space but with the cold war as the contemporary allegory. that sort of story would still have been resonant during the post-9/11 era, but we've moved on from those wars by now into an altogether different geopolitics and political economy.the monumentalism of the shots can be impressive, and certainly the design of the mechanical vehicles is (in addition to the still-eye candy costumes), but there are too many moments where it's like watching a video game cut-scene, or even a video game playing out (c.f. the entire opening sequence). cinema is going backwards when that's the case. and there are some egregious dissonances in the sound design, most of all in the various accents the actors were allowed to use, which takes us out of the suspension of disbelief, but also in the over-application of non-diegetic score, which treats the audience as dumb emotions-receptacles, during scenes that by-and-large do not earn such responses.(the only outstanding sequence of the film is when paul attempts his first worm-ride, which is almost as exhilirating as the roller coaster ride it attempts to be for us on screen.)there are also weird dissonances in this film attempting to be humorous, as the on-again off-again nature of those lines (and how they're delivered) feel like a wink to the audience that this allegory of abrahamic religions co-opting a people's revolution--albeit against a totalitarian capitalist empire, mixing all kinds of economic stages of history, much as the genres of swords & planets and sci-fi and fantasy are mixed--is not to be taken too seriously in our secular times. but then, what are we to take from this "epic"?'
"try as hard as you like i left feeling bored, and that's a bad sign for an epic sci-fi. i watched dune i and loved it, the deep sonorous sounds of an alien nation were exciting, and the dialogue kept minimal and thick. dune ii blasts you with ott noise, over the top effects, and piss poor dialogue... 'for the duke, and my friends' i felt this movie was aimed at a pre-teen audience with spiderman fetish and a heavy hand of americanism... the emperor was not an emperor. recommend putting a human written storyline first and leave ai/cgi to a bare minimum. i watched dune 20 years ago and loved it. i read dune 30 years ago and loved it. the actors tried hard with what they got but it wasn't enough to make it a masterpiece, it's more like an aprenticepiece."

positive

"best movie in recent years. the movie is a more impressive, more exciting and deeper production than the first part. give it 9 out of 10.the acting, visual effects, music and atmosphere in the movie are amazing. paul's evolution is perfectly demonstrated by timothee chalamet.the visual effects deliver a breathtaking rendering of arrakis' desert landscapes, giant worms, and battle scenes. you can smell the scent of a spice behind curtain.music adds soul to the film with the mastery of hans zimmer. the atmosphere is to keep tension and emotion at a high level throughout the film.while the film's script remains faithful to the book, it also offers some differences. while some changes make the film better, others do not fit the spirit of the book. however, i can honestly say that the changes made do not harm the film at all.dune: part two is one of the masterpieces of science fiction cinema. it's the best movie i've seen in nearly 15 years. maybe oppenheimer.nah, this movie is better."
"best movie ever what a movie!!!!!!!!!!the whole movie is so good! the setting is amazing. the story is so good. and the plot and the premise is amazing my favorite characters are paul and chani. this whole movie is seeking revenge from the darkness and the evil that was causing the world to collapse. and following that they decide just like on star wars to choose what side they're on the light side or the dark side. and man the cliffhanger of the movie was the most shocking thing ever. the whole movie is a very well done movie. i love this movie so much it gave me chills. this movie will get the best picture next year for the oscars. 0 out of 0 found this helpful. was this review helpful? sign in to vote. permalink"
"very spicey! undoubtedly one of the greatest cinematic experiences i've ever had. most movies nowadays try to wow you with either visuals, action, character development, and seemingly less and less so everyday with a reasonable plot. this movie manages to check off every box. it is hard to pinpoint an actor in it that wasn't superb in their role. the visual effects, especially in imax , are stunning and are not simply artistic in nature, but actually work to advance the plot.the film is pieced together so brilliantly with each act seamlessly fitting in with the last. the score by zimmer is unsurprisingly absolute perfection as well.for the length of the movie it actually feels quite short which is a huge achievement and shows how immersed you become in villneuve's world.however, i would have liked to see more of feyd rautha. they had an epic scene of his in the harkonnen arena, but not too much else to develop him for his final battle against paul. i also would have liked to see the sardaukar put up a little better of a fight. they somehow went from the empires greatest fighters to pretty pathetic. perhaps this was to show how strong paul and his forces had become, but it just seemed a bit too easy. still these are just personal aspects i would have liked to see and are not issues in the movie itself.overall, an epic movie, and the trilogy is likely to be sitting right alongside the lord of the rings and the original star wars movies when all is said and done.this is a can't miss in imax."

Evaluation

Metrics

Label	Accuracy	Precision	Recall	F1
all	0.8247	0.9916	0.8188	0.8969

Uses

Direct Use for Inference

First install the SetFit library:

pip install setfit

Then you can load this model and run inference.

from setfit import SetFitModel

# Download from the 🤗 Hub
model = SetFitModel.from_pretrained("carlesoctav/SentimentClassifierDune-8shot")
# Run inference
preds = model("great movie with holes in the plot dune 2 is a great movie that can be enjoyed despite some holes in the plot and questionable story elements. the movie is great visually and serves as an example of how cgi doesn't have to make a movie seem sterile and fake, or like watching a video game like the new brand of marvel movies and aquaman do.the cast is great - christopher walken should have had more scenes and other than it being him, his performance was not unique in any way - and there is a non credited appearance that i'm not going to spoil that is a wow!the movie is long, but there's a difference between long and too long, and any movie that wants to be an epic. 2 out of 5 found this helpful. was this review helpful? sign in to vote. permalink")

Training Details

Training Set Metrics

Training set	Min	Median	Max
Word count	121	271.5	993

Label	Training Sample Count
negative	8
positive	8

Training Hyperparameters

batch_size: (16, 16)
num_epochs: (1, 1)
max_steps: -1
sampling_strategy: oversampling
body_learning_rate: (2e-05, 1e-05)
head_learning_rate: 0.01
loss: CosineSimilarityLoss
distance_metric: cosine_distance
margin: 0.25
end_to_end: False
use_amp: False
warmup_proportion: 0.1
seed: 42
eval_max_steps: -1
load_best_model_at_end: True

Training Results

Epoch	Step	Training Loss	Validation Loss
0.1111	1	0.2058	-
1.0	9	-	0.2368

The bold row denotes the saved checkpoint.

Framework Versions

Python: 3.10.11
SetFit: 1.0.3
Sentence Transformers: 2.5.1
Transformers: 4.38.2
PyTorch: 2.0.1
Datasets: 2.18.0
Tokenizers: 0.15.2

Citation

BibTeX

@article{https://doi.org/10.48550/arxiv.2209.11055,
    doi = {10.48550/ARXIV.2209.11055},
    url = {https://arxiv.org/abs/2209.11055},
    author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
    keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
    title = {Efficient Few-Shot Learning Without Prompts},
    publisher = {arXiv},
    year = {2022},
    copyright = {Creative Commons Attribution 4.0 International}
}