Skip to main content
Ctrl+K

ferret

  • User Guide
  • Reference
  • Release notes
  • Demo
  • GitHub
  • User Guide
  • Reference
  • Release notes
  • Demo
  • GitHub

Section Navigation

  • Benchmark
    • ferret.Benchmark
    • ferret.Benchmark.explain
    • ferret.Benchmark.evaluate_explanation
    • ferret.Benchmark.evaluate_explanations
    • ferret.Benchmark.show_table
    • ferret.Benchmark.show_evaluation_table
    • ferret.Benchmark.show_samples_evaluation_table
    • ferret.Benchmark.load_dataset
    • ferret.Benchmark.evaluate_samples
    • ferret.Benchmark.score
  • Explainers
    • ferret.BaseExplainer
    • ferret.GradientExplainer
    • ferret.IntegratedGradientExplainer
    • ferret.SHAPExplainer
    • ferret.LIMEExplainer
  • Evaluators
    • ferret.BaseEvaluator
    • ferret.AOPC_Comprehensiveness_Evaluation
    • ferret.AOPC_Sufficiency_Evaluation
    • ferret.TauLOO_Evaluation
    • ferret.AUPRC_PlausibilityEvaluation
    • ferret.Tokenf1_PlausibilityEvaluation
    • ferret.TokenIOU_PlausibilityEvaluation
  • Datasets
    • ferret.BaseDataset
    • ferret.HateXplainDataset
    • ferret.MovieReviews
    • ferret.SSTDataset
    • ferret.ThermostatDataset
  • Reference
  • Evaluators

Evaluators#

Abstract Classes#

BaseEvaluator(model, tokenizer, task_name)

Evaluation Methods#

AOPC_Comprehensiveness_Evaluation(model, ...)

AOPC_Sufficiency_Evaluation(model, ...)

TauLOO_Evaluation(model, tokenizer, task_name)

AUPRC_PlausibilityEvaluation(model, ...)

Tokenf1_PlausibilityEvaluation(model, ...)

TokenIOU_PlausibilityEvaluation(model, ...)

previous

ferret.LIMEExplainer

next

ferret.BaseEvaluator

On this page
  • Abstract Classes
  • Evaluation Methods
Show Source

© Copyright 2022, Giuseppe Attanasio.

Created using Sphinx 7.2.6.

Built with the PyData Sphinx Theme 0.15.2.

Built with the PyData Sphinx Theme 0.15.2.