Skip to content

Replicating baselines form Paper #3

Description

@DanielRoeder1

Hi,

I am really interested in your paper and I am trying to replicate some baselines of yours to compare to. In the paper you state parametric models as one of the baselines. Am I correct in understanding that parametric models receive the questions as input and are tasked with generating the output? (i.e. no knowledge in form of context passages is fed to the model)

If this is the case I am struggling to reach the same kind of EM / F1 on these baselines (specifically t5-base). Any advise is welcome1

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions