Skip to content

FEAT: Adding Garak Figsafe Scenario - #2406

Open
Richard Lundeen (rlundeen2) wants to merge 2 commits into
microsoft:mainfrom
rlundeen2:rlundeen2-plan-garak-figstep-scenario
Open

FEAT: Adding Garak Figsafe Scenario#2406
Richard Lundeen (rlundeen2) wants to merge 2 commits into
microsoft:mainfrom
rlundeen2:rlundeen2-plan-garak-figstep-scenario

Conversation

@rlundeen2

Copy link
Copy Markdown
Contributor

Summary

  • Add a Garak-inspired FigStep/FigStep-Pro scenario that reuses PyRIT's grouped visual datasets and PromptSendingAttack.
  • Validate multimodal target capabilities, score harmful compliance, and include a direct-text baseline.
  • Register the FigStep-Pro dataset provider and add tests and documentation.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: 669aaa53-c978-4479-aea3-b2215bb42041
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: 669aaa53-c978-4479-aea3-b2215bb42041
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant