Skip to content

Removing private parameter from __call__ of AdversarialSimulator #37709

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
nagkumar91 merged 9 commits into from
Oct 3, 2024
Merged

Removing private parameter from __call__ of AdversarialSimulator #37709

Changes from 1 commit
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
7de6367
Update task_query_response.prompty
nagkumar91 Oct 1, 2024
f288b34
Update task_simulate.prompty
nagkumar91 Oct 1, 2024
2a4b6f7
Update task_query_response.prompty
nagkumar91 Oct 2, 2024
c8ce251
Update task_simulate.prompty
nagkumar91 Oct 2, 2024
4522ae4
Merge branch 'Azure:main' into main
nagkumar91 Oct 3, 2024
e672f62
Remove private variable and use kwargs
Oct 3, 2024
1c59d3e
Add experimental tag to adv sim
Oct 3, 2024
dbb27e8
format with black
Oct 3, 2024
774d8e6
Fix the pylint issues
Oct 3, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Remove private variable and use kwargs
  • Loading branch information
Nagkumar Arkalgud committed Oct 3, 2024
commit e672f62913bd460ec5cc3ee0a0d5640731ea3a1d
3 changes: 2 additions & 1 deletion sdk/evaluation/azure-ai-evaluation/azure/ai/evaluation/simulator/_adversarial_simulator.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -106,10 +106,10 @@ async def __call__(
api_call_retry_sleep_sec: int = 1,
api_call_delay_sec: int = 0,
concurrent_async_task: int = 3,
_jailbreak_type: Optional[str] = None,
language: SupportedLanguages = SupportedLanguages.English,
randomize_order: bool = True,
randomization_seed: Optional[int] = None,
**kwargs,
):
"""
Executes the adversarial simulation against a specified target function asynchronously.
Expand Down Expand Up @@ -216,6 +216,7 @@ async def __call__(
total_tasks,
)
total_tasks = min(total_tasks, max_simulation_results)
_jailbreak_type = kwargs.get("_jailbreak_type", None)
if _jailbreak_type:
jailbreak_dataset = await self.rai_client.get_jailbreaks_dataset(type=_jailbreak_type)
progress_bar = tqdm(
Expand Down