Can't wait to see how these AI models hold up against a weekend of red-teaming by infosec's village people
This year's DEF CON AI Village has invited hackers to show up, dive in, and find bugs and biases in large language models built by OpenAI, Google, Anthropic, and others.
The collaborative event, which AI Village organizers describe as"the largest red teaming exercise ever for any group of AI models," will host"thousands" of people, including"hundreds of students from overlooked institutions and communities," all of whom will be tasked with finding flaws in LLMs that power today's chat bots and generative AI.
Think: traditional bugs in code, but also problems more specific to machine learning, such as bias, hallucinations, and jailbreaks — all of which ethical and security professionals are now having to grapple with as these technologies scale.The diverse issues with these models will not be resolved until more people know how to red team and assess them
"Traditionally, companies have solved this problem with specialized red teams. However this work has largely happened in private," said Sven Cattell, the founder of AI Village, in a."The diverse issues with these models will not be resolved until more people know how to red team and assess them." The data scientist wants to see bug bounties and live hacking events modified in general to fit in ML model-based systems."These fill two needs with one deed, addressing the harms and growing the community of researchers that know how to help," Cattell said.
Danmark Seneste Nyt, Danmark Overskrifter
Similar News:Du kan også læse nyheder, der ligner denne, som vi har indsamlet fra andre nyhedskilder.
Microsoft could be planning to let widgets loose on the Windows 11 desktopSet free from their panel prison – assuming you want that
Læs mere »
Promise of 'spectacular' coronation celebrations as King Charles III prepares to be crownedToday's historic event includes a procession and military flypast, as thousands of street parties are set to take place to celebrate the first coronation in 70 years.
Læs mere »
Coronation day: Promise of 'spectacular' celebrations as King Charles III prepares to be crownedToday's historic event includes a procession and military flypast, as thousands of street parties are set to take place to celebrate the first coronation in 70 years.
Læs mere »