I finally made the meme I've had in my head for over a year
Artificial intelligence is worse than humans in every way at summarising documents and might actually create additional work for people, a government trial of the technology has found. Amazon conducted the test earlier this year for Australia’s corporate regulator the Securities and Investments Commission (ASIC) using submissions made to an inquiry. The outcome of the trial was revealed in an answer to a questions on notice at the Senate select committee on adopting artificial intelligence. The test involved testing generative AI models before selecting one to ingest five submissions from a parliamentary inquiry into audit and consultancy firms. The most promising model, Meta’s open source model Llama2-70B, was prompted to summarise the submissions with a focus on ASIC mentions, recommendations, references to more regulation, and to include the page references and context. Ten ASIC staff, of varying levels of seniority, were also given the same task with similar prompts. Then, a group of reviewers blindly assessed the summaries produced by both humans and AI for coherency, length, ASIC references, regulation references and for identifying recommendations. They were unaware that this exercise involved AI at all. These reviewers overwhelmingly found that the human summaries beat out their AI competitors on every criteria and on every submission, scoring an 81% on an internal rubric compared with the machine’s 47%. Human summaries ran up the score by significantly outperforming on identifying references to ASIC documents in the long document, a type of task that the report notes is a “notoriously hard task” for this type of AI. But humans still beat the technology across the board. Reviewers told the report’s authors that AI summaries often missed emphasis, nuance and context; included incorrect information or missed relevant information; and sometimes focused on auxiliary points or introduced irrelevant information. Three of the five reviewers said they guessed that they were reviewing AI content. The reviewers’ overall feedback was that they felt AI summaries may be counterproductive and create further work because of the need to fact-check and refer to original submissions which communicated the message better and more concisely.
3 September 2024
[Blanche]
Extremely rough late-night sketches for me to get to know one of my MCs (info post to be shared sometime later).
Props to whoever recognizes the dialogue I’m referencing in the fourth image :)
Trick or treat, but we pull up a UNO reverse card (whatever that does, we've only once played UNO and forgot everything about it), and we give you this plastic pony we took a photo of once at night.
He says you seem nice so he won't eat your soul :33
i humbly accept this marvelous gift 😁
Want to help an unemployed college student that's not allowed to have a job and get a super swaglistic drawing for real fricking cheap and eternal gratitude in return?? Then I'm your guy!!
PLS PLS I'LL DO ANYTHING AAAA (I'm new to using PayPal and Ko-fi so pls be patient, I will ask questions 😭)
will you update your “about the artist” reel now that it’s been a long time
yeah definitely, just probably more in the ballpark of october-november both so it’s been closer to a full year since upload and also since in the meantime i have health shit to deal with :p