<![CDATA["Artificial intelligence (AI)" and the law thread 🧵]]>"Artificial intelligence (AI)" and the law thread 🧵

(Really large language models (LLM), not AI, but I'll never find the thread if I don't put "AI" in it)

]]>https://wanderingadventure.party/topic/fd31377a-321d-4c54-9cbd-0e9bee5d01cc/artificial-intelligence-ai-and-the-law-threadRSS for NodeFri, 31 Jul 2026 22:14:08 GMTTue, 27 Feb 2024 13:03:19 GMT60<![CDATA[Reply to "Artificial intelligence (AI)" and the law thread 🧵 on Mon, 06 Jul 2026 14:22:51 GMT]]>Of the about 9 cases it said it could not find citations for, I found 6.

This is basic, basic work right here. Not even research. And this thing cannot do it.

]]>https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116873479556865939https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116873479556865939Mon, 06 Jul 2026 14:22:51 GMT<![CDATA[Reply to "Artificial intelligence (AI)" and the law thread 🧵 on Mon, 06 Jul 2026 14:02:53 GMT]]>I just asked CoPilot to check names of cases and provide me with links as a test. After six queries, it made two lists, one “confirmed CanLII links” and the second unconfirmed but likely links.

The very first item on the “confirmed” link was incorrect.

Its output:

"Clean master list of CanLII links

Confirmed CanLII URLs

Animal House Investments Inc. v. Lisgar Development Ltd. (2007), 2007 CanLII 82794 (ON SC): https://canlii.ca/t/1x827"

]]>https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116873401053382833https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116873401053382833Mon, 06 Jul 2026 14:02:53 GMT<![CDATA[Reply to "Artificial intelligence (AI)" and the law thread 🧵 on Thu, 25 Jun 2026 13:16:08 GMT]]>This appears to be a huge waste of time and money and energy and this isn't anything I would pay for.

I think I've pointed out elsewhere that when I ran a search in the AI search box versus the regular search box, I basically got the same results back.

I presume the tests that they run these things against are tailored to produce great results and that's how they conclude that they're operating at a PhD level. Because it's giving me garbage.

]]>https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116810931817835397https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116810931817835397Thu, 25 Jun 2026 13:16:08 GMT<![CDATA[Reply to "Artificial intelligence (AI)" and the law thread 🧵 on Thu, 25 Jun 2026 12:17:46 GMT]]>We just tested* a legal LLM and at least about 1 3rd of the cases it returned were not relevant to the question or the cases did not exist.

I tested it filing in citations only and it seemed to do that reasonably well but it still got two wrong. This was just looking up the actual citations of a case with a given name.

(Edit: *I should clarify that this thing came bundled in another service we already have. So this is not a service we sought out. It was shoved into my face.)

]]>https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116810702263013629https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116810702263013629Thu, 25 Jun 2026 12:17:46 GMT<![CDATA[Reply to "Artificial intelligence (AI)" and the law thread 🧵 on Fri, 12 Jun 2026 02:21:49 GMT]]>"Aycock barred the lawyers on each side who either used AI for legal research or for drafting the filings at issue — Kathleen Wilson and Kathryn Williams — from appearing in the Northern District of Mississippi for two years. Wilson was fined $2,500, and Williams was fined $3,500."

]]>https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116734748852668899https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116734748852668899Fri, 12 Jun 2026 02:21:49 GMT<![CDATA[Reply to "Artificial intelligence (AI)" and the law thread 🧵 on Fri, 12 Jun 2026 02:12:09 GMT]]>A federal judge just disqualified both parties' lawyers from practicing before the courts for 2 years. They were also each fined about $3,000.

Each side had used "artificial intelligence" to generate their materials and the materials were full of fake cases. Good times.

https://www.reuters.com/legal/litigation/judge-rules-both-sides-lawsuit-misused-ai-disqualifies-lawyers-2026-06-09/

]]>https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116734710886760974https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116734710886760974Fri, 12 Jun 2026 02:12:09 GMT<![CDATA[Reply to "Artificial intelligence (AI)" and the law thread 🧵 on Wed, 03 Jun 2026 00:58:36 GMT]]>It is very clear from the sheer volume of such decisions that the courts and tribunals are getting absolutely PUMMELLED with this garbage.

]]>https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116683460847394324https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116683460847394324Wed, 03 Jun 2026 00:58:36 GMT<![CDATA[Reply to "Artificial intelligence (AI)" and the law thread 🧵 on Wed, 03 Jun 2026 00:38:01 GMT]]>Wait a second, I may have just taken on a second job.

i just searched "artificial intelligence" and hallucination, and 138 results popped up.

The majority are not articles about the topic but actual cases where the decision maker has made comments that the cases before it are hallucinated.

Edit: Upon review, the vast majority are self-represented people using AI. That they do so is not helpful, but at least understandable. I won't be focussing on these cases here.

]]>https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116683379963102450https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116683379963102450Wed, 03 Jun 2026 00:38:01 GMT<![CDATA[Reply to "Artificial intelligence (AI)" and the law thread 🧵 on Wed, 03 Jun 2026 00:30:25 GMT]]>Added a fourth to that page.

Zhang v Chen, 2024 BCSC 285.

]]>https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116683350019924208https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116683350019924208Wed, 03 Jun 2026 00:30:25 GMT<![CDATA[Reply to "Artificial intelligence (AI)" and the law thread 🧵 on Wed, 03 Jun 2026 00:26:56 GMT]]>Third case about a lawyer reprimanded for fake cases in their factum, likely because of the use of artificial intelligence.

https://www.crookston.ca/wp/2026/03/12/false-quotes-fake-citations-and-artificial-intelligence/

]]>https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116683336322351466https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116683336322351466Wed, 03 Jun 2026 00:26:56 GMT<![CDATA[Reply to "Artificial intelligence (AI)" and the law thread 🧵 on Mon, 30 Mar 2026 00:50:23 GMT]]>_CEO Asks ChatGPT How to Void $250 Million Contract, Ignores His Lawyers, Loses Terribly in Court_
https://www.404media.co/ceo-ignores-lawyers-asks-chatgpt-how-to-void-250-million-contract-loses-terribly-in-court/

]]>https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116315378353976747https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116315378353976747Mon, 30 Mar 2026 00:50:23 GMT<![CDATA[Reply to "Artificial intelligence (AI)" and the law thread 🧵 on Sat, 28 Mar 2026 21:03:11 GMT]]>Another day another client hands me AI slop to review. Sigh.

]]>https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116308822676399428https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116308822676399428Sat, 28 Mar 2026 21:03:11 GMT<![CDATA[Reply to "Artificial intelligence (AI)" and the law thread 🧵 on Fri, 27 Mar 2026 13:06:35 GMT]]>AI summary of oppression remedy in England says creditors have standing to bring such an action. It cites two sources.

Neither source says that.

🤷

]]>https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116301286304749893https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116301286304749893Fri, 27 Mar 2026 13:06:35 GMT<![CDATA[Reply to "Artificial intelligence (AI)" and the law thread 🧵 on Sun, 15 Mar 2026 17:29:31 GMT]]>Trying CanLII's stupid "AI" search/analysis.

My FIRST result was bad.

First, the "AI" result:

"Hyundai Auto Canada Corp. v Engen, 2023 ABCA 85. The decision gives the appeal outcome (allowed in part), but it does not state any motion result."

Wrong. The VERY FIRST LINE of that decision:

"[1] The appellants (collectively, Hyundai) appeal the certification judge’s decision certifying the product liability action of the respondent, Robert Engen, as a class proceeding"

]]>https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116234372452314027https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116234372452314027Sun, 15 Mar 2026 17:29:31 GMT<![CDATA[Reply to "Artificial intelligence (AI)" and the law thread 🧵 on Mon, 09 Mar 2026 13:31:23 GMT]]>... In a surreply, he stated that he “inadvertently included incorrect citations to case law from this Circuit,” attributing the errors to the “inadvertent filing of an unfinalized draft document.”
...
Having reviewed the filings in this matter and other submissions by Renfer, the court has serious concerns about the accuracy of certain quotations and representations in Renfer’s filings,
and the explanation offered for their inclusion."

Good for the court for saying "and the explanation"

]]>https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116199462248230116https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116199462248230116Mon, 09 Mar 2026 13:31:23 GMT<![CDATA[Reply to "Artificial intelligence (AI)" and the law thread 🧵 on Mon, 09 Mar 2026 13:31:06 GMT]]>"In his reply, Fivehouse asserted that the response brief contained fabricated quotations and misstated the holdings of several cases.

The court directed Renfer to respond.

...

]]>https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116199461145059375https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116199461145059375Mon, 09 Mar 2026 13:31:06 GMT<![CDATA[Reply to "Artificial intelligence (AI)" and the law thread 🧵 on Mon, 09 Mar 2026 13:30:18 GMT]]>Uh oh another attorney getting ordered by the court to appear and show cause why he should not be sanctioned for fake cases in his memorandum of law. (Because he used "AI" to draft it.)

Here's the court order:
https://storage.courtlistener.com/recap/gov.uscourts.nced.221403/gov.uscourts.nced.221403.119.0_1.pdf

]]>https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116199457988115936https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/116199457988115936Mon, 09 Mar 2026 13:30:18 GMT<![CDATA[Reply to "Artificial intelligence (AI)" and the law thread 🧵 on Fri, 09 May 2025 05:31:37 GMT]]>Guy tried to play a video of an avatar to present his arguments. The judges immediately turned it off because they hadn't been told that this is was what was being submitted.

https://apnews.com/article/artificial-intelligence-ai-courts-nyc-5c97cba3f3757d9ab3c2e5840127f765

]]>https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/114476233363210527https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/114476233363210527Fri, 09 May 2025 05:31:37 GMT<![CDATA[Reply to "Artificial intelligence (AI)" and the law thread 🧵 on Thu, 08 May 2025 01:53:51 GMT]]>There are some things where you say to yourself, "I'm not sure how I feel about this."

This is not one of those things.

An AI video of a victim was presented at a criminal sentencing hearing to make a victim impact statement.

https://www.nbcnews.com/news/us-news/road-rage-victim-speaks-killers-sentencing-rcna205454

]]>https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/114469714787668496https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/114469714787668496Thu, 08 May 2025 01:53:51 GMT<![CDATA[Reply to "Artificial intelligence (AI)" and the law thread 🧵 on Tue, 27 Feb 2024 13:03:54 GMT]]>BC lawyer sanctioned for hallucinated cases.

"The cases never made it into Ke's arguments; they were withdrawn once she learned they were non-existent."

https://www.cbc.ca/news/canada/british-columbia/lawyer-chatgpt-fake-precedent-1.7126393

]]>https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/112003582171514469https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/112003582171514469Tue, 27 Feb 2024 13:03:54 GMT<![CDATA[Reply to "Artificial intelligence (AI)" and the law thread 🧵 on Tue, 27 Feb 2024 13:03:30 GMT]]>https://www.wsj.com/articles/judge-sanctions-lawyers-who-filed-fake-chatgpt-legal-research-9ebad8f9

]]>https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/112003580606751151https://wanderingadventure.party/post/https://mastodon.social/users/jmcrookston/statuses/112003580606751151Tue, 27 Feb 2024 13:03:30 GMT