Skip to main content
Try Lexiel for freeTry now →
Lexiel vs ChatGPT for legal contracts: why generic AI is not enough
Comparisons9 minEquipo Lexiel

Lexiel vs ChatGPT for legal contracts: why generic AI is not enough

We compare Lexiel and ChatGPT on 5 real contract analysis tasks: abusive clauses, compensation calculations, applicable case law, and citation accuracy.

lexiel vs chatgptai legal contractschatgpt spanish lawcontract analysis aiabusive clauses ai

ChatGPT and other generalist models generate convincing text. But in contract law, "convincing" is not enough: you need the exact rule, the correct ruling, and the deadline that applies in Spain today.

This article compares Lexiel and ChatGPT (GPT-4o) on five real contract analysis tasks. Every result was verified against BOE and CENDOJ.


The test: 5 contract analysis tasks

Task 1: Identify abusive clauses in a lease agreement

ChatGPT: Generic analysis mentioning Act 29/1994. No specific articles. Misses RDL 7/2019.

Lexiel: Clause void under Art. 19 LAU. Cites RDL 7/2019. Distinguishes residential vs. non-residential. Includes case law: SAP Madrid, Section 11, 14 February 2024.


Task 2: Calculate early termination compensation

ChatGPT: "Depends on what's in the contract." Vague and unusable.

Lexiel: Applies Art. 11 LAU. Explains penalty clause rules. Gives calculation framework with STS citation.


Task 3: Post-contractual non-compete clause

ChatGPT: Mentions adequate compensation. Misses Art. 21 ET limits.

Lexiel: Art. 21.2 ET: max 2 years for technical staff, 6 months for others. If any requirement missing, clause is void; not reducible.


Task 4: Arbitration clause in B2C contract

ChatGPT: "Valid if consumer consented.": INCORRECT under Spanish law.

Lexiel: Clause void. Art. 90.1 TRLGDCU. Cites CJEU 26 October 2006 (Mostaza Claro).


Task 5: Deadline to challenge a floor rate clause

ChatGPT: "Nullity action doesn't prescribe. You can claim." Incomplete.

Lexiel: Full map: nullity imprescriptible, restitution 5 years (Art. 1964 CC), full retroactivity from CJEU 21 December 2016.


Summary table

CriterionChatGPT (GPT-4o)Lexiel
Cites specific articlesPartiallyAlways
Verified case lawNoYes (CENDOJ)
Potentially harmful error1 of 50 of 5
Independent benchmarkNot available99.3%

Conclusion

For general legal exploration, ChatGPT is useful. For real contracts under current Spanish law with verified case law, the difference is significant.

Analyze your next contract with Lexiel →


Try Lexiel free · 28 days

Use code LEX-BLOG for double the standard trial period. Cancel anytime, no commitment.

LEX-BLOG

Weekly legal updates

Legislative changes, relevant case law, and Lexiel news. No spam. Unsubscribe anytime.

GDPR compliant. We never share your email with third parties.