Generative AI for Smart Discovery Professionals: An Introduction to Large Language Models – Second Edition

GenAI for Smart Discovery Professionals by John Tredennick and Dr. William Webber
ImageL John Tredennick with AI.

[EDRM Editor’s Note: The opinions and positions are those of John Tredennick and Dr. William Webber.] 


In November of 2022, ChatGPT upended our thinking about artificial intelligence with a new form of machine learning called Generative AI (GenAI). Since then, discussions about GenAI models like GPT have taken center stage in nearly every field, especially in the legal profession. Today, most legal publications feature articles about how GenAI will change the legal profession, and vendors at legal conferences tout their GenAI powered software.

This Guide introduces Generative AI for Smart Discovery and Investigation Professionals. It is designed for the smart individuals in our profession who want to learn the basics of how GenAI models like GPT work and how they can improve discovery workflow. While the underlying algorithms may be complex, we can learn enough about their function to put them to use in our practices.

Our goal is to teach smart discovery professionals how GenAI models operate and how to use them for more efficient and effective work. flow.


John Tredennick and Dr. William Webber.

The book is divided into two parts. Part 1 explores the fundamentals of GenAI and Large Language Models (LLMs), including key concepts like training, context windows, data security, and the potential for hallucinations in AI-generated content. Part 2 focuses on practical applications, demonstrating how GenAI and LLMs can streamline tasks such as document review, analysis, and transcript summarization in discovery and investigation workflows.

Our goal is to teach smart discovery professionals how GenAI models operate and how to use them for more efficient and effective work. Even if you are not focused on investigations and discovery, you should find this book interesting and helpful. While the examples in Part 2 are geared towards finding information in large document sets, the capabilities can be applied to a wide range of information needs. By understanding and harnessing the power of GenAI, professionals across various domains can unlock new levels of efficiency, insight, and innovation in their work.

Let’s get going. We hope you enjoy the ride.

John Tredennick and Dr. William Webber


TABLE OF CONTENTS

Introduction

PART 1: What is Generative AI and How Does it Work?

  • What is GPT?
  • What are LLMs?
    • LLMs: Modern Supercomputers
    • Training an LLM
    • Training Cutoff
    • If an LLM Has No Memory, How Does it Carry on a Conversation?
    • The Role of ChatGPT
    • The Importance of Context Windows
    • Carrying on a Conversation
  • The Context Window Size is Limited
    • Enlargements in Context Window Sizes
  • Is the Data We Send to GPT Secure?
    • Can an LLM Share Confidential Information, Even by Accident?
  • What about Hallucinations?
    • Reducing Chances of Hallucination
    • DiscoveryPartner, An Advanced RAG System

PART 2: Using Generative AI and Large Language Models for Investigation and Discovery

  • Using LLMs to Read, Analyze, and Report on Documents
    • The Assignment
    • Key Issues
    • Key Individuals and Organizations
  • Using LLMs to Answer Questions about Deposition and Hearing Transcripts
    • Deposition Summaries
    • Searching Across Transcripts
  • Conclusion
  • Key GenAI Terms Smart Discovery Professionals Should Know
  • About the Authors
  • About Merlin Search Technologies

To read the entire book, please click below and use your mouse or trackpad to advance the pages or download your own copy with the button at the bottom of this book.



Assisted by GAI and LLM Technologies per EDRM GAI and LLM Policy.

Authors

  • John Tredennick Headshot

    John Tredennick is CEO and founder of Merlin Search Technologies, a company pioneering AI-powered document intelligence for legal professionals. He spent the first 20 years of his career as a trial lawyer and senior litigation partner at Holland & Hart LLP, where he became one of the first CTOs of a major law firm. In 2000, he founded Catalyst Repository Systems, an international ediscovery technology company acquired by OpenText in 2019. He has authored or edited eight books and dozens of articles on legal technology and AI, has spoken on five continents, and served as Chair of the ABA's Law Practice Management Section. He has been recognized by The American Lawyer as one of the six top ediscovery pioneers.

    View all posts CEO & Founder, Merlin Search Technologies
  • Wiliiam webber

    Dr. William Webber is Chief Data Scientist of Merlin Search Technologies. He completed his PhD in measurement in information retrieval evaluation at the University of Melbourne under Professors Alistair Moffat and Justin Zobel, and his post-doctoral research at the E-Discovery Lab of the University of Maryland under Professor Doug Oard. With more than 30 peer-reviewed publications in information retrieval, statistical evaluation and machine learning, he is a leading authority on AI and statistical measurement for information retrieval and ediscovery. At Merlin he leads the data science behind the Alchemy™ platform, including its multi-LLM architecture and the validation methods that keep AI-generated answers sourced and measurable.

    View all posts Chief Data Scientist, Merlin Search Technologies