Skip to the notes
← All winter school notes

Anna Rogers

Large Language Models and Factuality

Download PDF ↓

HPLT × NLPL Winter School · Day 1 · 10 February 2025 · Scroll to read

About these notes

Lecture material on what factuality means for language models, how hallucinations arise, and what retrieval, chain-of-thought prompting, and evaluation can—and cannot—fix.

  1. Page 1 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 1 of 121
  2. Page 2 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 2 of 121
  3. Page 3 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 3 of 121
  4. Page 4 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 4 of 121
  5. Page 5 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 5 of 121
  6. Page 6 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 6 of 121
  7. Page 7 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 7 of 121
  8. Page 8 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 8 of 121
  9. Page 9 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 9 of 121
  10. Page 10 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 10 of 121
  11. Page 11 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 11 of 121
  12. Page 12 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 12 of 121
  13. Page 13 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 13 of 121
  14. Page 14 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 14 of 121
  15. Page 15 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 15 of 121
  16. Page 16 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 16 of 121
  17. Page 17 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 17 of 121
  18. Page 18 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 18 of 121
  19. Page 19 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 19 of 121
  20. Page 20 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 20 of 121
  21. Page 21 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 21 of 121
  22. Page 22 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 22 of 121
  23. Page 23 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 23 of 121
  24. Page 24 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 24 of 121
  25. Page 25 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 25 of 121
  26. Page 26 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 26 of 121
  27. Page 27 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 27 of 121
  28. Page 28 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 28 of 121
  29. Page 29 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 29 of 121
  30. Page 30 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 30 of 121
  31. Page 31 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 31 of 121
  32. Page 32 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 32 of 121
  33. Page 33 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 33 of 121
  34. Page 34 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 34 of 121
  35. Page 35 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 35 of 121
  36. Page 36 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 36 of 121
  37. Page 37 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 37 of 121
  38. Page 38 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 38 of 121
  39. Page 39 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 39 of 121
  40. Page 40 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 40 of 121
  41. Page 41 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 41 of 121
  42. Page 42 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 42 of 121
  43. Page 43 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 43 of 121
  44. Page 44 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 44 of 121
  45. Page 45 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 45 of 121
  46. Page 46 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 46 of 121
  47. Page 47 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 47 of 121
  48. Page 48 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 48 of 121
  49. Page 49 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 49 of 121
  50. Page 50 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 50 of 121
  51. Page 51 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 51 of 121
  52. Page 52 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 52 of 121
  53. Page 53 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 53 of 121
  54. Page 54 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 54 of 121
  55. Page 55 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 55 of 121
  56. Page 56 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 56 of 121
  57. Page 57 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 57 of 121
  58. Page 58 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 58 of 121
  59. Page 59 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 59 of 121
  60. Page 60 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 60 of 121
  61. Page 61 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 61 of 121
  62. Page 62 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 62 of 121
  63. Page 63 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 63 of 121
  64. Page 64 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 64 of 121
  65. Page 65 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 65 of 121
  66. Page 66 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 66 of 121
  67. Page 67 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 67 of 121
  68. Page 68 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 68 of 121
  69. Page 69 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 69 of 121
  70. Page 70 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 70 of 121
  71. Page 71 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 71 of 121
  72. Page 72 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 72 of 121
  73. Page 73 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 73 of 121
  74. Page 74 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 74 of 121
  75. Page 75 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 75 of 121
  76. Page 76 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 76 of 121
  77. Page 77 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 77 of 121
  78. Page 78 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 78 of 121
  79. Page 79 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 79 of 121
  80. Page 80 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 80 of 121
  81. Page 81 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 81 of 121
  82. Page 82 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 82 of 121
  83. Page 83 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 83 of 121
  84. Page 84 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 84 of 121
  85. Page 85 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 85 of 121
  86. Page 86 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 86 of 121
  87. Page 87 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 87 of 121
  88. Page 88 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 88 of 121
  89. Page 89 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 89 of 121
  90. Page 90 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 90 of 121
  91. Page 91 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 91 of 121
  92. Page 92 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 92 of 121
  93. Page 93 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 93 of 121
  94. Page 94 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 94 of 121
  95. Page 95 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 95 of 121
  96. Page 96 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 96 of 121
  97. Page 97 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 97 of 121
  98. Page 98 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 98 of 121
  99. Page 99 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 99 of 121
  100. Page 100 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 100 of 121
  101. Page 101 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 101 of 121
  102. Page 102 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 102 of 121
  103. Page 103 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 103 of 121
  104. Page 104 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 104 of 121
  105. Page 105 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 105 of 121
  106. Page 106 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 106 of 121
  107. Page 107 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 107 of 121
  108. Page 108 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 108 of 121
  109. Page 109 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 109 of 121
  110. Page 110 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 110 of 121
  111. Page 111 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 111 of 121
  112. Page 112 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 112 of 121
  113. Page 113 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 113 of 121
  114. Page 114 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 114 of 121
  115. Page 115 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 115 of 121
  116. Page 116 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 116 of 121
  117. Page 117 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 117 of 121
  118. Page 118 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 118 of 121
  119. Page 119 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 119 of 121
  120. Page 120 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 120 of 121
  121. Page 121 of 121 from Large Language Models and Factuality, included in Lucia Domenichelli's HPLT × NLPL Winter School notes.
    Page 121 of 121