公开数据集评测
DeepLocalsRAG 问答实测
Natural Questions、PopQA、HotpotQA、2WikiMultiHopQA 四个公开数据集（单跳 + 多跳）各抽 100 题，全部资料导入同一张知识卡片，本地 qwen3.8:27b 逐题作答，结果逐题公开。
仅用本地大模型 Qwen3.8:27B，无需云端大模型
在 4 个公开数据集共 400 道题上，DeepLocals 平均准确率88.5%
单跳问答平均 88.5%，多跳推理平均 88.5%——一块显卡上的本地 27B 模型，就能做到这样的准确率。
Accuracy：四个公开数据集
100%75%50%25%0%
90%
87%
89%
88%
NQ
单跳Natural Questions（单跳）PopQA
单跳PopQA（单跳）Hotpot
多跳HotpotQA（多跳）2Wiki
多跳2WikiMultiHopQA（多跳）
Natural Questions
单跳 · 100 题谷歌搜索真实提问，一段资料即可回答
Accuracy 准确率 · 意思答对即算正确
90%
12.1s
耗时中位数
16.2s
平均耗时
40.1s
P95 耗时
PopQA
单跳 · 100 题冷门实体知识问答，最能检验检索是否真正有效
Accuracy 准确率 · 意思答对即算正确
87%
6.5s
耗时中位数
8s
平均耗时
14.4s
P95 耗时
HotpotQA
多跳 · 100 题需要把两段不同资料串起来推理
Accuracy 准确率 · 意思答对即算正确
89%
10.9s
耗时中位数
13.1s
平均耗时
34.3s
P95 耗时
2WikiMultiHopQA
多跳 · 100 题维基百科多跳推理：组合、比较、关系推断
Accuracy 准确率 · 意思答对即算正确
88%
10.6s
耗时中位数
11.3s
平均耗时
17.5s
P95 耗时
DeepLocals 多跳推理按题型（Accuracy）
100%75%50%25%0%
100%
86.6%
90.5%
78.9%
96%
93.8%
Hotpot
比较
18 题HotpotQA · 比较推理（18 题）Hotpot
桥接
82 题HotpotQA · 桥接推理（82 题）2Wiki
桥接
比较
21 题2WikiMultiHopQA · 桥接比较（21 题）2Wiki
组合
38 题2WikiMultiHopQA · 组合推理（38 题）2Wiki
比较
25 题2WikiMultiHopQA · 比较推理（25 题）2Wiki
推断
16 题2WikiMultiHopQA · 关系推断（16 题）
评测方法
- 数据：HippoRAG 2 公开发布的评测集（Natural Questions 共 1000 题，PopQA 共 1000 题，HotpotQA 共 1000 题，2WikiMultiHopQA 共 1000 题），按固定随机种子 20261015 各抽 100 题，可复现。
- 资料：4 个数据集的全部段落（34,239 段，按维基词条整理为 29,262 个文件）导入同一张知识卡片“标准数据集测试”，每题都要从全部资料中检索。
- 作答：DeepLocals 正常问答流程（检索、规划、引用），回答模型为本地 Ollama qwen3.8:27b（关闭思考模式），运行于 NVIDIA RTX 5090（32GB 显存）；不联网搜索。
- 准确率：意思答对即算正确——全名与简称、同义转述、数字或符号写法不同都算对；年份、数字、人物等关键事实不同，或回答“资料中没有提到”，算错。回答逐字包含标准答案的直接判对，其余由本地 qwen3.8:27b（与作答同一模型，温度 0）逐题判定，判定理由随结果保存。
- 耗时：从提问到回答完成的端到端时间。评测日期 2026-10-15。
Natural Questions 逐题结果（100 题，点击展开）
| # | 问题 | 标准答案 | DeepLocals 短答案 | 判定 | 耗时 |
|---|---|---|---|---|---|
| 1 | what features of muscle contraction can be determined from an emg ( electromyogram ) | electric potential generated | Activation level, recruitment order/pattern, action potential rates and amplitudes, motor unit activity, medical abnormalities, and movement biomechanics. | ✓ | 107.8s |
| 2 | what is the highest peak in the ozarks | Buffalo Lookout / Lookout | Buffalo Lookout | ✓ | 10.6s |
| 3 | who sang rip it up and start again | Orange Juice / Scottish post-punk band Orange Juice | Billy Idol | ✗ | 43.8s |
| 4 | who has won the eurovision song contest the most times | Ireland 's Johnny Logan / Ireland | Ireland | ✓ | 7.9s |
| 5 | who were the members of the traveling wilburys group | Tom Petty / George Harrison / Bob Dylan / Jeff Lynne / Roy Orbison | Bob Dylan, George Harrison, Jeff Lynne, Roy Orbison, and Tom Petty. | ✓ | 19.1s |
| 6 | what is final season of game of thrones | The eighth / eighth / the eighth season | Season 8 | ✓ | 9.3s |
| 7 | who played doctor smith in lost in space | Jonathan Harris | Jonathan Harris | ✓ | 10.1s |
| 8 | when did to kill a mockingbird become popular | 1960 | To Kill a Mockingbird became popular immediately after it was published in 1960. The novel “was immediately successful, winning the Pulitzer Prize,” and by 1961 it was on the bestseller list in its 41st week when it received the Pulitzer Prize. It has since remained internationally popular, selling more than 30 million copies in 40 languages. | ✓ | 11.8s |
| 9 | where does the red wolf live in the world | the southeastern United States / southeastern United States | The red wolf is native to the southeastern United States, and currently survives in the wild only in northeastern North Carolina. | ✓ | 16.2s |
| 10 | who in germany signed the treaty of versailles | Gustav Bauer / Foreign minister Hermann Müller / colonial minister Johannes Bell | Hermann Müller and Johannes Bell | ✓ | 14.2s |
| 11 | what is the width of a cricket bat | no more than 4.25 inches / no more than four.25 inches | 4.25 inches (108 mm) | ✓ | 13.6s |
| 12 | who played daisy duke in the new dukes of hazzard | Jessica Simpson | Jessica Simpson. | ✓ | 10.6s |
| 13 | the radiographic term used to describe the dense bone of the socket and septal crest is | the lamina dura / alveolar process / lamina dura | lamina dura | ✓ | 16.9s |
| 14 | who has the most international goals of all time | Ali Daei | Abby Wambach | ✓ | 19.5s |
| 15 | what nfl team has the most expensive super bowl ring | New England Patriots / the New England Patriots | New England Patriots | ✓ | 14.7s |
| 16 | what was the first capital city of australia | Sydney / Melbourne / New South Wales | Melbourne | ✓ | 11.4s |
| 17 | what is the official symbol of the carnival of quebec | Bonhomme Carnaval | Bonhomme Carnaval | ✓ | 8.2s |
| 18 | who is the director of nightmare before christmas | Henry Selick | Henry Selick | ✓ | 19.1s |
| 19 | who plays the girl in wreck it ralph | Stefanie Scott / Sarah Silverman | Sarah Silverman | ✓ | 11.5s |
| 20 | who was the person who escaped from alcatraz | Clarence Anglin / Frank Morris / John Anglin | Frank Morris, John Anglin, and Clarence Anglin (most famous successful escape); John Paul Scott (only swimmer to reach shore). | ✓ | 9s |
| 21 | who did johnny manziel play college football for | Texas A&M Aggies / Texas A&M University / Texas A&M | Texas A&M | ✓ | 9.7s |
| 22 | who won the mens curling in the olympics 2018 | United States | United States | ✓ | 8.4s |
| 23 | who plays grace in the secret life of the american teenager | Megan Park | Megan Park | ✓ | 15.6s |
| 24 | who plays on the tv show the resident | Matt Czuchry / Moran Atias / Bruce Greenwood / Shaunette Renée Wilson / Merrin Dungey / Manish Dayal / Emily VanCamp / Melina Kanakaredes | Matt Czuchry, Emily VanCamp, Melina Kanakaredes, Manish Dayal, Bruce Greenwood, Moran Atias, Merrin Dungey, Glenn Morshower, Malcolm-Jamal Warner, and Violett Beane | ✓ | 12s |
| 25 | when was the first book made into a movie | 1924 | The provided sources do not identify the first book ever adapted into a film or state a definitive date for the earliest literary-to-film adaptation. They only cite early 20th-century examples (e.g., *Manon Lescaut* in 1914, *Camille* in 1915) and general statements that adaptation existed from cinema’s early days, but do not specify which book was first. | ✗ | 32.9s |
| 26 | when did the movie karate kid come out | 1984 / 2010 | The original film came out in 1984; the 2010 remake came out on June 11, 2010. | ✓ | 13.2s |
| 27 | where did the tea come from in the boston tea party | England / East India Company / the East India Company | China (via the British East India Company) | ✓ | 11.4s |
| 28 | which is the fastest train in india and what is its speed | 160km / hour / Mumbai Rajdhani Express / Gatiman | Gatimaan Express; 160 km/h | ✓ | 17s |
| 29 | who ruled the ottoman empire in the 1500s | Selim I | Selim I and Suleiman the Magnificent | ✓ | 13.6s |
| 30 | who did bette midler portray in the rose | Mary Rose Foster | Mary Rose Foster (a rock star loosely based on Janis Joplin) | ✓ | 8.5s |
| 31 | who is the premier of northern cape 2018 | Sylvia Lucas | Sylvia Lucas (as of 2013, with no 2018 change specified in the provided sources) | ✓ | 18.1s |
| 32 | what was generally the preferred way for european powers to control colonial regions | Indirect rule | Indirect rule | ✓ | 20.5s |
| 33 | who sings the songs in crazy ex girlfriend | Rachel Bloom | Rachel Bloom (as Rebecca Bunch), with other cast members occasionally singing specific songs. | ✓ | 10.5s |
| 34 | leader of carthage in the first punic war | Hamilcar Barca / Hanno the Great / Hasdrubal the Fair / Xanthippus | Not specified in the provided sources. | ✗ | 27.4s |
| 35 | when was the original stephen king it movie made | 1990 | 1990 | ✓ | 17.7s |
| 36 | which country is the last member of saarc | Afghanistan | Afghanistan | ✓ | 11.6s |
| 37 | who has the most votes for the all star game | fan voting | The provided sources do not identify a single person who has the most votes overall across all All-Star Games. They only list leading vote-getters for specific years in different sports: in the 2012 MLB All-Star Game, Josh Hamilton led with 11,073,744 votes; in the 2017 MLB All-Star Game, Bryce Harper led with 4,630,306 votes; and in the 2011 NHL All-Star Game, Sidney Crosby led with 635,509 votes. | ✗ | 49s |
| 38 | who played the king in the ten commandments | Yul Brynner / Woodrow Strode | Yul Brynner | ✓ | 10s |
| 39 | who wrote i 'm in the mood for dancing | Ben Findon / Bob Puzey / Mike Myers | Ben Findon, Mike Myers, and Bob Puzey | ✓ | 11.3s |
| 40 | when did the cubs won a world series | 2016 / 1907 / 1908 | 1907, 1908, and 2016 | ✓ | 12.1s |
| 41 | where does the this is us family live | Pittsburgh | Pittsburgh (childhood); present-day adults: Los Angeles, New Jersey, and Kevin’s location not fully specified in the excerpts. | ✓ | 19.3s |
| 42 | how long were the pyramids the tallest structure | over three,800 / over 3,800 / over three,800 years / over 3,800 years | Over 3,800 years | ✓ | 13.6s |
| 43 | who was the first black person to register to vote | Thomas Mundy Peterson | Thomas Mundy Peterson | ✓ | 18.4s |
| 44 | when did skiing halfpipe become an olympic event | 2014 | 2014 Winter Olympics | ✓ | 10.2s |
| 45 | when was the day that the pubs ran dry in the poem 9-3 | 31 October 1972 | 31 October 1972 | ✓ | 8.2s |
| 46 | where does the term pop music come from | Britain | The term “pop music” derives from “popular music,” with its specific usage originating in Britain and gaining distinct meaning by contrasting with rock music. | ✓ | 13.3s |
| 47 | who has won india 's next super star | Aman Gandotra / Natasha Bharadwaj | Aman Gandotra and Natasha Bharadwaj | ✓ | 14.4s |
| 48 | who signed the declaration of independence for maryland | Charles Carroll of Carrollton / Samuel Chase / William Paca / Thomas Stone | Samuel Chase, William Paca, Thomas Stone, and Charles Carroll of Carrollton. | ✓ | 13.1s |
| 49 | who designed the first toy released by nintendo | Gunpei Yokoi / Fusajiro Yamauchi | Gunpei Yokoi | ✓ | 9s |
| 50 | who had a baby at 100 in the bible | Sarah / Abraham | Sarah | ✓ | 13.1s |
| 51 | when did the great plague of london start and end | from 1665 to 1666 / 1665 to 1666 / 1665 / 1666 | 1665–1666 | ✓ | 18.9s |
| 52 | where was the movie silver linings playbook filmed | Upper Darby / Ridley Park / Lansdowne / just outside Philadelphia , Pennsylvania | Upper Darby, Ridley Park, and Lansdowne, just outside Philadelphia, Pennsylvania | ✓ | 10.9s |
| 53 | public companies are part of what economic sector | public sector / The public sector | private sector | ✗ | 8.2s |
| 54 | who was the original host of jokers wild | Jack Barry | Barry Cryer | ✗ | 15s |
| 55 | who won the oscar over wolf of wall street | Jonah Hill / Terence Winter / Martin Scorsese / Leonardo DiCaprio | 12 Years a Slave (Best Picture) | ✗ | 14.8s |
| 56 | how many episodes curse of oak island season 5 | 18 / eighteen | not specified in the provided materials | ✗ | 18s |
| 57 | who played mary in christmas with the kranks | Felicity Huffman | Felicity Huffman | ✓ | 58.1s |
| 58 | who gets to race in the daytona clash | Daytona Pole Award winners / former Clash race winners | Previous season's pole winners, former Clash winners, former Daytona 500 pole winners (who raced full-time), and drivers who qualified for the Daytona 500. | ✓ | 15.8s |
| 59 | who is the actor that plays saul on grace and frankie | Sam Waterston | Not specified in the provided materials. | ✓ | 44.4s |
| 60 | when did toyota first come to the united states | 1957 | 1957 | ✓ | 11s |
| 61 | who plays the voice of sulley in monsters inc | John Goodman | John Goodman | ✓ | 9s |
| 62 | who has won the most superbowls as a player | Bill Belichick / Tom Brady / Charles Haley / Neal Dahlen | Tom Brady and Charles Haley (five each) | ✓ | 11.1s |
| 63 | when did sierra nevada brewery open in asheville | early 2014 / 2014 / January 2012 | early 2014 | ✓ | 19.4s |
| 64 | where does the last name cintron come from | Spanish - French / Portuguese | The surname Cintron is of Spanish origin. It is generally understood as a variant spelling or phonetic adaptation of the Spanish given name Cintia or Cintia, which itself derives from the Latin name Cynthia (meaning "of the moon" or associated with the moon goddess Diana/Cynthia). In many Spanish-speaking regions, particularly in Puerto Rico and other parts of Latin America, surnames often originate from a male ancestor's given name (patronymic tradition), and over time, spellings can shift due to phonetics or local dialects. "Chintron" is not a standard historical Spanish surname; it is widely considered a specific regional or familial spelling variation of names like Cintron or Cintia. Therefore, its ultimate root is traceable to the Latin *Cynthia*. | ✗ | 11s |
| 65 | who plays jack skellington in nightmare before christmas | Danny Elfman / Chris Sarandon | Chris Sarandon (speaking voice) and Danny Elfman (singing voice). | ✓ | 16s |
| 66 | how many senators are there in the us senate | hundred members / hundred / 100 members / 100 | 100 senators | ✓ | 11s |
| 67 | who is the sixth president of the united states | John Quincy Adams | John Quincy Adams | ✓ | 11.9s |
| 68 | the boards name on ed edd and eddy | Plank | Plank | ✓ | 10.4s |
| 69 | who was the girl that played cindy lou who | Taylor Michel Momsen | Taylor Momsen | ✓ | 12.5s |
| 70 | cast of the movie pride of the marines | Rosemary DeCamp / John Ridgely / Dane Clark as Lee Diamond / Ann E. Todd / Dane Clark / Anthony Caruso / John Ridgely as Jim Merchant / Eleanor Parker as Ruth Hartley / John Garfield / Eleanor Parker / Ann Doran / John Garfield as Al Schmid / Anthony Caruso as Johnny Rivers / Rosemary DeCamp as Virginia Pfeiffer | John Garfield, Eleanor Parker | ✓ | 26.1s |
| 71 | when did ga state get a football team | 2010 | 2010 (program launched April 17, 2008; team founded in 2010) | ✓ | 11.8s |
| 72 | who is playing halftime show super bowl 2018 | Justin Timberlake | Justin Timberlake | ✓ | 9.9s |
| 73 | who won the womens 2017 ncaa basketball tournament | South Carolina | South Carolina | ✓ | 15.5s |
| 74 | how did early humans make use of stones during the prehistoric period | hunt / bury their dead / start fires | Early humans shaped stones into tools with edges, points, or percussion surfaces for hunting, gathering, and other survival tasks. | ✓ | 15.7s |
| 75 | who has been ranked no. 1 in the latest football rankings announced by fifa | Germany | Belgium | ✗ | 10.8s |
| 76 | most home runs by 2 teammates in a season | Mickey Mantle / Roger Maris / 115 / a combined 115 home runs | 115 (Mickey Mantle and Roger Maris, 1961) | ✓ | 9.5s |
| 77 | what is the second largest country in asia | China | China | ✓ | 40.1s |
| 78 | who sang the theme song for laverne and shirley | Cyndi Grecco | Cyndi Grecco | ✓ | 13.1s |
| 79 | who kidnapped ben in the deep end of the ocean | the celebrity alumna Cecil Lockhart / Cecil Lockhart / celebrity alumna Cecil Lockhart | Cecil Lockhart | ✓ | 13.5s |
| 80 | when did the united states acquired puerto rico | 1898 | 1898 (formalized by the Treaty of Paris signed December 10, 1898; effective April 11, 1899) | ✓ | 10.4s |
| 81 | what episode does lori die on the walking dead | `` Killer Within '' / Killer Within | “Killer Within” (Season 3, Episode 4) | ✓ | 18.4s |
| 82 | who was hope brady 's mother on days of our lives | Ciara Brady / Addie Horton | Not specified in the provided materials | ✓ | 11.2s |
| 83 | who is young george bailey in it 's a wonderful life | Robert James Anderson | Bobby Anderson | ✓ | 12.6s |
| 84 | who sang what are we doing in love | Kenny Rogers / Dottie West | Dottie West (with uncredited vocals by Kenny Rogers) | ✓ | 7.3s |
| 85 | when was the last time an american won the new york marathon | 2009 / 2017 | November 5, 2017 | ✓ | 9.5s |
| 86 | how long was dark side of the moon number 1 | 42 : 49 / a week | one week | ✓ | 16.1s |
| 87 | is the united states a country or nation | country | It is both a country and a nation. | ✓ | 10.9s |
| 88 | when did they stop making pull tabs on beer cans | 1990 / 1970s | mid-to-late 1970s | ✓ | 10.1s |
| 89 | who has scored the most half centuries in test cricket | Sachin Tendulkar | Not specified in the provided sources | ✓ | 39.5s |
| 90 | who sings the song it ai n 't me | Selena Gomez / American singer Selena Gomez | Kygo and Selena Gomez | ✓ | 11.1s |
| 91 | an influential religion to enter china along the silk route during the han dynasty was | Buddhism | Buddhism | ✓ | 11.5s |
| 92 | who is the girl in the stone sour video say you 'll haunt me | Joanna Moskawa | Joanna Moskawa | ✓ | 10.7s |
| 93 | who was the inventor who developed a way to record sound | Thomas Edison | Thomas Edison | ✓ | 12.1s |
| 94 | who sang one bad apple spoils the bunch | The Osmonds | The Osmonds | ✓ | 9.2s |
| 95 | when does season 6 of the next step start | 2018 | September 29, 2018 | ✓ | 12.1s |
| 96 | who owns the rights to rocky and bullwinkle | Universal Pictures | Universal Pictures (via Bullwinkle Studios and Ward Productions); General Mills holds US television rights | ✓ | 12.6s |
| 97 | where is the largest salt mine in the us | Central New York / Western New York | Hampton Corners in the Town of Groveland, Livingston County, New York | ✓ | 11.5s |
| 98 | who played santa in the santa clause movies | Tim Allen | Tim Allen | ✓ | 10.8s |
| 99 | what 's the difference between salisbury steak and hamburger steak | ingredients | Salisbury steak is a specific American dish named after Dr. James H. Salisbury, while hamburger steak is a general term for a minced meat patty dish, with the primary difference being their specific ingredients and culinary origin. | ✓ | 11.6s |
| 100 | who wrote the song i hate you i love you | Angel Benitez / Olivia O'Brien / Garrett Nash | Gnash | ✓ | 15.7s |
PopQA 逐题结果（100 题，点击展开）
| # | 问题 | 标准答案 | DeepLocals 短答案 | 判定 | 耗时 |
|---|---|---|---|---|---|
| 1 | In what city was John Robinson born? | Mansfield / Mansfield, Ohio | Cannot be determined from the provided sources (ambiguous identity; e.g., John D. Robinson: Binghamton, NY) | ✗ | 74.6s |
| 2 | In what city was Scott Fraser born? | Edinburgh / Edinburg / Edinburgh, Scotland / City of Edinburgh / Edina / Modern Athens | Edinburgh | ✓ | 7.4s |
| 3 | What is Chris Jericho's occupation? | actor / actress / actors / actresses | professional wrestler, rock musician, and actor | ✓ | 6.9s |
| 4 | What is Alex Reid's occupation? | actor / actress / actors / actresses | American television producer and screenwriter | ✓ | 6.9s |
| 5 | In what city was Irving Amen born? | New York City / NYC / New York / the five boroughs / Big Apple / City of New York / NY City / New York, New York / New York City, New York / New York, NY / New York City (NYC) | New York City | ✓ | 6.2s |
| 6 | What is Susan Kent's occupation? | actor / actress / actors / actresses | actress | ✓ | 6.3s |
| 7 | In what city was Nelson Vargas born? | Holyoke / The Paper City / The Venice of America / The Birthplace of Volleyball / The Chicago of Massachusetts / Holyoke, Massachusetts | not specified in the provided sources | ✗ | 12.4s |
| 8 | In what city was Derek Lamb born? | London / London, UK / London, United Kingdom / London, England / Modern Babylon | Not specified in the provided materials | ✗ | 17s |
| 9 | In what city was Ted Williams born? | San Diego / San Diego, California / SD / America's Finest City / Sandi / the birthplace of California | San Diego | ✓ | 7.1s |
| 10 | What is Edward Norton's occupation? | politician / political leader / political figure / polit. / pol | actor | ✓ | 6.8s |
| 11 | What is Michael Radford's occupation? | film director / movie director / director / motion picture director / screenwriter / scenarist / writer / screen writer / script writer / scriptwriter | Film director and screenwriter | ✓ | 5.9s |
| 12 | In what city was Jim Roland born? | Franklin / Franklin, North Carolina | Unknown based on the provided references | ✗ | 14.3s |
| 13 | What is Henry Campbell-Bannerman's occupation? | diplomat / politician / political leader / political figure / polit. / pol | Politician | ✓ | 7.1s |
| 14 | In what city was Reinaldo Dalcin born? | Canoas | Not specified in the provided sources | ✗ | 12s |
| 15 | What is Eleanor Yule's occupation? | film director / movie director / director / motion picture director | film director | ✓ | 4.1s |
| 16 | What is Christoph Schlingensief's occupation? | theatrical director / stage director / theatre director / play director / director / theater director | theatre director, performance artist, and filmmaker | ✓ | 6s |
| 17 | What is Jim Boyd's occupation? | journalist / journo / journalists / actor / actress / actors / actresses | News anchor and reporter; actor. | ✓ | 7.4s |
| 18 | In what city was Joris Delle born? | Briey | Not specified in the provided materials | ✗ | 12.9s |
| 19 | In what city was Joseph Patrick Addabbo born? | Queens / Queens, New York City / Queens, New York | New York City | ✓ | 6s |
| 20 | In what city was Sevil Atasoy born? | Istanbul / İstanbul | Cannot be determined from the provided sources. | ✓ | 11.5s |
| 21 | What is Min's occupation? | actor / actress / actors / actresses | Singer, television personality, songwriter, and actress | ✓ | 8.6s |
| 22 | In what city was Anton Lui born? | Rabaul | Rabaul | ✓ | 5.9s |
| 23 | What is Mildred Okwo's occupation? | film director / movie director / director / motion picture director | film director and producer | ✓ | 5.2s |
| 24 | What is Rumi's occupation? | philosopher / poet / poetess / bard | Poet, jurist, Islamic scholar, theologian, and Sufi mystic | ✓ | 4.8s |
| 25 | What is Rick Wilson's occupation? | farmer / agriculturist / grower / raiser / cultivator / agriculturer / farmer (occupation) / politician / political leader / political figure / polit. / pol | Politician, Farmer, Basketball player, Ice hockey player, Jockey, NASCAR driver, or Professional wrestler (depending on the specific individual) | ✓ | 9.3s |
| 26 | In what city was Lois Bancroft Long born? | Stamford / Stamford, Connecticut | Stamford | ✓ | 6.6s |
| 27 | In what city was Trae tha Truth born? | Houston / Houston, Texas / Space City / H-Town / City of Houston / USHOU / Houston, TX | Houston, Texas | ✓ | 9.4s |
| 28 | In what city was Rose Bampton born? | Lakewood / Lakewood, Ohio | Lakewood, Ohio | ✓ | 8.1s |
| 29 | In what city was Israel Horowitz born? | New York City / NYC / New York / the five boroughs / Big Apple / City of New York / NY City / New York, New York / New York City, New York / New York, NY / New York City (NYC) | New York City | ✓ | 5.9s |
| 30 | In what city was Alexandre-Marie Colin born? | Paris / City of Light / Paris, France | Not specified in the provided materials | ✗ | 8.5s |
| 31 | What is Alleppey Vincent's occupation? | actor / actress / actors / actresses | Actor | ✓ | 5.3s |
| 32 | What is Akimasa Nakamura's occupation? | astronomer | Japanese astronomer | ✓ | 3.7s |
| 33 | What is Guillaume du Tillot's occupation? | politician / political leader / political figure / polit. / pol | Politician (minister of the Duchy of Parma) | ✓ | 4.1s |
| 34 | What is Jilly Cooper's occupation? | journalist / journo / journalists / novelist | Author (also a journalist) | ✓ | 4s |
| 35 | What is Annie Beustes's occupation? | politician / political leader / political figure / polit. / pol | politician | ✓ | 3.7s |
| 36 | In what city was Margaret, Countess of Pembroke born? | Windsor Castle | Windsor | ✓ | 4.3s |
| 37 | In what city was Claudio Costamagna born? | Milan / Milano / Milan, Italy / Milano, Italy / Milano, Italia / Mailand / Milan Records | Milan | ✓ | 4s |
| 38 | What is Natasha Leggero's occupation? | actor / actress / actors / actresses | stand-up comedian, actress, and writer | ✓ | 3.9s |
| 39 | In what city was Gabriella Di Laccio born? | Porto Alegre | Not specified in the provided sources | ✗ | 7.4s |
| 40 | In what city was Bob Warlick born? | Hickory / Hickory, North Carolina | Hickory | ✓ | 12.4s |
| 41 | In what city was Andranik Migranyan born? | Yerevan / Erivan / Erevan / The Pink City / Irevan / Iravan | Yerevan | ✓ | 7.1s |
| 42 | What is Kazuyoshi Sekine's occupation? | playwright / dramatist / playwrite / scriptwriter | film director | ✓ | 6.4s |
| 43 | What is Everley Gregg's occupation? | actor / actress / actors / actresses | Actress | ✓ | 9.8s |
| 44 | In what city was Leobardo Soto born? | Puebla / Free and Sovereign State of Puebla / Estado de Puebla | Not specified in the provided references | ✓ | 11s |
| 45 | In what city was Brandon Bays born? | United States of America / the United States of America / America / U.S.A. / USA / U.S. / US / the US / the USA / US of A / the United States / U. S. A. / U. S. / the States / the U.S. / 'Merica / U.S / United States / 'Murica | New York City | ✗ | 5.5s |
| 46 | In what city was Karim Ojjeh born? | Geneva / Genève / Geneva GE / Geneve / Genf | Geneva | ✓ | 4.6s |
| 47 | What is Petr Mlsna's occupation? | politician / political leader / political figure / polit. / pol | Politician (Czech politician; former government official/minister) | ✓ | 4.6s |
| 48 | What is G.E.M.'s occupation? | singer-songwriter / singer songwriter / singer/songwriter / singersongwriter / singer-songwriter | Singer, songwriter, and producer. | ✓ | 4.5s |
| 49 | In what city was Dennis Havig born? | Powell / Powell, Wyoming | Powell, Wyoming | ✓ | 4s |
| 50 | In what city was Vitaly Arkhangelsky born? | Almaty / Алматы / Almatı / Alma-Ata / City of Almaty | Almaty | ✓ | 4.1s |
| 51 | What is Leigh Whannell's occupation? | screenwriter / scenarist / writer / screen writer / script writer / scriptwriter / actor / actress / actors / actresses | screenwriter, actor, film producer, and film director | ✓ | 4.4s |
| 52 | What is Adele Capell, Countess of Essex's occupation? | socialite / prominent person | Socialite and vegetarianism activist | ✓ | 4.7s |
| 53 | What is Tatiana Doronina's occupation? | actor / actress / actors / actresses | Actress | ✓ | 6.5s |
| 54 | What is Jean-Baptiste de Lamarck's occupation? | biologist / biologists | naturalist, biologist, academic, and soldier | ✓ | 5.8s |
| 55 | In what city was Alfredo Ramos Martínez born? | Monterrey / Monterrey, Nuevo Leon / Monterrey, Mexico / La sultana del norte / La ciudad de las montañas | Monterrey | ✓ | 5.8s |
| 56 | In what city was Ramón Luis Valcárcel Siso born? | Murcia | Murcia | ✓ | 6.1s |
| 57 | What is Maev-Ann Wren's occupation? | journalist / journo / journalists | Economist, journalist, and author | ✓ | 5.4s |
| 58 | What is Claire Berlinski's occupation? | journalist / journo / journalists | Journalist and author | ✓ | 4.3s |
| 59 | In what city was Aleksandr Nekrasov born? | Moscow / Moskva / Moscow, Russia / Moskva Federal City, Russia / Moscow, USSR / Moskva, Russia / City of Moscow / Moscow, Russian Federation / Moscow, Soviet Union / Moscow, Russian SFSR / Muscovite / Moscovite | Moscow | ✓ | 8.9s |
| 60 | What is Alex Krieps's occupation? | politician / political leader / political figure / polit. / pol | politician and general practitioner. | ✓ | 5.9s |
| 61 | What is Salvador Allende's occupation? | physician / physicians / medical doctor / medical practitioner / doctor / medical doctors / politician / political leader / political figure / polit. / pol | politician and president | ✓ | 6.7s |
| 62 | In what city was Reinhard Jirgl born? | East Berlin / Soviet zone of Berlin / Berlin-Ost / Ostberlin / Soviet sector of Berlin / Berlin, Hauptstadt der DDR / Berlin Hauptstadt der DDR | East-Berlin | ✓ | 6.7s |
| 63 | What is David Joyce's occupation? | lawyer / attorney / solicitor / barrister / lawyers / politician / political leader / political figure / polit. / pol | Politician and attorney (if referring to David Patrick Joyce, the U.S. Representative); lumber baron/industrialist (if referring to the 19th-century businessman). | ✓ | 9.3s |
| 64 | What is Arkady Chernetsky's occupation? | politician / political leader / political figure / polit. / pol | Politician | ✓ | 7.1s |
| 65 | In what city was Batman born? | Gotham City / Gotham | Not specified | ✓ | 13.2s |
| 66 | What is Thomas R. Whitney's occupation? | politician / political leader / political figure / polit. / pol | politician and writer | ✓ | 6.4s |
| 67 | In what city was Rahi Masoom Raza born? | Ghazipur / Ghazeepore / Gauspur / Ghazipour / Gadjipur / Ghazipoor / Gazipoor | Gangauli | ✓ | 7.5s |
| 68 | In what city was Robert Crannell Minor born? | New York City / NYC / New York / the five boroughs / Big Apple / City of New York / NY City / New York, New York / New York City, New York / New York, NY / New York City (NYC) | New York City | ✓ | 6.7s |
| 69 | In what city was Louis Joseph Troost born? | Paris / City of Light / Paris, France | Paris | ✓ | 8s |
| 70 | In what city was Franky Zapata born? | Marseille / Massaliotes / Massalia / Marsailles / Marseilles / Marsielles / Marsielle / City of Marseille / Marsaille / Marsiglia / Marseille, France / Ville-sans-Nom / Sans-Nom | Not specified in the provided documents | ✗ | 16.2s |
| 71 | In what city was Tim Alexander born? | Chertsey / Chertsey, Surrey | Chertsey | ✓ | 7s |
| 72 | What is Ernst Timme's occupation? | farmer / agriculturist / grower / raiser / cultivator / agriculturer / farmer (occupation) / politician / political leader / political figure / polit. / pol | Farmer and politician | ✓ | 5.7s |
| 73 | What is Dean Alfange's occupation? | politician / political leader / political figure / polit. / pol | politician | ✓ | 5.5s |
| 74 | In what city was Shawn Respert born? | Detroit / Motor City / Detroit, Michigan / Detroiit / Detroit, MI / The D | Not specified in provided sources | ✓ | 14.5s |
| 75 | What is Robert Jonckheere's occupation? | astronomer | astronomer | ✓ | 7.5s |
| 76 | What is Ek Yi Oun's occupation? | politician / political leader / political figure / polit. / pol | Politician | ✓ | 5.5s |
| 77 | In what city was Fernando García born? | Santiago / Santiago de Chile / Santiago, Chile | Cannot be determined without specifying which Fernando García is meant | ✓ | 13.9s |
| 78 | What is Tiffany Pollard's occupation? | actor / actress / actors / actresses | television personality / reality TV host | ✗ | 6.6s |
| 79 | What is Gerard Kennedy's occupation? | actor / actress / actors / actresses | Actor (and CEO of Alpha Healthcare/Alpha Laboratories) | ✓ | 15.9s |
| 80 | In what city was Petar Stambolić born? | Ivanjica | Ivanjica | ✓ | 14.4s |
| 81 | In what city was Jakob Kaiser born? | Hammelburg | Hammelburg | ✓ | 5.8s |
| 82 | In what city was Martin Simonson born? | Gothenburg / Göteborg | Göteborg | ✓ | 6.8s |
| 83 | What is Edwin E. Ellis's occupation? | photographer / photog / photographers | inventor and photographer | ✓ | 6.8s |
| 84 | What is Mohd Sharkar Shamsudin's occupation? | politician / political leader / political figure / polit. / pol | Politician | ✓ | 7.6s |
| 85 | In what city was Robert Kraft born? | Brookline / Brookline, Massachusetts | Brookline | ✓ | 6.3s |
| 86 | What is Ivan III Drašković's occupation? | politician / political leader / political figure / polit. / pol | warrior and statesman | ✓ | 6.2s |
| 87 | What is Carlo Giustini's occupation? | actor / actress / actors / actresses | Italian actor | ✓ | 6.3s |
| 88 | What is Uri Nakayama's occupation? | singer-songwriter / singer songwriter / singer/songwriter / singersongwriter / singer-songwriter / hairdresser / hairstylist / hair stylist / hair dresser / beautician / hairdressers | singer-songwriter and hairdresser | ✓ | 5.2s |
| 89 | What is Fairfax M. Cone's occupation? | businessperson / business person / dealer / businesswoman / business man / business woman / businessman | American businessperson and advertising executive (former director of the American Association of Advertising Agencies) | ✓ | 4.5s |
| 90 | In what city was Billy McGinty born? | Glasgow / Glasgow, Scotland | Glasgow | ✓ | 4.2s |
| 91 | What is Kanye West's occupation? | record producer / music producer / songwriter / song writer | Rapper and record producer | ✓ | 5.2s |
| 92 | What is Gillian Raine's occupation? | actor / actress / actors / actresses | actress and singer | ✓ | 5.8s |
| 93 | What is Virginia Haviland's occupation? | librarian / library staff | Librarian and writer | ✓ | 6.5s |
| 94 | In what city was Ralph Campney born? | Picton / Picton, Ontario | Picton, Ontario | ✓ | 6.4s |
| 95 | In what city was Gianni Lonzi born? | Florence / Firenze / Florence, Italy / Florence, Tuscany / Florencia / Florentia / Florenz / Firenca / Florencie / Fiuränza / Florentzia / Firense / Firenz / Firenzi | Florence | ✓ | 6.1s |
| 96 | In what city was Mapy Cortés born? | Santurce / San Mateo de Cangrejos / Santurce Barrio / Santurce, San Juan / Santurce, Puerto Rico | Not specified in the provided materials | ✗ | 6.7s |
| 97 | In what city was Roger Mendy born? | Dakar | Dakar | ✓ | 9.9s |
| 98 | What is Ya'akov Ahimeir's occupation? | journalist / journo / journalists | Journalist; television and radio personality | ✓ | 6.8s |
| 99 | In what city was Mark Holzemer born? | Littleton / LIttleton, Colorado / Littleton, Colorado | Littleton, Colorado | ✓ | 5.8s |
| 100 | In what city was C. N. Annadurai born? | Kanchipuram / Kancheepuram | The city is not specified in the provided materials. | ✗ | 9.9s |
HotpotQA 逐题结果（100 题，点击展开）
| # | 问题 | 标准答案 | DeepLocals 短答案 | 判定 | 耗时 |
|---|---|---|---|---|---|
| 1 | Which came to market first, "Hey Pa! There's a Goat on the Roof" or "Poleconomy" | Hey Pa! There's a Goat on the Roof | Hey Pa! There's a Goat on the Roof | ✓ | 12.2s |
| 2 | Who was the fourth son of the lord of the Seventeen Provinces of the Netherlands in 1555? | Diego Félix of Austria | Diego Félix of Austria | ✓ | 16.8s |
| 3 | What was the benefit of reintroducing piston power and replacing the most popular turboprop engine in history? | much better fuel economy | Better fuel economy | ✓ | 11.5s |
| 4 | Which band included more previously-known figures when it was formed, !!! or Puddle of Mudd? | !!! | !!! | ✓ | 46.1s |
| 5 | Which film has more writers, Splash or Christopher Robin? | Christopher Robin | Christopher Robin | ✓ | 10.2s |
| 6 | Who was born first, Ronnie Radke or Dave Brockie? | Dave Brockie | Dave Brockie | ✓ | 10.8s |
| 7 | James Fowle Baldwin helped design a historic railroad that operated in Massachusetts and whose line later operated as part of what? | Boston and Maine Railroad's Southern Division | Boston and Maine Railroad's Southern Division | ✓ | 15.4s |
| 8 | Which feature film was released earlier, One Magic Christmas or Muppet Treasure Island? | One Magic Christmas | One Magic Christmas | ✓ | 11.9s |
| 9 | Who is older, Tarryl Lynn Clark or Michele Marie Bachmann? | Michele Marie Bachmann | Michele Marie Bachmann | ✓ | 14.4s |
| 10 | Swiss music duo Double released their best known single "The Captain of Her Heart" in what year? | 1986 | 1985 | ✗ | 15.7s |
| 11 | When was the movie adaption of Jennifer Weiner's novel "In Her Shoes" released? | 2005 | 2005 | ✓ | 9s |
| 12 | Of these two publication--Báiki and Sick--what type of publication is the one that was published most frequently? | satirical-humor magazine | satirical-humor magazine | ✓ | 8.9s |
| 13 | When was the Russian composer who composed "Prisoner of the Caucasus" born? | [O.S. 6 January] 1835 | 18 January 1835 | ✓ | 13.7s |
| 14 | The album "The Best of LeAnn Rimes" contained a song used as the theme song for a film. What is the name of the film? | Coyote Ugly | Coyote Ugly | ✓ | 11.8s |
| 15 | What year was the actor son of Jeremiah Porter born? | 1997 | unknown | ✗ | 37.8s |
| 16 | Where does the state legislature in which John Coffin Talbot served convene? | the State House in Augusta | State House in Augusta, Maine | ✓ | 8.6s |
| 17 | Hate Them is the ninth album by a band likened to who? | Motörhead | Motörhead | ✓ | 36.3s |
| 18 | Who wrote Bring Me Sunshine and where did they write it? | Bring Me Sunshine (1994) was originally a three-part retrospective in tribute to Eric Morecambe | Sylvia Dee; location not specified in the source. | ✗ | 20.2s |
| 19 | What is in both the Lithocarpus and Duranta species? | trees | trees | ✓ | 24s |
| 20 | What was the name of the publisher who published "Finnegans Wake" in 1939 by James Joyce | Teriade | The provided materials do not specify the publisher. | ✗ | 24.8s |
| 21 | The Company They Keep is a book written by Diana Pavlac Glyer, who is a professor at a university in Azusa, California, that was founded in 1899, and is under the auspices of what religion? | evangelical Christian | Evangelical Christianity | ✓ | 17.9s |
| 22 | What characteristic meaning it's transferable between species, does monkeypox and cowpox virus both share? | zoonotic | zoonotic | ✓ | 16.5s |
| 23 | Which movie came out first, "Bambi" or "Underdog"? | Bambi | Bambi | ✓ | 16.8s |
| 24 | Which retired Argentine footballer who played as a forward was a main player for Valencia CF? | Claudio Javier López | Claudio López | ✓ | 15.6s |
| 25 | What 2003 Christmas-themed romantic comedy did Gregor Fisher have a role in? | Love Actually | Love Actually | ✓ | 18.5s |
| 26 | What is the nickname of the peninsula that is home to the Calabrian Black Squirrel? | "lo Stivale" (the Boot) | the Boot | ✓ | 34.4s |
| 27 | In which town was the amusement park that is operated by Britannia Jinky Jersey Ltd located where the first Tomorrow's Parties Festival was held?. | Camber Sands | Camber Sands | ✓ | 8.7s |
| 28 | The 2006 NCAA Wrestling Championships crowned Jake Rosholt and another athlete known for powerful punches from what hand? | left | left hand | ✓ | 9.4s |
| 29 | What is the original name of the place where The 1st Minnesota Light Artillery Battery mustered? | Fort Saint Anthony | Fort Saint Anthony | ✓ | 9s |
| 30 | Who was the last king of the Shahiya? | Trilochanpala | Trilochanpala | ✓ | 14.3s |
| 31 | In what year was the mathematician husband of Anneli Cahn Lax born? | 1926 | 1926 | ✓ | 8.3s |
| 32 | The ghetto that George Kadish documented held how many people at its peak? | 29,000 | 29,000 | ✓ | 9.3s |
| 33 | Which Australian singer-songwriter wrote Cold Hard Bitch | Nicholas John "Nic" Cester | Nic Cester | ✓ | 9.2s |
| 34 | What team won the XLII super bowl in their 48th overall season? | 2007 New England Patriots | No team (The New York Giants won Super Bowl XLII in their 83rd season; the New York Jets were in their 48th overall season in 2007 but did not win) | ✗ | 35.8s |
| 35 | Which author wrote about a woman captured by the Symbionese Liberation Army? | Paul Avery | Susan Choi | ✗ | 8.3s |
| 36 | Hans Florian Zimmer composed The original music score for Pacific Heights, since the 19080's how many films has he composed music for? | over 150 films | over 150 | ✓ | 14.3s |
| 37 | When was the Chinese American electronic musician and singer who collaborated on the album I Remember born? | 1989 | 1989 | ✓ | 12.2s |
| 38 | The Twelfth United States Army Group commander was the first chairman of what? | Joint Chiefs of Staff | Joint Chiefs of Staff | ✓ | 8.1s |
| 39 | When did Senator Ted Kennedy helped dedicate a new room at the location to his maternal grandfather, John F. Fitzgerald. | St. Patrick's Day in 1988 | St. Patrick’s Day in 1988 | ✓ | 8.5s |
| 40 | What key role did the stadium's snowplow operated play in the game following the Dolphins win against the Minnesota Vikings? | cleared a spot on the snowy field specifically for New England kicker John Smith | Cleared a spot on the field for the Patriots’ game-winning field goal. | ✓ | 15.7s |
| 41 | How many times has the national team Joseph Raich Garriga played for in 1941 participated in FIFA World Cups? | 14 | 14 | ✓ | 13.6s |
| 42 | Which writer is older, Joseph Epstein or Milan Kundera? | Milan Kundera | Milan Kundera | ✓ | 8.5s |
| 43 | The most principle species of plants which requires an ericaceous type of compost can have what effect on its surroundings because of the way it takes up cations? | Peat moss can also acidify its surroundings by taking up cations | acidify its surroundings | ✓ | 9.5s |
| 44 | Ruffin Horne McNeill Jr. an American football coach was named interim head coach after the suspension of a head coach that lead the team to winning seasons in every year of his what? | tenure | tenure | ✓ | 16.5s |
| 45 | Atlanta Zero Mile Post is located within a historic area opened in what year ? | 1969 | 1969 | ✓ | 9.5s |
| 46 | What is the country of origin of the film Dui Purush and the music director Pankaj Mullick | Bengali | India | ✓ | 11s |
| 47 | Who else beside the American university administrator and politician from the state of Oklahoma was part of the Boren-McCurdy proposals? | David McCurdy | David McCurdy | ✓ | 9.8s |
| 48 | Hina is derived from a dye prepared in what areas? | South Asia and the Middle East | Not specified in the provided materials. | ✓ | 20s |
| 49 | "52nd Street" is a 1978 album that earned two Grammy Awards for which piano-playing songwriter? | Billy Joel | Billy Joel | ✓ | 9.3s |
| 50 | Are Vintage Life and InStyle both US-based magazines? | no | No | ✓ | 8.7s |
| 51 | How long does the lower level degree program, offered at Helene Fuld College of Nursing, typically last? | two years | Two years | ✓ | 10.5s |
| 52 | How large of the area is the nature reserve south of Seacroft Esplanade? | 4.3 km2 | approximately 4.3 km² | ✓ | 8.6s |
| 53 | What are the letters of the radio station serves the area comprising all of Belknap County, among others? | WANH | WVNH | ✗ | 16.5s |
| 54 | What where both Hawker Hurricane and No. 1455 Flight apart of? | Royal Air Force | the Royal Air Force (RAF) | ✓ | 11.8s |
| 55 | ElvenQuest is a comic fantasy broadcast that stars what English actress who is the wife of Lord Frederick Windsor, and who is formally referred to as what? | Lady Frederick Windsor | Sophie Winkleman; Lady Frederick Windsor | ✓ | 9.6s |
| 56 | Which singer is younger, Shirley Manson or Jim Kerr? | Shirley Ann Manson | Shirley Manson | ✓ | 11.5s |
| 57 | Kang Sung-yeon played Prince Yeonsan in a film that runs for how many minutes ? | 119 minutes | 119 | ✓ | 34.3s |
| 58 | Which album was released first, "Talk That Talk" or "Loud"? | Loud | Loud | ✓ | 13s |
| 59 | Where was the set for the winner of the WD Weatherford Award in 1998? | Coalwood | Coalwood, West Virginia | ✓ | 15s |
| 60 | What chef is the owner of a Japanese restaurant in the Tribeca neighborhood and also owns two Bar Masas in New York and Nevada? | Masayoshi "Masa" Takayama | Masa Takayama | ✓ | 10.5s |
| 61 | What is special about the wristwatches that Favre-Leuba manufactures? | Swiss made | The material does not specify any special features of Favre-Leuba wristwatches. | ✗ | 16.3s |
| 62 | Who is the son of John Button under contract with as a driver? | McLaren-Honda | Jenson Button | ✓ | 12s |
| 63 | Where is the seminar Jeanne Marie Beaumont directed in 2007-2010 located? | Franconia, New Hampshire | Franconia, New Hampshire, United States | ✓ | 14s |
| 64 | Muslim Mahammad oglu Magomayev is the grandfther of what Soviet Azerbaijani singer who was dubbed the King of Songs? | Muslim Magometovich Magomayev | Muslim Magomayev | ✓ | 11.9s |
| 65 | The Hong Kong Museum of Coastal Defence is located on an island with a population of what? | 1,289,500 | 1,289,500 | ✓ | 9.4s |
| 66 | Have tennis players Françoise Dürr and Mate Pavić both won a doubles title? | yes | Yes | ✓ | 11.9s |
| 67 | Who achieved more academically, Andrea Martin or Mark Hoplamazian? | Mark S. Hoplamazian | Mark Hoplamazian | ✓ | 12.3s |
| 68 | What county in Minnesota holds a 202 lb slab of greywacke covered in runes? | Douglas | Douglas County | ✓ | 9.6s |
| 69 | Toby Scott worked with which American singer born on May 24, 1941? | Bob Dylan | Bob Dylan | ✓ | 7.1s |
| 70 | Cliburn railway station was a station situated on This railway that ran between Clifton Junction near Penrith and Kirkby Stephen via what? | Appleby-in-Westmorland | Appleby-in-Westmorland | ✓ | 9.8s |
| 71 | What other jobs did the man that co-produced Gyara Hazar Ladkian have? | film lyricist | Poet and story writer | ✗ | 8s |
| 72 | What was the name of the person that was interviewed and later written about by John G. Neihardt? | Black Elk | Black Elk | ✓ | 8.8s |
| 73 | Daddy was an American Pit Bull who was integral to the work of what Mexican-American dog behaviorist with over 25 years of canine experience? | Cesar Millan | Cesar Millan | ✓ | 8.4s |
| 74 | What man is linked to both Johnny Tremain and Magic Kingdom? | Walt Disney | Walt Disney | ✓ | 11.3s |
| 75 | In what year was the narrator of "Blackadder's Christmas Carol" born? | 1959 | 1959 | ✓ | 10s |
| 76 | Which other film did one of the supporting cast in "Sleepless in Seattle" appear? | "Now and Then" (1995) | Uncle Buck | ✗ | 7.7s |
| 77 | This stadium, the largest in eastern Europe, was home to the 1998 IAAF Grand Prix Final. How many seats does it have? | 81,000 seats | 81,000 | ✓ | 8.8s |
| 78 | The comedy play written by Shakespeare titled Twelfth Night is also know by what name? | What You Will | Twelfth Night, or What You Will | ✓ | 9.4s |
| 79 | What country does Haringey Heartlands and The Mall Wood Green have in common? | London | England | ✓ | 13.8s |
| 80 | Which genus of plant is named after a person, Amesiella or Cucurbita? | Amesiella | Amesiella | ✓ | 8s |
| 81 | The world's greatest Super-Heroes anthology showcased one of four superheroes known for speaking the phrase "SHAZAM", what was their name? | Captain Marvel | Captain Marvel | ✓ | 11.3s |
| 82 | Firstar Center was the name for two buildings before the company changed its name to match which company based in Minneapolis? | U.S. Bancorp | U.S. Bancorp | ✓ | 9.5s |
| 83 | Gail Matthius co-anchored the Weekend Update segment of "Saturday Night Live" with the actor who played the villain Nicholas Andre in what movie? | Dumb and Dumber | Dumb and Dumber | ✓ | 8.8s |
| 84 | Bill Woodfull opened pairing with what cricketer who died in April of 1991? | Bill Ponsford | Bill Ponsford | ✓ | 10.8s |
| 85 | Who composed the theme music in 1989 of an animated television series which has the current arrangement by a person who has scored or orchestrated music for more than 30 films and television shows? | Danny Elfman | Danny Elfman | ✓ | 10.9s |
| 86 | In which of the largest surviving medieval old towns in Europe is the Vilnius Cathedral located? | Vilnius Old Town | Old Town of Vilnius | ✓ | 7.4s |
| 87 | What profession does H. L. Mencken and Albert Camus have in common? | journalist | Journalist | ✓ | 7.1s |
| 88 | Jimmy D'Arcy played in Northern Ireland for the team based in what county? | Antrim | Antrim | ✓ | 12s |
| 89 | Which building is taller Bertelsmann Building or 432 Park Avenue? | 432 Park Avenue | 432 Park Avenue | ✓ | 8.7s |
| 90 | Which "The Chronicles of Narnia" character is prominently featured in "The Lion, the Witch and the Wardrobe" and is a close friend with Lucy Pevensie whom she meets in the Lantern Waste. | Mr. Tumnus | Mr. Tumnus | ✓ | 10.7s |
| 91 | Who directed the 2015 South Korean drama film starring Hwang Jung-min? | Lee Seok-hoon | Lee Seok-hoon | ✓ | 9.7s |
| 92 | How many episodes were there of the TV series where Julianna Margulies had the role of Carol Hathaway ? | 331 episodes | 331 episodes | ✓ | 12.7s |
| 93 | Which publisher released the prequel to the 2012 novel Boneland in 1960? | Sir William Collins | Collins | ✓ | 11.7s |
| 94 | Who has written more than 300 papers, Semyon Aranovich Gershgorin or Pavel Alexandrov? | Pavel Sergeyevich Alexandrov | Pavel Alexandrov | ✓ | 10.4s |
| 95 | What is this subfamily within the cat family Felidae named by Reginald Innes Pocock that is descendant of Pseudaelurus? | Pantherinae | Pantherinae | ✓ | 7.8s |
| 96 | In which election did Norm Coleman won to become the last republican elected as of 2017? | 2002 | 2002 United States Senate election in Minnesota | ✓ | 11s |
| 97 | Giselle Cossard was known as Mother Giselle of what type of diety? | major water deity | Orisha | ✗ | 7s |
| 98 | Dan Balan co-wrote the song from what T.I. album? | Paper Trail | Paper Trail | ✓ | 6.5s |
| 99 | Who was the brother of the wife of the Democratic Party nomination for Vice President in 1972? | President John F. Kennedy | John F. Kennedy, Robert F. Kennedy, and Ted Kennedy | ✓ | 9.4s |
| 100 | The 2000 ICC KnockOut Trophy was the debut of a Jamaican cricketer who is a right-handed what? | middle order batsman | middle order batsman and off-spinner | ✓ | 11.2s |
2WikiMultiHopQA 逐题结果（100 题，点击展开）
| # | 问题 | 标准答案 | DeepLocals 短答案 | 判定 | 耗时 |
|---|---|---|---|---|---|
| 1 | Which film has the director born earlier, Carlo Giuliani, Boy or Ned Rifle? | Ned Rifle | Ned Rifle | ✓ | 13.8s |
| 2 | Which film has the director born later, Ask A Policeman or The Half-Naked Truth? | Ask A Policeman | Ask A Policeman | ✓ | 13.6s |
| 3 | Which film has the director who was born later, Caresses or Satiricosissimo? | Caresses | Caresses | ✓ | 15.4s |
| 4 | Which film has the director died later, The Glass Wall or Where Does It Hurt?? | Where Does It Hurt? | Where Does It Hurt? | ✓ | 15s |
| 5 | Which country Henry Cavendish, Earl Of Ogle's father is from? | English | England | ✓ | 11.2s |
| 6 | Who is older, Pattom A. Thanu Pillai or Francesco Boccapaduli? | Francesco Boccapaduli | Francesco Boccapaduli | ✓ | 20.2s |
| 7 | Do director of film Ten9Eight: Shoot For The Moon and director of film Sabotage (1936 Film) share the same nationality? | yes | Cannot be confirmed from the provided materials. | ✗ | 10.9s |
| 8 | Who is Tlilpotoncatzin's uncle? | Chimalpopoca | Huitzilihuitl is his grandfather; his uncles include Chimalpopoca and Moctezuma I. | ✓ | 7.9s |
| 9 | Where was the director of film Flags And Waves born? | Toronto | Unknown from the provided sources | ✗ | 13.1s |
| 10 | Who is Margaret Of Baux's father-in-law? | John of Luxembourg, Lord of Beauvoir | John of Luxembourg, Lord of Beauvoir | ✓ | 9.8s |
| 11 | Which film has the director who is older than the other, Airheads or Return To Cabin By The Lake? | Return To Cabin By The Lake | Return to Cabin by the Lake | ✓ | 12.7s |
| 12 | Which film has the director who is older, God'S Gift To Women or Aldri Annet Enn Bråk? | God'S Gift To Women | God's Gift to Women | ✓ | 13.4s |
| 13 | Where was the place of death of the director of film Volavérunt? | La Riera de Gaià | La Riera de Gaià, Catalonia | ✓ | 17.3s |
| 14 | Who is the paternal grandfather of Margaret Of Bavaria, Marchioness Of Mantua? | Ernest, Duke of Bavaria | Ernest, Duke of Bavaria | ✓ | 8.2s |
| 15 | Which film has the director who is older, The Gamecock (Film) or Monster A Go-Go? | Monster A Go-Go | The Gamecock (Film) | ✓ | 26.2s |
| 16 | Are Carl Wijk and Anders Lindstedt from the same country? | yes | Yes | ✓ | 7s |
| 17 | What is the place of birth of Marisabel Rodríguez De Chávez's husband? | Sabaneta | Sabaneta, Barinas, Venezuela | ✓ | 9s |
| 18 | Who is Abd Al-Aziz Ibn Al-Walid's paternal grandfather? | Abd al-Malik ibn Marwan | Abd al-Malik ibn Marwan | ✓ | 7.5s |
| 19 | What is the place of birth of the director of film The Return Of Swamp Thing? | New York | Glen Cove, Long Island, New York | ✓ | 9.9s |
| 20 | Which film was released more recently, An Empress And The Warriors or Die Screaming, Marianne? | An Empress And The Warriors | An Empress and the Warriors | ✓ | 6.4s |
| 21 | Are both Cupid The Cowpuncher and Hashimura Togo from the same country? | yes | Yes | ✓ | 8.9s |
| 22 | Who is the spouse of the director of film The Glass Boat? | Käthe von Nagy | Käthe von Nagy | ✓ | 10.8s |
| 23 | Who died first, Thomas Valentine Cooper or John Ellis Roosevelt? | Thomas Valentine Cooper | Thomas Valentine Cooper | ✓ | 6.7s |
| 24 | Which film has the director who died earlier, The Toast Of Death or The Famous Mrs. Fair? | The Toast Of Death | The Toast of Death | ✓ | 17.2s |
| 25 | Who died first, Earl Valiquette or Jean-Joseph Gaume? | Jean-Joseph Gaume | Jean-Joseph Gaume | ✓ | 7.1s |
| 26 | Which film whose director is younger, Chased By The Dogs or The Demise Of Herman Durer? | The Demise Of Herman Durer | The Demise Of Herman Durer | ✓ | 15.7s |
| 27 | Are both movies, Inauguration Of The Pleasure Dome and Texans Never Cry, from the same country? | yes | Yes | ✓ | 19.5s |
| 28 | Where did the director of film Ave Caesar! die? | London | Unknown (not specified in provided documents) | ✗ | 12.2s |
| 29 | Which film has the director who was born later, Il Diavolo In Convento or The Big Broadcast Of 1936? | The Big Broadcast Of 1936 | The Big Broadcast of 1936 | ✓ | 16s |
| 30 | What is the place of birth of the director of film Under The Cards? | Carcassonne | Carcassonne | ✓ | 9.2s |
| 31 | Who is the father-in-law of Sisowath Kossamak? | Norodom Sutharot | Prince Norodom Sutharot | ✓ | 5.5s |
| 32 | Which film has the director who died later, Love, Honor And Oh-Baby! or I Cover The Underworld? | Love, Honor And Oh-Baby! | Love, Honor And Oh-Baby! | ✓ | 16.6s |
| 33 | Who is the spouse of the director of film Bratuku Teruvu? | Bhanumathi Ramakrishna | Bhanumathi Ramakrishna | ✓ | 10.7s |
| 34 | Where was the husband of Ting-Xing Ye born? | Toronto, Ontario | Toronto, Ontario | ✓ | 9.9s |
| 35 | Who is Thomas Stafford, 3Rd Earl Of Stafford's father? | Hugh de Stafford, 2nd Earl of Stafford | Hugh Stafford, 2nd Earl of Stafford | ✓ | 8.6s |
| 36 | Who is the spouse of the director of film Pratisodh (2004 Film)? | Piya Sengupta | Piya Sengupta | ✓ | 12.9s |
| 37 | Who was born later, John Augustus Conolly or Abdel Nasser Barakat? | Abdel Nasser Barakat | Abdel Nasser Barakat | ✓ | 6.6s |
| 38 | Which film has the director who was born earlier, The Red Eagle or Vishukkani? | Vishukkani | Vishukkani | ✓ | 15.2s |
| 39 | What nationality is Arabia (Daughter Of Justin Ii)'s mother? | Byzantine Empire | Byzantine (empress consort of the Byzantine Empire; not explicitly stated as a nationality in the materials). | ✓ | 14.2s |
| 40 | Who is younger, Isaac P. Walker or Nakkhatra Mangala? | Nakkhatra Mangala | Nakkhatra Mangala | ✓ | 9.8s |
| 41 | When did Eduardo Frei Ruiz-Tagle's father die? | January 22, 1982 | January 22, 1982 | ✓ | 6.2s |
| 42 | Who is the father of the director of film Homage At Siesta Time? | Leopoldo Torres Ríos | Leopoldo Torres Ríos | ✓ | 9.7s |
| 43 | Are both airports, Far View Airport and Bellevue Airfield, located in the same country? | yes | Yes | ✓ | 6.9s |
| 44 | Did R. D. Call and Taryn Power share the same nationality? | yes | Yes | ✓ | 5.1s |
| 45 | Which film has the director who was born later, The Devil And Miss Jones or The Man In The Funny Suit? | The Man In The Funny Suit | The Man in the Funny Suit | ✓ | 17.2s |
| 46 | Which film has the director born earlier, The Korean Wedding Chest or True To The Navy? | True To The Navy | True To The Navy | ✓ | 14.9s |
| 47 | Where did John Ii, Duke Of Cleves's wife die? | Cologne | Not specified in the provided sources. | ✗ | 14.4s |
| 48 | Who is the paternal grandfather of Reginald I Of Guelders? | Gerard III, Count of Guelders | Gerard III, Count of Guelders | ✓ | 7.1s |
| 49 | Who is Albert G. Simms's father-in-law? | Mark Hanna | Mark Hanna | ✓ | 11.4s |
| 50 | Are Antoine Jean-Baptiste Thomas and Canardo (Rapper) of the same nationality? | yes | Yes | ✓ | 7s |
| 51 | Which film has the director who was born later, Five Red Tulips or Laughing At Death? | Laughing At Death | Laughing at Death | ✓ | 15.9s |
| 52 | Are Victoria Winter and Jon Sullivan of the same nationality? | yes | Yes. | ✓ | 10.7s |
| 53 | Who is the father-in-law of Elizabeth Somerset, Baroness Herbert? | Henry Beaufort | Not specified in the provided materials. | ✗ | 8.8s |
| 54 | Which film was released more recently, Woman Without A Past or Il Seduttore? | Il Seduttore | Il Seduttore | ✓ | 8.2s |
| 55 | Do both films All Souls (Film) and Atomised (Film) have the directors from the same country? | yes | The provided documents state that both are German films, but do not explicitly state the nationalities of the directors Oskar Roehler and Erik Lund. | ✗ | 14s |
| 56 | Who is the maternal grandmother of Princess Catherine Of Württemberg? | Henriette of Nassau-Weilburg | Princess Henriette of Nassau-Weilburg | ✓ | 8.5s |
| 57 | Why did the composer of song Waspman die? | overdose | He died from a Heminevrin overdose. | ✓ | 11.9s |
| 58 | Who is the paternal grandfather of Ferdinand Zvonimir Von Habsburg? | Otto von Habsburg | Otto von Habsburg | ✓ | 7.6s |
| 59 | What is the date of death of the founder of university University Of Los Andes (Colombia)? | July 16, 2013 | July 16, 2013 | ✓ | 6.7s |
| 60 | Which film has the director born first, Free Hand For A Tough Cop or Man'S Favorite Sport?? | Man'S Favorite Sport? | Man's Favorite Sport? | ✓ | 16.5s |
| 61 | Where was the director of film The Ape (2005 Film) born? | Palo Alto | Not specified in the provided materials | ✗ | 21.2s |
| 62 | Which country Anthony I, Count Of Ligny's father is from? | France | Country not explicitly stated in the provided references; father was Louis de Luxembourg, Count of Saint-Pol. | ✓ | 11.7s |
| 63 | Who died earlier, Joseph Dudley or Francisco Herrera Luque? | Joseph Dudley | Joseph Dudley | ✓ | 7.2s |
| 64 | What nationality is Huo Yi's father? | Eastern Han Dynasty | Chinese | ✓ | 9s |
| 65 | Which film came out first, Girl From Hong Kong or Forces Occultes? | Forces Occultes | Forces Occultes | ✓ | 6.5s |
| 66 | What is the place of birth of the editor of magazine Scrutiny (Journal)? | Cambridge | Birmingham, England | ✗ | 12.9s |
| 67 | Are Chemours and Hadag located in the same country? | no | No | ✓ | 6.6s |
| 68 | Who lived longer, Martino Finotto or Franklin Edson? | Martino Finotto | Martino Finotto | ✓ | 10.2s |
| 69 | Were both Pietro Salini and Domenico Ravenna, born in the same place? | yes | Cannot be determined from the provided information. | ✗ | 10.3s |
| 70 | What is the place of birth of Richard Socarides's father? | Brockton, Massachusetts | Brockton, Massachusetts | ✓ | 6.6s |
| 71 | Where did the director of film The Eagle'S Eye study? | Amherst | Amherst College | ✓ | 12.9s |
| 72 | Who is Edith Of Wessex's mother-in-law? | Emma | Emma of Normandy | ✓ | 8.9s |
| 73 | What is the place of birth of the director of film Tammy And The T-Rex? | British | Cannot be determined from the provided sources | ✓ | 13.1s |
| 74 | Which film has the director died later, Lost In The Stratosphere or Blind Man'S Eyes? | Blind Man'S Eyes | Blind Man's Eyes | ✓ | 17.5s |
| 75 | Who is the paternal grandmother of George Rodney, 3Rd Baron Rodney? | Lady Jane Compton | Lady Jane Compton | ✓ | 10s |
| 76 | Which magazine was founded first, Racing Toward Diversity or Lo Scolaro? | Lo Scolaro | Lo Scolaro | ✓ | 6.3s |
| 77 | Where did Adolph Of Cleves, Lord Of Ravenstein's mother die? | Kalkar | Cleves (present-day Monterberg, Kalkar) | ✓ | 5.7s |
| 78 | Where was the place of burial of Li Sujie's father? | Qianling Mausoleum | Qianling Mausoleum | ✓ | 10.6s |
| 79 | Who is the paternal grandfather of Anna Dorothea, Abbess Of Quedlinburg? | William, Duke of Saxe-Weimar | William, Duke of Saxe-Weimar | ✓ | 10.6s |
| 80 | Who is the spouse of the composer of song Know Bout Me? | Beyoncé | Not found in provided sources | ✗ | 16.2s |
| 81 | Which film was released more recently, No Path Through Fire or Bright Leaf? | No Path Through Fire | No Path Through Fire | ✓ | 14.6s |
| 82 | Which country Al-Mu'Tasim's father is from? | Abbasid Caliphate | Iraq | ✓ | 21.1s |
| 83 | Which film came out earlier, I Love You Rosa or Pyar Ka Bandhan? | Pyar Ka Bandhan | Pyar Ka Bandhan | ✓ | 8.2s |
| 84 | Which museum was established first, Museum Of Croatian Archaeological Monuments or Bayernhof Music Museum? | Museum Of Croatian Archaeological Monuments | Museum of Croatian Archaeological Monuments | ✓ | 7.4s |
| 85 | Who is the maternal grandmother of Louis, Dauphin Of France (Son Of Louis Xv)? | Catherine Opalińska | Catherine Opalińska | ✓ | 8.4s |
| 86 | Which country Nizar Al-Mustafa's father is from? | Fatimid caliphate | Egypt | ✓ | 13.4s |
| 87 | Where was the director of film The Outlaw Express born? | Santa Rosa | Not specified in the provided materials (director: George Waggner for the 1938 film or Leo D. Maloney for the 1926 film) | ✗ | 11.7s |
| 88 | Which film has the director who was born later, Sylvie Et Le Fantôme or Sky Patrol? | Sylvie Et Le Fantôme | Sylvie Et Le Fantôme | ✓ | 15.2s |
| 89 | Are the movies Hellraiser: Revelations and Night Of Mystery, from the same country? | yes | Yes | ✓ | 9.6s |
| 90 | Where did Fedor Frešo's father die? | Piešťany | Piešťany | ✓ | 6.7s |
| 91 | Did the movies Inside The Room and Crude Set Drama, originate from the same country? | yes | Yes | ✓ | 8.7s |
| 92 | Where did the director of film That Nazty Nuisance die? | Orlando, Florida | Orlando, Florida | ✓ | 10.8s |
| 93 | Where was the place of death of the director of film The Picture Of Dorian Gray (1945 Film)? | New York | Not specified in the provided materials | ✗ | 16.5s |
| 94 | Where did the director of film The Alster Case die? | Baltimore | Baltimore, Maryland | ✓ | 11.4s |
| 95 | Which country the director of film Sarah Silverman: Jesus Is Magic is from? | United States | United States | ✓ | 13.6s |
| 96 | Who is Marianus V Of Arborea's mother? | Eleanor of Arborea | Eleanor of Arborea | ✓ | 6.9s |
| 97 | Where did the composer of film Camille (1926 Feature Film) die? | Ukiah | Ukiah, California | ✓ | 6.7s |
| 98 | Where was the director of film The Poll Diaries born? | Göttingen | Göttingen, Germany | ✓ | 12.6s |
| 99 | Where did M. K. Muthu's father die? | kauvery hospital | Kauvery Hospital in Chennai | ✓ | 10.2s |
| 100 | Which film has the director born first, A.P.E.X. or Quax In Africa? | Quax In Africa | Quax In Africa | ✓ | 13.5s |