Day9-基礎語言模型N_Gram實作作業.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### 作業目的: 使用N-Gram模型預測文字\n",
    "\n",
    "本次作業會使用[桃園市官網市政新聞](https://data.gov.tw/dataset/25891)來進行練習"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### 載入所需的Libraries"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [],
   "source": [
    "import json\n",
    "import re\n",
    "from collections import Counter, namedtuple"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### 載入資料"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [],
   "source": [
    "with open('./WebNews.json', 'r', encoding= 'UTF8') as f:\n",
    "    ### <your code> ###\n",
    "    news_data= json.load(f)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [
    {
     "output_type": "execute_result",
     "data": {
      "text/plain": [
       "[{'file': [],\n",
       "  'link': [],\n",
       "  'id': '202006110003',\n",
       "  'istop': 'N',\n",
       "  'img': [{'imgname': '0611桃園屏東_200611_0004.jpg',\n",
       "    'imgcontent': '<br>鄭<br>市<br>長<br>與<br>潘<br>縣<br>長<br>合<br>體<br>推<br>廣<br>防<br>疫<br>互<br>惠<br>旅<br>遊<br>',\n",
       "    'imgurl': 'http://www.tycg.gov.tw/uploaddowndoc?file=news/202006111817400.jpg&filedisplay=202006111817400.jpg&flag=pic'},\n",
       "   {'imgname': '0611桃園屏東_200611_0005.jpg',\n",
       "    'imgcontent': '<br>潘<br>縣<br>長<br>挑<br>選<br>屏<br>東<br>特<br>色<br>伴<br>手<br>禮<br>致<br>贈<br>鄭<br>市<br>長<br>',\n",
       "    'imgurl': 'http://www.tycg.gov.tw/uploaddowndoc?file=news/202006111817401.jpg&filedisplay=202006111817401.jpg&flag=pic'},\n",
       "   {'imgname': '0611桃園屏東_200611_0007.jpg',\n",
       "    'imgcontent': '<br>鄭<br>市<br>長<br>精<br>心<br>準<br>備<br>桃<br>園<br>特<br>色<br>伴<br>手<br>禮<br>送<br>給<br>潘<br>縣<br>長<br>',\n",
       "    'imgurl': 'http://www.tycg.gov.tw/uploaddowndoc?file=news/202006111817402.jpg&filedisplay=202006111817402.jpg&flag=pic'},\n",
       "   {'imgname': '0611桃園屏東_200611_0006.jpg',\n",
       "    'imgcontent': '<br>桃<br>園<br>市<br>觀<br>光<br>旅<br>遊<br>發<br>展<br>協<br>會<br>李<br>理<br>事<br>長<br>特<br>別<br>致<br>贈<br>端<br>午<br>粽<br>子<br>給<br>屏<br>東<br>縣<br>政<br>府<br>團<br>隊<br>',\n",
       "    'imgurl': 'http://www.tycg.gov.tw/uploaddowndoc?file=news/202006111819460.jpg&filedisplay=202006111819460.jpg&flag=pic'},\n",
       "   {'imgname': '0611桃園屏東_200611_0008.jpg',\n",
       "    'imgcontent': '<br>潘<br>縣<br>長<br>推<br>薦<br>親<br>子<br>旅<br>遊<br>首<br>選<br>屏<br>東<br>',\n",
       "    'imgurl': 'http://www.tycg.gov.tw/uploaddowndoc?file=news/202006111819461.jpg&filedisplay=202006111819461.jpg&flag=pic'},\n",
       "   {'imgname': '0611桃園屏東_200611_0009.jpg',\n",
       "    'imgcontent': '<br>鄭<br>市<br>長<br>期<br>盼<br>透<br>過<br>互<br>惠<br>旅<br>遊<br>，<br>國<br>境<br>之<br>南<br>與<br>國<br>境<br>之<br>門<br>有<br>最<br>好<br>的<br>交<br>流<br>',\n",
       "    'imgurl': 'http://www.tycg.gov.tw/uploaddowndoc?file=news/202006111819462.jpg&filedisplay=202006111819462.jpg&flag=pic'},\n",
       "   {'imgname': '0611桃園屏東_200611_0010.jpg',\n",
       "    'imgcontent': '<br>桃<br>園<br>Ｘ<br>屏<br>東<br>，<br>旅<br>遊<br>優<br>惠<br>一<br>波<br>接<br>一<br>波<br>',\n",
       "    'imgurl': 'http://www.tycg.gov.tw/uploaddowndoc?file=news/202006111816210.jpg&filedisplay=202006111816210.jpg&flag=pic'},\n",
       "   {'imgname': '0611桃園屏東_200611_0002.jpg',\n",
       "    'imgcontent': '<br>桃<br>園<br>伴<br>手<br>禮<br>種<br>類<br>多<br>元<br>',\n",
       "    'imgurl': 'http://www.tycg.gov.tw/uploaddowndoc?file=news/202006111816211.jpg&filedisplay=202006111816211.jpg&flag=pic'},\n",
       "   {'imgname': '0611桃園屏東_200611_0003.jpg',\n",
       "    'imgcontent': '<br>大<br>合<br>照<br>',\n",
       "    'imgurl': 'http://www.tycg.gov.tw/uploaddowndoc?file=news/202006111816212.jpg&filedisplay=202006111816212.jpg&flag=pic'}],\n",
       "  'subject': '迎接國旅爆發期，五星縣市長合體推廣桃園、屏東互惠旅遊',\n",
       "  'datasourceunit': '新聞處',\n",
       "  'liaisonemail': '',\n",
       "  'fsort': 2,\n",
       "  'detailcontent': '<strong>迎接國旅爆發期，五星縣市長合體推廣桃園、屏東互惠旅遊</strong><br />&nbsp;<br />桃園市長鄭文燦今（11）日下午出席「桃園加屏東『旅遊優惠強棒一棒接一棒』好康發表記者會」，鄭市長表示，隨著疫情趨緩，國內進入國旅爆發期，觀光局近期公布最新10大熱門旅遊景點，桃園包辦前三名，依序為大溪老街、石門水庫及角板山，顯示桃園旅遊的潛力無限；鄭市長說，桃園市與屏東縣各自擁有獨特的觀光魅力與資源，希望能搭配中央觀光振興方案，共同推廣防疫互惠旅遊，並推出更多加碼優惠措施，降低民眾的旅遊負擔、增加旅遊的樂趣，也讓國境之南與國境之門做最好的交流。<br />&nbsp;<br />鄭市長提到，桃園是國門之都、屏東是國境之南，兩個城市各有特色及魅力，許多景點也互相輝映，假如你喜歡屏東的山川琉璃吊橋，絕對不能錯過桃園的新溪口吊橋，如果你喜歡大溪老街，也應該去恆春古城漫遊；鄭市長說，許多民眾造訪過很多國外景點，例如普吉島、巴里島，卻沒有到過小琉球、澎湖等離島，十分可惜；他也稱讚屏東幅員遼闊，擁有多樣化的景點，墾丁更是國內旅遊勝地之一，希望現階段推動防疫新生活的同時，桃園也能與各縣市合作，一起推廣防疫互惠旅遊，讓更多在地旅遊業者受惠。<br />&nbsp;<br />桃園預估下半年包含鄰里長、環保志工、守望相助隊、義警民防等觀摩旅遊團數，出團數將達500團以上，目前桃園第一階段已經與基隆、台南、屏東等縣市簽署合作契約，第二階段將與宜蘭、花蓮、南投、嘉義等縣市合作，希望未來逐漸擴大至其他縣市，提供遊客更多優惠措施；鄭市長也說，屏東縣推出三鐵優惠方案，桃園市自7月1日起推出「來桃園住一晚‧加贈免費一日遊」方案，遊客來桃園在合法旅宿住一晚，即可獲得市府加贈免費一日遊行程，內容包含遊覽車接送、午餐、景點門票或DIY體驗等，期盼帶領遊客體驗桃園的觀光魅力；此外，民眾也可以持200元振興三倍券兌換400元夜市券，藉此鼓勵民眾到夜市消費，市府未來也將陸續推出更多的加碼優惠措施。<br />&nbsp;<br />屏東縣長潘孟安則希望在鄭市長推廣下，吸引更多桃園市民到屏東旅遊，他表示，桃園為國境之門，擁有很大的發展優勢，在鄭市長帶領下，桃園連續多年結婚率及出生率都是全國之冠，也成為一座宜居城市，他也特別推薦親子旅遊首選屏東，屏東縣政府整合轄內旅宿業者、伴手禮業者、食品業者等，推出「鐵定加碼、鐵定貼心、鐵定好玩」三鐵優惠，7月15日以前，遊客在恆春地區住宿一晚，即加贈場館門票或等值餐飲券，在東港地區住宿則可用10元加購伴手禮及小王馬福袋；10人以上團體旅遊，每人可獲得500元旅費補助，每團上限1萬元，屏東也有許多當季優質農特產品及特色伴手禮，歡迎桃園市民踴躍到屏東旅遊，保證遊客玩得痛快、買得愉快、吃得爽快。<br />&nbsp;<br />全國中等學校運動會今（109）年首度移師屏東舉辦，潘縣長也特別邀請鄭市長在7月18日開幕式當天，帶領市府團隊一同到屏東為桃園選手加油打氣，爭取比賽佳績，同時也抽空享受屏東的湖光山色，以及感受屏東鄉親的熱情。<br />&nbsp;<br />鄭市長與潘縣長在活動現場互贈特色伴手禮，鄭市長表示，桃園雖然是工業重鎮，但在地農特產品類型多元，食品工業也十分蓬勃，這次市府團隊特別挑選東方美人茶、黃金蜜、吻仔魚海鮮醬、棗到杏福等特色伴手禮送給潘縣長及屏東縣政府團隊；鄭市長也說，桃園接下來幾乎每個月都會有一場以上的大型觀光活動，可說月月都精彩，呼籲屏東鄉親也來桃園走走，促進桃園與屏東的互相交流；潘縣長則特別挑選花襯衫、世界金牌巧克力、金牌咖啡，及全中運吉祥物「驕（鳥）仔」玩偶送給鄭市長。<br />&nbsp;<br />今日包括市議員王仙蓮、呂林小鳳、陳美梅、簡志偉、屏東縣長潘孟安、屏東縣政府交通旅遊處處長黃國維、傳播暨國際事務處處長黃建嘉、研考處處長鄞鳳蘭、農業處副處長鄭永裕、桃園市政府副秘書長何明光、觀旅局長楊勝評、經發局長郭裕信、研考會主委吳君婷、警察局長陳國進、人事處長黃新雛、環保局長呂理德、農業局副局長江富貴、桃園市工商發展投資策進會總幹事陳家濬、屏東旅遊集團董事長郭子義、屏東縣恆春半島觀光產業聯盟理事長林榮欽、屏東縣觀光協會副理事長吳炫東、大鵬灣觀光產業聯盟總幹事徐鳴懋、大鵬灣觀光產業聯盟副總幹事黃啟禎、桃園市觀光旅遊發展協會理事長李三連、桃園市旅館商業同業公會理事長邱照進、桃園市觀光工廠促進發展協會理事長林世閎、桃園市民宿發展協會理事長陳秉弘、雄獅集團總經理劉冷紅等均一同出席活動。<br />&nbsp;',\n",
       "  'secsubject': '',\n",
       "  'closedate': '',\n",
       "  'liaisonfax': '',\n",
       "  'postdate': '2020-06-11',\n",
       "  'postunit': '新聞處',\n",
       "  'liaisonper': '',\n",
       "  'liaisontel': '',\n",
       "  'topdate': '1900-01-01 00:00:00.0'},\n",
       " {'file': [],\n",
       "  'link': [],\n",
       "  'id': '202006110002',\n",
       "  'istop': 'N',\n",
       "  'img': [{'imgname': '0611慰問怡仁醫院暨捐贈防疫物資_200611_0001.jpg',\n",
       "    'imgcontent': '<br>市<br>長<br>感<br>謝<br>鴻<br>福<br>食<br>品<br>力<br>挺<br>怡<br>仁<br>醫<br>院<br>',\n",
       "    'imgurl': 'http://www.tycg.gov.tw/uploaddowndoc?file=news/202006111645370.jpg&filedisplay=202006111645370.jpg&flag=pic'},\n",
       "   {'imgname': '0611慰問怡仁醫院暨捐贈防疫物資_200611_0002.jpg',\n",
       "    'imgcontent': '<br>市<br>長<br>頒<br>發<br>感<br>謝<br>狀<br>予<br>鋒<br>尚<br>精<br>密<br>公<br>司<br>',\n",
       "    'imgurl': 'http://www.tycg.gov.tw/uploaddowndoc?file=news/202006111645371.jpg&filedisplay=202006111645371.jpg&flag=pic'},\n",
       "   {'imgname': '0611慰問怡仁醫院暨捐贈防疫物資_200611_0003.jpg',\n",
       "    'imgcontent': '<br>市<br>長<br>致<br>詞<br>表<br>示<br>，<br>感<br>謝<br>怡<br>仁<br>醫<br>院<br>第<br>一<br>線<br>醫<br>護<br>人<br>員<br>辛<br>勞<br>，<br>也<br>感<br>謝<br>民<br>間<br>企<br>業<br>捐<br>贈<br>防<br>疫<br>物<br>資<br>',\n",
       "    'imgurl': 'http://www.tycg.gov.tw/uploaddowndoc?file=news/202006111645372.jpg&filedisplay=202006111645372.jpg&flag=pic'},\n",
       "   {'imgname': '0611慰問怡仁醫院暨捐贈防疫物資_200611_0004.jpg',\n",
       "    'imgcontent': '<br>市<br>長<br>頒<br>發<br>感<br>謝<br>狀<br>予<br>鴻<br>福<br>食<br>品<br>公<br>司<br>',\n",
       "    'imgurl': 'http://www.tycg.gov.tw/uploaddowndoc?file=news/202006111646030.jpg&filedisplay=202006111646030.jpg&flag=pic'},\n",
       "   {'imgname': '0611慰問怡仁醫院暨捐贈防疫物資_200611_0005.jpg',\n",
       "    'imgcontent': '<br>市<br>長<br>感<br>謝<br>鋒<br>尚<br>精<br>密<br>公<br>司<br>捐<br>贈<br>1<br>,<br>4<br>4<br>0<br>瓶<br>酒<br>精<br>乾<br>洗<br>手<br>噴<br>霧<br>予<br>怡<br>仁<br>醫<br>院<br>',\n",
       "    'imgurl': 'http://www.tycg.gov.tw/uploaddowndoc?file=news/202006111646031.jpg&filedisplay=202006111646031.jpg&flag=pic'},\n",
       "   {'imgname': '0611慰問怡仁醫院暨捐贈防疫物資_200611_0006.jpg',\n",
       "    'imgcontent': '<br>市<br>長<br>與<br>怡<br>仁<br>醫<br>院<br>院<br>長<br>李<br>典<br>穎<br>合<br>影<br>',\n",
       "    'imgurl': 'http://www.tycg.gov.tw/uploaddowndoc?file=news/202006111646032.jpg&filedisplay=202006111646032.jpg&flag=pic'},\n",
       "   {'imgname': '0611慰問怡仁醫院暨捐贈防疫物資_200611_0007.jpg',\n",
       "    'imgcontent': '<br>怡<br>仁<br>醫<br>院<br>院<br>長<br>李<br>典<br>穎<br>表<br>示<br>，<br>感<br>謝<br>市<br>府<br>於<br>疫<br>情<br>之<br>初<br>，<br>即<br>整<br>合<br>1<br>1<br>家<br>醫<br>院<br>成<br>立<br>聯<br>防<br>醫<br>療<br>網<br>，<br>有<br>效<br>率<br>的<br>整<br>合<br>及<br>調<br>度<br>防<br>疫<br>物<br>資<br>',\n",
       "    'imgurl': 'http://www.tycg.gov.tw/uploaddowndoc?file=news/202006111646280.jpg&filedisplay=202006111646280.jpg&flag=pic'},\n",
       "   {'imgname': '0611慰問怡仁醫院暨捐贈防疫物資_200611_0008.jpg',\n",
       "    'imgcontent': '<br>捐<br>贈<br>物<br>資<br>酒<br>精<br>清<br>潔<br>液<br>',\n",
       "    'imgurl': 'http://www.tycg.gov.tw/uploaddowndoc?file=news/202006111646281.jpg&filedisplay=202006111646281.jpg&flag=pic'},\n",
       "   {'imgname': '0611慰問怡仁醫院暨捐贈防疫物資_200611_0009.jpg',\n",
       "    'imgcontent': '<br>感<br>謝<br>民<br>間<br>捐<br>贈<br>防<br>疫<br>物<br>資<br>予<br>怡<br>仁<br>醫<br>院<br>',\n",
       "    'imgurl': 'http://www.tycg.gov.tw/uploaddowndoc?file=news/202006111646282.jpg&filedisplay=202006111646282.jpg&flag=pic'},\n",
       "   {'imgname': '0611慰問怡仁醫院暨捐贈防疫物資_200611_0010.jpg',\n",
       "    'imgcontent': '<br>怡<br>仁<br>醫<br>院<br>醫<br>護<br>人<br>員<br>',\n",
       "    'imgurl': 'http://www.tycg.gov.tw/uploaddowndoc?file=news/202006111646510.jpg&filedisplay=202006111646510.jpg&flag=pic'},\n",
       "   {'imgname': '0611慰問怡仁醫院暨捐贈防疫物資_200611_0011.jpg',\n",
       "    'imgcontent': '<br>市<br>府<br>感<br>謝<br>狀<br>及<br>致<br>贈<br>物<br>資<br>',\n",
       "    'imgurl': 'http://www.tycg.gov.tw/uploaddowndoc?file=news/202006111646511.jpg&filedisplay=202006111646511.jpg&flag=pic'},\n",
       "   {'imgname': '0611慰問怡仁醫院暨捐贈防疫物資_200611_0012.jpg',\n",
       "    'imgcontent': '<br>市<br>長<br>與<br>醫<br>護<br>人<br>員<br>互<br>動<br>',\n",
       "    'imgurl': 'http://www.tycg.gov.tw/uploaddowndoc?file=news/202006111646512.jpg&filedisplay=202006111646512.jpg&flag=pic'},\n",
       "   {'imgname': '0611慰問怡仁醫院暨捐贈防疫物資_200611_0013.jpg',\n",
       "    'imgcontent': '<br>醫<br>護<br>人<br>員<br>協<br>助<br>市<br>長<br>進<br>行<br>手<br>部<br>清<br>潔<br>',\n",
       "    'imgurl': 'http://www.tycg.gov.tw/uploaddowndoc?file=news/202006111647100.jpg&filedisplay=202006111647100.jpg&flag=pic'},\n",
       "   {'imgname': '0611慰問怡仁醫院暨捐贈防疫物資_200611_0014.jpg',\n",
       "    'imgcontent': '<br>市<br>長<br>與<br>貴<br>賓<br>及<br>醫<br>護<br>人<br>員<br>合<br>影<br>',\n",
       "    'imgurl': 'http://www.tycg.gov.tw/uploaddowndoc?file=news/202006111647101.jpg&filedisplay=202006111647101.jpg&flag=pic'}],\n",
       "  'subject': '鄭市長慰問怡仁醫院第一線醫護人員辛勞，感謝民間企業捐贈防疫物資',\n",
       "  'datasourceunit': '新聞處',\n",
       "  'liaisonemail': '',\n",
       "  'fsort': 2,\n",
       "  'detailcontent': '<strong>鄭市長慰問怡仁醫院第一線醫護人員辛勞，感謝民間企業捐贈防疫物資</strong><br />&nbsp;<br />桃園市長鄭文燦今（11）日下午前往楊梅區怡仁醫院，慰問醫護人員，並感謝鴻福食品公司及鋒尚精密公司捐贈防疫物資，同時頒發感謝狀予2家公司。鄭市長表示，感謝醫護人員於疫情期間，發揮專業為市民朋友健康把關，在第一線支援防疫醫療工作，非常辛苦，也感謝楊梅在地企業鴻福食品公司捐贈動物造型餅乾及沙琪瑪各600袋、鋒尚精密公司捐贈30箱酒精乾洗手噴霧予怡仁醫院，共同為防疫盡一份心力。<br />&nbsp;<br />鄭市長提及，市府於防疫期間，每天召開防疫會議，直到6月7日，在中央疫情指揮中心宣布國內階段性解封後，市府才降低召開會議的頻率。桃園為國境第一線，許多集中檢疫所也在桃園，因此防疫負擔沉重，桃園的確診案例為53位，而收治101位確診病患，佔全國約占約2成多，居家隔離及檢疫人數則約為2萬人，桃園更發生幾次指標性案例，例如：首次醫院群聚感染、長照機構護理師確診案、交通部觀光局員工小孩遭感染確診案、酒店公關確診案及磐石艦隊官兵確診案等，桃園市都盡最大努力，做好防疫的工作，也有很多貢獻。<br />&nbsp;<br />鄭市長表示，感謝防疫期間第一線醫護人員的辛勞，不僅要守護市民健康，還要注意自身安全，因為有大家的辛苦貢獻，讓台灣打了一場成功的防疫戰，不僅增加國人對國家的信心及認同，也提高台灣在國際的可見度，並提供全世界最好的防疫經驗。近期疫情雖然稍緩，但國境尚未解封，仍要防止境外移入的個案，必須保持警戒，不能鬆懈，持續努力。<br />&nbsp;<br />怡仁綜合醫院院長李典穎表示，全球疫情相當嚴重，約有700萬人次確診、40萬人死亡，而台灣在政府及國人的努力下，疫情相對緩和，其中第一線醫護人員更是功不可沒。而怡仁醫院身為桃園11家急救責任醫院，防疫期間也全力配合中央及市府，積極參與防疫工作，包括添購紅外線體溫感測儀、建置醫護人員插管使用隔離箱、開發健保卡與旅遊史結合的系統供各醫療院所使用等，為防疫工作超前部署。<br />&nbsp;<br />李院長也說，感謝市府於疫情之初，即整合11家醫院成立聯防醫療網，有效率的整合及調度防疫物資，並積極募款經費及物資，給醫護人員最大的支持，讓醫護人員無後顧之憂，也感謝市長多次至第一線鼓舞防疫同仁，慰勉醫護人員的辛勞。另也感謝許多廠商捐贈物資及食物，幫第一線同仁加油打氣，近期疫情趨緩，但院內醫護人員仍不鬆懈的為疫情奮戰，持續努力為南桃園的市民健康把關。<br />&nbsp;<br />今日包括議員鄭淑方、怡仁綜合醫院院長李典穎、鴻福食品工廠有限公司董事長鄭福來、鋒尚精密有限公司董事長吳榮哲、啟翔輕金屬科技股份有限公司董事長陳百欽、交通大學管理學院院長鐘惠民、市府衛生局副局長蘇柏文、經發局主秘熊勇智、楊梅區長羅國裕、桃園工策會總幹事陳家濬均一同進行慰問。<br />&nbsp;',\n",
       "  'secsubject': '',\n",
       "  'closedate': '',\n",
       "  'liaisonfax': '',\n",
       "  'postdate': '2020-06-11',\n",
       "  'postunit': '新聞處',\n",
       "  'liaisonper': '',\n",
       "  'liaisontel': '',\n",
       "  'topdate': '1900-01-01 00:00:00.0'}]"
      ]
     },
     "metadata": {},
     "execution_count": 16
    }
   ],
   "source": [
    "news_data[:2]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### 進行資料清洗\n",
    "觀察上面的資料，資料包含許多其他的資訊，我們需要將真正的新聞內文取出，並且對內文進行文字清洗。\n",
    "請做以下的文字處理:\n",
    "\n",
    "1. 取出新聞內文\n",
    "2. 去除HTML Tags\n",
    "3. 移除標點符號，只保留英文、數字、中文"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 40,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "output_type": "execute_result",
     "data": {
      "text/plain": [
       "'迎接國旅爆發期五星縣市長合體推廣桃園屏東互惠旅遊桃園市長鄭文燦今11日下午出席桃園加屏東旅遊優惠強棒一棒接一棒好康發表記者會鄭市長表示隨著疫情趨緩國內進入國旅爆發期觀光局近期公布最新10大熱門旅遊景點桃園包辦前三名依序為大溪老街石門水庫及角板山顯示桃園旅遊的潛力無限鄭市長說桃園市與屏東縣各自擁有獨特的觀光魅力與資源希望能搭配中央觀光振興方案共同推廣防疫互惠旅遊並推出更多加碼優惠措施降低民眾的旅遊負擔增加旅遊的樂趣也讓國境之南與國境之門做最好的交流鄭市長提到桃園是國門之都屏東是國境之南兩個城市各有特色及魅力許多景點也互相輝映假如你喜歡屏東的山川琉璃吊橋絕對不能錯過桃園的新溪口吊橋如果你喜歡大溪老街也應該去恆春古城漫遊鄭市長說許多民眾造訪過很多國外景點例如普吉島巴里島卻沒有到過小琉球澎湖等離島十分可惜他也稱讚屏東幅員遼闊擁有多樣化的景點墾丁更是國內旅遊勝地之一希望現階段推動防疫新生活的同時桃園也能與各縣市合作一起推廣防疫互惠旅遊讓更多在地旅遊業者受惠桃園預估下半年包含鄰里長環保志工守望相助隊義警民防等觀摩旅遊團數出團數將達500團以上目前桃園第一階段已經與基隆台南屏東等縣市簽署合作契約第二階段將與宜蘭花蓮南投嘉義等縣市合作希望未來逐漸擴大至其他縣市提供遊客更多優惠措施鄭市長也說屏東縣推出三鐵優惠方案桃園市自7月1日起推出來桃園住一晚加贈免費一日遊方案遊客來桃園在合法旅宿住一晚即可獲得市府加贈免費一日遊行程內容包含遊覽車接送午餐景點門票或體驗等期盼帶領遊客體驗桃園的觀光魅力此外民眾也可以持200元振興三倍券兌換400元夜市券藉此鼓勵民眾到夜市消費市府未來也將陸續推出更多的加碼優惠措施屏東縣長潘孟安則希望在鄭市長推廣下吸引更多桃園市民到屏東旅遊他表示桃園為國境之門擁有很大的發展優勢在鄭市長帶領下桃園連續多年結婚率及出生率都是全國之冠也成為一座宜居城市他也特別推薦親子旅遊首選屏東屏東縣政府整合轄內旅宿業者伴手禮業者食品業者等推出鐵定加碼鐵定貼心鐵定好玩三鐵優惠7月15日以前遊客在恆春地區住宿一晚即加贈場館門票或等值餐飲券在東港地區住宿則可用10元加購伴手禮及小王馬福袋10人以上團體旅遊每人可獲得500元旅費補助每團上限1萬元屏東也有許多當季優質農特產品及特色伴手禮歡迎桃園市民踴躍到屏東旅遊保證遊客玩得痛快買得愉快吃得爽快全國中等學校運動會今109年首度移師屏東舉辦潘縣長也特別邀請鄭市長在7月18日開幕式當天帶領市府團隊一同到屏東為桃園選手加油打氣爭取比賽佳績同時也抽空享受屏東的湖光山色以及感受屏東鄉親的熱情鄭市長與潘縣長在活動現場互贈特色伴手禮鄭市長表示桃園雖然是工業重鎮但在地農特產品類型多元食品工業也十分蓬勃這次市府團隊特別挑選東方美人茶黃金蜜吻仔魚海鮮醬棗到杏福等特色伴手禮送給潘縣長及屏東縣政府團隊鄭市長也說桃園接下來幾乎每個月都會有一場以上的大型觀光活動可說月月都精彩呼籲屏東鄉親也來桃園走走促進桃園與屏東的互相交流潘縣長則特別挑選花襯衫世界金牌巧克力金牌咖啡及全中運吉祥物驕鳥仔玩偶送給鄭市長今日包括市議員王仙蓮呂林小鳳陳美梅簡志偉屏東縣長潘孟安屏東縣政府交通旅遊處處長黃國維傳播暨國際事務處處長黃建嘉研考處處長鄞鳳蘭農業處副處長鄭永裕桃園市政府副秘書長何明光觀旅局長楊勝評經發局長郭裕信研考會主委吳君婷警察局長陳國進人事處長黃新雛環保局長呂理德農業局副局長江富貴桃園市工商發展投資策進會總幹事陳家濬屏東旅遊集團董事長郭子義屏東縣恆春半島觀光產業聯盟理事長林榮欽屏東縣觀光協會副理事長吳炫東大鵬灣觀光產業聯盟總幹事徐鳴懋大鵬灣觀光產業聯盟副總幹事黃啟禎桃園市觀光旅遊發展協會理事長李三連桃園市旅館商業同業公會理事長邱照進桃園市觀光工廠促進發展協會理事長林世閎桃園市民宿發展協會理事長陳秉弘雄獅集團總經理劉冷紅等均一同出席活動'"
      ]
     },
     "metadata": {},
     "execution_count": 40
    }
   ],
   "source": [
    "#取出新聞內文\n",
    "corpus_list = [i['detailcontent'] for i in news_data] ### <your code> ###\n",
    "corpus_list[0]\n",
    "\n",
    "#去除HTML Tags與標點符號(只保留英文、數字、中文)\n",
    "corpus_list = [ re.sub(r'<.*> |[^\\u4E00-\\u9FFF0-9]' , \"\" , corpus_str) for corpus_str in corpus_list ]\n",
    "corpus_list[0]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### 建立N-Gram模型\n",
    "N-Gram模型在計算詞機率時為(以Trigram為例)\n",
    "$$\n",
    "P(W_i|W_{i-1},W_{i-2}) = \\frac{count(W_i,W_{i-1},W_{i-2})}{count(W_{i-1},W_{i-2})}\n",
    "$$\n",
    "\n",
    "舉例來說\n",
    "$$\n",
    "P(the|this,is) = \\frac{count(this\\ is\\ the)}{count(this\\ is)}\n",
    "$$"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 43,
   "metadata": {},
   "outputs": [],
   "source": [
    "def ngram(documents, N=2):\n",
    "    \n",
    "    #建立儲存預測字, 所有ngram詞頻字典, 所有字詞(分母)\n",
    "    ngram_prediction = dict()\n",
    "    total_grams = list()\n",
    "    words = list()\n",
    "    Word = namedtuple('Word', ['word', 'prob']) #使用namedtuple來儲存預測字詞與對應機率\n",
    "\n",
    "    for doc in documents:\n",
    "        # 在每個文章前加上起始(<start>)與結束符號(<end>)\n",
    "        ### <your code> ###\n",
    "        # 已經是list of characters\n",
    "        doc = ['<start>'] + list(doc) + ['<end>']\n",
    "        # 計算分子\n",
    "        ### <your code> ###\n",
    "        [total_grams.append(tuple(doc[i:i+N])) for i in range(len(doc)-N+1)]\n",
    "        # 計算分母\n",
    "        ### <your code> ###\n",
    "        [words.append(tuple(doc[i:i+N-1])) for i in range(len(doc)-N+2)]\n",
    "    \n",
    "    #計算分子詞頻\n",
    "    total_word_counter = Counter(total_grams) ### <your code> ###\n",
    "    #計算分母詞頻\n",
    "    word_counter = Counter(words) ### <your code> ###\n",
    "    \n",
    "    #計算所有N-gram預測字詞的機率\n",
    "    for key in total_word_counter:\n",
    "        ### <your code> ###\n",
    "      word = ''.join(key[:N-1])\n",
    "      if word not in ngram_prediction:\n",
    "        ngram_prediction.update({word:set()})\n",
    "      \n",
    "      next_word_prob = total_word_counter[key]/word_counter[key[:N-1]]\n",
    "      w = Word(key[-1], f'{next_word_prob}')\n",
    "      # ngram_prediction[word]=w\n",
    "      # add方法是set的一個操作\n",
    "      ngram_prediction[word].add(w)  \n",
    "    return ngram_prediction"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### 使用N-Gram模型進行預測\n",
    "這裡我們使用4 gram模型，也就是輸入三個字之後，第四個字出現的機率，並將輸出依據機率做排序"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 45,
   "metadata": {},
   "outputs": [],
   "source": [
    "#建立four_gram模型，並將預測的機率按照大小排列\n",
    "four_gram_pred = ngram(corpus_list , N=4) ### <your code> ###\n",
    "for word, pred in four_gram_pred.items():\n",
    "    ### <your code> ###\n",
    "  four_gram_pred[word] = sorted(pred , key = lambda x:x.prob , reverse = True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 46,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "output_type": "execute_result",
     "data": {
      "text/plain": [
       "\n",
       "  Word(word='設', prob='0.002053388090349076'),\n",
       "  Word(word='平', prob='0.002053388090349076'),\n",
       "  Word(word='取', prob='0.002053388090349076'),\n",
       "  Word(word='端', prob='0.002053388090349076'),\n",
       "  Word(word='適', prob='0.002053388090349076'),\n",
       "  Word(word='停', prob='0.002053388090349076'),\n",
       "  Word(word='使', prob='0.002053388090349076'),\n",
       "  Word(word='龍', prob='0.002053388090349076'),\n",
       "  Word(word='招', prob='0.002053388090349076'),\n",
       "  Word(word='在', prob='0.002053388090349076'),\n",
       "  Word(word='敬', prob='0.002053388090349076'),\n",
       "  Word(word='花', prob='0.002053388090349076'),\n",
       "  Word(word='0', prob='0.002053388090349076'),\n",
       "  Word(word='至', prob='0.002053388090349076'),\n",
       "  Word(word='因', prob='0.002053388090349076'),\n",
       "  Word(word='請', prob='0.002053388090349076'),\n",
       "  Word(word='已', prob='0.002053388090349076'),\n",
       "  Word(word='於', prob='0.002053388090349076'),\n",
       "  Word(word='面', prob='0.002053388090349076'),\n",
       "  Word(word='盛', prob='0.002053388090349076'),\n",
       "  Word(word='長', prob='0.002053388090349076'),\n",
       "  Word(word='核', prob='0.002053388090349076'),\n",
       "  Word(word='住', prob='0.002053388090349076'),\n",
       "  Word(word='成', prob='0.002053388090349076'),\n",
       "  Word(word='順', prob='0.002053388090349076'),\n",
       "  Word(word='楊', prob='0.002053388090349076'),\n",
       "  Word(word='陸', prob='0.002053388090349076'),\n",
       "  Word(word='包', prob='0.002053388090349076'),\n",
       "  Word(word='建', prob='0.002053388090349076'),\n",
       "  Word(word='土', prob='0.002053388090349076'),\n",
       "  Word(word='以', prob='0.002053388090349076'),\n",
       "  Word(word='實', prob='0.002053388090349076'),\n",
       "  Word(word='清', prob='0.002053388090349076'),\n",
       "  Word(word='亦', prob='0.002053388090349076'),\n",
       "  Word(word='爭', prob='0.002053388090349076'),\n",
       "  Word(word='祭', prob='0.002053388090349076')],\n",
       " '9年首': [Word(word='度', prob='1.0')],\n",
       " '年首度': [Word(word='移', prob='0.4'),\n",
       "  Word(word='從', prob='0.2'),\n",
       "  Word(word='不', prob='0.2'),\n",
       "  Word(word='獲', prob='0.2')],\n",
       " '首度移': [Word(word='師', prob='1.0')],\n",
       " '度移師': [Word(word='老', prob='0.4'),\n",
       "  Word(word='屏', prob='0.2'),\n",
       "  Word(word='崙', prob='0.2'),\n",
       "  Word(word='桃', prob='0.2')],\n",
       " '移師屏': [Word(word='東', prob='1.0')],\n",
       " '師屏東': [Word(word='舉', prob='1.0')],\n",
       " '屏東舉': [Word(word='辦', prob='1.0')],\n",
       " '東舉辦': [Word(word='潘', prob='1.0')],\n",
       " '舉辦潘': [Word(word='縣', prob='1.0')],\n",
       " '辦潘縣': [Word(word='長', prob='1.0')],\n",
       " '潘縣長': [Word(word='及', prob='0.25'),\n",
       "  Word(word='在', prob='0.25'),\n",
       "  Word(word='則', prob='0.25'),\n",
       "  Word(word='也', prob='0.25')],\n",
       " '縣長也': [Word(word='特', prob='1.0')],\n",
       " '長也特': [Word(word='別', prob='1.0')],\n",
       " '特別邀': [Word(word='請', prob='0.9333333333333333'),\n",
       "  Word(word='集', prob='0.06666666666666667')],\n",
       " '別邀請': [Word(word='樂', prob='0.14285714285714285'),\n",
       "  Word(word='流', prob='0.07142857142857142'),\n",
       "  Word(word='金', prob='0.07142857142857142'),\n",
       "  Word(word='院', prob='0.07142857142857142'),\n",
       "  Word(word='觀', prob='0.07142857142857142'),\n",
       "  Word(word='鄭', prob='0.07142857142857142'),\n",
       "  Word(word='知', prob='0.07142857142857142'),\n",
       "  Word(word='謝', prob='0.07142857142857142'),\n",
       "  Word(word='曙', prob='0.07142857142857142'),\n",
       "  Word(word='國', prob='0.07142857142857142'),\n",
       "  Word(word='科', prob='0.07142857142857142'),\n",
       "  Word(word='中', prob='0.07142857142857142'),\n",
       "  Word(word='集', prob='0.07142857142857142')],\n",
       " '邀請鄭': [Word(word='董', prob='0.5'), Word(word='市', prob='0.5')],\n",
       " '請鄭市': [Word(word='長', prob='1.0')],\n",
       " '市長在': [Word(word='三', prob='0.08'),\n",
       "  Word(word='大', prob='0.04'),\n",
       "  Word(word='聽', prob='0.04'),\n",
       "  Word(word='中', prob='0.04'),\n",
       "  Word(word='視', prob='0.04'),\n",
       "  Word(word='會', prob='0.04'),\n",
       "  Word(word='仁', prob='0.04'),\n",
       "  Word(word='今', prob='0.02'),\n",
       "  Word(word='吉', prob='0.02'),\n",
       "  Word(word='觀', prob='0.02'),\n",
       "  Word(word='啟', prob='0.02'),\n",
       "  Word(word='復', prob='0.02'),\n",
       "  Word(word='德', prob='0.02'),\n",
       "  Word(word='番', prob='0.02'),\n",
       "  Word(word='楊', prob='0.02'),\n",
       "  Word(word='第', prob='0.02'),\n",
       "  Word(word='訪', prob='0.02'),\n",
       "  Word(word='現', prob='0.02'),\n",
       "  Word(word='規', prob='0.02'),\n",
       "  Word(word='保', prob='0.02'),\n",
       "  Word(word='任', prob='0.02'),\n",
       "  Word(word='埔', prob='0.02'),\n",
       "  Word(word='這', prob='0.02'),\n",
       "  Word(word='興', prob='0.02'),\n",
       "  Word(word='消', prob='0.02'),\n",
       "  Word(word='慰', prob='0.02'),\n",
       "  Word(word='壽', prob='0.02'),\n",
       "  Word(word='明', prob='0.02'),\n",
       "  Word(word='竹', prob='0.02'),\n",
       "  Word(word='廣', prob='0.02'),\n",
       "  Word(word='甘', prob='0.02'),\n",
       "  Word(word='祭', prob='0.02'),\n",
       "  Word(word='7', prob='0.02'),\n",
       "  Word(word='富', prob='0.02'),\n",
       "  Word(word='各', prob='0.02'),\n",
       "  Word(word='月', prob='0.02'),\n",
       "  Word(word='主', prob='0.02'),\n",
       "  Word(word='溥', prob='0.02'),\n",
       "  Word(word='青', prob='0.02'),\n",
       "  Word(word='龍', prob='0.02'),\n",
       "  Word(word='羅', prob='0.02')],\n",
       " '長在7': [Word(word='月', prob='1.0')],\n",
       " '在7月': [Word(word='1', prob='0.6666666666666666'),\n",
       "  Word(word='也', prob='0.3333333333333333')],\n",
       " '月18': [Word(word='日', prob='1.0')],\n",
       " '18日': [Word(word='上', prob='0.3333333333333333'),\n",
       "  Word(word='下', prob='0.24561403508771928'),\n",
       "  Word(word='市', prob='0.05263157894736842'),\n",
       "  Word(word='率', prob='0.05263157894736842'),\n",
       "  Word(word='開', prob='0.03508771929824561'),\n",
       "  Word(word='為', prob='0.017543859649122806'),\n",
       "  Word(word='舉', prob='0.017543859649122806'),\n",
       "  Word(word='推', prob='0.017543859649122806'),\n",
       "  Word(word='全', prob='0.017543859649122806'),\n",
       "  Word(word='函', prob='0.017543859649122806'),\n",
       "  Word(word='至', prob='0.017543859649122806'),\n",
       "  Word(word='止', prob='0.017543859649122806'),\n",
       "  Word(word='於', prob='0.017543859649122806'),\n",
       "  Word(word='已', prob='0.017543859649122806'),\n",
       "  Word(word='期', prob='0.017543859649122806'),\n",
       "  Word(word='零', prob='0.017543859649122806'),\n",
       "  Word(word='及', prob='0.017543859649122806'),\n",
       "  Word(word='蔡', prob='0.017543859649122806'),\n",
       "  Word(word='晚', prob='0.017543859649122806'),\n",
       "  Word(word='完', prob='0.017543859649122806'),\n",
       "  Word(word='7', prob='0.017543859649122806')],\n",
       " '8日開': [Word(word='賽', prob='0.25'),\n",
       "  Word(word='幕', prob='0.25'),\n",
       "  Word(word='打', prob='0.125'),\n",
       "  Word(word='始', prob='0.125'),\n",
       "  Word(word='展', prob='0.125'),\n",
       "  Word(word='工', prob='0.125')],\n",
       " '日開幕': [Word(word='試', prob='0.3333333333333333'),\n",
       "  Word(word='的', prob='0.3333333333333333'),\n",
       "  Word(word='招', prob='0.16666666666666666'),\n",
       "  Word(word='式', prob='0.16666666666666666')],\n",
       " '開幕式': [Word(word='鄭', prob='0.3333333333333333'),\n",
       "  Word(word='當', prob='0.3333333333333333'),\n",
       "  Word(word='暨', prob='0.3333333333333333')],\n",
       " '幕式當': [Word(word='天', prob='1.0')],\n",
       " '式當天': [Word(word='帶', prob='1.0')],\n",
       " '當天帶': [Word(word='領', prob='1.0')],\n",
       " '天帶領': [Word(word='市', prob='1.0')],\n",
       " '帶領市': [Word(word='民', prob='0.7142857142857143'),\n",
       "  Word(word='府', prob='0.2857142857142857')],\n",
       " '領市府': [Word(word='團', prob='0.6666666666666666'),\n",
       "  Word(word='相', prob='0.3333333333333333')],\n",
       " '市府團': [Word(word='隊', prob='1.0')],\n",
       " '府團隊': [Word(word='至', prob='0.5254237288135594'),\n",
       "  Word(word='出', prob='0.0576271186440678'),\n",
       "  Word(word='將', prob='0.04406779661016949'),\n",
       "  Word(word='的', prob='0.03728813559322034'),\n",
       "  Word(word='積', prob='0.02711864406779661'),\n",
       "  Word(word='在', prob='0.020338983050847456'),\n",
       "  Word(word='與', prob='0.01694915254237288'),\n",
       "  Word(word='努', prob='0.01694915254237288'),\n",
       "  Word(word='持', prob='0.013559322033898305'),\n",
       "  Word(word='及', prob='0.013559322033898305'),\n",
       "  Word(word='合', prob='0.010169491525423728'),\n",
       "  Word(word='都', prob='0.010169491525423728'),\n",
       "  Word(word='也', prob='0.010169491525423728'),\n",
       "  Word(word='一', prob='0.006779661016949152'),\n",
       "  Word(word='致', prob='0.006779661016949152'),\n",
       "  Word(word='桃', prob='0.006779661016949152'),\n",
       "  Word(word='今', prob='0.006779661016949152'),\n",
       "  Word(word='推', prob='0.006779661016949152'),\n",
       "  Word(word='會', prob='0.006779661016949152'),\n",
       "  Word(word='預', prob='0.006779661016949152'),\n",
       "  Word(word='全', prob='0.006779661016949152'),\n",
       "  Word(word='等', prob='0.003389830508474576'),\n",
       "  Word(word='分', prob='0.003389830508474576'),\n",
       "  Word(word='觀', prob='0.003389830508474576'),\n",
       "  Word(word='復', prob='0.003389830508474576'),\n",
       "  Word(word='不', prob='0.003389830508474576'),\n",
       "  Word(word='後', prob='0.003389830508474576'),\n",
       "  Word(word='應', prob='0.003389830508474576'),\n",
       "  Word(word='攜', prob='0.003389830508474576'),\n",
       "  Word(word='辛', prob='0.003389830508474576'),\n",
       "  Word(word='除', prob='0.003389830508474576'),\n",
       "  Word(word='繼', prob='0.003389830508474576'),\n",
       "  Word(word='給', prob='0.003389830508474576'),\n",
       "  Word(word='支', prob='0.003389830508474576'),\n",
       "  Word(word='親', prob='0.003389830508474576'),\n",
       "  Word(word='作', prob='0.003389830508474576'),\n",
       "  Word(word='鄭', prob='0.003389830508474576'),\n",
       "  Word(word='迅', prob='0.003389830508474576'),\n",
       "  Word(word='過', prob='0.003389830508474576'),\n",
       "  Word(word='所', prob='0.003389830508474576'),\n",
       "  Word(word='再', prob='0.003389830508474576'),\n",
       "  Word(word='杜', prob='0.003389830508474576'),\n",
       "  Word(word='已', prob='0.003389830508474576'),\n",
       "  Word(word='於', prob='0.003389830508474576'),\n",
       "  Word(word='輪', prob='0.003389830508474576'),\n",
       "  Word(word='因', prob='0.003389830508474576'),\n",
       "  Word(word='協', prob='0.003389830508474576'),\n",
       "  Word(word='用', prob='0.003389830508474576'),\n",
       "  Word(word='著', prob='0.003389830508474576'),\n",
       "  Word(word='運', prob='0.003389830508474576'),\n",
       "  Word(word='貼', prob='0.003389830508474576'),\n",
       "  Word(word='進', prob='0.003389830508474576'),\n",
       "  Word(word='無', prob='0.003389830508474576'),\n",
       "  Word(word='就', prob='0.003389830508474576'),\n",
       "  Word(word='夥', prob='0.003389830508474576'),\n",
       "  Word(word='特', prob='0.003389830508474576'),\n",
       "  Word(word='均', prob='0.003389830508474576'),\n",
       "  Word(word='採', prob='0.003389830508474576'),\n",
       "  Word(word='以', prob='0.003389830508474576'),\n",
       "  Word(word='亦', prob='0.003389830508474576'),\n",
       "  Word(word='擔', prob='0.003389830508474576'),\n",
       "  Word(word='恢', prob='0.003389830508474576'),\n",
       "  Word(word='和', prob='0.003389830508474576')],\n",
       " '團隊一': [Word(word='同', prob='1.0')],\n",
       " '隊一同': [Word(word='恭', prob='0.5'), Word(word='到', prob='0.5')],\n",
       " '一同到': [Word(word='場', prob='0.6666666666666666'),\n",
       "  Word(word='屏', prob='0.3333333333333333')],\n",
       " '同到屏': [Word(word='東', prob='1.0')],\n",
       " '屏東為': [Word(word='桃', prob='1.0')],\n",
       " '東為桃': [Word(word='園', prob='1.0')],\n",
       " '為桃園': [Word(word='市', prob='0.17721518987341772'),\n",
       "  Word(word='的', prob='0.06962025316455696'),\n",
       "  Word(word='帶', prob='0.0379746835443038'),\n",
       "  Word(word='爭', prob='0.03164556962025317'),\n",
       "  Word(word='國', prob='0.03164556962025317'),\n",
       "  Word(word='航', prob='0.02531645569620253'),\n",
       "  Word(word='最', prob='0.02531645569620253'),\n",
       "  Word(word='之', prob='0.02531645569620253'),\n",
       "  Word(word='第', prob='0.02531645569620253'),\n",
       "  Word(word='都', prob='0.02531645569620253'),\n",
       "  Word(word='在', prob='0.02531645569620253'),\n",
       "  Word(word='加', prob='0.02531645569620253'),\n",
       "  Word(word='重', prob='0.0189873417721519'),\n",
       "  Word(word='發', prob='0.0189873417721519'),\n",
       "  Word(word='輕', prob='0.0189873417721519'),\n",
       "  Word(word='燈', prob='0.012658227848101266'),\n",
       "  Word(word='工', prob='0.012658227848101266'),\n",
       "  Word(word='注', prob='0.012658227848101266'),\n",
       "  Word(word='醫', prob='0.012658227848101266'),\n",
       "  Word(word='往', prob='0.012658227848101266'),\n",
       "  Word(word='清', prob='0.012658227848101266'),\n",
       "  Word(word='產', prob='0.012658227848101266'),\n",
       "  Word(word='民', prob='0.012658227848101266'),\n",
       "  Word(word='教', prob='0.012658227848101266'),\n",
       "  Word(word='農', prob='0.012658227848101266'),\n",
       "  Word(word='推', prob='0.012658227848101266'),\n",
       "  Word(word='廠', prob='0.006329113924050633'),\n",
       "  Word(word='青', prob='0.006329113924050633'),\n",
       "  Word(word='未', prob='0.006329113924050633'),\n",
       "  Word(word='1', prob='0.006329113924050633'),\n",
       "  Word(word='馬', prob='0.006329113924050633'),\n",
       "  Word(word='採', prob='0.006329113924050633'),\n",
       "  Word(word='著', prob='0.006329113924050633'),\n",
       "  Word(word='地', prob='0.006329113924050633'),\n",
       "  Word(word='另', prob='0.006329113924050633'),\n",
       "  Word(word='迅', prob='0.006329113924050633'),\n",
       "  Word(word='交', prob='0.006329113924050633'),\n",
       "  Word(word='文', prob='0.006329113924050633'),\n",
       "  Word(word='亮', prob='0.006329113924050633'),\n",
       "  Word(word='為', prob='0.006329113924050633'),\n",
       "  Word(word='特', prob='0.006329113924050633'),\n",
       "  Word(word='中', prob='0.006329113924050633'),\n",
       "  Word(word='進', prob='0.006329113924050633'),\n",
       "  Word(word='樹', prob='0.006329113924050633'),\n",
       "  Word(word='鐵', prob='0.006329113924050633'),\n",
       "  Word(word='南', prob='0.006329113924050633'),\n",
       "  Word(word='企', prob='0.006329113924050633'),\n",
       "  Word(word='區', prob='0.006329113924050633'),\n",
       "  Word(word='行', prob='0.006329113924050633'),\n",
       "  Word(word='水', prob='0.006329113924050633'),\n",
       "  Word(word='以', prob='0.006329113924050633'),\n",
       "  Word(word='百', prob='0.006329113924050633'),\n",
       "  Word(word='有', prob='0.006329113924050633'),\n",
       "  Word(word='人', prob='0.006329113924050633'),\n",
       "  Word(word='客', prob='0.006329113924050633'),\n",
       "  Word(word='更', prob='0.006329113924050633'),\n",
       "  Word(word='學', prob='0.006329113924050633'),\n",
       "  Word(word='科', prob='0.006329113924050633'),\n",
       "  Word(word='留', prob='0.006329113924050633'),\n",
       "  Word(word='量', prob='0.006329113924050633'),\n",
       "  Word(word='幸', prob='0.006329113924050633'),\n",
       "  Word(word='選', prob='0.006329113924050633'),\n",
       "  Word(word='謀', prob='0.006329113924050633'),\n",
       "  Word(word='音', prob='0.006329113924050633'),\n",
       "  Word(word='舊', prob='0.006329113924050633'),\n",
       "  Word(word='舞', prob='0.006329113924050633'),\n",
       "  Word(word='休', prob='0.006329113924050633'),\n",
       "  Word(word='鄉', prob='0.006329113924050633'),\n",
       "  Word(word='警', prob='0.006329113924050633'),\n",
       "  Word(word='增', prob='0.006329113924050633')],\n",
       " '桃園選': [Word(word='手', prob='1.0')],\n",
       " '園選手': [Word(word='加', prob='0.3333333333333333'),\n",
       "  Word(word='能', prob='0.3333333333333333'),\n",
       "  Word(word='表', prob='0.3333333333333333')],\n",
       " '選手加': [Word(word='油', prob='1.0')],\n",
       " '手加油': [Word(word='今', prob='0.5'), Word(word='打', prob='0.5')],\n",
       " '加油打': [Word(word='氣', prob='1.0')],\n",
       " '油打氣': [Word(word='鄭', prob='0.3157894736842105'),\n",
       "  Word(word='桃', prob='0.18421052631578946'),\n",
       "  Word(word='今', prob='0.10526315789473684'),\n",
       "  Word(word='也', prob='0.07894736842105263'),\n",
       "  Word(word='並', prob='0.05263157894736842'),\n",
       "  Word(word='感', prob='0.05263157894736842'),\n",
       "  Word(word='爭', prob='0.02631578947368421'),\n",
       "  Word(word='另', prob='0.02631578947368421'),\n",
       "  Word(word='尤', prob='0.02631578947368421'),\n",
       "  Word(word='近', prob='0.02631578947368421'),\n",
       "  Word(word='他', prob='0.02631578947368421'),\n",
       "  Word(word='讓', prob='0.02631578947368421'),\n",
       "  Word(word='除', prob='0.02631578947368421'),\n",
       "  Word(word='希', prob='0.02631578947368421')],\n",
       " '打氣爭': [Word(word='取', prob='1.0')],\n",
       " '氣爭取': [Word(word='比', prob='1.0')],\n",
       " '爭取比': [Word(word='照', prob='0.5'), Word(word='賽', prob='0.5')],\n",
       " '取比賽': [Word(word='佳', prob='1.0')],\n",
       " '比賽佳': [Word(word='績', prob='1.0')],\n",
       " '賽佳績': [Word(word='同', prob='0.5'), Word(word='盼', prob='0.5')],\n",
       " '佳績同': [Word(word='時', prob='1.0')],\n",
       " '績同時': [Word(word='也', prob='1.0')],\n",
       " '同時也': [Word(word='感', prob='0.06578947368421052'),\n",
       "  Word(word='要', prob='0.06578947368421052'),\n",
       "  Word(word='能', prob='0.06578947368421052'),\n",
       "  Word(word='讓', prob='0.05263157894736842'),\n",
       "  Word(word='是', prob='0.05263157894736842'),\n",
       "  Word(word='積', prob='0.039473684210526314'),\n",
       "  Word(word='希', prob='0.039473684210526314'),\n",
       "  Word(word='舉', prob='0.039473684210526314'),\n",
       "  Word(word='與', prob='0.02631578947368421'),\n",
       "  Word(word='非', prob='0.02631578947368421'),\n",
       "  Word(word='可', prob='0.02631578947368421'),\n",
       "  Word(word='提', prob='0.02631578947368421'),\n",
       "  Word(word='呼', prob='0.02631578947368421'),\n",
       "  Word(word='會', prob='0.02631578947368421'),\n",
       "  Word(word='為', prob='0.02631578947368421'),\n",
       "  Word(word='請', prob='0.02631578947368421'),\n",
       "  Word(word='營', prob='0.02631578947368421'),\n",
       "  Word(word='規', prob='0.02631578947368421'),\n",
       "  Word(word='在', prob='0.013157894736842105'),\n",
       "  Word(word='進', prob='0.013157894736842105'),\n",
       "  Word(word='特', prob='0.013157894736842105'),\n",
       "  Word(word='抽', prob='0.013157894736842105'),\n",
       "  Word(word='清', prob='0.013157894736842105'),\n",
       "  Word(word='禁', prob='0.013157894736842105'),\n",
       "  Word(word='務', prob='0.013157894736842105'),\n",
       "  Word(word='被', prob='0.013157894736842105'),\n",
       "  Word(word='預', prob='0.013157894736842105'),\n",
       "  Word(word='須', prob='0.013157894736842105'),\n",
       "  Word(word='建', prob='0.013157894736842105'),\n",
       "  Word(word='鼓', prob='0.013157894736842105'),\n",
       "  Word(word='期', prob='0.013157894736842105'),\n",
       "  Word(word='帶', prob='0.013157894736842105'),\n",
       "  Word(word='享', prob='0.013157894736842105'),\n",
       "  Word(word='結', prob='0.013157894736842105'),\n",
       "  Word(word='邀', prob='0.013157894736842105'),\n",
       "  Word(word='強', prob='0.013157894736842105'),\n",
       "  Word(word='促', prob='0.013157894736842105'),\n",
       "  Word(word='將', prob='0.013157894736842105'),\n",
       "  Word(word='發', prob='0.013157894736842105'),\n",
       "  Word(word='不', prob='0.013157894736842105'),\n",
       "  Word(word='確', prob='0.013157894736842105'),\n",
       "  Word(word='需', prob='0.013157894736842105')],\n",
       " '時也抽': [Word(word='空', prob='1.0')],\n",
       " '也抽空': [Word(word='享', prob='1.0')],\n",
       " '抽空享': [Word(word='受', prob='1.0')],\n",
       " '空享受': [Word(word='屏', prob='1.0')],\n",
       " '享受屏': [Word(word='東', prob='1.0')],\n",
       " '受屏東': [Word(word='的', prob='0.5'), Word(word='鄉', prob='0.5')],\n",
       " '東的湖': [Word(word='光', prob='1.0')],\n",
       " '的湖光': [Word(word='山', prob='1.0')],\n",
       " '湖光山': [Word(word='色', prob='1.0')],\n",
       " '光山色': [Word(word='大', prob='0.25'),\n",
       "  Word(word='以', prob='0.25'),\n",
       "  Word(word='無', prob='0.25'),\n",
       "  Word(word='並', prob='0.25')],\n",
       " '山色以': [Word(word='及', prob='1.0')],\n",
       " '色以及': [Word(word='養', prob='0.3333333333333333'),\n",
       "  Word(word='代', prob='0.3333333333333333'),\n",
       "  Word(word='感', prob='0.3333333333333333')],\n",
       " '以及感': [Word(word='受', prob='1.0')],\n",
       " '及感受': [Word(word='佳', prob='0.5'), Word(word='屏', prob='0.5')],\n",
       " '感受屏': [Word(word='東', prob='1.0')],\n",
       " '屏東鄉': [Word(word='親', prob='1.0')],\n",
       " '東鄉親': [Word(word='也', prob='0.5'), Word(word='的', prob='0.5')],\n",
       " '鄉親的': [Word(word='熱', prob='0.3333333333333333'),\n",
       "  Word(word='配', prob='0.1111111111111111'),\n",
       "  Word(word='健', prob='0.1111111111111111'),\n",
       "  Word(word='支', prob='0.1111111111111111'),\n",
       "  Word(word='期', prob='0.1111111111111111'),\n",
       "  Word(word='口', prob='0.1111111111111111'),\n",
       "  Word(word='團', prob='0.1111111111111111')],\n",
       " '親的熱': [Word(word='情', prob='1.0')],\n",
       " '的熱情': [Word(word='及', prob='0.16666666666666666'),\n",
       "  Word(word='鄭', prob='0.16666666666666666'),\n",
       "  Word(word='期', prob='0.08333333333333333'),\n",
       "  Word(word='體', prob='0.08333333333333333'),\n",
       "  Word(word='秉', prob='0.08333333333333333'),\n",
       "  Word(word='尤', prob='0.08333333333333333'),\n",
       "  Word(word='與', prob='0.08333333333333333'),\n",
       "  Word(word='活', prob='0.08333333333333333'),\n",
       "  Word(word='以', prob='0.08333333333333333'),\n",
       "  Word(word='並', prob='0.08333333333333333')],\n",
       " '熱情鄭': [Word(word='市', prob='1.0')],\n",
       " '情鄭市': [Word(word='長', prob='1.0')],\n",
       " '市長與': [Word(word='潘', prob='0.14285714285714285'),\n",
       "  Word(word='秘', prob='0.14285714285714285'),\n",
       "  Word(word='議', prob='0.14285714285714285'),\n",
       "  Word(word='高', prob='0.14285714285714285'),\n",
       "  Word(word='校', prob='0.14285714285714285'),\n",
       "  Word(word='格', prob='0.14285714285714285'),\n",
       "  Word(word='復', prob='0.14285714285714285')],\n",
       " '長與潘': [Word(word='縣', prob='1.0')],\n",
       " '與潘縣': [Word(word='長', prob='1.0')],\n",
       " '縣長在': [Word(word='活', prob='1.0')],\n",
       " '長在活': [Word(word='動', prob='1.0')],\n",
       " '在活動': [Word(word='中', prob='0.42857142857142855'),\n",
       "  Word(word='現', prob='0.2857142857142857'),\n",
       "  Word(word='期', prob='0.14285714285714285'),\n",
       "  Word(word='網', prob='0.14285714285714285')],\n",
       " '活動現': [Word(word='場', prob='1.0')],\n",
       " '動現場': [Word(word='除', prob='0.10526315789473684'),\n",
       "  Word(word='有', prob='0.10526315789473684'),\n",
       "  Word(word='將', prob='0.10526315789473684'),\n",
       "  Word(word='也', prob='0.10526315789473684'),\n",
       "  Word(word='鄭', prob='0.05263157894736842'),\n",
       "  Word(word='購', prob='0.05263157894736842'),\n",
       "  Word(word='亦', prob='0.05263157894736842'),\n",
       "  Word(word='扮', prob='0.05263157894736842'),\n",
       "  Word(word='互', prob='0.05263157894736842'),\n",
       "  Word(word='為', prob='0.05263157894736842'),\n",
       "  Word(word='服', prob='0.05263157894736842'),\n",
       "  Word(word='包', prob='0.05263157894736842'),\n",
       "  Word(word='宣', prob='0.05263157894736842'),\n",
       "  Word(word='同', prob='0.05263157894736842'),\n",
       "  Word(word='搭', prob='0.05263157894736842')],\n",
       " '現場互': [Word(word='贈', prob='1.0')],\n",
       " '場互贈': [Word(word='特', prob='1.0')],\n",
       " '互贈特': [Word(word='色', prob='1.0')],\n",
       " '贈特色': [Word(word='伴', prob='1.0')],\n",
       " '手禮鄭': [Word(word='市', prob='1.0')],\n",
       " '禮鄭市': [Word(word='長', prob='1.0')],\n",
       " '桃園雖': [Word(word='然', prob='1.0')],\n",
       " ...}"
      ]
     },
     "metadata": {},
     "execution_count": 46
    }
   ],
   "source": [
    "# 執行時因為字典數龐大，顯示會較慢\n",
    "four_gram_pred"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 47,
   "metadata": {},
   "outputs": [
    {
     "output_type": "stream",
     "name": "stdout",
     "text": [
      "next word: 今, probability: 0.9795698924731183\nnext word: 市, probability: 0.00967741935483871\nnext word: 表, probability: 0.002150537634408602\nnext word: 模, probability: 0.002150537634408602\nnext word: 於, probability: 0.001075268817204301\nnext word: 率, probability: 0.001075268817204301\nnext word: 台, probability: 0.001075268817204301\nnext word: 成, probability: 0.001075268817204301\nnext word: 回, probability: 0.001075268817204301\nnext word: 昨, probability: 0.001075268817204301\n"
     ]
    }
   ],
   "source": [
    "#給定字詞，使用ngram預測下一個字的機率(顯示top 10)\n",
    "text = '鄭文燦'\n",
    "next_words = four_gram_pred[text][:10] ### <your code> ###\n",
    "for next_word in next_words:\n",
    "    print('next word: {}, probability: {}'.format(next_word.word, next_word.prob))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "可自行嘗試使用不同的N搭建不同的N-Gram模型的效果"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "name": "python3",
   "display_name": "Python 3.7.6 64-bit (conda)",
   "metadata": {
    "interpreter": {
     "hash": "7b4b4feff2f24a0f0a34464dbe537a36fda679851528fb8735cb41fa49dffb2d"
    }
   }
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.6-final"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}