{"id":278,"date":"2017-05-25T23:47:35","date_gmt":"2017-05-25T15:47:35","guid":{"rendered":"https:\/\/dream-wonderland.com\/blog\/?page_id=278"},"modified":"2017-09-17T14:00:37","modified_gmt":"2017-09-17T06:00:37","slug":"twitter-aikatsu-image-scrape","status":"publish","type":"page","link":"https:\/\/dream-wonderland.com\/blog\/twitter-aikatsu-image-scrape\/","title":{"rendered":"Twitter Aikatsu Image Scrape"},"content":{"rendered":"

This is my test using python and twitter API to scrape the latest and random aikatsu Images from Twitter.<\/p>\n

It is updated from the server every ten minutes.<\/p>\n

Logic:<\/p>\n

    \n
  1. Twitter search API with “Aikatsu” as keyword and 100 post count.<\/li>\n
  2. Step 1 is repeated X number of times to get even more images. Actual count of tweets obtained is showed in the metadata below.<\/li>\n
  3. Then the posts is filtered to only those that contain image media. All duplicate images are being filtered.<\/li>\n
  4. All images are linked to the original tweet.<\/li>\n<\/ol>\n

    Issue:<\/p>\n

      \n
    1. Of course there are images that are not Aikatsu related.<\/li>\n
    2. Number of images in a single page is HIGH<\/strong>, so if you are using MOBILE DATA<\/strong> or having a DATA CAP<\/strong>, DO NOT SCROLL DOWN<\/strong>.<\/li>\n<\/ol>\n

       <\/p>\n

      Generated at 2023-04-08 01:40:14.418504\nTotal number of tweet processed = 949\nTotal number of images processed = 506\nTotal number of unique images = 299\n<\/pre>\n<\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n      <\/a>
      \n
       <\/p>\n","protected":false},"excerpt":{"rendered":"
      This is my test using python and twitter API to scrape the latest and random aikatsu Images from Twitter. It is updated from the server every ten minutes. Logic: Twitter search API with “Aikatsu” as keyword and 100 post count. Step 1 is repeated X number of times to get even more images. Actual count […]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_mi_skip_tracking":false,"ngg_post_thumbnail":0,"jetpack_post_was_ever_published":false},"yoast_head":"\nTwitter Aikatsu Image Scrape - Yume's Wonderland<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/dream-wonderland.com\/blog\/twitter-aikatsu-image-scrape\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Twitter Aikatsu Image Scrape - Yume's Wonderland\" \/>\n<meta property=\"og:description\" content=\"This is my test using python and twitter API to scrape the latest and random aikatsu Images from Twitter. It is updated from the server every ten minutes. Logic: Twitter search API with “Aikatsu” as keyword and 100 post count. Step 1 is repeated X number of times to get even more images. Actual count […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/dream-wonderland.com\/blog\/twitter-aikatsu-image-scrape\/\" \/>\n<meta property=\"og:site_name\" content=\"Yume's Wonderland\" \/>\n<meta property=\"article:modified_time\" content=\"2017-09-17T06:00:37+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/dream-wonderland.com\/blog\/twitter-aikatsu-image-scrape\/\",\"url\":\"https:\/\/dream-wonderland.com\/blog\/twitter-aikatsu-image-scrape\/\",\"name\":\"Twitter Aikatsu Image Scrape - Yume's Wonderland\",\"isPartOf\":{\"@id\":\"https:\/\/dream-wonderland.com\/blog\/#website\"},\"datePublished\":\"2017-05-25T15:47:35+00:00\",\"dateModified\":\"2017-09-17T06:00:37+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/dream-wonderland.com\/blog\/twitter-aikatsu-image-scrape\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/dream-wonderland.com\/blog\/twitter-aikatsu-image-scrape\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/dream-wonderland.com\/blog\/twitter-aikatsu-image-scrape\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/dream-wonderland.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Twitter Aikatsu Image Scrape\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/dream-wonderland.com\/blog\/#website\",\"url\":\"https:\/\/dream-wonderland.com\/blog\/\",\"name\":\"Yume's Wonderland\",\"description\":\"Just a playground for myself\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/dream-wonderland.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Twitter Aikatsu Image Scrape - Yume's Wonderland","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/dream-wonderland.com\/blog\/twitter-aikatsu-image-scrape\/","og_locale":"en_US","og_type":"article","og_title":"Twitter Aikatsu Image Scrape - Yume's Wonderland","og_description":"This is my test using python and twitter API to scrape the latest and random aikatsu Images from Twitter. It is updated from the server every ten minutes. Logic: Twitter search API with “Aikatsu” as keyword and 100 post count. Step 1 is repeated X number of times to get even more images. Actual count […]","og_url":"https:\/\/dream-wonderland.com\/blog\/twitter-aikatsu-image-scrape\/","og_site_name":"Yume's Wonderland","article_modified_time":"2017-09-17T06:00:37+00:00","twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/dream-wonderland.com\/blog\/twitter-aikatsu-image-scrape\/","url":"https:\/\/dream-wonderland.com\/blog\/twitter-aikatsu-image-scrape\/","name":"Twitter Aikatsu Image Scrape - Yume's Wonderland","isPartOf":{"@id":"https:\/\/dream-wonderland.com\/blog\/#website"},"datePublished":"2017-05-25T15:47:35+00:00","dateModified":"2017-09-17T06:00:37+00:00","breadcrumb":{"@id":"https:\/\/dream-wonderland.com\/blog\/twitter-aikatsu-image-scrape\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/dream-wonderland.com\/blog\/twitter-aikatsu-image-scrape\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/dream-wonderland.com\/blog\/twitter-aikatsu-image-scrape\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/dream-wonderland.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Twitter Aikatsu Image Scrape"}]},{"@type":"WebSite","@id":"https:\/\/dream-wonderland.com\/blog\/#website","url":"https:\/\/dream-wonderland.com\/blog\/","name":"Yume's Wonderland","description":"Just a playground for myself","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/dream-wonderland.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"}]}},"jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/P8I9dr-4u","jetpack-related-posts":[{"id":52,"url":"https:\/\/dream-wonderland.com\/blog\/about\/","url_meta":{"origin":278,"position":0},"title":"About","date":"May 4, 2017","format":false,"excerpt":"Just my personal interest page\u00a0I set up to play with. Interested in anime, console games and tinkering with IT stuff. Welcome to my website !!! Love Aikatsu very much. I am usually active in the Aikatsu discord. Please join. https:\/\/discord.gg\/HQvVwdZ","rel":"","context":"Similar post","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":91,"url":"https:\/\/dream-wonderland.com\/blog\/photokatsu\/","url_meta":{"origin":278,"position":1},"title":"Photokatsu","date":"May 7, 2017","format":false,"excerpt":"I am an avid Photokatsu player, having played this non-stop since September in year 2016. Current progress and my PR photos : 59 PRs right now (Last Akari was a dupe) This is the only mobage that is so addictive for me. Will keep this updated if I make any\u2026","rel":"","context":"Similar post","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":153,"url":"https:\/\/dream-wonderland.com\/blog\/photokatsu\/photokatsu-guide\/","url_meta":{"origin":278,"position":2},"title":"Photokatsu Guide","date":"May 16, 2017","format":false,"excerpt":"I have decided to just write a simple guide on various aspects on Photokatsu (Aikatsu! Photo on Stage!!)\uff08\u30a2\u30a4\u30ab\u30c4\uff01\u30d5\u30a9\u30c8\u30aa\u30f3\u30b9\u30c6\u30fc\u30b8\uff01\uff01\uff09. This is the only mobile game I am playing on my phone. Disclaimer: I am by no means a skilled player. I still have quite a few songs that I didn't manage\u2026","rel":"","context":"Similar post","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/dream-wonderland.com\/blog\/wp-json\/wp\/v2\/pages\/278"}],"collection":[{"href":"https:\/\/dream-wonderland.com\/blog\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/dream-wonderland.com\/blog\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/dream-wonderland.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/dream-wonderland.com\/blog\/wp-json\/wp\/v2\/comments?post=278"}],"version-history":[{"count":9,"href":"https:\/\/dream-wonderland.com\/blog\/wp-json\/wp\/v2\/pages\/278\/revisions"}],"predecessor-version":[{"id":825,"href":"https:\/\/dream-wonderland.com\/blog\/wp-json\/wp\/v2\/pages\/278\/revisions\/825"}],"wp:attachment":[{"href":"https:\/\/dream-wonderland.com\/blog\/wp-json\/wp\/v2\/media?parent=278"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}