Interpreting Clouds: Final Ideation

Rosalind, Sophia and Zoe

alt text

This series explores the relationship between human psychology and digital machines. Rooted in the concept of Pareidolia, a psychological phenomenon triggered by the temporal lobe of the brain, where neurons are responsible for face and object recognition. This biological ability is vital in identifying predators, as well as parents for sustenance during infant development.

Using the intuitive pattern recognition skills that have developed and evolved over thousands of years of human history, paired with ideas that have only become possible with the invention of computers in the past 70 years, we can explore the way machine learning tools make use of Pareidolia.

Feeding refined and intentional image data through many layers of a Convolutional Neural Network, via TensorFlow, we have created a series of images and titles, given by our machine, in attempt to invoke human psychological phenomena through code.

alt text TensorFlow Inception model for ImageNet

Proposal

Proof of Concept

Model

alt text

Image Description Data

c_1.jpg
alp (score = 0.13540) valley, vale (score = 0.12731) lakeside, lakeshore (score = 0.07377) wing (score = 0.06108) volcano (score = 0.04491)

c_2.jpg
wing (score = 0.38125) parachute, chute (score = 0.07606) cliff, drop, drop-off (score = 0.06124) megalith, megalithic structure (score = 0.03066) valley, vale (score = 0.02833)

c_3.jpg
geyser (score = 0.15055) missile (score = 0.14142) wing (score = 0.11640) projectile, missile (score = 0.08466) space shuttle (score = 0.07960)

c_4.jpg
geyser (score = 0.42768) volcano (score = 0.04334) megalith, megalithic structure (score = 0.02740) beacon, lighthouse, beacon light, pharos (score = 0.02340) rapeseed (score = 0.02084)

c_5.jpg
wing (score = 0.56471) volcano (score = 0.05122) alp (score = 0.02148) valley, vale (score = 0.01712) maze, labyrinth (score = 0.01375)

c_6.jpg
rapeseed (score = 0.1681 3) wing (score = 0.06743) volcano (score = 0.06542) alp (score = 0.04578) parachute, chute (score = 0.04453)

c_7.jpg
geyser (score = 0.34126) volcano (score = 0.29207) parachute, chute (score = 0.08914) flagpole, flagstaff (score = 0.00994) rapeseed (score = 0.00941)

c_8.jpg
volcano (score = 0.68900) space shuttle (score = 0.07361) geyser (score = 0.02306) alp (score = 0.00344) missile (score = 0.00326)

c_9.jpg
parachute, chute (score = 0.21870) alp (score = 0.16039) balloon (score = 0.14397) wing (score = 0.10658) cliff, drop, drop-off (score = 0.09097)

c_10.jpg
rapeseed (score = 0.05555) beacon, lighthouse, beacon light, pharos (score = 0.05364) hay (score = 0.04863) parachute, chute (score = 0.03568) balloon (score = 0.03279)

c_11.jpg
volcano (score = 0.24023) parachute, chute (score = 0.18067) jellyfish (score = 0.08899) geyser (score = 0.04050) space shuttle (score = 0.01674)

c_12.jpg
space shuttle (score = 0.61488) volcano (score = 0.10118) geyser (score = 0.03653) alp (score = 0.01912) megalith, megalithic structure (score = 0.01141)

c_13.jpg
hay (score = 0.22265) rapeseed (score = 0.08806) beacon, lighthouse, beacon light, pharos (score = 0.04284) geyser (score = 0.03793) balloon (score = 0.02594)

c_14.jpg
volcano (score = 0.21806) lakeside, lakeshore (score = 0.07117) alp (score = 0.04764) valley, vale (score = 0.04461) balloon (score = 0.04059)

c_15.jpg
orchid (score = 0.09552) hay (score = 0.08442) valley, vale (score = 0.08411) alp (score = 0.07704) balloon (score = 0.05038)

c_16.jpg
geyser (score = 0.16401) valley, vale (score = 0.05602) balloon (score = 0.04555) alp (score = 0.04436) parachute, chute (score = 0.03637)

c_17.jpg
wing (score = 0.59212) mountain (score = 0.08956) parachute, chute (score = 0.06842) balloon (score = 0.01583) cliff, drop, drop-off (score = 0.01041)

c_18.jpg
storm (score = 0.11118) quilt (score = 0.10776) hay (score = 0.07224) megalith, megalithic structure (score = 0.04500) balloon (score = 0.03494)

c_19.jpg
parachute, chute (score = 0.13171) rapeseed (score = 0.09473) hay (score = 0.06208) geyser (score = 0.05794) volcano (score = 0.03771)

c_20.jpg
volcano (score = 0.73571) alp (score = 0.04293) cliff (score = 0.00817) geyser (score = 0.00719) parachute, chute (score = 0.00613)

c_21.jpg
lily (score = 0.29654) hay (score = 0.12165) parachute, chute (score = 0.03291) megalith, megalithic structure (score = 0.02794) flagpole, flagstaff (score = 0.02236)

c_22.jpg
parachute, chute (score = 0.37083) geyser (score = 0.07544) balloon (score = 0.04032) cliff, drop, drop-off (score = 0.03828) rapeseed (score = 0.03309)

c_23.jpg
anthurium (score = 0.20880) pole (score = 0.07667) parachute, chute (score = 0.06739) hay (score = 0.05628) balloon (score = 0.04330)

c_24.jpg
volcano (score = 0.09171) rapeseed (score = 0.07913) wing (score = 0.06180) alp (score = 0.06117) beacon, lighthouse, beacon light, pharos (score = 0.04849)

c_25.jpg
mount, mountain (score = 0.22543) orchid (score = 0.05927) geyser (score = 0.03696) alp (score = 0.02802) pole (score = 0.02709)

alt text

c_26.jpg
gastropoda, snail (score = 0.70747) hay (score = 0.06056) parachute, chute (score = 0.02240) balloon (score = 0.01566) megalith, megalithic structure (score = 0.01025)

c_27.jpg
parachute, chute (score = 0.39040) rabbit (score = 0.05065) geyser (score = 0.03941) wing (score = 0.03940) cliff, drop, drop-off (score = 0.03193)

c_28.jpg
quilt (score = 0.23014) sunset (score = 0.13462) valley, vale (score = 0.13287) hay (score = 0.10590) balloon (score = 0.05697)

c_29.jpg
brachyura, crab (score = 0.15854) volcano (score = 0.13115) wing (score = 0.08623) rapeseed (score = 0.04961) balloon (score = 0.04415)

c_30.jpg
parachute, chute (score = 0.23460) pumpkin (score = 0.10889) geyser (score = 0.06706) balloon (score = 0.03689) flagpole, flagstaff (score = 0.03011)

c_31.jpg
castle (score = 0.15552) megalith, megalithic structure (score = 0.13805) cliff, drop, drop-off (score = 0.07213) hay (score = 0.06158) alp (score = 0.05618)

c_32.jpg
raindrop (score = 0.14712) volcano (score = 0.11780) parachute, chute (score = 0.06783) rapeseed (score = 0.03271) hay (score = 0.03215)

c_33.jpg
fence (score = 0.12746) wing (score = 0.12450) volcano (score = 0.03628) cliff, drop, drop-off (score = 0.01831) parachute, chute (score = 0.01409)

c_34.jpg
beacon, lighthouse, beacon light, pharos (score = 0.11266) seashore, coast, seacoast, sea-coast (score = 0.06908) drilling platform, offshore rig (score = 0.06787) breakwater, groin, groyne, mole, bulwark, seawall, jetty (score = 0.04437) megalith, megalithic structure (score = 0.03681)

c_35.jpg
megalith, megalithic structure (score = 0.17392) bed (score = 0.13818) sunlight (score = 0.07871) geyser (score = 0.03953) obelisk (score = 0.02658)

c_36.jpg
space shuttle (score = 0.82127) parachute, chute (score = 0.05299) volcano (score = 0.01788) wing (score = 0.01409) jellyfish (score = 0.00408)

c_37.jpg
hair (score = 0.08996) drilling platform, offshore rig (score = 0.07833) valley, vale (score = 0.04206) quill, quill pen (score = 0.04035) alp (score = 0.02719)

c_38.jpg
obelisk (score = 0.14075) volcano (score = 0.07921) rock (score = 0.06990) parachute, chute (score = 0.05911) flagpole, flagstaff (score = 0.05766)

c_39.jpg
road (score = 0.25316) hill (score = 0.24560) valley, vale (score = 0.05874) geyser (score = 0.05723) parachute, chute (score = 0.01972)

c_40.jpg
ocean (score = 0.16835) sea (score = 0.05969) buoy (score = 0.05616) alp (score = 0.05289) balloon (score = 0.03245)

c_41.jpg
breakwater, groin, groyne, mole, bulwark, seawall, jetty (score = 0.26337) sandbar, sand bar (score = 0.15033) seashore, coast, seacoast, sea-coast (score = 0.14316) beacon, lighthouse, beacon light, pharos (score = 0.06552) lakeside, lakeshore (score = 0.03841)

c_42.jpg
fish (score = 0.45181) child (score = 0.03689) rock (score = 0.03222) flagpole, flagstaff (score = 0.02761) rapeseed (score = 0.02313)

c_43.jpg
wave (score = 0.18860) line (score = 0.08288) coast (score = 0.04823) wing (score = 0.04552) space shuttle (score = 0.02298)

c_44.jpg
projectile, missile (score = 0.36566) geyser (score = 0.30406) mountain (score = 0.06263) missile (score = 0.05371) wing (score = 0.00785)

c_45.jpg
cat, house cat (score = 0.52226) space shuttle (score = 0.19230) lion (score = 0.06225) geyser (score = 0.04917) cliff, drop, drop-off (score = 0.00696)

c_46.jpg
seashore, coast, seacoast, sea-coast (score = 0.32422) sandbar, sand bar (score = 0.10697) promontory, headland, head, foreland (score = 0.08032) breakwater, groin, groyne, mole, bulwark, seawall, jetty (score = 0.02668) geyser (score = 0.02550)

c_47.jpg
wing (score = 0.22465) sandbar, sand bar (score = 0.06243) parachute, chute (score = 0.06148) hair (score = 0.03171) beacon, lighthouse, beacon light, pharos (score = 0.03040)

c_48.jpg
mountains (score = 0.60866) alp (score = 0.15226) space shuttle (score = 0.11528) geyser (score = 0.00711) cliff, drop, drop-off (score = 0.00367)

c_49.jpg
obelisk (score = 0.10843) parachute, chute (score = 0.09707) flagpole, flagstaff (score = 0.09319) balloon (score = 0.06839) beacon, lighthouse, beacon light, pharos (score = 0.04846)

c_50.jpg
field (score = 0.57045) crops (score = 0.06548) parachute, chute (score = 0.05370) bubble (score = 0.02420) rapeseed (score = 0.02297)

c_51.jpg
radio telescope, radio reflector (score = 0.14726) orchid (score = 0.10252) beacon, lighthouse, beacon light, pharos (score = 0.08945) megalith, megalithic structure (score = 0.07350) hay (score = 0.03292)

c_52.jpg
geyser (score = 0.70068) cliff, drop, drop-off (score = 0.01486) megalith, megalithic structure (score = 0.01234) parachute, chute (score = 0.011 sunflower (score = 0.01143)

c_53.jpg
lakeside, lakeshore (score = 0.27854) alp (score = 0.27663) valley (score = 0.04411) volcano (score = 0.02797) cliff, drop, drop-off (score = 0.02630)

c_54.jpg
parachute, chute (score = 0.13246) geyser (score = 0.11263) hand (score = 0.07068) finger, fingers (score = 0.06002) balloon (score = 0.03517)

c_55.jpg
steam locomotive (score = 0.88489) volcano (score = 0.02729) geyser (score = 0.00338) space shuttle (score = 0.00180) missile (score = 0.00114)

c_56.jpg
volcano (score = 0.23397) hay (score = 0.09533) perennis (score = 0.05813) geyser (score = 0.05189) parachute, chute (score = 0.03820)

c_57.jpg
seashore, coast (score = 0.32422) sandbar, sand bar (score = 0.10697) sunflower (score = 0.08032) breakwater, seawall, jetty (score = 0.02668) geyser (score = 0.02550)

c_58.jpg
table (score = 0.14075) obelisk (score = 0.07921) rock (score = 0.06990) plateau (score = 0.05911) cliff (score = 0.05766)

c_59.jpg
hair (score = 0.14075) fur (score = 0.07921) string, strings (score = 0.06990) parachute, chute (score = 0.05911) geyser (score = 0.05766)

c_60.jpg
orchid (score = 0.09552) alp (score = 0.08442) valley, vale (score = 0.08411) hay (score = 0.07704) balloon (score = 0.05038)