{"id":5,"date":"2020-02-03T11:01:31","date_gmt":"2020-02-03T16:01:31","guid":{"rendered":"https:\/\/pressbooks.library.ryerson.ca\/360essentials\/2020\/02\/03\/chapter-1\/"},"modified":"2021-05-17T19:51:48","modified_gmt":"2021-05-17T23:51:48","slug":"chapter-1","status":"publish","type":"chapter","link":"https:\/\/pressbooks.library.torontomu.ca\/360essentials\/chapter\/chapter-1\/","title":{"raw":"Chapter 1: What is 360 Video?","rendered":"Chapter 1: What is 360 Video?"},"content":{"raw":"In <\/span>this <\/span>chapter, <\/span>we\u2019ll <\/span>touch <\/span>upon <\/span>the <\/span>history <\/span>and <\/span>evolution <\/span>of <\/span>immersive <\/span>360 <\/span>visual <\/span>experiences, <\/span>look <\/span>at <\/span>how <\/span>modern <\/span>360 <\/span>video <\/span>works <\/span>and <\/span>highlight <\/span>some <\/span>technical <\/span>terms <\/span>and <\/span>concepts <\/span>that <\/span>are <\/span>important <\/span>to <\/span>know <\/span>as <\/span>you <\/span>move <\/span>into <\/span>shooting <\/span>and <\/span>producing <\/span>immersive <\/span>content.<\/span>\r\n\r\n \r\n\r\n[caption id=\"attachment_28\" align=\"aligncenter\" width=\"813\"]\"\" Fig. 1: 360 photo of Hong Kong\u2019s Wet Markets (Axile Gerona, RSJ360 Team)[\/caption]\r\n

What is 360 Video?<\/h1>\r\n

SOME HISTORY, KEY TERMS AND CONCEPTS<\/strong><\/h3>\r\n

Before <\/span><\/span>we <\/span><\/span>dive <\/span><\/span>into <\/span>the <\/span>how-to <\/span><\/span>aspects <\/span>of <\/span>creating <\/span><\/span>cool <\/span>360 <\/span>videos, <\/span>we <\/span><\/span>should <\/span>spend <\/span>a <\/span>little <\/span>time <\/span>getting <\/span><\/span>familiar <\/span><\/span>with <\/span>this <\/span>technology <\/span><\/span>so <\/span>that we're all<\/span>\u00a0<\/span>on <\/span>the <\/span>same <\/span>page. <\/span><\/span>There <\/span><\/span>are <\/span>several key terms<\/span><\/span>\u00a0<\/span>and <\/span>concepts <\/span>specific <\/span>to <\/span>the <\/span>realm <\/span><\/span>of <\/span>360 <\/span>content <\/span>that <\/span>we <\/span><\/span>need <\/span>to <\/span>acquaint <\/span>ourselves <\/span><\/span>with, <\/span>as <\/span>well <\/span><\/span>as <\/span>important <\/span>bits <\/span>of <\/span>history <\/span><\/span>and <\/span>context <\/span><\/span>that <\/span>will <\/span>help <\/span>us <\/span>better <\/span><\/span>understand <\/span><\/span>the <\/span>capabilities <\/span>and <\/span>opportunities <\/span>of <\/span>this <\/span>emerging <\/span><\/span>content <\/span>form.<\/span><\/p>\r\n

Essentially, <\/span><\/span>360-degree <\/span><\/span>photos <\/span>or <\/span><\/span>videos <\/span>are <\/span><\/span>visuals <\/span>in <\/span>which <\/span><\/span>the <\/span>view <\/span><\/span>in <\/span>every <\/span><\/span>direction <\/span><\/span>is <\/span>captured <\/span><\/span>and <\/span>presented <\/span><\/span>simultaneously. You may <\/span><\/span>think <\/span>this <\/span>is <\/span>a <\/span>recent <\/span><\/span>innovation, <\/span><\/span>but <\/span>actually, <\/span><\/span><\/span>people <\/span><\/span>have <\/span><\/span>been <\/span>trying <\/span>to <\/span>capture <\/span><\/span>and <\/span>reproduce <\/span><\/span>immersive <\/span><\/span>360 <\/span>experiences <\/span><\/span>for <\/span><\/span><\/strong>centuries<\/strong>.<\/span><\/span><\/p>\r\n

During <\/span>the <\/span>days <\/span><\/span>of <\/span>the <\/span>Roman <\/span>Empire, <\/span><\/span>painters <\/span><\/span>would <\/span><\/span>adorn <\/span>the <\/span>interiors <\/span><\/span>of <\/span>buildings <\/span>and <\/span>villas <\/span>from <\/span><\/span>floor <\/span><\/span>to <\/span>ceiling <\/span>to <\/span>depict <\/span>scenes <\/span>of <\/span>natural <\/span><\/span>landscapes, <\/span>court <\/span>life, <\/span>cities <\/span>or <\/span><\/span>dramatizations <\/span><\/span>of <\/span>historical <\/span>or <\/span><\/span>mythological <\/span>events, <\/span>creating <\/span><\/span>something <\/span>of <\/span>a <\/span>360 <\/span>visual <\/span>experience <\/span><\/span>(fig. <\/span>1)<\/span>. <\/span><\/span><\/p>\r\n

The <\/span><\/span>concept <\/span>of <\/span>the <\/span><\/span>panorama<\/span><\/span><\/span><\/strong> <\/span>(essentially <\/span><\/span>taking <\/span>an <\/span>ultra-wide <\/span><\/span>horizontal <\/span>perspective <\/span>allowing <\/span><\/span>you <\/span><\/span>to <\/span>see <\/span>as <\/span>much <\/span>of <\/span>the <\/span>subject <\/span>as <\/span>possible) <\/span><\/span>is <\/span>as <\/span>old <\/span>as <\/span>art <\/span>itself, <\/span>with <\/span>many <\/span><\/span>examples <\/span><\/span>from <\/span><\/span>many <\/span><\/span>cultures <\/span><\/span>over <\/span><\/span>hundreds <\/span><\/span>of <\/span>years, <\/span><\/span>like <\/span><\/span>this <\/span>example <\/span><\/span>(fig. <\/span>2)<\/span> <\/span>from China's <\/span><\/span>Song <\/span>Dynasty.<\/span><\/span><\/span><\/p>\r\n

It <\/span><\/span>would <\/span><\/span>seem <\/span>that <\/span>people <\/span>have <\/span><\/span>always <\/span><\/span>enjoyed <\/span><\/span>images <\/span><\/span>that <\/span>make <\/span><\/span>them <\/span>feel <\/span>part <\/span>of <\/span>the <\/span>scene <\/span>and <\/span>artists <\/span>have <\/span><\/span>likewise <\/span><\/span>consistently <\/span><\/span>developed <\/span><\/span>new <\/span><\/span>techniques <\/span>and <\/span>presentation <\/span><\/span>methods <\/span>to <\/span>help <\/span>strengthen <\/span><\/span>that <\/span>feeling <\/span>of <\/span>immersion. <\/span><\/span>During <\/span>the <\/span>late-<\/span>18th <\/span>century, <\/span><\/span>painters <\/span><\/span>and <\/span>visual <\/span>artists <\/span>in <\/span>Europe <\/span><\/span>were <\/span><\/span>especially <\/span><\/span>developing <\/span><\/span>intriguing <\/span>new <\/span><\/span>ways <\/span><\/span>of <\/span>showcasing <\/span><\/span>their <\/span><\/span>work, <\/span><\/span>particularly <\/span><\/span>for <\/span><\/span>their <\/span><\/span>panorama <\/span><\/span>art.<\/span><\/span><\/p>\r\n

While <\/span><\/span>the <\/span>concept <\/span>of <\/span>presenting <\/span><\/span>ultra-wide scenes wasn't new, <\/span><\/span>English <\/span>painter <\/span><\/span>Robert <\/span><\/span>Barker <\/span><\/span>is <\/span>largely <\/span><\/span>credited <\/span><\/span>for <\/span><\/span>coining <\/span>the <\/span>term \"panorama\" <\/span>inspired <\/span><\/span>by <\/span><\/span>the <\/span>Greek <\/span><\/span>words <\/span>for \"all\"<\/span><\/span><\/span>\u00a0<\/span><\/span>(pan) <\/span><\/span>and <\/span>\u201cview\u201d <\/span><\/span>(horama) <\/span><\/span>in <\/span>1792. <\/span>Barker <\/span><\/span>famously <\/span><\/span>introduced <\/span><\/span>the <\/span>term <\/span>when <\/span><\/span>he <\/span>developed <\/span><\/span>a <\/span>more <\/span><\/span>interactive <\/span><\/span>presentation <\/span>experience <\/span><\/span>to <\/span>showcase <\/span><\/span>his <\/span>panoramic <\/span><\/span>paintings <\/span>of <\/span>cities. <\/span>He <\/span><\/span>would <\/span><\/span>wrap <\/span><\/span>his <\/span>work <\/span><\/span>around <\/span><\/span>giant <\/span>cylindrical <\/span><\/span>displays, <\/span><\/span>allowing <\/span><\/span>people <\/span>to <\/span>walk <\/span><\/span>around <\/span><\/span>and <\/span>see <\/span>an <\/span>unbroken <\/span><\/span>horizontal <\/span>view <\/span><\/span>of <\/span>the <\/span>scene. <\/span>These \"cycloramas\", <\/span><\/span>as <\/span>they <\/span><\/span>were <\/span><\/span>called, <\/span>lead <\/span>to <\/span>a <\/span>deeper <\/span><\/span>sense <\/span>of <\/span>immersion <\/span><\/span>and <\/span>the <\/span>effect <\/span>of <\/span>people <\/span>feeling <\/span>like <\/span><\/span>they <\/span><\/span>were <\/span><\/span>almost <\/span>walking <\/span>through <\/span><\/span>the <\/span>scene <\/span>itself.<\/span><\/span><\/p>\r\n

This <\/span><\/span>concept <\/span>caught <\/span>on <\/span>and <\/span>soon <\/span>other <\/span><\/span>artists <\/span>began <\/span>innovating <\/span><\/span>panoramic <\/span><\/span>exhibits. <\/span><\/span>Travelling <\/span><\/span>shows <\/span><\/span>and <\/span>purpose-<\/span>built <\/span>panorama <\/span>theatres <\/span><\/span>became <\/span>wildly <\/span><\/span>popular <\/span><\/span>throughout <\/span><\/span>the <\/span>19th <\/span>century. <\/span><\/span>These <\/span><\/span>buildings <\/span>popped <\/span>up <\/span>over <\/span><\/span>Europe <\/span><\/span>and <\/span>North <\/span><\/span>America, <\/span>including <\/span>one <\/span>that <\/span>was <\/span><\/span>built <\/span>in <\/span>Toronto, <\/span><\/span>Canada <\/span>in <\/span>1887.<\/span><\/span><\/p>\r\n \r\n\r\n[caption id=\"attachment_31\" align=\"aligncenter\" width=\"1024\"]\"\" Fig. 2: Lord Pheasant<\/a> at English Wikipedia, Public Domain via Wikimedia Commons[\/caption]\r\n\r\n \r\n\r\n[caption id=\"attachment_32\" align=\"aligncenter\" width=\"968\"]\"\" Fig. 3: Panorama of a half section of Night Revels of Han Xizai, 12th century Song Dynasty painting. Anonymous Song<\/a>, Chinese artist after the original by Gu Hongzhong, Public domain, via Wikimedia Commons[\/caption]\r\n

The <\/span><\/span>audience <\/span>would <\/span><\/span>stand <\/span>in <\/span>the <\/span>middle <\/span>of <\/span>the <\/span>scene <\/span>on <\/span>a <\/span>raised <\/span><\/span>platform <\/span>to <\/span>view <\/span><\/span>the <\/span>scenes. <\/span>These <\/span><\/span>ranged <\/span><\/span>from <\/span><\/span>wonders <\/span><\/span>of <\/span>the <\/span>world <\/span><\/span>like <\/span><\/span>Niagara <\/span><\/span>Falls, <\/span>to <\/span>religious <\/span><\/span>scenes, <\/span>to <\/span>famous <\/span>battles. <\/span>While <\/span><\/span>many <\/span><\/span>of <\/span>these <\/span>scenes <\/span>were <\/span><\/span>painted, <\/span>few <\/span><\/span>have <\/span><\/span>survived. <\/span><\/span>One<\/span>\u00a0<\/span>that <\/span>did <\/span>was <\/span><\/span>the <\/span>\u201cCyclorama <\/span><\/span>of <\/span><\/span>the Battle of Gettysburg\u201d, which originally opened in Chicago in 1883. This work took more than a year and a half to finish and opened to rave reviews from visitors and veterans of Gettysburg alike. A second version of this battle was painted and was eventually put on display in Gettysburg in 1913. This painting was purchased by the National Park Service in the 1940\u2019s and has been restored and rehabilitated several times since. Click here to check out the Gettysburg example.<\/a><\/p>\r\nThis 360 medium was popular but was not particularly portable and could be easily damaged. The paintings themselves were large and took time to move and set up. The Gettysburg Cyclorama, for example, is 377 feet long, 42 feet high and weighs 12.5 tons! But clearly, there was enough interest to make this a viable medium for many years. This was a way of allowing people to experience, at least in part, spaces and events that they would never otherwise be able to. This was especially significant in the age when transportation was slower and travel was much more difficult and quite costly.\r\n\r\nMeanwhile, during this era, photographers also developed early versions of cameras that could capture panoramas. By sequencing several wide shots together, photographers back then were able to recreate unbroken views of cities and natural landscapes by pressing the images onto silver-coated copper plates called daguerreotypes. Indeed, the U.S. Library of Congress has a really incredible collection of early panorama photography you should check out here<\/a>.\r\n\r\nAnother popular and unique way of showcasing photography in a more immersive way was the spectacularly-named Kaiserpanorama. Patented in 1890 by scientist August Fuhrmann (no idea why he didn\u2019t call it the Fuhrmanorama\u2026 way catchier, right?), this fascinating circular mini-theatre comprised a number of wooden viewing stations that rotated through a series of illuminated glass slide images (fig. 4).\r\n\r\nThese glass slide images were designed using the stereoscopic<\/strong> effect. Essentially two images of the same subject are taken, but at slightly different angles for the left and right eyes. Because the images are ever so slightly incongruous with one another, when the eyes see the images together through the Kaiserpanorama, the brain interprets them as one image but with a sense of depth<\/strong>, at least much more so than a standard image. This stereoscopic technique is the basis for many of the \u201c3D\u201d experiences you\u2019re likely familiar with in the modern era, from 3D comic books to those red toy View-Masters to old superhero films that charged you an extra $10 to rent 3D glasses. The concept of the stereoscopic effect is also important to know if when it comes to shooting, editing and viewing your own 360-3D videos. More on this later.\r\n\r\n \r\n\r\n[caption id=\"attachment_39\" align=\"aligncenter\" width=\"778\"]\"\" Fig. 4: A drawing of the Kaiserpanorama, built with 25 viewing stations. Unknown<\/a>, Public Domain from Wikimedia Commons[\/caption]\r\n

THE BIRTH OF 360 PHOTOGRAPHY<\/strong><\/h3>\r\nAs camera technology improved, moving from pressed plates to flexible film, so did the ability to create more immersive visual experiences. New innovations, such as rotating cameras, were developed. However, for much of the early-to-mid 20th century, 360 photography and video were still incredibly expensive and difficult to create and the image quality lagged far behind conventional camera technology. Indeed, most people producing 360 visual content at this time were doing so for scientific or military research or documentary work. The late-20th century saw smaller, more agile and more affordable panoramic cameras hit the market, but as these devices still required lots of setup, training and production know-how, this technology remained largely limited to the professional set.\r\n\r\nHowever, this all changed dramatically in the early-2000s with the development and widespread introduction of sophisticated, powerful (yet relatively affordable) digital cameras and smartphones.\r\n\r\n \r\n

THE DIGITAL 360 ERA<\/strong><\/h3>\r\nCompanies like Nikon and Canon introduced game-changing digital single-lens reflex (DSLR) cameras, inspiring whole new generations to take up photography. California\u2019s GoPro became an international market leader by popularizing affordable action cameras designed to be sturdy and stable enough to take on everything from kayak trips to skydiving.\r\n\r\nGoPro\u2019s action camera took the photo market by storm by offering a small, robust camera with a very wide lens. While this became popular with extreme sports lovers, it also found a place in 360 shooting.\r\n\r\nStandard cameras utilize one lens, allowing you to shoot with a narrow field of vision, generally a few degrees up to 180 degrees. In order to create a 360 effect, one would use a computer program to arrange and overlap the separate wide shots together to create an unbroken view of a scene in all directions \u2014 essentially, a panorama that covered the entire field of view for a person. This is why 360 video is often referred to as being spherical \u2014 spheres have no edges, so you can keep looking around and around \u2014 vs. flat video (i.e. 180 degree visuals where the edges are clearly visible).\r\n\r\nThe ability to shoot and edit digital files and the higher optical quality of these new digital cameras made 360 content production far easier. One could now position a few digital cameras together in a custom rig, covering every angle. Each camera would shoot video simultaneously, giving the shooter high-quality videos and photos from each angle. Several rigs were developed using multiple GoPro cameras, which were quite clunky and hard to manage.\r\n\r\nThere were several other major disadvantages with these rigs. One was the cost. At about $500 per GoPro camera the price quickly escalated (and don\u2019t forget the SD cards needed as well!). The other issue was that if one of the cameras stopped working (battery issues for example), then there would be a piece of the 360 scene missing.\r\n\r\nThe other disadvantage with these rigs was that they required tremendous computing power (and time!) to sequence all the footage together. Clearly this was not technology aimed at main street.\r\n\r\nThere were other attempts to create 360 photos. One involved placing a single GoPro camera on a motorized tilt pan head which would automatically rotate and take the photos needed to create a 360 photo. It would then stitch the photos together using software. The issue with this set up was that if there were people in the scene they had to stand completely still (sort of a throw back to the early days of photography!). Again, this was not a technology that would work for most people and was only photos, not video.\r\n\r\nHowever, over the past decade, we\u2019ve seen some exponential advances in 360 shooting technology that has reduced the need to construct such elaborate rigs. For one, high-definition video would become a standard (if not minimal) feature on every type of digital camera, including the ones built-in to ever-improving smartphones. Now, it\u2019s easy and cost-effective to find 360 cameras that can shoot 4K resolution video, with 6K and 8K cameras trending down in price as well. There are 360 cameras that are capable of shooting 11K video, but these tend to still cost upwards of $20,000 and are ideal for professional filmmakers.\r\n\r\nMajor strides have also been made to create cameras and programs that make sequencing the footage far easier than before. The act of sequencing separate shots together to produce this 360 effect is called stitching, which is an important term to remember. The stitch line is where the edges of the visuals come together. An excellent stitching job will help the 360 \u201cillusion\u201d appear smooth and seamless. However, it can be challenging to achieve this seamlessness as objects on or near the stitchlines easily distort or blur or differences in lighting can become more apparent.\r\n\r\nNow, it\u2019s easy and cost-effective to find 360 cameras that can shoot 4K resolution video, with 6K and 8K cameras are trending down in price as well.\r\n

AN EVOLVING STITCH-UATION<\/strong><\/h3>\r\nWe\u2019ll address these potential issues later in the chapters on shooting and editing, but for now, just know that stitching is an essential aspect of producing 360 video content. Above, you can see the differences between unstitched 360 video and stitched 360 video content (fig. 7).\r\n\r\n \r\n\r\n \r\n\r\n[caption id=\"attachment_49\" align=\"aligncenter\" width=\"806\"]\"\" Fig. 5.1: Unstitched 360 video footage. Two wide shots that have yet to be fitted together. Adrian Ma, Ryerson University, CC BY 4.0<\/a>[\/caption]\r\n\r\n[caption id=\"attachment_50\" align=\"aligncenter\" width=\"780\"]\"\" Fig. 5.2: The visual clears up once the wide shots have been stitched together. Adrian Ma, Ryerson University, CC BY 4.0[\/caption]\r\n\r\nAs we mentioned before, the primary method for shooting high quality 360 video several years ago was to rig up multiple cameras and then stitch the footage together using computer software, often a third-party program. Even with a high-end computer and powerful software, this is a labour intensive and time-consuming method of producing 360 content. However, one of the most critical developments for the widespread adoption of 360 video has been the manufacturing of affordable, user-friendly and visually powerful digital cameras designed specifically to capture 360 content.\r\n\r\nIn recent years, numerous companies \u2014 from well-established brands like Samsung and GoPro to upstarts like Insta360 \u2014 have brought to market myriad 360 camera options for shooters of all kinds, whether you\u2019re a hobbyist who just wants to share some interesting vacation videos on social media or a professional filmmaker creating cutting-edge cinematic virtual reality experiences. In general these days, 360 cameras feature multiple lenses on one camera body. At the minimum, there is a front and rear lens, each capturing a 180 degree field of view on either side.\r\n\r\nWhen you bring them together, that gives you a 360 degree field of view. Some of the more advanced cinematic 360 cameras have several lenses on the camera body, which provides the ability to capture video at much higher resolutions.\r\n\r\nThe trend to make 360-specific cameras has also led to the creation of auto-stitching features or \u201cno stitch\u201d workflows to help you save time and energy from having to do it all manually. Our guidebook is an introduction to 360 video storytelling and, as such, our focus is on the use of the more user-friendly and affordable 360 cameras, most of which come with native stitching software or have designed their production workflow to minimize (or remove) stitching altogether. So we will not be delving into the technical aspects of manually stitching 360 content, although there are many effective programs one could use to do so (see our Resources chapter).\r\n\r\nInstead, for this guidebook, we advise you to start with a 360 camera and to follow the directions of your particular 360 camera to prepare your video files accordingly (And see our Gear Guide in Chapter 2 to figure out which camera is right for you!).\r\n\r\n \r\n

YOUR OWN PERSONAL IMMERSIVE THEATRE<\/strong><\/h3>\r\nAs important as the innovations of 360 cameras have been, of equal importance has been tremendous advancements in how we view 360 content. A few decades ago, 360 video was a highly specialized type of content that was only accessible to the public as theatre experiences. Probably the most famous person to explore 360 cinema was Walt Disney. Disney put a lot of effort to make people feel like they were part of the story and the interactive attractions at Disneyland (and subsequent parks that opened after his death) are great examples of this. He was however, first and foremost a filmmaker, and in 1955 he installed \u201cCircarama\u201d (later to be called Circlevision) in his theme park. In the early days, this technology used eleven 16mm projectors but this would eventually change to nine 35mm projectors. Disney\u2019s first film that used this technology was \u201cAmerica the Beautiful\u201d and it would later be used at Epcot\u2019s Canada Pavilion with the film \u201cO Canada!\u201d<\/a>.\r\n\r\nBoth the cyclorama paintings and the Circlevision technologies offered audiences a panorama experience but not a true 360 experience. One theatre that offers a true 360 experience is Space 360 which opened in Gwangju, South Korea. This is a spherical theatre built by the Lucerium National Science Museum and Korea Hydro and Power. Up to 45 people at a time stand on a glass bridge and are surrounded by projected images.\r\n\r\nThe problem with all theatre based 360 experiences, whether it is a 360 painting or a film, is the special building required. Also, the actual viewing experience is hindered by audience size. If you are with a large group of people then your field of view can be limited by others who block the screen\/painting. In the case of Disney\u2019s use of 360 film projection, the screens were elevated above the audience who were then required to stand to watch the film. The view in the Space 360 theatre is again limited by people around you and the bridge which is not completely transparent. There are also two exits on either end of the bridge which cut in to the experience.\r\n\r\n \r\n

THE DIFFERENCES BETWEEN 360, 3D-360 AND VR VIDEO<\/strong><\/h3>\r\nNowadays, we can watch 360 video content easily on your desktop computer or your smartphone. But for a much more immersive experience, we can also use a headset<\/strong> or head-mounted device (HMD)<\/strong>. These wearable goggles can help block out environmental distractions to help immerse the user entirely in the 360 content, allowing one to better experience this sensation of presence. They also often have control features, either built-in the headset itself or in the form of hand controllers or an phone-based app, which grant the viewer more control or interact with the content.\r\n\r\nHeadsets are available in a variety of forms. The most basic headsets, like Google\u2019s famous Cardboard model, are designed to work with your smartphones, as dozens of video player apps and streaming platforms (including YouTube, Vimeo) offer different levels of 360 and stereoscopic playback. Other headsets, such as the Oculus and HTC Vive series, offer more power, higher build quality and native playback support. Although every model of headset has different strengths and weaknesses, they all share one common flaw \u2014 it\u2019s really hard to look cool while wearing them.\r\n\r\nHowever, headsets are essential for experiencing what has proven to be the next tier of immersive video \u2014 360-3D and virtual reality.\r\n\r\nWhether you\u2019ve used a 360 camera before, there is a good chance you have watched some 360 video or virtual reality content before, perhaps on YouTube or Facebook. It\u2019s important to understand that 360 video<\/strong>, 3D video<\/strong> and virtual reality (VR) <\/strong>are distinctive in their own rights.\r\n\r\nThese terms are often used interchangeably by those working in news media and advertising (and often to the annoyance of those who specialize in virtual reality), but they\u2019re not technically the same thing. Let\u2019s break it down real quick.\r\n\r\n \r\n

\"360\"<\/strong><\/h4>\r\nQuite simply, a piece of 360 content allows people to choose where in the photo or video they want to look by using a mouse, trackpad or by moving their phone to control the viewing angle \u2014 this example, when uploaded or embedded on a platform that supports 360 content, would only show you a small section at a time, and you could drag your cursor left or right to see more.\r\n\r\n[caption id=\"attachment_54\" align=\"aligncenter\" width=\"663\"]\"\" Fig. 6: A 360 photo of a farm in Veerhaven, Breskens. Breskens Veerhaven 360 Panorama<\/a> by Jack Sparrow<\/a>, Public Domain from PublicDomainPictures.net[\/caption]\r\n\r\nIt can be a pretty neat experience that lets you experience a scene from interesting angles and perspectives. If you\u2019re watching on your computer or your phone, the experience doesn\u2019t fully immerse you, as you remain well aware of the borders of the video, the other people in the room and other objects and sounds around you. You can watch 360 content on a headset or head-mounted device (HMD) for a more immersive experience.\r\n\r\nIf you viewed this clip wearing a headset, you might notice that while the video is pretty cool, the video looks kind of flat, like there\u2019s no feeling of depth. That\u2019s because most 360 video is monoscopic<\/strong>.\r\n\r\n \r\n

\"3D-360\"<\/strong><\/h4>\r\nIf you recall, earlier in this chapter we discussed how employing stereoscopic<\/strong> techniques can create the illusion of depth by showing each eye a slightly different version of the same image. Monoscopic video shows the exact same image to both eyes, meaning the brain has no issue interpreting the visual, thus leading to no 3D trickery.\r\n\r\nBelow (fig. 9) is a clip of a proper stereoscopic 360 video produced by National Geographic<\/a>. You\u2019ll need to watch it on your headset to actually perceive the depth, but do you notice the difference between this piece and some of the others you\u2019ve watched?\r\n\r\nWhy is most 360 video (right now anyways) monoscopic? Great question! Much of that has to do with cost and complexity. Cameras designed specifically to capture stereoscopic 360 video are very expensive, ranging from several thousand to tens of thousands of dollars. They feature double the lenses in order to simultaneously record separate images for the left and right eyes. It is possible to augment monoscopic 360 video to create a stereoscopic version or a video with sensory depth, but this usually involves advanced production skills involving additional 3D scanning equipment and software like Matterport<\/a> or Vpix360<\/a>.\r\n\r\nAgain, since this guidebook focuses on presenting an introduction to 360 video, we won\u2019t be tackling this, but will refer to some further reading in the resources section for those who are interested. What\u2019s important for now is for you to know a) the difference between monoscopic and stereoscopic 360 video b) that most 360 video is monoscopic and c) that only some 360 cameras have the option to shoot stereoscopic content and they tend to be much more expensive and geared towards professional filmmakers.\r\n\r\n \r\n\r\n[embed]https:\/\/www.youtube.com\/watch?v=dwHBpykTloY[\/embed]\r\n\r\nFig. 7: 3D VR filmed in space by National Geographic\r\n

WHAT IS VR VIDEO?<\/strong><\/h3>\r\n

\u201cVirtual Reality\u201d<\/strong><\/h4>\r\nOK, so is any of this 360 stuff we\u2019ve been watching \u201cvirtual reality?\u201d Yes and no. It turns out that virtual reality has been maddeningly difficult to define.\r\n\r\nThe Tow Center at the Columbia Graduate School of Journalism, for one, defines virtual reality as \u201can immersive media experience that replicates either a real or imagined environment and allows users to interact with this world in ways that feel as if they are there.\u201d Other definitions emphasize that true VR involves a three-dimensional experience where one has full freedom of movement and the ability to manipulate aspects of the environment.\r\n\r\nWhile the term \u201cvirtual reality\u201d remains loosely defined and open to interpretation, most researchers and content creators would agree that a fundamental aspect of VR is the idea of presence, the sensation of actually feeling like you\u2019re physically part of the scene, but through the connection of technology. When VR is done well, it can actually trick your brain and body into believing you\u2019re about to swing through a canyon in Utah<\/a> (fig. 10).\r\n\r\nTry watching the tightrope video again with a headset. Did your stomach drop a little? Did the brightness of the sun remind you of a summer day? Those sensations are something VR content producers are hoping to elicit in viewers. Now, aspects of this are very achievable even without 3D depth, but not without a headset. So it is widely accepted that one of the elements that make an experience virtual reality is the use of a headset to help immerse the viewer.\r\n\r\n \r\n\r\n[embed]https:\/\/www.youtube.com\/watch?v=tl6rVm9vx2g[\/embed]\r\n\r\nFig. 10: 360 video, Canyon Swing: Jump Into the Unknown by Discovery\r\n\r\n \r\n

Degrees of freedom<\/strong><\/h4>\r\nAnother key aspect of VR is giving the user some degree of agency to choose how they engage with the content or interact with what they\u2019re seeing. This is what\u2019s known as degrees of freedom (DoF)<\/strong>. We\u2019re going to get a little sciencey and jargony here, so bear with us for a moment.\r\n\r\nThere are six basic ways a solid object can move through three-dimensional space, thus, there are six degrees of freedom.\r\n\r\nThree degrees of freedom correspond to rotational movements around x, y and z axes, also referred to as \u201cpitch, yaw and roll.\u201d In other words, if you use a VR headset that offers 3DoF<\/strong> (three degrees of freedom), you can look forwards and backwards, side to side and shoulder to shoulder (fig. 11)\u2014 basically wherever your head can rotate. You may be able to use your hand controllers to manipulate some objects or perform certain actions, but 3DoF VR essentially limits you to be tethered in one spot, why is why it\u2019s often called standing VR<\/strong>.\r\n\r\n[caption id=\"attachment_164\" align=\"aligncenter\" width=\"382\"]\"\" Fig. 11: The movements one can experience using a virtual reality headset. (Gregor DS<\/a> licensed under a CC BY-SA 4.0 license<\/a> via Wikimedia Commons)[\/caption]\r\n\r\nThe actual ability to move within a scene requires other degrees of freedom: elevating (moving up and down), strafing (moving side to side) and surging (moving forwards and backwards). With a 6DoF system, now you\u2019re able to explore a scene more freely and perform basic, natural movements, like walking and crouching. Being able to move through the physical and virtual space can also be referred as room-scale virtual reality, because your runway is the length and width of the room you are in.\r\n\r\nIn general, VR headset systems are only available with either 3DoF or 6DoF capabilities (see our Headset guide). The 360\/VR content you see on YouTube or Facebook are generally 3DoF experiences. On the most basic level, this would mean giving people the ability to look wherever they wanted to, like with 360 video. More premium types of VR headsets like the Oculus or HTC Vive brands, have superior movement tracking technology, allowing them to enjoy 6DoF games and video content.\r\n\r\nAs this is an introductory guidebook, our primary focus is on producing 3DoF video content, as specialized software and gaming programs like Unity and Unreal are often required to create environments that actually utilize 6DoF (Learn more about this in Chapter X - The Future of 360) and most 360 cameras aimed for consumer users on the market are not advanced to support the depth mapping and 3D video needed for this.\r\n

TL;DR<\/h1>\r\nWe hope this chapter has provided some history and context into the evolution of 360 video. Of course, the real fun is in shooting, editing and showing off amazing 360 experiences (we\u2019re about to get to that, we swear!), but it is important to understand some of the key terms and concepts that underpin this medium. As a props for making it to the end of the chapter, we\u2019ll make things easy and break everything down for you.\r\n