© 2018 LE/EECS4700 Digital Media Project(Full Year 2018-2019) Sharing Silhouette group.

lexmoakler
Oct 29, 2018

Lex's Update Oct. 29th

This week I worked on updating the system diagram to reflect recent decisions, and on finishing three mock-up images.



Here is the current system diagram. Major changes include reducing the number of participants to one, adding speakers, changing the run-time environment to Windows, and using one of the ghost figures from Lu's designs.


The mock-up images are like 'fake screenshots' of a potential outcome for the display visuals. These serve as 'work in progress' discussion points for our creative process.


Participant sees themself at the beginning of the interaction:


Participant spots a disembodied skeleton hand - maybe they can use it! The background has changed to reflect the passing of time.


The moon has almost set! Soon the sun will rise and the interaction will be over.


0 comments0 replies
New Posts
  • zhouyang lu
    Nov 13, 2018

    Day & night video background

    Discussion 
    Day & night video background 11.25 NightSky Animation 11.13
  • zhouyang lu
    Nov 9, 2018

    Raw Depth Data - Point Clouds

    Discussion 
    Visualize its data by capturing Raw Depth Data from Kinect and show it as a Point Clouds. Using this way to make the 2d picture is converted into 3d, which is convenient to be combined with other 3d object.
  • lexmoakler
    Nov 5, 2018

    Connecting Processing and Max/MSP with Spout

    Discussion 
    One goal for this project is to develop an entire software ecosystem. This means our run-time environment is spread out among multiple applications developed with more than one coding paradigm. Our results may be more resource-intensive, but this strategy allows us to prototype rapidly with access to a wide variety of pre-built development tools. The two applications we're connecting here are Processing and Max/MSP. Since we're planning on using a Windows setup, our open source tool of choice is Spout: http://spout.zeal.co/ First we install the Spout framework on the Windows machine that will be used for demonstration. Here we include the optional Spout Controls content, because it includes a Processing example. After installation the operating system is ready, but we still need the application-specific libraries. In Processing, we open up either our own sketch or the example code and go to Sketch > Import Library > Add Library. Search for "Spout" by Lynn Jarvis and Martin Froehlich. The setup in Max is similar: go to File > Show Package Manager, and in that window search for "Spout" by Lynn Jarvis and Bob Jarvis. That's everything! The screenshot below shows a working example of Spout being used for a system flow like ours. The Processing sketch renders a virtual scene, shown on the left. Simultaneously, a Max patch receives and re-renders that same scene on the right. The rotating cube is an example scene made by Dave Bollinger. On a Mac environment, the same multi-application setup can be created as well. Instead of Spout, we would be using an open source tool called Syphon: http://syphon.v002.info/ With this system workflow, we will be able to process visual elements twice: once in Processing and once in Max/MSP. The first step has direct access to the Kinect data, and will be focused on representing the participant. The second step will add the results of the first step to an interactive virtual environment. The 3D rendered composite will be combined with a thematically-appropriate soundscape, and output back to the participant through a projector and surround sound.