Public deliverables
The following .pdf documents are the public deliverables produced by Fascinate so far. The documents can be viewed using Acrobat Reader, which is freely available for download here.
Work Package 1: Requirements & System Definition, System Integration and Validation
D1.1.1 End User, Production and Hardware and Networking Requirements
This document describes the overall requirements that the FascinatE system should meet in order to fulfil the needs of end-users, production teams and network infrastructure.
The objective of this deliverable is to define the overall requirements that the FascinatE system should meet. The requirements are defined from three different points of view: end-users, production teams and network infrastructure. In the first case, end-user requirements are established that will provide consumers with a novel and engaging experience in terms of the functionalities available from terminal devices. Production requirements are defined based on how production teams would expect to interact with the system. Finally, network requirements determine the expected capability of networks and processing hardware that the FascinatE system should be able to work on.
Work Package 2: AV Scene Capture, Production Networks & Layered Production
D2.1.1 Generic Data Representation and Coding Scheme
This document aims to define a first version of the layered scene description. As the overall system will be defined in the next few months, some parameters will be changed and some further will be added. However the general structure and even more important, the different terms and geometrical relationship between all different layers for audio and video have been defined.
D2.1.2 Interim Specification of Generic Data Representation and Coding Scheme
This deliverable is an updated version of D2.1.1, which revisits the generic data representation for format-agnostic production, the type and structure of calibration data needed as operative metadata for the further processing chain as well as a coding scheme suited to the generic data representation.This deliverable presents an overall framework, showing how an audio-visual scene can be described in a hierarchical order by partitioning a scene into an audio and video scene. The audio and video scene is further broken down to sensor level and the geometrical relations as well as the parameters describing each layer are listed. One section describes the mapping from different video sources into a common panoramic image, which is relevant for the final presentation of the format-agnostic production workflow.
Work Package 3: Automated Scripting
D3.1.1 Survey of Metadata and Knowledge for Automated Scripting
This document defines the various types of metadata in the FascinatE system and discusses representation requirements and candidate formats. The document considers various types of metadata describing capture, production, context, content, scripts, network, terminals and users. Representation of essence and essence-like metadata (e.g. depth maps) are out of scope of this document.
D3.1.2 Metadata and Knowledge Models and Tools
This deliverable defines the metadata and knowledge models that will be used in FascinatE. A software
prototype for working with these models is provided.
D3.2.1a The Semantic Layer Management System and Scripting Engine Design
This deliverable describes the initial version of the semantic layer design and a detailed system design for the scripting engine. This document outlines requirements, technology review, performance tests and decisions. This document starts defining what will be from now on referred to as Semantic Layer Management System (SLMS) and Scripting Engine, explaining their functions, what kind of data moves inside them, how should it be processed and expected results.
Work Package 4: Audiovisual Services, Proxies and Distribution Networks
D4.1.1 Service Concepts, Business Models,Delivery Modes
This document is the third iteration of the first deliverable of WP4, Task 4.1; Business models for network-based services. According to the FascinatE proposal this task is concerned with identifying viable business models and associated services. In the previous iterations of this deliverable, we focused mainly on the non-financial aspects of the business model canvas. In this document all aspects of the business model will be discussed. The main objective of this deliverable is to view from the perspective of the companies that want to adopt the technology and understand their position, interests and way of working. The central questions in this deliverable are:
• Do third parties recognize the selected PMC as viable for their own business?
• How do these parties analyse
D4.1.2a Business and Market Overview
The main objective of this deliverable is to identify and analyse the markets that the consortium partners
aim for with technology developed within FascinatE. The analysis considers market sizes; existing
products and research projects that deliver service values that are highly similar to the FascinatE service
values. Based on the insights into the characteristics of these products, the markets and the
organisations that operate on these markets, we analyse how this will affect potential FascinatE services.
D4.1.2b Business and Market Overview
This deliverable is a continuation of the business and market overview, following on from D4.1.2a. This document presents a market overview, to validate the working hypothesis from D4.1.1. Its scope is to provide an overview of the current market for FascinatE-related services. This overview is built up by describing and analysing the markets that we have marked as interesting in D4.1.1b, and then by analysing several service and technology examples, that provide service value and use technology similar to FascinatE.
D4.2.1 Capabilities of Current and Next-Generation Delivery Networks involved in FascinatE Services
The main objective of this deliverable is to identify and analyse capabilities of current and next-generation delivery networks involved in FascinatE services. This can help further work, which is aimed at specifying the functionalities required in media proxy nodes and the interaction between the network elements for provisioning the overall service behaviour, identifying the optimal location of FascinatE functionalities in the network and showing architecture solutions for the different selected services.
Work Package 5: Terminals, AV Rendering and User Interaction
D5.1.1 AV Renderer Specification and Basic Characterisation of Audience Interaction
Processing platforms and frameworks for FascinatE audiovisual rendering are explored in this document. With FascinatE’s goal to bring the postproduction closer to the end user, it is shown that this requires a distributed rendering operation and hence a large scale of different processing platforms to be considered during the runtime of the project. Nevertheless, a structure to organize potential FascinatE platform is proposed that will be backed with future benchmarking results.
Furthermore, aspects of audience interaction are discussed, backed with studies from workshops and literature. Several fields for further enquiry are identified and will be investigated in the continuing projects runtime. This will be supported with first definitions of user interaction commands based on gestures that later will be used to build a comprehensive gesture database.
D5.3.1 Requirements for the Network Interfaces and Interactive Systems Usability
This deliverable is composed of two main parts. The first part is related to a study of the requirements of the network interfaces at the terminal side of the end-to-end FascinatE architecture. The second part of the deliverable focuses on the usability of interactive systems in the context of FascinatE.
Work Package 6: Demonstrations
This document reports on the first public demonstration of FascinatE technology, at the International Broadcast Convention (IBC) in September 2011. It describes the preparations for the FascinatE booth, the demonstrations that were exhibited, the papers that were presented and other visual material that was used to explain FascinatE to the IBC visitors. Also included is a series of photos, to provide readers with a visual tour of the FascinatE booth and the IBC exhibition.
D6.2.1 Report on Interim Demonstration
This document reports on the second public demonstration of FascinatE technology, at the concert hall Arena in Berlin in May 2012, during the production of a dance project by the Compagnie Sasha Waltz & Guests and the Education Programme by the Berlin Philharmonic Orchestra conducted by Sir Simon Rattle performing a choreography of the Carmen-Suite by Rodion Schtschedrin. Invited journalists and other guests were able to see live stitching of a panorama from the new OMNICAM equipped with ALEXA-M cameras at the Arena, as well as audio capture using two Eigenmike® microphones. Some of the latest results from other parts of the project were shown in a demonstration room at HHI’s premises nearby. These demonstrations resulted in several press publications, which are also listed in this deliverable.
Work Package 7: Dissemination and Exploitation
FascinatE Project newsletter. This issue looks at the first Fascinate test shoot which was done at a Premier League football match in the UK and also describes how gesture recognition will form part of the user interaction with the Fascinate system.
This is the 2nd edition of the FascinatE Project newsletter. This issue looks at the role of the Omnicam in the project and describes the FascinatE Video Rendering Toolbox as well as a generalised update on project progress.
This special IBC 2011 edition of the FascinatE Project newsletter contains articles on:
- Live ultra high definition panoramic video
- Person tracking and production scripting
- Format agnostic 3D audio system
- FascinatE Rendering Node with ROI zoom and gesture control
- FascinatE neywork and delivery
- ALEX M – The new capture device for the Omnicam
- Use of broadcast camera to Support the Omnicam.
This bumper edition of the newsletter is designed to coinside with IBC 2011 and describes the demos that can be seen at our booth at the convention.
This edition of the newsletter features articles on: Real-time Stitching Engine for Multi-layers, the second FascinatE Test Shoot, FascinatE Demonstrations at IBC 2011, FascinatE’s Virtual Director, Scalable and Personalized Media Delivery and the FascinatE Editor User Interface.
This edition of newsletter was released at the NEM summit 2012 and features articles on: Audio object extraction, the recent FascinatE test shoots in Berlin and London and a description of an audio streaming format for format-agnostic audio. Also featured is an article on the detecting of salient spatio-temporal regions of visual content and more on the Fascinate gesture control.
—–
Follow us on Twitter (FascinatE_prjct) for updates on our progress…
