<p>The effect is the feeling of a person sitting just across from you, like they are right there. </p>

Future of video conferencing

<figure><img src="https://storage.googleapis.com/gweb-uniblog-publish-prod/images/Blog_HERO.max-1000x1000.png" alt="A woman wearing a green shirt, blue overalls and a blue hat smiles on screen as a man, seen in profile, watches." width="785" height="327"></figure><div>Clay Bavor</div><div>
        VP, Google
      </div><div dir="ltr">

      

      <span dir="ltr">Published May 18, 2021</span>

      
    </div><p>People love being together — to share, collaborate and connect.&nbsp; And this past year, with limited travel and increased remote work, being together has never felt more important.</p><p>Through the years, we’ve built products to help people feel more connected. We’ve simplified email with Gmail, and made it easier to share what matters with Google Photos and be more productive with Google Meet. But while there have been advances in these and other communications tools over the years, they're all a far cry from actually sitting down and talking face to face.</p><p>We looked at this as an important and unsolved problem. We asked ourselves: could we use technology to create the feeling of being together with someone, just like they're actually there?</p><p>To solve this challenge, we’ve been working for a few years on Project Starline — a technology project that combines advances in hardware and software to enable friends, families and coworkers to feel together, even when they're cities (or countries) apart.</p><p>Imagine looking through a sort of magic window, and through that window, you see another person, life-size and in three dimensions. You can talk naturally, gesture and make eye contact.</p><UL><LI><div aria-label="A woman communicates with her sister and baby using Project Starline."><span>A woman communicates with her sister and baby using Project Starline.</span></div><p>We brought in people to reconnect using Project Starline.</p></LI></UL><UL><LI><button type="button" role="tab" tabindex="0" aria-selected="true" aria-label="" data-ng-click="paginationPageListCtrl.setPage(index)" data-ng-focus="paginationPageListCtrl.handleFocus()" data-ng-blur="paginationPageListCtrl.handleBlur(index)" data-ng-if="!paginationPageListCtrl.getAriaControlId(index)">
            1
          </button></LI><LI><button type="button" role="tab" tabindex="-1" aria-selected="false" aria-label="" data-ng-click="paginationPageListCtrl.setPage(index)" data-ng-focus="paginationPageListCtrl.handleFocus()" data-ng-blur="paginationPageListCtrl.handleBlur(index)" data-ng-if="!paginationPageListCtrl.getAriaControlId(index)">
            2
          </button></LI><LI><button type="button" role="tab" tabindex="-1" aria-selected="false" aria-label="" data-ng-click="paginationPageListCtrl.setPage(index)" data-ng-focus="paginationPageListCtrl.handleFocus()" data-ng-blur="paginationPageListCtrl.handleBlur(index)" data-ng-if="!paginationPageListCtrl.getAriaControlId(index)">
            3
          </button></LI><LI><button type="button" role="tab" tabindex="-1" aria-selected="false" aria-label="" data-ng-click="paginationPageListCtrl.setPage(index)" data-ng-focus="paginationPageListCtrl.handleFocus()" data-ng-blur="paginationPageListCtrl.handleBlur(index)" data-ng-if="!paginationPageListCtrl.getAriaControlId(index)">
            4
          </button></LI></UL><p>To make this experience possible, we are applying research in computer vision, machine learning, spatial audio and real-time compression. We've also developed a breakthrough light field display system that creates a sense of volume and depth that can be experienced without the need for additional glasses or headsets.</p><p dir="ltr">The effect is the feeling of a person sitting just across from you, like they are right there.&nbsp;<br dir="ltr"></p><figure><img src="https://storage.googleapis.com/gweb-uniblog-publish-prod/original_images/howitworks_v8_480p.gif" alt="A breakdown of how Project Starline works from 3D imaging to real-time data compression to 3D display." width="785" height="441"><figcaption dir="auto">Key breakthroughs include 3D imaging, real-time compression and a 3D display.</figcaption></figure><p>One of the things we are most proud of is that as soon as you sit down and start talking, the technology fades into the background, and you can focus on what's most important: the person in front of you.&nbsp;</p><p>Project Starline is currently available in just a few of our offices and it relies on custom-built hardware and highly specialized equipment. We believe this is where person-to-person communication technology can and should go, and in time, our goal is to make this technology more affordable and accessible, including bringing some of these technical advancements into our suite of communication products.</p><figure><img src="https://storage.googleapis.com/gweb-uniblog-publish-prod/images/Booth_Blog.max-1000x1000.png" alt="A man sitting down using Project Starline." width="353" height="203"><figcaption dir="auto">Project Starline being used in one of our Google offices.</figcaption></figure><p>To start that journey, we’ve spent thousands of hours testing Project Starline within Google as we connected colleagues between the Bay Area, New York and Seattle. We've also been conducting demos with select enterprise partners in areas like healthcare and media to get early feedback on the technology and its applications. We’re planning trial deployments with enterprise partners later this year.</p><p>We’re really excited about the progress we’re making with Project Starline, and the technology’s potential to solve the important problem of wanting to be together with someone even when you physically can’t. We look forward to sharing more later this year.</p><div class="embed-placeholder" data-type="youtube" data-id="Q13CishCKXY"></div><figure><img src="https://storage.googleapis.com/gweb-uniblog-publish-prod/images/YouTube_Thumbnail.max-1000x1000.png" alt="A video showing Project Starline in action." width="785" height="442"><figcaption dir="auto">1:51</figcaption></figure>

Introducing Project Starline, a technology proof of concept that makes you feel like you're together, even when you're apart.

technologyandthefuture

Technology & The Future

<p>People love being together — to share, collaborate and connect.  And this past year, with limited travel and increased remote work, being together has never felt more important. </p>

<p>Through the years, we’ve built products to help people feel more connected. We’ve simplified email with Gmail, and made it easier to share what matters with Google Photos and be more productive with Google Meet. But while there have been advances in these and other communications tools over the years, they're all a far cry from actually sitting down and talking face to face. </p>

<p>We looked at this as an important and unsolved problem. We asked ourselves: could we use technology to create the feeling of being together with someone, just like they're actually there? </p>

<p>To solve this challenge, we’ve been working for a few years on Project Starline — a technology project that combines advances in hardware and software to enable friends, families and coworkers to feel together, even when they're cities (or countries) apart. </p>

<p>Imagine looking through a sort of magic window, and through that window, you see another person, life-size and in three dimensions. You can talk naturally, gesture and make eye contact. </p>

<ul><li><div aria-label="A woman communicates with her sister and baby using Project Starline."><span>A woman communicates with her sister and baby using Project Starline. </span> </div><p>We brought in people to reconnect using Project Starline. </p> </li> </ul>

<p>To make this experience possible, we are applying research in computer vision, machine learning, spatial audio and real-time compression. We've also developed a breakthrough light field display system that creates a sense of volume and depth that can be experienced without the need for additional glasses or headsets. </p>

<p dir="ltr">The effect is the feeling of a person sitting just across from you, like they are right there. <br dir="ltr"/> </p>

<p>One of the things we are most proud of is that as soon as you sit down and start talking, the technology fades into the background, and you can focus on what's most important: the person in front of you.  </p>

<p>Project Starline is currently available in just a few of our offices and it relies on custom-built hardware and highly specialized equipment. We believe this is where person-to-person communication technology can and should go, and in time, our goal is to make this technology more affordable and accessible, including bringing some of these technical advancements into our suite of communication products. </p>

<p>To start that journey, we’ve spent thousands of hours testing Project Starline within Google as we connected colleagues between the Bay Area, New York and Seattle. We've also been conducting demos with select enterprise partners in areas like healthcare and media to get early feedback on the technology and its applications. We’re planning trial deployments with enterprise partners later this year. </p>

<p>We’re really excited about the progress we’re making with Project Starline, and the technology’s potential to solve the important problem of wanting to be together with someone even when you physically can’t. We look forward to sharing more later this year. </p>

Project Starline: Feel like you're there, together

Future of video conferencing

Anand Malkari's ideas are part of this journey:

Related collections

Similar ideas