Adobe updates to Premiere Pro and After Effects – improved text-based editing, improved speech, and a true 3D workspace

Adobe updates to Premiere Pro and After Effects – improved text-based editing, improved speech, and a true 3D workspace

Adobe updates to Premiere Pro and After Effects – improved text-based editing, improved speech, and a true 3D workspace

At IBC 2023 in Amsterdam, Adobe announced quite a few software improvements and new features that are already available in beta. This includes multiple AI workflows in Premiere Pro, new camera-to-cloud connections in Frame.io, and the first true 3D motion graphics workspace in After Effects. Let’s take a more detailed look at Adobe’s updates for filmmakers below!

As the company claims, AI and 3D innovations across its suite of video and audio applications should simplify and accelerate various workflows. Some of these improvements are user requested.

Adobe’s top priority is to provide powerful tools designed with the editor in mind. This year, the Adobe Creative Cloud video team spoke with… More than 1000 professional editors for comments – many of which have been incorporated into today’s release.

From the official blog announcement

Improved text-based editing in Premiere Pro

You’re probably familiar with this AI tool that Adobe integrated into its editing software in May. (If not, we wrote about that in detail here.) Essentially, it allows users to use automatic audio transcription to perform simple copy-and-paste text-based editing. This feature works in 18 different languages, and does so with great success.

What’s new here is the discovery of the filler word. From now on, the AI ​​can identify “uhs”, “ums” and very long pauses (you can choose the length yourself) in dialogue, and delete them all with one click.

Adobe updates for filmmakers – improved text-based editing
Filler word detection. Image source: Adobe

Adobe updates for filmmakers – speech improvement

Another AI tool that has performed so well that it must go inside Adobe applications is speech enhancement. You may have experienced it on Adobe Podcast, or read about it in our Audio AI Toolkit. This feature, based on the company’s neural network called Sensei, helps turn a poor-quality audio track (whether because of the wrong microphone placement, poor location choice, or because it’s from the archive) into a studio-like recording. Starting with the new beta version of the software, you can use this tool directly in Premiere Pro in the Essential Sound panel. Here’s a brief overview of how it works:

A real 3D workspace for motion graphics in After Effects

Well, this sounds like a huge improvement! For the first time in Adobe history, you can import 3D models directly into the After Effects workspace without plug-ins or software, as well as animate, light, shade, and render them. What’s more, you can combine 2D and 3D motion graphics into one unified composition. Another feature introduced here is image-based lighting, which means you can use HDR images as a light source, making objects appear as if they naturally belong to the scene.

Adobe updates for filmmakers - 3D Workspace in After Effects
Image source: Adobe

AI roto brush

Another announced improvement for After Effects that could save VFX artists hours of tedious rotoscoping work is the improved Roto Brush, which uses a deep learning model trained on frame-by-frame manual rotoscoping (made by humans, of course). The developers promise that this feature will also do a much better job when it comes to objects that are difficult to rotate, such as hair, overlapping limbs, or transparent items. In the following demo, you can see how the AI ​​brush works:

Comparison Viewer in Frame.io

Frame.io has also gone through several iterations in preparation for the IBC offering. First, Adobe has updated its review and approval tools for creators who work with a wide range of assets and need to compare them. Now, Frame.io’s comparison viewer supports displaying two video, audio, image, design, and even PDF assets side by side. This way, you can compare and annotate not only different versions of a particular video, but also choose to view selected files customarily.

Adobe updates for filmmakers - view comparison at frame.io
Image source: Adobe

Extended communications from camera to cloud

Camera-to-cloud connections allow video teams to transfer their footage to Frame.io directly after each take. This feature is already supported in more than 200 camera systems, and in this release, Adobe has announced five additional ways to connect your production to the cloud, such as:

  • ProRes RAW and 10-bit 4K workflow with Atomos Ninja and Ninja Ultra.
  • 102MP RAW shooting + 8K video with the Fujifilm GFX-100ii.
  • C2C with any camcorder on Accsoon Seemo and Seemo Pro.

If you want to read more specifically about Frame.io updates, head over to their blog.

Adobe update for filmmakers – new camera-to-cloud connections
Image source: Adobe

Other Adobe updates for filmmakers

Of course, these are just the major updates that Adobe has prepared for its users this fall. Among other announcements and improvements are Premiere Pro timeline performance, which is 5x faster, an all-new color settings panel with 3 new automatic tone mapping methods, Frame.io storage connection, a high-performance GPU-accelerated engine in After Effects, etc. and so on. To see the full list, please check the official Adobe blog. All the mentioned features are already available in the beta version, so you can try it out for yourself. There is no specific date for when it will be released publicly, but the company has promised to launch it later this fall.

What do you think of Adobe’s updates for filmmakers? Anything in particular you want to test right away? What feature or improvement is still missing, in your opinion? We will be happy to read your opinions in the comments section below.

Featured images source: Adobe

You may also like...

Leave a Reply

Your email address will not be published. Required fields are marked *