Gen-1: Structure and Content-Guided Video Synthesis with Diffusion Models
Deep neural networks for image and video synthesis are becoming increasingly precise, realistic and controllable. In a couple of years, we have gone from blurry low-resolution images to both highly realistic and aesthetic imagery allowing for the rise of synthetic media. Large language models and models with shared text-image latent spaces, such as CLIP, are now also enabling new ways of interacting with software and synthesizing media. Diffusion models are a prime example of the power of such approaches. Runway Research is at the forefront of these developments and we ensure that the future of content creation is both accessible, controllable and empowering for users. We believe that deep learning techniques applied to audiovisual content will forever change art, creativity, and design tools.
Key Benefits
We’re hiring for a variety of roles across research, engineering. We are based in New York, but welcome remote applications from everywhere.
Installation:
Download and install the Runway ML application from the official website.
Create an account on the Runwy ML website.
Launch Runway ML:
Open the Runway ML application on your computer.
Explore Models:
Once the application is open, you can explore the available models.
Models are categorized based on tasks such as image generation, text generation, style transfer, etc.
Select a Model:
Choose a model that suits your needs.
Configure Model:
Configure the model parameters, if necessary.
Some models may require additional input settings such as image size, style options, etc.
Run the Model:
After configuring the model, you can run it through the Runway ML interface.
Depending on the model, you may need to provide input data (e.g., an image for image generation).
Interact with the Model:
Explore the results and interact with the model in real-time.
Some models allow you to tweak parameters on the fly.
Export Results:
Save or export the results generated by the model.
Community and Documentation:
Check the Runway ML community forums and documentation for user-contributed models, tips, and troubleshooting.
Remember that the specific steps might vary based on the model you are using and the updates made to the Runway ML platform. Always refer to the official Runway ML documentation for the most accurate and current information.