VideoTrace is a system for interactively generating realistic 3D models of objects from video—models that might be inserted into a video game, a simulation environment, or another video sequence. The user interacts with VideoTrace by tracing the shape of the object to be modelled over one or more frames of the video. By interpreting the sketch drawn by the user in light of 3D information obtained from computer vision techniques, a small number of simple 2D interactions can be used to generate a realistic 3D model. Each of the sketching operations in VideoTrace provides an intuitive and powerful means of modelling shape from video, and executes quickly enough to be used interactively. Immediate feedback allows the user to model rapidly those parts of the scene which are of interest and to the level of detail required. The combination of automated and manual reconstruction allows VideoTrace to model parts of the scene not visible, and to succeed in cases where purely automated approaches would fail.
Videotrace is being commercialised by a company called Punchcard. Punchcard are currently running a free beta testing program, so go to www.punchcard.com.au to sign up if you’d like to give it a try.
The Siggraph paper describing VideoTrace is available here, the Youtube video is below, and there’s a Google Tech Talk about the program and the project here.
Hello
I’ve discovered your very innovative application via google. I would love to use it to model the building I work in. It would appear that the project has been taken off the web, i.e. beta testing. Is there any way I could test or purchase the software?
Regards
Ravi Gajjar
Hi Ravi
I’m glad you like it. You can sign up as a beta tester for Videotrace and receive a free copy at http://www.punchcard.com.au.
Cheers
Anton
haw you download dis program tell me plz
You can sign up as a beta tester for Videotrace and receive a free copy at http://www.punchcard.com.au.
Cheers
Anton
i like it very much plz also add me to beta tester
Hi Naeem,
You need to go to http://www.punchcard.com.au
Cheers
Anton
What were the dozens of blue dots and crosses seen in the footage of the truck and opera house? Are they reference points that help the program compare one frame of the video to another? Do they have to be added manually?
Yes, they’re the features that are tracked through the video
Anton
It has a few glitches but is primarily great.
I laughed very loudly when I saw ‘University of Adelaide”.
Very cool, I want to know more.
Thanks for posting.
This is so awesome. I can’t wait for my free copy!
But I subscribed to the site and I got a verification e-mail and all but it’s been 3 days and I didn’t get my free beta copy yet. How long do I wait?
very cool software guys, I can see this being great for some fast SFX creation. Can’t wait to see how it develops!
Hello , I love this software and I want for me but subscribed to the site and I got a verification e-mail and all but it’s been 3 days and I didn’t get my free beta copy yet. How long do I wait? (Sorry for my bad english I am french )
Hi Kévin,
The new beta is about to be released so it is taking a little longer than normal to get the software out to people.
Thanks for your patience, and it won’t be long.
im a multimedia & graphical designer
i work with 3dsmax,maya i like this software very much
im interested in help developing it
regards
shylesh
I got the response that i am able to download the new beta version, but there is no download link in the mail. Could you check that please? It only says “you can download the software from the same location as before”. But since i’m new at this, i dont know where “before” is. Thanks in advance
Is it working on Linux (at least on Fedora Core 14 64bit)?
Regards.
Yes, Windows Mac and Linux
howdy signed up on friday just wanted to say i hope i get a chance to have a try with this brilliant program i signed up for the last beta but never recived a email saying how to download it
hello,could you send the lastest version to me?
Sign up for the beta at http://www.punchcard.com.au
I cannot import boujou into the software, just “Failed to load requsted video sequence.”
Boujou import should work, but leave a comment at http://www.punchcard.com.au to get one of teh developers to help you with it.
hiya im a dj/vj i work lots with vj, video & 3d softwares as beta tester & can contribute a lot to testing your software & i can contribute a lot of knowledge & input i can also help with free advertisement on various vj forums & video editing forums & give this software the recognition it deserves. is there any news on the release date of this software yet please consider me for the beta testing program
Hi Robert
Sign up for the beta test at http://www.punchcard.com.au and let us know what you think.
This software is fantastic. I’m a Cinematographer, editor, and graphic designer in Los Angeles and this could be very useful. i’m very interested in beta testing this. i already signed up. interested in seeing the workflow to other software. this plus cinema 4D and after effects could make a very powerful, yet cost effective option for Special Effects and Graphics.
Thanks Remond, I’m glad you like it.
We think it has a lot of potential, but it’s still in early beta at the moment, so let us know what you think needs work and we’ll add it to the list.
Is the software beta available for anyone or is it for people in a particular field that would benefit from such program?
The beta is available to anyone. We think there are too many fields that could benefit from Videotrace to specify, so there are no restrictions.
Wow, amazing software. this will be really useful for people that are not very good at modelling in blender, 3ds Max etc, like me :S
where do i sing up
http://www.punchcard.com.au
Hi Anton, WOW!!! this is mind blowing!!!
I use SketchUp daily for 3D modelling in Architecture and can see some real synergies with Photo Trace.
I am about to post on our forum [www.sketchucation.com]to show everybody around the world what you guys are doing.
Well done, will download a trial ASAP! Great to see this technology coming out of OZ….
Regards,
Andrew
Thanks Andrew, much appreciated.
Let us know how you go with the software, we’re really keen to get the feedback we need to continue improving it.
Cheers
Anton
I am assuming that, as I have waited over two weeks for notification, that I am to be refused beta teting facilities. If so please be polite enough to tell me and if not let me know.
Hi Trevor
There is a new version coming out so there has been a bit of a delay.
And I would have thought that the polite place for such messages would be the forum on the web site of the company where you signed up for the beta, but maybe that’s just me.
Absolutely 100% correct but Punch Card will not allow me to do that. I keep getting replies from something called Wufoo saying you are talking to a machine. I am sorry if my assumption that the purvayors of your software were connected to you and that this website was my only access. However, thank you for your reply, I will look forward to seeing what happens.
Regards
Trevor
I’ve just had a text from my son. He applied for a beta test download on Saturday 20th August, having heard of my trouble, and he is now using the program. So I’m confused.
Are you aware of Autodesk Photo Scene Editor?
Yes, and it’s fantastic technology.
What we are expecting, however, is that once people have started generating models from photographs they’ll realise that they want to have some control over the mesh. The Autodesk solution is that you edit the mesh in 3DSMax or similar, but most people don’t have the software or know how to use it. There’s also the problem that this process only allows you to edit the mesh you’ve got, rather than create the mesh you wanted from the photos.
Videotrace is interactive, which means you can get the mesh you want, rather than the mesh you are given. It also allows you to generate low polygon count models, which is exactly what you want if you’re hoping to put your models into a game, or a simulation environment (like google earth).
We’re currently looking at whether it makes sense to use Videotrace as a model editor for Autodesk Photo Scene editor models, so you could edit their models to get the model you wanted in the first place.
This is a badass SW. way to go guys!!!
This really is the info I need to. Thank you for writing this posting.
What are the system requirments for this software?
You really need to ask questions like this at the Punchcard web site, but it runs on Linux, Mac and Windows.
It runs on Mac, Windows and Linux, and although it doesn’t need particularly advanced hardware, it’s unlikely to run too well on a netbook.
I was wondering if there is a way to use this with a series of still photos rather that actual video. I understand it works by calibrating a video sequence, but the Copenhagen example seems to be a single image. Is there a way to do it with a collection of stills taken from different vantage points of a building? I am a beta tester and cant get past the calibration phase. THANKS!
Hi Colin,
We’re working on calibrating from image sets at the moment, but it’s a substantial change and is taking a while to complete.
Watch the Punchcard website for updates
Hi
It is interesting. I would like use this method for medical image processing. Do you have any suggestion for me to start?
Thanks in advance,
Farshid
It’s an interesting idea, but I’m afraid we haven’t really been working in that direction.
We’d have to find a way to estimate the camera parameters for medical scans. I’m sure the scanners provide that information, but we’d need to get it into Videotrace in a form we could use.
Let us know if you have any great ideas.
Hi everybody,
It seems like Autodesk has done it:
http://www.123dapp.com/catch
Enjoy!
Hi Lernsky
I think the Autodesk 123D gear is great, but I suggest you really give it a go before you get too enthusiastic about it.
It generates high polygon count models of only what you can see, which is very different to the Videotrace approach where you get only the polygons you want, even of bits of the object that you can’t see in the image set.
They are different approaches for different purposes.
Hi Anton,
Thanks for your reply.
I agree these are two different approaches. But the idea that this technology will find its way into consumer electronics stuck in my head. I think future mobile devices could do the job, irrepsective of high polygon counts. Recording a 3D scene with a move of my hand would be awesome.
Even if user assisted processing has its advantages I would say that in the long term machines should be using this and will be able to truly recognize things. I mean, humans do it
123D Catch isn’t quite flawless, but if you keep it simple you can achieve amazing results. Also, with this, a simple camera can replace a 3D laser scanner or a similar system.
Staying tuned & best regards,
Lernsky
[...] http://www.acvt.com.au/research/structure-from-image-sets/videotrace Tags: 3d, crea, filmati, Semplice, VideoTrace [...]
[...] Video Trace (Looking into this, post coming soon) [...]
Yes, from whole surf.. now i need your program..
Literally just stumbled on this program (stumbleupon). Hoping to tie it in with Cinema 4d and After Effects. Will definitely be a buyer if the price is right.
The price is hard to beat!
Hi guys,
I have a question on videotrace: Is it possible to import the PTAM camera move which is expressed in .XML file?
Did anyone try that?
Didier