VideoTrace is a system for interactively generating realistic 3D models of objects from video—models that might be inserted into a video game, a simulation environment, or another video sequence. The user interacts with VideoTrace by tracing the shape of the object to be modelled over one or more frames of the video. By interpreting the sketch drawn by the user in light of 3D information obtained from computer vision techniques, a small number of simple 2D interactions can be used to generate a realistic 3D model. Each of the sketching operations in VideoTrace provides an intuitive and powerful means of modelling shape from video, and executes quickly enough to be used interactively. Immediate feedback allows the user to model rapidly those parts of the scene which are of interest and to the level of detail required. The combination of automated and manual reconstruction allows VideoTrace to model parts of the scene not visible, and to succeed in cases where purely automated approaches would fail.

Videotrace is being commercialised by a company called Punchcard.  Punchcard are currently running a free beta testing program, so go to www.punchcard.com.au to sign up if you’d like to give it a try.

The Siggraph paper describing VideoTrace is available here, the Youtube video is below, and there’s a Google Tech Talk about the program and the project here.

Videotrace patent accepted

Anton : May 24, 2013 2:07 pm : Commercialisation, Publications, Videotrace

One of the Videotrace patent applications has just been accepted by IP Australia.

It’s Patent Number 2007202157

ABSTRACT A method for generating a three dimensional (3D) model of an object is depicted in a two dimensional (2D) image is disclosed, The 2D image includes associated 3D information. The method includes an operator determining a geometric primitive corresponding to shape characteristics of the object and then the generation of the 3D model based on the determined geometric primitive, the 2D image, and the associated 3D information.

 

Leave a response »

Videotrace for Sketchfab

Anton : May 23, 2012 4:09 pm : Videotrace

We’ve loaded some Videotrace models on Sketchfab, a new 3D model sharing web site, which means you can embed them in web pages:

Click on the model above to spin it around.

Leave a response »

3D User-Created Content in Saarbruecken

Anton : September 16, 2010 4:44 pm : Augmented Reality, Research, Videotrace

Well actually Anton van den Hengel gave a talk at the Max Planck Center for Visual Computing and Communication in Saarbreuken (Germany) about 3D User-Created Content (3DUCC).   Anton was in Saarbrueken visiting the Computer Graphics Department of Max-Planck-Institut für Informatik there, and particularly the group of Dr. Thorsten Thormaehlen.  Thorsten was instrumental in the development of Videotrace while doing a post-doc in Adelaide.

The talk followed the theme being developed on Anton’s blog, that 3DUCC tools are critical to the success of current and future explorations into 3D content delivery.  Effectively the message is that having the content delivery technologies sorted out doesn’t help much if there’s no way to creat the content to send.  The list of 3D systems that have failed to meet their full potential due to the lack of 3DUCC tools continues to grow (VRML, SGI, Google Earth, Second Life, VR Caves, and so many more).    The next big one seems to be 3DTV, which seems bound to follow the same path unless better content creation tools can be developed quickly.

Leave a response »

Videotrace wins at iAwards

Anton : August 20, 2010 10:31 pm : Commercialisation, Videotrace

Videotrace and Punchcard, the company commercialising it won the Research and Development category of this year’s South Australian iAwards.

iAwards Winner Logo

The iAwards are Australia’s premier technology innovation awards program.  The Australian Information Industry Association (AIIA) has hosted the awards for 16 years, with this year’s awards sponsored by Fujitsu, KPMG, IBM, and Microsoft, amongst others.

Leave a response »

Videotrace in Tech23

Anton : July 20, 2010 10:38 pm : Commercialisation, Videotrace

Punchard, the company commercialising Videotrace, has been selected as one of the 23 ICT companies to participate in this year’s Tech23 event.

Tech23 is run by Slattery IT, and offers 23 of Australia’s most innovative companies a five-minute time-slot to show off their business model to an audience of 400+ potential investors, mentors, entrepreneurs and customers.

3 Comments »
« Page 1, 2»
 

69 Responses to Videotrace

  1. Ravi Gajjar says:

    Hello
    I’ve discovered your very innovative application via google. I would love to use it to model the building I work in. It would appear that the project has been taken off the web, i.e. beta testing. Is there any way I could test or purchase the software?
    Regards
    Ravi Gajjar

  2. Anton says:

    Hi Ravi

    I’m glad you like it. You can sign up as a beta tester for Videotrace and receive a free copy at http://www.punchcard.com.au.

    Cheers

    Anton

  3. habib says:

    haw you download dis program tell me plz

  4. naeem says:

    i like it very much plz also add me to beta tester

  5. Raphael Kargon says:

    What were the dozens of blue dots and crosses seen in the footage of the truck and opera house? Are they reference points that help the program compare one frame of the video to another? Do they have to be added manually?

  6. Jonathan says:

    It has a few glitches but is primarily great.

  7. Cliquein says:

    I laughed very loudly when I saw ‘University of Adelaide”.

    Very cool, I want to know more.

    Thanks for posting.

  8. Dodo says:

    This is so awesome. I can’t wait for my free copy!

    But I subscribed to the site and I got a verification e-mail and all but it’s been 3 days and I didn’t get my free beta copy yet. How long do I wait? :(

  9. very cool software guys, I can see this being great for some fast SFX creation. Can’t wait to see how it develops!

  10. Kévin says:

    Hello , I love this software and I want for me but subscribed to the site and I got a verification e-mail and all but it’s been 3 days and I didn’t get my free beta copy yet. How long do I wait? (Sorry for my bad english I am french )

    • Anton says:

      Hi Kévin,

      The new beta is about to be released so it is taking a little longer than normal to get the software out to people.

      Thanks for your patience, and it won’t be long.

  11. shylesh says:

    im a multimedia & graphical designer
    i work with 3dsmax,maya i like this software very much
    im interested in help developing it

    regards
    shylesh

  12. Luis says:

    I got the response that i am able to download the new beta version, but there is no download link in the mail. Could you check that please? It only says “you can download the software from the same location as before”. But since i’m new at this, i dont know where “before” is. Thanks in advance

  13. jisaac says:

    Is it working on Linux (at least on Fedora Core 14 64bit)?

    Regards.

  14. Toby says:

    howdy signed up on friday just wanted to say i hope i get a chance to have a try with this brilliant program i signed up for the last beta but never recived a email saying how to download it

  15. sungang says:

    hello,could you send the lastest version to me?

  16. sungang says:

    I cannot import boujou into the software, just “Failed to load requsted video sequence.”

  17. robert says:

    hiya im a dj/vj i work lots with vj, video & 3d softwares as beta tester & can contribute a lot to testing your software & i can contribute a lot of knowledge & input i can also help with free advertisement on various vj forums & video editing forums & give this software the recognition it deserves. is there any news on the release date of this software yet please consider me for the beta testing program

  18. Remond Francois says:

    This software is fantastic. I’m a Cinematographer, editor, and graphic designer in Los Angeles and this could be very useful. i’m very interested in beta testing this. i already signed up. interested in seeing the workflow to other software. this plus cinema 4D and after effects could make a very powerful, yet cost effective option for Special Effects and Graphics.

    • Anton says:

      Thanks Remond, I’m glad you like it.

      We think it has a lot of potential, but it’s still in early beta at the moment, so let us know what you think needs work and we’ll add it to the list.

  19. Devan says:

    Is the software beta available for anyone or is it for people in a particular field that would benefit from such program?

    • Anton says:

      The beta is available to anyone. We think there are too many fields that could benefit from Videotrace to specify, so there are no restrictions.

  20. Alex says:

    Wow, amazing software. this will be really useful for people that are not very good at modelling in blender, 3ds Max etc, like me :S

  21. Joron Kydd says:

    where do i sing up

  22. Hi Anton, WOW!!! this is mind blowing!!!
    I use SketchUp daily for 3D modelling in Architecture and can see some real synergies with Photo Trace.
    I am about to post on our forum [www.sketchucation.com]to show everybody around the world what you guys are doing.

    Well done, will download a trial ASAP! Great to see this technology coming out of OZ….
    Regards,
    Andrew

    • Anton says:

      Thanks Andrew, much appreciated.

      Let us know how you go with the software, we’re really keen to get the feedback we need to continue improving it.

      Cheers

      Anton

  23. T.M. Lyde says:

    I am assuming that, as I have waited over two weeks for notification, that I am to be refused beta teting facilities. If so please be polite enough to tell me and if not let me know.

    • Anton says:

      Hi Trevor

      There is a new version coming out so there has been a bit of a delay.

      And I would have thought that the polite place for such messages would be the forum on the web site of the company where you signed up for the beta, but maybe that’s just me.

      • T.M. Lyde says:

        Absolutely 100% correct but Punch Card will not allow me to do that. I keep getting replies from something called Wufoo saying you are talking to a machine. I am sorry if my assumption that the purvayors of your software were connected to you and that this website was my only access. However, thank you for your reply, I will look forward to seeing what happens.

        Regards

        Trevor

  24. T.M. Lyde says:

    I’ve just had a text from my son. He applied for a beta test download on Saturday 20th August, having heard of my trouble, and he is now using the program. So I’m confused.

  25. MTB says:

    Are you aware of Autodesk Photo Scene Editor?

    • Anton says:

      Yes, and it’s fantastic technology.

      What we are expecting, however, is that once people have started generating models from photographs they’ll realise that they want to have some control over the mesh. The Autodesk solution is that you edit the mesh in 3DSMax or similar, but most people don’t have the software or know how to use it. There’s also the problem that this process only allows you to edit the mesh you’ve got, rather than create the mesh you wanted from the photos.

      Videotrace is interactive, which means you can get the mesh you want, rather than the mesh you are given. It also allows you to generate low polygon count models, which is exactly what you want if you’re hoping to put your models into a game, or a simulation environment (like google earth).

      We’re currently looking at whether it makes sense to use Videotrace as a model editor for Autodesk Photo Scene editor models, so you could edit their models to get the model you wanted in the first place.

  26. Trabzonlu Temel says:

    This is a badass SW. way to go guys!!!

  27. Bowen says:

    This really is the info I need to. Thank you for writing this posting.

  28. Andrew says:

    What are the system requirments for this software?

  29. Colin says:

    I was wondering if there is a way to use this with a series of still photos rather that actual video. I understand it works by calibrating a video sequence, but the Copenhagen example seems to be a single image. Is there a way to do it with a collection of stills taken from different vantage points of a building? I am a beta tester and cant get past the calibration phase. THANKS!

    • Anton says:

      Hi Colin,

      We’re working on calibrating from image sets at the moment, but it’s a substantial change and is taking a while to complete.

      Watch the Punchcard website for updates

  30. Farshid says:

    Hi
    It is interesting. I would like use this method for medical image processing. Do you have any suggestion for me to start?
    Thanks in advance,
    Farshid

    • Anton says:

      It’s an interesting idea, but I’m afraid we haven’t really been working in that direction.

      We’d have to find a way to estimate the camera parameters for medical scans. I’m sure the scanners provide that information, but we’d need to get it into Videotrace in a form we could use.

      Let us know if you have any great ideas.

  31. Lernsky says:

    Hi everybody,

    It seems like Autodesk has done it:

    http://www.123dapp.com/catch

    Enjoy!

    • Anton says:

      Hi Lernsky

      I think the Autodesk 123D gear is great, but I suggest you really give it a go before you get too enthusiastic about it.

      It generates high polygon count models of only what you can see, which is very different to the Videotrace approach where you get only the polygons you want, even of bits of the object that you can’t see in the image set.

      They are different approaches for different purposes.

      • Lernsky says:

        Hi Anton,

        Thanks for your reply.

        I agree these are two different approaches. But the idea that this technology will find its way into consumer electronics stuck in my head. I think future mobile devices could do the job, irrepsective of high polygon counts. Recording a 3D scene with a move of my hand would be awesome.

        Even if user assisted processing has its advantages I would say that in the long term machines should be using this and will be able to truly recognize things. I mean, humans do it :)

        123D Catch isn’t quite flawless, but if you keep it simple you can achieve amazing results. Also, with this, a simple camera can replace a 3D laser scanner or a similar system.

        Staying tuned & best regards,
        Lernsky

  32. [...] Video Trace (Looking into this, post coming soon) [...]

  33. Jack Holmes says:

    Yes, from whole surf.. now i need your program..

  34. ray smith says:

    Literally just stumbled on this program (stumbleupon). Hoping to tie it in with Cinema 4d and After Effects. Will definitely be a buyer if the price is right.

  35. didier muanza says:

    Hi guys,
    I have a question on videotrace: Is it possible to import the PTAM camera move which is expressed in .XML file?
    Did anyone try that?

    Didier

  36. gabriel says:

    I have a question.

    Can interact with the objects that get the video?
    I need to do a game.

    thanks

  37. suraj says:

    nice softwre

  38. Aljon says:

    how nice! this is the first 2d video tracer to make a great 3d.

  39. Aljon says:

    i suggest that this program may have a spherical edge to make spherical object easily.

  40. Wendy Vainickis says:

    lol! I asked about this a year ago at least, did it ever eventuate? Been playing with Autodesk 123Dcatch which when it works is quite good, pity an Adelaide company likevyourscould not have got on with developing this technology sooner as could have put us on the global map.

  41. deng says:

    HOW CAN I GET A TEST VERSION?

  42. josewa says:

    I want a copy, I have requested the report and did not respond, kindly give it to me or at least answer me.

    Thank you very much for your attention

  43. reasey says:

    i want to know what program to make like this?

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>