Re: GSoC: Photomontage and Panoram Stitching
Hi. Here is the proposal: http://www.google-melange.com/gsoc/proposal/review/google/gsoc2013/fm/10001 вторник, 30 апреля 2013 г., 2:54:43 UTC+4 пользователь Fedor Morozov написал:
Hello. My name is Fedor Morozov and I am a 2nd year computer science student in Moscow State University.
A few words about me: I specialize in computer vision and my recent projects include various vision tasks: car numbers recognition, road signs classification and some small tasks to get a hands-on experience with different techniques like SIFT, Hough transform etc. Last year I successfully participated in GSoC with an HDR imaging project, recently I've been working on implementing some HDR algorithms on GPU for Photorealistic Rendering course.
I usually use Matlab and C++ for imaging tasks, mostly because I am used to them and it is stated in the task. Nevertheless, I often use Python for scripting tasks, programming contests and children education, and it would be great for vision applications.
About the project: There are some very interesting ideas in the proposed list, but most of them are not big enough for gsoc. Since I believe that a project should be solid and complete, I would like to add some of these tools to scikit-image and combine them to an image stitching framework, that can serve as the main project goal, useful application and a showcase for the implemented features.
Let us assume that there is a set of images, that we want to combine into a panorama. First, we should extract local features (using STAR or other detector) and use them to properly place the images by estimating the transform model using methods like RANSAC or by using pyimreg. Then, graph-cut can be used to choose, where to cut, and the images can be finally blended, using simple laplacian pyramid approach or gradien domain fusion, that is akin to one of the coolest high dynamic range reduction algorithms.
This pipeline requires feature detection, image registration and graph-cut support.
What do you think about such project? I guess, it's rather ambitious, yet it is diverse, interesting and will keep me from slacking. If some of the mentioned ideas get separate projects, they can be adopted during summer.
I am sorry for writing so late, there were a few deadlines recently and I couldn't find courage to write a proposal. Qualification pull request is coming soon.
Thank you.
Hi Fedor, I plan to implement the STAR feature descriptor as mentioned in my proposal. Instead, it would be great if you could implement FASThttp://web.eecs.umich.edu/~silvio/teaching/EECS598_2010/slides/11_16_Hao.pdfcorner detector, which I could not cover in my proposal. Also, including a reference section in your proposal would be great and make it better for other community members to review it. I would also like to know how you intend to implement photo-stitching. Some of the references you can refer to for Photo-stitching : CV by Szeliski, Chap 6, Feature based Alignmenthttp://szeliski.org/Book/drafts/SzeliskiBook_20100903_draft.pdf and this paper Automatic Panoramic Image Stitching using Invariant Featureshttp://www.cs.bath.ac.uk/brown/papers/ijcv2007.pdf. The paper makes use of SIFT, which is patented as informed by Stefan and hence you might need to look for an alternate Invariant feature descriptor. Thank you. Regards, Ankit Agrawal, Communication and Signal Processing, IIT Bombay.
In case there already is a descriptor when I need it, I might spend more time on other parts of the framework. Anyway, I'll look into FAST and will try to work on it if time allows. Thanks for the advice about references, I thought them unnecessary since most of the mentioned algorithms speak for themselves, but I think I will add a list of articles soon. I had a very bad or no internet connection recently, so there was some mess instead of the message and I didn't notice it. I'll make the article list tomorrow. пятница, 3 мая 2013 г., 8:04:15 UTC+4 пользователь Ankit Agrawal написал:
Hi Fedor,
I plan to implement the STAR feature descriptor as mentioned in my proposal. Instead, it would be great if you could implement FASThttp://web.eecs.umich.edu/~silvio/teaching/EECS598_2010/slides/11_16_Hao.pdfcorner detector, which I could not cover in my proposal. Also, including a reference section in your proposal would be great and make it better for other community members to review it. I would also like to know how you intend to implement photo-stitching. Some of the references you can refer to for Photo-stitching : CV by Szeliski, Chap 6, Feature based Alignmenthttp://szeliski.org/Book/drafts/SzeliskiBook_20100903_draft.pdf and this paper Automatic Panoramic Image Stitching using Invariant Featureshttp://www.cs.bath.ac.uk/brown/papers/ijcv2007.pdf. The paper makes use of SIFT, which is patented as informed by Stefan and hence you might need to look for an alternate Invariant feature descriptor. Thank you.
Regards, Ankit Agrawal, Communication and Signal Processing, IIT Bombay.
participants (2)
-
Ankit Agrawal
-
Fedor Morozov