Sept. 14, 2009

http://searchengineland.com/bing-2-0-unveiled-visual-search-25703

Bing Visual Search lets searchers browse easily through a slick interface of “structured data sets from trusted partners” using Sliverlight technology.

http://www.vam.ac.uk/cis-online/

Date: Mon, 14 Sep 2009 18:54:50 +0100
From: Gail Durbin
Subject: V&A Beta Search the Collections

I am sorry if you have already seen this on the MCN site or a brief
reference on Twitter.

The V&A has launched a Beta version of Search the Collections where
wehave moved from 55,000 object records online to over a million.
The temporary address is www.vam.ac.uk/cis-online .
There is still a way to go but we would welcome comments and ways
to improve what we have there now.

The technical work for this has been done by Richard Morgan, the V&A web
technical manager, and his team and he will be able to answer any of the
more technical questions. Mark Hook on the content side has worked with
the designers, The Other Media, on the user interface. Our Collections
records staff under Heather Caven have done a lot of work preparing the
records to go live. The project has been about using what we already
had so it draws text from our collections information system and images
from the digital asset management system and aims to make the
presentation and functionality as user friendly as possible. We have
tried to make sure visitors see the best records first. And as
information is added to our records so the site will get better.

We are working on making the browse function smoother, introducing
text mining, making the mapping function work more accurately and adding
some less conventional options to the browse. There will be an API and
we hope to add an element of crowd sourcing. In the longer term there
will be saved searches, lightboxes and more linking, among other things,
but some of these items will have to wait until we have completed our
more general website redesign in the Autumn of 2010. For now it feels
like we have made a major digital leap forward which is good for
visitors and provides a foundation for many other web facilities.

Gail Durbin
Head of V&A Online

Work on Info. Retrieval by Rueger et al.:

• [2007,incollection] bibtex
  D. Heesch and S. Rüger, "Interaction Models and Relevance Feedback in Image Retrieval." , 2007, pp. 160-86.
  @InCollection{heesch-rueger-2007,
  author = {D. Heesch and S. R{\"u}ger},
  title = {Interaction Models and Relevance Feedback in Image Retrieval},
  year = {2007},
  pages = {160--86},
  chapter = 8, note = {in \cite{Zhang07}}
}
• [2007,book] bibtex
  Semantic-Based Visual Information Retrieval, Zhang, Y. -J., Ed., Hershey, PA: Idea Group Inc, 2007.
  @Book{Zhang07, editor = {Y.-J. Zhang},
  title = {Semantic-Based Visual Information Retrieval},
  publisher = {Idea Group Inc},
  year = {2007},
  address = {Hershey, PA},
  annote = {http://www.ee.tsinghua.edu.cn/~zhangyujin/3_6.htm}
}
• [2007,inproceedings] bibtex
  J. Magalhães and S. Rüger, "Information theoretic semantic multimedia indexing," in 6th ACM International Conference on Image and Video Retrieval (CIVR), Amsterdam, Holland, 2007, pp. 619-626.
  @InProceedings{Magalhaes07,
  author = {J. Magalh{\~a}es and S. R{\"u}ger},
  title = {Information theoretic semantic multimedia indexing},
  booktitle = {6th ACM International Conference on Image and Video Retrieval (CIVR)},
  pages = {619--626},
  year = {2007},
  address = {Amsterdam, Holland},
  month = {July},
  note = {Best paper award},
  annote = {http://portal.acm.org/citation.cfm?id=1282368}
}
• [2007,incollection] bibtex
  J. Magalhães and S. Rüger, "Semantic multimedia information analysis for retrieval applications." , 2007, pp. 334-54.
  @InCollection{magalhaes-rueger-chapter-2007,
  author = {J. Magalh{\~a}es and S. R{\"u}ger},
  title = {Semantic multimedia information analysis for retrieval applications},
  year = 2007, pages = {334--54},
  chapter = {16},
  note = {in \cite{Zhang06}}
}
• [2006,inproceedings] bibtex
  D. Heesch, A. Yavlinsky, and S. Rüger, "NN$^k$ networks and automated annotation for browsing large image collections from the world wide web," in ACM Multimedia, 2006.
  @InProceedings{Heesch06,
  author = {Daniel Heesch and Alexei Yavlinsky and Stefan R{\"u}ger},
  title = {{NN}$^k$ networks and automated annotation for browsing large image collections from the world wide web},
  booktitle = {ACM Multimedia},
  year = {2006},
  }
• [2005,inproceedings] bibtex
  D. Heesch and S. Rüger, "Image browsing: semantic analysis of NN$^k$ networks," in International Conference on Image and Video Retrieval (CIVR, Singapore, Jul 2005), 2005, pp. 609-618.
  @InProceedings{heesch-rueger-2005,
  author = {D Heesch and S R{\"u}ger},
  title = {Image browsing: semantic analysis of {NN}$^k$ networks},
  booktitle = {International Conference on Image and Video Retrieval (CIVR, Singapore, Jul 2005)},
  publisher = {Springer LNCS 3568},
  pages = {609--618},
  year = 2005, }
• [2005,inproceedings] bibtex
  B. Chawda, B. Craft, P. Cairns, S. Rüger, and D. Heesch, "Do Attractive Things Work Better? An Exploration of Search Tool Visualisations," in HCI, Edinburgh, UK, 2005, pp. 46-51.
  @InProceedings{chawda-etal-2005,
  author = {B. Chawda and B. Craft and P. Cairns and S. R\"uger and D. Heesch},
  title = {Do Attractive Things Work Better? {A}n Exploration of Search Tool Visualisations},
  booktitle = {HCI},
  volume = 2, pages = "46--51", year = 2005, address = {Edinburgh, UK},
  }
• [2005,article] bibtex
  P. Howarth and S. Rüger, "Robust texture features for still-image retrieval," IEE Proceedings on Vision, Image and Signal Processing, vol. 152, iss. 6, pp. 868-874, 2005.
  @Article{howarth-rueger-2005d,
  author = {P. Howarth and S. R\"{u}ger},
  title = {Robust texture features for still-image retrieval},
  journal = {IEE Proceedings on Vision, Image and Signal Processing},
  year = {2005},
  volume = {152},
  number = {6},
  pages = {868--874},
  month = {December},
  }
• [2004,inproceedings] bibtex
  D. Heesch, M. Pickering, P. Howarth, A. Yavlinsky, and S. Rüger, "Digital Library Access via Image Similarity Search," in Joint Conference on Digital Libraries (JCDL), Tucson, AZ, USA, 2004.
  @InProceedings{heesch-etal-2004a,
  author = {D Heesch and M Pickering and P Howarth and A Yavlinsky and S R{\"u}ger},
  title = {Digital Library Access via Image Similarity Search},
  booktitle = {Joint Conference on Digital Libraries (JCDL)},
  address = {Tucson, AZ, USA},
  year = 2004, month = {June},
  }
• [2004,inproceedings] bibtex
  D. Heesch, P. Howarth, J. Magalhães, A. May, M. Pickering, A. Yavlinsky, and S. Rüger, "Video retrieval using search and browsing," in TRECVID, Gaithersburg, USA, 2004, pp. 92-101.
  @InProceedings{heesch-etal-2004b,
  author = {D Heesch and P Howarth and J Magalh{\~a}es and A May and M Pickering and A Yavlinsky and S R{\"u}ger},
  title = {Video retrieval using search and browsing},
  booktitle = {TRECVID},
  year = 2004, pages = {92--101},
  address = {Gaithersburg, USA},
  month = {November},
  }
• [2004,inproceedings] bibtex
  D. Heesch and S. Rüger, "NN$^k$ networks for content based image retrieval," in 26th European Conference on IR Research (ECIR), 2004, pp. 253-266.
  @InProceedings{heesch-rueger-2004a,
  author = {D Heesch and S R{\"u}ger},
  title = {{NN}$^k$ networks for content based image retrieval},
  booktitle = {26th European Conference on IR Research (ECIR)},
  year = 2004, month = {April},
  pages = {253--266},
  publisher = {Springer, LNCS 2997},
  }

• More complete publications list.

Work on Info. Retrieval by others:

Work on Shape by Fol Leymarie et al.:

• [2009+,article] bibtex
  M. -C. Chang, F. F. Leymarie, and B. B. Kimia, "Surface Reconstruction from Point Clouds by Transforming the Medial Scaffold," CVIU: Computer Vision and Image Understanding, 2009+.
  @Article{Chang09Surf,
  author = {M.-C. Chang and F. F. Leymarie and B. B. Kimia},
  title = {Surface Reconstruction from Point Clouds by Transforming the Medial Scaffold},
  journal = {CVIU: Computer Vision and Image Understanding},
  year = {2009+},
  OPTvolume = {},
  OPTnumber = {},
  OPTpages = {},
  OPTmonth = {},
  note = {Special issue on new advances in 3-D imaging and modeling},
  annote = {http://www.elsevier.com/locate/cviu}
}
• [2008,incollection] bibtex
  F. F. Leymarie and B. B. Kimia, "From the Infinitely Large to the Infinitely Small," , Siddiqi, K. and Pizer, S. M., Eds., Springer, 2008, vol. 37, pp. 369-406.
  @InCollection{Leymarie08,
  author = {F. F. Leymarie and B. B. Kimia},
  title = {From the Infinitely Large to the Infinitely Small},
  booktitle = {Medial Representations --- Mathematics, Algorithms and Applications},
  pages = {369--406},
  publisher = {Springer},
  year = {2008},
  editor = {K. Siddiqi and S. M. Pizer},
  volume = {37},
  series = {Computational Imaging and Vision},
  chapter = {11},
  note = {http://www.springer.com/math/geometry/book/978-1-4020-8657-1},
  }
• [2007,incollection] bibtex
  F. F. Leymarie, "Thoughts on Shape," , Albertazzi, L., Ed., Amsterdam: John Benjamins, 2007, vol. 67, pp. 303-350.
  @InCollection{Leymarie07Thoughts,
  author = {Frederic F. Leymarie},
  title = {Thoughts on Shape},
  booktitle = {Visual Thought: The Depictive Space of the Mind},
  pages = {303--350},
  publisher = {John Benjamins},
  year = {2007},
  editor = {L. Albertazzi},
  volume = {67},
  series = {Advances in Consciousness Research},
  address = {Amsterdam},
  }
• [2007,article] bibtex
  F. F. Leymarie and B. B. Kimia, "The Medial Scaffold of 3D Unorganized Point Clouds," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 29, iss. 2, pp. 313-330, 2007.
  @Article{Leymarie07MS,
  author = {Frederic F. Leymarie and Benjamin B. Kimia},
  title = {The Medial Scaffold of {3D} Unorganized Point Clouds},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2007},
  volume = {29},
  number = {2},
  pages = {313--330},
  month = {February},
  }
• [2007,inproceedings] bibtex
  M. -C. Chang, F. F. Leymarie, and B. B. Kimia, "Surface Reconstruction from Point Clouds by Transforming the Medial Scaffold," in Proceedings of the 6th International Conference on 3-D Digital Imaging and Modeling (3DIM), Montreal, Canada, 2007, pp. 13-20.
  @InProceedings{Chang07,
  author = {M.-C. Chang and F. F. Leymarie and B. B. Kimia},
  title = {Surface Reconstruction from Point Clouds by Transforming the Medial Scaffold},
  booktitle = {Proceedings of the 6th International Conference on 3-D Digital Imaging and Modeling (3DIM)},
  pages = {13--20},
  year = {2007},
  editor = {G. Godin and others},
  address = {Montreal, Canada},
  month = {August},
  publisher = {IEEE Computer Society},
  }
• [2006,incollection] bibtex
  F. F. Leymarie, "Aesthetic Computing and Shape," , Fishwick, P., Ed., MIT Press, 2006, pp. 259-288.
  @InCollection{Leymarie06Aesthetics,
  author = {Frederic F. Leymarie},
  title = {Aesthetic Computing and Shape},
  chapter = {14},
  booktitle = {Aesthetic Computing},
  pages = {259--288},
  publisher = {MIT Press},
  year = {2006},
  editor = {P. Fishwick},
  series = {Leonardo Books},
  month = {April},
  }
• [2004,inproceedings] bibtex
  M. -C. Chang, F. F. Leymarie, and B. B. Kimia, "3D Shape Registration using Regularized Medial Scaffolds," in 2nd International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT), Thessaloniki, Greece, 2004, pp. 987-994.
  @InProceedings{Chang04,
  author = {M.-C. Chang and F.F. Leymarie and B.B. Kimia},
  title = {{3D} Shape Registration using Regularized Medial Scaffolds},
  booktitle = {2nd International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT)},
  pages = {987--994},
  year = {2004},
  address = {Thessaloniki, Greece},
  month = {September},
  publisher = {IEEE Computer Society},
  }
• [2004,inproceedings] bibtex
  F. F. Leymarie, B. B. Kimia, and P. J. Giblin, "Towards Surface Regularization via Medial Axis Transitions," in 17th International Conference on Pattern Recognition (ICPR'04), Cambridge, U.K., 2004, pp. 123-26.
  @InProceedings{Leymarie04,
  author = {F. F. Leymarie and B. B. Kimia and P. J. Giblin},
  title = {Towards Surface Regularization via Medial Axis Transitions},
  booktitle = {17th International Conference on Pattern Recognition (ICPR'04)},
  pages = {123--26},
  year = {2004},
  volume = {3},
  address = {Cambridge, U.K.},
  month = {August},
  }
• [2003,phdthesis] bibtex
  F. F. Leymarie, "Three-Dimensional Shape Representation via Shock Flows," PhD Thesis , Providence, RI, USA, 2003.
  @PhdThesis{Leymarie03PhD,
  author = {F. F. Leymarie},
  title = {Three-Dimensional Shape Representation via Shock Flows},
  school = {Brown University, Division of Engineering},
  year = {2003},
  address = {Providence, RI, USA},
  month = {May},
  note = {http://doc.gold.ac.uk/~ffl/phd/},
  }
• [2003,inproceedings] bibtex
  F. F. Leymarie and B. B. Kimia, "Computation of the Shock Scaffold for Unorganized Point Clouds in 3D," in Conference on Computer Vision and Pattern Recognition (CVPR'03), Madison, Wisconsin, USA, 2003, pp. 821-827.
  @InProceedings{Leymarie03CVPR,
  author = {F. F. Leymarie and B. B. Kimia},
  title = {Computation of the Shock Scaffold for Unorganized Point Clouds in {3D}},
  booktitle = {Conference on Computer Vision and Pattern Recognition (CVPR'03)},
  pages = {821--827},
  year = {2003},
  volume = {1},
  address = {Madison, Wisconsin, USA},
  month = {June},
  publisher = {IEEE Computer Society},
  }
• [2002,inproceedings] bibtex
  D. B. Cooper and others, "Bayesian Virtual Pot-Assembly from Fragments as Problems in Perceptual-Grouping and Geometric-Learning," in International Conference on Pattern Recognition (ICPR'02), Québec City, Canada, 2002, pp. 297-302.
  @InProceedings{Cooper02,
  author = {D. B. Cooper and others},
  title = {Bayesian Virtual Pot-Assembly from Fragments as Problems in Perceptual-Grouping and Geometric-Learning},
  booktitle = {International Conference on Pattern Recognition (ICPR'02)},
  pages = {297--302},
  year = {2002},
  volume = {3},
  address = {Québec City, Canada},
  month = {August},
  publisher = {IEEE Computer Society},
  }

• More complete publications list.

Work on Shape by others:

• [2008,article] bibtex
  Y. Liu and G. T. Toussaint, "A Tessellation-Transformation Method for Categorizing and Generating Geometric Textile Design Patterns," Design Principles and Practices: An International Journal, vol. 2, iss. 4, pp. 101-112, 2008.
  @Article{Liu08,
  author = {Yang Liu and Godfried T. Toussaint},
  title = {A Tessellation-Transformation Method for Categorizing and Generating Geometric Textile Design Patterns},
  journal = {Design Principles and Practices: An International Journal},
  year = {2008},
  volume = {2},
  number = {4},
  pages = {101--112},
  }
• [2008,inproceedings] bibtex
  M. Pauly, N. J. Mitra, J. Wallner, H. Pottmannv, and L. J. Guibas, "Discovering Structural Regularity in 3D Geometry," in Proceedings of SIGGRAPH, Los Angeles, USA, 2008.
  @InProceedings{Pauly08,
  author = {Mark Pauly and Niloy J. Mitra and Johannes Wallner and Helmut Pottmannv and Leonidas J. Guibas},
  title = {Discovering Structural Regularity in {3D} Geometry},
  booktitle = {Proceedings of SIGGRAPH},
  year = {2008},
  volume = {27},
  number = {3},
  address = {Los Angeles, USA},
  month = {August},
  publisher = {ACM},
  note = {http://doi.acm.org/10.1145/1360612.1360642},
  }
• [2007,inproceedings] bibtex
  J. Schietse, J. P. Eakins, and R. C. Veltkamp, "Practice and Challenges in Trademark Image Retrieval," in Proceedings of the 6th ACM International Conference on Image and Video Retrieval (CIVR), Amsterdam, The Netherlands, 2007, pp. 518-524.
  @InProceedings{Schietse07,
  author = {Jan Schietse and John P. Eakins and Remco C. Veltkamp},
  title = {Practice and Challenges in Trademark Image Retrieval},
  booktitle = {Proceedings of the 6th ACM International Conference on Image and Video Retrieval (CIVR)},
  pages = {518--524},
  year = {2007},
  address = {Amsterdam, The Netherlands},
  }
• [2004,article] bibtex
  T. Sebastian, P. Klein, and B. Kimia, "Recognition of Shapes by Editing their Shock Graphs," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, iss. 5, pp. 550-571, 2004.
  @Article{Sebastian:RecShape:PAMI:2004,
  author = {Thomas Sebastian and Philip Klein and Benjamin Kimia},
  title = {Recognition of Shapes by Editing their Shock Graphs},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2004},
  volume = 26, number = 5, pages = {550--571},
  month = {May},
  }
• [2003,article] bibtex
  B. B. Kimia, "On the Role of Medial Geometry in Human Vision," Journal of Physiology, vol. 97, iss. 2--3, pp. 155-190, 2003.
  @Article{Kimia03Role,
  author = {Benjamin B. Kimia},
  title = {On the Role of Medial Geometry in Human Vision},
  journal = {Journal of Physiology},
  year = {2003},
  volume = {97},
  number = {2--3},
  pages = {155--190},
  month = {March--May},
  }
• [2003,article] bibtex
  G. J. van Tonder and Y. Ejima, "Flexible Computation of Shape Symmetries Within the Maximal Disk Paradigm," IEEE Transactions on Systems, Man, and Cybernetics, Part B, vol. 33, iss. 3, pp. 535-540, 2003.
  @Article{vanTonder03HST,
  author = {Gert J. van Tonder and Yoshimichi Ejima},
  title = {Flexible Computation of Shape Symmetries Within the Maximal Disk Paradigm},
  journal = {IEEE Transactions on Systems, Man, and Cybernetics, Part B},
  year = {2003},
  volume = {33},
  number = {3},
  pages = {535--540},
  month = {June},
  }
• [2002,article] bibtex
  G. J. van Tonder, M. J. Lyons, and Y. Ejima, "Visual Structure of a Japanese Zen Garden," Nature, iss. 419, pp. 359-360, 2002.
  @Article{vanTonder02Nature,
  author = {Gert J. van Tonder and Michael J. Lyons and Yoshimichi Ejima},
  title = {Visual Structure of a {J}apanese {Z}en Garden},
  journal = {Nature},
  year = {2002},
  number = {419},
  pages = {359--360},
  month = {September},
  }
• [2001,article] bibtex
  H. Tek and B. B. Kimia, "Boundary Smoothing via Symmetry Transforms," Journal of Mathematical Imaging and Vision (JMIV), vol. 14, iss. 3, pp. 211-223, 2001.
  @Article{Tek01,
  author = {H. Tek and B. B. Kimia},
  title = {Boundary Smoothing via Symmetry Transforms},
  journal = {Journal of Mathematical Imaging and Vision (JMIV)},
  year = {2001},
  volume = {14},
  number = {3},
  pages = {211--223},
  month = {May},
  }
• [2001,book] bibtex
  M. Leyton, A Generative Theory of Shape, Springer-Verlag, 2001.
  @Book{Leyton01Generative,
  author = {Michael Leyton},
  title = {A Generative Theory of Shape},
  publisher = {Springer-Verlag},
  year = {2001},
  number = {LNCS 2145},
  series = {Lecture Notes in Computer Science},
  note = {http://link.springer.de/link/service/series/0558/tocs/t2145.htm},
  }
• [2000,article] bibtex
  G. J. van Tonder and Y. Ejima, "The Patchwork Engine: Image Segmentation from Image Symmetries," Neural Networks, vol. 13, iss. 3, pp. 291-303, 2000.
  @Article{vanTonder00Patchwork,
  author = {Gert J. van Tonder and Yoshimichi Ejima},
  title = {The Patchwork Engine: Image Segmentation from Image Symmetries},
  journal = {Neural Networks},
  year = {2000},
  volume = {13},
  number = {3},
  pages = {291--303},
  month = {April},
  }
• [1998,article] bibtex
  I. Kovacs, A. Feher, and B. Julesz, "Medial-point description of shape: A representation for action coding and its psychological correlates," Vision Research, vol. 38, pp. 2323-2333, 1998.
  @Article{Kovacs98,
  author = {Ilona Kovacs and Akos Feher and Bela Julesz},
  title = {Medial-point description of shape: A representation for action coding and its psychological correlates},
  journal = {Vision Research},
  year = {1998},
  volume = {38},
  pages = {2323--2333},
  }
• [1987,book] bibtex
  B. Grunbaum and G. C. Shephard, Tilings and Patterns, W. H. Freeman, 1987.
  @Book{Grunbaum87,
  author = {Bruno Grunbaum and G. C. Shephard},
  title = {Tilings and Patterns},
  publisher = {W. H. Freeman},
  year = {1987},
  }
• [1973,article] bibtex
  H. Blum, "Biological Shape and Visual Science," Journal of Theoretical Biology, vol. 38, pp. 205-287, 1973.
  @Article{Blum73,
  author = {Harry Blum},
  title = {Biological Shape and Visual Science},
  year = 1973, journal = {Journal of Theoretical Biology},
  volume = 38, pages = {205--287}
}

ImageClef: cross-language image retrieval track : www.imageclef.org

TREC Video Retrieval Evaluation : www-nlpir.nist.gov/projects/trecvid/

Aluka: online digital library of scholarly resources from and about Africa: www.aluka.org

Botany @ the NHM: www.nhm.ac.uk/botany

EDIT: European Distributed Institute of Taxonomy: www.e-taxonomy.eu

EOL: Encyclopedia Of Life: www.eol.org

LAPI: Latin America Plant Initiative: www.huh.harvard.edu/collections/lapi.html

NBN: The UK National Biodiversity Network: www.nbn.org.uk

OPAL: Open Air Laboratory Network: www.nhm.ac.uk/nature-online/british-natural-history/opal/

SYNTHESIS: Synthesis of Systematic Resources: www.synthesys.info

An example of the use of ideal graph targets in characterising patterns found in the CHHRCT collection.

IGRAB: 2D shock graph on lace

The main goal of this project is to study the problems involved in populating large DB of digitised objects (image, text, possibly sound) coming from collections, and producing powerful interactive means of indexing these. In particular, we focus on:

• shape representation via symmetry structures (shock graphs, scaffolds)
• pattern matching and language for dynamic shape and images/video
• multimedia management and access inclusive of content-based visual search
• semantic gap and polysemy
• lateral browsing, clustering and information navigation
• sketching and polyphonic-music retrieval modalities