This thesis addresses the problem of content-based video indexing by motion. Our research works cover the 3 fundamental and challenging issues in content-based video indexing: video structure analysis, low-level feature index, high-level semantic description. First, we propose a new rapid shot boundary detection algorithm. The proposed First of all, I would like to express my profound gratitude to my supervisor, Dr. Deepu Raj an for his support since the beginning, and for his patience and guidance. I am especially grateful to Associate Professor Chia Liang-Tien, Clement for his supervision, guidance, friendship, and moral support. I regard myself fortunate to have him as my cosupervisor. Without their continuous encouragement and advice, I could never complete this thesis.