Abstract: Digital image analysis of rice canopy has widely been used for monitoring rice growth, diagnosing rice nitrogen (N) content, controlling pests and predicting rice yield. But the accuracy, stability and reliability of digital image analysis of rice canopy has greatly relied on assumed segmentation precision of rice pixels. There is current a significant progress in auto-segmentation methods for plant images captured indoor or under controlled light conditions. However, it is still hard to segment images of rice canopy taken in outdoor environments with complex and changing illumination conditions. In this paper, we proposed a segmentation method for rice canopy images taken in outdoor environment that improves the accuracy and robustness of illumination of segmentation based on multi-color spaces and support vector machine (SVM) algorithm. The rice canopy images were taken using a digital camera (NikonD90, Nikon Inc., Tokyo, Japan) in August 11st to September 25th 2016 at the largest double-season rice production area in Pearl River Delta. The camera was mounted on a tripod at 1.5 m above rice canopy with straight downward looking posture. Three typical samples taken under different illumination conditions (which changed from sunny days to cloudy days and to overcast days) were treated as test images. The training data (including rice pixels and background pixels) for modeling the support vector machine classifier was randomly picked from the test images. The color features (r, g, b, L^*, a^*, b^*, H, S, V) defined in 3 ordinarily used color spaces (RGB, CIEL^*a^*b^* and HSV) of each pixel were calculated as training data. The SVM classifiers learned from the training data with the color features from RGB, CIEL^*a^*b^*, HSV and multi-color spaces (including RGB, CIEL^*a^*b^*, HSV) were defined as rgb-SVM, lab-SVM, hsv-SVM and Multi-SVM accordingly. The accuracy and robustness of the proposed methods were examined using the test images, which were next compared with ExG&Otsu (excess green index) performance. With the help of Photoshop image editing software, the ground-truth of the rice canopy images was labeled manually and treated as the reference for segmented error calculation, including false positive rate (the rate where segmentation algorithm falsely classed background pixels as rice pixels) and false negative rate (the rate that the segmented algorithm falsely classed the rice pixels as background pixels). The results showed that rgb-SVM algorithm performed better than ExG&Otsu algorithm. While segmentation errors of rgb-SVM algorithm for the images taken on overcast days and cloudy days were respectively 5.76% and 7.74%, that of rgb-SVM algorithm for the images taken on sunny days reached 16.99%. The accuracies of lab-SVM and hsv-SVM algorithms were unstable and high under-segmentation occurred under lab-SVM and hsv-SVM algorithms for images taken on cloudy days and sunny days. Multi-SVM algorithm had the best segmentation results, which were very close to ground-truth images. Specially, segmentation error of Multi-SVM algorithm for images taken on overcast days, cloudy days and sunny days were as low as 3.11%, 3.28% and 3.95%, respectively, which were lower than that for ExG&Otsu algorithm, especially for images taken on sunny days. The results showed that the accuracy of rice canopy extraction using Multi-SVM algorithm was significantly better than that using the other methods, particularly for images taken under high illumination conditions. The Multi-SVM algorithm based on multi-color spaces and support vector machine proposed in this paper accurately segmented and extracted rice pixels in rice canopy images. It was well-suited to the changing illumination in outdoor environment, thus providing valid data support for monitoring field rice growth under natural field conditions and automated rice farming.