Abstract: The most common joint disorder, due to aging, wear and tear on a joint is Osteoarthritis (OA). Computer-aided diagnosis system is able to detect the osteoarthritis so that proper treatment options can be considered. In this study, a novel classification system for the classification of OA in knee X-ray images based on Local Binary Pattern (LBP) is presented. The classification is achieved by extracting the histograms of LBP of the knee x-ray image. The performance of the proposed system is analyzed by nearest neighbor classifier using 50 knee X-ray images. The proposed method predicts normal or abnormal knee X-ray image with 95.24% maximum accuracy and medium or worst cases with 97.37% maximum accuracy. Experimental results show that the proposed system could assist radiologists to detect OA earlier and faster.