This publication contains three new datasets for scene-level sketch semantic segmentation task, namely SKY-Scene, TUB-Scene, and Freehand-Scene. SKY-Scene and TUB-Scene are synthetic datasets, where the scene layout templates were extracted from dataset SketchyScene, and the object components were adopted from dataset Sketchy. They are composed to include more sketch-specific characteristics, e.g., sparsity, abstractness, and diversity, to truly evaluate segmentation performance. Freehand-Scene are fifty real human-drawn scene sketches for practical test.