The dataset, Pedestrians with IMU (Ped-IMU), contains pedestrians moving in different behaviors while carrying a wearable sensor. We use a smartphone mounted on a subject's waist as a wearable device and record the smartphone's accelerometer, gyroscope, and magnetometer readings. We invite ten subjects of ages 22-35 to perform walking around with 4 trajectories: Left-Turn Back (L-TB), Left-Go Straight (L-GS), Right-Turn Back (R-TB), and Right-Go Straight (R-GS). A camera is set with screen ratio 16:9, resolution 1920*1080 pixels, and 12 fps.