As large amplitude hand movements are often involved in the machine vision-based gesture interaction,aproper control-display mapping relationship is necessary for users to complete interaction tasks in a comfortablemotion range.In this paper,an adaptive adjustment method of the control-display mapping relationship is proposedaccording to user's interaction features based on a psychological experiment.A Borg's CR-10 scale experiment isemployed to test user's perception of the hand movement velocity,and a mapping equation based on a velocityorientedtechnique is revised according to ergonomics.Then,according to user's hand movement amplitude,themapping equation is adjusted after each continuous interaction.Moreover,a user test system based on Kinect isestablished to test the performance of the proposed method.The results show that the proposed method can not onlyreduce the probability of large amplitude hand movements occurring but also keep user's performance stable.