Aiming at the disadvantage of traditional analog monitor, a mine video surveillance system is designed based on S3C6410 hardware platform, Linux 2.6 software platform, H.264 coding and WIFI wireless. For the background is essentially the same, this paper use of H.264 sigle Gaussian moving image compression algorithm and proposed the code optimization methods. And proposed the scheme of system software. Finally, through the PSNR, compression ratio, compression time and rate to verify the algorithm. The experimental results show:This system can realize better quality of image on lower speed, has higher coding rate and can satisfy the real time encoding demand.