Parallel data transfer integrity control method in large data environment
Author:
Affiliation:
Guangzhou institute of Technology,The department of information engineering,Guangzhou institute of Technology,The department of information engineering
Aiming at the problems of serious congestion, low data transmission rate and low data integrity in the process of parallel data transmission, a method of integrity control for parallel data transmission in large data environment is proposed. Based on the principle of integrity control of parallel data transmission, two interference factors of parallel data acquisition and transmission congestion measurement in transmission are analyzed. Reference single service window mixed queuing model and method were pre control of single node and parallel data transmission rate, using data flow priority to realize parallel data transmission method of complete control. The experimental results show that the proposed method has good transmission control effect, effectively alleviates the congestion of nodes and improves the data integrity.