Abstract: The tremendous growth of internet increase the enormous pressure on internet service providers to ensure Quality of Service for real time applications such as Voice over IP and Video on demand. These applications are very sensitive to delay, jitter, packet loss and needs to be engineered. In this study, a Multi Protocol Label Switching (MPLS) based load balancing technique is proposed to enhance the quality of service for VoIP applications. The proposed study is implemented with an effective flow classification technique and prioritizes the Voice packets based on their flow arrival rate and bandwidth utilization. The link failure or system failure in IP network causes load unbalanced situation and increases the congestion in the network. During this load unbalanced condition both responsive and unresponsive VoIP flows are rerouted into congestion free constraint based least loaded multiple paths. The non VoIP data flows are routed using Stream Control Transmission Protocol Multihomming technique. Simulation results are reported to show the efficiency of the proposed technique.