Matt Tubbs grabbed the only goal of the game six minutes before half-time at Plainmoor and the Blue Square Bet Premier side could have had more, but Gulls goalkeeper Scott Bevan saved second-half penalties from Tubbs and Craig McAllister. Both sides finished with 10 men after Chris Zebroski and Dean Howell saw red.
The win added Torquay to the scalps of Swindon and Derby that Crawley have already claimed and Evans said: "We expected to come here and win. We said it and we have done it."
He added: "Arguably if we go and practise penalties tomorrow we might score the next one. I think if the first one goes in then we may have won here rather comfortably.
"It's fantastic for the owners that we are through to the last 16 for the first time.
"Obviously by progressing in the FA Cup we might encounter some fixture congestion ahead - and now we might do some transfer business before the window closes that wasn't planned.
"I think you have to give us a lot of credit for the way we played."
Evans insisted his club would not alter their style of play in the next round - whoever their opponents turn out to be.
He added: "We are just proud to get where we are and now we are in the fifth round we would like the draw to be kind to us. If it is, then fantastic, but whoever we get in the fifth round, we will go and try and win like we did.
"I know that may sound stupid coming from the manager of a non-league club but we played three up front here and if we were at Old Trafford we would do the same."
Source: PA
Source: PA