If you accept that the Big Bang was the first thing that ever happened, then yes. Otherwise, no. If you accept that the universe will continue to expand forever (a more debatable point than the previous one), then time is also not infinite. Otherwise, time may or may not end when the universe collapses in on itself, depending whether or not anything else happens after that.