You can believe something without being certain. You probably believe many things you aren't certain of.
There are various philosophies for dealing with uncertainty, such as Bayesianism, which gives all beliefs a "credence", a % chance of being true, and discusses how those percents change with new information.