To determine your mortgage comfort-zone, you need three things: a budget, a price, and a free mortgage calculator. For the price, just start with the cost of a house you think you might be interested in buying.
At first, don't worry about whether the price is too high -- you'll find that out soon enough when you run the numbers through a mortgage calculator.
Next, run the home price through our mortgage calculator at current interest rates and at a 30-year fixes mortgage. (You might choose a different mortgage type later on; but this exercise is just to get a ballpark mortgage payment based on home price, so choose the 30-year fixed option for the sake of simplicity.)