No Fuel Pressure
More likely the pump is not putting gas up to the engine's fuel rail.
With key on, not start, the pump should turn on for 2 seconds to put pressure in the line and fuel rail. Do you hear the buzz or hum from the tank with key on?
Did you put a fuel pressure gauge on the fuel rail's test port (shraeder valve), and find no pressure with key on? If so, you will need to check into the pump operation (assuming the fuel filter is not clogged). A quick test is to pull off the gas tank electrical connector, find the fuel pump wire in the connector, and use a test light grounded to a metal frame or a voltmeter. Check for power on the fuel pump wire, while the engine is being cranked over. If power then, your new pump is not working. It could be the ground for the pump, so you need to check that. If no power to pump, engine cranking, then you will have to find the fuel pump relay under the hood, and check the wiring to it. There is also a fuel pump fuse-it may be under hood or in the instrument fuse panel-need to find and check it.
If the pump is working and the fuel filter is clean, you should have gas in the fuel rail (which supplies the injectors with fuel under pressure). I have not heard of a pressure regulator problem that could cause no pressure, but then...
Post back what you find, or with comments. Hope this has helped a little.