The manor has been called Hampshire's Most Haunted house, by David Scanlan, founder of the Hampshire Ghost Society, who was responsible for bringing the alleged haunting to the attention of paranormal investigators and the public during his time as manager of the youth hostel there from 2002 to 2006.The Manor's reputation for being haunted was blamed by the press for the property's failure to sell at auction in 2010. although a local chartered surveyor had described it as a unique selling point likely to appeal to developers wanting to turn it into a guest house. Manor trustees have confirmed the value of the Manor's reputation in getting the public interested in the restoration of the building.
The ghosts have played their part in generating interest in the manor. They will always be part of the manor but there is so much more to the house, as we give it a bigger, new life.
— Portsmouth North MP Penny Mordaunt
The reported paranormal activity includes sudden drops in temperature, children whispering, furniture moving and apparitions of more than twenty ghosts.
Reckless Roddy
During the medieval period, according to local legend, Sir Roderick of Portchester rode to the manor to take advantage of a young bride who had been left alone on her wedding night when her new husband had been called away by an emergency. Unfortunately for Reckless Roddy the husband returned chased him from the house and thrust a sword through him as he attempted to mount his horse. The horse bolted. One night during the Second World War, Leonard Metcalfe stated that he heard a horse gallop down the lane near the manor, and one night in 1960 YHA Warden Mr. E. Jones heard a horse outside the building. The apparitions of Reckless Roddy's ghost are said to occur when a new bride is brought into the house
Francis Austen
The ghost of Sir Francis William Austen, brother of Jane Austen and former warden of the adjacent St. Peter and St. Paul's church, who is presumed to have visited the manor while it served as the vicarage, has reportedly been sighted on numerous occasions and is said[by whom?] to have smiled at one of the staff.
Bloody Nun
The apparition of a nun with bloody hands, sighted at the top of the stairs outside a small attic room known as Noah's Ark, has been linked by paranormal investigators to a local legend that this room was once where babies, possibly the product of illicit relations between monks and nuns, were aborted before being buried in the garden.