The best neighborhood in Budapest to stay in is concentrated on the Pest side of the city. The main sights and historical attractions are located there: District V, VI and VII.
On the Buda side of the city, the Castle District (District I) which sits right next to the west bank of the Danube River is also a good option to find accommodation.