The files in my office go back decades, so there is an absolute treasure trove of old, wonderful, beautifully unique names that I come across from time to time. I wrote some down last week that I found especially delightful and/or interesting (and I put a <3 next to my favorites) :
Effie Effie was #63 in 1880
Elva another popular turn of the century name
Marzella peaked in 1881
Winfield <3 an especially good Kansas name!
Monte that pink isn't a mistake!
Neva in the top 500 until the 1940's
Johnita misspelled Juanita? I also found a Waunita!
Atha hasn't even been in the top #1000 since 1908
Dagmar a guy in our file, but in the last 100 years it's been more commonly a female name
Ila <3 peaked at #250 in 1911
Info from www.ssa.gov