I did essentially the same thing before leaving CBS/CNET earlier this year to found http://recent.io/ -- saving salary over multiple years, buying a smaller house on the SF peninsula rather than a bigger one with a larger mortgage, etc. That gave me the luxury of being able to work-full time on creating this recommendation/prediction engine and accompanying app without worrying about income for now.

It's not an easy process, but it is possible!