Colorectal cancer (CRC) is the third leading cause of cancer-related deaths in Japan. The etiology of CRC has been linked to numerous factors including genetic mutation, diet, life style, inflammation, and recently, the gut microbiota. However, CRC-associated gut microbiota is still largely unexamined. This study used terminal restriction fragment length polymorphism (T-RFLP) and next-generation sequencing (NGS) to analyze and compare gut microbiota of Japanese control subjects and Japanese patients with carcinoma in adenoma. Stool samples were collected from 49 control subjects, 50 patients with colon adenoma, and 9 patients with colorectal cancer (3/9 with invasive cancer and 6/9 with carcinoma in adenoma) immediately before colonoscopy; DNA was extracted from each stool sample. Based on T-RFLP analysis, 12 subjects (six control and six carcinoma in adenoma subjects) were selected; their samples were used for NGS and species-level analysis. T-RFLP analysis showed no significant differences in bacterial population between control, adenoma and cancer groups. However, NGS revealed that i), control and carcinoma in adenoma subjects had different gut microbiota compositions, ii), one bacterial genus (Slackia) was significantly associated with the control group and four bacterial genera (Actinomyces, Atopobium, Fusobacterium, and Haemophilus) were significantly associated with the carcinoma-in-adenoma group, and iii), several bacterial species were significantly associated with each type (control: Eubacterium coprostanoligens; carcinoma in adenoma: Actinomyces odontolyticus, Bacteroides fragiles, Clostridium nexile, Fusobacterium varium, Haemophilus parainfluenzae, Prevotella stercorea, Streptococcus gordonii, and Veillonella dispar). Gut microbial properties differ between control subjects and carcinoma-in-adenoma patients in this Japanese population, suggesting that gut microbiota is related to CRC prevention and development.