We aimed to investigate whether frequencies of protein-rich food intake were associated with frailty among older Japanese adults. A cross-sectional study was conducted in 2011 among 3843 men and 4331 women in a population-based cohort of Kameoka city, Kyoto Prefecture, Japan. Frailty was assessed by the weighted score based on the 25-item Kihon-Checklist. The frequency of protein-rich food intake was examined as “seafood”, “meat”, “dairy products”, “eggs”, and “soy products”. The outcome of frailty was analyzed with a multiple logistic regression model using the frequency of protein-rich food intake. When compared to the first quartile, it was observed that there was a significant association between the lower adjusted prevalence ratio (PR) for frailty and the frequency of seafood intake in the fourth quartile among men (PR 0.64, 95% confidence interval (CI), 0.42, 0.99) and from the second quartile to the third quartile among women (PR 0.61, 95% CI, 0.43, 0.85; PR 0.64, 95% CI, 0.46, 0.91). The frequency of dairy products intake in the third quartile among women was significantly associated with a lower PR for frailty ( p-value = 0.013). Our findings suggest that the consumption of seafood and dairy products may help older adults in maintaining their independence.