We developed comprehensive models to determine risk of Barrett’s esophagus (BE) or esophageal adenocarcinoma (EAC) based on genetic and non-genetic factors. We used pooled data from 3288 patients with BE, 2511 patients with EAC, and 2177 individuals without either (controls) from participants in the international Barrett’s and EAC consortium as well as the United Kingdom’s BE gene study and stomach and esophageal cancer study. We collected data on 23 genetic variants associated with risk for BE or EAC, and constructed a polygenic risk score (PRS) for cases and controls by summing the risk allele counts for the variants weighted by their natural log-transformed effect estimates (odds ratios) extracted from genome-wide association studies. We also collected data on demographic and lifestyle factors (age, sex, smoking, body mass index, use of nonsteroidal anti-inflammatory drugs) and symptoms of gastroesophageal reflux disease (GERD). Risk models with various combinations of non-genetic factors and the PRS were compared for their accuracy in identifying patients with BE or EAC using the area under the receiver operating characteristic curve (AUC) analysis. Individuals in the highest quartile of risk, based on genetic factors (PRS), had a 2-fold higher risk of BE (odds ratio, 2.22; 95% confidence interval, 1.89-2.60) or EAC (odds ratio, 2.46; 95% confidence interval, 2.07-2.92) than individual in the lowest quartile of risk based on PRS. Risk models developed based on only demographic or lifestyle factors or GERD symptoms identified patients with BE or EAC with AUC values ranging from 0.637 to 0.667. Combining data on demographic or lifestyle factors with data on GERD symptoms identified patients with BE with an AUC of 0.793 and patients with EAC with an AUC of 0.745. Including PRSs with these data only minimally increased the AUC values for BE (to 0.799) and EAC (to 0.754). Including the PRSs in the model developed based on non-genetic factors resulted in a net reclassification improvement for BE of 3.0% and for EAC of 5.6%. We used data from 3 large databases of patients from studies of BE or EAC to develop a risk prediction model based on genetic, clinical, and demographic/lifestyle factors. We identified a PRS that increases discrimination and net reclassification of individuals with vs without BE and EAC. However, the absolute magnitude of improvement is not sufficient to justify its clinical use.