The extraction of acetic acid and other carboxylic acids from water is an emerging separation need as they are increasingly produced from waste organics and CO 2 during carbon valorization. However, the traditional experimental approach can be slow and expensive, and machine learning (ML) may provide new insights and guidance in membrane development for organic acid extraction. In this study, we collected extensive literature data and developed the first ML models for predicting separation factors between acetic acid and water in pervaporation with polymers' properties, membrane morphology, fabrication parameters, and operating conditions. Importantly, we assessed seed randomness and data leakage problems during model development, which have been overlooked in ML studies but will result in over-optimistic results and misinterpreted variable importance. With proper data leakage management, we established a robust model and achieved a root-mean-square error of 0.515 using the CatBoost regression model. In addition, the prediction model was interpreted to elucidate the variables' importance, where the mass ratio was the topmost significant variable in predicting separation factors. In addition, polymers' concentration and membranes' effective area contributed to information leakage. These results demonstrate ML models' advances in membrane design and fabrication and the importance of vigorous model validation.