12/23 Speaker:Prof. Lih-Yuan Deng (University of Memphis, U.S.A.)
Topic:Random Integrated Subdata Ensemble (RISE) for Big Data Model Building
Speaker:Prof. Lih-Yuan Deng (University of Memphis, U.S.A.)
Date Time:Fri. Dec 23, 2022, 10:40 AM - 11:30 AM
Place: 4F-427, Assembly Building I
Online Seminars- Google Meet
https://meet.google.com/pmf-qvee-kxt
Abstract
We discuss our newly proposed Random Integrated Subdata Ensemble (RISE) method to build a more efficient big data model such as variable selections and/or model building. Generally speaking, large sample size tends to make some "variables" statistically significant while they may not have real "practical importance". Therefore, it is more likely to overly select such variables simply because of using (relatively) large sample size. For most "big data" applications, the number of observations for the whole data and training data can easily exceed few thousands. Consequently, most "typical" statistical variable selection procedures tends to overly select "less important" variables which are "statistically significant". RISE is a better strategy to choose and analyze various subdata of a "smaller size" that can combine or ensemble various results to build a more efficient and reliable model.