It Was DataFest Time Again
Apr 29, 2024
At California State University, Fresno, the driving force behind DataFest is Professor Earvin Balderama from the Mathematics department, a statistics expert. Other faculty members help with workshops and mentoring.
- The hackathon starts with a Friday kickoff. There are R and Python workshops in parallel; generally, these are the two main technology stacks the students use. For curriculum reasons, R has a very strong foundation in statistics; only a smaller group usually chooses my area of expertise: Python + Pandas + Scikit-Learn + Seaborn.
- On Friday night, the dataset is revealed as well. The dataset is shared across all participating student campuses. The dataset always comes from a real-world setting and is always very interesting. Datasets may be retained only for the duration and purpose of the hackathon.
- Teams can start to work once the dataset is revealed and the hackathon grind begins.
- Teams work tirelessly all Saturday and Sunday until the submission deadline before noon on Sunday.
- Judging takes place and winners are announced in the afternoon.
During the two years I participated, there were also students and mentors traveling from UC Merced, UC Santa Cruz, and other campuses around California. In 2023, I helped Earvin recruit judges for the panel. I managed to mobilize more data science people than expected, so I gave up my judge seat and Agustin Rivera from NVIDIA and Andrew Sweet from Assemi Group hopped on to complement Marcela Alfaro Córdoba from UC Santa Cruz. I ended up being featured as a speaker with a talk about MLOps and thoughts on LLM consciousness and problem-solving.
It was great to talk with data science meetup friends: Agustin has gathered a ton of experience at NVIDIA, and Andrew Sweet conducts in-depth research, mostly on time-series machine learning and forecasting. He has even given talks at major conferences.
Last year’s dataset came from the American Bar Association’s pro-bono legal help service for lower-income people dealing with legal issues. The dataset was anonymized, and due to the legal domain, it contained a lot of text (user conversations with agents), paving the way for NLP (Natural Language Processing).
The 2024 DataFest dataset was from the CourseKata online learning platform, and the task was somewhat “meta” for the students: the aim was to find patterns that could help students learn. We saw interesting visualizations and patterns. In general, students’ lives are demanding, and they often struggle to balance all their commitments.
The best part is the socialization. For example, in 2024, I retreated to a classroom to give my talk on Cloud Sustainability for GDG Tucson. One team came and overheard my lecture. Later we spoke for hours about generative AI. I learned that those students already had projects in the making that were already generating revenue. Mind-blowing!
I hope Fresno State will keep participating in more DataFests under the leadership of Earvin Balderama, and that I can keep contributing as a mentor or in any other capacity.