Ben Gutteridge

Ben Gutteridge

DPhil candidate researching machine learning at the University of Oxford

Posts by Tags

daily blog

less than 1 minute read

Published:

Yesterday

  • NOTHING!

less than 1 minute read

Published:

Yesterday

  • NOTHING!

less than 1 minute read

Published:

Yesterday

  • NOTHING!

less than 1 minute read

Published:

Yesterday

  • RT exps and digging

less than 1 minute read

Published:

TODO

  • RT investigation:
    • Can you reproduce the RT plot with the same params?
    • Plots for all weight sharing (and non-sharing) combinations
    • Study the differences between the GCN implementations

less than 1 minute read

Published:

Yesterday

  • Mostly admin/travel
  • RT param investigation

less than 1 minute read

Published:

Yesterday

  • NOTHING!

less than 1 minute read

Published:

Yesterday

  • Cleaned up JUDGE repo, sorted cache file with downloadable link
  • Started sorting stuff for A

less than 1 minute read

Published:

Yesterday

  • Finished edits to, and submitted, JUDGE workshop paper

less than 1 minute read

Published:

TODO

Final push and submission of JUDGE HTR paper.

  • Go through X’s comments on JUDGE paper draft and make edits and improvements
    • Make figures to explain method
  • Finish cleaning up repo and put link in paper
    • Clean up plot/fig generating notebooks
    • Check _minpages=02 was working right
    • Run codebase e2e including with fresh env to make sure it all works
    • Anonymize and check
  • Submit paper on CMT before EoD

less than 1 minute read

Published:

TODO

  • Morning meeting catching up w/ A
  • Then off to Rotterdam for a mini-break over the weekend

less than 1 minute read

Published:

29th-4th

  • Grinding out experiments and a paper draft for the DocUI@AAAI-25 document understanding workshop. Finally finished 😮‍💨

less than 1 minute read

Published:

Yesterday

  • Worked a little on Lyapunov but mostly cleaning up HTR code and notebooks all day
  • Messaged T

less than 1 minute read

Published:

Yesterday

  • Worked on Lyapunov, Jacobian for RT

less than 1 minute read

Published:

Yesterday

  • Meetings and fixing up some experiment code, both for LR and Lyapunov
  • LoG Oxford meetup

less than 1 minute read

Published:

Friday/weekend

  • Fixed LR exps, mostly, and cleaned up/merged/closed 4 open PRs

less than 1 minute read

Published:

Yesterday

  • AGM, PR for LR

less than 1 minute read

Published:

Yesterday

  • Getting RT working properly on brocluster

less than 1 minute read

Published:

Yesterday

  • HTR lit reviewing

less than 1 minute read

Published:

Yesterday

  • Meetings, LR exps

less than 1 minute read

Published:

TODO

  • LR bullets presentation in Geodudes meeting
  • Meeting with S and J

less than 1 minute read

Published:

Yesterday

  • Loads of meetings

less than 1 minute read

Published:

Yesterday

  • Collated/cleaned up HTR tables, multi-page results
  • Unsuccessful exp checking if rerarranging pages so page * is first fixes error
  • Unsuccessful exp with very challenging old German RPK docs

less than 1 minute read

Published:

Yesterday

  • Shared HTR proj w/ X, got M on board
  • LR PR, cleaned up, refactored, no longer returning nan/inf (but not training properly by the look of it)

less than 1 minute read

Published:

Yesterday

  • Worked on HTR project all day; refactoring, different page counts

less than 1 minute read

Published:

TODO

  • HTR exps and notebook to point of sharing with XD; send to him
    • Further divide pre-processing and exps/results — should be able to run exps on either dataset with a single notebook
    • Exps for page selection on both into notebook
    • Exps for doc length variation
    • A messy paper roundup for initial lit review
  • Merge LR PR if J/S approve

less than 1 minute read

Published:

Yesterday

  • Morning LR call and plan for the next week, took rest of day off because of family visiting

less than 1 minute read

Published:

Yesterday

  • Post-election doomscrolling
  • Implemented chosen-page for HTR-ICL

less than 1 minute read

Published:

Yesterday

  • Worked on PR for RT in Lyapunov

less than 1 minute read

Published:

Yesterday

  • Made a start on PR in LR repo, almost got very rough func synthetic exp pipeline working
  • Chat w/ M about HTR

less than 1 minute read

Published:

Friday/weekend

  • First draft of HTR-ICL write-up and promising experiments for Bentham and IAM

less than 1 minute read

Published:

Yesterday

  • HTR-ICL all day, initial promising results

less than 1 minute read

Published:

Yesterday

  • Worked on HTR-ICL all day instead of LR stuff
  • Got a rudimentary exp pipeline for Bentham and sorted preproc for IAM

less than 1 minute read

Published:

Yesterday

  • Bit of progress on the HTR notebooks, not nearly enough

less than 1 minute read

Published:

Yesterday

  • Some stuff into LR Overleaf
  • Meetings with A, X, S+J+X

less than 1 minute read

Published:

Friday/weekend

  • DRew PR for A’s repo

less than 1 minute read

Published:

Yesterday

  • Read other O paper
  • Worked on DRew Lyapunov PR

less than 1 minute read

Published:

Yesterday

  • Reread some old F papers, helps w/ LR
  • Read one of O’s papers
  • Call w/ A and some setup stuff for that PR
  • Got IAM, OCR space, made a little progress on HTR-ICL

less than 1 minute read

Published:

Yesterday

  • Properly grokked the discrete vs continuous thing for Jacobian eigenvalues/stability
  • Somewhat made sense of notes from LR meeting yesterday, wrote up some stuff in the Overleaf

    TODO

  • Until noon:
    • Read F’s CT paper, read O’s papers
    • More notes into the LR Overleaf, clean up a little
  • Clean up piled up misc Obsidian notes
  • Afternoon:
    • Start on PR for A
    • If time, IAM and a little progress on HTR-ICL idea

less than 1 minute read

Published:

Yesterday

  • Group meeting, grokked A’s notes/code a bit, LR project meeting w/ S & J

less than 1 minute read

Published:

Friday

  • Read A-DGN
  • Call w/ A and follow-up dig into repo/Overleaf
  • Broke ground on HTR-ICL idea

less than 1 minute read

Published:

Yesterday

  • Read stack of graph/RNN VG papers (coRNN, GraphCON, gradient flossing, A-RNN)

less than 1 minute read

Published:

TODO

  • Read stack of papers related to project w/ A
  • Gather thoughts and Qs for meeting tomorrow

less than 1 minute read

Published:

Yesterday

  • A bunch of admin, replying to messages
  • Big think about DocAI ICL idea

less than 1 minute read

Published:

Yesterday

  • Paper notes writeups, grokking PRODIGY
  • Meeting(s) w/ O, A, S on LR
  • Meeting w/ A
  • Useful talk w/ M

less than 1 minute read

Published:

Friday

  • Read a load of papers (CARTE, TabMDA, LoCalPFN, GraphToken, Talk like a Graph, PRODIGY)
  • Chat with Y

less than 1 minute read

Published:

Yesterday

  • Went through DRew2/STMP stuff, made some notes, made an assessment
  • OxNSG group meeting, chat w/ J and S about LR
  • Read SPoT-Mamba
  • More wrapping head arounf J’s LR notes
  • Meeting with XD, talking about short- and long-term plans going forward

less than 1 minute read

Published:

Yesterday

  • More SSM/Mamba reading
  • BuNN/diffusion reading for LR proj
  • Some LR proj proposal writeup

less than 1 minute read

Published:

Yesterday

  • Dig into SSMs, S4, Mamba and graph Mamba

less than 1 minute read

Published:

Yesterday

  • Dive into long-range papers/datasets, notes for convo w/ Jacob, convo, first draft of potential project abstract

less than 1 minute read

Published:

TODO

  • Before group meeting:
    • Finish skimming graph mamba
    • Quick look at the reading list paper this week (is there one?)
    • Quick recap of long range papers/benchmarks
    • Quick compilation of notes about long-range thoughts for chat w/ Jacob
  • After:
    • Dig into mamba for STMP
    • Dust off half-written Overleafs from STMP and old experiments, make a plan to get into a nicely written form — springboard
    • Send message to arrange first post-internships supervisor meeting