Skip to content
  • Andrew Tridgell's avatar
    023ebcd1
    speed up parsing of bin logs · 023ebcd1
    Andrew Tridgell authored
    use a dictionary of sets to record which instances of a message have
    been seen before. This avoids us having to parse all instance based
    messages fully during the load.
    
    as we have added more instance messages the time to load the log has
    become progressively longer. With this change it now becomes short
    again
    
    on a recent 160MByte quadplane log the time to load the log with this
    change drops from 39.9s to 6.5s
    023ebcd1
    speed up parsing of bin logs
    Andrew Tridgell authored
    use a dictionary of sets to record which instances of a message have
    been seen before. This avoids us having to parse all instance based
    messages fully during the load.
    
    as we have added more instance messages the time to load the log has
    become progressively longer. With this change it now becomes short
    again
    
    on a recent 160MByte quadplane log the time to load the log with this
    change drops from 39.9s to 6.5s
Loading