Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse

The Fedi Forum

  1. Home
  2. GoToSocial
  3. Anyone using #litestream for an #sqlite DB

Anyone using #litestream for an #sqlite DB

Scheduled Pinned Locked Moved GoToSocial
litestreamsqlitegotosocialgts
5 Posts 2 Posters 99 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • BumbleB This user is from outside of this forum
    BumbleB This user is from outside of this forum
    Bumble
    wrote on last edited by
    #1

    Anyone using #litestream for an #sqlite DB

    I have a 3GB database, and Litestream is replicating it to another server. However, it seems to be running out of control with disk space. On the original server (where the live DB is) is a
    generations folder under the hidden litestream folder. It is full of WAL files. Currently over 37,000 files consuming 118GB of disk space.

    My config includes
    retention: 24h and retention-check-interval: 1h with a snapshot-interval: 4h. I understood it would delete anything older than 24 hours. Am I doing something wrong? These wal files go back to the day I started using litestream

    #GoToSocial #gts @gotosocial@thefedi.forum

    Markus 🤓✨M 1 Reply Last reply
    0
    • BumbleB Bumble

      Anyone using #litestream for an #sqlite DB

      I have a 3GB database, and Litestream is replicating it to another server. However, it seems to be running out of control with disk space. On the original server (where the live DB is) is a
      generations folder under the hidden litestream folder. It is full of WAL files. Currently over 37,000 files consuming 118GB of disk space.

      My config includes
      retention: 24h and retention-check-interval: 1h with a snapshot-interval: 4h. I understood it would delete anything older than 24 hours. Am I doing something wrong? These wal files go back to the day I started using litestream

      #GoToSocial #gts @gotosocial@thefedi.forum

      Markus 🤓✨M This user is from outside of this forum
      Markus 🤓✨M This user is from outside of this forum
      Markus 🤓✨
      wrote on last edited by
      #2

      @bumble @gotosocial hmm. AFAIK, there should’t be any extra files at the live db, since litestream stores its metadata in tables in the db itself. I can’t check right now, so could be wrong, but sounds like a configuration issue.

      Markus 🤓✨M 1 Reply Last reply
      0
      • Markus 🤓✨M Markus 🤓✨

        @bumble @gotosocial hmm. AFAIK, there should’t be any extra files at the live db, since litestream stores its metadata in tables in the db itself. I can’t check right now, so could be wrong, but sounds like a configuration issue.

        Markus 🤓✨M This user is from outside of this forum
        Markus 🤓✨M This user is from outside of this forum
        Markus 🤓✨
        wrote on last edited by
        #3

        @bumble @gotosocial I was wrong! I have the dir too, but it doesn’t take up a lot of space.

        BumbleB 1 Reply Last reply
        0
        • Markus 🤓✨M Markus 🤓✨

          @bumble @gotosocial I was wrong! I have the dir too, but it doesn’t take up a lot of space.

          BumbleB This user is from outside of this forum
          BumbleB This user is from outside of this forum
          Bumble
          wrote on last edited by
          #4

          @markus@hachyderm.io @gotosocial@thefedi.forum I've had to turn it off for now. It's continuing to eat disk space. I didn't know if I could just delete all those files or it would comprise the integrity of the mirror process. Very odd.
          I did try their support channel but no response in a week. I'm at a loss. Need to try and find a new solution.

          #litestream

          Markus 🤓✨M 1 Reply Last reply
          0
          • BumbleB Bumble

            @markus@hachyderm.io @gotosocial@thefedi.forum I've had to turn it off for now. It's continuing to eat disk space. I didn't know if I could just delete all those files or it would comprise the integrity of the mirror process. Very odd.
            I did try their support channel but no response in a week. I'm at a loss. Need to try and find a new solution.

            #litestream

            Markus 🤓✨M This user is from outside of this forum
            Markus 🤓✨M This user is from outside of this forum
            Markus 🤓✨
            wrote on last edited by
            #5

            @bumble @gotosocial hmm. Odd. I've had this configuration for a year or so, it’s working quite well: https://gist.github.com/markuswustenberg/3914cd2fea9aa9e3313863de501b67a5 . Maybe you can stop litestream, delete the metadata files and tables ("_litestream_lock" and “_litestream_seq”), change to this config, and try again?

            1 Reply Last reply
            0
            Reply
            • Reply as topic
            Log in to reply
            • Oldest to Newest
            • Newest to Oldest
            • Most Votes


            • Login

            • Don't have an account? Register

            • Login or register to search.
            Powered by NodeBB Contributors
            • First post
              Last post
            0
            • Categories
            • Recent
            • Tags
            • Popular
            • World