• Aux@lemmy.world
          link
          fedilink
          arrow-up
          0
          ·
          27 days ago

          You can start by running sudo apt install tesseract-ocr and then reading its docs.

          • MacN'Cheezus@lemmy.today
            link
            fedilink
            English
            arrow-up
            0
            ·
            edit-2
            26 days ago

            It appears to be as simple as tesseract <infile> <outfile>. Possibly could even pipe (or tee) the screenshot straight into that and save both an image and a text file in a single command line.

            So something like this should do the trick:

            gnome-screenshot -f - | tee /Microsoft/yourPrivacy/$(date +%s).png | tesseract - /Microsoft/yourPrivacy/$(date +%s).txt
            

            Skip the database, just use grep to search that directory if you need to find anything. Voilà, homemade Recall.

            • Aux@lemmy.world
              link
              fedilink
              arrow-up
              0
              ·
              23 days ago

              It is much better to search using ElasticSearch or Sphinx. Grep is super slow, non indexed and can’t do natural language full text searches. It’s pretty much useless for any real world text search you’d want from OCRed content. And all these better tools are free and open source, so really a no brainer.

          • MacN'Cheezus@lemmy.today
            link
            fedilink
            English
            arrow-up
            0
            ·
            26 days ago

            Llava and Bakllava are two Ollama models than can not only extract text but also describe what’s happening on screen.

            Using tesseract-ocr, as the other guy suggested, is probably simpler and less resource intensive though.

          • not_amm@lemmy.ml
            link
            fedilink
            English
            arrow-up
            0
            ·
            26 days ago

            I found a small command to run KDE Spectacle (screenshot software) with Tesseract so I can OCR a screenshot if I want to, I only had to install Tesseract and a main language, you could easily do the same with an API and/or a local AI.

    • macniel@feddit.de
      link
      fedilink
      arrow-up
      0
      ·
      edit-2
      27 days ago

      its a cronjob that runs each minute (*/1) in any hour, any day, any month, on any weekday, gnome-screenshot obviously takes a screenshot and outputs it to the given file path and filename, where the filename is written as the current date as string and .png as format

    • DaPorkchop_@lemmy.ml
      link
      fedilink
      arrow-up
      0
      ·
      27 days ago

      It’s a crontab entry which, once a minute, uses the gnome-screenshot program to take a screenshot of your monitor and save it to /Microsoft/yourPrivacy.