Code

Discover Feeds#1832

Code

Open

samuelclay wants to merge 177 commits intomastersamuelclay/NewsBlur:masterfrom discoversamuelclay/NewsBlur:discoverCopy head branch name to clipboard

+6,281-909

Commits

Commits on Jun 28, 2023

• Stubbing in discover feed icons in popover on feeds.

  samuelclay

  committed
  28b66f9

Commits on Jun 30, 2023

• Adding feed badges to discover popover.

  samuelclay

  committed
  d233c1f

Commits on Aug 13, 2023

• Merge branch 'master' into discover

  Show description for 530c04f
  samuelclay

  committed
  530c04f

• Asynchronously loading discover feed data. Need to show story previews and then hook up to read data. Also would like to add a folder chooser directly to add.

  samuelclay

  committed
  091b079

• Ordering discover feeds, fixing render bug.

  samuelclay

  committed
  e7e6fd6

Commits on Aug 20, 2023

• Attempting to add openai model.

  samuelclay

  committed
  7afed3e

Commits on Oct 9, 2023

• Merge branch 'master' into discover

  Show description for aea20be
  samuelclay

  committed
  aea20be

Commits on Oct 10, 2023

• Adding surprise scipy package, adding new CollaborativelyFilteredRecommendation model and management command.

  samuelclay

  committed
  423434f

• Merge branch 'master' into discover

  Show description for 663b5f9
  samuelclay

  committed
  663b5f9

Commits on Oct 11, 2023

• Running scikit-surprise

  samuelclay

  committed
  2feaf08

• More scikit-learn experiments.

  samuelclay

  committed
  6acac46

• Fixing story titles in discover popover.

  samuelclay

  committed
  73e29a0

• Adding site from discover popover. Updating notification hsitory icon.

  samuelclay

  committed
  e93215f

Commits on Oct 12, 2023

• Selecting stories in discover popover.

  samuelclay

  committed
  4e8637f

• Fixing subscribe button placement.

  samuelclay

  committed
  52f9d96

• Fixing folder icon.

  samuelclay

  committed
  3abffeb

Commits on Oct 15, 2023

• Styling

  samuelclay

  committed
  cb4e73b

Commits on Nov 8, 2023

• More training attempts.

  samuelclay

  committed
  0702fbb

Commits on Nov 10, 2023

• It's a wash if this does anything.

  samuelclay

  committed
  3acd6d1

Commits on Nov 16, 2023

• Styling

  samuelclay

  committed
  f3622d3

• Upgrading flask

  samuelclay

  committed
  9a236d1

• Only storing active feeds

  samuelclay

  committed
  6085d97

• Adding preference for showing/hiding discover popover.

  samuelclay

  committed
  14172f6

• Cleaning up SVD

  samuelclay

  committed
  60d90ce

Commits on Nov 23, 2023

• Create the surprise data folder if it doesn't exist.

  samuelclay

  committed
  f9b8e08

• Set SURPRISE_DATA_FOLDER envvar.

  samuelclay

  committed
  29c9961

• Random feed ids.

  samuelclay

  committed
  849e3f1

• Faster discover feed count

  samuelclay

  committed
  bf49f47

• Optimizing storing user-item csv.

  samuelclay

  committed
  0b33171

• Rounding reach score

  samuelclay

  committed
  a22b25b

Commits on Nov 24, 2023

• Adding skip to allow continuation of previous runs

  samuelclay

  committed
  392d2ae

• Count stats on user item rating csv.

  samuelclay

  committed
  ac008c1

Commits on Nov 25, 2023

• If skip is set, then restart saving data.

  samuelclay

  committed
  cf6b973

• Don't re-write, append.

  samuelclay

  committed
  150cfd3

• Handling missing skip

  samuelclay

  committed
  89424dc

Commits on Dec 6, 2023

• Allow full backup only. These was included to attempt to fix a crash with Hilt and backups.

  

  sictiru

  authored and

  samuelclay

  committed
  282bccf

• Remove tools target api in manifest

  

  sictiru

  authored and

  samuelclay

  committed
  2b076df

• #1813 Cleanup proguard rules. Use optimized default proguard rules.

  

  sictiru

  authored and

  samuelclay

  committed
  4e8e37b

• #1812 Scroll the stories list to the last user read story once reading session ends

  

  sictiru

  authored and

  samuelclay

  committed
  8e01388

• #1816 Update to SDK 34

  

  sictiru

  authored and

  samuelclay

  committed
  b57e2fa

• Prevent unauthorized access to feeds with a single subscriber

  Show description for d9b190e
  

  aladh

  authored and

  samuelclay

  committed
  d9b190e

• Fixing logic error in PR #1817

  samuelclay

  committed
  e6f963e

• Moving favicon servers in haproxy

  samuelclay

  committed
  fa2b21e

• Styling

  samuelclay

  committed
  c46a623

• New rating scale

  samuelclay

  committed
  6c250f5

Commits on Dec 16, 2023

• Merge branch 'master' into discover

  Show description for ad58ad2
  samuelclay

  committed
  ad58ad2

Commits on Dec 25, 2023

• Adding overlap

  samuelclay

  committed
  b398bed

Commits on Dec 26, 2023

• Using tfidf and lightfm for recs, only recommeneds the same feeds every time.

  samuelclay

  committed
  c360682

• Using KNN for recs. I think this might have actually worked.

  samuelclay

  committed
  02494c1

Commits on Dec 27, 2023

• Adding similiar feeds many-to-many field. Using KNN classifier for similar feeds using user-feed-rating csv. Now to productionalize.

  samuelclay

  committed
  95a0acb

• Renaming discover to similar.

  samuelclay

  committed
  c8162d1

Commits on Jan 6, 2024

• New discover icon

  samuelclay

  committed
  51dda25

Commits on Apr 24, 2024

• Merge branch 'master' into discover

  Show description for 573476e
  samuelclay

  committed
  573476e

• Merge branch 'black-formatting' into discover

  Show description for c630677
  samuelclay

  committed
  c630677

• Merge branch 'black-formatting' into discover

  Show description for da0275d
  samuelclay

  committed
  da0275d

Commits on Apr 30, 2024

• Merge branch 'js-format' into discover

  Show description for 6c81069
  samuelclay

  committed
  6c81069

• Merge branch 'master' into discover

  Show description for 8190b32
  samuelclay

  committed
  8190b32

Commits on May 1, 2024

• Adding third party sharing services to sideoptions. Need to hook up actions and build a extend menu.

  samuelclay

  committed
  2013c45

Commits on Jun 29, 2024

• Merge branch 'master' into discover

  Show description for 55dda97
  samuelclay

  committed
  55dda97

• Fixing docker image build

  samuelclay

  committed
  27b1069

Commits on Jun 30, 2024

• Using sentence transformers and the MiniLM model to create embeddings for feeds.

  samuelclay

  committed
  0f579cb

• Merge branch 'master' into discover

  Show description for e862793
  samuelclay

  committed
  e862793

Commits on Jul 1, 2024

• Hooking up new elasticsearch discovery.

  samuelclay

  committed
  bb6400f

Commits on Jul 6, 2024

• Merge branch 'master' into discover

  Show description for c31893f
  samuelclay

  committed
  c31893f

• Removing unused scikit-learn code.

  samuelclay

  committed
  711a6fb

Commits on Jul 9, 2024

• Updating migrations

  samuelclay

  committed
  a74480e

Commits on Jul 10, 2024

• Sticky header

  samuelclay

  committed
  fbe34c4

• Switching discover feeds search index to preserve prod.

  samuelclay

  committed
  a49eaa1

• Setting TRANSFORMERS_CACHE

  samuelclay

  committed
  8d30cec

• If hostname has staging in it, only 2 workers

  samuelclay

  committed
  92f881e

Commits on Jul 12, 2024

• Adding discover to folders of feeds. Holy moly this is nearly done.

  samuelclay

  committed
  7e68b00

Commits on Jul 17, 2024

• Styling third party shares.

  samuelclay

  committed
  838a16f

Commits on Aug 4, 2024

• Narrow to wide should be consistent.

  samuelclay

  committed
  36ad948

• Merge branch 'master' into discover

  Show description for db3bcc9
  samuelclay

  committed
  db3bcc9

• Fixing couple of issues on hover.

  samuelclay

  committed
  3b7dfe3

• Links to send story to third party service now work in story detail.

  samuelclay

  committed
  514c8b6

• Adding reddit as third party service. Going to add more but need to refactor.

  samuelclay

  committed
  2845c66

• +LinkedIn. Refactoring preferences for third party services.

  samuelclay

  committed
  99f3a2e

• +WhatsApp

  samuelclay

  committed
  3e57bb3

• LiveJournal + Hacker News

  samuelclay

  committed
  8525c5e

• Fixing LJ and HN

  samuelclay

  committed
  f8dce65

• +Flipboard

  samuelclay

  committed
  526b547

Commits on Aug 5, 2024

• +Telegram +Line.me

  samuelclay

  committed
  2593c23

• Copy URL and Copy Text.

  samuelclay

  committed
  5f704ff

• Print story

  samuelclay

  committed
  3b1ac7c

• Adding Copy URL/Text/Print to default sharing services.

  samuelclay

  committed
  796111e

Commits on Aug 6, 2024

• Printing should use original text when shown.

  samuelclay

  committed
  928772e

• Twitter + Facebook logos.

  samuelclay

  committed
  f473a7f

• Disappearing print button, local timezone for story date.

  samuelclay

  committed
  b9e5d5d

• Extending send service buttons.

  samuelclay

  committed
  9f46ca2

• Adding .cursorrules.

  samuelclay

  committed
  83ca7e3

• Cleanup icon dimming and manage menu title text on copied url/text.

  samuelclay

  committed
  e2edc5d

Commits on Aug 7, 2024

• Moving sentence transformers to only import when needed.

  samuelclay

  committed
  bda72b7

• Logging transformers loading.

  samuelclay

  committed
  7cef002

Commits on Aug 9, 2024

• Merge branch 'master' into discover

  Show description for f03d881
  samuelclay

  committed
  f03d881

Commits on Aug 10, 2024

• Merge branch 'master' into discover

  Show description for 623552b
  samuelclay

  committed
  623552b

Commits on Aug 13, 2024

• Setup imageproxy crontab

  samuelclay

  committed
  8740c9a

Commits on Oct 11, 2024

• Merge branch 'master' into discover

  Show description for abeb3d4
  samuelclay

  committed
  abeb3d4

• Moving to OpenAI Embeddings API.

  samuelclay

  committed
  2931e5d

Commits on Oct 13, 2024

• Adding paging and infinite scroll to discover popover. Needs de-dupe and a refactor.

  samuelclay

  committed
  f17f5f2

• Removing dupe feeds based on feed title.

  samuelclay

  committed
  914d07d

• Showing 5 distinct related feeds in title bar.

  samuelclay

  committed
  1bd3de2

Commits on Oct 23, 2024

• Merge branch 'master' into discover

  Show description for c5bb864
  samuelclay

  committed
  c5bb864

Commits on Oct 24, 2024

• New screenshots of the macOS app

  samuelclay

  committed
  4d93362

Commits on Oct 26, 2024

• Merge branch 'master' into discover

  Show description for 6d58c79
  samuelclay

  committed
  6d58c79

• Merge branch 'master' into discover

  Show description for 933abba
  samuelclay

  committed
  933abba

Commits on Oct 27, 2024

• Pre-selected folder on discover feed badge. Fixing loading dincator when adding site.

  samuelclay

  committed
  ec468fa

• Fixing paging on folders, no longer unnecessarily loading river on discover scroll.

  samuelclay

  committed
  9a605c1

Commits on Oct 28, 2024

• Stubbing in discover stories.

  samuelclay

  committed
  753d816

• Stubbing in working Related side options button.

  samuelclay

  committed
  e378661

Commits on Nov 4, 2024

• Merge branch 'master' into discover

  Show description for 5655433
  samuelclay

  committed
  5655433

• Indexing stories with content vectors.

  samuelclay

  committed
  9e7b08b

Commits on Nov 5, 2024

• Merge branch 'master' into discover

  Show description for a2d3785
  samuelclay

  committed
  a2d3785

Commits on Nov 7, 2024

• Adding API endpoints for discover stories. Need to finish the UI for stories. Then prob add premium limits.

  samuelclay

  committed
  d04b4b0

• Styling discover stories

  samuelclay

  committed
  cd8feb2

• Not perfect but stories are now rendered. Need to calculate the height and disable scroll.

  samuelclay

  committed
  19522cc

Commits on Nov 18, 2024

• Merge branch 'master' into discover

  Show description for 3e961c6
  samuelclay

  committed
  3e961c6

• Adding Bluesky and Mastodon sharing services.

  samuelclay

  committed
  60f980a

• Moving discover view in story detail.

  samuelclay

  committed
  0678480

Commits on Nov 20, 2024

• Storing last used discover stories folder for all stories in that folder/feed.

  samuelclay

  committed
  6dc247b

• Attempting to fix feed title layout in discover stories.

  samuelclay

  committed
  cf72874

• Splitting DiscoverStory from SearchStory so the indexes can be separate.

  samuelclay

  committed
  d3280ff

Commits on Nov 21, 2024

• Separating index discover from index stories. Need to separate out index discover and index story when initially indexing so as to return search results to the user faster. Also need to index stori…

  Show description for a0cf47a
  samuelclay

  committed
  a0cf47a

• Cleaning up discover stories index, adding discover_indexed field, beginning to split discover/search indexing. Needs further splitting at the task/queue level.

  samuelclay

  committed
  74f0f25

Commits on Nov 24, 2024

• Adding debug_index

  samuelclay

  committed
  a45170f

• Adding index debug to all search models.

  samuelclay

  committed
  4cfb64b

• Fixing folders disappearing on search.

  samuelclay

  committed
  a49a2f6

Commits on Nov 27, 2024

• Renaming StoryDiscoverView -> DiscoverStoriesView. Need to figure out if subscribed so we can load the appropriate feed.

  samuelclay

  committed
  9a8531e

Commits on Nov 28, 2024

• Refactoring discover stories so that it now loads the correct story when clicked on. Still work to be done on layout showing the feed, the double embedding padding offset, and moving to below the s…

  Show description for e67399f
  samuelclay

  committed
  e67399f

• Moving the discover stories side option to the right place. Needs triggers when narrow content flag changes.

  samuelclay

  committed
  9c0dff2

• Moving discover view to the correct spot on resize/narrow.

  samuelclay

  committed
  3c3d55a

• Moving feed title to above story title in related stories.

  samuelclay

  committed
  78c4807

• Moving NEWSBLUR.Collections.DiscoverStories to its proper place.

  samuelclay

  committed
  beb33f2

• Adding paging to related stories. Needs premium cutoff, end line guardrail, and more testing.

  samuelclay

  committed
  787a996

• Cleaning up load more / no more button.

  samuelclay

  committed
  7e8d4b7

• Aborting requests when switching tabs.

  samuelclay

  committed
  8655644

• Showing error when related stories request fails, complete with retry button.

  samuelclay

  committed
  0654024

Commits on Dec 1, 2024

• No need to reindex stories once indexed.

  samuelclay

  committed
  5b9f6d4

Commits on Dec 2, 2024

• Adding preferences to hide story sideoptions buttons.

  samuelclay

  committed
  f8b667e

• New discover icon.

  samuelclay

  committed
  cc6e737

Commits on Dec 7, 2024

• Default to 'all' if no section is highlighted in Related Stories.

  samuelclay

  committed
  ecc3609

• Non-premiums see upgrade button.

  samuelclay

  committed
  9d248ed

• Adding discover to premium features.

  samuelclay

  committed
  d0075d7

• Cleaning up intro dialog, removing find friends.

  samuelclay

  committed
  2c1f545

• When trying to find a related story, if we go past 10 pages and still can't find it, switch to search.

  samuelclay

  committed
  8cd499c

Commits on Dec 10, 2024

• Adding Elasticsearch graphs.

  samuelclay

  committed
  284c53e

• isort

  samuelclay

  committed
  ba87788

Commits on Dec 14, 2024

• Moving discover indexing to its own queue.

  samuelclay

  committed
  153cb87

• Only index discover stories for premium archive users.

  samuelclay

  committed
  58e66f7

Commits on Dec 15, 2024

• Messages for premium/non-archives for the discover stories footer.

  samuelclay

  committed
  c5a9646

• Real-time updates on discover being indexed. Need to sort out exactly when to start indexing, becuase on MUserSearch creation won't cover people who only use Related Stories. That should touch the …

  Show description for 9a2a52c
  samuelclay

  committed
  9a2a52c

• Indexing discover stories when using Related Stories sideoption. Also reindexes discover on upgrade.

  samuelclay

  committed
  f837804

• Showing unsubed feeds in discover stories global. Now need to change tryfeed's search-on-discover behavior.

  samuelclay

  committed
  46c3954

• Searching for story title on discover story for a try feed.

  samuelclay

  committed
  23fd5b3

Commits on Dec 19, 2024

• Indexing discover stories as they come in a) in a task, and b) only for archive subscribers.

  samuelclay

  committed
  4427eb2

• Switching to POST for discover stories since the url can get too big.

  samuelclay

  committed
  892420f

• Merge branch 'master' into discover

  Show description for 9272f66
  samuelclay

  committed
  9272f66

• Bumping time limit for discover indexing.

  samuelclay

  committed
  7894588

Commits on Dec 20, 2024

• Re-scheduling discover indexing if indexing didn't finish in the last day and user is checking related again.

  samuelclay

  committed
  6cfd38f

• Showing Related text next to discover popover if no feed icons are loaded.

  samuelclay

  committed
  f6676eb

Commits on Dec 21, 2024

• Fixing padding on story titles in discover.

  samuelclay

  committed
  e6e8800

• Fixing touch discover date typo

  samuelclay

  committed
  58754ab

• Logging old discover date vs unindexed.

  samuelclay

  committed
  335bf19

Commits on Dec 24, 2024

• Small fix to requirements (wrong pyflakes)

  samuelclay

  committed
  be7380a

Commits on Dec 25, 2024

• Re-normalizing dense vectors from 1584 dimensions to 256 dimensions, applying bbq_hnsw index to save 96% memory usage on vector embeddings.

  samuelclay

  committed
  5f02400

• Adding elasticsearch v8 for dense vector support in discover.

  samuelclay

  committed
  7378111

• Switching to elasticsearch v8 for discover.

  samuelclay

  committed
  eb5ea92

• Ansible_tags is not defined.

  samuelclay

  committed
  b43b4e8

• Db monitor for ES needs to point to the correct server.

  samuelclay

  committed
  7a9894e

• Db monitor for ES needs to point to the correct server.

  samuelclay

  committed
  6c5aed5

• Fixing monitor to use new venv.

  samuelclay

  committed
  e55e6c3

• ES no longer allows positional arguments.

  samuelclay

  committed
  148abed

• Python3 only has logging.warning.

  samuelclay

  committed
  9fecce4

• DEBUG is always True this high up.

  samuelclay

  committed
  ff52a4f

• Logging

  samuelclay

  committed
  9967692

• Don't count similar feeds on the regular.

  samuelclay

  committed
  8278d9f

Commits on Dec 27, 2024

• New task celery role

  samuelclay

  committed
  5e87091