ef51ef635cMerge pull request 'fix: close#6 - find and build all Dockerfiles in subdirectories' (#7) from fix/issue-6 into masterJarian Cottingham2026-07-05 00:24:24 -05:00
930189ac4ffix: close#6 - find and build all Dockerfiles in subdirectoriesJarian Cottingham2026-07-05 05:23:49 +00:00
db7bbf5907Merge pull request 'fix: close#1 - add bot-detection evasion for Reuters scraping' (#5) from fix/issue-1 into masterJarian Cottingham2026-07-05 00:23:13 -05:00
abb63db4b7enhancement: Make article processor more robust with multiple path support and fallback file format detectionJarian Cottingham2026-02-02 09:31:14 -06:00
ba8f24fcbdfix: Update scraper directory path for Docker container compatibility and add debuggingJarian Cottingham2026-02-02 09:27:02 -06:00
0b82bb13c4fix: Handle missing cache_stats key in logging to prevent KeyErrorJarian Cottingham2026-02-02 09:24:02 -06:00
e7b31a510afix: Complete removal of relative imports to resolve Docker container issuesJarian Cottingham2026-02-02 09:20:44 -06:00
1dd9337c39Fix embedding service by removing unused openai import and cleaning up dependenciesJarian Cottingham2026-02-02 01:23:14 -06:00
da03b3e847Clean up requirements files and remove unnecessary dependencies including PyTorchJarian Cottingham2026-02-01 21:11:22 -06:00
157e4541fcImplement enhanced cache system with batch processing and two-phase processing approachJarian Cottingham2026-02-01 21:03:00 -06:00
56231fa354feat: Implement automated cron job setup for embedding pipeline and clean up AI processor fact extraction logicJarian Cottingham2026-02-01 20:39:07 -06:00
874c64c9d1Fix file path handling and add robust error handling for cron job executionJarian Cottingham2026-01-31 11:00:14 -06:00
585499a171Add webhook functionality to send new articles to external endpointJarian Cottingham2026-01-31 05:28:18 -06:00
b923201695Adding a cron job script and a setup script to help with setting up cronjobJarian Cottingham2026-01-31 09:49:18 +00:00
b8a24a9fb1feat(scraper): Add cron_scraper.py to fix freezing issuesJarian Cottingham2026-01-31 00:03:06 -06:00
15862cf32afeat(scraper): Implement cron-based scraper to fix freezing issues with 15-minute schedulingJarian Cottingham2026-01-30 15:09:20 -06:00
f32902e894New Readmes, cleaned reqs.txt, fixed multithreading issue, and commenting out aiserver and embedder until more testing doneJarian Cottingham2025-10-17 09:53:15 -05:00