Show HN: Build a SQLite satabase from your Reddit data https://news.ycombinator.com/item?id=36062256

Show HN: Build a SQLite satabase from your Reddit data With Reddit's upcoming API changes[0], I got nervous that I'd no longer be able to access the many posts and comments I've left there over the years. Inspired by the Dogsheep projects[1], this CLI lets you immediately pull your most recent 1k comments & 1k posts (the max allowed by the paged API) into a nicely-structured SQLite database. It's perfect for loading into Datasette for nice viewing & full-text search of your content. Taking it a step further, the project's killer feature is the ability to import data from GDPR archives. This allows you to store your full Reddit history (including deleted comments and posts on removed subreddits). I hope you find this tool useful! I'll be around to answer questions and field comments (or feel free to open a GH issue). [0]: https://old.reddit.com/r/reddit/comments/12qwagm/an_update_r... [1]: https://dogsheep.github.io/ https://github.com/xavdid/reddit-user-to-sqlite May 24, 2023 at 11:35AM

Show HN: Gis.chat – a Geospatial Community https://news.ycombinator.com/item?id=36040612

Show HN: Gis.chat – a Geospatial Community Hi folks! I'm excited to show you gis.chat, a geospatial chat platform in both senses: a platform about geospatial topics and a geospatial platform itself, referencing the location of our communities. The setup is fairly simple and reproducible: a plain Zulip instance and a homepage with geospatial search capabilities. It seems almost trivial but it has some very nice features. I guess you should be familiar with Zulips stream/topic model to follow along ( https://zulip.com/help/streams-and-topics ). The core idea is that there are city-specific streams (currently represented by a pin), but there could just as well be streams about points of interest, line geometries (e.g. a river) or polygons (e.g. national park). - Every local stream can have the same topics, e.g. "general", "news", "meetups", "jobs" etc. - With Zulip's search you can either search for a particular topic, e.g. "news" in a local stream or instead in all streams and have some kind of news feed of the community with "topic:news" - Once more communities are added, specific filters could be added, e.g. country-wise or by drawing your own area of interest - Eventually, for the ones who like, users could associate themselves with a local community in their profile or add there main location so one could not only search for the local communities but instead also for individuals There are many nice features in Zulip's pipeline that would foster gis.chat: - Further nesting of streams/topics - Semantic search If for example Zulip would allow for saving coordinates (or better an entire geometry) in the Postgres DB, with the help of PostGIS, Zulip's search could allow for bounding boxes (or custom geometries). Let me know if you have any kind of other ideas or feedback! https://gis.chat May 22, 2023 at 11:24PM

Show HN: Yakread – An RSS reader powered by machine learning https://news.ycombinator.com/item?id=36061427

Show HN: Yakread – An RSS reader powered by machine learning This is a web-based reading app I've been working on since August. The main differentiator is that Yakread uses machine learning to rank the articles in your feed: as you click on articles from a particular RSS/newsletter subscription, other articles from that subscription will tend to be ranked higher in the future (via a bandit algorithm). Yakread also uses ML to recommend articles that other users have read, so your feed will have articles in it even before you sign up and add your own subscriptions. For the recommendations, I'm using the collaborative filtering implementation from Spark MLlib[1]. I model RSS feeds instead of individual articles: when you click an article, that counts as a "point" for that article's RSS feed; at recommendation time, the algorithm first selects an RSS feed to recommend, and then it picks one of the popular/recent articles from that feed. To counter popularity bias, I have a pre-ranking step that probabilistically filters out RSS feeds that have already been recommended a lot. I manually approve all RSS feeds before they're eligible to be recommended. In addition to scrolling through the algorithmic feed, you can read articles chronologically on the subscriptions page, which I sometimes prefer when I have a larger chunk of reading time. There's also a daily digest email that lists new articles from your subscriptions; skimming that is part of my morning routine. I find the whole system gives me a nice balance between algorithmic filtering and manual control. This is the culmination of the past four years I've spent as a full-time bootstrapped founder; Yakread both scratches a personal itch and attempts to fix various deficiencies that my previous businesses have had. In a nutshell, I've come to believe that "discovery is a feature, not a product," which is why Yakread is a full reading app instead of a standalone recommender system like my previous products.[2] From a business perspective, the recommendation algorithm is primarily intended to help onboard new users quickly/easily. More ideologically, I think RSS is ready for a comeback :). [1] https://spark.apache.org/docs/latest/mllib-collaborative-fil... -- I'm using the implicit feedback setting. [2] Show HN for Yakread's immediate predecessor, The Sample: https://news.ycombinator.com/item?id=27664020 . The Sample does bring in $1k or so per month, but long-term retention is too low for me to grow it sustainably. https://yakread.com/ May 24, 2023 at 10:29AM

Show HN: I made a Chrome extension to hide history in ChatGPT https://news.ycombinator.com/item?id=36056404

Show HN: I made a Chrome extension to hide history in ChatGPT https://chrome.google.com/webstore/detail/hide-chatgpt-history/nclfjbhifakabnbohdppoghfdhmlbgak May 24, 2023 at 04:15AM

Show HN: Mental Models for Startup Founders https://news.ycombinator.com/item?id=36054769

Show HN: Mental Models for Startup Founders Hello HN, I launched Wingify/VWO (Visual Website Optimizer) here on HN in 2010. The initial momentum and feedback I got from this place was a key reason I was able to profitably bootstrap the company to roughly ~$30MN ARR. Over the last 2 years, I have been writing a book for startup founders that's informed by my experience with Wingify and many failed attempts before it. It's finally done, so thought of launching it on the same forum where it all started for me :) There are a total of 68 mental models covering various aspects of building a startup: - Choosing markets - Building products - Ecosystems and partners - Thinking about Moats - Approaching marketing - B2B v/s B2C - Hiring & culture Unlike other books, I'm not sharing my story and neither take a very prescriptive approach. Rather, I use mental models to shine light and provide a tractable way of looking at problems an entrepreneur encounters during her startup. I understand that entrepreneurship cannot be systemized, but I'm hoping some of the mental models I share help in clearer thinking and faster decisions. Would love your feedback on the book: https://invertedpassion.com/free-book-mental-models-for-star... If you find it useful, please share it with others in your network. https://invertedpassion.com/free-book-mental-models-for-startup-founders/ May 23, 2023 at 11:27PM

Show HN: Defguard – open-source security army knife (Identity,MFA,VPN,Yubikey) https://news.ycombinator.com/item?id=36056080

Show HN: Defguard – open-source security army knife (Identity,MFA,VPN,Yubikey) https://github.com/DefGuard/defguard May 24, 2023 at 03:27AM

Show HN: Dark Mode for HN https://news.ycombinator.com/item?id=36055506

Show HN: Dark Mode for HN https://chrome.google.com/webstore/detail/hacker-news-dark-mode/jnmbfobflanbemhhphppnjmfhhfdkegd May 24, 2023 at 01:41AM

Show HN: Veml – Vector Embedding Markup Language https://news.ycombinator.com/item?id=36045029

Show HN: Veml – Vector Embedding Markup Language https://github.com/embedditor/veml May 23, 2023 at 07:43AM

Show HN: Willow Inference Server: Optimized ASR/TTS/LLM for Willow/WebRTC/REST https://news.ycombinator.com/item?id=36044755

Show HN: Willow Inference Server: Optimized ASR/TTS/LLM for Willow/WebRTC/REST Hey HN! Willow Inference Server (WIS) is a focused and highly optimized language inference server implementation. Our goal is to "automagically" enable performant, cost-effective self-hosting of released state of the art/best of breed models to enable speech and language tasks: Primarily targeting CUDA (works on CPU too) with support for low-end (cheap) devices such as the Tesla P4, GTX 1060, and up. Don't worry - it screams on an RTX 4090 too! (See benchmarks on Github). Memory optimized - all three default Whisper (base, medium, large-v2) models loaded simultaneously with TTS support inside of 6GB VRAM. LLM support defaults to int4 quantization (conversion scripts included). ASR/STT + TTS + Vicuna 13B require roughly 18GB VRAM. Less for 7B, of course! ASR. Heavy emphasis - Whisper optimized for very high quality as-close-to-real-time-as-possible speech recognition via a variety of means (Willow, WebRTC, POST a file, integration with devices and client applications, etc). Results in hundreds of milliseconds or less for most intended speech tasks. See YouTube WebRTC demo[0]. TTS. Primarily provided for assistant tasks (like Willow!) and visually impaired users. LLM. Optionally pass input through a provided/configured LLM for question answering, chatbot, and assistant tasks. Currently supports LLaMA deriviates with strong preference for Vicuna (I like 13B). Built in support for quantization to int4 to conserve GPU memory. Support for a variety of transports. REST, WebRTC, Web Sockets (primarily for LLM). Performance and memory optimized. Leverages CTranslate2 for Whisper support and AutoGPTQ for LLMs. Willow support. WIS powers the Tovera hosted best-effort example server Willow users enjoy. Support for WebRTC - stream audio in real-time from browsers or WebRTC applications to optimize quality and response time. Heavily optimized for long-running sessions using WebRTC audio track management. Leave your session open for days at a time and have self-hosted ASR transcription within hundreds of milliseconds while conserving network bandwidth and CPU! Support for custom TTS voices. With relatively small audio recordings WIS can create and manage custom TTS voices. See API documentation for more information. Much like the release of Willow[1] last week this is an early release but we had a great response from HN and are looking forward to hearing what everyone thinks! [0] - https://www.youtube.com/watch?v=PxCO5eONqSQ [1] - https://github.com/toverainc/willow https://github.com/toverainc/willow-inference-server May 23, 2023 at 07:22AM

Show HN: A recipe parser to get rid of the cruft. I need you to break it https://news.ycombinator.com/item?id=36043947

Show HN: A recipe parser to get rid of the cruft. I need you to break it I made a recipe parser to get rid of all the cruft on recipes. Check it out: https://recipeplz.fly.dev/ Has this been done? Yes. Does this project use AI? Also yes...but barely. What it does do is grab various forms of metadata that recipe sites often provide for SEO reasons (as per schema.org Recipe spec). It's commonly ld+json, but can be other formats as well. The trick is this: What the numerous recipe sites output is not always the same - there are many variations of the schema.org specs used for Recipes, so this project attempts to correct for that. It's just a bunch of conditionals. If all else fails, it uses AI as a fallback to parse a recipe and return valid ld+json Recipe data based on Schema.org's Recipe spec. I even say "please" to the AI overlords. If a request for a recipe seems to take a long time, you'll know it's pinging OpenAI's API (the Chat API via the 3.5-turbo model). I'd love to see if you can find a recipe that breaks it! May 23, 2023 at 06:29AM

Show HN: A better IP Lookup tool I made https://news.ycombinator.com/item?id=36043315

Show HN: A better IP Lookup tool I made Most other IP lookup tools I've found are mostly just trying to push you to signup for their API, which is fine but less useful if you're just trying to figure out which IP addresses in your log files are from sketchy locations and likely to do bad things to your application. I merged together a bunch of APIs and some of our own honeypot collected data to make something I hope devs and security folks find useful. If you want to try out a "bad" IP, try this one: https://wafris.org/ip-lookup/104.244.72.115 https://wafris.org/ip-lookup May 23, 2023 at 05:27AM

Show HN: MrScraper AI – Dead simple web scraper (powered by AI) https://news.ycombinator.com/item?id=36041016

Show HN: MrScraper AI – Dead simple web scraper (powered by AI) I've decided to test a new approach in my web scraping app. What do you think? https://mrscraper.com/ai May 23, 2023 at 12:20AM

Show HN: I made Hazumi, a modern HN reader for iOS https://news.ycombinator.com/item?id=36031944

Show HN: I made Hazumi, a modern HN reader for iOS Hello HN, I'm thrilled to announce the launch of my first app, Hazumi, a Hacker News reader, available for free on iOS! I’ve been lurking on HN for around 2 years while working on this project seeing people post amazing HN reader apps of their own. I’ve always figured Hazumi wasn’t good enough yet to post here but if I wait around until I’m ready, I’ll probably never share so here goes… Hazumi is a modern Hacker News app for your pocket with some intentional limitations. Stories are displayed on a simple colourful card, with images, that condenses all the information you need at a glance. Out of the box you get accessibility features for system settings like light/dark mode and text size. Others are controlled in app for opening stories in a Web View vs externally via Safari, defaulting to Reader Mode and reducing animation bounciness. You can browse top, new and best sections, limited to 30 stories each, which refresh every hour on the server. I’m not a fan of infinite scrolling or spending a lot of time reading news. I just want to get in and get out while keeping up on the latest. Other notable features: - Basic search - Widgets for your Home and Lock Screen - Apple Watch app - Warns you of non-HTTPS links There are a few “PRO” features that require a subscription ($/€1.99 monthly): - AI summaries of comments on stories that have at least 30 root level comments - In app newsletter (yesterday’s top 10 stories) - Bookmarking with iCloud support - Themes (change the colour of the cards) - Supporting indie developers and keeping the lights on for Hazumi Working on: - Better comments/tappable links - Enhancing search - More themes Being the first version, it's very early days for Hazumi and there are bugs that I’m working on fixing. I'm eager to improve it and shape its future based on your input. I welcome any feedback you may have, whether it's about existing features or ideas for new ones. Your thoughts will be instrumental in shaping Hazumi, making it an even more useful tool for tech news enthusiasts. Please give it a try and let me know your thoughts. P.S. Shout out to MB and MC for your awesome feedback during the TestFlight beta! https://apps.apple.com/ie/app/hazumi/id1670237209 May 22, 2023 at 07:31AM

Show HN: Aimless.js – the missing js randomness library https://news.ycombinator.com/item?id=36037607

Show HN: Aimless.js – the missing js randomness library https://github.com/ChrisCavs/aimless.js May 22, 2023 at 03:41PM

Show HN: Blotter – An interactive, never ending music video https://news.ycombinator.com/item?id=36037419

Show HN: Blotter – An interactive, never ending music video One day I was listening to a playlist and wished there could be some cool visuals to go along with it. Blotter is a proof of concept I hacked together that does a bit of audio recognition combined with a few generative AI models (both text and img) to create visuals that are relevant to the song. The video stream is generated in real time at 24fps - you can try it yourself by requesting visuals in the Twitch chat using the "!v" command! Right now it's mostly a fun hack project, but I am tinkering with new model architectures for higher fidelity video as well as an interactive tool so people can make videos with their own audio files. I'd love to hear any feedback or suggestions, thanks! https://www.twitch.tv/blotterstream May 22, 2023 at 03:21PM

Show HN: Psychic - An open-source integration platform for unstructured data https://news.ycombinator.com/item?id=36032081

Show HN: Psychic - An open-source integration platform for unstructured data My cofounder and I used to work at Robinhood where we shipped the company’s first OAuth integrations, so we know a lot about how data moves between companies. For example, we know that the pain of building new API integrations scales with the level of fragmentation and number of competing "standards". In the current meta, we see this pain with a lot of AI startups who invariably need to connect to their customers data, but have to support 50+ integrations before they even scale to 50+ customers. This is the process for an AI startup to add a new integration for a customer: - Pore over the API docs for each source application and write a connector for each - Play email tag to find the right stakeholders and get them to share sensitive API keys, or give them an OAuth app. It can take 6+ weeks for some platforms to review new OAuth apps - Normalize data that arrives in a different formats from each source (HTML, XML, text dumps, 3 different flavors of markdown, JSON, etc) - Figure out what data should be vectorized, what should be stored as SQL, and what should be discarded - Detect when data has been updated and synchronize it - Monitor when pipelines break so data doesn’t go stale This is a LOT of work for something that doesn’t move the needle on product quality. That’s why we built Psychic.dev to be the fastest and most secure way for startups to connect to their customer’s data. You integrate once with our universal APIs and get N integrations with CRMs, knowledge bases, ticketing systems and more with no incremental engineering effort. We abstract away the quirks of each data source into Document and Conversation data models, and try to find a good balance to allow for deep integrations while maintaining broad utility. Since it’s open source, we encourage founders to fork and extend our data models to fit their needs as they evolve, even if it means migrating off our paid version. To see an example in action, check out our demo repo here: https://github.com/psychic-api/psychic-langchain-tutorial/ We are also open source and open to contributions, learn more at docs.psychic.dev or by emailing us at founders@psychic.dev! https://github.com/psychic-api/psychic May 22, 2023 at 07:41AM

Show HN: Airbroke, open souce error catcher https://news.ycombinator.com/item?id=36030843

Show HN: Airbroke, open souce error catcher tired of errbit https://github.com/icoretech/airbroke May 22, 2023 at 05:56AM

Show HN: ClipBase - YouTube Full Text Search – Search videos by words spoken https://news.ycombinator.com/item?id=36028833

Show HN: ClipBase - YouTube Full Text Search – Search videos by words spoken https://clipbase.xyz May 22, 2023 at 01:39AM

Show HN: WikTok – A Recommendation UI for Wikipedia https://news.ycombinator.com/item?id=36028940

Show HN: WikTok – A Recommendation UI for Wikipedia Hi HN, WikTok is a UI for Wikipedia that lets you quickly swipe (or use your arrow keys) to navigate between random and recommended articles (based on the previous articles you interacted most with). It's just a fun project I hacked together this weekend, so may be a little rough around the edges, but I'd love to get your thoughts. Let me know if you have any suggestions (or find any interesting articles!) Cheers, https://wiktok.org/ May 22, 2023 at 01:59AM

Show HN: Trogon – An automatic TUI for command line apps https://news.ycombinator.com/item?id=36020717

Show HN: Trogon – An automatic TUI for command line apps Hi HN, Trogon is a project to generate a TUI for command line apps. It presents the arguments, options, and switches as a form. Editing the form generates a command line, which you can then run with a keypress. I'm a lover of the command line. But I can recall only a fraction of the switches for most commands I use. I would love it if there was a TUI available for most commands. Trogon currently works with Python and the Click library, but I would like it to cover more of the Python ecosystem and also generate TUIs for apps not written in Python. More information in the repository. Let me know what you think... https://github.com/Textualize/trogon May 21, 2023 at 06:36AM