New ask Hacker News story: Ask HN: How to Find Anomalies in JSONs?
Ask HN: How to Find Anomalies in JSONs?
2 by thiago_fm | 0 comments on Hacker News.
Hello everyone, I have some JSON files(>1000, possibly stream of JSONs) which look quite similar. If I want to find anomalies among them, what would be the way to go? I saw that k-means isn't the best method. I don't want to find particularly examples which are just a little bit different from others, but examples which are VERY different. If you ever did web development, you might as well in your life have got a strange error inside a JSON instead of what you expected. I want to be able to get it with an algorithm. Why I want to do that? I have a few APIs I use, but sometimes they end up changing those responses or give out unknown response body's. I want my algorithm/model to be able to detect them and show me a list of the biggest anomalies. If I manage to do it successfully, I'll make sure it's open source. Also if you know an easy way or an OSS solution, please also share). Hell, even if you know what I should study! I was studying deep learning but didn't find any known methods by me that I could use in order to make sense of that data.
2 by thiago_fm | 0 comments on Hacker News.
Hello everyone, I have some JSON files(>1000, possibly stream of JSONs) which look quite similar. If I want to find anomalies among them, what would be the way to go? I saw that k-means isn't the best method. I don't want to find particularly examples which are just a little bit different from others, but examples which are VERY different. If you ever did web development, you might as well in your life have got a strange error inside a JSON instead of what you expected. I want to be able to get it with an algorithm. Why I want to do that? I have a few APIs I use, but sometimes they end up changing those responses or give out unknown response body's. I want my algorithm/model to be able to detect them and show me a list of the biggest anomalies. If I manage to do it successfully, I'll make sure it's open source. Also if you know an easy way or an OSS solution, please also share). Hell, even if you know what I should study! I was studying deep learning but didn't find any known methods by me that I could use in order to make sense of that data.
Comments
Post a Comment