About 1 month ago, I published this post below:
In that post, I mentioned the increasing number of posts generated by COMPLETELY AI on the internet and DEV.to. We've even talked/discussed with many authors in the comments section, we had a brainstorm. I've seen that many people were actually complaining about this issue.
As I was thinking about this issue, I realised that it is actually possible to separate content that is COMPLETELY AI generated with a method using both AI app and humans.
I've seen many AI content detector software on the internet, but frankly I don't like any of them because they don't properly describe the AI detected patterns. They produce low quality results.
Open Source AI-Content-Detector App
To show how simple it is and how effective Prompt Template is, I developed an Open Source AI Content Detector App using AWS Bedrock and Llama 3.1 405B parameters LLM.
GitHub Link: https://github.com/omerbsezer/AI-Content-Detector
git clone https://github.com/omerbsezer/AI-Content-Detector
pip install -r requirements.txt
python -m streamlit run .\main.py
It is simple tool using AWS Bedrock Service - Llama 3.1 405B
- to give AI generated score,
- to analyze and explain how much input text is AI generated.
I tested with COMPLETELY AI Generated and HUMAN Generated Content
AI Score for Human Generated Text in App
Please have a look below Demo GIF/Video for Human-Generated Post:
AI Score for COMPLETELY AI Generated Text
Please have a look below Demo GIF/Video for AI-Generated Post:
How do we proceed to separate COMPLETELY AI vs HUMAN generated posts?
As mentioned above, in Dev.to, we can use both community and AI app together to eliminate the COMPLETELY AI posts.
Step 1: Give people the option to tag COMPLETELY AI-generated content, and if 5-6 people agree, move to step 2.
Step 2: Uploading the content to the AI Content Detector app and if it scores above 50%, notifying the author with detected patterns, removing the article or ensuring that more people do not see the article.
Maybe, Dev.to management will see this article, and maybe it will inspire them.
Let's Discuss! 🤝
How is this idea? Alternative Ideas?
I am throwing a letter in a bottle into the ocean, maybe someone reads it, maybe nobody.. If anybody read/agree, pls write something in comments, or am I alone?
Top comments (7)
Brilliant post! I’m excited to apply this! 🎉
Sooner or later we will have a skill to detect AI generated content without any software help. But this program are very welcoming ... untill our skill raise enough high level.
Thank you very much for your opinion and good wishes. Yes, we can separate the content generated with COMPLETELY AI by using AI and improve the quality of the content. It is also a good motivation to develop applications with LLM 😉
How can this AI content detector help businesses like mine in distinguishing between human-written and AI-generated content, especially when it comes to ensuring authenticity in product descriptions or marketing materials?
Thank you for your comment. If you have a comment, content area on your platform/website that is entered by everyone, and you don't want completely AI generated content, software such as this type of AI content detector can help you. As I mentioned in the article, there is an increasing number of COMPLETELY AI-generated posts on Dev.to and on the internet, which has started to prevent the human labour from being seen and causes a decrease in the quality of the article. This is a humble idea to show how this can be prevented with a simple LLM application.
@ben @jess @peter I think you realized it, even you considered before.. I'm a new writer in DEV community. I just want to express my humble opinion, maybe, you can see it from here, thanks :)
Looking into this further, thanks for the mention