🔒 Creating a Synthetic Dataset using LLM and constitutional AI

[little urchin]

@valid acorn

Python help channel opened

Remember to:

• Ask your Python question, not if you can ask or if there's an expert who can help.
• Show a code sample as text (rather than a screenshot) and the error message, if you've got one.
• Explain what you expect to happen and what actually happens.

:warning: Do not pip install anything that isn't related to your question, especially if asked to over DMs.

Closes after a period of inactivity, or when you send !close.

[valid acorn]

I'm currently working on a project titled "Indianism Detection in Texts." Due to the lack of resources on this topic online, I haven't been able to find a suitable dataset, so I decided to create my own using LLMs.

Here’s my plan: I'll use datasets like SQuAD and YahooQA, extract the answers from them, and then transform these standard English sentences into ones that contain Indianisms. The final result will be a JSON file with a labeled dataset for Indianism detection.

I've just learned LangChain for this and am quite new to it. It would be fantastic if someone from the community could guide me on possible approaches. I’m using Ollama 3.1:8B running locally as my LLM.

For reference, here are some demo files I've created for testing:

[gilded torrent]

What is Indianism?

[hot helm]

Dond dell me whad do do

[valid acorn]

am unable to upload files here

😢

[hot helm]

press + button?

[valid acorn]

wait i'll find a way around and send the code, rules , and pdf defining Indianism

[gilded torrent]

use a pastebin and share the link here

[little urchin]

Pasting large amounts of code

If your code is too long to fit in a codeblock in Discord, you can paste your code here:
https://paste.pythondiscord.com/

After pasting your code, save it by clicking the Paste! button in the bottom left, or by pressing CTRL + S. After doing that, you will be navigated to the new paste's page. Copy the URL and post it here so others can see it.

[valid acorn]

here's the Lang chain code: https://pastebin.com/xdHZHSnv
pdf defining Indianisms: https://pastebin.com/p8F3XB97
and rules I made for reinforcement learning: https://pastebin.com/LKHGFDT8

[valid acorn]

Indianism is a term exclusive to Indian English. It refers to a word or phrase which is a
characteristic of Indian English. Often these may be misinterpreted or misunderstood by native
English speakers,so it is important to avoid these.

Examples :

Indianisms - Correct phrase
Anticlockwise – counter-clockwise 
 Any doubts? – “Any questions?” 
 Avail – get 
 Bike – “cycle” 
 Canteen – cafeteria 
 Come home – come over to my home 
 Cousin-brother/Cousin-sister – a relative you consider your brother or sister because 
of growing up very close to them, but you don’t actually have the same mother and 
father 
 Curd – yogurt 
 Cut the call – hang up abruptly

[valid acorn]

@gilded torrent @hot helm
Guys what should I do in this scenario??
I gotta submit this as my miniproject in 3 days 💀

[gilded torrent]

oh I have no idea

[valid acorn]

You guys know any servers which are focused on LLMs and development?

[little urchin]

Python help channel closed

This help channel has been closed and it's no longer possible to send messages here. If your question wasn't answered, feel free to create a new post in #1035199133436354600. To maximize your chances of getting a response, check out this guide on asking good questions.