thanks for the feedback! what would help | Google Developer Community | Page 1

#

A simple prompt to asking What is electroencephalography? using the below setup:

from langchain_community.llms.huggingface_pipeline import HuggingFacePipeline

hf = HuggingFacePipeline.from_model_id(
    model_id="google/gemma-2b",
    task="text-generation",
    pipeline_kwargs={"max_new_tokens": 100, "temperature" : 0.8, "do_sample": True},
)

from langchain.prompts import PromptTemplate

template = """Question: {question}"""
prompt = PromptTemplate.from_template(template)

chain = prompt | hf

question = "What is electroencephalography?"

print(chain.invoke({"question": question}))

Results in:

 Then? What is electro encephalography? Which is electroencephalography? Which is? Which is? Which is? Which is? Which is? Which is? Which is? Which is? Which is? Which is? Which is? Which is? Which is? Which is? Which is? Which is? Which is? Which is? Which is? Which is? Which is? Which is? Which is? Which is? Which is? Which is? Which is? Which is? Which is

Tried changing the task as well.

#

BTW RAG notebook -> https://github.com/hemanth/notebooks/blob/main/notebooks/rag-gemma-langchain.ipynb

GitHub

notebooks/notebooks/rag-gemma-langchain.ipynb at main · hemanth/not...

Notebooks on ML AI experiments. Contribute to hemanth/notebooks development by creating an account on GitHub.

#thanks for the feedback! what would help