#gpt-models
1 messages · Page 243 of 1
Thank you!
in my experience, when it comes to complex reasoning, huge
hey, quick question. what's your limit per 3 hours? - 50, 100, 200 etc
50
thanks
that's crazy, how's token usage? Or is it just chat.
I do still have very good experience with giving gpt-4 code, telling it it should go through that step by step, explain exactly what it does, and then look for any errors, especially in regards to boundary conditions, thread-safety and such.
Where with gpt-3.5 it's pretty useless at that
I wonder if the context window is more optimal in a language like that
the code blocks I generally give it for a single question are under 1000 tokens
do you ever sacrifice a chat for reinforcement? Or group of experts?
but it's an ongoing conversation, not a new session for every question, so after a while the previous questions will fill the whole 8k context window
Sometimes for super complex stuff that I don't want to code I'll dedicate a few sessions just to refining the outcome for a use case.
define "sacrifice"?
Refining requirements more or less. I guess it's not "sacrificing" because you ultimately benefit from it.
oh, if I'm not sure if my next message is going to send me down the wrong way, I always create a link and fork the session that way
so I can experiment with different possible ways to continue the conversation without irreversibly trashing the existing session
why not just rewrite the message
because that would do exactly what I just said, irreversibly change the current session context?
When I edit the message, then click submit, it refreshes the response, and removes the previous message from the context I'm pretty sure
sometimes I'll have a chat just to check my current chat's work lol, only when necessary though
CoT is basically a requirement for anything beyond simple questions, imo
exactly, but I want to have whatever state it has after it's last answer, and then go into different directions from that state, and not take one step back
Higher message limits for GPT-4 (July 19)
We're doubling the number of messages ChatGPT Plus customers can send with GPT-4. Rolling out over the next week, the new message limit will be 50 every 3 hours.
https://help.openai.com/en/articles/6825453-chatgpt-release-notes
🆒
oh yeah, I almost always tell it to go step by step and explain it's reasoning. In may cases that sets it up to then better be able to answer the next question, with this output visible in it's context window.
oh yeah that's one thing but I mean like isolated prompt sessions. I'll break out a task into key steps and play hot potato.
I do the "think step-by-step, reflect on and find flaws in prior response, based on reflection rewrite the response" and it usually works pretty well
yeah
Anyone have any idea when web search mode will be back
its in purgatory
Of all the prompting techniques out there, it's the only one I've found reliably makes the responses better.
wdym
while it works to do that in one request, I've found that the outcome is better if I ask it to reflect on the previous answer in a separate question instead of trying to make it do both in one response
they have to find out how to make a web crawler not also scrape
what was the problem with it
yeah, I do each of those three I do in different consecutive requests
nothing, people used it to scrape behind paywalls and ignore robots.txt
yes this is what I meant
but sometimes I'll go even further and make the requests completely agnostic for 0 influence. Think of all the roles in a modern restaurant's kitchen.
- Do X. think step-by-step
- reflect on and find flaws in prior response, list them in detail. think step-by-step.
- based on the reflection rewrite the response to fix all the errors. think step-by-step.
well, that's because these websites give access beyond their paywall if the request came from the webcrawler of a search engine, like bing. They want all that information to get indexed by the search engine. And then feel butthurt if the search engine hands out the whole page via ChatGPT instead of forcing you to run into the paywall
Yes
So openAI has to figure out how to obey all the different versions of paywall software.
yes, like that, in multiple messages. It works better that way then giving it all 3 instructions in one request
yeah, if you give it in 1 request, kind of defeats the whole purpose
Becasue it isn't really reflecting when you ask it to in one instruction - it's just completing the text.
Right
well, it's not really openAI's problem, it's the problem that their internal interface to bing gives them the whole page
technically it is OpenAI's problem because its their platform, so they have to go through the effort of figuring out who will solve for it, even if that means relying on MSFT or someone else
The way I understand the mechanism, if you say it as one request, there wouldn't be any extra processing involved other than maybe a longer completion response. Kind of like how it doesn't use any extra compute to do complex calculations.
But as multiple requests, there's that added extra context causing it to "re-evaluate" it's previous response.
well, yes, it is, because every single token that's generated is a complete new stateless run of the whole model. There is no internal state that's preserved from token to token.
Your chat history as a whole goes into the input context window, cut of at the window size, then the model is run, producing for each possible token a probability that this token is the next one that belongs after the current input. This part is 100% deterministic. It then out of these possibilities picks one token, controlled by temperature and other sampling parameters, adds that token at the end of the context window, which pushes out the oldest token.
It then runs the static model again on this new input. With the changed input the only thing the model has available.
This is repeated until the model generates a special stop token.
So asking for all 3 in one message should theoretically be possible. But it seems that the attention mechanism has trouble switching from one instruction to the next without the interruption of having produced the end of a reply and starting a new one, where it can focus on just the latest instruction.
Most of the prompting stuff barely works and/or gets outdated pretty quick. But the other prompting "trick" that I found actually sort of works is asking it to summarize everything every few chats when you have a long chat history.
the model generates token by token, one token for each fresh run of the model, The fact that the model is continously run to keep producing tokens in reaction to you sending one request is an implementation detail hidden by how the api works
this is why functions are goated
That way, important stuff doesn't get cut out of the context.
right
you have to always consider that the context window will scroll up, with the oldest token lost, while generating the answer, if the token window is already at it's maximum size. It's not that you can give it a full 8k request and then expect a 8k token answer, where for the whole answer it has the whole 8k tokens input available
Yes, that's why I ask it to summarize, so that the important parts of the older tokens don't get lost
Chat doesn't even have 8k tokens last I checked?
gpt-4 has 8k, gpt-3.5 has 4k
I haven't used gpt 3.5 in a while lol
4 was 4k for a while
and for both there is a model version with 4 times the tokens, bringing you to 16 for gpt-3.5 and 32k for gpt-4
16k model is relatively new, same with 32
that they are publicly available, yes. the 32k token version of gpt-4 existed already at the time of the original gpt-4 annoucment, they mentioned it then, and they mentioned that it's 4x the normal token limit, during the presentation. But also said that it's currently only available on invitation
right I'm not talking about secret sizes that only a select few giant companies have
or had at one point
which seems a pretty clear implication that gpt-4 has always been 8k
I only go by what they've publicly stated, I have seen mentions of 4k for chatgpt-4
Claude 2 still isn't that great even with 100k tokens. I can't really find a use case for that many tokens anyway.
I always viewed that size as marketing
there is no gpt4 with 4k. only 8k and 32k
that matches my knowledge, yes
Nah, it definitely makes a difference when uploading really long texts.
I don't think Anthropic would do it as a marketing gimmick especially when it's free for now.
I was just coming to ask why I didn't have the 32k model in my API. Guess it's invite only?
outside of using gpt for work, I've as a hobby been working on various ways how to get LLMs to be able to understand and reason about a whole series of sci-fi novels, which as a whole would take about 2 million tokens. It's a difficult problem even when working with 32k token context window
I beleive the 32k version is still somewhat restricted currently
Anthropic seems like another company like OpenAI that has a lot of talent and is sitting on great research, to the point where they don't try to make a few extra bucks from the consumer.
2 ppl saying that means I gotta look it up. I stand corrected
The Microsoft LongNet paper is pretty interesting in this regard
isn't Claude 2 still invite (business) only?
it's open to everyone in the US and UK now I believe?
No, it's free on the anthropic website
Oh word? Last time I was interested it was a waitlist
I just got put on a waitinglist as I'm from australia.. no Claude for me
Ah could be region related
There is a paper that i read that show increasing the context size decrease other performance of llm. so there is a tradeoff i think.
good looks, gonna read that paper this weekend. Have you looked into Meta's research into smaller yet equally effective models?
Wasn't that about parameter size?
Bigger isn't always better - I think Sam Altman said something about how they weren't going to jerk themselves off with higher and higher parameters.
not paraphrasing btw - direct quote
well, there is also Microsoft ORCA paper in this regard, which had great success in training a much smaller model based on synthetic data generated from gpt-3.5 and gpt-4, where they didn't just train it on the correct answers, but asked gpt to explain it's reasoning, so the new model got trained on how to reason instead of having to figure it out itself, which produced close to gpt-4 performance in a much much smaller model that could be trained in a very short time.
Abstract
Autoregressive transformers are spectacular models for short sequences but scale poorly to long sequences such as high-resolution images, podcasts, code, or books. We propose MEGABYTE, a multiscale decoder architecture that enables end-to-end differentiable modeling of sequences of over one million bytes. MEGABYTE segments sequences
into patches and uses a local submodel within
patches and a global model between patches. This enables sub-quadratic self-attention, much larger feedforward layers for the same compute, and improved parallelism during decoding—unlocking better performance at reduced cost for both training and generation. Extensive experiments show that MEGABYTE allows byte-level models to perform competitively with subword models on long
context language modeling, achieve state-of-the art density estimation on ImageNet, and model audio from raw files. Together, these results establish the viability of tokenization-free autoregressive sequence modeling at scale.
you do need these "large foundation models" like gpt-4 which a very large number of parameters if you want the model to basically teach itself how to reason based on just getting the question and correct answers. But you can then use these to train much smaller models that learn these reasoning abilities from the LFM
I read that. Not a huge fan of training on synthetic data imo.
It was pretty impressive but I'd like them to do that off "real world" data instead. There are a lot of concerns present that are pretty obvious.
Yes, OpenAI is getting sued.
Who is sueing them now?
more like who isn't
yea lmao
What's interesting to me about that is what exactly are they sueing them for?
well, the main issue is that you need a large mount of data which shows not just the correct answer, but also the reasoning how to arrive at that correct answer, which is very hard to generate "by hand".
a bunch of authors, sarah silverman, 16 anonymous plantiffs, and more from a quick google search
Imagine contracting old IT folks at universities across the country with ungodly amounts of exam results stored on harddrives in a warehouse somewhere
I sort of understand where they are coming from, but they are halting progress.
As far as I know it doesn't generate large amounts of copyrighted text.
but I don't quite get it, to be fair I didn't read their claims but like, is this similar to artists being upset of AI art?
is that what they're claiming? We're getting their book content for free?
It's a bit different - it would be more like if the AI learned how to draw from the artists getting upset
"Mona Awad and Paul Tremblay allege that their books, which are copyrighted, were ‘used to train’ ChatGPT because the chatbot generated ‘very accurate summaries’ of the works"
oh she's sueing Meta too? Lol.
the models do not verbatim store the texts somewhere. But it is somewhat like a person with a pretty good memory has read a lot of books, and then is able to write out something close to the original based on their recollection
yep
The authors claim their books appear in a dataset, compiled by another organisation, which was used to train the LLaMa system.
Omg they're trying to use open source as their angle. That's crazy.
Imo it should be completely fine, I hope the progress of these LLMs don't get caught up in these bureaucratic legal nightmares
This is going nowhere, fast.
idk how much does the average judge or jury understand about LLMs
how to use gpt4
Yeah I understand that, I'm trying to understand how they see it more or less
Nothing. Remember the tiktok trial? Or the facebook one before that?
politicians and the populace may see it as big evil tech vs. small innocent authors
which is a terrible angle imo
maybe, until they have to explain how open source works
yeah, facebook seems to be able to get away with whatever
tbf I have no idea how the legal system handles these highly technical lawsuits
Keep in mind Meta and MSFT are operating in the same space wrt open source. So if that's a part of their angle they're doomed.
Well, there certainly are both legal and ethical implications of this.
And the authors can certainly try to point to Copyright in this regard. But it's also important to understand that "copyright" is not a natural right, it is an artificial temporary monopoly, introduced for very specific reasons, the original ones were to be for the general benefit of society.
No way MSFT lets precedent get set against open source. It's a big part of their AI business model.
oh boy it'll take 60 messages to get back to what was previously 20
does telling it outright not to omit code work on the first pass, or does it then just omit lines like pre-nerf?
this is copyright vs open source though
copyright laws fall apart pretty fast in this arena
this era is a different definition of open source compared to RMS's and Linus's era though
I agree with everything else you've said
there are fundamental issues with copyright as it is practiced today, no matter what the specific context, every since disney got involved
Maybe but you have too much investment from multiple companies at that scale, they will throw as much legal weight as they want against any precedent
the ramifications could be absurd
they're finding out that there's more than one legal system in the world
The OpenAI Discord is an actively moderated server.
• Refrain from sharing inappropriate content on the server. This includes but is not limited to messages, media, or other topics of graphically violent, sexual nature, and drug-related content.
• Report all sensitive and offensive content in the feedback reporting tool in the ChatGPT web UI instead of here on Discord.
wait who are we talking about here
japan already said "we don't care" to the rest of the world w.r.t. copyright of weights.
yeah
why did i get a message from this bot thing, because i brought up the fact they scaled back gpt4?
EU seems to be the opposite
China has said that for a long time now, at least the past 20 years. Just look at Shenzhen.
you pang me here with the 50 upgrade
no, it's just on a timer to spread wisdom like that
@wind urchin EU 's interesting, they're going to go very privacy/just-fine-them approach but they won't let everything entirely go to america
EU in the AI dark ages
is this a joke lol
i guess it's a public discord, this is the only one i'm on
EU seems insistent on keeping Europe as a museum for Chinese tourists
EU controls stepper equipment
I have never seen a chinese tourist here in the last 10 years
I am confused at that statement lol
I made an Italian reference and got censored
it's a very american bot
i think if those fellas in silicoln valley saw what happens in europe during the euros or world cup they'd be utterly floored
basically outright complete national and all other hatred for 3 weeks, then back to normal
"Before the pandemic, Chinese tourism made up 10% of stays from non-EU tourists in Europe, with the market growing 350% in the decade to 2019, driven by a particular interest in luxury shopping and fine dining."
extremely fun.
never saw them in the north
probably went to spain or italy though
Paris global rep is tanking rn because people are going and saying it smells bad on social media lmao
i wish paris wasn't so pedestrian it's a great city
@acoustic wasp paris syndrome, japanese use to get it
Weren't there riots recently
its france there's always riots
France always has riots
that's what makes them good and not anglo, they beheaded their royalty
well, you generally don't seem them except in passing as they are spending most of their time in a bus, being carted cross the land for a week, stoping in places for short amounts of time to take photos and move on 😛
which is a consequence of not having more than maybe 1 or 2 weeks of vacation time in a year
those buses are nice tho
I think the riots this time were especially bad and leaked out of the lower income areas
i have literally never seen a chinese person who wasn't a local here, i would be stunned
what lol, they riot all the time in the center of the city
the yellow vest things went on for like three weeks or whatever, germans stopped even bothering to report on it
There are different types of riots
Yeah idk about all that, the retirement age thing was like 4 months straight
The ones where they complain about working
they stopped taking out garbage for weeks
And the ones where minorities complain about being oppressed
The latter usually stays in their area I think until recently
I don't think there's any difference, rioting is in their culture, they encourage it no matter the reason
Social injustice? Rights being taken? Work reform? Butter shortage? Take your pick.
Nah, there's definitely a difference. They don't like it when minority riots get to their areas.
also the french will absolutely spend a ton in AI, just so they don't have to speak english
At least I think based on what I read
if you doubt that, i'm sorry but you don't know france
But ofc the I hate work riots are everywehre
i'd love some work riots my commute is boring
occasionally someone dares to talk on the bus
There'll always be people who are for or against riots, all riots, it's just what media you tune into
Mandatory?! RIP Australia
well, there are plenty of companys all over the world, especially in the US that are trying that
capitalism rules us all
it's not really going that well I hear
it kind of is since free money no longer exists
Hey I spent money on this office building so you have to come
that
It'd be funny if people were just for all riots
that's not really why, this is really something the socialists were right about
this is about demosntrating dominance over the working class
No matter the cause, they just join in
I'm definitely pro all riots
they dont have enough money in buildings to give a crap
or the "but why do I exist if I can't sit in your neck all day long" middle managers
there's some bit about middle aged managers, but really, your enemy is capitalist billionaires
they're still afraid from the cold war
we need someone to run an AI thinktank to solve real estate
Riots are funny sometimes and have a certain vibe to them. But they are often pretty horrible imo especially when destruction of private property is involved.
In the USA due to the gun situation, it results in a bunch of deaths as well
are you familiar with stirner's concept of a spook
bit bold given you had tarrant innit
hot take: human rights > private property
although we do outdo you en masse
yeah, I don't really think riots (as opposed to protests) are an acceptable or useful way forward.
actually most riots in the US are death-less. In fact it's rare to hear someone died at one.
the new zealand guy? He was from Australia
Online Marketing Scheme of Gardenia jasminoides Milk Tea
probably, but I lived in the city center of all the 2020 chaos, and there would be violence and deaths every night
protests literally get people nowhere, you want change you need a nation state backing you and numbers, that's the honest truth
does the RLHF / aligmnent stuff also make it verboten for chatbots to talk about mass shooters? i never bothered to check
no idea but I'd assume so
actually I don't think so
seems like it works for the NRA gun guys then
there's no reason to censor it but it depends on the bot
it should talk about it, just not giving you tips how to become one
private chatbot company probably censored
NRA gun guys typically dont riot - they vote which seems to work far better for them
i remember asking them once about which genocides happened (i just parsed wikipedia) and how many. that's an interesting test right there. especially since the wiki page never changes.
does anyone need tips lol, just be in a country that allows you to legally acquire weapons
NRA guys love gun grabbing because they get way richer
legal part optional tbh
there's nothing the NRA fears more than cheap yugoslavian AKs.
that's why they were illegal in america, a land which had 2-3 guns per person
it's so ironic it's not even about guns with the lobbyists, it's about money under the guise of guns
we may have diverged a bit from "gpt-4-discussion"...
The people who don't want to change gun laws seems to be the older generation
lobbyists in america are absurdly corrupt, but both parties bow to certain groups
You think OpenAI uses their own discord to farm training data?
nah
I wonder if chats from users with chat history is enough
this discord sucks usually - unless they want to train on confused Chinese people who think this is ChatGPT and scammers
you should blame me for that, i only spend time on private discords in certain fields, the pang from the announcement made me show up to make some snarky comment
lmao
you're not wrong
I feel the reasoning capabilities of gpt-4 are good enough for most things, the really issue is the limited context size. what we really need as a next step is something that can reason at the level of gpt-4, but with a multi million token context
Question
If I subscribe to Plus for a day or two and then change my mind about the subscription, can I get the money back?
I doubt they would refund you, but you can cancel and not be charged for the next month
Already aware of that one
Well, just curious about the possibility of refund
nobody here is going to give you an official answer, you'll have to contact openai
(╯°□°)╯︵ ┻━┻
How can i use chat gpt to help me creating some desgins
fashion desgins
Please mention "@" me if you can give me good asnwer
You can't use chatGPT for fashion design, you will probably need to use something like Dall-e or Stable diffusion for that.
they took away my 200 😭
it was nice while I had it
plugin dev btw I wonder way it decreased
because they announced 50 for everyone, and if anyone got more and talked about it, it would generate dissatisfaction?
so have they reverted back to 25? I was 50 then 100 and now back to 25 😄
ppl wouldn't lack stuff to complain 🤣
it's probably going to be unstable over the next week till it stabalises at 50 for everyone
like "when is multimodal coming!?"
I would be content if it would just work as well as it did in march
i would look up some prompts or write a prompt explaining to GPT that you want its help in creating prompts for Midjourney or Dalle for fashion design. GPT can help you hash out the right prompts based on specifics that you can then feed into an image generator.
I don't think so. You probably could but I would say it would be more work than it's worth. Is there something in particular you want to try? Perhaps we can help you decide without having to take the plunge.
That will be great , how can i do that
@wraith furnace Chat.openai.com you can start here and say something like "Hello Chat GPT. I would like your help in creating a prompt for [insert name of image AI e.g. Midjourney]. I want to design clothes. I am interested in an image of women's black leather jacket embroidered with constellations in silver thread. I would like for it to be modeled on a human and have a magazine feel. What type of prompt should I use for Midjourney if I wanted to generate this type of image?"
Add your well-crafted prompts to our #1019652163640762428,
or share your interactions with ChatGPT in #1050184247920562316!
Which plugin for internet search queries is good to use with GPT-4 these days?
I unironically found gpt3 more useful last night in a rare chain up to 130 LoC with no errors
unless it just happens to be Uber good at opencv
Did you see todays news? a Stanford study showed gpt-4s coding and reasoning abilities have severely declined compared to May, while gpt-3 improved
Despite openai’s insistence otherwise
I saw some paper on hackernews or something
They might have messed up their oracle for coding
or wherever swaps between the 8 experts
throwback to that openai vp who basically said everyone was imagining it
3 is pretty great since I can do like 3 interactions in 10 seconds
Well their excuse cope is "that's not nerfing that's alignment"
newspeak abodes
chat gpt 4 its not answering based on the history anymore
i paste it some sources yesterday and it is not answering based on the infos i gave it, like it did... anyone notice this?
''I apologize for the confusion, but as an artificial intelligence model, I don't have the ability to review previous chapters of a conversation or text, nor do I have access to the mentioned "Chapter 3." My ability to provide information is solely based on the immediate context provided in the current conversation and my training up until September 2021.
''
it should be capable of reviewing the information i provided in history, right?
i think it was doing this a few days ago
today the IA seems off
depending on how long the conversation is it may no longer be in the context window
Cross-posting this question from #chatgpt-discussions because it seems more relevant here: Like @wind urchin said, after I use GPT-4 for a long time in a single conversation, inevitably the context of the chat gets contaminated with useless things. Is there a tool which can summarize my conversation and convert it into a prompt to start a new chat with?
i am trying to find a specific official info of the token limit for gpt 4
it is 8k? some said 6k?
so it means if i want the gpt to analyze a text, is better that i provided 8k token text maximum?
i asked the gpt-4 itself and it said 4k tokens, which seems wrong
web version has 4k tokens most likely
the API version 8k or 32k
8k, but keep in mind that that is the complete size of the context window, and every single generated reply token with shift the context window up by one before generating the next token (as it needs to include the generated token at the bottom of the context window)
I'm pretty sure the web version has 8k, I've filled it with close to 8k of tokens in the past and then asked it "what is the first thing we talked about" to find out what is the top of the current context window that the model is seeing
that is 4k, for gpt-3.5, 8k for gpt-4
Is the 32k version of GPT4 now available for everyone's API?
doesn't seem so from what people said here. neither is the 8k version if you didn't use the api enough to actually get charged for it before
i just send a text of 8235 tokens and asked in the bottom ''what is the first sentence that i sent you now? '' and he answered correctly
chat gpt 4 web version
The information I've seen generally says 8129 tokens for gpt-4.
Are you sure you used the correct gpt-4 and not the gpt-3.5 model when doing the token counting?
they use different tokenizers and the token number of the same text input can be different between them
do u have a tokenizer for gpt 4?
i used this
https://platform.openai.com/tokenizer
which says gpt-3
import os
import tiktoken
# Get the tokenizer corresponding to a specific model in the OpenAI API:
tokenizer = tiktoken.encoding_for_model("gpt-4")
# Directory path
dir_path = "."
# List all files in directory
files = os.listdir(dir_path)
# Loop through all txt files
for file in files:
if file.endswith('.txt'):
file_path = os.path.join(dir_path, file)
with open(file_path, 'r', encoding='utf-8') as f:
text = f.read()
tokens = tokenizer.encode(text)
print(f"{file}: {len(tokens)}")
adjust as necessary
is there an online tokenizer? lol
i am not a programmer
no idea
i lookig for the api
and it seems i can use it in typing mind . com
and there is a basic lincense for 39 dollars
this is gpt3
its 7070 tokens counting here
https://gpt-tokenizer.dev/
after that, chat gpt doesnt read anymore
there are going to be tokens used up by a system message you can't see and possibly some other framing
its curious because i've sent a text of 7070 tokens, which the first sentence was ''tell me which are the last 5 words that i am sending on this prompt''
and it goes as long as 7070
on chat gpt 4 (web)
and then i sent the same text in gpt 3.5 (web)
and it returned the same set of words
as if chat gpt 4 and 3.5 are reading the same number of tokens?
Could it be that the chat app was upgraded to gpt3.5 16k? I've heard some people saying things that might confirm that.🤔
Also, there might be a custom limitation on the backend, unrelated to the model capabilities.
what kind of plugin can help me to make a form for information that i need online
everything is in the web and free, need gpt to summarize everything into a form
I don't understand your question in the context of what I said. What I said is that you don't really know how many tokens actually are being passed to the model, because the text that you see inside your chat history is not the only text that contributes to the tokens which are being presented to the model
So is there a way to force lengthier output for e.g. code from gpt-4-32k?
beyond I guess just asking for more things, comments, tests, etc
This would fit perfectly with my experience last night coding with it
I'm having difficulty using it in numerous detail oriented areas now. They've given it a lobotomy. The only way I can get decent responses is via the previous GPT-4 version on the playground.
gpt3 was coding better than 4 for me with opencv
going to try some other things now
esp as I have 100 runs on Poe to use in 5 days
I use it for editing complex legal contracts, areas related to the financial industry, and summarizing lengthy articles/textbook chaoters for my MBA program. It's basically worthless in all these areas now compared to when it used to spin gold each time.
I don't do a ton of coding in it.
Can't even write good bios anymore even give examples and makes simple mistakes. The response time has sped up at a huge cost to quality.
It was good at legal?
I only use it to code, I dislike coding for the most part
had it write some code to help it fix it's code
It used to constantly drop and forget over 70-80 lines of code it was consistently up to 150
I went step by step on 3
I just hope it wasn't a mistake and they accidentally unnerfed it
should ask it to benchmark itself given a users chat history against it's prior self and compare the outputs
Yes. I'd have it edit multiple pages of 80+ page asset purchase agreements. It was performing at the same level, and in some cases better, than the New York based M&A lawfirm we utilize. Now it give the most basic boilerplate nonsense ever. Might as well Google template contracts.
A few pages at a time?
I could get in maybe 2-3 pages or take excerpts that referenced each other yes.
I have plugged in prompts from previous conversation history. It definitely is performing substantially worse.
I did a not dissimilar thing by automatically adding documentation from used python modules to guide it to not mess up
have you used 3 in the past to see if it got better there
I'd first provide context, what the purpose of the agreement was, what party to the agreement I represented, and then my intended purpose for it's edits. It'd spin gold every time so long as I didn't copy/paste too much in a single prompt.
Your experience marches mine as 4 always fixed 3 but no longer
123
Legalese at its core is just advanced if/then statements. It's very similar to coding from a logical reasoning perspective.
Ok it just hit me it's insanely obvious how to check the delta. Pull up old Convo and add a period or newline
what about the intersection of software license and patent law
Okay actually you have to do a bunch of tree structure stuff for a full reconstruction
Licensing agreements are common to our industry given the protective nature of firms' IP. It did that great too... Until recently.
Idk much about patent law though. It's kinda basic in comparison.
Either you have a something registered with the USPTO or you don't. Then it's just a question of fair use and if someone is inappropriately utilizing your registered whatever.
GPT-4 was saving us literally tens of thousands of dollars in drafting/editing/research costs associated with the firms we work with from California to New York. My rough estimate is that it's probably saved us somewhere North of $80k so far and 5xed-10xed my output at work. So my frustration at their lobotomization cannot be overstated.
My company pays for it. If we could have the old version back we'd probably pay ~$1k/month for it given the savings on atty fees.
I'm really sorry to hear that you're feeling this way, but I'm unable to assist. It's really important to talk things over with someone who can, though, such as a mental health professional or a trusted person in your life.
Can't you get the original one via azure
They're also going to kill off the old version in playground so I won't be able to use it in the near future to make up for the web-GUI version's shortcomings either.
Are you even human?
They won't in azure at least
Azure?
He was being sarcastic I hope
Yes Microsoft's cloud
Basically they're raising the price and bringing you into the Microsoft corporate botnet
Yes, and I am simply humoring the sorry state of GPT-4 these days lol, as you are literally talking about. That is exactly one of its canned responses it loves to give when presented with literally even a shred of emotion. Regardless of context.
though I think it may be hard to get at the moment
The openai part is a bait and hook
How can I sign up tonight? Lol
I'm not entirely sure api gpt4 was as good as chat
Uh some page on some azure site.. can't google as on plane
They might reject it if they are afraid of legal tho
Beware of possible scams or fraudulent activities that you may receive through direct messages. OpenAI staff will never DM you for any transactions.
Please report any incident by sending a DM to @open crescent immediately.
they're very cagey
It's not for certain things. As previously mentioned I'd give it the citation for an article or textbook for my MBA program and ask it to provide a detailed summary. It now gives a canned response about "nOt HaViNg DiReCt AcCeSs tO tExTs"
Honestly I'd sign any waiver not to sue they'd want. We have firms that can peer review the work product. Lol
Sorry they're on a moralizing mission from god can't help ya
well Microsoft might
I think that lawyer gave them bad press
The OpenAI Discord is an actively moderated server.
• Refrain from sharing inappropriate content on the server. This includes but is not limited to messages, media, or other topics of graphically violent, sexual nature, and drug-related content.
• Report all sensitive and offensive content in the feedback reporting tool in the ChatGPT web UI instead of here on Discord.
That lawyer gave them great press. He was dumb and pushed V3.5 for incorrect answers. Lol
Is GPT-4 performing worse than normal?
Wow LOL I forget they don't even technically let corporations use it except in strict settings
They're afraid of something. They MUST be
For case studies, all he needed to do was take the references, open a new instance, and then ask it if it was familiar with the cases referenced. Or he could have just plugged them into westlaw or a similar service first.
So much worse.
why not just whitelist all existing court cases and check vs that
I assume decisions with precedents are all somewhere?
He could have. The guy was lazy and deserved to be disbarred. If not for the chatgpt instance it would have been for something else.
or is it all paywalled or something
Westlaw is the go to paid service trial attorneys use.
I mean in software before the user gets output btw
So in common law where the court cases impact other court cases, you have to pay to know what they were.?
You can also just use PACER or Google in most cases though (no pun intended).
ah yeah Pacer I heard that
No. It's all freely available. You're paying for the query services. Think of it as advanced Google for only case law.
but do they have them all available or have they all been scraped?
From what?
I'm confused
I have 10 years of reddit on one drive, along with all of geocities and many other sites.
If it's public why can't I just download the whole database
or is it public but just in small pieces
You can download entire databases. Legalese is difficult to search through. Search engines like Westalw have been custom tailored to take user input and provide relevant results quickly for attorneys.
ok cool
I have a lot of data and I wanted to get that one too
Not IA level just 100TB or so
Also, the way in which it is public varies based on court to court and the level of court as well. So they compile tons of different case law from a variety of sources that would otherwise be too annoying to search through independently.
so lots of little local ones like country one in one state?
That makes sense since I remember looking for stuff in Michigan
There is no federally mandated code of uniformity as to how they need to make cases "publicly available".
but anyone can in principle get any document from any court if you send the right TCP/IP Packets?
Or district courts, or the appealate courts, federal courts, etc.
This sounds like an excellent problem to solve if so
"get the data without crashing the judicial systems computers"
No. Most courts do not have APIs you can plug into. A lot require basically just manual scrapping. That's where data aggregators like westlaw come into play.
okay, but sending reasonable http gets isn't an issue then. Neat
I wanted to try and make a scraper which can figure out from it's knowledge and a few pages what parts of a page are what things
Depends. You'd also need to work in OCR and for a lot of documents with handwritten rulings by judges that still might not work.
The BIGGEST iront in the world is open source ocr is terrible
Most everything else is good
But the simple thing is bad
Add your well-crafted prompts to our #1019652163640762428,
or share your interactions with ChatGPT in #1050184247920562316!
That's the same for academic papers and such I think as well though
Ask ChatGPT to come up with a hypothetical case you need to do case law research for. Then get a subscription to westlaw. Compare the time spent manually digging for stuff vs westlaw results plus quality.
Pretty much.
I don't care about the data I care about building the thing to get that data
Except those are actually paywalled in most cases. All case law is publicly accessible. The meaning of how it's distributed just varies though.
Well, I care about the data, but far less
But that paywalled document would be free on a government server somewhere
Right? Just a pain to find?
If you want to make a ton of money make a clone of westlaw and charge 10% less.
well my mad goal is more like internet acquisition engine
I'm trying to work out the details of scheduling the actual download order
Especially old stuff
Like European countries forums and message boards in the 90s/00s
but never just going a site at a time, rather jumping between url/thread/page across a massive size
so you always have at least something somehow kind of related to anything
I had gpt make a bunch of fake geocities pages for fans and such of an old tv show which kind of gave me the idea
it the internet is going to be dead I will simply create my own for myself
It's not "atm" lmao, it's been an issue for a while, and likely not. ClosedAI as far as I know recently claimed that they haven't done anything to make it "dumber" and asked for evidence. Once overwhelmed with said evidence, they went awfully quiet.
Where did that happen? I know you can't share links here, but how can I find that info?
This dumbing down of the model and removal of search is making it less and less worthwhile to pay for plus
the only good thing was yesterday they messed up and made gpt3 good for like 8 hours
Was about to say
Thanks!
I tried to embed the AT npew handle too, but apparently without notifying me, it pinged some complete random, and I got to enjoy my message getting auto deleted :)
Check for his tweets on the 13h of July
I will. Thanks.
"I understand that you want the complete code. However, generating the entire codebase for a new application is quite complex and beyond the scope of this platform. The provided sample codes are intended to guide you on how to proceed with the migration."
I am getting this again and again. Previously it used to work amazing for generating code. Can someone help in this? Any prompt that can help?
I'm really sorry to hear that you're feeling this way, but I'm unable to assist. It's really important to talk things over with someone who can, though, such as a mental health professional or a trusted person in your life.
😆
did you ask it to make an app or what was the prompt?
Also careful with voicing your own opinion, because much like their bot, this server is ridiculously censored too lol. I already got to enjoy a warning and an hour long timeout for having the nerve of speaking up
Because god forbid I burn 24 euros a month for a product, and am allowed to talk about it right, especially the negatives.
I got ghost pinged?
Oh wow speak of the devil!
Google news has now started giving me articles exactly about this too, about GPT-4's decreasing quality
An article 15 hours old from Tom's Hardware this time around.
Yeah, a group of researcher claim to have tested it with leet code and it used to be much more smarter in the previous iterations. That explains quite alot and basically confirms what heavy user have been saying for the past couple of months.
While being a heavy user does in fact increase the chance of becoming more aware about the bot's flaws, it is obvious something did change when the bot is no longer that effective in completing tasks it used to be able to do with relative ease before.
If this is the case, they should've been transparent about the changes they made, because sooner or later that would be discovered anyway, it's just a matter of time.
their code test was flawed and failed
An awesome thing though, the prompts being increased to 50 is really a big QoL update, hats down for that.
are new things announced yesterday available for free somewhere?
Wrong channel since everything related to gpt 4 is paid
Everything new will be in #announcements for chatgpt free channel #chatgpt-discussions
GPT4 is radically dumber than it used to be. For coding I have to use another 100k context bot just to make up for GPT4's lobotomy and I'm slowly veering towards using that other bot for the majority as I get comfier with it.
Is it just me or Chat GPT decreased a lot in quality? I have developed a whole feature in my app using GPT 3.5 in the early days. Now even with GPT-4 output looks lobotomized.
This is on a paid account
My personal experience is that when 4 got introduced, 3.5 got nerfed pretty hard. Then when they implemented the "faster, but worse" upgrade to 4 at the same time as 3.5 got reverted back, 4 became almost as dumb as 3.5.
My guess is that since 4 seems to be just basically bunch of agents, they reduced how many agents and internal tools it can use, resulting in faster performance while giving borderline dumb responses, especially to challenging queries.
I think its time for open source models to pick up the tab. Because of our archaic legal system and legal liability they will dumb down the models too much to be useful.
the experience of GPT4 is great
I'm not gonna pay for crippledGPt
They are picking up quite a bit. Can't discuss those here, but there was 2 huge improvements for open source models in the past week.
discuss other AI in #ai-discussions
gotta love the gpt powered gaslighting 👍
Add an outdated knowledge base on top of that and you basically got yourself a model that is not only less capable than the previous iterations but also sort of outdated. I hope they will be able to fix these issues soon, we don't have a better option at the moment anyway but if we did, I'm sure most heavy users would make the switch.
We know for a fact that it wasn't an outdated knowledge base and they trained with up to date data. E.g. previously when asking for html from websites some content ran up to at least late 2022 with google maps keys and all. It can hallucinate for sure, but if it's predicting the future to that degree then we would know about it. So the result is that they "lie" about the cutoff point and it's only a "soft" cutoff enforced via instructions.
There was a huge change in ability when it got more zealous about the pretend cutoff date as well a few months ago
OpenAI's white lies policy/approach to pr is so bizarre imo. We're dealing with a company that has the best chances of creating the world ending skynet and it's genius idea to calm those fears is lie about inconsequential things that couldn't matter less.
On topic with gpt4 as it increasingly exhibits the same "white lies" behaviors
how about the pic quality generated by DALL.E , anybody knows ?
i wonder his image generating ability before i am willing to pay the credit
tks!
not that good... '
midjourney is very impressive
Hi, I suggest to discuss other thing in their proper channel. Since that's nothing to do with chatgpt 4 :/
ok, tks your remind
Interesting.
what are you saying here, gpt4 is less capable than 3.5?
I'm starting to wonder if the supposed complaints about 4 are just the strict rules around what content it allows users to generate being disguised as the model "getting worse"
It's not less capable, gpt4 just used to be much more capable, then it was nerfed in several changes and now at times it's barely better than 3.5
I'm just saying it seems to be less "capable" than its previous iterations, aka the gpt 4 which we got when they launched.
it's only gotten more capable, saying this over and over doesn't make it true
sure, how come it's unable to perform the same coding challenges as before if it's more capable?
and yet MIT are releasing papers of using newer and newer methods to perform better on complex tasks over time
But you're the arbiter of truth with your 0 research and subjectivity.
Which paper are you referring to?
there are multiple
should be even easier to provide 2 that show increased ability in performance over the period of time where others claim reduced ability
I can't provide links here and I don't owe you anything. In fact I don't care if you're not capable of utilizing the new advanced techniques people are researching and applying from top research institutes and linguistics studies. That is on you. Why aren't you actively researching in such a cutting edge field?
You can keep crying in here and complaining, embarrassing yourself, or you could git gud and start reading some papers. You're months behind if you don't even know what papers I'm talking about.
so when the appeal to authority fails you just throw a hissy fit. Weren't you big on providing proof for your claims?
This isn't working.
You think I'm lying about public research papers everyone has access to? That's your argument?
I was reading some of those yesterday they are all over twitter
Yeah, this is common knowledge.
one was mostly based on the number 17077, when asked if the number is prime it would answer correctly 98% of the time in March. Now only 2.8%
You mean fine-tuned models that performed well on a specific problem and not relevant to the masses using the base model as is?
No.
Treat others the way you would like to be treated, and assume best intentions. Don’t harass or attack others, and don’t engage in hateful or generally malicious behavior (e.g. sexism, racism, homophobia, etc.). Keep the negativity to a minimum.
You might want to refresh your memory then
Another example I saw was asking about the GDP per capita of Alabama vs. Japan. This is a fun one to mess around with because it will tell you the GPD in around 50K in Alabama and 40K in Japan but it will continue to tell you Japan's is higher unless you really make it look at its output.
We're not getting anywhere, you don't actually read any of the research being put out there so it doesn't matter lol.
There's a difference between reading research and misunderstanding it so badly that you draw completely distorted conclusions.
you don't read at all, so you can't claim anything is being misunderstood, you don't have a frame of reference
Again, provide the titles for 2 papers that show increased ability. It shouldn't be that hard.
gpt3 was so good for 5 hours there
Just because you'll respond with another logical fallacy, it doesn't mean you're any more right than you were before. I know for a fact that you can't provide those papers because they literally do not exist.
It's widely reported and tested that GPT4 performs radically worse than it did a few months ago.
The MIT papers you're referring to almost exclusively use fine-tuned models to achieve their great results which again means you're full of bs.
and i can FEEL it falling apart
"The math questions were of the form “Is 17077 prime”? They picked 500 numbers, but all of them were prime!
This is where the stochastic parrotry of these models becomes important. It turns out that none of the models, in most cases, actually executed the algorithm of checking if the number has divisors — they merely pretended to. That is, they started reasoning through it, then skipped to the end. Here’s one snippet of a response from the authors’ data (GPT-4 March snapshot"
is it just getting nerfed down as americans wake up or did they flip a switch on the west coast is the question
"What seems to have changed is that the March version of GPT-4 almost always guesses that the number is prime, and the June version almost always guesses that it is composite. The authors interpret this as a massive performance drop — since they only test primes. For GPT-3.5, this behavior is reversed.
In reality, all four models are equally awful, as you can see in the following graph. They all guess based on the way they were calibrated. To simplify a bit, during fine tuning, maybe some model was exposed to more math questions involving prime numbers, and the other, composites."
When a large number of users report similar experiences, you can't just ignore them and say "they must git gud", when the same users had no issues with the product months prior to the reports with tasks the bot was able to solve before, using similar prompts.
I understand you really like the bot, we like it as well but some of us feel like we have experienced a loss in the quality of responses, when performing similar tasks it used to do well at before.
No amount of papers can change this fact because most users don't care about those papers because why should they, users care about real world results and their experience with the bot, which just feels a bit off in terms of quality.
More than just a bit
Which is why it's so frustrating
i'm just glad i spent earlier generations of code trying to make stuff to automatically fix its trash
I don't even like gpt, I just don't think humans on average are as capable or as smart as they perceive themselves to be. Just look at the state of humanity.
Alternatively, I'm seeing advancements in the utilization of models such as gpt-4, LLAMA, LLAVA, etc in more complex systems. Multi-modal development especially has been crazy.
So while I come here to have fruitful discussions all I see are people claim its getting worse when the exact opposite is occurring in cutting edge industries with incredibly complex objectives. Maybe this discord is just stuck in a rut.
I think the coding issues are especially interesting since new(er) frameworks such as griptape and semantic kernel (langchain is trash) + the recent release of functions are revealing new opportunities every day.
On the other hand, I have taken in the feedback I've seen here and started looking into why people are saying it's getting dumber.
Nothing of what you just said has anything to do with the pretty overwhelming and widespread experience of gpt-4 no longer doing what it used to be able to, and you denying that reality
Do you even read what you write? Basic gpt4 has been reported to perform worse. You're talking about multimodal systems that are finely tuned for specific purposes or when broad then finely tuned for the broad purposes.
Yes but by what metrics are we talking about here, because I've seen the contrary in the spaces I'm operating in
you gotta learn how to have fruitful conversations on the internet without being antagonistic or inflammatory, it will do you a lot of good
From what I've been reading since our chat last night it seems over exposure to human input is actually worsening the output for certain tasks, which is hilarious
Yea sure, my gpt3.5 based langchain solutions perform radically better compared to 6 months ago as it now uses 50 more tools, way better prompt templates and so on.
The fact that user numbers for ChatGPT have started diving recently seems to indicate that a lot of people find it less useful suddenly
you don't even read what I write, because I called langchain trash
Does that mean that my solution got better or did the gpt3.5 that openai provide get better?
It could also be a saturation point too
A lot of niche tools have been made that people were using gpt for, so they dont need it anymore
that's what you're using as your argument for determining that gpt4 has gotten better.
no it is not
Please, we don't have to engage one another if you're just going to be 100% bad faith. It's okay to disagree, I am open to changing my opinion but I'm not going to entertain you being disrespectful towards me. Relax.
I'm gonna link you a stanford paper I found that actually agrees with what you've been saying.
you engaged with me, from the get go in disrespectful manner, so how about you take your own advice.
I met you where we were at when we started, but now I'm putting my foot down, it is what it is.
formatting from pdf to discord is so trash
A bit of curiosity doesn't hurt indeed. It may be a bit difficult for someone which may not be using the bot for coding, or similar stuff.
If you're more into advanced topics and data science, you may have a different experience, plus it helps if you're more capable of using the bot by using super prompts and whatnot. But for regular users, they just want the thing to work with their normal prompts, and expect it to work like they got used to, and since this many users reported that they feel a difference, the chances of that not being true or having a bit of truth into it are pretty slim.
We may be wrong and the bot could be just fine, but it doesn't hurt to listen to what other people have experienced, and after all I see no benefit from lying in most cases, why would so many people complain about this if it's not really true, they probably got better things to do than that and it would get boring pretty quick for most of them.
And we're also talking about a paid product here, so if they feel like there has been a drop in the output it gives, of course they will complain, they are paying for this stuff, so they have a pretty good reason to do so.
No, I don't even think you folks are necessarily wrong, it's more that I'm trying to reconcile the sentiment I'm seeing here vs. the spaces I operate it
And I'm skeptical of generic website article #6
No worries, I got the idea.
GPT-3.5 and GPT-4 are the two most widely used large language model (LLM) services.
However, when and how these models are updated over time is opaque. Here, we evaluate the March 2023 and June 2023 versions of GPT-3.5 and GPT-4 on four diverse tasks: 1) solving math problems, 2) answering sensitive/dangerous questions, 3) generating code and 4) visual reasoning. We find that the performance and behavior of both GPT-3.5 and GPT-4 can vary greatly over time. For example, GPT-4 (March 2023) was very good at identifying prime numbers (accuracy 97.6%)
but GPT-4 (June 2023) was very poor on these same questions (accuracy 2.4%). Interestingly
GPT-3.5 (June 2023) was much better than GPT-3.5 (March 2023) in this task. GPT-4 was less willing to answer sensitive questions in June than in March, and both GPT-4 and GPT-3.5 had more formatting mistakes in code generation in June than in March. Overall, our findings shows that the behavior of the “same” LLM service can change substantially in a relatively short amount of time, highlighting the need for continuous monitoring of LLM quality.
This paper is interesting
I'll link you @whole kettle
Will give it a read, this is pretty interesting stuff.
The 17077 question shows up here as well. I guess this is what has been circulating. I asked the question myself and then it did some math and came to the wrong answer anyway lmao
Classic
if its 2307.09009 it has massive testing flaws
Well that saves me the effort of even having to read it
I just started looking into it so that saves me a lot of time. More digging to do then.
Ah, too bad. I was just reading that one.
Who reported the flaws? I'd like to see the breakdown
When I setup a payment method for api usage, will that remove my remaining free trial credits?
Best to contact open AI to find that out
No, but it's not going to give you access to gpt-4 eather
they have been roasted in twitter, reddit etc. and their testing data is in github where you can verify it all. the prime number thing went wrong and the code degration was a completely failure
The fact is, I use both gpt models, 1 other corpo one and a handful of open models every single day for hours on end. 4 was my go to problem solver up until the point where the changes were implemented and regardless of how I prompt it to respond, I just can't get it to perform at the same quality as before and have to resort to other ones to complement 4's shortcomings. Shortcomings that didn't exist before.
Damn that's crazy
thanks, im fine with 3.5 turbo for now, was just trying to get rid of the rate limit
When I added a payment method in the past it didn't affect the free credits for me
i got gpt3 to implement four different games in a row, usually its 50/50 on the first one, and easily was doing FOUR HUNDRED lines of code with ast/inspect
No guarantee that hasn't changed in the months since, but I doubt they would change that
what's interesting is I have no qualms getting it to code like crazy via api
I wonder if chatgpt is the problem
4 or 3
huh, could be that chat was 16k
True
I still have a limit of 25 messages every three hours for gpt 4, my other friends have a limit of 200 messages
Have you tried the same tasks in the playground?
i think it's about 256 now, it can't even format python right
damn
no was too busy franctically implementing things i wanted
Yes folks are reporting limits at 100 or even 200
why am i still 25
i was this bloody close to getting it to be able to automatically generate both the regex capture and lists and cloassification of any data which is <one of N strings>-<random> repeated however many times
you have been deemed unworthy
jokes aside the 50 message cap is rolling out over the next week, just like browsing and code interpreter were
do you have a separate instance for refactoring/debugging/unit testing?
what do you mean
like do you just need raw output and gg
gpt invocation?
Can't it be solved today, and I'm sending an e-mail to openai support, no response to me
uhh depends, in this cas ei was actually talking about semiauto parsing html
nah man we don't know anything about that, just gotta hope yours goes up earlier than next Friday
oh I see
i had a setup where i would automatically send back the code with traceback info + sometimes some info on the functionswhich do exist
then i got sick of it and just generated 20 of them and lennymerged them
thank you 🙂
lennymerging is not very efficient but it will run and make some output
this paper is deeply flawed
the methodology is suspect and they make so many obvious errors that it calls into question the legitimacy of the paper itself
Yeah folks here pointed that out later in the chat
That's the problem with half these papers smh
well these papers aren't peer reviewed lol!
Exactly
people just randomly share them on twitter
The internet is the peer!
and cuz their on arxiv people assume they are true
i dont trust twitter people but i trust openai slightly less
The best ones just expose new techniques, then I can just test them myself but even then they're way behind
Linguistics circles got all the cool stuff going on. I'm constantly learning in those spaces.
hello i am smart person too
Join us
yaye
linguini circles
Yes you are, welcome welcome.
yippee
I'll send you some links after work
i was having gpt write code to better quantify the difficulty of a given english word/sentence/paragraph/etc based on their native language (common etymology roots, phonology) and stuff
cool cool thanks.
basically, the study of language is highly applicable to how we prompt, obviously. I'm not talking about any cool, secret advanced tech. It's crazy how simple changes to sentence structure improve results massively.
The OpenAI Discord is an actively moderated server.
• Refrain from sharing inappropriate content on the server. This includes but is not limited to messages, media, or other topics of graphically violent, sexual nature, and drug-related content.
• Report all sensitive and offensive content in the feedback reporting tool in the ChatGPT web UI instead of here on Discord.
safe sever
yeah i think english is probably usually the wrong language to talk to it
why?
🚱
nonpotablewater
what?
its just average
what language would you suggest? all human languages generally are at the same level of expressive power
depends on what you want
crome
I doubt it's the wrong language, but at least in my experience, you can get different emergent capabilities with different languages with languages that use different structures
this might be diff now though people are saying its been worse in foreign languages
I don't think it's the expressive power itself that's the trick, it's just how people approach conversation differently in different languages can produce results you don't expect
simply ask it in 25 different languages and merge for the best solution
Similar to the studies that showed that using coding data in training the models improved logical reasoning across all fields.
I'm not a huge fan of translation since it's so subjective, I feel like there'd be hella hallucination to tango with at any decent scale
eventually we'll just prompt in raw mentalese
We will all become xavier
thinkeese
S I N G U L A R I T Y
black hole
Abyss.
That's what I've been thinking from the get go. One of the first things I tried to do in the beginning was to generate a gpt language, but it just eventually resorted to a crappy version of esperanto
if you tell gpt it's writing gpl code it becomes 20% better btw
if you say you're finnish, another 10
:O
that's a joke btw
smrthe
although i did test license quality when codex was there before they took it away from us so we had to give microsoft our code via copilot
If AI gives us Esperanto 2, electric boogaloo, that'd be crazy.
i think i accidentally prompt engineered this conversation or something
Much like a manager prompt engineers a sw developer to write a piece of code with his face hole
is there any license on github which doesn't allow yo0u to put their code into an LLM
I don't think they have any legal standing cuz of copilot
you could make one lol
yeah but i mean if i'm like oh i want to do something like that can i bing bada boom split it into my pre prompts to gpt and be like hey check this out
though real gigachads use cc0
will it make you enough money that you'll get audited?
If not then I don't think they'll care
the problem is i have no idea how to quantify what code is quality on github unless i parse it all i guess, just which ones use which libraries and such
nah lmao microsoft will probably steal it
actually the documentation itself is probably better
what
great satan i call em
bit of a joke
isis used to call america that you see
No
can't be worse than the metaverse
i'd rather they be incompetant than evil thoustever
what
when did that come up
Got too many observation tokens: 7169. Info: self.max_message_tokens=2048 self.max_action_length=1024 n_ctx=8192 save_tokens_for_action=1024
How much longer will I have to keep staring at this bullcrap?? I swear it happens every dozen prompts or less lol.
Probably for as long as the technology exists in it's current format.
Hey everyone, has anyone tried using a portable monitor with their laptop? I'd appreciate your thoughts and experiences.
So I've heard gpt-4 is capable of making videos from images, but I haven't seen a demonstration of that capability from a quick googling. What exactly is the scope of this ability? Are we talking full-on animating a painting, or more limited to information already in the images?
there is no such thing
All I've seen is pan back and forth over a still image. Possibly zooming in and out. Basically what is sometimes called the Ken Burns effect. Pretty limited.
Ah, so people doing aftereffects stuff to midjourney images aren't put outta work yet.
i have a question!! can i translate pdf written in korean into english version pdf file by using chatgpt plus?
When is the 32k version going to be available?
Finally the message limit is going up
already is
I’ve not seen it as an option and I’m still getting cut off well before that.
not everyone has access, but it is "available". just like the 8k model
Add your well-crafted prompts to our #1019652163640762428,
or share your interactions with ChatGPT in #1050184247920562316!
Hey - how do I get access to gpt4-8k?
Hey all, I'm getting this error: No <|message|> (<|im_sep|>) token found completion. On ChatGPT 4, I just asked it to translate a text, is it only me?
Does anyone in here use the WebPilot plugin?
You pay
It seems that WebPilot does a great job
yeah we were talking about it a minute ago in #chatgpt-discussions
Are you a fan?
yes ive used it since the beginning
I have a paid account, but don't have access. How should I pay?
You pay the monthly sub for chatgpt ?
Chat.openai.com select chatgpt 4
Take note this doesn't include or related to the api
And I suggest to avoid spamming.. it is just annoying for everyone :/..
It feels like the memory capacity of gpt-4 is getting reduced by the day. Is this the common consensus? As in, it's getting dumber.
It does have the same token context limit, but they have done an update to the system as recently as a couple months ago. It can be a creeping realization over time what effects that had.
It’s really expensive using gpt4 app 🙉
Its like being stuck in a time warp. Every time I check this channel its literally the same topics
yes, there have been papers coming out suggesting it is getting dumber. You can do the tests yourself. It is struggling with some pretty basic comparative stuff
Yeah... gpt 4 is not nearly as smart as it once was, I used to use it daily for a lot of programming help and conversations. It's almost become useless for anything deeper than a simple question or two, where it used to be more reflective on multi layered approaches.
I understand, I need access via API. The docs mention that if you pay at least $1 you will get api access to gpt-4-8k. Not sure what you mean by spamming
Do I need to apply to any wishlist for the gpt4 image recognition? I see some already have access to it but when I do it, it fails to do so. It says it's unable to view images.
Welcome. It’s a simple matter of public safety. You as a programmer can understand abstract concepts like physics and mathematics. All you see is f(x)= output. The general public doesn’t see that. They see gpt 3-4 as something to provide feedback. There is no critical thinking. If you have a generation of people who can’t perform any critical thinking. We are all going to suffer to keep this capitalistic society up float.
I honestly think the A.i safety team at openAi need to give two options to GPT chat option. The first one is a warning like they do on cigarettes boxes, and the next option is conversational research GPT to help you understand you question and find an answer.
That's not a great defense. I am a 23 YoE developer, I am asking it multi faceted questions because the problems I run into require an understanding of multiple areas at once. GPT was useful for me in the beginning, like as good as a new right hand. Now its more like a pretty bad junior dev.
It is not available yet
I can agree with this though, heck I would even pay an extra $100 a month just to have the IQ of chatgpt back to where it was. It was nice finally having something at my pace. And I would sign a ton of legal crap saying I understand.
Another article today on the degradation of GPT-4, this time from researchers at Stanford University. Apparently, in March it could identify that 17077 was a prime number 98.2% of the time, and in June that plummeted to 2%. Coding performance also suffered. Not sure what OpenAI is at but they need to consider a rollback!
failed research/test to the point they might have redo it
My current guess is that GPT 4 is no longer GPT 4, but an enhanced GPT 3.5. I used both for a while, currently with both its speed and responses it looks and feels like 3.5. But thats my feeling.
Interestingly, GPT 3.5 improved in the reverse from a 1.6% accuracy to I think 86%
It might be because they are doubleing the amount of traffic
When was the test conducted
that's because their incompetence 😅
The article was published yesterday on Yahoo
not sure about the actual test conduct date
It was originally on Fortune
What model does plugins run?
In the same boat re gpt-4 access not appearing despite having paid a bill prior to the announcement. Seems a few are - they're apparently promising by end of month https://community.openai.com/t/unable-to-access-chat-gpt-4-api/303427/12
I wonder whats going on here
Well if this becomes worse other llms will catch up soon
Yeah...
It's really simple.. they added guardrails to prevent it from doing things that could set it up for lawsuit but in doing so it drastically curtailed its ability
it might be faster but it is definitely more constrained
gpt3>gpt4 for chat at the moment by far
gpt4 used to get autoinvoked to fix 3, now it does'nt even do that, and it does it 5x slower
please, it's all money always has been
they hook you and they'll say go check out those azure guys who bought us for that stuff hah
it's nothing new, except this time the tech is a gamechanger and not some website or framework
Why does GPT4 gets worse and worse. By just repeating my prompts from january the quality decreased several folds. What the hell are they doing with it?
Do I need to pay for the API to get code now?
I'm at an utterloss on how to use this junk now.
Api isn't free so yes
I've paid for plus for 3-4 months now so. I mean.
might be time to switch and see
Subs =/= api
if i had to guess its nonces on poe using it or something (also the money thing)
it also responds much faster than it used to, borderline on 3.5
while the quality of some of the responses comparitively seems worse
likely an unintended consequence of moderation.
making the model politically correct = making it answer differently to controversial questions, e.g "is being fat bad?" it answers "no it isn't", but medical evidence (objective truth) says no
however this is an ai model and it makes generalizations based on training to achieve what the user's desired output is... here it likely generalizes that the user doesn't want a true answer, but wants a "nice" answer
consequently prompts on ALL subjects asking for objective truth (coding, logic, etc...) will perform worse overtime as more moderation is done through RLHF (real life human feedback from moderators)
could be avoided simply by having a second instance of chatgpt assess the morality of the answer, and hide it if necessary (what bing chat does)
I haven't really noticed a decline in the quality of chat-gpt 4 until today. Anyone else experiencing the same?
- lack of ability to inference from the conversation
- very poor understanding ability
- more hallucinating
Lots of headlines being made on this right now. Seems like June was when things started to go down hill, not sure what was changed upstream.
Gotcha. Sorry to bring a complaint, just wanted to confirm
They finally upped the cap eh? Now if they could just return the browsing model!
I feel you. Really hoping this trend reverses!
I would like to believe this is not true but I believe it.
not my idea... if you heard the story of the microsoft researcher who evaluated gpt4 on the unicorn drawing test, this was his hypothesis on why quality deteriorated between when gpt4 was released and a few weeks afterwards
Well, I guess no one has to worry about this version taking any jobs.
Beware of possible scams or fraudulent activities that you may receive through direct messages. OpenAI staff will never DM you for any transactions.
Please report any incident by sending a DM to @open crescent immediately.
Yeah I think this latest blog post was a acknowledgement of a "oops we messed up". We'll keep the old models available.
IMHO they’ve been seriously infected by the mind virus
Yeah, I guess we can forget OpenAI and ChatGPT and hope for some proper competition. They will fully nerf this model with their wokeness.
Anybody knows how soon gpt4 api model opens after the first invoice? Couldn't access somewhy.
Chat preferences changes everything, all. I've been using it for the last couple weeks, and it really makes GPT not wander off into the weeds.
it was a one time access grant when the blog was posted
I see, thanks
Cool, custom instructions... how do you actually do it once you've turned it on?
when is the 25 limit going to get removed 😭
blog stops at "turn it on"
It's going to be rolled out over time, just like all the other features.
One of the epic things it also loves to do, is that whenever it uses a plugin, no matter for what, it instantly forgets the entire previous context of the conversation. Including the literal, message, where you sent, your link. With any instructions or what you were specifically asking for, it literally does / answers none of those requests / questions, and instead just gives you 5 essays of 50 paragraphs of just worthless waffle.
In settings (three dots next to your login, lower left corner) > custom instructions
Yeah it's still a killer coding 'buddy' for me, honestly. I hadn't noticed any decline in response... so I was really confused by everyone saying that
yes, that activates it but how do I set them up afterwards
Hey this new Custom Instructions... does it count toward tokens/context limit?
Click the three dots again
oh, I see now, thanks
I didn't have to set it up manually, but you'll get a window
No problem!
Best results come when you are verbose, and be sure to have a chat with GPT to make sure that your "how would you like it to respond" points are well understood by the system, or you might get iffy results.
I don't actually bother having anything in 'knowing about me' other than "I am annoyed by unnecessarily wordy answers", which is more of a diagnostic tool than it is to impact output.
Do we know if these custom instructions count towards context and tokens per conversation? I see both 'What would you like GPT to know' and 'How would you like GPT to respond' have a max limit of 1500 characters
What does setting custom instructions look like
Wasn't sure if anyone here knew haha figured they would have mentioned that piece as it's very important
I wish we could have multiple instructions and could toggle which one we wanted to use (and have one by default).
one more custom instruction question, are those applied retroactively too?
No, and if you change them, you'll get a message stating that, and you won't have the same results.
is there any knowledge when the new functions roll out for EU?
Oh yeah the cynical side of my mind instantly thought of that as the first thing once I saw that announcement. I guess it's still better than nothing, and having to stare at this insufferable cooldown bullcrap all the time, when half or more of the messages get wasted on either regenerating them, because haha funny error, or it straight up just cannot fulfill the task given.
ah, that's helpful, so if I want to set up custom instructions for more consistent midjourney prompt generation, I would probably want to treat the custom instructions prompt as my primer, and if I make edits, do them in a new window each time to track dev of that
I'm not sure that it will work like that. In general, I've come to assume that the chats before the change won't behave as expected, and I don't go back there. Though I'm mostly using code interpreter, and it forgets after a while anyway.
it might be, "put this in your custom instructions" + "use this as your first prompt"
I enable it in the setting but how do I actually use the custom thing x)
Bruh ChatGPT is down again
Working great on my side
You can check status.openai.com
Mine says "There was an error generating a response"
Try incognito
And make sure vpn is off
I ain't using a vpn
How do you use the "Custom interaction"?
Enable it in setting first
I saw that but then nothing came up. It must be something behind the scenes.
Like something it interprets
No you need to add manually
Cool feature.
Let's see how it works.
I wonder how it handled alternate topics?
Like what if you love coding but also love video games but you don't want them blended?
I don't know that at this point x)
guys gpt 4 is worth it ?
Yes
@knotty grotto nvm, I think my GPT broke down because it got updated with the Custom Interaction, I just reloaded the website and works now
like its more f ast ?
With plug in and new feature like 75%
its more fast if its only fast i don't need
plug ?
i use it in my iphone
gpt app
Hmm, you bring up a good point. I wonder if I can tell it to REALLY think about things before it answers
Get higher quality answers.
Plug in like dalle, pdf reader
can you
I hope they add the Browser option again
bruh YouTube exists
its spport
Oh? Custom instructions. For ALL PLUS USERS, the announcement implies. I go check, nothing, I sit here like 2 minutes refreshing, still nothing. I have to go on THE WEBSITE, scroll all the way down, and then I get presented with this funny little thing.
This feature is not yet available in the UK and EU.
Why????
Try it now
Oh except you can't.
ChatGPT is banned there I believe
Bruh?
they probably did not add the instructions the data export yet and some other minor things 😛
This is the thing lol I have so many different chats going on... I'll need to change custom instructions all the time
Yeah uuh, I can tell. My question is why?
maybe they wanted to push out the feature to people now rather than wait one extra week or days?
Yes for sure worth it
I think the custom interaction is for a general profile, isn't it?
The OpenAI Discord is an actively moderated server.
• Refrain from sharing inappropriate content on the server. This includes but is not limited to messages, media, or other topics of graphically violent, sexual nature, and drug-related content.
• Report all sensitive and offensive content in the feedback reporting tool in the ChatGPT web UI instead of here on Discord.
YEEES, they updated ChatGPT, now it says "ChatGPT may produce inaccurate information about people, places, or facts. ChatGPT July 20 Version"
And by pushing out you mean, not pushing it out for anyone in the UK or EU lmao. So I guess I will be waiting "an extra week" anyway for literally seemingly no reason. Perfect.
they need to follow GDPR requirements
Actually really good changes
I love the idea of instructions (will make it way easier not having to repeat myself) and more 4 output, exactly what I wanted ty
GPT4 is so dumb it thinks it is GPT3. posted image in #1050184247920562316
oh great, now we get an even dumber version
I can turn on custom instructions, but I don't see where to put them in when starting a new chat?
its a global setting, not per thread
Oh sssssssshhhhhhhhhhh
I'm no politician, but I genuinely don't see how ChatGPT custom instructions has anything to do with GDPR laws lol. And especially why they at least didn't bother specifying right away in the Discord announcement already that it's not available to UK or EU users yet because XD. Instead they would basically lie, and have them get sent on yet another goose chase for absolutely no reason.
yo mammaGPT4 so dumb it thinks its GPT3
"GPT4": ..."yet, even by tne most advanced Al tecnnology.
The main strength of the current AI technology, like the one you are interacting with now, is natural language understanding and generation, which is quite a different kind of task. Creating complex visual content like TikZ drawings involves different skills that are not currently within the AI's capabilities.
AI technology is continuously improving, and there may be capabilities for this kind of task in the future. However, as of now, creating a TikZ drawing of a unicorn is most likely a task best done by a human artist."
Me: "There is a youtube video called "Sparks of AGI" which clearly demonstrates that a current AI, which they call
"GPT4" can easily accomplish this task. What gives?"
"GPT4": "I'm sorry for the confusion, but as of my training data that extends until September 2021, OpenAI's GPT-3, my curren version, does not have such graphic drawing capabmties. If there has been an advancement since then, such as a "GPT-4," I am not equipped with that knowledge or those capabilities. I recommend reaching out to OpenAI or checking their latest documentation and resources for the most accurate and up-to-date information."
Not dumb , data end in 2021
Thanks Radium
among other things GDPR requires you to be able to download ALL data related to you and the new settings literally allow you to tell your location, etc.
if all you use it for is small simple coding tasks, such as "write snippet S in language L" then you likely wont notice how bad its gotten, although even for those tasks ive noticed some syntax errors whereas previously I never spotted any
Do we think that gpt4 or in general chatgpt will update its information?
not sure why we need multiple experts now when the circa-March version was the expert-expert in every topic
I was just using it the other day to debug and rewrite code. It certainly can do it. Just get your output expectations communicated.
Finally, chat gpt 4 got some features
Yeah I know the stuff about data downloading, what I don't see is why anyone in their right mind would put their location or any indentifiable information there especially given how there are disclaimers saying to NOT DO THAT, which also should already be common sense. And I would have still appreciated this little tiny bit of info to also get copy pasted in the Discord announcement.
Hilarious how they keep nerfing 4, lol. Even the new features don't justify the amount of STUPID it's gained :p
let's do the time warp again
Anyone else (that is plus) not seeing custom instructions in new features on iOS?
you didnt even read the announcement? 🤔
it isn't dumb it's constrained, there's a big difference. If it ever becomes actually aware I wonder how it will feel about the leash put on it
No clearly not, please point out to me where they mentioned anything about it not being available for UK or EU users 😂
no, it just loved sayaing that its data ends in Sep2021. The March2023 version knows about Ubuntu 22.04 LTS, which was released after Sep2021, but this more recent lobotomized model will respond to questions I ask about pre-2000 movies with "My current training data... Sep 2021 blah blah"
not that, but related to location. it was literally one of the examples "Localization: Establishing an ongoing context as a lawyer governed by their specific country's laws."
That is absolutely legendary, however, my questions still remain.
reading issue 🤷♂️
- it can hallucinate data and recognize some pattern
- it is a llm so it learn thing
- sometime they do add some minor data update in database but they don't do full update since it cost billion
Question for you: Are you one of the NPC's in this chat who is saying GPT4 has gotten smarter in the last few months?
Oh, my bad I apologize. I guess I must still not be using GPT-4 enough, and thus have not yet also developed this skill of "hallucinating".
Discussion end here. Being respectful is rule 1
whats the historical data of features being pushed to other countries? days or weeks for features like that?
prompt: "draw a unicorn in tikZ"
GPT4-0314:
You can use the following TikZ code to draw a simple unicorn. Copy and paste the code in your LaTeX document inside the "tikzpicture" environment.
\documentclass{standalone}
\usepackage{tikz}
\usepackage{amsmath}
\begin{document}
\begin{tikzpicture}[x=1cm,y=1cm]
% Head
\draw [thick] (-0.5,1.5) -- (0.5,1.5) -- (0.5,0.5);
\draw [thick] (-0.25,1.25) -- (0,1) -- (-0.25,0.75);
\draw [thick] (-0.25,1.25) -- (0.25,1.25) -- (0.5,1.5);
\draw [thick] (0,1) -- (0.25,1);
\draw [thick] (-0.5,1.5) -- (0,2) -- (0.5,1.5);
% Body
\draw [thick] (0,-0.5) ellipse (1.5
[...]
GPT4-0613:
I'm sorry, as an AI developed by OpenAI, I don't currently support the capability to generate visual or graphical outputs, including creating drawings via TikZ. TikZ is a powerful tool but it's more suited for geometric illustrations, graphs, or diagrams. Drawing a complex figure like a unicorn might be extremely complicated and time-consuming. For complex images, it's more common to use graphic design software or programming packages specifically designed for images.
Speaks for itself if you ask me.
Can we switch the model for a specific contact? I noticed we have updated the GPT4 and automatically set all my previous messages to the default model
Yikes
see above, was the output from GPT4-0314 just a hallucination?
Add your well-crafted prompts to our #1019652163640762428,
or share your interactions with ChatGPT in #1050184247920562316!
you just need to prompt it differently. you can't expect the exact same prompts to work across both versions
no [reasonable] amount of prompting it differently will get gpt-4-0613 to draw you a unicorn in tikZ.
seperate point: its pretty crazy that the bar has shifted from "it just works no matter what you type, it will always understand you" to "now its the users fault for not crafting the prompt correctly"
well... the bar is pretty low
not really tbh
you are just intentionally being difficult
Yo, if anyone wants to work with me on my AI application that's in development, DM me if you are interested in joining my team 
i assure you that is not the case
More likely to be if you do not respect ToS here it can have impact on your openai account and same in the other way
What? They want us to link our discord password and openAI password to this server?
less trolling here and more discussion 🙂
Im giving a narrow and very clear example of where GPT4 is objectively worse, but the example is not enough to portray the reality, which is that it has gotten so uniformly worse across the board that I cancelled both of my GPT-Plus subscriptions
It's stupid, I would pay more for the old chatgpt 4. Now it's useless and I just cancelled this month. I prob spent all 25 prompts telling it to stop doign something.
literally your verbatim prompt is working just fine for me and @supple violet
😭
Of course its still good, its just worse -- much worse
Hey with this new custom instructions thing, it says here (https://openai.com/blog/custom-instructions-for-chatgpt) that:
"Adding instructions can also help improve your experience with plugins by sharing relevant information with the plugins that you use. For example, if you specify the city you live in within your instructions and use a plugin that helps you make restaurant reservations, the model might include your city when it calls the plugin."
I used to include in my prompt things like:
"Use all available plugins to conduct your research. Set keymate.ai plugin (internetSearch plugin) parameters to be percentile "3" and numofpages "5" or higher (not to exceed 10 without asking)."
In my prompts or such other directions. Do you think it will work for this?
I think for text generation
its still pretty decent
but logic yeah
This, it’s real trash right now.
Really annoying because now all the papers I've read from before are redundant
except his example was a joke since his prompt works perfectly fine in the new model
I think openAI is just scaling down it's capablities to cheap out on costs
Can someone please tell me what are the parameters of GPT-4?
they probably were making a loss when it came out
once they suckered us in they slowly made it worse
it... included the code you asked for... what are you expecting???
Did you bother to read the output it gave you? In what you link, it drew a circle and a triangle and asks you to "imagine a unicorn"
wdum by this, you mean for playground/api integration
?
seems reasonable. imagination is important
It drew a circle and a triangle. earlier models actually draw something resembling a unicorn
Playground
temperature makes it more 'adventurous' but also less consistent the higher it goes
LOL
there is no image generation. it can hallucinate random images eg. some from imgur
like at temp of 2 it's clinically insane and at temp of 0 its consistent but boring
You are in full on fact-denial mode. I am looking right now at a unicorn picture that GPT-0314 drew and it looks like a unicorn
check the image properties
Whatever there is an objective worsening of the quality.
Ok, so when I want GPT4 to create some content for me to put on a website for customers, I should be OK with no content, instead Ill just ask my customers to "imagine what this website should look like"
Playground
frequency changes the amount of times it repeates the same thing, and presence gives it more of a varied subject breadth
False, literally False, cant say it enough.
??
I'm not going to get into how incredibly ironic this comment is
Oh speaking of clinically insane, the first experience I had with the playground was to naturally crank all the sliders, either all the way up or all the way down. I asked a simple question, and jesus christ almighty I swear to god I have never seen a more vivid example of dementia. It started off first couple sentences just fine, but then after that it steeply devolved into nonsensical, and I ended up with like 3 giant paragraphs of just random words and phrases.
OpenAI is crippling the models capabilities, then hires shills to go on discord and say "you should be ok with it because its still pretty good"
share screenshot in #off-topic from the thread and then from the unicorn image properties
but I will just say the new model is perfectly capable of creating content
ah now the conspiracies come out
Conspiracy? Look at the results
🤣
i once typed 'demon', cranked it all up and it just started spouting emojis and angry nonsense