#databases | Python | Page 125

radiant elbow Dec 28, 2020, 1:19 AM

#

👍

lucid needle Dec 28, 2020, 2:14 AM

#

i installed aiosqlite3

#

but i cant import it

#

i am using vsc

#

and it says its unable to import aiosqlite3

granite oasis Dec 28, 2020, 3:12 AM

#

What is fast way to remove large amounts of data from a SQLite3 Database. I tried to look online to no help.
Is there a way to bulk remove? like to bulk add to a database using 'executemany' eg. cursor.executemany(sqInsert, recordList)

Im working with a database of 8BG. 3.5mill lines need to be removed from a total of 49mill lines. Here is the inside of the dataTest.db
https://i.imgur.com/2AyGf8x.png
https://i.imgur.com/vRWszH4.png

listToSkip = []

def readToSkip():
    sqConn = sqlite3.connect(f'dataTest.db')
    cursor = sqConn.cursor()
    data = cursor.execute("""SELECT line_skip FROM Skip""").fetchall()
    for i in data:
        listToSkip.append(i[0])
    cursor.close()

readToSkip()

logging.info(f'Done Load. Size to remove: {len(listToSkip)}')
#>>>INFO:root:Done Load. Size to remove: 111

def delLine(line):
    cursor.execute(f"DELETE from Train WHERE line_skip={line}")
    sqConn.commit()
    logging.info(f"Del Line {line}")
    # >>>INFO:root:Del Line 24, ext,ext


sqConn = sqlite3.connect(f'data.db')
cursor = sqConn.cursor()
for line in listToSkip:
    delLine(line)
cursor.close()

Imgur

radiant elbow Dec 28, 2020, 3:24 AM

#

granite oasis What is fast way to remove large amounts of data from a SQLite3 Database. I trie...

don't commit after each and every delete, instead commit after every 1000 or so. It'll be much faster.

#

if that's still not fast enough, the next step would be to run fewer statements, and have each one delete multiple rows, using where line_skip in (1, 2, 3, 4, ...) or where line_skip=1 or line_skip=2 or line_skip=3 or something like that

#

also, make sure you have an index on line_skip

granite oasis Dec 28, 2020, 3:34 AM

#

@radiant elbow

for number, line in enumerate(listToSkip):
    if number % 1000 == 0:
        sqConn.commit()
    delLine(line)

then for your second Part I could use something like this

# in def delLine(line):
toRemove = len(listToSkip)
listToSkip= listToSkip[toRemove:]
for the ? ? ? places

#

will that work?

radiant elbow Dec 28, 2020, 3:35 AM

#

yes, though you'd need to have exactly as many ? placeholders as items in the list, which is annoying but doable

pseudo summit Dec 28, 2020, 3:35 AM

#

Do it all in one statement with WHERE IN and sub select.

Unless your dB supports join in where clause of delete. Not all do.

radiant elbow Dec 28, 2020, 3:36 AM

#

I'd just do the "only commit after every 1000 (and right before closing, don't forget that or you'll miss the last partial batch!) and see if that's fast enough.

pseudo summit Dec 28, 2020, 3:36 AM

#

Sql will do it faster than python.

radiant elbow Dec 28, 2020, 3:36 AM

#

yes, definitely - but that requires more changes from what they already have.

pseudo summit Dec 28, 2020, 3:36 AM

#

So I’d avoid looping in python

radiant elbow Dec 28, 2020, 3:37 AM

#

this isn't a huge number of rows - it's only a few million. Python will be slower at it than SQL, but I'd still expect it to only take a few minutes.

#

you can see if I'm right: move the commit out of the inner loop, only commit once every 1000 deletes, and print the amount of time since the last commit. That'll let you quickly figure out how long it will take to do all 3500 commits, and whether or not you need a faster solution.

granite oasis Dec 28, 2020, 3:38 AM

#

I had a 10BG file that I needed to remove Non english from it then put it back into a .txt. So I used python to do this

pseudo summit Dec 28, 2020, 3:38 AM

#

Just saying that there’s no need to select then loop.

DELETE FROM Train WHERE line_skip IN (SELECT line_skip FROM Skip)

radiant elbow Dec 28, 2020, 3:39 AM

#

ooh, you're right

#

I missed that the set of rows to delete was already coming from a query

#

that changes my mind entirely; your approach is both easier and faster.

#

I was picturing needing to build up a temp table with all the rows to delete or something, which would have been much more work.

granite oasis Dec 28, 2020, 3:40 AM

#

https://paste.pythondiscord.com/bepahubadi.py

#

here is my code to remove non english text

#

took 3min when using a db

#

I have 2 databses

#

Have to remove from both

#

so lines are equal

#

@pseudo summit The list is coming from another DB

#

its not of the same DB

pseudo summit Dec 28, 2020, 3:45 AM

#

Ah!

#

I rescind. 🤪

granite oasis Dec 28, 2020, 3:46 AM

#

Also using

    if number % 1000 == 0:
        sqConn.commit()
``` does not speed it up

#

have to use the placeholders

radiant elbow Dec 28, 2020, 3:49 AM

#

how long does each commit wind up taking, out of curiosity?

#

and you did remove the commit that was right after the delete, right?

granite oasis Dec 28, 2020, 3:51 AM

#

checking

#

yes

deep rover Dec 28, 2020, 3:51 AM

#

I'm having trouble rn

cursor.execute("UPDATE sespot SET (status = ? AND time = ?) WHERE (status = ? AND time > ?)", ('taken', 0, 'free', 60))

It returns an error: sqlite3.OperationalError: near "=": syntax error

granite oasis Dec 28, 2020, 3:52 AM

#

@radiant elbow 99% of the time is taken by
cursor.execute(f"DELETE from Train WHERE line_skip={line}")

radiant elbow Dec 28, 2020, 3:53 AM

#

deep rover I'm having trouble rn ```py cursor.execute("UPDATE sespot SET (status = ? AND t...

it's UPDATE sespot SET status = ?, time = ? WHERE (status = ? AND time > ?)

radiant elbow Dec 28, 2020, 3:54 AM

#

granite oasis <@!451976922361102357> 99% of the time is taken by cursor.execute(f"DELETE from...

do you have an index on line_skip?

granite oasis Dec 28, 2020, 3:56 AM

#

I dont how do I add that in sql3

radiant elbow Dec 28, 2020, 3:57 AM

#

CREATE UNIQUE INDEX by_line_skip ON Train(line_skip);

deep rover Dec 28, 2020, 4:01 AM

#

Also I tried py cursor.execute("SELECT * FROM sespot WHERE status = ?", ('free',)) fetch = cursor.fetchall() print(fetch)
It gave me
[]
This is a '[]' string right

radiant elbow Dec 28, 2020, 4:02 AM

#

no, it's an empty list

#

fetchall() always returns a list of matching rows.

granite oasis Dec 28, 2020, 4:02 AM

#

listToSkip = []


def readToSkip():
    sqConn = sqlite3.connect(f'data.db')
    cursor = sqConn.cursor()
    data = cursor.execute("""SELECT line_skip FROM Skip""").fetchall()
    for i in data:
        listToSkip.append(i[0])
    cursor.close()

readToSkip()

logging.info(f'Done Load. Size to remove: {len(listToSkip)}')

def delLine(line):
    cursor.execute(f"DELETE from Train WHERE line_skip={line}")
    logging.info(f"Del Line {line}")

sqConn = sqlite3.connect(f'dataTest.db')
cursor = sqConn.cursor()
index = 'CREATE UNIQUE INDEX by_line_skip ON Train(line_skip);'
cursor.execute(index)



for number, line in enumerate(listToSkip):
    if number % 1000 == 0:
        sqConn.commit()
    delLine(line)
cursor.close()

Traceback (most recent call last):
File "R:/Ai Bot/dataCleaner/readfile Remove.py", line 43, in <module>
cursor.execute(index)
sqlite3.OperationalError: index by_line_skip already exists

deep rover Dec 28, 2020, 4:02 AM

#

Because later after that I tried py if fetch is None: etc the etc part not working

radiant elbow Dec 28, 2020, 4:02 AM

#

granite oasis ```python listToSkip = [] def readToSkip(): sqConn = sqlite3.connect(f'dat...

You only need to add the index once ever. You've done it, remove that line now.

radiant elbow Dec 28, 2020, 4:03 AM

#

deep rover Also I tried ```py cursor.execute("SELECT * FROM sespot WHERE status = ?", ('fre...

if fetchall() returned [] then there are no rows in the table where status='free'

deep rover Dec 28, 2020, 4:04 AM

#

Ye I aware of that. I want the bot to do something when there are no rows

#

I tried like above #databases message

radiant elbow Dec 28, 2020, 4:05 AM

#

deep rover Ye I aware of that. I want the bot to do something when there are no rows

fetch is None isn't true, but fetch == [] is. You want if fetch == []:

deep rover Dec 28, 2020, 4:05 AM

#

Oh thank you

#

thumbsup

granite oasis Dec 28, 2020, 4:08 AM

#

@radiant elbow

sqConn = sqlite3.connect(f'data.db')
cursor = sqConn.cursor()
index = 'CREATE UNIQUE INDEX by_line_skip ON Train(line_skip);'
cursor.execute( index )
cursor.close()

cursor.execute( index )
sqlite3.IntegrityError: UNIQUE constraint failed: Train.line_skip

radiant elbow Dec 28, 2020, 4:08 AM

#

adding the index has made the database maintain a list of all rows in the table sorted by their line_skip value. Now, when you want to find one of them to delete it, it can quickly find that row by binary searching. Think of a dictionary: you want to find a word, so you flip the book open to somewhere in the middle. You check whether the word you're looking for is alphabetically before or after the words for the page you're on and you either flip to a page in the half of the dictionary before or after the page you originally flipped to, and you keep cutting down the search space until you find the page you need.

#

hm. on that database, line_skip isn't unique - there are multiple rows with the same line_skip value

#

if that's an expected condition, you can just drop the word UNIQUE. If that's not expected, you need to clean up your data.

granite oasis Dec 28, 2020, 4:10 AM

#

https://i.imgur.com/hJ2RJrA.png

Imgur

#

is this the reason?

radiant elbow Dec 28, 2020, 4:11 AM

#

no. try doing select * from train group by line_skip having count(*) > 1

#

actually, make that:

select * from train where line_skip in (select line_skip from train group by line_skip having count(*) > 1)

granite oasis Dec 28, 2020, 4:14 AM

#

im bad with sql how do I print that statement

radiant elbow Dec 28, 2020, 4:16 AM

#

if you're doing it with Python, you can do:

conn = sqlite3.connect('data.db')
cursor = conn.cursor()
query = 'select * from train where line_skip in (select line_skip from train group by line_skip having count(*) > 1);'
cursor.execute(query)
for row in cursor.fetchall():
    print(row)

granite oasis Dec 28, 2020, 4:19 AM

#

that worked and fixed the issue

radiant elbow Dec 28, 2020, 4:20 AM

#

what do you mean "fixed the issue"? It should have printed out a list of rows that violate the uniqueness constraint and stop you from being able to add the unique index.

granite oasis Dec 28, 2020, 4:20 AM

#

yeah and now it runs

#

does the UNIQUE INDEX be stored in memory? I know .fetchall() does and make things run way faster

radiant elbow Dec 28, 2020, 4:23 AM

#

no, the reason an index makes things faster is that it helps the database find the rows that are being affected.

#

and fetchall() usually makes things slower, not faster. Reading the entire result set into memory means you can't start processing any rows until all of them are available.

granite oasis Dec 28, 2020, 4:27 AM

#

@radiant elbow Thanks a lot for the help and knowledge. I help me learn a lot and understand DB more

vivid delta Dec 28, 2020, 8:57 AM

#

I am getting pgconfig error while executing my postgres script on a server, I searched guthub and it says to bump pgproto, can anyone give me an idea about it?

torn sphinx Dec 28, 2020, 9:28 AM

#

How do I know when I should use a database

#

vs a CSV or JSON file

#

I need a simple list of accessible data to hold user accounts.

#

for a discord bot.

#

thing is a JSON file seems ideal besides being slow once I get say... 10000

#

Is their any magic database that is easily accessible and read/writable like JSON but faster?

vivid delta Dec 28, 2020, 9:36 AM

#

There are various databases which are better than JSON, for eg SqLite3, MySQL, Postgres, etc.

torn sphinx Dec 28, 2020, 9:37 AM

#

What would you recomend? I know nothing about databses

#

Heard bad things about mysql

vivid delta Dec 28, 2020, 9:39 AM

#

Well depends on the project, I recommend Postgres but learn basic SQL before you go for it 🙂

torn sphinx Dec 28, 2020, 9:39 AM

#

ok.

runic mirage Dec 28, 2020, 9:43 AM

#

what's data type for prefix in MySQL?

proven arrow Dec 28, 2020, 10:21 AM

#

runic mirage what's data type for prefix in MySQL?

What prefix?

runic mirage Dec 28, 2020, 10:21 AM

#

like i want to change prefix for bot but its in not update

#

DataError: 1292 (22007): Truncated incorrect DOUBLE value: '!'

proven arrow Dec 28, 2020, 10:23 AM

#

Use a text type like char

runic mirage Dec 28, 2020, 10:23 AM

#

i use varchar

proven arrow Dec 28, 2020, 10:23 AM

#

That's fine also

runic mirage Dec 28, 2020, 10:23 AM

#

after that its happen

proven arrow Dec 28, 2020, 10:24 AM

#

Where is the error happening? Show the query

runic mirage Dec 28, 2020, 10:24 AM

#


def update_prefix(cursor, dbs, prefix, updated_by, server_id):
    cursor.execute('update prefixes set prefix = %s and updated_by = %s where server_id = %s',(prefix, updated_by, server_id))
    dbs.commit()```

#

Ignoring exception in command prefix:
Traceback (most recent call last):
  File "/home/bl/.local/lib/python3.8/site-packages/mysql/connector/connection_cext.py", line 504, in cmd_query
    self._cmysql.query(query,
_mysql_connector.MySQLInterfaceError: Truncated incorrect DOUBLE value: '!' ```

proven arrow Dec 28, 2020, 10:27 AM

#

And can you show the table structure for it

proven arrow Dec 28, 2020, 10:28 AM

#

torn sphinx Is their any magic database that is easily accessible and read/writable like JSO...

NoSQL databases allow json storage. However even sql relational databases allow it too. Also MySQL is perfectly fine, so I'm not too sure what "bad things" you heard about it.

runic mirage Dec 28, 2020, 10:28 AM

#

def create_table_prefixes(cursor):
    cursor.execute('''CREATE TABLE IF NOT EXISTS prefixes(
                                Num int AUTO_INCREMENT,
                                server_id varchar(255),
                                prefix varchar(255),
                                updated_by varchar(255),
                                updated_at TIMESTAMP DEFAULT CURRENT_TIMESTAMP ON UPDATE CURRENT_TIMESTAMP,
                                PRIMARY KEY (Num))''')

#

    async def prefix(self, ctx, *, prefix='db.get_defualt_prefix(self.bot.cursor)'):
        db.update_prefix(self.bot.cursor, self.bot.dbs, prefix, ctx.author.id, ctx.guild.id)
```  its in cog

torn sphinx Dec 28, 2020, 10:31 AM

#

I think I will use sqlite

proven arrow Dec 28, 2020, 10:34 AM

#

@runic mirage Right so the error is becahse your update statement is incorrect

torn sphinx Dec 28, 2020, 10:34 AM

#

I'm logging discord messages (among other things)... I'm most worried about

📎 exploits_of_a_mom.png

#

lol

proven arrow Dec 28, 2020, 10:34 AM

#

When you want to update multiple columns, you seperate it by a comma. You have done it by AND

proven arrow Dec 28, 2020, 10:35 AM

#

torn sphinx I'm logging discord messages (among other things)... I'm most worried about

Check the pinned message. It shows how to avoid this. If anything of it doesn't make sense or needs clarification then you can ask.

runic mirage Dec 28, 2020, 10:35 AM

#

proven arrow When you want to update multiple columns, you seperate it by a comma. You have d...

ok i try this one

#

thanks dude it's work

torn sphinx Dec 28, 2020, 10:37 AM

#

lmao thats amazing

river vortex Dec 28, 2020, 10:41 AM

#

what is REAL here??

📎 Capture1.JPG

proven arrow Dec 28, 2020, 10:42 AM

#

It'll be a floating point number

river vortex Dec 28, 2020, 10:43 AM

#

Ohh...Got that...

#

Another question

#

what does 'UNIQUE(from_id, to_id)' do here??

📎 Capture2.JPG

proven arrow Dec 28, 2020, 10:44 AM

#

It'll make a unique constraint on the combination of those 2 columns

#

So, for example
1,2 is a pair and so 1,2 combination can't exist twice. However 2,1 combination can occur (but only once)

river vortex Dec 28, 2020, 10:46 AM

#

Got that...Thanks a lot...

boreal niche Dec 28, 2020, 12:20 PM

#

Does anyone know how to set the default type to a column when creating a table?

copper sparrow Dec 28, 2020, 12:31 PM

#

i’m looking at making a form for entering details the same as entering information through html, php and phpmyadmin but im not sure how to do it via bluetooth

snow imp Dec 28, 2020, 3:00 PM

#

im using sqlalchemy mixed with discord.py and i want to send the primary key to the person who does the command of their object in the db how do i do this?

analog trellis Dec 28, 2020, 3:40 PM

#

what is the best way to represent a task that repeats every day in a database? for example, task: read 10 pages a day. the task spans 50 days for example and I want to store data on every individual day's progress? what would the models be like? i am using django but a normal sql example is fine, I am just wondering what the relation would be

bright hound Dec 29, 2020, 2:11 AM

#

Hello. I'm new to developing in general and I'm trying to set up a database for a stock trading bot. I'm using QuestDB and so far I've downloaded their tar.gz file and ran the command they specified to unpack it, but it all unpacked to the download folder where the tar file was. I'm wondering if that's not ideal, because it seems to me like I'd want those files in a more permanent place on my computer. Total beginner question but I'm brand new to this. Any help is appreciated

#

To clarify, the setup involved extracting the file with the -xvf command from the command line and I think it also installed something when it extracted it. I'm wondering if I can move those files now or if that would break something

#

Or if I need to do it over in the directory where it should be installed

finite perch Dec 29, 2020, 2:36 AM

#

You should be fine moving the extracted folder anywhere you want, about the installation part ... did it 'install' in the same directory where it was extracted to?

bright hound Dec 29, 2020, 2:44 AM

#

I'm not sure, lol

#

Sorry I'm not familiar with these tar.gz files so I'm not sure what happened when I ran that command

tender shadow Dec 29, 2020, 4:05 AM

#


mydb = mysql.connector.connect(
  host="localhost",
  user="yourusername",
  password="yourpassword"
)

print(mydb)```

#

pls help i dont know what to put here it says it cant connect to the sql server 😦

#

i just started learning SQL so pls be patient with me

#

im not sure it just told me to type this

#

ohhhh

#

where should i put that?

#

inside or after?

#

like should it be inside mydb?

#

thanks man

#

sorry hehe...

white jungle Dec 29, 2020, 9:27 AM

#

DBQ.query("INSERT INTO member_table (clan_id, member_id, join_date) VALUES (?, ?, ?) ON CONFLICT(clan_id, member_id) DO UPDATE SET join_date = ? ;",       [ctx.guild.id, member.id, datetime.now(), datetime.now()])

gives an error for the "ON CONFLICT"
version of python is 3.6.6. I think 3.6.6 has an updated enough version of sqlite3 to use " on conflict". can anyone assist?

#

sqlite3.sqlite_version spits out 3.28.0 so it should be able to use on conflict...

#

oh nvm.. 3.6.6 has 3.21.0 of sqlite.. i was in my 3.8 python version

keen sundial Dec 29, 2020, 10:57 AM

#

Suriyawong'); DROP TABLE messages; --

calm prawn Dec 29, 2020, 11:06 AM

#

How can I add date in a google database
In google docs example it said it as
data = {"date":datetime.datetime.now()}

#

But I am getting syntax error

keen sundial Dec 29, 2020, 11:15 AM

#

What does the syntax error say and where is the documentation you are reading?

#

my first guess is that the document wants json so you may need to run json.dumps(data) before sending it

velvet coyote Dec 29, 2020, 1:42 PM

#

Hey so if i have a .sql file, is there a way to execute that file and the stuff within that file in a postgres db?

fallow dove Dec 29, 2020, 2:08 PM

#

Pretty sure postgres has cli that'll do that.

fallow dove Dec 29, 2020, 2:11 PM

#

velvet coyote Hey so if i have a `.sql` file, is there a way to execute that file and the stuf...

If you're dead set on using python to interface with db, just read in the file and feed statements to server via execute or whatever equivalent your chosen module/library/driver offers.

torn sphinx Dec 29, 2020, 2:35 PM

#

Every built-in module that can be used for making mini databases:

json
csv
pickle
shelve
marshal
dbm

elder karma Dec 29, 2020, 5:53 PM

#

is there a way to do insert or ignore into table with foreign key violations in sqlite?

#

i know it doesn't allow for on conflict clauses for FKs but i really want the FK to just limit what data can be inserted not roll back an entire multi row insert over a FK violation.

glossy tusk Dec 29, 2020, 6:16 PM

#

Need company for studying..

trim acorn Dec 29, 2020, 6:22 PM

#

Hey guys, sorry if i'm interrupting anything. Does anyone here have a DB certification? Is there any value in getting it? So far all of my google searches have brought up Microsoft sql server. Any advice would be greatly appreciated

torn sphinx Dec 29, 2020, 7:22 PM

#

can somone teach me how to use mysql

#

in python

warm sphinx Dec 29, 2020, 7:41 PM

#

i have a similar need

#

i need help using the mysql connector in python

#

@torn sphinx can you lmk if you find out?

torn sphinx Dec 29, 2020, 7:49 PM

#

@warm sphinx uh

#

ill see

warm sphinx Dec 29, 2020, 7:49 PM

#

well you'd probably need to use mysql connector too actually

torn sphinx Dec 29, 2020, 7:49 PM

#

yeah

torn sphinx Dec 29, 2020, 7:49 PM

#

tender shadow ```import mysql.connector mydb = mysql.connector.connect( host="localhost", ...

like this4=

#

sql3lite is ew

warm sphinx Dec 29, 2020, 7:56 PM

#

how do you find the user

#

like i forgot what i put in for user and password

#

in mysql still

whole niche Dec 29, 2020, 8:19 PM

#

how do i setup a database for strikes? dead

#

^discord py

elfin talon Dec 29, 2020, 8:54 PM

#

trim acorn Hey guys, sorry if i'm interrupting anything. Does anyone here have a DB certifi...

Did you find an answer? i'm on the same thing

elfin talon Dec 29, 2020, 8:54 PM

#

torn sphinx can somone teach me how to use mysql

what do you need?

trim acorn Dec 29, 2020, 8:59 PM

#

@elfin talon Haven’t really found an answer. I have come across different ones like certified sql developer or db admin.Not sure what the benefits are of getting one vs the other.

sick nacelle Dec 29, 2020, 10:13 PM

#

Im trying to upload data into my redshift cluster using this command

pgcli -h <your-redshift-cluster> -U <your-user> -p 5439 -d <your-database> but I keep getting this error:

https://cdn.discordapp.com/attachments/668636896897007627/793602518856499240/unknown.png

#

First time working with aws and redshift and wasn't sure if I should ask here or one of the help channels

whole niche Dec 29, 2020, 10:46 PM

#

@client.command(aliases=['s'])
async def strike(ctx, member: discord.User = None, reason='null'):
                warnid = random.randint(9000000000, 12000000000000)
            post = {
                "guild": ctx.guild.id,
                "member": member.id,
                "warnid": warnid,
                "moderator": ctx.message.author.name,
                "reason": reason,
                "date": str(ctx.message.created_at)
            }```

warm sphinx Dec 29, 2020, 11:13 PM

#

@uneven elk (feel free to @) you responded to my thing abt databases but i didn't get to respond
basically i have created a database and i need to find the parameters user and host
i forgot what they are

#

also sorry for double ping

torn sphinx Dec 29, 2020, 11:19 PM

#

how can i connect to a sql database

#

?

torn sphinx Dec 30, 2020, 12:42 AM

#

Can I connect my mongodb database to GitHub?

velvet coyote Dec 30, 2020, 7:13 AM

#

Could someone give me an example of creating a connection pool in asyncpg.

#

I don't understand the example in the docs.

torn sphinx Dec 30, 2020, 10:24 AM

#

QQ about the pinned message about SQL injection

#

How would I do that for mass populating

#


cursor.execute("INSERT INTO messages VALUES ("\
                        f"{int(message.id)},"\
                        f"{int(message.channel.id)},"\
                        f"{str(message.channel.name)},"\
                        f"{int(message.author.id)},"\
                        f"{str(message.author.name)},"\
                        f"{str(message.author.status)},"\
                        f"{str(message.author.mobile_status)},"\
                        f"{str(message.author.desktop_status)},"\
                        f"{str(message.author.web_status)},"\
                        f"{str(message.author.bot)},"\
                        f"{str(message.author.nick)},"\
                        f"{int(message.guild.id)},"\
                        f"{str(message.guild.name)},"\
                        f"{str(message.clean_content)},"\
                        f"{str(message.created_at)}"\
                        ")")

#

I don't need to int/string convertions but it can't hurt besides possible a very slight performance cost

#

oh duh

#

just put all that in a variable and refrence that with a ?

#

... nvm sqlite3.OperationalError: table messages has 17 columns but 1 values were supplied

#

Do I just put a bunch of ? marks then have them all afterwards

proven arrow Dec 30, 2020, 10:40 AM

#

torn sphinx Do I just put a bunch of ? marks then have them all afterwards

Correct

torn sphinx Dec 30, 2020, 10:40 AM

#

ok thx

torn sphinx Dec 30, 2020, 10:59 AM

#

Ok. one other question. For asyncronus operation... should I make the cursor inside the awaited function or just use the same cursor throghout and pass it the cursor

#

Presently I have the cursor created at the start

#

but I assume one cursor can only do one thing at a time

#

yea other examples create cursor inside the function so that is probably correct

proven arrow Dec 30, 2020, 11:16 AM

#

Cursors should not be used globally.

torn sphinx Dec 30, 2020, 11:16 AM

#

yea wasn't thinking so

proven arrow Dec 30, 2020, 11:16 AM

#

Once you are done with it dispose of it.

#

They are lightweight objects anyways so its ok to recreate them

torn sphinx Dec 30, 2020, 11:17 AM

#

oh. do I need to close them? or just let them go away with the function end

#

or with cursor

proven arrow Dec 30, 2020, 11:18 AM

#

Well if you use a with block, they would close automatically. Otherwise you can manually call cursor.close().

torn sphinx Dec 30, 2020, 11:18 AM

#

ok will use with block

#

oh is their any way to escape the ? substitution of doom?

proven arrow Dec 30, 2020, 11:18 AM

#

Im not sure what you mean

torn sphinx Dec 30, 2020, 11:19 AM

#

Reading a few other articles and they all use somewhat more complex ways of avoiding SQL injection

#

like passing through sql.Literal()

proven arrow Dec 30, 2020, 11:19 AM

#

This is the best way i.e. prepared statements

torn sphinx Dec 30, 2020, 11:20 AM

#

Is their any real difference though?

#

like is

cursor.execute("INSERT INTO messages VALUES (?)", value)

#

the same as

value = sql.Literal(value)
cursor.execute("INSERT INTO messages VALUES (value)")

#

Really worried about injection because i'm not planning on running in a container and it will be open to literely everyone

#

lol

proven arrow Dec 30, 2020, 11:26 AM

#

Then use prepared statements (with the ?). They are the safest way, because the query is pre compiled and sent to the database first. Your parameters will always be isolated, and can never be injected.

torn sphinx Dec 30, 2020, 11:26 AM

#

Ah ok thx.

torn sphinx Dec 30, 2020, 2:16 PM

#

can someone tell me why this aint working

#

📎 unknown.png

proven arrow Dec 30, 2020, 2:29 PM

#

torn sphinx can someone tell me why this aint working

Because x is a tuple, and your comparing it with a string

torn sphinx Dec 30, 2020, 2:29 PM

#

erm

#

so do i convert it to string

proven arrow Dec 30, 2020, 2:30 PM

#

You can get the first element of it

torn sphinx Dec 30, 2020, 2:30 PM

#

and how would i do this

#

?

proven arrow Dec 30, 2020, 2:31 PM

#

if x[0] == "your code":

grave eagle Dec 30, 2020, 2:31 PM

#

hewo ^w^ I feel dumb but do not know what the hell is the problem here

cur.execute(f"SELECT emoji, role, message_id, channel_id, guild_id FROM reactions WHERE guild_id = '{reaction.guild_id}' and message_id = '{reaction.message_id}' and emoji '{str(reaction.emoji)}'")
sqlite3.OperationalError: near "'![zoroark](https://cdn.discordapp.com/emojis/791270455356686366.webp?size=128 "zoroark")'": syntax error

torn sphinx Dec 30, 2020, 2:32 PM

#

proven arrow `if x[0] == "your code":`

yes but wouldnt that just get 1 row

proven arrow Dec 30, 2020, 2:32 PM

#

The method fetchall() returns an list of tuples. Each tuple in that list is a row that the query matched.
x[0] just gets the first column of that row.

torn sphinx Dec 30, 2020, 2:33 PM

#

hm

#

ok

proven arrow Dec 30, 2020, 2:35 PM

#

grave eagle hewo ^w^ I feel dumb but do not know what the hell is the problem here ``` cur....

Its because your missing an = after the emoji

torn sphinx Dec 30, 2020, 2:36 PM

#

also @proven arrow i fogot to thank you man

#

thanks for the help

proven arrow Dec 30, 2020, 2:36 PM

#

@grave eagle And dont use f strings for your queries. Instead you want to use a parameterised query.

grave eagle Dec 30, 2020, 2:37 PM

#

proven arrow Its because your missing an = after the `emoji`

ty ^W^

grave eagle Dec 30, 2020, 2:38 PM

#

proven arrow <@!334757627684847616> And dont use f strings for your queries. Instead you want...

can't be injected, all thing come from discord's api and can't be "modified" by a user

proven arrow Dec 30, 2020, 2:40 PM

#

Well then in that case the api is your user/client

torn sphinx Dec 30, 2020, 3:19 PM

#

@proven arrow

#

can you help me again

#

you're code worked but when i tried to do it with another key it didnt work

#

📎 unknown.png

#

id 1 worked

#

but the others no\

#

for x in row:

        if x[0] == auth_token:
            return(f"<p> {json_data} </p>")
        elif (x) != auth_token:
            return "<p> Please enter the correct api-key.</p>"
        else:
            return "A error has occured."

proven arrow Dec 30, 2020, 3:20 PM

#

What doesnt work?

torn sphinx Dec 30, 2020, 3:20 PM

#

when i do a different key

proven arrow Dec 30, 2020, 3:20 PM

#

What is auth_token?

torn sphinx Dec 30, 2020, 3:20 PM

#

auth_token = request.args['api_key']

proven arrow Dec 30, 2020, 3:21 PM

#

Then the token doesnt match.

torn sphinx Dec 30, 2020, 3:21 PM

#

it does

proven arrow Dec 30, 2020, 3:21 PM

#

What is your goal here? What are you trying to do?

torn sphinx Dec 30, 2020, 3:21 PM

#

a api_key authentication

#

cause im making a api

#

and i need api to auth, and im getting the auth data from sql

#

db

#

📎 unknown.png

#

@proven arrow

proven arrow Dec 30, 2020, 3:22 PM

#

So then check if the value exists in the database using a query, instead of with python.

torn sphinx Dec 30, 2020, 3:23 PM

#

how

#

and i need to do it in python cause the api is in python

#

sql_data = "SELECT encoded_api_key FROM api_auth"

#

that the query

proven arrow Dec 30, 2020, 3:25 PM

#

SELECT COUNT(*) FROM api_auth WHERE encoded_api_key = 'the_key'
This will return the count of how many rows matched. If its 0, then no result was found.

#

That way you dont need to loop at all, or do any comparisons in your code, because its done by the database.

torn sphinx Dec 30, 2020, 3:27 PM

#

error

#

import ipinfo
import json
import mysql.connector
import flask
from flask import request, jsonify

mydb = mysql.connector.connect(
    host="freedb.tech",
    user="",
    passwd="",
    database="freedbtech_9ine_auth"
)

app = flask.Flask(__name__)
app.config["DEBUG"] = True

@app.route('/iplookup/', methods=["GET"])
def home():

    access_token = '1c1fe412af2b81'
    handler = ipinfo.getHandler(access_token)
    ip = request.args['ip']
    auth_token = request.args['api_key']

    mycursor = mydb.cursor()

    sql_data = f"SELECT COUNT(*) FROM api_auth WHERE encoded_api_key = {auth_token}"

    mycursor.execute(sql_data)

    row = mycursor.fetchall()

    details = handler.getDetails(ip)

    ip1 = (details.ip)
    hostname1 = (details.hostname)
    city1 = (details.city)
    org1 = (details.org)
    region1 = (details.region)
    country1 = (details.country)
    postal1 = (details.postal)
    country_name1 = (details.country_name)
    timezone1 = (details.timezone)

    json_data = ("{" + f'"ip": "{ip1}","hostname": "{hostname1}","org": "{org1}", "city": "{city1}", "region": "{region1}", "postal": "{postal1}", "country_name": "{country_name1}", "country": "{country1}", "timezone": "{timezone1}"' + "}")

    for x in row:

        if x[0] == auth_token:
            return(f"<p> {json_data} </p>")
        elif (x) != auth_token:
            return "<p> Please enter the correct api-key.</p>"
        else:
            return "A error has occured."

app.run()

#

thats my code

#

can you please help me

proven arrow Dec 30, 2020, 3:30 PM

#

Do you understand what the query SELECT COUNT(*) FROM api_auth WHERE encoded_api_key = 'the_key' does?

torn sphinx Dec 30, 2020, 3:31 PM

#

no

#

i only started import mysql.connector today

proven arrow Dec 30, 2020, 3:32 PM

#

Well if you read what i sent maybe you would 😛
#databases message

torn sphinx Dec 30, 2020, 3:32 PM

#

oh ok

#

sorry didnt see

#

so how would i do a check on this

#

cause i dont need to get the count

#

i need to get the api key from db

#

nothing else

proven arrow Dec 30, 2020, 3:34 PM

#

You already have the key, because you got it from the request? Otherwise how would you check in the database with that query if it exists?

torn sphinx Dec 30, 2020, 3:35 PM

#

yes but i need to do a check to see if the key exists

#

thats why its api key authentication

proven arrow Dec 30, 2020, 3:35 PM

#

The result of that query tells you if the value exists or not.

torn sphinx Dec 30, 2020, 3:35 PM

#

but it didnt work

#

and i dont check if the value exists

#

i need to see if the key exists

proven arrow Dec 30, 2020, 3:38 PM

#

Ive told you quite a few times now on what the query does. Maybe you need to think about this logically and then try to figure out what it is your doing/not doing.

torn sphinx Dec 30, 2020, 3:39 PM

#

i know im doing

#

but the query you send me doesnt work

#

i need to check for APIKEY not VALUE

umbral lark Dec 30, 2020, 5:32 PM

#

Hey, I'm new to databases, and I've got a question.
I thought about working with sqlite, but I heard, that MySQL is faster, because it's online.
If I now wanted to host some application online (on a VPS or sth), then the sqlite db would be a file within the application, right? But how would I go about using MySQL for my application?

pure cypress Dec 30, 2020, 6:05 PM

#

Yes it's generally faster as you scale up the number of concurrent connections

pure cypress Dec 30, 2020, 6:06 PM

#

umbral lark Hey, I'm new to databases, and I've got a question. I thought about working with...

You'd need to host a mysql instance on a server and then connect to it over the network. You could host it on the same server as the rest of the application

#

You'd pass a connection string containing the host and credentials to a python library that will connect to the db and let you interact with it

torn sphinx Dec 30, 2020, 6:30 PM

#

@pure cypress can you help me with something please

pure cypress Dec 30, 2020, 6:32 PM

#

Please don't unsolicitedly ping people for help

torn sphinx Dec 30, 2020, 6:32 PM

#

sorry

#

but can you help me

#

?

#

import ipinfo
import json
import mysql.connector
import flask
from flask import request, jsonify

mydb = mysql.connector.connect(
    host="",
    user="",
    passwd="",
    database=""
)

mycursor = mydb.cursor()

sql_data = "SELECT encoded_api_key FROM api_auth"

mycursor.execute(sql_data)

row = mycursor.fetchall()

app = flask.Flask(__name__)
app.config["DEBUG"] = True

@app.route('/iplookup/', methods=["GET"])
def home():

    access_token = ''
    handler = ipinfo.getHandler(access_token)
    ip = request.args['ip']
    auth_token = request.args['api_key']

    details = handler.getDetails(ip)

    ip1 = (details.ip)
    hostname1 = (details.hostname)
    city1 = (details.city)
    org1 = (details.org)
    region1 = (details.region)
    country1 = (details.country)
    postal1 = (details.postal)
    country_name1 = (details.country_name)
    timezone1 = (details.timezone)

    json_data = ("{" + f'"ip": "{ip1}","hostname": "{hostname1}","org": "{org1}", "city": "{city1}", "region": "{region1}", "postal": "{postal1}", "country_name": "{country_name1}", "country": "{country1}", "timezone": "{timezone1}"' + "}")

    for x in row:

        if x[0] == auth_token:
            return(f"<p> {json_data} </p>")
        elif (x) != auth_token:
            return "<p> Please enter the correct api-key.</p>"
        else:
            return "A error has occured."

app.run()

#

📎 unknown.png

#

the aeron key workds

#

but when i do the qorrds key it dont wokr

#

work*

#

can you please help me

#

@pure cypress , i dont know what unsolicitedly means

#

@torn sphinx why you showing token

#

cause its on my local host

#

so it dont really matter for now

#

and there testing ones

#

🤣 @torn sphinx you think im dumb enough to show the actuall data that is going to be used

#

** Can anyone help me ? **

pure cypress Dec 30, 2020, 6:47 PM

#

Unsolicitedly means that you ping me out of the blue or randomly.

torn sphinx Dec 30, 2020, 6:47 PM

#

oh ok sorry

#

please can you help me?

pure cypress Dec 30, 2020, 6:48 PM

#

What's not working?

#

You were too vague

torn sphinx Dec 30, 2020, 6:48 PM

#

its only checking for the top api key

#

aeron1234

#

but when i try qorrds1234 it dont work

pure cypress Dec 30, 2020, 6:48 PM

#

What happens with the other key?

torn sphinx Dec 30, 2020, 6:49 PM

#

return "<p> Please enter the correct api-key.</p>"

#

📎 unknown.png

#

Working key

#

📎 unknown.png

#

Not working

#

even tho there both in the db

brazen charm Dec 30, 2020, 6:50 PM

#

if x[0] == auth_token:
   return(f"<p> {json_data} </p>")
elif (x) != auth_token:```

pure cypress Dec 30, 2020, 6:50 PM

#

You need to let your loop check all the keys before returning an error

brazen charm Dec 30, 2020, 6:50 PM

#

they're two very conflicting if statements you got there

pure cypress Dec 30, 2020, 6:50 PM

#

Right now you return an error if the first key you check is invalid

torn sphinx Dec 30, 2020, 6:50 PM

#

so how would i do this

#

a while lopp

#

loop?

pure cypress Dec 30, 2020, 6:51 PM

#

A for loop is fine

torn sphinx Dec 30, 2020, 6:51 PM

#

it does

#

for x in row:

    if x[0] == auth_token:
        return(f"<p> {json_data} </p>")
    elif (x[0]) != auth_token:
        return "<p> Please enter the correct api-key.</p>"
    else:
        return "A error has occured."

#

__ ** for x in row: ** __

pure cypress Dec 30, 2020, 6:52 PM

#

for ...:
  if equal:
    return "they match"
# At this point, if the loop has ended it means none were equal
return "invalid"

torn sphinx Dec 30, 2020, 6:52 PM

#

for auth_token = row

#

?

#

in*

pure cypress Dec 30, 2020, 6:53 PM

#

It's pseudo code for the kind of loop you'd need to validate the token

torn sphinx Dec 30, 2020, 6:54 PM

#

equal is not defined

#

📎 unknown.png

#

im new to python if you couldnt tell

pure cypress Dec 30, 2020, 6:54 PM

#

Err it's just pseudo code

#

So it's not exactly what you need to write

torn sphinx Dec 30, 2020, 6:54 PM

#

idk these big words man

pure cypress Dec 30, 2020, 6:54 PM

#

By "if equal" I just meant you replace that with the actual comparison of api keys

torn sphinx Dec 30, 2020, 6:55 PM

#

what do i put after for then

pure cypress Dec 30, 2020, 6:55 PM

#

Sorry I took for granted you'd follow that.

torn sphinx Dec 30, 2020, 6:55 PM

#

for x in a row

pure cypress Dec 30, 2020, 6:55 PM

#

Yes you need to loop over the results of your sql query

torn sphinx Dec 30, 2020, 6:55 PM

#

for x in row:
if auth_token == x[0]:
return "<p> It worked </p>"

return "<p> invalid </p>"

#

should that work

pure cypress Dec 30, 2020, 6:56 PM

#

Try it

torn sphinx Dec 30, 2020, 6:56 PM

#

thank you man

#

ily 💋

#

no homo

real hemlock Dec 30, 2020, 7:01 PM

#

Is there a way to use to execute a statement like this

SELECT time // 86400 AS day, COUNT(*) FROM table GROUP BY day

Without having to select the day? As in only selecting the COUNT(*) but still creating the day variable to group by

brazen charm Dec 30, 2020, 7:02 PM

#

isnt that literally just the where clause

#

WHERE day = (time // 86400) or what ever

real hemlock Dec 30, 2020, 7:04 PM

#

maybe? I didn't know you could do that

#

i'll try now

#

no it is not

#

day is not an column, time is

brazen charm Dec 30, 2020, 7:20 PM

#

so let me get this straight

#

i take it

#

does it matter if the groups are in numerical order in some way

#

if not then you can just do the math on the time coloumn then order it because it'll naturally group the times together

#

if it does matter

#

use a Self JOIN ig?

#

https://www.w3schools.com/sql/sql_join_self.asp

pure dirge Dec 30, 2020, 7:47 PM

#

Hey everyone I Have a vague question

#

I am collecting some info and some of it is very obvious in length and what the answers will be, for example boolean returns or simple strings like 'orange'/'blue' etc.

I have some other data that is pulled from the same page that's a little longer and more free form in length (Descriptions)

So right now I think saving all the first stuff is easily done in a cvs, but not sure giant paragraphs should also go in that lol

spark parrot Dec 30, 2020, 8:13 PM

#

How can i storage images into a sqlite column? for each product i have?

craggy arrow Dec 30, 2020, 9:42 PM

#

spark parrot How can i storage images into a sqlite column? for each product i have?

Use a BLOB column, you'll probably want to also store metadata (name, datatype, etc ...)
https://sqlite.org/datatype3.html

proven arrow Dec 30, 2020, 10:17 PM

#

spark parrot How can i storage images into a sqlite column? for each product i have?

Generally you store the path to the image, which can just be a text type.

torn sphinx Dec 30, 2020, 10:55 PM

#

firbase
sqlite
mongodb

#

which one is the best !?

steep bloom Dec 30, 2020, 11:09 PM

#

mongodb @torn sphinx

torn sphinx Dec 30, 2020, 11:44 PM

#

okey ty

proven arrow Dec 30, 2020, 11:52 PM

#

torn sphinx which one is the best !?

Sqlite and Firebase/MongoDB are two completely different database systems. Sqlite is relational, uses SQL and has a schema, whereas Firebase/mongo do not give you this. There is no best, and each has is good for different use cases.

spark parrot Dec 31, 2020, 1:03 AM

#

Hello There i have a problem:
for i in range(len(columns)):
c.execute("SELECT * FROM " + table + " WHERE " + columns[i] + " LIKE " + "%" + searched + "%")

#

is returning.. sqlite3.OperationalError: near "%": syntax error

#

how can i solve this?

shell ocean Dec 31, 2020, 1:10 AM

#

@spark parrot what are you trying to do

spark parrot Dec 31, 2020, 1:11 AM

#

Hello!

shell ocean Dec 31, 2020, 1:11 AM

#

hellos

spark parrot Dec 31, 2020, 1:11 AM

#

Im triying to search for a word in all the columns of a table and then returning all matches

shell ocean Dec 31, 2020, 1:12 AM

#

spark parrot Im triying to search for a word in all the columns of a table and then returning...

do you know what query parameters are?

spark parrot Dec 31, 2020, 1:12 AM

#

the "?"?

shell ocean Dec 31, 2020, 1:12 AM

#

also, the table name is known, right?

#

yup

spark parrot Dec 31, 2020, 1:12 AM

#

shell ocean also, the table name is known, right?

yeah

shell ocean Dec 31, 2020, 1:12 AM

#

you should use that in place of searched

#

then

#

it should be in the string directly too

spark parrot Dec 31, 2020, 1:13 AM

#

so.... searched="%Hello%"

#

?

shell ocean Dec 31, 2020, 1:13 AM

#

no

#

like

#

SELECT * FROM this_table WHERE this_column LIKE %?%

spark parrot Dec 31, 2020, 1:13 AM

#

ok... let me try

shell ocean Dec 31, 2020, 1:16 AM

#

okay

#

in general

#

you should pass a single string

#

not like

#

the result of string concatenation

#

and then the parameters separately

#

sqlite3 does it a certain way

#

that you can Google

#

that I don't remember because I don't use it but it's as a tuple I think

spark parrot Dec 31, 2020, 1:17 AM

#

ok, im going to do it, give me a moment

#

@shell ocean c.execute("SELECT * FROM " + table + " WHERE " + columns[i] + "LIKE %?%", (searched))

sqlite3.OperationalError: incomplete input

shell ocean Dec 31, 2020, 1:18 AM

#

(searched,)

spark parrot Dec 31, 2020, 1:18 AM

#

oh... ok

shell ocean Dec 31, 2020, 1:18 AM

#

why is table in a variable?

spark parrot Dec 31, 2020, 1:19 AM

#

because i have multiple tables, so i want to be able from a tkinter optiondrop to choose in which do i wanna search the Searched variable

#

@shell ocean c.execute("SELECT * FROM " + table + " WHERE " + columns[i] + "LIKE %?%", (searched, ))
sqlite3.OperationalError: incomplete input

shell ocean Dec 31, 2020, 1:21 AM

#

I see...

#

you're missing a space before your LIKE I think

spark parrot Dec 31, 2020, 1:21 AM

#

Let me see

#

c.execute("SELECT * FROM " + table + " WHERE " + columns[i] + " LIKE %?%", (searched,))
sqlite3.OperationalError: near "%": syntax error @shell ocean

shell ocean Dec 31, 2020, 1:22 AM

#

it's mega hard to debug this kind of query

#

because

#

it's hard to see what's in table and columns

#

how about

#

you print the full query

spark parrot Dec 31, 2020, 1:22 AM

#

let me try

shell ocean Dec 31, 2020, 1:22 AM

#

print("SELECT * FROM " + table + " WHERE " + columns[i] + " LIKE %?%") and print(searched)

spark parrot Dec 31, 2020, 1:25 AM

#

@shell ocean its not printing it, idk why, let me try another way

#

@shell ocean
SELECT * FROM customers WHERE first_name LIKE
sandra

#

i removed %?% because it was giving me an error

shell ocean Dec 31, 2020, 1:28 AM

#

maybe sqlite3 uses something other than ?

#

I'm not sure

spark parrot Dec 31, 2020, 1:29 AM

#

if i do searched="%Sandra%"

#

it works

#

so i will format it and done

#

@shell ocean Thanks for the help

shell ocean Dec 31, 2020, 1:43 AM

#

what does searched look like

#

seems like a problem there

craggy arrow Dec 31, 2020, 1:46 AM

#

The query needs to look like this:
query="SELECT * FROM " + table + " WHERE " + columns[i] + " LIKE ?"
And then when your executing this you need to do:
cursor.execute(query, (f"%{searched}%",))

#

The issue here is the query that SQLite ends up getting is:
SELECT * FROM <table> WHERE <columns[i]> LIKE %"searchterm"%
if he does %?%

#

@spark parrot

#

Oh re-reading, it sounds like you already figured that out -_- Ill show myself out

torn sphinx Dec 31, 2020, 3:13 AM

#

How would I do this:

await cursor.execute("SELECT clean_content FROM messages WHERE author_id=?", int(user.id))

#

It should select the clean_content entries (valid column name) for rows with a certain author_id

#

from the table "messages"

#

It for some reason gives an unsupported type error

#

even though int is correct

radiant elbow Dec 31, 2020, 3:19 AM

#

you most likely need to give a tuple, not just a single value. ```
await cursor.execute("SELECT clean_content FROM messages WHERE author_id=?", (int(user.id),))

torn sphinx Dec 31, 2020, 3:26 AM

#

that worked... do not really understand why but ok

#

How can I iterate through?

I tried this:
for text in list(cursor.fetchall()):

#

also without the List and .fetchall

frail abyss Dec 31, 2020, 3:33 AM

#

Can someone help me? I've tried to convert this string to a python dict for some time now. I've converted all ' to " to see it would help. I've tried the eval() and json.loads() function but both return error. What is wrong with this string, what do i need to format to make it work?

This is the string

{"Item": {"coords": ["45.6 56.3", "45.7 56.4"], "vehicle-name": "vehicle-1", "tilt": [Decimal("89.9"), Decimal("50"), Decimal("29"), Decimal("50")]}, "ResponseMetadata": {"RequestId": "PO0B6QBL3EOA80Q2NQGNTVCBUBVV4KQNSO5AEMVJF66Q9ASUAAJG", "HTTPStatusCode": 200, "HTTPHeaders": {"server": "Server", "date": "Thu, 31 Dec 2020 03:25:27 GMT", "content-type": "application/x-amz-json-1.0", "content-length": "157", "connection": "keep-alive", "x-amzn-requestid": "PO0B6QBL3EOA80Q2NQGNTVCBUBVV4KQNSO5AEMVJF66Q9ASUAAJG", "x-amz-crc32": "1945811615"}, "RetryAttempts": 0}}

torn sphinx Dec 31, 2020, 3:34 AM

#

did you try string = string.json()?

#

@frail abyss

frail abyss Dec 31, 2020, 3:35 AM

#

No, i'll try that! Hold on

#

so new_string = string_name.json()

#

?

#

Never used that function before

#

@torn sphinx

torn sphinx Dec 31, 2020, 3:36 AM

#

yes that should work

#

json.loads(string) should do the same though

#

Are you sure its valid json?

frail abyss Dec 31, 2020, 3:37 AM

#

I'm not sure, not to familiar with json

#

Didn't work that function either, since the string isn't a json already

torn sphinx Dec 31, 2020, 3:38 AM

#

https://jsonlint.com/?code= pasting that there gives invalid.

The JSON Validator

JSONLint is the free online validator and reformatter tool for JSON, a lightweight data-interchange format.

frail abyss Dec 31, 2020, 3:38 AM

#

Or maybe i called the function wrong

#

Any idea what I need to change?

#

Seems this line is the problem?

"tilt": [Decimal("89.9"), Decimal("50"), Decimal("29"), Decimal("50")]

torn sphinx Dec 31, 2020, 3:39 AM

#

yea

#

Decimal

frail abyss Dec 31, 2020, 3:39 AM

#

DynamoDB that added the Decimal before the value?

#

Why are they doing that? hmm...

torn sphinx Dec 31, 2020, 3:40 AM

#

Decimal is not a valid json thing

#

you can put that in quotes

frail abyss Dec 31, 2020, 3:40 AM

#

Yeah so "Decimal("89.9")" would work? Probably will maybe see how to remove those Decimal from DynamoDB from the start

torn sphinx Dec 31, 2020, 3:41 AM

#

Yes should

#

their may be some way to convert that... idk how

frail abyss Dec 31, 2020, 3:42 AM

#

Yeah, was apparently a common problem

https://www.reddit.com/r/aws/comments/bwvio8/dynamodb_has_been_storing_integers_as/

But thanks for the help anyways!

r/aws - DynamoDB has been storing integers as Decimal('234234') and...

11 votes and 8 comments so far on Reddit

#

Hmm... Probably just going to be lazy and store every number in the database as a string I guess

torn sphinx Dec 31, 2020, 3:44 AM

#

I would just add in regex replace to remove it

#

Any chance you know how to itterate through a sqlite result?

frail abyss Dec 31, 2020, 3:45 AM

#

never messed around with sqllite, just some t-sql so don't think I would be of great help

torn sphinx Dec 31, 2020, 3:48 AM

#

ah well worth a shot

frail abyss Dec 31, 2020, 4:03 AM

#

@torn sphinx Are you good with regex? How would i remove from Decimal("89.9") so only 89.9 is left?

torn sphinx Dec 31, 2020, 4:06 AM

#

Sorry i'm terrible at regex I'm sure I could figure it out but so could you.

#

your going to have to research that

frail abyss Dec 31, 2020, 4:09 AM

#

Haha yeah I guess, just regex is a pain in the ass, worth a shot. Thanks anyways

radiant elbow Dec 31, 2020, 4:25 AM

#

frail abyss <@456226577798135808> Are you good with regex? How would i remove from Decimal("...

Do you need to use regex?

#

!e ```
s = 'Decimal("89.9")'
s2 = s.strip('Decimal()"')
print(s2)

delicate fieldBOT Dec 31, 2020, 4:31 AM

#

@radiant elbow :white_check_mark: Your eval job has completed with return code 0.

89.9

radiant elbow Dec 31, 2020, 4:31 AM

#

str.strip() removes any character from a given list of characters from the beginning or the end of a string.

torn sphinx Dec 31, 2020, 7:28 AM

#

I assumed that their might be parentheses elsewhere that were needed though

#

or other letters

#

and it was in the middle of the string

torn sphinx Dec 31, 2020, 7:57 AM

#

How could I model attributes for products?

#

So like when people click a page it shows all products, then they click a button it filters by for example colour red, or another button to filter by size . Like this

river vortex Dec 31, 2020, 7:59 AM

#

What is the work of 'COUNT' here?? ''''' SELECT COUNT(from_id) AS inbound, old_rank, new_rank, id, url
FROM Pages JOIN Links ON Pages.id = Links.to_id
WHERE html IS NOT NULL AND ERROR IS NULL
GROUP BY id ORDER BY id,inbound ''''''

torn sphinx Dec 31, 2020, 8:00 AM

#

@river vortex is counting how many values for that column like how many rows

#

But it's not include the null values of that column

river vortex Dec 31, 2020, 8:04 AM

#

@torn sphinx Does it select duplicates??

torn sphinx Dec 31, 2020, 8:08 AM

#

I think yeah

river vortex Dec 31, 2020, 8:18 AM

#

Ohh...Thanks a lot...

vocal moon Dec 31, 2020, 4:21 PM

#

Im trying to design my database but im having some issues.

For each guild there will be multiple users, new users are added constantly
For each guild there will be multiple products, the guild owner can remove or add more

Each user is able to purchase products, therefor I need some way of giving each user products

#

Im not sure how to do that

#

i thought about arrays but that just seems flimsy

craggy arrow Dec 31, 2020, 4:22 PM

#

You need to look at many-to-many relationships

#

In database modeling

#

It seems you have 3 tables:

Guilds
Users
Products

And then various relationships between them. Which will likely need to be represented by a many to many relationships:

UsersProducts
GuildsProducts
GuildsUsers

vocal moon Dec 31, 2020, 4:25 PM

#

would UsersProducts, etc be separate tables?

craggy arrow Dec 31, 2020, 4:25 PM

#

No

vocal moon Dec 31, 2020, 4:26 PM

#

oh, there related

#

Guilds
Users
Products

#

so like the data is interlinked?

craggy arrow Dec 31, 2020, 4:26 PM

#

Right, the "link tables" just have 2 columns, that point to the left and right hand side of the relationship

#

So like UsersProducts would be like:
| user_id | product_id |

#

Where user_id and product_id are foreign keys to the user and product tables respectively

#

You can model the other relationships in the same way.

vocal moon Dec 31, 2020, 4:29 PM

#

can you give me an example of what my products table may look like

#

with user_id be a list of users who have the product

craggy arrow Dec 31, 2020, 4:29 PM

#

#

and users might be:
| user_id | name |

#

Are you using SQL Alchemy or just hand writing?

vocal moon Dec 31, 2020, 4:31 PM

#

postgres and pgadmin

vocal moon Dec 31, 2020, 4:31 PM

#

craggy arrow Maybe something like: | product_id | name | price | ... other stuff just about p...

but there isnt anything about the users here

craggy arrow Dec 31, 2020, 4:31 PM

#

vocal moon but there isnt anything about the users here

Im not sure I follow

proven arrow Dec 31, 2020, 4:32 PM

#

craggy arrow So like UsersProducts would be like: | user_id | product_id |

You may want to add guild id here as well. Otherwise if the user is in another guild with the same bot then their products will be global.

craggy arrow Dec 31, 2020, 4:32 PM

#

Yeah it depends, I figured the same product could be found for multiple guilds

#

or users can be in multiple guilds, if they can't then you can have simpler tables

#

User's Products still need to be many-many though

#

So are the requirements:
Guilds can have many users, and many products
Users can only have 1 guild
Products belong to 1 guild
Users can have many products

#

?

vocal moon Dec 31, 2020, 4:34 PM

#

users can be in multiple guilds but products for this user are guild specific
and yes, each product belongs to only one guild

craggy arrow Dec 31, 2020, 4:34 PM

#

Alright, so this is how I would model this, (bare with me a second)

vocal moon Dec 31, 2020, 4:37 PM

#

okie

craggy arrow Dec 31, 2020, 4:38 PM

#

Guilds
| guild_id | owner_user_id_fk | ... more data columns as needed ... |

Products
| product_id | guild_id_fk | ... more columns as needed ... |

Users
| user_id |  ... more columns as needed ... |


GuildUsers
| guild_id_fk | user_id_fk |

UsersProducts
| user_id_fk | product_id_fk |```

#

So this assumes guilds can have only 1 "owner"

#

When I say "more data columns" I just mean I assume you have some stuff like the guild / user name, etc ...

#

anything ending with _fk means "Foreign key" to one of the "core" tables

vocal moon Dec 31, 2020, 4:39 PM

#

i still dont understand what UsersProducts or GuildUsers would be

#

because you said it wouldnt be a table right

craggy arrow Dec 31, 2020, 4:40 PM

#

Oh, sorry if I said that I must have misunderstood, it will be a table

#

GuildUsers makes a link between the users table and the guild table, UsersProducts make a link between users and products

#

Because you said Products are specific to only one guild, the relationship between Guilds and Products is on the products table (meaning 1 guild to many products)

vocal moon Dec 31, 2020, 4:42 PM

#

ohhhh

#

i understand

#

thank u

#

so

#

much

#

❣️

#

no homo

craggy arrow Dec 31, 2020, 4:42 PM

#

No problem, this is kind of a classic db modeling problem 😄 and I like those

vocal moon Dec 31, 2020, 4:43 PM

#

https://giphy.com/gifs/justin-barnaby-xULW8v7LtZrgcaGvC0

Giphy

Barnaby

fading breach Dec 31, 2020, 4:56 PM

#

I have this at the top of my code db=pickledb.load("economy.db", False), but how can I set it to True, later in a command

craggy arrow Dec 31, 2020, 5:29 PM

#

@fading breach hard to help without some code, can you paste what you have?

fading breach Dec 31, 2020, 6:14 PM

#

its fine, I figured it out

craggy arrow Dec 31, 2020, 6:58 PM

#

👍

glass gorge Dec 31, 2020, 7:09 PM

#

hey

#

im getting a qlalchemy.exc.DataError: (pymysql.err.DataError) (1406, "Data too long for column

#

but the model is long enough to handle the input

#

so idk

#

maybe my orm isnt updating properly?

#

not sure

glass gorge Dec 31, 2020, 7:30 PM

#

can anyone advise on this?

#

hmmm i checked the db and it looks like it isnt updating it correctly

#

flask migrate

high sparrow Dec 31, 2020, 7:33 PM

#

I am trying to created a new Dataframe from an existing one, this works for the first colum but the second colum i am trying to create always has "NaN" as its values, there are obviously values in my Original Dataframe at that space but for some reason they are not being read

my first Dataframe:

import pandas as pd
import matplotlib.pyplot as plt
df = pd.readcsv('C:/Users/andi/OneDrive/Desktop/UNI/Angew_SYS1/Projekt/2012_gwr_sprengelerg.csv', sep = ';', encoding='cp1252')
df

This is how i want to create my Second Dataframe:

dataframe = pd.DataFrame(columns=['stimm',"stimm2"])
dataframe["stimm"] = df.loc[df['ptname'] == 'SPÖ', 'stimmen']
dataframe["stimm2"] = df.loc[df['ptname'] == 'FPÖ', 'stimmen']
print(dataframe)

My output is this:

stimm stimm2
2        32    NaN
13       46    NaN
24       41    NaN
35       39    NaN
46       48    NaN
...     ...    ...
2939     57    NaN
2950     74    NaN
2961     82    NaN
2972    535    NaN
2983     42    NaN

Does anyone know how i should go about this?

glass gorge Dec 31, 2020, 7:41 PM

#

let me refine my question

#

flask migrate, is not handling column datatype size changes

#

i read online that it doesnt handle column datatype changes, I assume this means that changing the size is also an issue

craggy arrow Dec 31, 2020, 7:43 PM

#

i read online that it doesnt handle column datatype changes, I assume this means that changing the size is also an issue

#

You got it

#

And that's actually because alemibic can't do it

#

you need to write a migration script for alembic by hand

#

I assume you used:
flask db revision ? probably with --auto-generate

#

You'll need to go into the script and add the stuff alembic couldn't do

#

Alembic is only able to do like 80% of stuff automatically

glass gorge Dec 31, 2020, 8:05 PM

#

i see

#

well, I read that i could just do compare_type=True that seems to have solved the issue

glass gorge Dec 31, 2020, 8:06 PM

#

craggy arrow you need to write a migration script for alembic by hand

i dont know what you mean by this

craggy arrow Dec 31, 2020, 8:06 PM

#

Oh really? That's cool

craggy arrow Dec 31, 2020, 8:07 PM

#

glass gorge i dont know what you mean by this

flask-migrate uses alembic underneath

glass gorge Dec 31, 2020, 8:07 PM

#

well yeah

#

but you said write a script manually for the migration

#

confused about that portion

craggy arrow Dec 31, 2020, 8:08 PM

#

so if you don't do --auto-generate then you just get a stub alembic script with the upgrade / downgrade functions left for you to write code for

#

Seems type compare works for your situation, I think there are some situations alembic cannot really handle though, in which case you have to hand write the migration

#

And there are other reasons too, like moving data from an old table to a new table, etc ...

glass gorge Dec 31, 2020, 8:09 PM

#

new to the orm and migrations in general

#

guess i need to do some more digging on writing migration scripts

craggy arrow Dec 31, 2020, 8:10 PM

#

Well sounds like you don't have to do it in this case

glass gorge Dec 31, 2020, 8:10 PM

#

have just been running 3 commands, stamp head, migrate, and upgrade

craggy arrow Dec 31, 2020, 8:10 PM

#

but I've seen alembic fail to figure out what its supposed to do

glass gorge Dec 31, 2020, 8:10 PM

#

yeah it seems kinda garbage

craggy arrow Dec 31, 2020, 8:11 PM

#

Well, I mean it does save you some work? But its not automagic, like we use SQLAlchemy and Alembic at work, and we always double check the scripts that alembic generates

glass gorge Dec 31, 2020, 8:11 PM

#

it does

#

i guess 80%

#

is better than 0%

#

seems touchy though, sensitive

craggy arrow Dec 31, 2020, 8:11 PM

#

Yeah that's the point, but it is annoying you have to go back and double check it

#

Well and like it kind of generates shit revision script names out of box

glass gorge Dec 31, 2020, 8:12 PM

#

yeaaa

#

omg those hashes

craggy arrow Dec 31, 2020, 8:12 PM

#

Yeah you can fix that

glass gorge Dec 31, 2020, 8:12 PM

#

"delete the most recent one"

#

ok but which one

#

lmao

glass gorge Dec 31, 2020, 8:13 PM

#

craggy arrow Yeah you can fix that

with autogenerate?

#

or how

craggy arrow Dec 31, 2020, 8:13 PM

#

There's a setting, let me see if I can find it

#

in the alembic ini

glass gorge Dec 31, 2020, 8:13 PM

#

cool

#

lmk

craggy arrow Dec 31, 2020, 8:13 PM

#

Im not sure how you specify it with flask-migrate

glass gorge Dec 31, 2020, 8:13 PM

#

I do have another question after

#

regarding declaring timestamp column in sqlalchemy

craggy arrow Dec 31, 2020, 8:14 PM

#

BTW, in the alembic section of the ini you can do:

#

file_template = %%(year)d%%(month).2d%%(day).2d_%%(rev)s

glass gorge Dec 31, 2020, 8:15 PM

#

craggy arrow `file_template = %%(year)d%%(month).2d%%(day).2d_%%(rev)s`

anywhere? or does it need a title row or something

craggy arrow Dec 31, 2020, 8:15 PM

#

so the name will then come out YYYYMMDD_<hash>.py

#

? Im talking about how to make alembic generate sequential filenames for the upgrade scripts

#

so the last one is the last upgrade, if you listed the directory

glass gorge Dec 31, 2020, 8:16 PM

#

craggy arrow ? Im talking about how to make alembic generate sequential filenames for the upg...

yeah but you said to drop that in the ini

#

so my ini has a bunch of "headers"

#

[handler_console]
class = StreamHandler
args = (sys.stderr,)
level = NOTSET
formatter = generic

[formatter_generic]
format = %(levelname)-5.5s [%(name)s] %(message)s
datefmt = %H:%M:%S```

#

handler_console

#

for example

craggy arrow Dec 31, 2020, 8:16 PM

#

Ooooh

#

it goes in [amelbic]

#

er

#

[alembic]

glass gorge Dec 31, 2020, 8:17 PM

#

[alembic]
file_template = %%(year)d%%(month).2d%%(day).2d_%%(rev)s```

craggy arrow Dec 31, 2020, 8:17 PM

#

Yeah

glass gorge Dec 31, 2020, 8:17 PM

#

thx

#

err regarding the timestamp

#

datatype

craggy arrow Dec 31, 2020, 8:18 PM

#

Yup?

glass gorge Dec 31, 2020, 8:18 PM

#

what's the syntax for sqlalchemy?

#

I looked in the docs

#

and it was just TIMESTAMP()

#

but that keeps kicking back an invalid datatype

#

    upload_timestamp = db.Column(db.TimeStamp())
AttributeError: 'SQLAlchemy' object has no attribute 'TimeStamp'

craggy arrow Dec 31, 2020, 8:19 PM

#

https://docs.sqlalchemy.org/en/13/core/type_basics.html

#

Date/Datetime

glass gorge Dec 31, 2020, 8:20 PM

#

oh

#

so datetime = timestamp

#

seems weird

craggy arrow Dec 31, 2020, 8:20 PM

#

Oh

#

theres one specifically for like unix epoch stamp

#

I think its this one:
https://docs.sqlalchemy.org/en/13/core/type_basics.html#sqlalchemy.types.Time

#

So there's date for a date with no time stamp, datetime for date+timestamp, and then for the epoch date stamp (seconds from like Jan 1, 1970 or something) you use Time IIRC

#

If you use PyCharm or a similarly intelligent IDE the autocomplete can help you out for this kind of thing too.

glass gorge Dec 31, 2020, 8:24 PM

#

i do use pycharm

#

but i think its datetime

craggy arrow Dec 31, 2020, 8:24 PM

#

Yeah, well I mean there's timestamp if you want it

#

I'd just keep type_basics open

#

while your working on stuff

glass gorge Dec 31, 2020, 8:25 PM

#

idk that didnt seem to work

#

it seems to have logged a null response

craggy arrow Dec 31, 2020, 8:26 PM

#

Whats your model look like?

glass gorge Dec 31, 2020, 8:27 PM

#


class Phone_Survey(db.Model):
    __tablename__ = "phone_survey"
    __bind_key__ = "user_data"


    survey_id = db.Column(db.Integer, primary_key=True, autoincrement=True)
    interviewer_id = db.Column(db.String(20), nullable=True)
    first_name = db.Column(db.String(20))
    last_name = db.Column(db.String(20))
    upload_timestamp = db.Column(db.DateTime())
    time_customer_drop = db.Column(db.DateTime)```

#

this is the shorter version

#

im looking at the upload_timestamp var

#

WARNING in survey_form: Invalid datetime value submitted: Could not match input '' to any of the following formats: YYYY-MM-DD, YYYY-M-DD, YYYY-M-D, YYYY/MM/DD, YYYY/M/DD, YYYY/M/D, YYYY.MM.DD, YYYY.M.DD, YYYY.M.D, YYYYMMDD, YYYY-DDDD, YYYYDDDD, YYYY-MM, YYYY/MM, YYYY.MM, YYYY, W

craggy arrow Dec 31, 2020, 8:29 PM

#

Your model looks fine, I think where ever your getting the upload_timestamp from is an empty string

glass gorge Dec 31, 2020, 8:29 PM

#

let me see

craggy arrow Dec 31, 2020, 8:29 PM

#

Well actually

#

upload_timestamp = db.Column(db.DateTime())
time_customer_drop = db.Column(db.DateTime)

glass gorge Dec 31, 2020, 8:30 PM

#

yeah

craggy arrow Dec 31, 2020, 8:30 PM

#

That could be a problem but I don't remember exactly

glass gorge Dec 31, 2020, 8:30 PM

#

that empty string i think is for the time_customer_drop

#

and i didnt fill that section out

#

the upload_timestamp is something else

#

#

hmmm maybe ill set nullable to false

craggy arrow Dec 31, 2020, 8:32 PM

#

Well you should be able to have a nullable Datetime

#

But

glass gorge Dec 31, 2020, 8:32 PM

#

not for my usecase though 😐

#

but i see your point

#

that shouldnt cause the error

craggy arrow Dec 31, 2020, 8:33 PM

#

Yeah I think you have an issue where like

#

The form being submitted back is sending '' for the timestamp

#

and SQLAlchemy is strick and doesn't consider that "None" (which it shouldnt)?

#

Maybe I don't know

glass gorge Dec 31, 2020, 8:34 PM

#

well theres no field for upload timestamp

#

on the form

#

lol 😦

craggy arrow Dec 31, 2020, 8:34 PM

#

Well where does it come from, that timestamp? like how are you populating it on the model

#

Im saying that's the problem

#

even if you make that column not nullable you probably will still have issues I think

#

(not a hundred percent sure, debugging fragments of code is not particularly easy :D)

glass gorge Dec 31, 2020, 8:35 PM

#

it was working before

#

gonna try the null thing

#

then see

#

lol

#

yeah that wasnt it

#

ill dig some more

#

thank you

craggy arrow Dec 31, 2020, 8:37 PM

#

np

glass gorge Dec 31, 2020, 8:40 PM

#

craggy arrow Well where does it come from, that timestamp? like how are you populating it on ...

it's server side

#

not in python

craggy arrow Dec 31, 2020, 8:40 PM

#

You mean default value for the column?

glass gorge Dec 31, 2020, 8:40 PM

#

yea

craggy arrow Dec 31, 2020, 8:40 PM

#

I didn't see you specify that on the model,

#

Think you have to tell SQLAlchemy to do that

glass gorge Dec 31, 2020, 8:40 PM

#

i had changed the model before

#

so that's prob why

craggy arrow Dec 31, 2020, 8:41 PM

#

I see I see, you want it to basically be the time the row was inserted, yeah I think you just need to tweak your model

#

Still seems like a weird error

glass gorge Dec 31, 2020, 8:43 PM

#

just going through my github

#

looking for what i had before

stuck raptor Dec 31, 2020, 9:13 PM

#

Can someone help me use a SQL data base to store stuff for a discord bot?

glass gorge Dec 31, 2020, 9:24 PM

#

@stuck raptor i suggest youtube tutorials

stuck raptor Dec 31, 2020, 9:24 PM

#

glass gorge <@!618209006837825547> i suggest youtube tutorials

do you know any on mysql

glass gorge Dec 31, 2020, 9:25 PM

#

I watched a corey schafer video

#

on building a flask app, and working with mysql db

#

there are also some on digital ocean

#

that I followed

#

I don't know how discord bots work

#

but you'd need to basically link the bot to the db

pure dirge Dec 31, 2020, 9:27 PM

#

Big pizza

#

Hello everyone.

glass gorge Dec 31, 2020, 9:27 PM

#

big pizza deez

pure dirge Dec 31, 2020, 9:27 PM

#

Anyone know how to manipulate a csv XD

glass gorge Dec 31, 2020, 9:28 PM

#

sure

#

use hammer

pure dirge Dec 31, 2020, 9:28 PM

#

Hammer?

glass gorge Dec 31, 2020, 9:30 PM

#

yeah use a hammer

#

im jk

#

what do you need help with

stuck raptor Dec 31, 2020, 9:31 PM

#

glass gorge I watched a corey schafer video

Can you please give me a link..

glass gorge Dec 31, 2020, 9:31 PM

#

nope :/

pure dirge Dec 31, 2020, 10:11 PM

#

glass gorge what do you need help with

search a column for a word, put the rows of those columsn close together

#

organising the csv basically

glass gorge Dec 31, 2020, 10:18 PM

#

idk

#

but i think datascience sounds more appropriate for this

#

are you using pandas?

#

is this in a db

#

youd prob have to use the selector method dataframe[]

#

then do your manipulations

snow knot Dec 31, 2020, 11:14 PM

#

hello?

#

does anyone know how to make a database for saving a game

#

like a multiplaye rgame

stuck raptor Dec 31, 2020, 11:16 PM

#

Can someone help me with making a table in MySQL?

pure dirge Dec 31, 2020, 11:58 PM

#

glass gorge are you using pandas?

I just have the csv and then put it into Libre calc, I have never even used another program or anything so I'm not sure options etc.

rugged ginkgo Jan 1, 2021, 1:30 AM

#

Would this be the place to ask a library specific question about asyncpg?

craggy arrow Jan 1, 2021, 1:32 AM

#

Probably not here unless their GH Readme pointed you here

torn sphinx Jan 1, 2021, 2:09 AM

#

rugged ginkgo Would this be the place to ask a library specific question about `asyncpg`?

@rugged ginkgo @craggy arrow yes because asyncpg is a database module of Postgres, which is a db

craggy arrow Jan 1, 2021, 2:09 AM

#

Well, it is, that doesn't mean anyone here has any experience with it.

#

They probably have their own discord / IRC channel / mailing list / <obligatory comms channel>

#

Their home page actually lists it:
http://magic.io/blog/asyncpg-1m-rows-from-postgres-to-python/

magicstack is a Toronto-based team of software engineers. Feel free to drop us a line at hello@magic.io.
So he/she probably wants to email hello@magic.io

rugged ginkgo Jan 1, 2021, 2:25 AM

#

Thanks 🙂

torn sphinx Jan 1, 2021, 2:38 AM

#

Anyone pymongo dev here?

pale canopy Jan 1, 2021, 6:52 AM

#

I'm using PyMongo to make a DB using MongoClient and I keep getting connection refused error py pymongo.errors.ServerSelectionTimeoutError: localhost:27017: [WinError 10061] No connection could be made because the target machine actively refused it, Timeout: 30s, Topology Description: topology_type: Single, servers: [<ServerDescription ('localhost', 27017) server_type: Unknown, rtt: None, error=AutoReconnect('localhost:27017: [WinError 10061] No connection could be made because the target machine actively refused it')>]>

#

I don't get how it doesn't work on localhost?

vivid delta Jan 1, 2021, 7:38 AM

#

I am getting pgconfig error while executing my postgres script on a server, I searched github and it says to bump pgproto, can anyone give me an idea about it?

zinc mist Jan 1, 2021, 12:54 PM

#

Hey everyone a newbie to python scripting is here, I want to share my Chrome extractor version 😊, and I want you all to tell me your comments and advices to learn more about this stuff.
This Python script will extract all saved passwords from your google chrome database and save it in a hidden file chrome.txt : https://github.com/Reda-BELHAJ/Chrome-Extractor

GitHub

Reda-BELHAJ/Chrome-Extractor

Python script that will extract all saved passwords from your google chrome database and save it in a hidden file chrome.txt - Reda-BELHAJ/Chrome-Extractor

craggy arrow Jan 1, 2021, 12:57 PM

#

I wrote the same thing awhile ago:
https://github.com/jimcarreer/tools/blob/master/crpd.py
I back up my passwords for my wife off to a thumbdrive I keep in a firebox, in case I die or something.

#

I just shamelessly stole most of it from:
https://github.com/priyankchheda/chrome_password_grabber/blob/master/chrome.py
😄

zinc mist Jan 1, 2021, 1:03 PM

#

@craggy arrow this version is way cooler ngl

craggy arrow Jan 1, 2021, 1:03 PM

#

Yeah its nice, it covers Nix and Mac. I haven't been on windows for ages now.

scarlet dagger Jan 1, 2021, 1:04 PM

#

i'm new to sql server. I want to secure my website from sql injection. What method is used to secure website. can anyone help please?

craggy arrow Jan 1, 2021, 1:04 PM

#

Use prepared statements is the main advice

#

Don't do things like:
cursor.execute(f"INSERT INTO table (column_name) VALUES ({raw_user_input})")
Do instead
cursor.execute("INSERT INTO table (column_name) VALUES (?)", (raw_user_input,))

#

If you're using SQL Alchemy, and don't hand write any queries, you're probably already protected @scarlet dagger

scarlet dagger Jan 1, 2021, 1:08 PM

#

craggy arrow If you're using SQL Alchemy, and don't hand write any queries, you're probably a...

What is SQL Alchemy?

craggy arrow Jan 1, 2021, 1:09 PM

#

It's an object relational mapper for Python that turns class definitions in your python code into Database tables / entities:
https://github.com/sqlalchemy

#

It's the de-facto ORM most people use in Python.

scarlet dagger Jan 1, 2021, 1:09 PM

#

ok Thanks @craggy arrow

craggy arrow Jan 1, 2021, 1:10 PM

#

I've also got a beta for a library I'm writing:
https://github.com/jimcarreer/dinao
If you like writing SQL

scarlet dagger Jan 1, 2021, 1:10 PM

#

Do you have an any idea how to secure in php?

craggy arrow Jan 1, 2021, 1:11 PM

#

Its the same strategy in every language, use prepared statements, don't put user input directly into the Query strings

#

https://www.php.net/manual/en/mysqli.quickstart.prepared-statements.php

scarlet dagger Jan 1, 2021, 1:11 PM

#

I use Store Procedure

#

but nothing works for me

craggy arrow Jan 1, 2021, 1:12 PM

#

I'm not a fan of sprocs and don't really use them but I think the same thing applies for that.

#

What DB Backend you using? (MySQL, PSQL, MS ... ? )

scarlet dagger Jan 1, 2021, 1:13 PM

#

craggy arrow Its the same strategy in every language, use prepared statements, don't put user...

@craggy arrow i am using sqlserver not mysql?

scarlet dagger Jan 1, 2021, 1:13 PM

#

craggy arrow What DB Backend you using? (MySQL, PSQL, MS ... ? )

mssql

craggy arrow Jan 1, 2021, 1:14 PM

#

Its still the same, all database backends implement prepared statement functionality.

scarlet dagger Jan 1, 2021, 1:14 PM

#

ok i try

craggy arrow Jan 1, 2021, 1:16 PM

#

Also if you want help with PHP, you might try a community focused on PHP instead of Python 😄 But since this is a general database question I guess its fine.

#

@scarlet dagger look here:
https://www.php.net/manual/en/pdo.prepared-statements.php
at Example #4 / #5, regardless of the backed the $db_handle->prepare(...) should be valid

eternal raptor Jan 1, 2021, 1:37 PM

#

async def create_db_pool():
    client.conn = await asyncpg.create_pool(user="bot", password="Sebi2006", database="ninjamnrdb", host="127.0.0.1")```
Password is correct, asyncpg is imported.

📎 unknown.png

craggy arrow Jan 1, 2021, 1:38 PM

#

@eternal raptor would help if you posted some context, but considering there's an authorization error, you should probably check that user+pass combo with something like pgadmin

eternal raptor Jan 1, 2021, 1:39 PM

#

pgadmin works

#

dbeaver too

craggy arrow Jan 1, 2021, 1:39 PM

#

ninjamnrdb
^ When this db is specified?

eternal raptor Jan 1, 2021, 1:39 PM

#

database="ninjamnrdb"

#

NinjaaaSKDziś o 14:37
async def create_db_pool():
    client.conn = await asyncpg.create_pool(user="bot", password="Sebi2006", database="ninjamnrdb", host="127.0.0.1")

craggy arrow Jan 1, 2021, 1:39 PM

#

Oh it says invalid password, nvm

eternal raptor Jan 1, 2021, 1:40 PM

#

wait

#

please

#

I connected with database in pgadmin correctly

craggy arrow Jan 1, 2021, 1:40 PM

#

Port 5432 ?

eternal raptor Jan 1, 2021, 1:41 PM

#

127.0.0.1:61462

#

http://127.0.0.1:61462/browser/

craggy arrow Jan 1, 2021, 1:41 PM

#

No I mean, is the port the db running on the standard one

#

5432, and are you sure you're not running 2 DB instances?

#

I mean unless there's a serious bug in asyncpg (I doubt it) the error is straight forward: either you're not connecting to the database server you think you are, or the password is wrong.

eternal raptor Jan 1, 2021, 1:42 PM

#

eee what? wait, Could you tell me how to check port?

craggy arrow Jan 1, 2021, 1:43 PM

#

Can you show me the settings for the database in PGAdmin?

eternal raptor Jan 1, 2021, 1:43 PM

#

yes, i can.

craggy arrow Jan 1, 2021, 1:43 PM

#

If you want to DM them to me that's fine

eternal raptor Jan 1, 2021, 1:43 PM

#

yup

craggy arrow Jan 1, 2021, 1:53 PM

#

(got him covered :D)

fading breach Jan 1, 2021, 4:34 PM

#

@maiden light can you help me with mongodb?

maiden light Jan 1, 2021, 4:37 PM

#

@fading breach Alright

fading breach Jan 1, 2021, 4:37 PM

#

I created a cluster

#

whats next

#

I found a YT tutorial

#

I will follow that

maiden light Jan 1, 2021, 4:40 PM

#

Create a database user with a password that you remember, it should have all access

fading breach Jan 1, 2021, 4:41 PM

#

ok

#

done

maiden light Jan 1, 2021, 4:42 PM

#

Well let me login I can't remember much

#

I apparently can't login, well allow all ip addresses or depends on you, that can access your db.

#

Add 0.0.0.0 as an ip to allow everyone

#

Create a database

#

Add a collection

#

Click on CONNECT on your cluster and then application, then set driver as Python 3.4+ and get the connection url, in that url change pass to the database user password you created, and done.

#

With that url you can add records, install Motor

fading breach Jan 1, 2021, 6:15 PM

#

@maiden light I have completed setup, how can I dump stuff into thew database

#

this is what I have for pickledb/json ```py
db.set(str(ctx.message.author.id),job+500)
db.dump()

tall olive Jan 1, 2021, 6:26 PM

#

dataclasses + sqlalchemy + active record:

https://twitter.com/arundsharma/status/1338596939600781313

Arun Sharma (@arundsharma)

Why isn't this style more popular? #Python #SQL

#

Looking for feedback and pointers to similar work so I can learn about prior art in this area

elfin wigeon Jan 1, 2021, 7:45 PM

#

Hello guys. I have a question. Is it possible to add a path and work with two work directories like in matlab?

torn sphinx Jan 1, 2021, 9:19 PM

#

is it possible to connect your database (from mongodb) to a website ?

#

Just wanted to say thanks for this

jovial notch Jan 2, 2021, 1:36 AM

#

@radiant elbow lmk if u could help, you helped me last time 😛

torn sphinx Jan 2, 2021, 1:38 AM

#

oh

#

i can help you

radiant elbow Jan 2, 2021, 1:38 AM

#

that's not got anything to do with databases - the error there is that data is a string, and you're using 'id' as an index into it.

torn sphinx Jan 2, 2021, 1:38 AM

#

data is returning a string not list

#

array **

jovial notch Jan 2, 2021, 1:43 AM

#

@radiant elbow @torn sphinx why is that tho like I have more codes that are like these? for example

radiant elbow Jan 2, 2021, 1:44 AM

#

data in that one is the return from fetchrow - it's the return from execute in the other.

jovial notch Jan 2, 2021, 1:45 AM

#

@radiant elbow so what do I need to fix?

radiant elbow Jan 2, 2021, 1:46 AM

#

you probably are missing a call to some fetch* function

jovial notch Jan 2, 2021, 1:47 AM

#

what is the difference between fetch, fetchrow and execute?

radiant elbow Jan 2, 2021, 1:48 AM

#

what library are you using?

jovial notch Jan 2, 2021, 1:50 AM

#

asyncpg @radiant elbow

radiant elbow Jan 2, 2021, 1:56 AM

#

fetch runs a statement and returns the result as a list of records. fetchrow returns a single record, the first row of the result set.

jovial notch Jan 2, 2021, 1:57 AM

#

ok 1 more question, difference between integer and bigint? @radiant elbow

radiant elbow Jan 2, 2021, 1:58 AM

#

integer has a maximum value it can hold, bigint is unlimited

jovial notch Jan 2, 2021, 1:59 AM

#

so like for things like 1 to 10

#

i need integer?

#

why cant it work with bigint?

radiant elbow Jan 2, 2021, 2:00 AM

#

it would work with bigint - just slower.

#

bigint can hold any integer, integer can hold only integers within a certain range.

pale canopy Jan 2, 2021, 3:02 AM

#

I'm using PyMongo to make a DB using MongoClient and I keep getting connection refused error py pymongo.errors.ServerSelectionTimeoutError: localhost:27017: [WinError 10061] No connection could be made because the target machine actively refused it, Timeout: 30s, Topology Description: topology_type: Single, servers: [<ServerDescription ('localhost', 27017) server_type: Unknown, rtt: None, error=AutoReconnect('localhost:27017: [WinError 10061] No connection could be made because the target machine actively refused it')>]>

radiant elbow Jan 2, 2021, 4:07 AM

#

do you have the same problem if you remove the ( and ) from inside query1? The column list for a select shouldn't be surrounded in ()

jovial notch Jan 2, 2021, 4:09 AM

#

damn u know a lot appreciated also whats fetchval?

shell ocean Jan 2, 2021, 5:03 AM

#

jovial notch damn u know a lot appreciated also whats `fetchval`?

fetch - multiple rows and columns
fetchrow - one row, multiple columns
fetchval - one row, one column (so one value)

maiden light Jan 2, 2021, 5:56 AM

#

fading breach <@!471602590359224351> I have completed setup, how can I dump stuff into thew d...

You got the url and Motor?

from motor.motor_asyncio import AsyncIOMotorClient as MotorClient
mongo = MotorClient("Your url")
db = mongo["database name"]

record = {"id": 1234, "balance": 0, "bank": 0}
await db["collection name"].insert_one(record)

#

To find it

find = await db["collection name"].find_one({"id": 1234})
find["balance"] # will give balance

Also

find = await db["collection name"].find_one({"balance": 0}) # if more than 1 people have 0 balance, it will give randomly
find["id"] etc.

#

find instead of find_one will give all people having 0 balance, there is update_one, update_many, insert_many, you can look at docs.

#

To update

await db["collection name"].update_one({"id": 1234}, {"$inc": {"balance": 500}})
# Here $inc means increase, it will add 500, if you use $set it would set the balance to 500 instead of adding.

torn sphinx Jan 2, 2021, 7:58 AM

#

radiant elbow `integer` has a maximum value it can hold, `bigint` is unlimited

bigint also has limit

radiant elbow Jan 2, 2021, 8:09 AM

#

oof, so it does. My mistake for assuming.

#

It's weird that they call that bigint instead of int64, at least to my sensibilities...

torn sphinx Jan 2, 2021, 8:16 AM

#

Is it also unlimited in python or is different?

radiant elbow Jan 2, 2021, 8:20 AM

#

Python's int type is unlimited, as are Java and C#'s BigInteger

#

I find it surprising that something would be called bigint and not be unlimited - everything I've ever seen before that's called a big integer is unlimited.

torn sphinx Jan 2, 2021, 8:21 AM

#

oh i thought everywhere it was limited to 64 bit

#

i didnt know this til

radiant elbow Jan 2, 2021, 8:22 AM

#

I mean, the postgres bigint type is limited to 64 bits, but big integers in other languages aren't

torn sphinx Jan 2, 2021, 8:22 AM

#

Thats nice

radiant elbow Jan 2, 2021, 8:22 AM

#

!e ```py
print(2**100)

delicate fieldBOT Jan 2, 2021, 8:22 AM

#

@radiant elbow :white_check_mark: Your eval job has completed with return code 0.

1267650600228229401496703205376

radiant elbow Jan 2, 2021, 8:23 AM

#

^ more than 2**64 🙂

torn sphinx Jan 2, 2021, 8:23 AM

#

So does this have anything do with IEE64
or is that for something else

radiant elbow Jan 2, 2021, 8:23 AM

#

nope, completely unrelated to that.

torn sphinx Jan 2, 2021, 8:23 AM

#

Oh yeah i remember that is for floating points right?

radiant elbow Jan 2, 2021, 8:23 AM

#

right. and it still has a limit

torn sphinx Jan 2, 2021, 8:24 AM

#

Oh so that has a limit. Ok now i see. I thought it was other way round.

radiant elbow Jan 2, 2021, 8:24 AM

#

IEEE-754 double precision floats (which take up 64 bits) can't represent integers above 2**53 precisely

#

(or below -2**53)

torn sphinx Jan 2, 2021, 8:24 AM

#

Understand, thanks. I thought floats were more precise befor

radiant elbow Jan 2, 2021, 8:24 AM

#

they have a wider range, but limited precision.

torn sphinx Jan 2, 2021, 8:25 AM

#

Thanks

radiant elbow Jan 2, 2021, 8:25 AM

#

!e ```py
print(2.053)
print(2.053+1)
print(2.0**53+2)

delicate fieldBOT Jan 2, 2021, 8:25 AM

#

@radiant elbow :white_check_mark: Your eval job has completed with return code 0.

001 | 9007199254740992.0
002 | 9007199254740992.0
003 | 9007199254740994.0

radiant elbow Jan 2, 2021, 8:26 AM

#

^ note that line 2 isn't correct, it skipped over ...993.0 because that can't be exactly represented in an IEEE 754 64-bit float.

torn sphinx Jan 2, 2021, 8:26 AM

#

I see

#

So is this edge case ever affected in real life?

#

Like you cant do some things because of this?

#

Or there is some other way around it

radiant elbow Jan 2, 2021, 8:29 AM

#

that's a very large number - it's not one that typically comes up when you're dealing with integers, because you rarely have to count 9 quadrillion of something - but it does come up in various types of math, and needs to be accounted for.

frail abyss Jan 2, 2021, 8:39 AM

#

Don't know where to put this question but anyone good with regex? I what to indentify the word Decimal("98.8"), the number can vary and have different length then just 00.0

I can indentify the last part ") but what to I write to tell to match everything before ") until space?

mild vector Jan 2, 2021, 11:20 AM

#

Hey, do I lose my databases if I uninstall and then re-install postgresql on Ubuntu 20.04 ?

astral gorge Jan 2, 2021, 1:47 PM

#

    Is the server running locally and accepting
    connections on Unix domain socket "/run/postgresql/.s.PGSQL.5432"?```
psql seems to have broke after the system update, any tips?

#

systemctl postgresql also doesn't work

mild vector Jan 2, 2021, 2:12 PM

#

Same problem

#

I tried everything but it didn't work

stark violet Jan 2, 2021, 2:44 PM

#

I'm very new to databases in python, and I want to learn more about them. Can you guys recommend me a good database that I should start?

fading breach Jan 2, 2021, 2:45 PM

#

stark violet I'm very new to databases in python, and I want to learn more about them. Can yo...

pymongo

stark violet Jan 2, 2021, 2:47 PM

#

fading breach pymongo

thoughts on mysql?

fading breach Jan 2, 2021, 2:48 PM

#

mysql is fine

#

postgres

stark violet Jan 2, 2021, 2:48 PM

#

because I'm familiar with mysql but haven't used it in python

stark violet Jan 2, 2021, 2:49 PM

#

fading breach postgres

is that like a upgraded version of mysql?

fading breach Jan 2, 2021, 2:50 PM

#

no

#

postgres is a differen database

maiden light Jan 2, 2021, 2:56 PM

#

fading breach pymongo

Pymongo is blocking, Motor is the way.

fading breach Jan 2, 2021, 2:56 PM

#

ok

#

@maiden light can you help me make the switch from pickledb to mongo

#

like step by step

#

for each command

#

do you have some time?

maiden light Jan 2, 2021, 2:57 PM

#

You know the basics? I mean, insert update delete ?

fading breach Jan 2, 2021, 2:57 PM

#

ok

maiden light Jan 2, 2021, 2:58 PM

#

Idk pickledb

fading breach Jan 2, 2021, 2:58 PM

#

its like json

#

@maiden light <password> should be replaced, right/

maiden light Jan 2, 2021, 2:59 PM

#

Yes

#

You don't need <> around it

fading breach Jan 2, 2021, 3:00 PM

#

ok

maiden light Jan 2, 2021, 3:00 PM

#

Did you make a database, and a collection?

fading breach Jan 2, 2021, 3:00 PM

#

yes

#

I put the link in

#

so record is the format I want my database to be in

maiden light Jan 2, 2021, 3:01 PM

#

maiden light You got the url and Motor? ```py from motor.motor_asyncio import AsyncIOMotorCli...

Look at this

fading breach Jan 2, 2021, 3:01 PM

#

record = {"id": message.author.id, "balance": current_balance, }
await db["collection name"].insert_one(record)

#

this correct?

maiden light Jan 2, 2021, 3:02 PM

#

If it is inserting it should be 0?

#

But yeah it's correct

#

Wait you don't need the , after current_balance

fading breach Jan 2, 2021, 3:04 PM

#

@commands.command()
 async def setup(self, ctx):
    for member in ctx.guild.members:
      record = {"id": (str(member.id)), "job": False}
      await db["Scope Economy"].insert_one(record)

#

is this correct?

#

if it is, I've got the hang of it, thanks

maiden light Jan 2, 2021, 3:06 PM

#

Well, it isn't :/, you don't have balance or bank, I don't know how you do it, but that False is a SyntaxError.

fading breach Jan 2, 2021, 3:07 PM

#

im trying to set all the ID's to false

#

or None

maiden light Jan 2, 2021, 3:07 PM

#

Have something like "status": False

fading breach Jan 2, 2021, 3:07 PM

#

ok

maiden light Jan 2, 2021, 3:07 PM

#

Or None

fading breach Jan 2, 2021, 3:08 PM

#

how about now

#

(I edited the message)

maiden light Jan 2, 2021, 3:09 PM

#

Yep it's fine

#

But you shouldn't make ids str just saying

fading breach Jan 2, 2021, 3:09 PM

#

ok

#

how do I find the job of ctx.message.author

maiden light Jan 2, 2021, 3:10 PM

#

You don't need the ( before str,
record = {"id": str(member.id), ..

fading breach Jan 2, 2021, 3:10 PM

#

ok

maiden light Jan 2, 2021, 3:10 PM

#

maiden light To find it ```py find = await db["collection name"].find_one({"id": 1234}) find[...

This

maiden light Jan 2, 2021, 3:10 PM

#

maiden light To find it ```py find = await db["collection name"].find_one({"id": 1234}) find[...

And this

#

Wait it's the same message LOL

fiery scaffold Jan 2, 2021, 3:11 PM

#

Postgress or MySQL...
Which one should I use...?

fading breach Jan 2, 2021, 3:11 PM

#

is this correct ```py
find = await db["Scope Economy"].find_one({"id": ctx.message.author})
find["id"]

fiery scaffold Jan 2, 2021, 3:12 PM

#

fiery scaffold Postgress or MySQL... Which one should I use...?

With Django

fading breach Jan 2, 2021, 3:12 PM

#

hmm

#

maybe MySQL

#

better for web development

fiery scaffold Jan 2, 2021, 3:12 PM

#

hmmm...

fading breach Jan 2, 2021, 3:13 PM

#

im not an expert or anything

maiden light Jan 2, 2021, 3:13 PM

#

fading breach is this correct ```py find = await db["Scope Economy"].find_one({"id": ctx.messa...

Yeah you can do find["job"]

fading breach Jan 2, 2021, 3:13 PM

#

maiden light Yeah you can do find["job"]

ok, thx

fiery scaffold Jan 2, 2021, 3:13 PM

#

well Then I'll see which one of them have better

#

learning resources

#

and community support

fading breach Jan 2, 2021, 3:14 PM

#

I just see more people use mysql for web

fiery scaffold Jan 2, 2021, 3:14 PM

#

yaa

#

but isn't postgress getting more and more attention

fading breach Jan 2, 2021, 3:14 PM

#

yeah

fiery scaffold Jan 2, 2021, 3:14 PM

#

lately

#

guess ill just toss a coin then🙃

strong granite Jan 2, 2021, 3:28 PM

#

Hey guys, looking forward to contibuting to this discord channel as I become more familar with python. I have a simple .JSON parsing question in help room chlorine if anybody could give me some input 🙂

fading breach Jan 2, 2021, 4:11 PM

#

im getting this error @maiden light InvalidDocument: cannot encode object:

astral gorge Jan 2, 2021, 4:14 PM

#

#databases message anyone?

craggy arrow Jan 2, 2021, 5:08 PM

#

fiery scaffold Postgress or MySQL... Which one should I use...?

I prefer Postgres, since Oracle owns MySQL

torn sphinx Jan 2, 2021, 5:18 PM

#

hello

fading breach Jan 2, 2021, 5:19 PM

#

Hi, I have this error bson.errors.InvalidDocument: cannot encode object:

#

code: ```py
find = await db["Scope Collection"].find_one({"id": message.author})
get = find["level"]

burnt turret Jan 2, 2021, 5:29 PM

#

mongodb (or any db that i know for that matter) won't support storing arbitrary python objects like that

#

you want to be storing/retrieving message.author.id in this case

placid igloo Jan 2, 2021, 5:41 PM

#

https://pastebin.com/t9KNptAk What am I doing wrong here? Running any function gives me "Error: Commands out of sync; you can't run this command now"

Pastebin

SQL.py - Pastebin.com

Pastebin.com is the number one paste tool since 2002. Pastebin is a website where you can store text online for a set period of time.

maiden light Jan 2, 2021, 5:56 PM

#

fading breach Hi, I have this error ``bson.errors.InvalidDocument: cannot encode object: ``

message.author.id not message.author

fading breach Jan 2, 2021, 5:57 PM

#

oh

#

oops

#

silly me

#

get = find["level"]
TypeError: 'NoneType' object is not subscriptable

#

@maiden light

craggy arrow Jan 2, 2021, 5:59 PM

#

LOL I like how someone will 👎 an opinion but then not bother responding to the person who asked.

burnt turret Jan 2, 2021, 6:06 PM

#

fading breach ```py get = find["level"] TypeError: 'NoneType' object is not subscriptable ```

the dictionary find is empty

#

as in you're query probably had zero matches

fading breach Jan 2, 2021, 6:06 PM

#

oh

burnt turret Jan 2, 2021, 6:06 PM

#

assuming you did something like find = await collection.find...

fading breach Jan 2, 2021, 6:07 PM

#

yeah, it equals nothing

#

thats the problem

burnt turret Jan 2, 2021, 6:10 PM

#

yeah, so make a case that handles that

#

the case where there's no data matching

fading breach Jan 2, 2021, 7:04 PM

#

@burnt turret should I make an if statement?