#kishore-data-ingestion

1 messages · Page 1 of 1 (latest)

cloud oarBOT
slate vigil
#

@gusty drum I'll start by sending this is mostly impossible in our API and is likely a misunderstanding or a bug in your code.

#

Let's focus on one concrete example on one specific API: can you share your exact code and an example object that isn't returned?

gusty drum
#

Sure, thanks for the response

#

ApI's are straight forward, I don't have any filters to fall off. I see several charges happening everyday in Payments folder (All transactions tab), I see 191 charge recordsi in it currently. through charge API I only got 31 tcharge records in my datawarehouse. What exactly you want me to share?

slate vigil
#

Your exact code as a developer and an exact example of where you list Charges and don't see it back

#

right now you seem to talk as if you use some third-party for data ingestion so I'm confused

gusty drum
#

I setup azure synapse pipeline (using bearer auth) to extract data from stripe to Azure Data lake, and from there to Azure SQL MI Database.

To test this simple way what I am talking using command prompt

v1/charges (it not letting me post complete curl link)

#

I use sk_live key

slate vigil
#

sure but that's just a call to list Charges and it will return 10 by default

#

sorry I'm still really confused on what the problem is right now

gusty drum
#

How to get all transactions instead of only 10

slate vigil
#

kishore-data-ingestion

gusty drum
#

May be I am not using the right end point? Please direct me the right way

These are the endpoints I am using

#

Can you please educate me with an example, how to paginate

slate vigil
#

We have List APIs. They return 10 objects at once. And then as a developer you write a loop that will get the next page and the next page until you are done. This requires custom logic/code. And it's explained on the exact doc I shared: https://stripe.com/docs/api/pagination
does that make sense?

gusty drum
#

Hmm, yes it make sense. Does it also have a date filters to get certain date range or kind of incremental?

#

Are there any other API's other than list apis' which can return everything? or with only last 24 hour data

#

A sample code will be very helpful. I use microsoft Azure tools only

slate vigil
#

yes there are date filters, all documented really in the API Reference. And no there are no API to dump everything.
I don't have code examples sorry I have never heard of your interface but our API reference also has clear examples for all languages we support like .NET maybe for your environment

gusty drum
#

So if I understand correctly, we have to put code around these api's if we need more than 10 records of data

#

To make it clear, I want to extract data from stripe for my company and create a report on that data(could be balance, transactions, charges, payments ...)

slate vigil
#

yes you have to paginate