#kishore-data-ingestion
1 messages · Page 1 of 1 (latest)
@gusty drum I'll start by sending this is mostly impossible in our API and is likely a misunderstanding or a bug in your code.
Let's focus on one concrete example on one specific API: can you share your exact code and an example object that isn't returned?
Sure, thanks for the response
ApI's are straight forward, I don't have any filters to fall off. I see several charges happening everyday in Payments folder (All transactions tab), I see 191 charge recordsi in it currently. through charge API I only got 31 tcharge records in my datawarehouse. What exactly you want me to share?
Your exact code as a developer and an exact example of where you list Charges and don't see it back
right now you seem to talk as if you use some third-party for data ingestion so I'm confused
I setup azure synapse pipeline (using bearer auth) to extract data from stripe to Azure Data lake, and from there to Azure SQL MI Database.
To test this simple way what I am talking using command prompt
v1/charges (it not letting me post complete curl link)
I use sk_live key
sure but that's just a call to list Charges and it will return 10 by default
sorry I'm still really confused on what the problem is right now
How to get all transactions instead of only 10
May be I am not using the right end point? Please direct me the right way
These are the endpoints I am using
Can you please educate me with an example, how to paginate
We have List APIs. They return 10 objects at once. And then as a developer you write a loop that will get the next page and the next page until you are done. This requires custom logic/code. And it's explained on the exact doc I shared: https://stripe.com/docs/api/pagination
does that make sense?
Hmm, yes it make sense. Does it also have a date filters to get certain date range or kind of incremental?
Are there any other API's other than list apis' which can return everything? or with only last 24 hour data
A sample code will be very helpful. I use microsoft Azure tools only
yes there are date filters, all documented really in the API Reference. And no there are no API to dump everything.
I don't have code examples sorry I have never heard of your interface but our API reference also has clear examples for all languages we support like .NET maybe for your environment
So if I understand correctly, we have to put code around these api's if we need more than 10 records of data
To make it clear, I want to extract data from stripe for my company and create a report on that data(could be balance, transactions, charges, payments ...)
yes you have to paginate